Nov 08 23:11:24 user nova-compute[75045]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_linux_bridge.linux_bridge.LinuxBridgePlugin'>' with name 'linux_bridge' {{(pid=75045) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Nov 08 23:11:24 user nova-compute[75045]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_noop.noop.NoOpPlugin'>' with name 'noop' {{(pid=75045) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Nov 08 23:11:24 user nova-compute[75045]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_ovs.ovs.OvsPlugin'>' with name 'ovs' {{(pid=75045) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Nov 08 23:11:24 user nova-compute[75045]: INFO os_vif [-] Loaded VIF plugins: linux_bridge, noop, ovs
Nov 08 23:11:24 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): grep -F node.session.scan /sbin/iscsiadm {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:11:24 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "grep -F node.session.scan /sbin/iscsiadm" returned: 0 in 0.018s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:11:25 user nova-compute[75045]: INFO nova.virt.driver [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] Loading compute driver 'libvirt.LibvirtDriver'
Nov 08 23:11:25 user nova-compute[75045]: INFO nova.compute.provider_config [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] No provider configs found in /etc/nova/provider_config/. If files are present, ensure the Nova process has access.
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] Acquiring lock "singleton_lock" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] Acquired lock "singleton_lock" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] Releasing lock "singleton_lock" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] Full set of CONF: {{(pid=75045) _wait_for_exit_or_signal /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/service.py:362}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] ******************************************************************************** {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2589}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] Configuration options gathered from: {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2590}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] command line args: ['--config-file', '/etc/nova/nova-cpu.conf'] {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2591}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] config files: ['/etc/nova/nova-cpu.conf'] {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2592}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] ================================================================================ {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2594}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] allow_resize_to_same_host      = True {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] arq_binding_timeout            = 300 {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] backdoor_port                  = None {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] backdoor_socket                = None {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] block_device_allocate_retries  = 300 {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] block_device_allocate_retries_interval = 5 {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] cert                           = self.pem {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] compute_driver                 = libvirt.LibvirtDriver {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] compute_monitors               = [] {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] config_dir                     = [] {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] config_drive_format            = iso9660 {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] config_file                    = ['/etc/nova/nova-cpu.conf'] {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] config_source                  = [] {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] console_host                   = user {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] control_exchange               = nova {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] cpu_allocation_ratio           = None {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] daemon                         = False {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] debug                          = True {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] default_access_ip_network_name = None {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] default_availability_zone      = nova {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] default_ephemeral_format       = ext4 {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] default_green_pool_size        = 1000 {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] default_schedule_zone          = None {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] disk_allocation_ratio          = None {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] enable_new_services            = True {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] enabled_apis                   = ['osapi_compute'] {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] enabled_ssl_apis               = [] {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] flat_injected                  = False {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] force_config_drive             = False {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] force_raw_images               = True {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] graceful_shutdown_timeout      = 5 {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] heal_instance_info_cache_interval = 60 {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] host                           = user {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] initial_cpu_allocation_ratio   = 4.0 {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] initial_disk_allocation_ratio  = 1.0 {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] initial_ram_allocation_ratio   = 1.0 {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] injected_network_template      = /opt/stack/nova/nova/virt/interfaces.template {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] instance_build_timeout         = 0 {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] instance_delete_interval       = 300 {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] instance_format                = [instance: %(uuid)s]  {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] instance_name_template         = instance-%08x {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] instance_usage_audit           = False {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] instance_usage_audit_period    = month {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] instances_path                 = /opt/stack/data/nova/instances {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] internal_service_availability_zone = internal {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] key                            = None {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] live_migration_retry_count     = 30 {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] log_config_append              = None {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] log_dir                        = None {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] log_file                       = None {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] log_options                    = True {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] log_rotate_interval            = 1 {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] log_rotate_interval_type       = days {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] log_rotation_type              = none {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] long_rpc_timeout               = 1800 {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] max_concurrent_builds          = 10 {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] max_concurrent_live_migrations = 1 {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] max_concurrent_snapshots       = 5 {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] max_local_block_devices        = 3 {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] max_logfile_count              = 30 {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] max_logfile_size_mb            = 200 {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] maximum_instance_delete_attempts = 5 {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] metadata_listen                = 0.0.0.0 {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] metadata_listen_port           = 8775 {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] metadata_workers               = 3 {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] migrate_max_retries            = -1 {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] mkisofs_cmd                    = genisoimage {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] my_block_storage_ip            = 10.0.0.210 {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] my_ip                          = 10.0.0.210 {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] network_allocate_retries       = 0 {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] osapi_compute_listen           = 0.0.0.0 {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] osapi_compute_listen_port      = 8774 {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] osapi_compute_unique_server_name_scope =  {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] osapi_compute_workers          = 3 {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] password_length                = 12 {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] periodic_enable                = True {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] periodic_fuzzy_delay           = 60 {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] pointer_model                  = ps2mouse {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] preallocate_images             = none {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] publish_errors                 = False {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] pybasedir                      = /opt/stack/nova {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] ram_allocation_ratio           = None {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] rate_limit_burst               = 0 {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] rate_limit_except_level        = CRITICAL {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] rate_limit_interval            = 0 {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] reboot_timeout                 = 0 {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] reclaim_instance_interval      = 0 {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] record                         = None {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] reimage_timeout_per_gb         = 60 {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] report_interval                = 120 {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] rescue_timeout                 = 0 {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] reserved_host_cpus             = 0 {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] reserved_host_disk_mb          = 0 {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] reserved_host_memory_mb        = 512 {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] reserved_huge_pages            = None {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] resize_confirm_window          = 0 {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] resize_fs_using_block_device   = False {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] resume_guests_state_on_host_boot = False {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] rootwrap_config                = /etc/nova/rootwrap.conf {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] rpc_response_timeout           = 60 {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] run_external_periodic_tasks    = True {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] running_deleted_instance_action = reap {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] running_deleted_instance_poll_interval = 1800 {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] running_deleted_instance_timeout = 0 {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] scheduler_instance_sync_interval = 120 {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] service_down_time              = 720 {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] servicegroup_driver            = db {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] shelved_offload_time           = 0 {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] shelved_poll_interval          = 3600 {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] shutdown_timeout               = 0 {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] source_is_ipv6                 = False {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] ssl_only                       = False {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] state_path                     = /opt/stack/data/nova {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] sync_power_state_interval      = 600 {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] sync_power_state_pool_size     = 1000 {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] syslog_log_facility            = LOG_USER {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] tempdir                        = None {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] timeout_nbd                    = 10 {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] transport_url                  = **** {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] update_resources_interval      = 0 {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] use_cow_images                 = True {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] use_eventlog                   = False {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] use_journal                    = False {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] use_json                       = False {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] use_rootwrap_daemon            = False {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] use_stderr                     = False {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] use_syslog                     = False {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] vcpu_pin_set                   = None {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] vif_plugging_is_fatal          = False {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] vif_plugging_timeout           = 0 {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] virt_mkfs                      = [] {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] volume_usage_poll_interval     = 0 {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] watch_log_file                 = False {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] web                            = /usr/share/spice-html5 {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] oslo_concurrency.disable_process_locking = False {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] oslo_concurrency.lock_path     = /opt/stack/data/nova {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] api.auth_strategy              = keystone {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] api.compute_link_prefix        = None {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] api.dhcp_domain                = novalocal {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] api.enable_instance_password   = True {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] api.glance_link_prefix         = None {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] api.instance_list_cells_batch_fixed_size = 100 {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] api.instance_list_cells_batch_strategy = distributed {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] api.instance_list_per_project_cells = False {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] api.list_records_by_skipping_down_cells = True {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] api.local_metadata_per_cell    = False {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] api.max_limit                  = 1000 {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] api.metadata_cache_expiration  = 15 {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] api.neutron_default_tenant_id  = default {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] api.use_forwarded_for          = False {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] api.use_neutron_default_nets   = False {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] api.vendordata_dynamic_connect_timeout = 5 {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] api.vendordata_dynamic_failure_fatal = False {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] api.vendordata_dynamic_read_timeout = 5 {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] api.vendordata_dynamic_ssl_certfile =  {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] api.vendordata_dynamic_targets = [] {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] api.vendordata_jsonfile_path   = None {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] api.vendordata_providers       = ['StaticJSON'] {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] cache.backend                  = dogpile.cache.memcached {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] cache.backend_argument         = **** {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] cache.config_prefix            = cache.oslo {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] cache.dead_timeout             = 60.0 {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] cache.debug_cache_backend      = False {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] cache.enable_retry_client      = False {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] cache.enable_socket_keepalive  = False {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] cache.enabled                  = True {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] cache.expiration_time          = 600 {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] cache.hashclient_retry_attempts = 2 {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] cache.hashclient_retry_delay   = 1.0 {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] cache.memcache_dead_retry      = 300 {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] cache.memcache_password        =  {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] cache.memcache_pool_maxsize    = 10 {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] cache.memcache_pool_unused_timeout = 60 {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] cache.memcache_sasl_enabled    = False {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] cache.memcache_socket_timeout  = 1.0 {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] cache.memcache_username        =  {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] cache.proxies                  = [] {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] cache.retry_attempts           = 2 {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] cache.retry_delay              = 0.0 {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] cache.socket_keepalive_count   = 1 {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] cache.socket_keepalive_idle    = 1 {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] cache.socket_keepalive_interval = 1 {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] cache.tls_allowed_ciphers      = None {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] cache.tls_cafile               = None {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] cache.tls_certfile             = None {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] cache.tls_enabled              = False {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] cache.tls_keyfile              = None {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] cinder.auth_section            = None {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] cinder.auth_type               = password {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] cinder.cafile                  = None {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] cinder.catalog_info            = volumev3::publicURL {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] cinder.certfile                = None {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] cinder.collect_timing          = False {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] cinder.cross_az_attach         = True {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] cinder.debug                   = False {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] cinder.endpoint_template       = None {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] cinder.http_retries            = 3 {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] cinder.insecure                = False {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] cinder.keyfile                 = None {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] cinder.os_region_name          = RegionOne {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] cinder.split_loggers           = False {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] cinder.timeout                 = None {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] compute.consecutive_build_service_disable_threshold = 10 {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] compute.cpu_dedicated_set      = None {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] compute.cpu_shared_set         = None {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] compute.image_type_exclude_list = [] {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] compute.live_migration_wait_for_vif_plug = True {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] compute.max_concurrent_disk_ops = 0 {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] compute.max_disk_devices_to_attach = -1 {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] compute.resource_provider_association_refresh = 300 {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] compute.shutdown_retry_interval = 10 {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] compute.vmdk_allowed_types     = ['streamOptimized', 'monolithicSparse'] {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] conductor.workers              = 3 {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] console.allowed_origins        = [] {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] console.ssl_ciphers            = None {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] console.ssl_minimum_version    = default {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] consoleauth.token_ttl          = 600 {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] cyborg.cafile                  = None {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] cyborg.certfile                = None {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] cyborg.collect_timing          = False {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] cyborg.connect_retries         = None {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] cyborg.connect_retry_delay     = None {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] cyborg.endpoint_override       = None {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] cyborg.insecure                = False {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] cyborg.keyfile                 = None {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] cyborg.max_version             = None {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] cyborg.min_version             = None {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] cyborg.region_name             = None {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] cyborg.service_name            = None {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] cyborg.service_type            = accelerator {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] cyborg.split_loggers           = False {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] cyborg.status_code_retries     = None {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] cyborg.status_code_retry_delay = None {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] cyborg.timeout                 = None {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] cyborg.valid_interfaces        = ['internal', 'public'] {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] cyborg.version                 = None {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] database.backend               = sqlalchemy {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] database.connection            = **** {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] database.connection_debug      = 0 {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] database.connection_parameters =  {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] database.connection_recycle_time = 3600 {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] database.connection_trace      = False {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] database.db_inc_retry_interval = True {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] database.db_max_retries        = 20 {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] database.db_max_retry_interval = 10 {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] database.db_retry_interval     = 1 {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] database.max_overflow          = 50 {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] database.max_pool_size         = 5 {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] database.max_retries           = 10 {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] database.mysql_wsrep_sync_wait = None {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] database.pool_timeout          = None {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] database.retry_interval        = 10 {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] database.slave_connection      = **** {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] database.sqlite_synchronous    = True {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] api_database.backend           = sqlalchemy {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] api_database.connection        = **** {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] api_database.connection_debug  = 0 {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] api_database.connection_parameters =  {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] api_database.connection_recycle_time = 3600 {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] api_database.connection_trace  = False {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] api_database.db_inc_retry_interval = True {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] api_database.db_max_retries    = 20 {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] api_database.db_max_retry_interval = 10 {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] api_database.db_retry_interval = 1 {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] api_database.max_overflow      = 50 {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] api_database.max_pool_size     = 5 {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] api_database.max_retries       = 10 {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] api_database.mysql_sql_mode    = TRADITIONAL {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] api_database.mysql_wsrep_sync_wait = None {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] api_database.pool_timeout      = None {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] api_database.retry_interval    = 10 {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] api_database.slave_connection  = **** {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] api_database.sqlite_synchronous = True {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] devices.enabled_mdev_types     = [] {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] ephemeral_storage_encryption.enabled = False {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] ephemeral_storage_encryption.key_size = 512 {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] glance.api_servers             = None {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] glance.cafile                  = None {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] glance.certfile                = None {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] glance.collect_timing          = False {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] glance.connect_retries         = None {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] glance.connect_retry_delay     = None {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] glance.debug                   = False {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] glance.default_trusted_certificate_ids = [] {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] glance.enable_certificate_validation = False {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] glance.enable_rbd_download     = False {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] glance.endpoint_override       = None {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] glance.insecure                = False {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] glance.keyfile                 = None {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] glance.max_version             = None {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] glance.min_version             = None {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] glance.num_retries             = 3 {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] glance.rbd_ceph_conf           =  {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] glance.rbd_connect_timeout     = 5 {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] glance.rbd_pool                =  {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] glance.rbd_user                =  {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] glance.region_name             = None {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] glance.service_name            = None {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] glance.service_type            = image {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] glance.split_loggers           = False {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] glance.status_code_retries     = None {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] glance.status_code_retry_delay = None {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] glance.timeout                 = None {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] glance.valid_interfaces        = ['internal', 'public'] {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] glance.verify_glance_signatures = False {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] glance.version                 = None {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] guestfs.debug                  = False {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] hyperv.config_drive_cdrom      = False {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] hyperv.config_drive_inject_password = False {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] hyperv.dynamic_memory_ratio    = 1.0 {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] hyperv.enable_instance_metrics_collection = False {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] hyperv.enable_remotefx         = False {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] hyperv.instances_path_share    =  {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] hyperv.iscsi_initiator_list    = [] {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] hyperv.limit_cpu_features      = False {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] hyperv.mounted_disk_query_retry_count = 10 {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] hyperv.power_state_check_timeframe = 60 {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] hyperv.power_state_event_polling_interval = 2 {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] hyperv.qemu_img_cmd            = qemu-img.exe {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] hyperv.use_multipath_io        = False {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] hyperv.volume_attach_retry_count = 10 {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] hyperv.volume_attach_retry_interval = 5 {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] hyperv.vswitch_name            = None {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] hyperv.wait_soft_reboot_seconds = 60 {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] mks.enabled                    = False {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] mks.mksproxy_base_url          = http://127.0.0.1:6090/ {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] image_cache.manager_interval   = 2400 {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] image_cache.precache_concurrency = 1 {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] image_cache.remove_unused_base_images = True {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] image_cache.subdirectory_name  = _base {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] ironic.api_max_retries         = 60 {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] ironic.api_retry_interval      = 2 {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] ironic.auth_section            = None {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] ironic.auth_type               = None {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] ironic.cafile                  = None {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] ironic.certfile                = None {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] ironic.collect_timing          = False {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] ironic.conductor_group         = None {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] ironic.connect_retries         = None {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] ironic.connect_retry_delay     = None {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] ironic.endpoint_override       = None {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] ironic.insecure                = False {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] ironic.keyfile                 = None {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] ironic.max_version             = None {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] ironic.min_version             = None {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] ironic.peer_list               = [] {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] ironic.region_name             = None {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] ironic.serial_console_state_timeout = 10 {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] ironic.service_name            = None {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] ironic.service_type            = baremetal {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] ironic.split_loggers           = False {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] ironic.status_code_retries     = None {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] ironic.status_code_retry_delay = None {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] ironic.timeout                 = None {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] ironic.valid_interfaces        = ['internal', 'public'] {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] ironic.version                 = None {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] key_manager.backend            = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] key_manager.fixed_key          = **** {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] barbican.barbican_api_version  = None {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] barbican.barbican_endpoint     = None {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] barbican.barbican_endpoint_type = public {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] barbican.barbican_region_name  = None {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] barbican.cafile                = None {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] barbican.certfile              = None {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] barbican.collect_timing        = False {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] barbican.insecure              = False {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] barbican.keyfile               = None {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] barbican.number_of_retries     = 60 {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] barbican.retry_delay           = 1 {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] barbican.send_service_user_token = False {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] barbican.split_loggers         = False {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] barbican.timeout               = None {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] barbican.verify_ssl            = True {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] barbican.verify_ssl_path       = None {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] barbican_service_user.auth_section = None {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] barbican_service_user.auth_type = None {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] barbican_service_user.cafile   = None {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] barbican_service_user.certfile = None {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] barbican_service_user.collect_timing = False {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] barbican_service_user.insecure = False {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] barbican_service_user.keyfile  = None {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] barbican_service_user.split_loggers = False {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] barbican_service_user.timeout  = None {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] vault.approle_role_id          = None {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] vault.approle_secret_id        = None {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] vault.cafile                   = None {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] vault.certfile                 = None {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] vault.collect_timing           = False {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] vault.insecure                 = False {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] vault.keyfile                  = None {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] vault.kv_mountpoint            = secret {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] vault.kv_path                  = None {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] vault.kv_version               = 2 {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] vault.namespace                = None {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] vault.root_token_id            = None {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] vault.split_loggers            = False {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] vault.ssl_ca_crt_file          = None {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] vault.timeout                  = None {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] vault.use_ssl                  = False {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] keystone.auth_section          = None {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] keystone.auth_type             = None {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] keystone.cafile                = None {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] keystone.certfile              = None {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] keystone.collect_timing        = False {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] keystone.connect_retries       = None {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] keystone.connect_retry_delay   = None {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] keystone.endpoint_override     = None {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] keystone.insecure              = False {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] keystone.keyfile               = None {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] keystone.max_version           = None {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] keystone.min_version           = None {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] keystone.region_name           = None {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] keystone.service_name          = None {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] keystone.service_type          = identity {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] keystone.split_loggers         = False {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] keystone.status_code_retries   = None {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] keystone.status_code_retry_delay = None {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] keystone.timeout               = None {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] keystone.valid_interfaces      = ['internal', 'public'] {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] keystone.version               = None {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] libvirt.connection_uri         =  {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] libvirt.cpu_mode               = custom {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] libvirt.cpu_model_extra_flags  = [] {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: WARNING oslo_config.cfg [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt".
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] libvirt.cpu_models             = ['Nehalem'] {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] libvirt.cpu_power_governor_high = performance {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] libvirt.cpu_power_governor_low = powersave {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] libvirt.cpu_power_management   = False {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] libvirt.cpu_power_management_strategy = cpu_state {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] libvirt.device_detach_attempts = 8 {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] libvirt.device_detach_timeout  = 20 {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] libvirt.disk_cachemodes        = [] {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] libvirt.disk_prefix            = None {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] libvirt.enabled_perf_events    = [] {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] libvirt.file_backed_memory     = 0 {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] libvirt.gid_maps               = [] {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] libvirt.hw_disk_discard        = None {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] libvirt.hw_machine_type        = None {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] libvirt.images_rbd_ceph_conf   =  {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] libvirt.images_rbd_glance_store_name =  {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] libvirt.images_rbd_pool        = rbd {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] libvirt.images_type            = default {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] libvirt.images_volume_group    = None {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] libvirt.inject_key             = False {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] libvirt.inject_partition       = -2 {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] libvirt.inject_password        = False {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] libvirt.iscsi_iface            = None {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] libvirt.iser_use_multipath     = False {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] libvirt.live_migration_bandwidth = 0 {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] libvirt.live_migration_completion_timeout = 800 {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] libvirt.live_migration_downtime = 500 {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] libvirt.live_migration_downtime_delay = 75 {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] libvirt.live_migration_downtime_steps = 10 {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] libvirt.live_migration_inbound_addr = None {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] libvirt.live_migration_permit_auto_converge = False {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] libvirt.live_migration_permit_post_copy = False {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] libvirt.live_migration_scheme  = None {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] libvirt.live_migration_timeout_action = abort {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] libvirt.live_migration_tunnelled = False {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: WARNING oslo_config.cfg [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal (
Nov 08 23:11:25 user nova-compute[75045]: live_migration_uri is deprecated for removal in favor of two other options that
Nov 08 23:11:25 user nova-compute[75045]: allow to change live migration scheme and target URI: ``live_migration_scheme``
Nov 08 23:11:25 user nova-compute[75045]: and ``live_migration_inbound_addr`` respectively.
Nov 08 23:11:25 user nova-compute[75045]: ).  Its value may be silently ignored in the future.
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] libvirt.live_migration_uri     = qemu+ssh://stack@%s/system {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] libvirt.live_migration_with_native_tls = False {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] libvirt.max_queues             = None {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] libvirt.mem_stats_period_seconds = 10 {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] libvirt.nfs_mount_options      = None {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] libvirt.nfs_mount_point_base   = /opt/stack/data/nova/mnt {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] libvirt.num_aoe_discover_tries = 3 {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] libvirt.num_iser_scan_tries    = 5 {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] libvirt.num_memory_encrypted_guests = None {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] libvirt.num_nvme_discover_tries = 5 {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] libvirt.num_pcie_ports         = 0 {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] libvirt.num_volume_scan_tries  = 5 {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] libvirt.pmem_namespaces        = [] {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] libvirt.quobyte_client_cfg     = None {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] libvirt.rbd_connect_timeout    = 5 {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] libvirt.rbd_destroy_volume_retries = 12 {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] libvirt.rbd_secret_uuid        = None {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] libvirt.rbd_user               = None {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] libvirt.realtime_scheduler_priority = 1 {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] libvirt.remote_filesystem_transport = ssh {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] libvirt.rescue_image_id        = None {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] libvirt.rescue_kernel_id       = None {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] libvirt.rescue_ramdisk_id      = None {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] libvirt.rng_dev_path           = /dev/urandom {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] libvirt.rx_queue_size          = None {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] libvirt.smbfs_mount_options    =  {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] libvirt.snapshot_compression   = False {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] libvirt.snapshot_image_format  = None {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] libvirt.snapshots_directory    = /opt/stack/data/nova/instances/snapshots {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] libvirt.sparse_logical_volumes = False {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] libvirt.swtpm_enabled          = False {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] libvirt.swtpm_group            = tss {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] libvirt.swtpm_user             = tss {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] libvirt.sysinfo_serial         = unique {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] libvirt.tb_cache_size          = None {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] libvirt.tx_queue_size          = None {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] libvirt.uid_maps               = [] {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] libvirt.use_virtio_for_bridges = True {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] libvirt.virt_type              = kvm {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] libvirt.volume_clear           = zero {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] libvirt.volume_clear_size      = 0 {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] libvirt.volume_use_multipath   = False {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] libvirt.vzstorage_cache_path   = None {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] libvirt.vzstorage_log_path     = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] libvirt.vzstorage_mount_group  = qemu {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] libvirt.vzstorage_mount_opts   = [] {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] libvirt.vzstorage_mount_perms  = 0770 {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] libvirt.vzstorage_mount_user   = stack {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] libvirt.wait_soft_reboot_seconds = 120 {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] neutron.auth_section           = None {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] neutron.auth_type              = password {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] neutron.cafile                 = None {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] neutron.certfile               = None {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] neutron.collect_timing         = False {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] neutron.connect_retries        = None {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] neutron.connect_retry_delay    = None {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] neutron.default_floating_pool  = public {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] neutron.endpoint_override      = None {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] neutron.extension_sync_interval = 600 {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] neutron.http_retries           = 3 {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] neutron.insecure               = False {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] neutron.keyfile                = None {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] neutron.max_version            = None {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] neutron.metadata_proxy_shared_secret = **** {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] neutron.min_version            = None {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] neutron.ovs_bridge             = br-int {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] neutron.physnets               = [] {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] neutron.region_name            = RegionOne {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] neutron.service_metadata_proxy = True {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] neutron.service_name           = None {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] neutron.service_type           = network {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] neutron.split_loggers          = False {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] neutron.status_code_retries    = None {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] neutron.status_code_retry_delay = None {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] neutron.timeout                = None {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] neutron.valid_interfaces       = ['internal', 'public'] {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] neutron.version                = None {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] notifications.bdms_in_notifications = False {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] notifications.default_level    = INFO {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] notifications.notification_format = unversioned {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] notifications.notify_on_state_change = None {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] pci.alias                      = [] {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] pci.device_spec                = [] {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] pci.report_in_placement        = False {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] placement.auth_section         = None {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] placement.auth_type            = password {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] placement.auth_url             = http://10.0.0.210/identity {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] placement.cafile               = None {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] placement.certfile             = None {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] placement.collect_timing       = False {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] placement.connect_retries      = None {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] placement.connect_retry_delay  = None {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] placement.default_domain_id    = None {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] placement.default_domain_name  = None {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] placement.domain_id            = None {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] placement.domain_name          = None {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] placement.endpoint_override    = None {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] placement.insecure             = False {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] placement.keyfile              = None {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] placement.max_version          = None {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] placement.min_version          = None {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] placement.password             = **** {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] placement.project_domain_id    = None {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] placement.project_domain_name  = Default {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] placement.project_id           = None {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] placement.project_name         = service {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] placement.region_name          = RegionOne {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] placement.service_name         = None {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] placement.service_type         = placement {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] placement.split_loggers        = False {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] placement.status_code_retries  = None {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] placement.status_code_retry_delay = None {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] placement.system_scope         = None {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] placement.timeout              = None {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] placement.trust_id             = None {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] placement.user_domain_id       = None {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] placement.user_domain_name     = Default {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] placement.user_id              = None {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] placement.username             = placement {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] placement.valid_interfaces     = ['internal', 'public'] {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] placement.version              = None {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] quota.cores                    = 20 {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] quota.count_usage_from_placement = False {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] quota.driver                   = nova.quota.DbQuotaDriver {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] quota.injected_file_content_bytes = 10240 {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] quota.injected_file_path_length = 255 {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] quota.injected_files           = 5 {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] quota.instances                = 10 {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] quota.key_pairs                = 100 {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] quota.metadata_items           = 128 {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] quota.ram                      = 51200 {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] quota.recheck_quota            = True {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] quota.server_group_members     = 10 {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] quota.server_groups            = 10 {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] rdp.enabled                    = False {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] rdp.html5_proxy_base_url       = http://127.0.0.1:6083/ {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] scheduler.enable_isolated_aggregate_filtering = False {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] scheduler.image_metadata_prefilter = False {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] scheduler.max_attempts         = 3 {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] scheduler.max_placement_results = 1000 {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] scheduler.placement_aggregate_required_for_tenants = False {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] scheduler.query_placement_for_image_type_support = False {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] scheduler.workers              = 3 {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] filter_scheduler.enabled_filters = ['ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] filter_scheduler.host_subset_size = 1 {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] filter_scheduler.hypervisor_version_weight_multiplier = 1.0 {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] filter_scheduler.image_properties_default_architecture = None {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] filter_scheduler.isolated_hosts = [] {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] filter_scheduler.isolated_images = [] {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] filter_scheduler.max_instances_per_host = 50 {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] filter_scheduler.max_io_ops_per_host = 8 {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] filter_scheduler.num_instances_weight_multiplier = 0.0 {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] filter_scheduler.pci_in_placement = False {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] filter_scheduler.track_instance_changes = False {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] metrics.required               = True {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] metrics.weight_multiplier      = 1.0 {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] metrics.weight_of_unavailable  = -10000.0 {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] metrics.weight_setting         = [] {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] serial_console.base_url        = ws://127.0.0.1:6083/ {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] serial_console.enabled         = False {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] serial_console.port_range      = 10000:20000 {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] serial_console.proxyclient_address = 127.0.0.1 {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] serial_console.serialproxy_host = 0.0.0.0 {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] serial_console.serialproxy_port = 6083 {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] service_user.auth_section      = None {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] service_user.auth_type         = password {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] service_user.cafile            = None {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] service_user.certfile          = None {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] service_user.collect_timing    = False {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] service_user.insecure          = False {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] service_user.keyfile           = None {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] service_user.send_service_user_token = True {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] service_user.split_loggers     = False {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] service_user.timeout           = None {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] spice.agent_enabled            = True {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] spice.enabled                  = False {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] spice.html5proxy_base_url      = http://10.0.0.210:6081/spice_auto.html {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] spice.html5proxy_host          = 0.0.0.0 {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] spice.html5proxy_port          = 6082 {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] spice.image_compression        = None {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] spice.jpeg_compression         = None {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] spice.playback_compression     = None {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] spice.server_listen            = 127.0.0.1 {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] spice.server_proxyclient_address = 127.0.0.1 {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] spice.streaming_mode           = None {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] spice.zlib_compression         = None {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] upgrade_levels.baseapi         = None {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] upgrade_levels.cert            = None {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] upgrade_levels.compute         = auto {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] upgrade_levels.conductor       = None {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] upgrade_levels.scheduler       = None {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] vendordata_dynamic_auth.auth_section = None {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] vendordata_dynamic_auth.auth_type = None {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] vendordata_dynamic_auth.cafile = None {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] vendordata_dynamic_auth.certfile = None {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] vendordata_dynamic_auth.collect_timing = False {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] vendordata_dynamic_auth.insecure = False {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] vendordata_dynamic_auth.keyfile = None {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] vendordata_dynamic_auth.split_loggers = False {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] vendordata_dynamic_auth.timeout = None {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] vmware.api_retry_count         = 10 {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] vmware.ca_file                 = None {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] vmware.cache_prefix            = None {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] vmware.cluster_name            = None {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] vmware.connection_pool_size    = 10 {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] vmware.console_delay_seconds   = None {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] vmware.datastore_regex         = None {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] vmware.host_ip                 = None {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] vmware.host_password           = **** {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] vmware.host_port               = 443 {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] vmware.host_username           = None {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] vmware.insecure                = False {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] vmware.integration_bridge      = None {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] vmware.maximum_objects         = 100 {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] vmware.pbm_default_policy      = None {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] vmware.pbm_enabled             = False {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] vmware.pbm_wsdl_location       = None {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] vmware.serial_log_dir          = /opt/vmware/vspc {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] vmware.serial_port_proxy_uri   = None {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] vmware.serial_port_service_uri = None {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] vmware.task_poll_interval      = 0.5 {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] vmware.use_linked_clone        = True {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] vmware.vnc_keymap              = en-us {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] vmware.vnc_port                = 5900 {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] vmware.vnc_port_total          = 10000 {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] vnc.auth_schemes               = ['none'] {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] vnc.enabled                    = True {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] vnc.novncproxy_base_url        = http://10.0.0.210:6080/vnc_lite.html {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] vnc.novncproxy_host            = 0.0.0.0 {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] vnc.novncproxy_port            = 6080 {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] vnc.server_listen              = 0.0.0.0 {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] vnc.server_proxyclient_address = 10.0.0.210 {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] vnc.vencrypt_ca_certs          = None {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] vnc.vencrypt_client_cert       = None {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] vnc.vencrypt_client_key        = None {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] workarounds.disable_compute_service_check_for_ffu = False {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] workarounds.disable_fallback_pcpu_query = False {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] workarounds.disable_group_policy_check_upcall = True {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] workarounds.disable_libvirt_livesnapshot = False {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] workarounds.disable_rootwrap   = False {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] workarounds.enable_numa_live_migration = False {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] workarounds.enable_qemu_monitor_announce_self = False {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] workarounds.handle_virt_lifecycle_events = True {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] workarounds.libvirt_disable_apic = False {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] workarounds.never_download_image_if_on_rbd = False {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] workarounds.skip_cpu_compare_at_startup = False {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] workarounds.skip_cpu_compare_on_dest = False {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] wsgi.api_paste_config          = /etc/nova/api-paste.ini {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] wsgi.client_socket_timeout     = 900 {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] wsgi.default_pool_size         = 1000 {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] wsgi.keep_alive                = True {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] wsgi.max_header_line           = 16384 {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] wsgi.secure_proxy_ssl_header   = None {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] wsgi.ssl_ca_file               = None {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] wsgi.ssl_cert_file             = None {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] wsgi.ssl_key_file              = None {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] wsgi.tcp_keepidle              = 600 {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] wsgi.wsgi_log_format           = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] zvm.ca_file                    = None {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] zvm.cloud_connector_url        = None {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] zvm.image_tmp_path             = /opt/stack/data/nova/images {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] zvm.reachable_timeout          = 300 {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] oslo_policy.enforce_new_defaults = True {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] oslo_policy.enforce_scope      = True {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] oslo_policy.policy_default_rule = default {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] oslo_policy.policy_file        = policy.yaml {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] profiler.connection_string     = messaging:// {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] profiler.enabled               = False {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] profiler.es_doc_type           = notification {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] profiler.es_scroll_size        = 10000 {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] profiler.es_scroll_time        = 2m {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] profiler.filter_error_trace    = False {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] profiler.hmac_keys             = **** {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] profiler.sentinel_service_name = mymaster {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] profiler.socket_timeout        = 0.1 {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] profiler.trace_requests        = False {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] profiler.trace_sqlalchemy      = False {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] profiler_jaeger.process_tags   = {} {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] profiler_jaeger.service_name_prefix = None {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] profiler_otlp.service_name_prefix = None {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] remote_debug.host              = None {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] remote_debug.port              = None {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] oslo_messaging_rabbit.ssl      = False {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] oslo_messaging_rabbit.ssl_version =  {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] oslo_messaging_notifications.retry = -1 {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] oslo_messaging_notifications.transport_url = **** {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] oslo_limit.auth_section        = None {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] oslo_limit.auth_type           = None {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] oslo_limit.cafile              = None {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] oslo_limit.certfile            = None {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] oslo_limit.collect_timing      = False {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] oslo_limit.connect_retries     = None {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] oslo_limit.connect_retry_delay = None {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] oslo_limit.endpoint_id         = None {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] oslo_limit.endpoint_override   = None {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] oslo_limit.insecure            = False {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] oslo_limit.keyfile             = None {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] oslo_limit.max_version         = None {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] oslo_limit.min_version         = None {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] oslo_limit.region_name         = None {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] oslo_limit.service_name        = None {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] oslo_limit.service_type        = None {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] oslo_limit.split_loggers       = False {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] oslo_limit.status_code_retries = None {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] oslo_limit.status_code_retry_delay = None {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] oslo_limit.timeout             = None {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] oslo_limit.valid_interfaces    = None {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] oslo_limit.version             = None {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] oslo_reports.file_event_handler = None {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] oslo_reports.file_event_handler_interval = 1 {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] oslo_reports.log_dir           = None {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] vif_plug_linux_bridge_privileged.capabilities = [12] {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] vif_plug_linux_bridge_privileged.group = None {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] vif_plug_linux_bridge_privileged.helper_command = None {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] vif_plug_linux_bridge_privileged.logger_name = oslo_privsep.daemon {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] vif_plug_linux_bridge_privileged.thread_pool_size = 12 {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] vif_plug_linux_bridge_privileged.user = None {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] vif_plug_ovs_privileged.capabilities = [12, 1] {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] vif_plug_ovs_privileged.group  = None {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] vif_plug_ovs_privileged.helper_command = None {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] vif_plug_ovs_privileged.logger_name = oslo_privsep.daemon {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] vif_plug_ovs_privileged.thread_pool_size = 12 {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] vif_plug_ovs_privileged.user   = None {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] os_vif_linux_bridge.flat_interface = None {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] os_vif_linux_bridge.forward_bridge_interface = ['all'] {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] os_vif_linux_bridge.iptables_bottom_regex =  {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] os_vif_linux_bridge.iptables_drop_action = DROP {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] os_vif_linux_bridge.iptables_top_regex =  {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] os_vif_linux_bridge.network_device_mtu = 1500 {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] os_vif_linux_bridge.use_ipv6   = False {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] os_vif_linux_bridge.vlan_interface = None {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] os_vif_ovs.default_qos_type    = linux-noop {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] os_vif_ovs.isolate_vif         = False {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] os_vif_ovs.network_device_mtu  = 1500 {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] os_vif_ovs.ovs_vsctl_timeout   = 120 {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] os_vif_ovs.ovsdb_connection    = tcp:127.0.0.1:6640 {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] os_vif_ovs.ovsdb_interface     = native {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] os_vif_ovs.per_port_bridge     = False {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] os_brick.lock_path             = None {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] privsep_osbrick.capabilities   = [21] {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] privsep_osbrick.group          = None {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] privsep_osbrick.helper_command = None {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] privsep_osbrick.logger_name    = os_brick.privileged {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] privsep_osbrick.thread_pool_size = 12 {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] privsep_osbrick.user           = None {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] nova_sys_admin.capabilities    = [0, 1, 2, 3, 12, 21] {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] nova_sys_admin.group           = None {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] nova_sys_admin.helper_command  = None {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] nova_sys_admin.logger_name     = oslo_privsep.daemon {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] nova_sys_admin.thread_pool_size = 12 {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] nova_sys_admin.user            = None {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG oslo_service.service [None req-6c0c40c4-c304-471e-a7b7-a17ebdf4c90b None None] ******************************************************************************** {{(pid=75045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}}
Nov 08 23:11:25 user nova-compute[75045]: INFO nova.service [-] Starting compute node (version 0.0.0)
Nov 08 23:11:25 user nova-compute[75045]: DEBUG nova.virt.libvirt.host [None req-b1869e0d-6af1-4bcb-a839-fb2c1c69e58c None None] Connecting to libvirt: qemu:///system {{(pid=75045) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:506}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG nova.virt.libvirt.host [None req-b1869e0d-6af1-4bcb-a839-fb2c1c69e58c None None] Registering for lifecycle events <nova.virt.libvirt.host.Host object at 0x7f1b70a72fe0> {{(pid=75045) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:512}}
Nov 08 23:11:25 user nova-compute[75045]: libvirt:  error : internal error: could not initialize domain event timer
Nov 08 23:11:25 user nova-compute[75045]: WARNING nova.virt.libvirt.host [None req-b1869e0d-6af1-4bcb-a839-fb2c1c69e58c None None] URI qemu:///system does not support events: internal error: could not initialize domain event timer: libvirt.libvirtError: internal error: could not initialize domain event timer
Nov 08 23:11:25 user nova-compute[75045]: DEBUG nova.virt.libvirt.host [None req-b1869e0d-6af1-4bcb-a839-fb2c1c69e58c None None] Registering for connection events: <nova.virt.libvirt.host.Host object at 0x7f1b70a72fe0> {{(pid=75045) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:533}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG nova.virt.libvirt.host [None req-b1869e0d-6af1-4bcb-a839-fb2c1c69e58c None None] Starting native event thread {{(pid=75045) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:492}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG nova.virt.libvirt.host [None req-b1869e0d-6af1-4bcb-a839-fb2c1c69e58c None None] Starting green dispatch thread {{(pid=75045) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:498}}
Nov 08 23:11:25 user nova-compute[75045]: DEBUG nova.virt.libvirt.host [None req-b1869e0d-6af1-4bcb-a839-fb2c1c69e58c None None] Starting connection event dispatch thread {{(pid=75045) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:501}}
Nov 08 23:11:25 user nova-compute[75045]: INFO nova.virt.libvirt.driver [None req-b1869e0d-6af1-4bcb-a839-fb2c1c69e58c None None] Connection event '1' reason 'None'
Nov 08 23:11:25 user nova-compute[75045]: WARNING nova.virt.libvirt.driver [None req-b1869e0d-6af1-4bcb-a839-fb2c1c69e58c None None] Cannot update service status on host "user" since it is not registered.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Nov 08 23:11:25 user nova-compute[75045]: DEBUG nova.virt.libvirt.volume.mount [None req-b1869e0d-6af1-4bcb-a839-fb2c1c69e58c None None] Initialising _HostMountState generation 0 {{(pid=75045) host_up /opt/stack/nova/nova/virt/libvirt/volume/mount.py:130}}
Nov 08 23:11:32 user nova-compute[75045]: INFO nova.virt.libvirt.host [None req-b1869e0d-6af1-4bcb-a839-fb2c1c69e58c None None] Libvirt host capabilities <capabilities>
Nov 08 23:11:32 user nova-compute[75045]:   <host>
Nov 08 23:11:32 user nova-compute[75045]:     <uuid>e20c3142-5af9-7467-ecd8-70b2e4a210d6</uuid>
Nov 08 23:11:32 user nova-compute[75045]:     <cpu>
Nov 08 23:11:32 user nova-compute[75045]:       <arch>x86_64</arch>
Nov 08 23:11:32 user nova-compute[75045]:       <model>IvyBridge-IBRS</model>
Nov 08 23:11:32 user nova-compute[75045]:       <vendor>Intel</vendor>
Nov 08 23:11:32 user nova-compute[75045]:       <microcode version='1070'/>
Nov 08 23:11:32 user nova-compute[75045]:       <counter name='tsc' frequency='2094952000' scaling='no'/>
Nov 08 23:11:32 user nova-compute[75045]:       <topology sockets='6' dies='1' cores='1' threads='1'/>
Nov 08 23:11:32 user nova-compute[75045]:       <feature name='ss'/>
Nov 08 23:11:32 user nova-compute[75045]:       <feature name='vmx'/>
Nov 08 23:11:32 user nova-compute[75045]:       <feature name='pcid'/>
Nov 08 23:11:32 user nova-compute[75045]:       <feature name='osxsave'/>
Nov 08 23:11:32 user nova-compute[75045]:       <feature name='hypervisor'/>
Nov 08 23:11:32 user nova-compute[75045]:       <feature name='arat'/>
Nov 08 23:11:32 user nova-compute[75045]:       <feature name='tsc_adjust'/>
Nov 08 23:11:32 user nova-compute[75045]:       <feature name='md-clear'/>
Nov 08 23:11:32 user nova-compute[75045]:       <feature name='stibp'/>
Nov 08 23:11:32 user nova-compute[75045]:       <feature name='arch-capabilities'/>
Nov 08 23:11:32 user nova-compute[75045]:       <feature name='ssbd'/>
Nov 08 23:11:32 user nova-compute[75045]:       <feature name='invtsc'/>
Nov 08 23:11:32 user nova-compute[75045]:       <feature name='rsba'/>
Nov 08 23:11:32 user nova-compute[75045]:       <feature name='skip-l1dfl-vmentry'/>
Nov 08 23:11:32 user nova-compute[75045]:       <pages unit='KiB' size='4'/>
Nov 08 23:11:32 user nova-compute[75045]:       <pages unit='KiB' size='2048'/>
Nov 08 23:11:32 user nova-compute[75045]:     </cpu>
Nov 08 23:11:32 user nova-compute[75045]:     <power_management>
Nov 08 23:11:32 user nova-compute[75045]:       <suspend_mem/>
Nov 08 23:11:32 user nova-compute[75045]:       <suspend_disk/>
Nov 08 23:11:32 user nova-compute[75045]:       <suspend_hybrid/>
Nov 08 23:11:32 user nova-compute[75045]:     </power_management>
Nov 08 23:11:32 user nova-compute[75045]:     <iommu support='no'/>
Nov 08 23:11:32 user nova-compute[75045]:     <migration_features>
Nov 08 23:11:32 user nova-compute[75045]:       <live/>
Nov 08 23:11:32 user nova-compute[75045]:       <uri_transports>
Nov 08 23:11:32 user nova-compute[75045]:         <uri_transport>tcp</uri_transport>
Nov 08 23:11:32 user nova-compute[75045]:         <uri_transport>rdma</uri_transport>
Nov 08 23:11:32 user nova-compute[75045]:       </uri_transports>
Nov 08 23:11:32 user nova-compute[75045]:     </migration_features>
Nov 08 23:11:32 user nova-compute[75045]:     <topology>
Nov 08 23:11:32 user nova-compute[75045]:       <cells num='2'>
Nov 08 23:11:32 user nova-compute[75045]:         <cell id='0'>
Nov 08 23:11:32 user nova-compute[75045]:           <memory unit='KiB'>8189224</memory>
Nov 08 23:11:32 user nova-compute[75045]:           <pages unit='KiB' size='4'>2047306</pages>
Nov 08 23:11:32 user nova-compute[75045]:           <pages unit='KiB' size='2048'>0</pages>
Nov 08 23:11:32 user nova-compute[75045]:           <distances>
Nov 08 23:11:32 user nova-compute[75045]:             <sibling id='0' value='10'/>
Nov 08 23:11:32 user nova-compute[75045]:             <sibling id='1' value='20'/>
Nov 08 23:11:32 user nova-compute[75045]:           </distances>
Nov 08 23:11:32 user nova-compute[75045]:           <cpus num='6'>
Nov 08 23:11:32 user nova-compute[75045]:             <cpu id='0' socket_id='0' die_id='0' core_id='0' siblings='0'/>
Nov 08 23:11:32 user nova-compute[75045]:             <cpu id='1' socket_id='2' die_id='0' core_id='0' siblings='1'/>
Nov 08 23:11:32 user nova-compute[75045]:             <cpu id='2' socket_id='4' die_id='0' core_id='0' siblings='2'/>
Nov 08 23:11:32 user nova-compute[75045]:             <cpu id='3' socket_id='6' die_id='0' core_id='0' siblings='3'/>
Nov 08 23:11:32 user nova-compute[75045]:             <cpu id='4' socket_id='8' die_id='0' core_id='0' siblings='4'/>
Nov 08 23:11:32 user nova-compute[75045]:             <cpu id='5' socket_id='10' die_id='0' core_id='0' siblings='5'/>
Nov 08 23:11:32 user nova-compute[75045]:           </cpus>
Nov 08 23:11:32 user nova-compute[75045]:         </cell>
Nov 08 23:11:32 user nova-compute[75045]:         <cell id='1'>
Nov 08 23:11:32 user nova-compute[75045]:           <memory unit='KiB'>8206460</memory>
Nov 08 23:11:32 user nova-compute[75045]:           <pages unit='KiB' size='4'>2051615</pages>
Nov 08 23:11:32 user nova-compute[75045]:           <pages unit='KiB' size='2048'>0</pages>
Nov 08 23:11:32 user nova-compute[75045]:           <distances>
Nov 08 23:11:32 user nova-compute[75045]:             <sibling id='0' value='20'/>
Nov 08 23:11:32 user nova-compute[75045]:             <sibling id='1' value='10'/>
Nov 08 23:11:32 user nova-compute[75045]:           </distances>
Nov 08 23:11:32 user nova-compute[75045]:           <cpus num='6'>
Nov 08 23:11:32 user nova-compute[75045]:             <cpu id='6' socket_id='12' die_id='0' core_id='0' siblings='6'/>
Nov 08 23:11:32 user nova-compute[75045]:             <cpu id='7' socket_id='14' die_id='0' core_id='0' siblings='7'/>
Nov 08 23:11:32 user nova-compute[75045]:             <cpu id='8' socket_id='16' die_id='0' core_id='0' siblings='8'/>
Nov 08 23:11:32 user nova-compute[75045]:             <cpu id='9' socket_id='18' die_id='0' core_id='0' siblings='9'/>
Nov 08 23:11:32 user nova-compute[75045]:             <cpu id='10' socket_id='20' die_id='0' core_id='0' siblings='10'/>
Nov 08 23:11:32 user nova-compute[75045]:             <cpu id='11' socket_id='22' die_id='0' core_id='0' siblings='11'/>
Nov 08 23:11:32 user nova-compute[75045]:           </cpus>
Nov 08 23:11:32 user nova-compute[75045]:         </cell>
Nov 08 23:11:32 user nova-compute[75045]:       </cells>
Nov 08 23:11:32 user nova-compute[75045]:     </topology>
Nov 08 23:11:32 user nova-compute[75045]:     <cache>
Nov 08 23:11:32 user nova-compute[75045]:       <bank id='0' level='3' type='both' size='15' unit='MiB' cpus='0'/>
Nov 08 23:11:32 user nova-compute[75045]:       <bank id='2' level='3' type='both' size='15' unit='MiB' cpus='1'/>
Nov 08 23:11:32 user nova-compute[75045]:       <bank id='4' level='3' type='both' size='15' unit='MiB' cpus='2'/>
Nov 08 23:11:32 user nova-compute[75045]:       <bank id='6' level='3' type='both' size='15' unit='MiB' cpus='3'/>
Nov 08 23:11:32 user nova-compute[75045]:       <bank id='8' level='3' type='both' size='15' unit='MiB' cpus='4'/>
Nov 08 23:11:32 user nova-compute[75045]:       <bank id='10' level='3' type='both' size='15' unit='MiB' cpus='5'/>
Nov 08 23:11:32 user nova-compute[75045]:       <bank id='12' level='3' type='both' size='15' unit='MiB' cpus='6'/>
Nov 08 23:11:32 user nova-compute[75045]:       <bank id='14' level='3' type='both' size='15' unit='MiB' cpus='7'/>
Nov 08 23:11:32 user nova-compute[75045]:       <bank id='16' level='3' type='both' size='15' unit='MiB' cpus='8'/>
Nov 08 23:11:32 user nova-compute[75045]:       <bank id='18' level='3' type='both' size='15' unit='MiB' cpus='9'/>
Nov 08 23:11:32 user nova-compute[75045]:       <bank id='20' level='3' type='both' size='15' unit='MiB' cpus='10'/>
Nov 08 23:11:32 user nova-compute[75045]:       <bank id='22' level='3' type='both' size='15' unit='MiB' cpus='11'/>
Nov 08 23:11:32 user nova-compute[75045]:     </cache>
Nov 08 23:11:32 user nova-compute[75045]:     <secmodel>
Nov 08 23:11:32 user nova-compute[75045]:       <model>apparmor</model>
Nov 08 23:11:32 user nova-compute[75045]:       <doi>0</doi>
Nov 08 23:11:32 user nova-compute[75045]:     </secmodel>
Nov 08 23:11:32 user nova-compute[75045]:     <secmodel>
Nov 08 23:11:32 user nova-compute[75045]:       <model>dac</model>
Nov 08 23:11:32 user nova-compute[75045]:       <doi>0</doi>
Nov 08 23:11:32 user nova-compute[75045]:       <baselabel type='kvm'>+64055:+108</baselabel>
Nov 08 23:11:32 user nova-compute[75045]:       <baselabel type='qemu'>+64055:+108</baselabel>
Nov 08 23:11:32 user nova-compute[75045]:     </secmodel>
Nov 08 23:11:32 user nova-compute[75045]:   </host>
Nov 08 23:11:32 user nova-compute[75045]:   <guest>
Nov 08 23:11:32 user nova-compute[75045]:     <os_type>hvm</os_type>
Nov 08 23:11:32 user nova-compute[75045]:     <arch name='alpha'>
Nov 08 23:11:32 user nova-compute[75045]:       <wordsize>64</wordsize>
Nov 08 23:11:32 user nova-compute[75045]:       <emulator>/usr/bin/qemu-system-alpha</emulator>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='4'>clipper</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <domain type='qemu'/>
Nov 08 23:11:32 user nova-compute[75045]:     </arch>
Nov 08 23:11:32 user nova-compute[75045]:     <features>
Nov 08 23:11:32 user nova-compute[75045]:       <cpuselection/>
Nov 08 23:11:32 user nova-compute[75045]:       <deviceboot/>
Nov 08 23:11:32 user nova-compute[75045]:       <disksnapshot default='on' toggle='no'/>
Nov 08 23:11:32 user nova-compute[75045]:     </features>
Nov 08 23:11:32 user nova-compute[75045]:   </guest>
Nov 08 23:11:32 user nova-compute[75045]:   <guest>
Nov 08 23:11:32 user nova-compute[75045]:     <os_type>hvm</os_type>
Nov 08 23:11:32 user nova-compute[75045]:     <arch name='armv6l'>
Nov 08 23:11:32 user nova-compute[75045]:       <wordsize>32</wordsize>
Nov 08 23:11:32 user nova-compute[75045]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='1'>integratorcp</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='2'>ast2600-evb</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='1'>borzoi</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='1'>spitz</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='255'>virt-2.7</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='2'>nuri</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='1'>romulus-bmc</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='512'>virt-3.0</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='512'>virt-5.0</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='2'>npcm750-evb</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='255'>virt-2.10</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='2'>rainier-bmc</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='1'>mps3-an547</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='2'>musca-b1</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='1'>versatileab</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='1'>kzm</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='255'>virt-2.8</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='2'>musca-a</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='512'>virt-3.1</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='512'>virt-5.1</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='2'>smdkc210</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='1'>sx1</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='255'>virt-2.11</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='1'>imx25-pdk</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='255'>virt-2.9</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='4'>orangepi-pc</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='1'>z2</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='512'>virt-5.2</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='1'>tosa</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='1'>mps2-an500</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='255'>virt-2.12</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='2'>mps2-an521</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='4'>sabrelite</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='1'>mps2-an511</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='1'>canon-a1100</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='1'>realview-eb</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='1'>emcraft-sf2</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='1'>realview-pb-a8</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='512'>virt-4.0</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='1'>raspi1ap</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='1'>palmetto-bmc</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='1'>sx1-v1</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='1'>n810</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='1'>g220a-bmc</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='1'>n800</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='2'>tacoma-bmc</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='512'>virt-4.1</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='2'>quanta-gsj</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='1'>versatilepb</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='1'>terrier</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='1'>mainstone</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='512'>virt-4.2</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='2'>mps3-an524</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='2'>kudo-bmc</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='4'>vexpress-a9</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='4'>midway</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='1'>musicpal</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='1'>lm3s811evb</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='1'>lm3s6965evb</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='1'>microbit</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='1'>mps2-an505</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='1'>mps2-an385</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='512'>virt-6.0</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='1'>cubieboard</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='1'>verdex</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='1'>netduino2</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='1'>mps2-an386</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='512'>virt-6.1</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='4'>raspi2b</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='4'>vexpress-a15</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='2'>fuji-bmc</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='512'>virt-6.2</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='1'>cheetah</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='255'>virt-2.6</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='1'>ast2500-evb</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='4'>highbank</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='1'>akita</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='1'>connex</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='1'>netduinoplus2</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='1'>collie</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='1'>raspi0</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <domain type='qemu'/>
Nov 08 23:11:32 user nova-compute[75045]:     </arch>
Nov 08 23:11:32 user nova-compute[75045]:     <features>
Nov 08 23:11:32 user nova-compute[75045]:       <cpuselection/>
Nov 08 23:11:32 user nova-compute[75045]:       <deviceboot/>
Nov 08 23:11:32 user nova-compute[75045]:       <disksnapshot default='on' toggle='no'/>
Nov 08 23:11:32 user nova-compute[75045]:     </features>
Nov 08 23:11:32 user nova-compute[75045]:   </guest>
Nov 08 23:11:32 user nova-compute[75045]:   <guest>
Nov 08 23:11:32 user nova-compute[75045]:     <os_type>hvm</os_type>
Nov 08 23:11:32 user nova-compute[75045]:     <arch name='armv7l'>
Nov 08 23:11:32 user nova-compute[75045]:       <wordsize>32</wordsize>
Nov 08 23:11:32 user nova-compute[75045]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='1'>integratorcp</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='2'>ast2600-evb</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='1'>borzoi</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='1'>spitz</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='255'>virt-2.7</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='2'>nuri</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='1'>romulus-bmc</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='512'>virt-3.0</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='512'>virt-5.0</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='2'>npcm750-evb</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='255'>virt-2.10</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='2'>rainier-bmc</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='1'>mps3-an547</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='2'>musca-b1</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='1'>versatileab</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='1'>kzm</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='255'>virt-2.8</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='2'>musca-a</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='512'>virt-3.1</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='512'>virt-5.1</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='2'>smdkc210</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='1'>sx1</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='255'>virt-2.11</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='1'>imx25-pdk</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='255'>virt-2.9</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='4'>orangepi-pc</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='1'>z2</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='512'>virt-5.2</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='1'>tosa</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='1'>mps2-an500</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='255'>virt-2.12</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='2'>mps2-an521</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='4'>sabrelite</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='1'>mps2-an511</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='1'>canon-a1100</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='1'>realview-eb</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='1'>emcraft-sf2</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='1'>realview-pb-a8</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='512'>virt-4.0</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='1'>raspi1ap</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='1'>palmetto-bmc</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='1'>sx1-v1</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='1'>n810</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='1'>g220a-bmc</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='1'>n800</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='2'>tacoma-bmc</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='512'>virt-4.1</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='2'>quanta-gsj</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='1'>versatilepb</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='1'>terrier</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='1'>mainstone</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='512'>virt-4.2</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='2'>mps3-an524</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='2'>kudo-bmc</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='4'>vexpress-a9</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='4'>midway</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='1'>musicpal</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='1'>lm3s811evb</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='1'>lm3s6965evb</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='1'>microbit</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='1'>mps2-an505</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='1'>mps2-an385</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='512'>virt-6.0</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='1'>cubieboard</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='1'>verdex</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='1'>netduino2</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='1'>mps2-an386</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='512'>virt-6.1</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='4'>raspi2b</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='4'>vexpress-a15</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='2'>fuji-bmc</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='512'>virt-6.2</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='1'>cheetah</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='255'>virt-2.6</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='1'>ast2500-evb</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='4'>highbank</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='1'>akita</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='1'>connex</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='1'>netduinoplus2</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='1'>collie</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='1'>raspi0</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <domain type='qemu'/>
Nov 08 23:11:32 user nova-compute[75045]:     </arch>
Nov 08 23:11:32 user nova-compute[75045]:     <features>
Nov 08 23:11:32 user nova-compute[75045]:       <cpuselection/>
Nov 08 23:11:32 user nova-compute[75045]:       <deviceboot/>
Nov 08 23:11:32 user nova-compute[75045]:       <disksnapshot default='on' toggle='no'/>
Nov 08 23:11:32 user nova-compute[75045]:     </features>
Nov 08 23:11:32 user nova-compute[75045]:   </guest>
Nov 08 23:11:32 user nova-compute[75045]:   <guest>
Nov 08 23:11:32 user nova-compute[75045]:     <os_type>hvm</os_type>
Nov 08 23:11:32 user nova-compute[75045]:     <arch name='aarch64'>
Nov 08 23:11:32 user nova-compute[75045]:       <wordsize>64</wordsize>
Nov 08 23:11:32 user nova-compute[75045]:       <emulator>/usr/bin/qemu-system-aarch64</emulator>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='1'>integratorcp</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='2'>ast2600-evb</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='1'>borzoi</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='1'>spitz</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='255'>virt-2.7</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='2'>nuri</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='1'>romulus-bmc</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='512'>virt-3.0</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='512'>virt-5.0</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='2'>npcm750-evb</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='255'>virt-2.10</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='2'>rainier-bmc</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='1'>mps3-an547</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='255'>virt-2.8</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='2'>musca-b1</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='1'>versatileab</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='1'>kzm</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='2'>musca-a</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='512'>virt-3.1</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='512'>virt-5.1</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='2'>smdkc210</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='1'>sx1</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='255'>virt-2.11</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='1'>imx25-pdk</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='255'>virt-2.9</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='4'>orangepi-pc</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='1'>z2</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='512'>virt-5.2</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='6'>xlnx-zcu102</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='1'>tosa</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='1'>mps2-an500</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='255'>virt-2.12</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='2'>mps2-an521</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='4'>sabrelite</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='1'>mps2-an511</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='1'>canon-a1100</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='1'>realview-eb</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='1'>emcraft-sf2</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='1'>realview-pb-a8</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='512'>sbsa-ref</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='512'>virt-4.0</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='1'>raspi1ap</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='1'>palmetto-bmc</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='1'>sx1-v1</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='1'>n810</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='1'>g220a-bmc</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='1'>n800</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='2'>tacoma-bmc</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='512'>virt-4.1</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='2'>quanta-gsj</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='1'>versatilepb</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='1'>terrier</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='1'>mainstone</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='512'>virt-4.2</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='2'>mps3-an524</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='2'>kudo-bmc</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='4'>vexpress-a9</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='4'>midway</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='1'>musicpal</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='1'>lm3s811evb</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='1'>lm3s6965evb</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='1'>microbit</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='1'>mps2-an505</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='1'>mps2-an385</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='512'>virt-6.0</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='4'>raspi3ap</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='1'>cubieboard</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='1'>verdex</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='1'>netduino2</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='2'>xlnx-versal-virt</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='1'>mps2-an386</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='512'>virt-6.1</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='4'>raspi3b</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='4'>raspi2b</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='4'>vexpress-a15</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='2'>fuji-bmc</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='512'>virt-6.2</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='1'>cheetah</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='255'>virt-2.6</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='1'>ast2500-evb</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='4'>highbank</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='1'>akita</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='1'>connex</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='1'>netduinoplus2</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='1'>collie</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='1'>raspi0</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <domain type='qemu'/>
Nov 08 23:11:32 user nova-compute[75045]:     </arch>
Nov 08 23:11:32 user nova-compute[75045]:     <features>
Nov 08 23:11:32 user nova-compute[75045]:       <acpi default='on' toggle='yes'/>
Nov 08 23:11:32 user nova-compute[75045]:       <cpuselection/>
Nov 08 23:11:32 user nova-compute[75045]:       <deviceboot/>
Nov 08 23:11:32 user nova-compute[75045]:       <disksnapshot default='on' toggle='no'/>
Nov 08 23:11:32 user nova-compute[75045]:     </features>
Nov 08 23:11:32 user nova-compute[75045]:   </guest>
Nov 08 23:11:32 user nova-compute[75045]:   <guest>
Nov 08 23:11:32 user nova-compute[75045]:     <os_type>hvm</os_type>
Nov 08 23:11:32 user nova-compute[75045]:     <arch name='cris'>
Nov 08 23:11:32 user nova-compute[75045]:       <wordsize>32</wordsize>
Nov 08 23:11:32 user nova-compute[75045]:       <emulator>/usr/bin/qemu-system-cris</emulator>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='1'>axis-dev88</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <domain type='qemu'/>
Nov 08 23:11:32 user nova-compute[75045]:     </arch>
Nov 08 23:11:32 user nova-compute[75045]:     <features>
Nov 08 23:11:32 user nova-compute[75045]:       <cpuselection/>
Nov 08 23:11:32 user nova-compute[75045]:       <deviceboot/>
Nov 08 23:11:32 user nova-compute[75045]:       <disksnapshot default='on' toggle='no'/>
Nov 08 23:11:32 user nova-compute[75045]:     </features>
Nov 08 23:11:32 user nova-compute[75045]:   </guest>
Nov 08 23:11:32 user nova-compute[75045]:   <guest>
Nov 08 23:11:32 user nova-compute[75045]:     <os_type>hvm</os_type>
Nov 08 23:11:32 user nova-compute[75045]:     <arch name='i686'>
Nov 08 23:11:32 user nova-compute[75045]:       <wordsize>32</wordsize>
Nov 08 23:11:32 user nova-compute[75045]:       <emulator>/usr/bin/qemu-system-i386</emulator>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='288'>pc-q35-artful</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='1'>x-remote</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='1'>isapc</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='288'>pc-q35-disco</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='288'>pc-q35-impish</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='288'>pc-q35-focal</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='288'>microvm</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <domain type='qemu'/>
Nov 08 23:11:32 user nova-compute[75045]:       <domain type='kvm'/>
Nov 08 23:11:32 user nova-compute[75045]:     </arch>
Nov 08 23:11:32 user nova-compute[75045]:     <features>
Nov 08 23:11:32 user nova-compute[75045]:       <pae/>
Nov 08 23:11:32 user nova-compute[75045]:       <nonpae/>
Nov 08 23:11:32 user nova-compute[75045]:       <acpi default='on' toggle='yes'/>
Nov 08 23:11:32 user nova-compute[75045]:       <apic default='on' toggle='no'/>
Nov 08 23:11:32 user nova-compute[75045]:       <cpuselection/>
Nov 08 23:11:32 user nova-compute[75045]:       <deviceboot/>
Nov 08 23:11:32 user nova-compute[75045]:       <disksnapshot default='on' toggle='no'/>
Nov 08 23:11:32 user nova-compute[75045]:     </features>
Nov 08 23:11:32 user nova-compute[75045]:   </guest>
Nov 08 23:11:32 user nova-compute[75045]:   <guest>
Nov 08 23:11:32 user nova-compute[75045]:     <os_type>hvm</os_type>
Nov 08 23:11:32 user nova-compute[75045]:     <arch name='m68k'>
Nov 08 23:11:32 user nova-compute[75045]:       <wordsize>32</wordsize>
Nov 08 23:11:32 user nova-compute[75045]:       <emulator>/usr/bin/qemu-system-m68k</emulator>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='1'>mcf5208evb</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='1'>an5206</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='1'>virt-6.0</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='1'>q800</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='1'>virt-6.2</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine canonical='virt-6.2' maxCpus='1'>virt</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='1'>next-cube</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='1'>virt-6.1</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <domain type='qemu'/>
Nov 08 23:11:32 user nova-compute[75045]:     </arch>
Nov 08 23:11:32 user nova-compute[75045]:     <features>
Nov 08 23:11:32 user nova-compute[75045]:       <cpuselection/>
Nov 08 23:11:32 user nova-compute[75045]:       <deviceboot/>
Nov 08 23:11:32 user nova-compute[75045]:       <disksnapshot default='on' toggle='no'/>
Nov 08 23:11:32 user nova-compute[75045]:     </features>
Nov 08 23:11:32 user nova-compute[75045]:   </guest>
Nov 08 23:11:32 user nova-compute[75045]:   <guest>
Nov 08 23:11:32 user nova-compute[75045]:     <os_type>hvm</os_type>
Nov 08 23:11:32 user nova-compute[75045]:     <arch name='microblaze'>
Nov 08 23:11:32 user nova-compute[75045]:       <wordsize>32</wordsize>
Nov 08 23:11:32 user nova-compute[75045]:       <emulator>/usr/bin/qemu-system-microblaze</emulator>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='1'>petalogix-ml605</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <domain type='qemu'/>
Nov 08 23:11:32 user nova-compute[75045]:     </arch>
Nov 08 23:11:32 user nova-compute[75045]:     <features>
Nov 08 23:11:32 user nova-compute[75045]:       <cpuselection/>
Nov 08 23:11:32 user nova-compute[75045]:       <deviceboot/>
Nov 08 23:11:32 user nova-compute[75045]:       <disksnapshot default='on' toggle='no'/>
Nov 08 23:11:32 user nova-compute[75045]:     </features>
Nov 08 23:11:32 user nova-compute[75045]:   </guest>
Nov 08 23:11:32 user nova-compute[75045]:   <guest>
Nov 08 23:11:32 user nova-compute[75045]:     <os_type>hvm</os_type>
Nov 08 23:11:32 user nova-compute[75045]:     <arch name='microblazeel'>
Nov 08 23:11:32 user nova-compute[75045]:       <wordsize>32</wordsize>
Nov 08 23:11:32 user nova-compute[75045]:       <emulator>/usr/bin/qemu-system-microblazeel</emulator>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='1'>petalogix-ml605</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <domain type='qemu'/>
Nov 08 23:11:32 user nova-compute[75045]:     </arch>
Nov 08 23:11:32 user nova-compute[75045]:     <features>
Nov 08 23:11:32 user nova-compute[75045]:       <cpuselection/>
Nov 08 23:11:32 user nova-compute[75045]:       <deviceboot/>
Nov 08 23:11:32 user nova-compute[75045]:       <disksnapshot default='on' toggle='no'/>
Nov 08 23:11:32 user nova-compute[75045]:     </features>
Nov 08 23:11:32 user nova-compute[75045]:   </guest>
Nov 08 23:11:32 user nova-compute[75045]:   <guest>
Nov 08 23:11:32 user nova-compute[75045]:     <os_type>hvm</os_type>
Nov 08 23:11:32 user nova-compute[75045]:     <arch name='mips'>
Nov 08 23:11:32 user nova-compute[75045]:       <wordsize>32</wordsize>
Nov 08 23:11:32 user nova-compute[75045]:       <emulator>/usr/bin/qemu-system-mips</emulator>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='16'>malta</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='1'>mipssim</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <domain type='qemu'/>
Nov 08 23:11:32 user nova-compute[75045]:     </arch>
Nov 08 23:11:32 user nova-compute[75045]:     <features>
Nov 08 23:11:32 user nova-compute[75045]:       <cpuselection/>
Nov 08 23:11:32 user nova-compute[75045]:       <deviceboot/>
Nov 08 23:11:32 user nova-compute[75045]:       <disksnapshot default='on' toggle='no'/>
Nov 08 23:11:32 user nova-compute[75045]:     </features>
Nov 08 23:11:32 user nova-compute[75045]:   </guest>
Nov 08 23:11:32 user nova-compute[75045]:   <guest>
Nov 08 23:11:32 user nova-compute[75045]:     <os_type>hvm</os_type>
Nov 08 23:11:32 user nova-compute[75045]:     <arch name='mipsel'>
Nov 08 23:11:32 user nova-compute[75045]:       <wordsize>32</wordsize>
Nov 08 23:11:32 user nova-compute[75045]:       <emulator>/usr/bin/qemu-system-mipsel</emulator>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='16'>malta</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='1'>mipssim</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <domain type='qemu'/>
Nov 08 23:11:32 user nova-compute[75045]:     </arch>
Nov 08 23:11:32 user nova-compute[75045]:     <features>
Nov 08 23:11:32 user nova-compute[75045]:       <cpuselection/>
Nov 08 23:11:32 user nova-compute[75045]:       <deviceboot/>
Nov 08 23:11:32 user nova-compute[75045]:       <disksnapshot default='on' toggle='no'/>
Nov 08 23:11:32 user nova-compute[75045]:     </features>
Nov 08 23:11:32 user nova-compute[75045]:   </guest>
Nov 08 23:11:32 user nova-compute[75045]:   <guest>
Nov 08 23:11:32 user nova-compute[75045]:     <os_type>hvm</os_type>
Nov 08 23:11:32 user nova-compute[75045]:     <arch name='mips64'>
Nov 08 23:11:32 user nova-compute[75045]:       <wordsize>64</wordsize>
Nov 08 23:11:32 user nova-compute[75045]:       <emulator>/usr/bin/qemu-system-mips64</emulator>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='16'>malta</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='1'>mipssim</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='1'>pica61</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='1'>magnum</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <domain type='qemu'/>
Nov 08 23:11:32 user nova-compute[75045]:     </arch>
Nov 08 23:11:32 user nova-compute[75045]:     <features>
Nov 08 23:11:32 user nova-compute[75045]:       <cpuselection/>
Nov 08 23:11:32 user nova-compute[75045]:       <deviceboot/>
Nov 08 23:11:32 user nova-compute[75045]:       <disksnapshot default='on' toggle='no'/>
Nov 08 23:11:32 user nova-compute[75045]:     </features>
Nov 08 23:11:32 user nova-compute[75045]:   </guest>
Nov 08 23:11:32 user nova-compute[75045]:   <guest>
Nov 08 23:11:32 user nova-compute[75045]:     <os_type>hvm</os_type>
Nov 08 23:11:32 user nova-compute[75045]:     <arch name='mips64el'>
Nov 08 23:11:32 user nova-compute[75045]:       <wordsize>64</wordsize>
Nov 08 23:11:32 user nova-compute[75045]:       <emulator>/usr/bin/qemu-system-mips64el</emulator>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='16'>malta</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='16'>loongson3-virt</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='1'>mipssim</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='1'>pica61</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='1'>magnum</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='16'>boston</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='1'>fuloong2e</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <domain type='qemu'/>
Nov 08 23:11:32 user nova-compute[75045]:     </arch>
Nov 08 23:11:32 user nova-compute[75045]:     <features>
Nov 08 23:11:32 user nova-compute[75045]:       <cpuselection/>
Nov 08 23:11:32 user nova-compute[75045]:       <deviceboot/>
Nov 08 23:11:32 user nova-compute[75045]:       <disksnapshot default='on' toggle='no'/>
Nov 08 23:11:32 user nova-compute[75045]:     </features>
Nov 08 23:11:32 user nova-compute[75045]:   </guest>
Nov 08 23:11:32 user nova-compute[75045]:   <guest>
Nov 08 23:11:32 user nova-compute[75045]:     <os_type>hvm</os_type>
Nov 08 23:11:32 user nova-compute[75045]:     <arch name='ppc'>
Nov 08 23:11:32 user nova-compute[75045]:       <wordsize>32</wordsize>
Nov 08 23:11:32 user nova-compute[75045]:       <emulator>/usr/bin/qemu-system-ppc</emulator>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='1'>g3beige</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='1'>virtex-ml507</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='1'>mac99</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='32'>ppce500</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='1'>pegasos2</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='1'>sam460ex</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='1'>bamboo</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='1'>40p</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='1'>ref405ep</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='15'>mpc8544ds</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='1'>taihu</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <domain type='qemu'/>
Nov 08 23:11:32 user nova-compute[75045]:     </arch>
Nov 08 23:11:32 user nova-compute[75045]:     <features>
Nov 08 23:11:32 user nova-compute[75045]:       <cpuselection/>
Nov 08 23:11:32 user nova-compute[75045]:       <deviceboot/>
Nov 08 23:11:32 user nova-compute[75045]:       <disksnapshot default='on' toggle='no'/>
Nov 08 23:11:32 user nova-compute[75045]:     </features>
Nov 08 23:11:32 user nova-compute[75045]:   </guest>
Nov 08 23:11:32 user nova-compute[75045]:   <guest>
Nov 08 23:11:32 user nova-compute[75045]:     <os_type>hvm</os_type>
Nov 08 23:11:32 user nova-compute[75045]:     <arch name='ppc64'>
Nov 08 23:11:32 user nova-compute[75045]:       <wordsize>64</wordsize>
Nov 08 23:11:32 user nova-compute[75045]:       <emulator>/usr/bin/qemu-system-ppc64</emulator>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='2048'>powernv9</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='1'>taihu</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='15'>mpc8544ds</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='2048'>powernv10</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='32'>ppce500</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='1'>40p</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='1'>pegasos2</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='1'>bamboo</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='1'>g3beige</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='1'>virtex-ml507</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='1'>mac99</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='1'>sam460ex</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='1'>ref405ep</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='2048'>powernv8</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <domain type='qemu'/>
Nov 08 23:11:32 user nova-compute[75045]:     </arch>
Nov 08 23:11:32 user nova-compute[75045]:     <features>
Nov 08 23:11:32 user nova-compute[75045]:       <cpuselection/>
Nov 08 23:11:32 user nova-compute[75045]:       <deviceboot/>
Nov 08 23:11:32 user nova-compute[75045]:       <disksnapshot default='on' toggle='no'/>
Nov 08 23:11:32 user nova-compute[75045]:     </features>
Nov 08 23:11:32 user nova-compute[75045]:   </guest>
Nov 08 23:11:32 user nova-compute[75045]:   <guest>
Nov 08 23:11:32 user nova-compute[75045]:     <os_type>hvm</os_type>
Nov 08 23:11:32 user nova-compute[75045]:     <arch name='ppc64le'>
Nov 08 23:11:32 user nova-compute[75045]:       <wordsize>64</wordsize>
Nov 08 23:11:32 user nova-compute[75045]:       <emulator>/usr/bin/qemu-system-ppc64le</emulator>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='2048'>powernv9</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='1'>taihu</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='15'>mpc8544ds</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='2048'>powernv10</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='32'>ppce500</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='1'>40p</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='1'>pegasos2</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='1'>bamboo</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='1'>g3beige</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='1'>virtex-ml507</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='1'>mac99</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='1'>sam460ex</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='1'>ref405ep</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='2048'>powernv8</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <domain type='qemu'/>
Nov 08 23:11:32 user nova-compute[75045]:     </arch>
Nov 08 23:11:32 user nova-compute[75045]:     <features>
Nov 08 23:11:32 user nova-compute[75045]:       <cpuselection/>
Nov 08 23:11:32 user nova-compute[75045]:       <deviceboot/>
Nov 08 23:11:32 user nova-compute[75045]:       <disksnapshot default='on' toggle='no'/>
Nov 08 23:11:32 user nova-compute[75045]:     </features>
Nov 08 23:11:32 user nova-compute[75045]:   </guest>
Nov 08 23:11:32 user nova-compute[75045]:   <guest>
Nov 08 23:11:32 user nova-compute[75045]:     <os_type>hvm</os_type>
Nov 08 23:11:32 user nova-compute[75045]:     <arch name='riscv32'>
Nov 08 23:11:32 user nova-compute[75045]:       <wordsize>32</wordsize>
Nov 08 23:11:32 user nova-compute[75045]:       <emulator>/usr/bin/qemu-system-riscv32</emulator>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='8'>spike</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='1'>opentitan</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='5'>sifive_u</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='1'>sifive_e</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='8'>virt</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <domain type='qemu'/>
Nov 08 23:11:32 user nova-compute[75045]:     </arch>
Nov 08 23:11:32 user nova-compute[75045]:     <features>
Nov 08 23:11:32 user nova-compute[75045]:       <cpuselection/>
Nov 08 23:11:32 user nova-compute[75045]:       <deviceboot/>
Nov 08 23:11:32 user nova-compute[75045]:       <disksnapshot default='on' toggle='no'/>
Nov 08 23:11:32 user nova-compute[75045]:     </features>
Nov 08 23:11:32 user nova-compute[75045]:   </guest>
Nov 08 23:11:32 user nova-compute[75045]:   <guest>
Nov 08 23:11:32 user nova-compute[75045]:     <os_type>hvm</os_type>
Nov 08 23:11:32 user nova-compute[75045]:     <arch name='riscv64'>
Nov 08 23:11:32 user nova-compute[75045]:       <wordsize>64</wordsize>
Nov 08 23:11:32 user nova-compute[75045]:       <emulator>/usr/bin/qemu-system-riscv64</emulator>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='8'>spike</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='5'>microchip-icicle-kit</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='5'>sifive_u</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='1'>shakti_c</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='1'>sifive_e</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='8'>virt</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <domain type='qemu'/>
Nov 08 23:11:32 user nova-compute[75045]:     </arch>
Nov 08 23:11:32 user nova-compute[75045]:     <features>
Nov 08 23:11:32 user nova-compute[75045]:       <cpuselection/>
Nov 08 23:11:32 user nova-compute[75045]:       <deviceboot/>
Nov 08 23:11:32 user nova-compute[75045]:       <disksnapshot default='on' toggle='no'/>
Nov 08 23:11:32 user nova-compute[75045]:     </features>
Nov 08 23:11:32 user nova-compute[75045]:   </guest>
Nov 08 23:11:32 user nova-compute[75045]:   <guest>
Nov 08 23:11:32 user nova-compute[75045]:     <os_type>hvm</os_type>
Nov 08 23:11:32 user nova-compute[75045]:     <arch name='s390x'>
Nov 08 23:11:32 user nova-compute[75045]:       <wordsize>64</wordsize>
Nov 08 23:11:32 user nova-compute[75045]:       <emulator>/usr/bin/qemu-system-s390x</emulator>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='248'>s390-ccw-virtio-jammy</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine canonical='s390-ccw-virtio-jammy' maxCpus='248'>s390-ccw-virtio</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='248'>s390-ccw-virtio-4.0</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='248'>s390-ccw-virtio-5.2</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='248'>s390-ccw-virtio-artful</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='248'>s390-ccw-virtio-3.1</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='248'>s390-ccw-virtio-groovy</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='248'>s390-ccw-virtio-hirsute</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='248'>s390-ccw-virtio-disco</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='248'>s390-ccw-virtio-2.12</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='248'>s390-ccw-virtio-2.6</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='248'>s390-ccw-virtio-yakkety</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='248'>s390-ccw-virtio-eoan</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='248'>s390-ccw-virtio-2.9</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='248'>s390-ccw-virtio-6.0</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='248'>s390-ccw-virtio-5.1</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='248'>s390-ccw-virtio-3.0</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='248'>s390-ccw-virtio-4.2</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='248'>s390-ccw-virtio-2.5</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='248'>s390-ccw-virtio-2.11</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='248'>s390-ccw-virtio-xenial</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='248'>s390-ccw-virtio-focal</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='248'>s390-ccw-virtio-2.8</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='248'>s390-ccw-virtio-impish</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='248'>s390-ccw-virtio-bionic</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='248'>s390-ccw-virtio-5.0</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='248'>s390-ccw-virtio-6.2</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='248'>s390-ccw-virtio-zesty</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='248'>s390-ccw-virtio-4.1</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='248'>s390-ccw-virtio-cosmic</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='248'>s390-ccw-virtio-2.4</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='248'>s390-ccw-virtio-2.10</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='248'>s390-ccw-virtio-2.7</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='248'>s390-ccw-virtio-6.1</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <domain type='qemu'/>
Nov 08 23:11:32 user nova-compute[75045]:     </arch>
Nov 08 23:11:32 user nova-compute[75045]:     <features>
Nov 08 23:11:32 user nova-compute[75045]:       <cpuselection/>
Nov 08 23:11:32 user nova-compute[75045]:       <deviceboot/>
Nov 08 23:11:32 user nova-compute[75045]:       <disksnapshot default='on' toggle='no'/>
Nov 08 23:11:32 user nova-compute[75045]:     </features>
Nov 08 23:11:32 user nova-compute[75045]:   </guest>
Nov 08 23:11:32 user nova-compute[75045]:   <guest>
Nov 08 23:11:32 user nova-compute[75045]:     <os_type>hvm</os_type>
Nov 08 23:11:32 user nova-compute[75045]:     <arch name='sh4'>
Nov 08 23:11:32 user nova-compute[75045]:       <wordsize>32</wordsize>
Nov 08 23:11:32 user nova-compute[75045]:       <emulator>/usr/bin/qemu-system-sh4</emulator>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='1'>shix</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='1'>r2d</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <domain type='qemu'/>
Nov 08 23:11:32 user nova-compute[75045]:     </arch>
Nov 08 23:11:32 user nova-compute[75045]:     <features>
Nov 08 23:11:32 user nova-compute[75045]:       <cpuselection/>
Nov 08 23:11:32 user nova-compute[75045]:       <deviceboot/>
Nov 08 23:11:32 user nova-compute[75045]:       <disksnapshot default='on' toggle='no'/>
Nov 08 23:11:32 user nova-compute[75045]:     </features>
Nov 08 23:11:32 user nova-compute[75045]:   </guest>
Nov 08 23:11:32 user nova-compute[75045]:   <guest>
Nov 08 23:11:32 user nova-compute[75045]:     <os_type>hvm</os_type>
Nov 08 23:11:32 user nova-compute[75045]:     <arch name='sh4eb'>
Nov 08 23:11:32 user nova-compute[75045]:       <wordsize>64</wordsize>
Nov 08 23:11:32 user nova-compute[75045]:       <emulator>/usr/bin/qemu-system-sh4eb</emulator>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='1'>shix</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='1'>r2d</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <domain type='qemu'/>
Nov 08 23:11:32 user nova-compute[75045]:     </arch>
Nov 08 23:11:32 user nova-compute[75045]:     <features>
Nov 08 23:11:32 user nova-compute[75045]:       <cpuselection/>
Nov 08 23:11:32 user nova-compute[75045]:       <deviceboot/>
Nov 08 23:11:32 user nova-compute[75045]:       <disksnapshot default='on' toggle='no'/>
Nov 08 23:11:32 user nova-compute[75045]:     </features>
Nov 08 23:11:32 user nova-compute[75045]:   </guest>
Nov 08 23:11:32 user nova-compute[75045]:   <guest>
Nov 08 23:11:32 user nova-compute[75045]:     <os_type>hvm</os_type>
Nov 08 23:11:32 user nova-compute[75045]:     <arch name='sparc'>
Nov 08 23:11:32 user nova-compute[75045]:       <wordsize>32</wordsize>
Nov 08 23:11:32 user nova-compute[75045]:       <emulator>/usr/bin/qemu-system-sparc</emulator>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='1'>SS-5</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='4'>SS-20</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='1'>LX</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='1'>SPARCClassic</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='1'>leon3_generic</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='1'>SPARCbook</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='1'>SS-4</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='4'>SS-600MP</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='4'>SS-10</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='1'>Voyager</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <domain type='qemu'/>
Nov 08 23:11:32 user nova-compute[75045]:     </arch>
Nov 08 23:11:32 user nova-compute[75045]:     <features>
Nov 08 23:11:32 user nova-compute[75045]:       <cpuselection/>
Nov 08 23:11:32 user nova-compute[75045]:       <deviceboot/>
Nov 08 23:11:32 user nova-compute[75045]:       <disksnapshot default='on' toggle='no'/>
Nov 08 23:11:32 user nova-compute[75045]:     </features>
Nov 08 23:11:32 user nova-compute[75045]:   </guest>
Nov 08 23:11:32 user nova-compute[75045]:   <guest>
Nov 08 23:11:32 user nova-compute[75045]:     <os_type>hvm</os_type>
Nov 08 23:11:32 user nova-compute[75045]:     <arch name='sparc64'>
Nov 08 23:11:32 user nova-compute[75045]:       <wordsize>64</wordsize>
Nov 08 23:11:32 user nova-compute[75045]:       <emulator>/usr/bin/qemu-system-sparc64</emulator>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='1'>sun4u</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='1'>niagara</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='1'>sun4v</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <domain type='qemu'/>
Nov 08 23:11:32 user nova-compute[75045]:     </arch>
Nov 08 23:11:32 user nova-compute[75045]:     <features>
Nov 08 23:11:32 user nova-compute[75045]:       <cpuselection/>
Nov 08 23:11:32 user nova-compute[75045]:       <deviceboot/>
Nov 08 23:11:32 user nova-compute[75045]:       <disksnapshot default='on' toggle='no'/>
Nov 08 23:11:32 user nova-compute[75045]:     </features>
Nov 08 23:11:32 user nova-compute[75045]:   </guest>
Nov 08 23:11:32 user nova-compute[75045]:   <guest>
Nov 08 23:11:32 user nova-compute[75045]:     <os_type>hvm</os_type>
Nov 08 23:11:32 user nova-compute[75045]:     <arch name='x86_64'>
Nov 08 23:11:32 user nova-compute[75045]:       <wordsize>64</wordsize>
Nov 08 23:11:32 user nova-compute[75045]:       <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='288'>pc-q35-artful</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='1'>x-remote</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='1'>isapc</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='288'>pc-q35-disco</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='288'>pc-q35-impish</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='288'>pc-q35-focal</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='288'>microvm</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <domain type='qemu'/>
Nov 08 23:11:32 user nova-compute[75045]:       <domain type='kvm'/>
Nov 08 23:11:32 user nova-compute[75045]:     </arch>
Nov 08 23:11:32 user nova-compute[75045]:     <features>
Nov 08 23:11:32 user nova-compute[75045]:       <acpi default='on' toggle='yes'/>
Nov 08 23:11:32 user nova-compute[75045]:       <apic default='on' toggle='no'/>
Nov 08 23:11:32 user nova-compute[75045]:       <cpuselection/>
Nov 08 23:11:32 user nova-compute[75045]:       <deviceboot/>
Nov 08 23:11:32 user nova-compute[75045]:       <disksnapshot default='on' toggle='no'/>
Nov 08 23:11:32 user nova-compute[75045]:     </features>
Nov 08 23:11:32 user nova-compute[75045]:   </guest>
Nov 08 23:11:32 user nova-compute[75045]:   <guest>
Nov 08 23:11:32 user nova-compute[75045]:     <os_type>hvm</os_type>
Nov 08 23:11:32 user nova-compute[75045]:     <arch name='xtensa'>
Nov 08 23:11:32 user nova-compute[75045]:       <wordsize>32</wordsize>
Nov 08 23:11:32 user nova-compute[75045]:       <emulator>/usr/bin/qemu-system-xtensa</emulator>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='4'>sim</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='32'>kc705</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='32'>ml605</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='32'>ml605-nommu</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='32'>virt</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='32'>lx60-nommu</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='32'>lx200</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='32'>lx200-nommu</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='32'>lx60</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='32'>kc705-nommu</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <domain type='qemu'/>
Nov 08 23:11:32 user nova-compute[75045]:     </arch>
Nov 08 23:11:32 user nova-compute[75045]:     <features>
Nov 08 23:11:32 user nova-compute[75045]:       <cpuselection/>
Nov 08 23:11:32 user nova-compute[75045]:       <deviceboot/>
Nov 08 23:11:32 user nova-compute[75045]:       <disksnapshot default='on' toggle='no'/>
Nov 08 23:11:32 user nova-compute[75045]:     </features>
Nov 08 23:11:32 user nova-compute[75045]:   </guest>
Nov 08 23:11:32 user nova-compute[75045]:   <guest>
Nov 08 23:11:32 user nova-compute[75045]:     <os_type>hvm</os_type>
Nov 08 23:11:32 user nova-compute[75045]:     <arch name='xtensaeb'>
Nov 08 23:11:32 user nova-compute[75045]:       <wordsize>32</wordsize>
Nov 08 23:11:32 user nova-compute[75045]:       <emulator>/usr/bin/qemu-system-xtensaeb</emulator>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='4'>sim</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='32'>kc705</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='32'>ml605</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='32'>ml605-nommu</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='32'>virt</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='32'>lx60-nommu</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='32'>lx200</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='32'>lx200-nommu</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='32'>lx60</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <machine maxCpus='32'>kc705-nommu</machine>
Nov 08 23:11:32 user nova-compute[75045]:       <domain type='qemu'/>
Nov 08 23:11:32 user nova-compute[75045]:     </arch>
Nov 08 23:11:32 user nova-compute[75045]:     <features>
Nov 08 23:11:32 user nova-compute[75045]:       <cpuselection/>
Nov 08 23:11:32 user nova-compute[75045]:       <deviceboot/>
Nov 08 23:11:32 user nova-compute[75045]:       <disksnapshot default='on' toggle='no'/>
Nov 08 23:11:32 user nova-compute[75045]:     </features>
Nov 08 23:11:32 user nova-compute[75045]:   </guest>
Nov 08 23:11:32 user nova-compute[75045]: </capabilities>
Nov 08 23:11:32 user nova-compute[75045]: 
Nov 08 23:11:32 user nova-compute[75045]: DEBUG nova.virt.libvirt.host [None req-b1869e0d-6af1-4bcb-a839-fb2c1c69e58c None None] Getting domain capabilities for alpha via machine types: {None} {{(pid=75045) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 08 23:11:32 user nova-compute[75045]: DEBUG nova.virt.libvirt.host [None req-b1869e0d-6af1-4bcb-a839-fb2c1c69e58c None None] Error from libvirt when retrieving domain capabilities for arch alpha / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-alpha' on this host {{(pid=75045) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 08 23:11:32 user nova-compute[75045]: DEBUG nova.virt.libvirt.host [None req-b1869e0d-6af1-4bcb-a839-fb2c1c69e58c None None] Getting domain capabilities for armv6l via machine types: {'virt', None} {{(pid=75045) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 08 23:11:32 user nova-compute[75045]: DEBUG nova.virt.libvirt.host [None req-b1869e0d-6af1-4bcb-a839-fb2c1c69e58c None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=75045) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 08 23:11:32 user nova-compute[75045]: DEBUG nova.virt.libvirt.host [None req-b1869e0d-6af1-4bcb-a839-fb2c1c69e58c None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=75045) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 08 23:11:32 user nova-compute[75045]: DEBUG nova.virt.libvirt.host [None req-b1869e0d-6af1-4bcb-a839-fb2c1c69e58c None None] Getting domain capabilities for armv7l via machine types: {'virt'} {{(pid=75045) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 08 23:11:32 user nova-compute[75045]: DEBUG nova.virt.libvirt.host [None req-b1869e0d-6af1-4bcb-a839-fb2c1c69e58c None None] Error from libvirt when retrieving domain capabilities for arch armv7l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=75045) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 08 23:11:32 user nova-compute[75045]: DEBUG nova.virt.libvirt.host [None req-b1869e0d-6af1-4bcb-a839-fb2c1c69e58c None None] Getting domain capabilities for aarch64 via machine types: {'virt'} {{(pid=75045) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 08 23:11:32 user nova-compute[75045]: DEBUG nova.virt.libvirt.host [None req-b1869e0d-6af1-4bcb-a839-fb2c1c69e58c None None] Error from libvirt when retrieving domain capabilities for arch aarch64 / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-aarch64' on this host {{(pid=75045) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 08 23:11:32 user nova-compute[75045]: DEBUG nova.virt.libvirt.host [None req-b1869e0d-6af1-4bcb-a839-fb2c1c69e58c None None] Getting domain capabilities for cris via machine types: {None} {{(pid=75045) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 08 23:11:32 user nova-compute[75045]: DEBUG nova.virt.libvirt.host [None req-b1869e0d-6af1-4bcb-a839-fb2c1c69e58c None None] Error from libvirt when retrieving domain capabilities for arch cris / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-cris' on this host {{(pid=75045) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 08 23:11:32 user nova-compute[75045]: DEBUG nova.virt.libvirt.host [None req-b1869e0d-6af1-4bcb-a839-fb2c1c69e58c None None] Getting domain capabilities for i686 via machine types: {'ubuntu', 'ubuntu-q35', 'pc', 'q35'} {{(pid=75045) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 08 23:11:32 user nova-compute[75045]: DEBUG nova.virt.libvirt.host [None req-b1869e0d-6af1-4bcb-a839-fb2c1c69e58c None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu:
Nov 08 23:11:32 user nova-compute[75045]: <domainCapabilities>
Nov 08 23:11:32 user nova-compute[75045]:   <path>/usr/bin/qemu-system-i386</path>
Nov 08 23:11:32 user nova-compute[75045]:   <domain>kvm</domain>
Nov 08 23:11:32 user nova-compute[75045]:   <machine>pc-i440fx-jammy</machine>
Nov 08 23:11:32 user nova-compute[75045]:   <arch>i686</arch>
Nov 08 23:11:32 user nova-compute[75045]:   <vcpu max='255'/>
Nov 08 23:11:32 user nova-compute[75045]:   <iothreads supported='yes'/>
Nov 08 23:11:32 user nova-compute[75045]:   <os supported='yes'>
Nov 08 23:11:32 user nova-compute[75045]:     <enum name='firmware'/>
Nov 08 23:11:32 user nova-compute[75045]:     <loader supported='yes'>
Nov 08 23:11:32 user nova-compute[75045]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 08 23:11:32 user nova-compute[75045]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 08 23:11:32 user nova-compute[75045]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 08 23:11:32 user nova-compute[75045]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 08 23:11:32 user nova-compute[75045]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 08 23:11:32 user nova-compute[75045]:       <enum name='type'>
Nov 08 23:11:32 user nova-compute[75045]:         <value>rom</value>
Nov 08 23:11:32 user nova-compute[75045]:         <value>pflash</value>
Nov 08 23:11:32 user nova-compute[75045]:       </enum>
Nov 08 23:11:32 user nova-compute[75045]:       <enum name='readonly'>
Nov 08 23:11:32 user nova-compute[75045]:         <value>yes</value>
Nov 08 23:11:32 user nova-compute[75045]:         <value>no</value>
Nov 08 23:11:32 user nova-compute[75045]:       </enum>
Nov 08 23:11:32 user nova-compute[75045]:       <enum name='secure'>
Nov 08 23:11:32 user nova-compute[75045]:         <value>no</value>
Nov 08 23:11:32 user nova-compute[75045]:       </enum>
Nov 08 23:11:32 user nova-compute[75045]:     </loader>
Nov 08 23:11:32 user nova-compute[75045]:   </os>
Nov 08 23:11:32 user nova-compute[75045]:   <cpu>
Nov 08 23:11:32 user nova-compute[75045]:     <mode name='host-passthrough' supported='yes'>
Nov 08 23:11:32 user nova-compute[75045]:       <enum name='hostPassthroughMigratable'>
Nov 08 23:11:32 user nova-compute[75045]:         <value>off</value>
Nov 08 23:11:32 user nova-compute[75045]:       </enum>
Nov 08 23:11:32 user nova-compute[75045]:     </mode>
Nov 08 23:11:32 user nova-compute[75045]:     <mode name='maximum' supported='yes'>
Nov 08 23:11:32 user nova-compute[75045]:       <enum name='maximumMigratable'>
Nov 08 23:11:32 user nova-compute[75045]:         <value>on</value>
Nov 08 23:11:32 user nova-compute[75045]:         <value>off</value>
Nov 08 23:11:32 user nova-compute[75045]:       </enum>
Nov 08 23:11:32 user nova-compute[75045]:     </mode>
Nov 08 23:11:32 user nova-compute[75045]:     <mode name='host-model' supported='yes'>
Nov 08 23:11:32 user nova-compute[75045]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 08 23:11:32 user nova-compute[75045]:       <vendor>Intel</vendor>
Nov 08 23:11:32 user nova-compute[75045]:       <feature policy='require' name='ss'/>
Nov 08 23:11:32 user nova-compute[75045]:       <feature policy='require' name='vmx'/>
Nov 08 23:11:32 user nova-compute[75045]:       <feature policy='require' name='pcid'/>
Nov 08 23:11:32 user nova-compute[75045]:       <feature policy='require' name='hypervisor'/>
Nov 08 23:11:32 user nova-compute[75045]:       <feature policy='require' name='arat'/>
Nov 08 23:11:32 user nova-compute[75045]:       <feature policy='require' name='tsc_adjust'/>
Nov 08 23:11:32 user nova-compute[75045]:       <feature policy='require' name='umip'/>
Nov 08 23:11:32 user nova-compute[75045]:       <feature policy='require' name='md-clear'/>
Nov 08 23:11:32 user nova-compute[75045]:       <feature policy='require' name='stibp'/>
Nov 08 23:11:32 user nova-compute[75045]:       <feature policy='require' name='arch-capabilities'/>
Nov 08 23:11:32 user nova-compute[75045]:       <feature policy='require' name='ssbd'/>
Nov 08 23:11:32 user nova-compute[75045]:       <feature policy='require' name='ibpb'/>
Nov 08 23:11:32 user nova-compute[75045]:       <feature policy='require' name='ibrs'/>
Nov 08 23:11:32 user nova-compute[75045]:       <feature policy='require' name='amd-stibp'/>
Nov 08 23:11:32 user nova-compute[75045]:       <feature policy='require' name='amd-ssbd'/>
Nov 08 23:11:32 user nova-compute[75045]:       <feature policy='disable' name='erms'/>
Nov 08 23:11:32 user nova-compute[75045]:       <feature policy='disable' name='xsaveopt'/>
Nov 08 23:11:32 user nova-compute[75045]:       <feature policy='disable' name='lm'/>
Nov 08 23:11:32 user nova-compute[75045]:     </mode>
Nov 08 23:11:32 user nova-compute[75045]:     <mode name='custom' supported='yes'>
Nov 08 23:11:32 user nova-compute[75045]:       <model usable='no'>qemu64</model>
Nov 08 23:11:32 user nova-compute[75045]:       <model usable='yes'>qemu32</model>
Nov 08 23:11:32 user nova-compute[75045]:       <model usable='no'>phenom</model>
Nov 08 23:11:32 user nova-compute[75045]:       <model usable='yes'>pentium3</model>
Nov 08 23:11:32 user nova-compute[75045]:       <model usable='yes'>pentium2</model>
Nov 08 23:11:32 user nova-compute[75045]:       <model usable='yes'>pentium</model>
Nov 08 23:11:32 user nova-compute[75045]:       <model usable='no'>n270</model>
Nov 08 23:11:32 user nova-compute[75045]:       <model usable='no'>kvm64</model>
Nov 08 23:11:32 user nova-compute[75045]:       <model usable='yes'>kvm32</model>
Nov 08 23:11:32 user nova-compute[75045]:       <model usable='yes'>coreduo</model>
Nov 08 23:11:32 user nova-compute[75045]:       <model usable='no'>core2duo</model>
Nov 08 23:11:32 user nova-compute[75045]:       <model usable='no'>athlon</model>
Nov 08 23:11:32 user nova-compute[75045]:       <model usable='no'>Westmere-IBRS</model>
Nov 08 23:11:32 user nova-compute[75045]:       <model usable='no'>Westmere</model>
Nov 08 23:11:32 user nova-compute[75045]:       <model usable='no'>Snowridge</model>
Nov 08 23:11:32 user nova-compute[75045]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 08 23:11:32 user nova-compute[75045]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 08 23:11:32 user nova-compute[75045]:       <model usable='no'>Skylake-Server</model>
Nov 08 23:11:32 user nova-compute[75045]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 08 23:11:32 user nova-compute[75045]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 08 23:11:32 user nova-compute[75045]:       <model usable='no'>Skylake-Client</model>
Nov 08 23:11:32 user nova-compute[75045]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 08 23:11:32 user nova-compute[75045]:       <model usable='no'>SandyBridge</model>
Nov 08 23:11:32 user nova-compute[75045]:       <model usable='no'>Penryn</model>
Nov 08 23:11:32 user nova-compute[75045]:       <model usable='no'>Opteron_G5</model>
Nov 08 23:11:32 user nova-compute[75045]:       <model usable='no'>Opteron_G4</model>
Nov 08 23:11:32 user nova-compute[75045]:       <model usable='no'>Opteron_G3</model>
Nov 08 23:11:32 user nova-compute[75045]:       <model usable='no'>Opteron_G2</model>
Nov 08 23:11:32 user nova-compute[75045]:       <model usable='no'>Opteron_G1</model>
Nov 08 23:11:32 user nova-compute[75045]:       <model usable='no'>Nehalem-IBRS</model>
Nov 08 23:11:32 user nova-compute[75045]:       <model usable='no'>Nehalem</model>
Nov 08 23:11:32 user nova-compute[75045]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 08 23:11:32 user nova-compute[75045]:       <model usable='no'>IvyBridge</model>
Nov 08 23:11:32 user nova-compute[75045]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 08 23:11:32 user nova-compute[75045]:       <model usable='no'>Icelake-Server</model>
Nov 08 23:11:32 user nova-compute[75045]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 08 23:11:32 user nova-compute[75045]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 08 23:11:32 user nova-compute[75045]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 08 23:11:32 user nova-compute[75045]:       <model usable='no'>Haswell-noTSX</model>
Nov 08 23:11:32 user nova-compute[75045]:       <model usable='no'>Haswell-IBRS</model>
Nov 08 23:11:32 user nova-compute[75045]:       <model usable='no'>Haswell</model>
Nov 08 23:11:32 user nova-compute[75045]:       <model usable='no'>EPYC-Rome</model>
Nov 08 23:11:32 user nova-compute[75045]:       <model usable='no'>EPYC-Milan</model>
Nov 08 23:11:32 user nova-compute[75045]:       <model usable='no'>EPYC-IBPB</model>
Nov 08 23:11:32 user nova-compute[75045]:       <model usable='no'>EPYC</model>
Nov 08 23:11:32 user nova-compute[75045]:       <model usable='no'>Dhyana</model>
Nov 08 23:11:32 user nova-compute[75045]:       <model usable='no'>Cooperlake</model>
Nov 08 23:11:32 user nova-compute[75045]:       <model usable='no'>Conroe</model>
Nov 08 23:11:32 user nova-compute[75045]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 08 23:11:32 user nova-compute[75045]:       <model usable='no'>Cascadelake-Server</model>
Nov 08 23:11:32 user nova-compute[75045]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 08 23:11:32 user nova-compute[75045]:       <model usable='no'>Broadwell-noTSX</model>
Nov 08 23:11:32 user nova-compute[75045]:       <model usable='no'>Broadwell-IBRS</model>
Nov 08 23:11:32 user nova-compute[75045]:       <model usable='no'>Broadwell</model>
Nov 08 23:11:32 user nova-compute[75045]:       <model usable='yes'>486</model>
Nov 08 23:11:32 user nova-compute[75045]:     </mode>
Nov 08 23:11:32 user nova-compute[75045]:   </cpu>
Nov 08 23:11:32 user nova-compute[75045]:   <memoryBacking supported='yes'>
Nov 08 23:11:32 user nova-compute[75045]:     <enum name='sourceType'>
Nov 08 23:11:32 user nova-compute[75045]:       <value>file</value>
Nov 08 23:11:32 user nova-compute[75045]:       <value>anonymous</value>
Nov 08 23:11:32 user nova-compute[75045]:       <value>memfd</value>
Nov 08 23:11:32 user nova-compute[75045]:     </enum>
Nov 08 23:11:32 user nova-compute[75045]:   </memoryBacking>
Nov 08 23:11:32 user nova-compute[75045]:   <devices>
Nov 08 23:11:32 user nova-compute[75045]:     <disk supported='yes'>
Nov 08 23:11:32 user nova-compute[75045]:       <enum name='diskDevice'>
Nov 08 23:11:32 user nova-compute[75045]:         <value>disk</value>
Nov 08 23:11:32 user nova-compute[75045]:         <value>cdrom</value>
Nov 08 23:11:32 user nova-compute[75045]:         <value>floppy</value>
Nov 08 23:11:32 user nova-compute[75045]:         <value>lun</value>
Nov 08 23:11:32 user nova-compute[75045]:       </enum>
Nov 08 23:11:32 user nova-compute[75045]:       <enum name='bus'>
Nov 08 23:11:32 user nova-compute[75045]:         <value>ide</value>
Nov 08 23:11:32 user nova-compute[75045]:         <value>fdc</value>
Nov 08 23:11:32 user nova-compute[75045]:         <value>scsi</value>
Nov 08 23:11:32 user nova-compute[75045]:         <value>virtio</value>
Nov 08 23:11:32 user nova-compute[75045]:         <value>usb</value>
Nov 08 23:11:32 user nova-compute[75045]:         <value>sata</value>
Nov 08 23:11:32 user nova-compute[75045]:       </enum>
Nov 08 23:11:32 user nova-compute[75045]:       <enum name='model'>
Nov 08 23:11:32 user nova-compute[75045]:         <value>virtio</value>
Nov 08 23:11:32 user nova-compute[75045]:         <value>virtio-transitional</value>
Nov 08 23:11:32 user nova-compute[75045]:         <value>virtio-non-transitional</value>
Nov 08 23:11:32 user nova-compute[75045]:       </enum>
Nov 08 23:11:32 user nova-compute[75045]:     </disk>
Nov 08 23:11:32 user nova-compute[75045]:     <graphics supported='yes'>
Nov 08 23:11:32 user nova-compute[75045]:       <enum name='type'>
Nov 08 23:11:32 user nova-compute[75045]:         <value>sdl</value>
Nov 08 23:11:32 user nova-compute[75045]:         <value>vnc</value>
Nov 08 23:11:32 user nova-compute[75045]:         <value>spice</value>
Nov 08 23:11:32 user nova-compute[75045]:         <value>egl-headless</value>
Nov 08 23:11:32 user nova-compute[75045]:       </enum>
Nov 08 23:11:32 user nova-compute[75045]:     </graphics>
Nov 08 23:11:32 user nova-compute[75045]:     <video supported='yes'>
Nov 08 23:11:32 user nova-compute[75045]:       <enum name='modelType'>
Nov 08 23:11:32 user nova-compute[75045]:         <value>vga</value>
Nov 08 23:11:32 user nova-compute[75045]:         <value>cirrus</value>
Nov 08 23:11:32 user nova-compute[75045]:         <value>vmvga</value>
Nov 08 23:11:32 user nova-compute[75045]:         <value>qxl</value>
Nov 08 23:11:32 user nova-compute[75045]:         <value>virtio</value>
Nov 08 23:11:32 user nova-compute[75045]:         <value>none</value>
Nov 08 23:11:32 user nova-compute[75045]:         <value>bochs</value>
Nov 08 23:11:32 user nova-compute[75045]:         <value>ramfb</value>
Nov 08 23:11:32 user nova-compute[75045]:       </enum>
Nov 08 23:11:32 user nova-compute[75045]:     </video>
Nov 08 23:11:32 user nova-compute[75045]:     <hostdev supported='yes'>
Nov 08 23:11:32 user nova-compute[75045]:       <enum name='mode'>
Nov 08 23:11:32 user nova-compute[75045]:         <value>subsystem</value>
Nov 08 23:11:32 user nova-compute[75045]:       </enum>
Nov 08 23:11:32 user nova-compute[75045]:       <enum name='startupPolicy'>
Nov 08 23:11:32 user nova-compute[75045]:         <value>default</value>
Nov 08 23:11:32 user nova-compute[75045]:         <value>mandatory</value>
Nov 08 23:11:32 user nova-compute[75045]:         <value>requisite</value>
Nov 08 23:11:32 user nova-compute[75045]:         <value>optional</value>
Nov 08 23:11:32 user nova-compute[75045]:       </enum>
Nov 08 23:11:32 user nova-compute[75045]:       <enum name='subsysType'>
Nov 08 23:11:32 user nova-compute[75045]:         <value>usb</value>
Nov 08 23:11:32 user nova-compute[75045]:         <value>pci</value>
Nov 08 23:11:32 user nova-compute[75045]:         <value>scsi</value>
Nov 08 23:11:32 user nova-compute[75045]:       </enum>
Nov 08 23:11:32 user nova-compute[75045]:       <enum name='capsType'/>
Nov 08 23:11:32 user nova-compute[75045]:       <enum name='pciBackend'/>
Nov 08 23:11:32 user nova-compute[75045]:     </hostdev>
Nov 08 23:11:32 user nova-compute[75045]:     <rng supported='yes'>
Nov 08 23:11:32 user nova-compute[75045]:       <enum name='model'>
Nov 08 23:11:32 user nova-compute[75045]:         <value>virtio</value>
Nov 08 23:11:32 user nova-compute[75045]:         <value>virtio-transitional</value>
Nov 08 23:11:32 user nova-compute[75045]:         <value>virtio-non-transitional</value>
Nov 08 23:11:32 user nova-compute[75045]:       </enum>
Nov 08 23:11:32 user nova-compute[75045]:       <enum name='backendModel'>
Nov 08 23:11:32 user nova-compute[75045]:         <value>random</value>
Nov 08 23:11:32 user nova-compute[75045]:         <value>egd</value>
Nov 08 23:11:32 user nova-compute[75045]:         <value>builtin</value>
Nov 08 23:11:32 user nova-compute[75045]:       </enum>
Nov 08 23:11:32 user nova-compute[75045]:     </rng>
Nov 08 23:11:32 user nova-compute[75045]:     <filesystem supported='yes'>
Nov 08 23:11:32 user nova-compute[75045]:       <enum name='driverType'>
Nov 08 23:11:32 user nova-compute[75045]:         <value>path</value>
Nov 08 23:11:32 user nova-compute[75045]:         <value>handle</value>
Nov 08 23:11:32 user nova-compute[75045]:         <value>virtiofs</value>
Nov 08 23:11:32 user nova-compute[75045]:       </enum>
Nov 08 23:11:32 user nova-compute[75045]:     </filesystem>
Nov 08 23:11:32 user nova-compute[75045]:     <tpm supported='yes'>
Nov 08 23:11:32 user nova-compute[75045]:       <enum name='model'>
Nov 08 23:11:32 user nova-compute[75045]:         <value>tpm-tis</value>
Nov 08 23:11:32 user nova-compute[75045]:         <value>tpm-crb</value>
Nov 08 23:11:32 user nova-compute[75045]:       </enum>
Nov 08 23:11:32 user nova-compute[75045]:       <enum name='backendModel'>
Nov 08 23:11:32 user nova-compute[75045]:         <value>passthrough</value>
Nov 08 23:11:32 user nova-compute[75045]:         <value>emulator</value>
Nov 08 23:11:32 user nova-compute[75045]:       </enum>
Nov 08 23:11:32 user nova-compute[75045]:     </tpm>
Nov 08 23:11:32 user nova-compute[75045]:   </devices>
Nov 08 23:11:32 user nova-compute[75045]:   <features>
Nov 08 23:11:32 user nova-compute[75045]:     <gic supported='no'/>
Nov 08 23:11:32 user nova-compute[75045]:     <vmcoreinfo supported='yes'/>
Nov 08 23:11:32 user nova-compute[75045]:     <genid supported='yes'/>
Nov 08 23:11:32 user nova-compute[75045]:     <backingStoreInput supported='yes'/>
Nov 08 23:11:32 user nova-compute[75045]:     <backup supported='yes'/>
Nov 08 23:11:32 user nova-compute[75045]:     <sev supported='no'/>
Nov 08 23:11:32 user nova-compute[75045]:   </features>
Nov 08 23:11:32 user nova-compute[75045]: </domainCapabilities>
Nov 08 23:11:32 user nova-compute[75045]:  {{(pid=75045) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 08 23:11:32 user nova-compute[75045]: DEBUG nova.virt.libvirt.host [None req-b1869e0d-6af1-4bcb-a839-fb2c1c69e58c None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu-q35:
Nov 08 23:11:32 user nova-compute[75045]: <domainCapabilities>
Nov 08 23:11:32 user nova-compute[75045]:   <path>/usr/bin/qemu-system-i386</path>
Nov 08 23:11:32 user nova-compute[75045]:   <domain>kvm</domain>
Nov 08 23:11:32 user nova-compute[75045]:   <machine>pc-q35-jammy</machine>
Nov 08 23:11:32 user nova-compute[75045]:   <arch>i686</arch>
Nov 08 23:11:32 user nova-compute[75045]:   <vcpu max='288'/>
Nov 08 23:11:32 user nova-compute[75045]:   <iothreads supported='yes'/>
Nov 08 23:11:32 user nova-compute[75045]:   <os supported='yes'>
Nov 08 23:11:32 user nova-compute[75045]:     <enum name='firmware'/>
Nov 08 23:11:32 user nova-compute[75045]:     <loader supported='yes'>
Nov 08 23:11:32 user nova-compute[75045]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 08 23:11:32 user nova-compute[75045]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 08 23:11:32 user nova-compute[75045]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 08 23:11:32 user nova-compute[75045]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 08 23:11:32 user nova-compute[75045]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 08 23:11:32 user nova-compute[75045]:       <enum name='type'>
Nov 08 23:11:32 user nova-compute[75045]:         <value>rom</value>
Nov 08 23:11:32 user nova-compute[75045]:         <value>pflash</value>
Nov 08 23:11:32 user nova-compute[75045]:       </enum>
Nov 08 23:11:32 user nova-compute[75045]:       <enum name='readonly'>
Nov 08 23:11:32 user nova-compute[75045]:         <value>yes</value>
Nov 08 23:11:32 user nova-compute[75045]:         <value>no</value>
Nov 08 23:11:32 user nova-compute[75045]:       </enum>
Nov 08 23:11:32 user nova-compute[75045]:       <enum name='secure'>
Nov 08 23:11:32 user nova-compute[75045]:         <value>no</value>
Nov 08 23:11:32 user nova-compute[75045]:       </enum>
Nov 08 23:11:32 user nova-compute[75045]:     </loader>
Nov 08 23:11:32 user nova-compute[75045]:   </os>
Nov 08 23:11:32 user nova-compute[75045]:   <cpu>
Nov 08 23:11:32 user nova-compute[75045]:     <mode name='host-passthrough' supported='yes'>
Nov 08 23:11:32 user nova-compute[75045]:       <enum name='hostPassthroughMigratable'>
Nov 08 23:11:32 user nova-compute[75045]:         <value>off</value>
Nov 08 23:11:32 user nova-compute[75045]:       </enum>
Nov 08 23:11:32 user nova-compute[75045]:     </mode>
Nov 08 23:11:32 user nova-compute[75045]:     <mode name='maximum' supported='yes'>
Nov 08 23:11:32 user nova-compute[75045]:       <enum name='maximumMigratable'>
Nov 08 23:11:32 user nova-compute[75045]:         <value>on</value>
Nov 08 23:11:32 user nova-compute[75045]:         <value>off</value>
Nov 08 23:11:32 user nova-compute[75045]:       </enum>
Nov 08 23:11:32 user nova-compute[75045]:     </mode>
Nov 08 23:11:32 user nova-compute[75045]:     <mode name='host-model' supported='yes'>
Nov 08 23:11:32 user nova-compute[75045]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 08 23:11:32 user nova-compute[75045]:       <vendor>Intel</vendor>
Nov 08 23:11:32 user nova-compute[75045]:       <feature policy='require' name='ss'/>
Nov 08 23:11:32 user nova-compute[75045]:       <feature policy='require' name='vmx'/>
Nov 08 23:11:32 user nova-compute[75045]:       <feature policy='require' name='pcid'/>
Nov 08 23:11:32 user nova-compute[75045]:       <feature policy='require' name='hypervisor'/>
Nov 08 23:11:32 user nova-compute[75045]:       <feature policy='require' name='arat'/>
Nov 08 23:11:32 user nova-compute[75045]:       <feature policy='require' name='tsc_adjust'/>
Nov 08 23:11:32 user nova-compute[75045]:       <feature policy='require' name='umip'/>
Nov 08 23:11:32 user nova-compute[75045]:       <feature policy='require' name='md-clear'/>
Nov 08 23:11:32 user nova-compute[75045]:       <feature policy='require' name='stibp'/>
Nov 08 23:11:32 user nova-compute[75045]:       <feature policy='require' name='arch-capabilities'/>
Nov 08 23:11:32 user nova-compute[75045]:       <feature policy='require' name='ssbd'/>
Nov 08 23:11:32 user nova-compute[75045]:       <feature policy='require' name='ibpb'/>
Nov 08 23:11:32 user nova-compute[75045]:       <feature policy='require' name='ibrs'/>
Nov 08 23:11:32 user nova-compute[75045]:       <feature policy='require' name='amd-stibp'/>
Nov 08 23:11:32 user nova-compute[75045]:       <feature policy='require' name='amd-ssbd'/>
Nov 08 23:11:32 user nova-compute[75045]:       <feature policy='disable' name='erms'/>
Nov 08 23:11:32 user nova-compute[75045]:       <feature policy='disable' name='xsaveopt'/>
Nov 08 23:11:32 user nova-compute[75045]:       <feature policy='disable' name='lm'/>
Nov 08 23:11:32 user nova-compute[75045]:     </mode>
Nov 08 23:11:32 user nova-compute[75045]:     <mode name='custom' supported='yes'>
Nov 08 23:11:32 user nova-compute[75045]:       <model usable='no'>qemu64</model>
Nov 08 23:11:32 user nova-compute[75045]:       <model usable='yes'>qemu32</model>
Nov 08 23:11:32 user nova-compute[75045]:       <model usable='no'>phenom</model>
Nov 08 23:11:32 user nova-compute[75045]:       <model usable='yes'>pentium3</model>
Nov 08 23:11:32 user nova-compute[75045]:       <model usable='yes'>pentium2</model>
Nov 08 23:11:32 user nova-compute[75045]:       <model usable='yes'>pentium</model>
Nov 08 23:11:32 user nova-compute[75045]:       <model usable='no'>n270</model>
Nov 08 23:11:32 user nova-compute[75045]:       <model usable='no'>kvm64</model>
Nov 08 23:11:32 user nova-compute[75045]:       <model usable='yes'>kvm32</model>
Nov 08 23:11:32 user nova-compute[75045]:       <model usable='yes'>coreduo</model>
Nov 08 23:11:32 user nova-compute[75045]:       <model usable='no'>core2duo</model>
Nov 08 23:11:32 user nova-compute[75045]:       <model usable='no'>athlon</model>
Nov 08 23:11:32 user nova-compute[75045]:       <model usable='no'>Westmere-IBRS</model>
Nov 08 23:11:32 user nova-compute[75045]:       <model usable='no'>Westmere</model>
Nov 08 23:11:32 user nova-compute[75045]:       <model usable='no'>Snowridge</model>
Nov 08 23:11:32 user nova-compute[75045]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 08 23:11:32 user nova-compute[75045]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 08 23:11:32 user nova-compute[75045]:       <model usable='no'>Skylake-Server</model>
Nov 08 23:11:32 user nova-compute[75045]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 08 23:11:32 user nova-compute[75045]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 08 23:11:32 user nova-compute[75045]:       <model usable='no'>Skylake-Client</model>
Nov 08 23:11:32 user nova-compute[75045]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 08 23:11:32 user nova-compute[75045]:       <model usable='no'>SandyBridge</model>
Nov 08 23:11:32 user nova-compute[75045]:       <model usable='no'>Penryn</model>
Nov 08 23:11:32 user nova-compute[75045]:       <model usable='no'>Opteron_G5</model>
Nov 08 23:11:32 user nova-compute[75045]:       <model usable='no'>Opteron_G4</model>
Nov 08 23:11:32 user nova-compute[75045]:       <model usable='no'>Opteron_G3</model>
Nov 08 23:11:32 user nova-compute[75045]:       <model usable='no'>Opteron_G2</model>
Nov 08 23:11:32 user nova-compute[75045]:       <model usable='no'>Opteron_G1</model>
Nov 08 23:11:32 user nova-compute[75045]:       <model usable='no'>Nehalem-IBRS</model>
Nov 08 23:11:32 user nova-compute[75045]:       <model usable='no'>Nehalem</model>
Nov 08 23:11:32 user nova-compute[75045]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 08 23:11:32 user nova-compute[75045]:       <model usable='no'>IvyBridge</model>
Nov 08 23:11:32 user nova-compute[75045]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 08 23:11:32 user nova-compute[75045]:       <model usable='no'>Icelake-Server</model>
Nov 08 23:11:32 user nova-compute[75045]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 08 23:11:32 user nova-compute[75045]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 08 23:11:32 user nova-compute[75045]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 08 23:11:32 user nova-compute[75045]:       <model usable='no'>Haswell-noTSX</model>
Nov 08 23:11:32 user nova-compute[75045]:       <model usable='no'>Haswell-IBRS</model>
Nov 08 23:11:32 user nova-compute[75045]:       <model usable='no'>Haswell</model>
Nov 08 23:11:32 user nova-compute[75045]:       <model usable='no'>EPYC-Rome</model>
Nov 08 23:11:32 user nova-compute[75045]:       <model usable='no'>EPYC-Milan</model>
Nov 08 23:11:32 user nova-compute[75045]:       <model usable='no'>EPYC-IBPB</model>
Nov 08 23:11:32 user nova-compute[75045]:       <model usable='no'>EPYC</model>
Nov 08 23:11:32 user nova-compute[75045]:       <model usable='no'>Dhyana</model>
Nov 08 23:11:32 user nova-compute[75045]:       <model usable='no'>Cooperlake</model>
Nov 08 23:11:32 user nova-compute[75045]:       <model usable='no'>Conroe</model>
Nov 08 23:11:32 user nova-compute[75045]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 08 23:11:32 user nova-compute[75045]:       <model usable='no'>Cascadelake-Server</model>
Nov 08 23:11:32 user nova-compute[75045]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 08 23:11:32 user nova-compute[75045]:       <model usable='no'>Broadwell-noTSX</model>
Nov 08 23:11:32 user nova-compute[75045]:       <model usable='no'>Broadwell-IBRS</model>
Nov 08 23:11:32 user nova-compute[75045]:       <model usable='no'>Broadwell</model>
Nov 08 23:11:32 user nova-compute[75045]:       <model usable='yes'>486</model>
Nov 08 23:11:32 user nova-compute[75045]:     </mode>
Nov 08 23:11:32 user nova-compute[75045]:   </cpu>
Nov 08 23:11:32 user nova-compute[75045]:   <memoryBacking supported='yes'>
Nov 08 23:11:32 user nova-compute[75045]:     <enum name='sourceType'>
Nov 08 23:11:32 user nova-compute[75045]:       <value>file</value>
Nov 08 23:11:32 user nova-compute[75045]:       <value>anonymous</value>
Nov 08 23:11:32 user nova-compute[75045]:       <value>memfd</value>
Nov 08 23:11:32 user nova-compute[75045]:     </enum>
Nov 08 23:11:32 user nova-compute[75045]:   </memoryBacking>
Nov 08 23:11:32 user nova-compute[75045]:   <devices>
Nov 08 23:11:32 user nova-compute[75045]:     <disk supported='yes'>
Nov 08 23:11:32 user nova-compute[75045]:       <enum name='diskDevice'>
Nov 08 23:11:32 user nova-compute[75045]:         <value>disk</value>
Nov 08 23:11:32 user nova-compute[75045]:         <value>cdrom</value>
Nov 08 23:11:32 user nova-compute[75045]:         <value>floppy</value>
Nov 08 23:11:32 user nova-compute[75045]:         <value>lun</value>
Nov 08 23:11:32 user nova-compute[75045]:       </enum>
Nov 08 23:11:32 user nova-compute[75045]:       <enum name='bus'>
Nov 08 23:11:32 user nova-compute[75045]:         <value>fdc</value>
Nov 08 23:11:32 user nova-compute[75045]:         <value>scsi</value>
Nov 08 23:11:32 user nova-compute[75045]:         <value>virtio</value>
Nov 08 23:11:32 user nova-compute[75045]:         <value>usb</value>
Nov 08 23:11:32 user nova-compute[75045]:         <value>sata</value>
Nov 08 23:11:32 user nova-compute[75045]:       </enum>
Nov 08 23:11:32 user nova-compute[75045]:       <enum name='model'>
Nov 08 23:11:32 user nova-compute[75045]:         <value>virtio</value>
Nov 08 23:11:32 user nova-compute[75045]:         <value>virtio-transitional</value>
Nov 08 23:11:32 user nova-compute[75045]:         <value>virtio-non-transitional</value>
Nov 08 23:11:32 user nova-compute[75045]:       </enum>
Nov 08 23:11:32 user nova-compute[75045]:     </disk>
Nov 08 23:11:32 user nova-compute[75045]:     <graphics supported='yes'>
Nov 08 23:11:32 user nova-compute[75045]:       <enum name='type'>
Nov 08 23:11:32 user nova-compute[75045]:         <value>sdl</value>
Nov 08 23:11:32 user nova-compute[75045]:         <value>vnc</value>
Nov 08 23:11:32 user nova-compute[75045]:         <value>spice</value>
Nov 08 23:11:32 user nova-compute[75045]:         <value>egl-headless</value>
Nov 08 23:11:32 user nova-compute[75045]:       </enum>
Nov 08 23:11:32 user nova-compute[75045]:     </graphics>
Nov 08 23:11:32 user nova-compute[75045]:     <video supported='yes'>
Nov 08 23:11:32 user nova-compute[75045]:       <enum name='modelType'>
Nov 08 23:11:32 user nova-compute[75045]:         <value>vga</value>
Nov 08 23:11:32 user nova-compute[75045]:         <value>cirrus</value>
Nov 08 23:11:32 user nova-compute[75045]:         <value>vmvga</value>
Nov 08 23:11:32 user nova-compute[75045]:         <value>qxl</value>
Nov 08 23:11:32 user nova-compute[75045]:         <value>virtio</value>
Nov 08 23:11:32 user nova-compute[75045]:         <value>none</value>
Nov 08 23:11:32 user nova-compute[75045]:         <value>bochs</value>
Nov 08 23:11:32 user nova-compute[75045]:         <value>ramfb</value>
Nov 08 23:11:32 user nova-compute[75045]:       </enum>
Nov 08 23:11:32 user nova-compute[75045]:     </video>
Nov 08 23:11:32 user nova-compute[75045]:     <hostdev supported='yes'>
Nov 08 23:11:32 user nova-compute[75045]:       <enum name='mode'>
Nov 08 23:11:32 user nova-compute[75045]:         <value>subsystem</value>
Nov 08 23:11:32 user nova-compute[75045]:       </enum>
Nov 08 23:11:32 user nova-compute[75045]:       <enum name='startupPolicy'>
Nov 08 23:11:32 user nova-compute[75045]:         <value>default</value>
Nov 08 23:11:32 user nova-compute[75045]:         <value>mandatory</value>
Nov 08 23:11:32 user nova-compute[75045]:         <value>requisite</value>
Nov 08 23:11:32 user nova-compute[75045]:         <value>optional</value>
Nov 08 23:11:32 user nova-compute[75045]:       </enum>
Nov 08 23:11:32 user nova-compute[75045]:       <enum name='subsysType'>
Nov 08 23:11:32 user nova-compute[75045]:         <value>usb</value>
Nov 08 23:11:32 user nova-compute[75045]:         <value>pci</value>
Nov 08 23:11:32 user nova-compute[75045]:         <value>scsi</value>
Nov 08 23:11:32 user nova-compute[75045]:       </enum>
Nov 08 23:11:32 user nova-compute[75045]:       <enum name='capsType'/>
Nov 08 23:11:32 user nova-compute[75045]:       <enum name='pciBackend'/>
Nov 08 23:11:32 user nova-compute[75045]:     </hostdev>
Nov 08 23:11:32 user nova-compute[75045]:     <rng supported='yes'>
Nov 08 23:11:32 user nova-compute[75045]:       <enum name='model'>
Nov 08 23:11:32 user nova-compute[75045]:         <value>virtio</value>
Nov 08 23:11:32 user nova-compute[75045]:         <value>virtio-transitional</value>
Nov 08 23:11:32 user nova-compute[75045]:         <value>virtio-non-transitional</value>
Nov 08 23:11:32 user nova-compute[75045]:       </enum>
Nov 08 23:11:32 user nova-compute[75045]:       <enum name='backendModel'>
Nov 08 23:11:32 user nova-compute[75045]:         <value>random</value>
Nov 08 23:11:32 user nova-compute[75045]:         <value>egd</value>
Nov 08 23:11:32 user nova-compute[75045]:         <value>builtin</value>
Nov 08 23:11:32 user nova-compute[75045]:       </enum>
Nov 08 23:11:32 user nova-compute[75045]:     </rng>
Nov 08 23:11:32 user nova-compute[75045]:     <filesystem supported='yes'>
Nov 08 23:11:32 user nova-compute[75045]:       <enum name='driverType'>
Nov 08 23:11:32 user nova-compute[75045]:         <value>path</value>
Nov 08 23:11:32 user nova-compute[75045]:         <value>handle</value>
Nov 08 23:11:32 user nova-compute[75045]:         <value>virtiofs</value>
Nov 08 23:11:32 user nova-compute[75045]:       </enum>
Nov 08 23:11:32 user nova-compute[75045]:     </filesystem>
Nov 08 23:11:32 user nova-compute[75045]:     <tpm supported='yes'>
Nov 08 23:11:32 user nova-compute[75045]:       <enum name='model'>
Nov 08 23:11:32 user nova-compute[75045]:         <value>tpm-tis</value>
Nov 08 23:11:32 user nova-compute[75045]:         <value>tpm-crb</value>
Nov 08 23:11:32 user nova-compute[75045]:       </enum>
Nov 08 23:11:32 user nova-compute[75045]:       <enum name='backendModel'>
Nov 08 23:11:32 user nova-compute[75045]:         <value>passthrough</value>
Nov 08 23:11:32 user nova-compute[75045]:         <value>emulator</value>
Nov 08 23:11:32 user nova-compute[75045]:       </enum>
Nov 08 23:11:32 user nova-compute[75045]:     </tpm>
Nov 08 23:11:32 user nova-compute[75045]:   </devices>
Nov 08 23:11:32 user nova-compute[75045]:   <features>
Nov 08 23:11:32 user nova-compute[75045]:     <gic supported='no'/>
Nov 08 23:11:32 user nova-compute[75045]:     <vmcoreinfo supported='yes'/>
Nov 08 23:11:32 user nova-compute[75045]:     <genid supported='yes'/>
Nov 08 23:11:32 user nova-compute[75045]:     <backingStoreInput supported='yes'/>
Nov 08 23:11:32 user nova-compute[75045]:     <backup supported='yes'/>
Nov 08 23:11:32 user nova-compute[75045]:     <sev supported='no'/>
Nov 08 23:11:32 user nova-compute[75045]:   </features>
Nov 08 23:11:32 user nova-compute[75045]: </domainCapabilities>
Nov 08 23:11:32 user nova-compute[75045]:  {{(pid=75045) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 08 23:11:32 user nova-compute[75045]: DEBUG nova.virt.libvirt.host [None req-b1869e0d-6af1-4bcb-a839-fb2c1c69e58c None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=pc:
Nov 08 23:11:32 user nova-compute[75045]: <domainCapabilities>
Nov 08 23:11:32 user nova-compute[75045]:   <path>/usr/bin/qemu-system-i386</path>
Nov 08 23:11:32 user nova-compute[75045]:   <domain>kvm</domain>
Nov 08 23:11:32 user nova-compute[75045]:   <machine>pc-i440fx-6.2</machine>
Nov 08 23:11:33 user nova-compute[75045]:   <arch>i686</arch>
Nov 08 23:11:33 user nova-compute[75045]:   <vcpu max='255'/>
Nov 08 23:11:33 user nova-compute[75045]:   <iothreads supported='yes'/>
Nov 08 23:11:33 user nova-compute[75045]:   <os supported='yes'>
Nov 08 23:11:33 user nova-compute[75045]:     <enum name='firmware'/>
Nov 08 23:11:33 user nova-compute[75045]:     <loader supported='yes'>
Nov 08 23:11:33 user nova-compute[75045]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 08 23:11:33 user nova-compute[75045]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 08 23:11:33 user nova-compute[75045]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 08 23:11:33 user nova-compute[75045]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 08 23:11:33 user nova-compute[75045]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 08 23:11:33 user nova-compute[75045]:       <enum name='type'>
Nov 08 23:11:33 user nova-compute[75045]:         <value>rom</value>
Nov 08 23:11:33 user nova-compute[75045]:         <value>pflash</value>
Nov 08 23:11:33 user nova-compute[75045]:       </enum>
Nov 08 23:11:33 user nova-compute[75045]:       <enum name='readonly'>
Nov 08 23:11:33 user nova-compute[75045]:         <value>yes</value>
Nov 08 23:11:33 user nova-compute[75045]:         <value>no</value>
Nov 08 23:11:33 user nova-compute[75045]:       </enum>
Nov 08 23:11:33 user nova-compute[75045]:       <enum name='secure'>
Nov 08 23:11:33 user nova-compute[75045]:         <value>no</value>
Nov 08 23:11:33 user nova-compute[75045]:       </enum>
Nov 08 23:11:33 user nova-compute[75045]:     </loader>
Nov 08 23:11:33 user nova-compute[75045]:   </os>
Nov 08 23:11:33 user nova-compute[75045]:   <cpu>
Nov 08 23:11:33 user nova-compute[75045]:     <mode name='host-passthrough' supported='yes'>
Nov 08 23:11:33 user nova-compute[75045]:       <enum name='hostPassthroughMigratable'>
Nov 08 23:11:33 user nova-compute[75045]:         <value>off</value>
Nov 08 23:11:33 user nova-compute[75045]:       </enum>
Nov 08 23:11:33 user nova-compute[75045]:     </mode>
Nov 08 23:11:33 user nova-compute[75045]:     <mode name='maximum' supported='yes'>
Nov 08 23:11:33 user nova-compute[75045]:       <enum name='maximumMigratable'>
Nov 08 23:11:33 user nova-compute[75045]:         <value>on</value>
Nov 08 23:11:33 user nova-compute[75045]:         <value>off</value>
Nov 08 23:11:33 user nova-compute[75045]:       </enum>
Nov 08 23:11:33 user nova-compute[75045]:     </mode>
Nov 08 23:11:33 user nova-compute[75045]:     <mode name='host-model' supported='yes'>
Nov 08 23:11:33 user nova-compute[75045]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 08 23:11:33 user nova-compute[75045]:       <vendor>Intel</vendor>
Nov 08 23:11:33 user nova-compute[75045]:       <feature policy='require' name='ss'/>
Nov 08 23:11:33 user nova-compute[75045]:       <feature policy='require' name='vmx'/>
Nov 08 23:11:33 user nova-compute[75045]:       <feature policy='require' name='pcid'/>
Nov 08 23:11:33 user nova-compute[75045]:       <feature policy='require' name='hypervisor'/>
Nov 08 23:11:33 user nova-compute[75045]:       <feature policy='require' name='arat'/>
Nov 08 23:11:33 user nova-compute[75045]:       <feature policy='require' name='tsc_adjust'/>
Nov 08 23:11:33 user nova-compute[75045]:       <feature policy='require' name='umip'/>
Nov 08 23:11:33 user nova-compute[75045]:       <feature policy='require' name='md-clear'/>
Nov 08 23:11:33 user nova-compute[75045]:       <feature policy='require' name='stibp'/>
Nov 08 23:11:33 user nova-compute[75045]:       <feature policy='require' name='arch-capabilities'/>
Nov 08 23:11:33 user nova-compute[75045]:       <feature policy='require' name='ssbd'/>
Nov 08 23:11:33 user nova-compute[75045]:       <feature policy='require' name='ibpb'/>
Nov 08 23:11:33 user nova-compute[75045]:       <feature policy='require' name='ibrs'/>
Nov 08 23:11:33 user nova-compute[75045]:       <feature policy='require' name='amd-stibp'/>
Nov 08 23:11:33 user nova-compute[75045]:       <feature policy='require' name='amd-ssbd'/>
Nov 08 23:11:33 user nova-compute[75045]:       <feature policy='disable' name='erms'/>
Nov 08 23:11:33 user nova-compute[75045]:       <feature policy='disable' name='xsaveopt'/>
Nov 08 23:11:33 user nova-compute[75045]:       <feature policy='disable' name='lm'/>
Nov 08 23:11:33 user nova-compute[75045]:     </mode>
Nov 08 23:11:33 user nova-compute[75045]:     <mode name='custom' supported='yes'>
Nov 08 23:11:33 user nova-compute[75045]:       <model usable='no'>qemu64</model>
Nov 08 23:11:33 user nova-compute[75045]:       <model usable='yes'>qemu32</model>
Nov 08 23:11:33 user nova-compute[75045]:       <model usable='no'>phenom</model>
Nov 08 23:11:33 user nova-compute[75045]:       <model usable='yes'>pentium3</model>
Nov 08 23:11:33 user nova-compute[75045]:       <model usable='yes'>pentium2</model>
Nov 08 23:11:33 user nova-compute[75045]:       <model usable='yes'>pentium</model>
Nov 08 23:11:33 user nova-compute[75045]:       <model usable='no'>n270</model>
Nov 08 23:11:33 user nova-compute[75045]:       <model usable='no'>kvm64</model>
Nov 08 23:11:33 user nova-compute[75045]:       <model usable='yes'>kvm32</model>
Nov 08 23:11:33 user nova-compute[75045]:       <model usable='yes'>coreduo</model>
Nov 08 23:11:33 user nova-compute[75045]:       <model usable='no'>core2duo</model>
Nov 08 23:11:33 user nova-compute[75045]:       <model usable='no'>athlon</model>
Nov 08 23:11:33 user nova-compute[75045]:       <model usable='no'>Westmere-IBRS</model>
Nov 08 23:11:33 user nova-compute[75045]:       <model usable='no'>Westmere</model>
Nov 08 23:11:33 user nova-compute[75045]:       <model usable='no'>Snowridge</model>
Nov 08 23:11:33 user nova-compute[75045]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 08 23:11:33 user nova-compute[75045]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 08 23:11:33 user nova-compute[75045]:       <model usable='no'>Skylake-Server</model>
Nov 08 23:11:33 user nova-compute[75045]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 08 23:11:33 user nova-compute[75045]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 08 23:11:33 user nova-compute[75045]:       <model usable='no'>Skylake-Client</model>
Nov 08 23:11:33 user nova-compute[75045]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 08 23:11:33 user nova-compute[75045]:       <model usable='no'>SandyBridge</model>
Nov 08 23:11:33 user nova-compute[75045]:       <model usable='no'>Penryn</model>
Nov 08 23:11:33 user nova-compute[75045]:       <model usable='no'>Opteron_G5</model>
Nov 08 23:11:33 user nova-compute[75045]:       <model usable='no'>Opteron_G4</model>
Nov 08 23:11:33 user nova-compute[75045]:       <model usable='no'>Opteron_G3</model>
Nov 08 23:11:33 user nova-compute[75045]:       <model usable='no'>Opteron_G2</model>
Nov 08 23:11:33 user nova-compute[75045]:       <model usable='no'>Opteron_G1</model>
Nov 08 23:11:33 user nova-compute[75045]:       <model usable='no'>Nehalem-IBRS</model>
Nov 08 23:11:33 user nova-compute[75045]:       <model usable='no'>Nehalem</model>
Nov 08 23:11:33 user nova-compute[75045]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 08 23:11:33 user nova-compute[75045]:       <model usable='no'>IvyBridge</model>
Nov 08 23:11:33 user nova-compute[75045]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 08 23:11:33 user nova-compute[75045]:       <model usable='no'>Icelake-Server</model>
Nov 08 23:11:33 user nova-compute[75045]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 08 23:11:33 user nova-compute[75045]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 08 23:11:33 user nova-compute[75045]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 08 23:11:33 user nova-compute[75045]:       <model usable='no'>Haswell-noTSX</model>
Nov 08 23:11:33 user nova-compute[75045]:       <model usable='no'>Haswell-IBRS</model>
Nov 08 23:11:33 user nova-compute[75045]:       <model usable='no'>Haswell</model>
Nov 08 23:11:33 user nova-compute[75045]:       <model usable='no'>EPYC-Rome</model>
Nov 08 23:11:33 user nova-compute[75045]:       <model usable='no'>EPYC-Milan</model>
Nov 08 23:11:33 user nova-compute[75045]:       <model usable='no'>EPYC-IBPB</model>
Nov 08 23:11:33 user nova-compute[75045]:       <model usable='no'>EPYC</model>
Nov 08 23:11:33 user nova-compute[75045]:       <model usable='no'>Dhyana</model>
Nov 08 23:11:33 user nova-compute[75045]:       <model usable='no'>Cooperlake</model>
Nov 08 23:11:33 user nova-compute[75045]:       <model usable='no'>Conroe</model>
Nov 08 23:11:33 user nova-compute[75045]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 08 23:11:33 user nova-compute[75045]:       <model usable='no'>Cascadelake-Server</model>
Nov 08 23:11:33 user nova-compute[75045]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 08 23:11:33 user nova-compute[75045]:       <model usable='no'>Broadwell-noTSX</model>
Nov 08 23:11:33 user nova-compute[75045]:       <model usable='no'>Broadwell-IBRS</model>
Nov 08 23:11:33 user nova-compute[75045]:       <model usable='no'>Broadwell</model>
Nov 08 23:11:33 user nova-compute[75045]:       <model usable='yes'>486</model>
Nov 08 23:11:33 user nova-compute[75045]:     </mode>
Nov 08 23:11:33 user nova-compute[75045]:   </cpu>
Nov 08 23:11:33 user nova-compute[75045]:   <memoryBacking supported='yes'>
Nov 08 23:11:33 user nova-compute[75045]:     <enum name='sourceType'>
Nov 08 23:11:33 user nova-compute[75045]:       <value>file</value>
Nov 08 23:11:33 user nova-compute[75045]:       <value>anonymous</value>
Nov 08 23:11:33 user nova-compute[75045]:       <value>memfd</value>
Nov 08 23:11:33 user nova-compute[75045]:     </enum>
Nov 08 23:11:33 user nova-compute[75045]:   </memoryBacking>
Nov 08 23:11:33 user nova-compute[75045]:   <devices>
Nov 08 23:11:33 user nova-compute[75045]:     <disk supported='yes'>
Nov 08 23:11:33 user nova-compute[75045]:       <enum name='diskDevice'>
Nov 08 23:11:33 user nova-compute[75045]:         <value>disk</value>
Nov 08 23:11:33 user nova-compute[75045]:         <value>cdrom</value>
Nov 08 23:11:33 user nova-compute[75045]:         <value>floppy</value>
Nov 08 23:11:33 user nova-compute[75045]:         <value>lun</value>
Nov 08 23:11:33 user nova-compute[75045]:       </enum>
Nov 08 23:11:33 user nova-compute[75045]:       <enum name='bus'>
Nov 08 23:11:33 user nova-compute[75045]:         <value>ide</value>
Nov 08 23:11:33 user nova-compute[75045]:         <value>fdc</value>
Nov 08 23:11:33 user nova-compute[75045]:         <value>scsi</value>
Nov 08 23:11:33 user nova-compute[75045]:         <value>virtio</value>
Nov 08 23:11:33 user nova-compute[75045]:         <value>usb</value>
Nov 08 23:11:33 user nova-compute[75045]:         <value>sata</value>
Nov 08 23:11:33 user nova-compute[75045]:       </enum>
Nov 08 23:11:33 user nova-compute[75045]:       <enum name='model'>
Nov 08 23:11:33 user nova-compute[75045]:         <value>virtio</value>
Nov 08 23:11:33 user nova-compute[75045]:         <value>virtio-transitional</value>
Nov 08 23:11:33 user nova-compute[75045]:         <value>virtio-non-transitional</value>
Nov 08 23:11:33 user nova-compute[75045]:       </enum>
Nov 08 23:11:33 user nova-compute[75045]:     </disk>
Nov 08 23:11:33 user nova-compute[75045]:     <graphics supported='yes'>
Nov 08 23:11:33 user nova-compute[75045]:       <enum name='type'>
Nov 08 23:11:33 user nova-compute[75045]:         <value>sdl</value>
Nov 08 23:11:33 user nova-compute[75045]:         <value>vnc</value>
Nov 08 23:11:33 user nova-compute[75045]:         <value>spice</value>
Nov 08 23:11:33 user nova-compute[75045]:         <value>egl-headless</value>
Nov 08 23:11:33 user nova-compute[75045]:       </enum>
Nov 08 23:11:33 user nova-compute[75045]:     </graphics>
Nov 08 23:11:33 user nova-compute[75045]:     <video supported='yes'>
Nov 08 23:11:33 user nova-compute[75045]:       <enum name='modelType'>
Nov 08 23:11:33 user nova-compute[75045]:         <value>vga</value>
Nov 08 23:11:33 user nova-compute[75045]:         <value>cirrus</value>
Nov 08 23:11:33 user nova-compute[75045]:         <value>vmvga</value>
Nov 08 23:11:33 user nova-compute[75045]:         <value>qxl</value>
Nov 08 23:11:33 user nova-compute[75045]:         <value>virtio</value>
Nov 08 23:11:33 user nova-compute[75045]:         <value>none</value>
Nov 08 23:11:33 user nova-compute[75045]:         <value>bochs</value>
Nov 08 23:11:33 user nova-compute[75045]:         <value>ramfb</value>
Nov 08 23:11:33 user nova-compute[75045]:       </enum>
Nov 08 23:11:33 user nova-compute[75045]:     </video>
Nov 08 23:11:33 user nova-compute[75045]:     <hostdev supported='yes'>
Nov 08 23:11:33 user nova-compute[75045]:       <enum name='mode'>
Nov 08 23:11:33 user nova-compute[75045]:         <value>subsystem</value>
Nov 08 23:11:33 user nova-compute[75045]:       </enum>
Nov 08 23:11:33 user nova-compute[75045]:       <enum name='startupPolicy'>
Nov 08 23:11:33 user nova-compute[75045]:         <value>default</value>
Nov 08 23:11:33 user nova-compute[75045]:         <value>mandatory</value>
Nov 08 23:11:33 user nova-compute[75045]:         <value>requisite</value>
Nov 08 23:11:33 user nova-compute[75045]:         <value>optional</value>
Nov 08 23:11:33 user nova-compute[75045]:       </enum>
Nov 08 23:11:33 user nova-compute[75045]:       <enum name='subsysType'>
Nov 08 23:11:33 user nova-compute[75045]:         <value>usb</value>
Nov 08 23:11:33 user nova-compute[75045]:         <value>pci</value>
Nov 08 23:11:33 user nova-compute[75045]:         <value>scsi</value>
Nov 08 23:11:33 user nova-compute[75045]:       </enum>
Nov 08 23:11:33 user nova-compute[75045]:       <enum name='capsType'/>
Nov 08 23:11:33 user nova-compute[75045]:       <enum name='pciBackend'/>
Nov 08 23:11:33 user nova-compute[75045]:     </hostdev>
Nov 08 23:11:33 user nova-compute[75045]:     <rng supported='yes'>
Nov 08 23:11:33 user nova-compute[75045]:       <enum name='model'>
Nov 08 23:11:33 user nova-compute[75045]:         <value>virtio</value>
Nov 08 23:11:33 user nova-compute[75045]:         <value>virtio-transitional</value>
Nov 08 23:11:33 user nova-compute[75045]:         <value>virtio-non-transitional</value>
Nov 08 23:11:33 user nova-compute[75045]:       </enum>
Nov 08 23:11:33 user nova-compute[75045]:       <enum name='backendModel'>
Nov 08 23:11:33 user nova-compute[75045]:         <value>random</value>
Nov 08 23:11:33 user nova-compute[75045]:         <value>egd</value>
Nov 08 23:11:33 user nova-compute[75045]:         <value>builtin</value>
Nov 08 23:11:33 user nova-compute[75045]:       </enum>
Nov 08 23:11:33 user nova-compute[75045]:     </rng>
Nov 08 23:11:33 user nova-compute[75045]:     <filesystem supported='yes'>
Nov 08 23:11:33 user nova-compute[75045]:       <enum name='driverType'>
Nov 08 23:11:33 user nova-compute[75045]:         <value>path</value>
Nov 08 23:11:33 user nova-compute[75045]:         <value>handle</value>
Nov 08 23:11:33 user nova-compute[75045]:         <value>virtiofs</value>
Nov 08 23:11:33 user nova-compute[75045]:       </enum>
Nov 08 23:11:33 user nova-compute[75045]:     </filesystem>
Nov 08 23:11:33 user nova-compute[75045]:     <tpm supported='yes'>
Nov 08 23:11:33 user nova-compute[75045]:       <enum name='model'>
Nov 08 23:11:33 user nova-compute[75045]:         <value>tpm-tis</value>
Nov 08 23:11:33 user nova-compute[75045]:         <value>tpm-crb</value>
Nov 08 23:11:33 user nova-compute[75045]:       </enum>
Nov 08 23:11:33 user nova-compute[75045]:       <enum name='backendModel'>
Nov 08 23:11:33 user nova-compute[75045]:         <value>passthrough</value>
Nov 08 23:11:33 user nova-compute[75045]:         <value>emulator</value>
Nov 08 23:11:33 user nova-compute[75045]:       </enum>
Nov 08 23:11:33 user nova-compute[75045]:     </tpm>
Nov 08 23:11:33 user nova-compute[75045]:   </devices>
Nov 08 23:11:33 user nova-compute[75045]:   <features>
Nov 08 23:11:33 user nova-compute[75045]:     <gic supported='no'/>
Nov 08 23:11:33 user nova-compute[75045]:     <vmcoreinfo supported='yes'/>
Nov 08 23:11:33 user nova-compute[75045]:     <genid supported='yes'/>
Nov 08 23:11:33 user nova-compute[75045]:     <backingStoreInput supported='yes'/>
Nov 08 23:11:33 user nova-compute[75045]:     <backup supported='yes'/>
Nov 08 23:11:33 user nova-compute[75045]:     <sev supported='no'/>
Nov 08 23:11:33 user nova-compute[75045]:   </features>
Nov 08 23:11:33 user nova-compute[75045]: </domainCapabilities>
Nov 08 23:11:33 user nova-compute[75045]:  {{(pid=75045) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 08 23:11:33 user nova-compute[75045]: DEBUG nova.virt.libvirt.host [None req-b1869e0d-6af1-4bcb-a839-fb2c1c69e58c None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=q35:
Nov 08 23:11:33 user nova-compute[75045]: <domainCapabilities>
Nov 08 23:11:33 user nova-compute[75045]:   <path>/usr/bin/qemu-system-i386</path>
Nov 08 23:11:33 user nova-compute[75045]:   <domain>kvm</domain>
Nov 08 23:11:33 user nova-compute[75045]:   <machine>pc-q35-6.2</machine>
Nov 08 23:11:33 user nova-compute[75045]:   <arch>i686</arch>
Nov 08 23:11:33 user nova-compute[75045]:   <vcpu max='288'/>
Nov 08 23:11:33 user nova-compute[75045]:   <iothreads supported='yes'/>
Nov 08 23:11:33 user nova-compute[75045]:   <os supported='yes'>
Nov 08 23:11:33 user nova-compute[75045]:     <enum name='firmware'/>
Nov 08 23:11:33 user nova-compute[75045]:     <loader supported='yes'>
Nov 08 23:11:33 user nova-compute[75045]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 08 23:11:33 user nova-compute[75045]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 08 23:11:33 user nova-compute[75045]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 08 23:11:33 user nova-compute[75045]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 08 23:11:33 user nova-compute[75045]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 08 23:11:33 user nova-compute[75045]:       <enum name='type'>
Nov 08 23:11:33 user nova-compute[75045]:         <value>rom</value>
Nov 08 23:11:33 user nova-compute[75045]:         <value>pflash</value>
Nov 08 23:11:33 user nova-compute[75045]:       </enum>
Nov 08 23:11:33 user nova-compute[75045]:       <enum name='readonly'>
Nov 08 23:11:33 user nova-compute[75045]:         <value>yes</value>
Nov 08 23:11:33 user nova-compute[75045]:         <value>no</value>
Nov 08 23:11:33 user nova-compute[75045]:       </enum>
Nov 08 23:11:33 user nova-compute[75045]:       <enum name='secure'>
Nov 08 23:11:33 user nova-compute[75045]:         <value>no</value>
Nov 08 23:11:33 user nova-compute[75045]:       </enum>
Nov 08 23:11:33 user nova-compute[75045]:     </loader>
Nov 08 23:11:33 user nova-compute[75045]:   </os>
Nov 08 23:11:33 user nova-compute[75045]:   <cpu>
Nov 08 23:11:33 user nova-compute[75045]:     <mode name='host-passthrough' supported='yes'>
Nov 08 23:11:33 user nova-compute[75045]:       <enum name='hostPassthroughMigratable'>
Nov 08 23:11:33 user nova-compute[75045]:         <value>off</value>
Nov 08 23:11:33 user nova-compute[75045]:       </enum>
Nov 08 23:11:33 user nova-compute[75045]:     </mode>
Nov 08 23:11:33 user nova-compute[75045]:     <mode name='maximum' supported='yes'>
Nov 08 23:11:33 user nova-compute[75045]:       <enum name='maximumMigratable'>
Nov 08 23:11:33 user nova-compute[75045]:         <value>on</value>
Nov 08 23:11:33 user nova-compute[75045]:         <value>off</value>
Nov 08 23:11:33 user nova-compute[75045]:       </enum>
Nov 08 23:11:33 user nova-compute[75045]:     </mode>
Nov 08 23:11:33 user nova-compute[75045]:     <mode name='host-model' supported='yes'>
Nov 08 23:11:33 user nova-compute[75045]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 08 23:11:33 user nova-compute[75045]:       <vendor>Intel</vendor>
Nov 08 23:11:33 user nova-compute[75045]:       <feature policy='require' name='ss'/>
Nov 08 23:11:33 user nova-compute[75045]:       <feature policy='require' name='vmx'/>
Nov 08 23:11:33 user nova-compute[75045]:       <feature policy='require' name='pcid'/>
Nov 08 23:11:33 user nova-compute[75045]:       <feature policy='require' name='hypervisor'/>
Nov 08 23:11:33 user nova-compute[75045]:       <feature policy='require' name='arat'/>
Nov 08 23:11:33 user nova-compute[75045]:       <feature policy='require' name='tsc_adjust'/>
Nov 08 23:11:33 user nova-compute[75045]:       <feature policy='require' name='umip'/>
Nov 08 23:11:33 user nova-compute[75045]:       <feature policy='require' name='md-clear'/>
Nov 08 23:11:33 user nova-compute[75045]:       <feature policy='require' name='stibp'/>
Nov 08 23:11:33 user nova-compute[75045]:       <feature policy='require' name='arch-capabilities'/>
Nov 08 23:11:33 user nova-compute[75045]:       <feature policy='require' name='ssbd'/>
Nov 08 23:11:33 user nova-compute[75045]:       <feature policy='require' name='ibpb'/>
Nov 08 23:11:33 user nova-compute[75045]:       <feature policy='require' name='ibrs'/>
Nov 08 23:11:33 user nova-compute[75045]:       <feature policy='require' name='amd-stibp'/>
Nov 08 23:11:33 user nova-compute[75045]:       <feature policy='require' name='amd-ssbd'/>
Nov 08 23:11:33 user nova-compute[75045]:       <feature policy='disable' name='erms'/>
Nov 08 23:11:33 user nova-compute[75045]:       <feature policy='disable' name='xsaveopt'/>
Nov 08 23:11:33 user nova-compute[75045]:       <feature policy='disable' name='lm'/>
Nov 08 23:11:33 user nova-compute[75045]:     </mode>
Nov 08 23:11:33 user nova-compute[75045]:     <mode name='custom' supported='yes'>
Nov 08 23:11:33 user nova-compute[75045]:       <model usable='no'>qemu64</model>
Nov 08 23:11:33 user nova-compute[75045]:       <model usable='yes'>qemu32</model>
Nov 08 23:11:33 user nova-compute[75045]:       <model usable='no'>phenom</model>
Nov 08 23:11:33 user nova-compute[75045]:       <model usable='yes'>pentium3</model>
Nov 08 23:11:33 user nova-compute[75045]:       <model usable='yes'>pentium2</model>
Nov 08 23:11:33 user nova-compute[75045]:       <model usable='yes'>pentium</model>
Nov 08 23:11:33 user nova-compute[75045]:       <model usable='no'>n270</model>
Nov 08 23:11:33 user nova-compute[75045]:       <model usable='no'>kvm64</model>
Nov 08 23:11:33 user nova-compute[75045]:       <model usable='yes'>kvm32</model>
Nov 08 23:11:33 user nova-compute[75045]:       <model usable='yes'>coreduo</model>
Nov 08 23:11:33 user nova-compute[75045]:       <model usable='no'>core2duo</model>
Nov 08 23:11:33 user nova-compute[75045]:       <model usable='no'>athlon</model>
Nov 08 23:11:33 user nova-compute[75045]:       <model usable='no'>Westmere-IBRS</model>
Nov 08 23:11:33 user nova-compute[75045]:       <model usable='no'>Westmere</model>
Nov 08 23:11:33 user nova-compute[75045]:       <model usable='no'>Snowridge</model>
Nov 08 23:11:33 user nova-compute[75045]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 08 23:11:33 user nova-compute[75045]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 08 23:11:33 user nova-compute[75045]:       <model usable='no'>Skylake-Server</model>
Nov 08 23:11:33 user nova-compute[75045]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 08 23:11:33 user nova-compute[75045]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 08 23:11:33 user nova-compute[75045]:       <model usable='no'>Skylake-Client</model>
Nov 08 23:11:33 user nova-compute[75045]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 08 23:11:33 user nova-compute[75045]:       <model usable='no'>SandyBridge</model>
Nov 08 23:11:33 user nova-compute[75045]:       <model usable='no'>Penryn</model>
Nov 08 23:11:33 user nova-compute[75045]:       <model usable='no'>Opteron_G5</model>
Nov 08 23:11:33 user nova-compute[75045]:       <model usable='no'>Opteron_G4</model>
Nov 08 23:11:33 user nova-compute[75045]:       <model usable='no'>Opteron_G3</model>
Nov 08 23:11:33 user nova-compute[75045]:       <model usable='no'>Opteron_G2</model>
Nov 08 23:11:33 user nova-compute[75045]:       <model usable='no'>Opteron_G1</model>
Nov 08 23:11:33 user nova-compute[75045]:       <model usable='no'>Nehalem-IBRS</model>
Nov 08 23:11:33 user nova-compute[75045]:       <model usable='no'>Nehalem</model>
Nov 08 23:11:33 user nova-compute[75045]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 08 23:11:33 user nova-compute[75045]:       <model usable='no'>IvyBridge</model>
Nov 08 23:11:33 user nova-compute[75045]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 08 23:11:33 user nova-compute[75045]:       <model usable='no'>Icelake-Server</model>
Nov 08 23:11:33 user nova-compute[75045]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 08 23:11:33 user nova-compute[75045]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 08 23:11:33 user nova-compute[75045]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 08 23:11:33 user nova-compute[75045]:       <model usable='no'>Haswell-noTSX</model>
Nov 08 23:11:33 user nova-compute[75045]:       <model usable='no'>Haswell-IBRS</model>
Nov 08 23:11:33 user nova-compute[75045]:       <model usable='no'>Haswell</model>
Nov 08 23:11:33 user nova-compute[75045]:       <model usable='no'>EPYC-Rome</model>
Nov 08 23:11:33 user nova-compute[75045]:       <model usable='no'>EPYC-Milan</model>
Nov 08 23:11:33 user nova-compute[75045]:       <model usable='no'>EPYC-IBPB</model>
Nov 08 23:11:33 user nova-compute[75045]:       <model usable='no'>EPYC</model>
Nov 08 23:11:33 user nova-compute[75045]:       <model usable='no'>Dhyana</model>
Nov 08 23:11:33 user nova-compute[75045]:       <model usable='no'>Cooperlake</model>
Nov 08 23:11:33 user nova-compute[75045]:       <model usable='no'>Conroe</model>
Nov 08 23:11:33 user nova-compute[75045]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 08 23:11:33 user nova-compute[75045]:       <model usable='no'>Cascadelake-Server</model>
Nov 08 23:11:33 user nova-compute[75045]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 08 23:11:33 user nova-compute[75045]:       <model usable='no'>Broadwell-noTSX</model>
Nov 08 23:11:33 user nova-compute[75045]:       <model usable='no'>Broadwell-IBRS</model>
Nov 08 23:11:33 user nova-compute[75045]:       <model usable='no'>Broadwell</model>
Nov 08 23:11:33 user nova-compute[75045]:       <model usable='yes'>486</model>
Nov 08 23:11:33 user nova-compute[75045]:     </mode>
Nov 08 23:11:33 user nova-compute[75045]:   </cpu>
Nov 08 23:11:33 user nova-compute[75045]:   <memoryBacking supported='yes'>
Nov 08 23:11:33 user nova-compute[75045]:     <enum name='sourceType'>
Nov 08 23:11:33 user nova-compute[75045]:       <value>file</value>
Nov 08 23:11:33 user nova-compute[75045]:       <value>anonymous</value>
Nov 08 23:11:33 user nova-compute[75045]:       <value>memfd</value>
Nov 08 23:11:33 user nova-compute[75045]:     </enum>
Nov 08 23:11:33 user nova-compute[75045]:   </memoryBacking>
Nov 08 23:11:33 user nova-compute[75045]:   <devices>
Nov 08 23:11:33 user nova-compute[75045]:     <disk supported='yes'>
Nov 08 23:11:33 user nova-compute[75045]:       <enum name='diskDevice'>
Nov 08 23:11:33 user nova-compute[75045]:         <value>disk</value>
Nov 08 23:11:33 user nova-compute[75045]:         <value>cdrom</value>
Nov 08 23:11:33 user nova-compute[75045]:         <value>floppy</value>
Nov 08 23:11:33 user nova-compute[75045]:         <value>lun</value>
Nov 08 23:11:33 user nova-compute[75045]:       </enum>
Nov 08 23:11:33 user nova-compute[75045]:       <enum name='bus'>
Nov 08 23:11:33 user nova-compute[75045]:         <value>fdc</value>
Nov 08 23:11:33 user nova-compute[75045]:         <value>scsi</value>
Nov 08 23:11:33 user nova-compute[75045]:         <value>virtio</value>
Nov 08 23:11:33 user nova-compute[75045]:         <value>usb</value>
Nov 08 23:11:33 user nova-compute[75045]:         <value>sata</value>
Nov 08 23:11:33 user nova-compute[75045]:       </enum>
Nov 08 23:11:33 user nova-compute[75045]:       <enum name='model'>
Nov 08 23:11:33 user nova-compute[75045]:         <value>virtio</value>
Nov 08 23:11:33 user nova-compute[75045]:         <value>virtio-transitional</value>
Nov 08 23:11:33 user nova-compute[75045]:         <value>virtio-non-transitional</value>
Nov 08 23:11:33 user nova-compute[75045]:       </enum>
Nov 08 23:11:33 user nova-compute[75045]:     </disk>
Nov 08 23:11:33 user nova-compute[75045]:     <graphics supported='yes'>
Nov 08 23:11:33 user nova-compute[75045]:       <enum name='type'>
Nov 08 23:11:33 user nova-compute[75045]:         <value>sdl</value>
Nov 08 23:11:33 user nova-compute[75045]:         <value>vnc</value>
Nov 08 23:11:33 user nova-compute[75045]:         <value>spice</value>
Nov 08 23:11:33 user nova-compute[75045]:         <value>egl-headless</value>
Nov 08 23:11:33 user nova-compute[75045]:       </enum>
Nov 08 23:11:33 user nova-compute[75045]:     </graphics>
Nov 08 23:11:33 user nova-compute[75045]:     <video supported='yes'>
Nov 08 23:11:33 user nova-compute[75045]:       <enum name='modelType'>
Nov 08 23:11:33 user nova-compute[75045]:         <value>vga</value>
Nov 08 23:11:33 user nova-compute[75045]:         <value>cirrus</value>
Nov 08 23:11:33 user nova-compute[75045]:         <value>vmvga</value>
Nov 08 23:11:33 user nova-compute[75045]:         <value>qxl</value>
Nov 08 23:11:33 user nova-compute[75045]:         <value>virtio</value>
Nov 08 23:11:33 user nova-compute[75045]:         <value>none</value>
Nov 08 23:11:33 user nova-compute[75045]:         <value>bochs</value>
Nov 08 23:11:33 user nova-compute[75045]:         <value>ramfb</value>
Nov 08 23:11:33 user nova-compute[75045]:       </enum>
Nov 08 23:11:33 user nova-compute[75045]:     </video>
Nov 08 23:11:33 user nova-compute[75045]:     <hostdev supported='yes'>
Nov 08 23:11:33 user nova-compute[75045]:       <enum name='mode'>
Nov 08 23:11:33 user nova-compute[75045]:         <value>subsystem</value>
Nov 08 23:11:33 user nova-compute[75045]:       </enum>
Nov 08 23:11:33 user nova-compute[75045]:       <enum name='startupPolicy'>
Nov 08 23:11:33 user nova-compute[75045]:         <value>default</value>
Nov 08 23:11:33 user nova-compute[75045]:         <value>mandatory</value>
Nov 08 23:11:33 user nova-compute[75045]:         <value>requisite</value>
Nov 08 23:11:33 user nova-compute[75045]:         <value>optional</value>
Nov 08 23:11:33 user nova-compute[75045]:       </enum>
Nov 08 23:11:33 user nova-compute[75045]:       <enum name='subsysType'>
Nov 08 23:11:33 user nova-compute[75045]:         <value>usb</value>
Nov 08 23:11:33 user nova-compute[75045]:         <value>pci</value>
Nov 08 23:11:33 user nova-compute[75045]:         <value>scsi</value>
Nov 08 23:11:33 user nova-compute[75045]:       </enum>
Nov 08 23:11:33 user nova-compute[75045]:       <enum name='capsType'/>
Nov 08 23:11:33 user nova-compute[75045]:       <enum name='pciBackend'/>
Nov 08 23:11:33 user nova-compute[75045]:     </hostdev>
Nov 08 23:11:33 user nova-compute[75045]:     <rng supported='yes'>
Nov 08 23:11:33 user nova-compute[75045]:       <enum name='model'>
Nov 08 23:11:33 user nova-compute[75045]:         <value>virtio</value>
Nov 08 23:11:33 user nova-compute[75045]:         <value>virtio-transitional</value>
Nov 08 23:11:33 user nova-compute[75045]:         <value>virtio-non-transitional</value>
Nov 08 23:11:33 user nova-compute[75045]:       </enum>
Nov 08 23:11:33 user nova-compute[75045]:       <enum name='backendModel'>
Nov 08 23:11:33 user nova-compute[75045]:         <value>random</value>
Nov 08 23:11:33 user nova-compute[75045]:         <value>egd</value>
Nov 08 23:11:33 user nova-compute[75045]:         <value>builtin</value>
Nov 08 23:11:33 user nova-compute[75045]:       </enum>
Nov 08 23:11:33 user nova-compute[75045]:     </rng>
Nov 08 23:11:33 user nova-compute[75045]:     <filesystem supported='yes'>
Nov 08 23:11:33 user nova-compute[75045]:       <enum name='driverType'>
Nov 08 23:11:33 user nova-compute[75045]:         <value>path</value>
Nov 08 23:11:33 user nova-compute[75045]:         <value>handle</value>
Nov 08 23:11:33 user nova-compute[75045]:         <value>virtiofs</value>
Nov 08 23:11:33 user nova-compute[75045]:       </enum>
Nov 08 23:11:33 user nova-compute[75045]:     </filesystem>
Nov 08 23:11:33 user nova-compute[75045]:     <tpm supported='yes'>
Nov 08 23:11:33 user nova-compute[75045]:       <enum name='model'>
Nov 08 23:11:33 user nova-compute[75045]:         <value>tpm-tis</value>
Nov 08 23:11:33 user nova-compute[75045]:         <value>tpm-crb</value>
Nov 08 23:11:33 user nova-compute[75045]:       </enum>
Nov 08 23:11:33 user nova-compute[75045]:       <enum name='backendModel'>
Nov 08 23:11:33 user nova-compute[75045]:         <value>passthrough</value>
Nov 08 23:11:33 user nova-compute[75045]:         <value>emulator</value>
Nov 08 23:11:33 user nova-compute[75045]:       </enum>
Nov 08 23:11:33 user nova-compute[75045]:     </tpm>
Nov 08 23:11:33 user nova-compute[75045]:   </devices>
Nov 08 23:11:33 user nova-compute[75045]:   <features>
Nov 08 23:11:33 user nova-compute[75045]:     <gic supported='no'/>
Nov 08 23:11:33 user nova-compute[75045]:     <vmcoreinfo supported='yes'/>
Nov 08 23:11:33 user nova-compute[75045]:     <genid supported='yes'/>
Nov 08 23:11:33 user nova-compute[75045]:     <backingStoreInput supported='yes'/>
Nov 08 23:11:33 user nova-compute[75045]:     <backup supported='yes'/>
Nov 08 23:11:33 user nova-compute[75045]:     <sev supported='no'/>
Nov 08 23:11:33 user nova-compute[75045]:   </features>
Nov 08 23:11:33 user nova-compute[75045]: </domainCapabilities>
Nov 08 23:11:33 user nova-compute[75045]:  {{(pid=75045) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 08 23:11:33 user nova-compute[75045]: DEBUG nova.virt.libvirt.host [None req-b1869e0d-6af1-4bcb-a839-fb2c1c69e58c None None] Getting domain capabilities for m68k via machine types: {'virt', None} {{(pid=75045) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 08 23:11:33 user nova-compute[75045]: DEBUG nova.virt.libvirt.host [None req-b1869e0d-6af1-4bcb-a839-fb2c1c69e58c None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=75045) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 08 23:11:33 user nova-compute[75045]: DEBUG nova.virt.libvirt.host [None req-b1869e0d-6af1-4bcb-a839-fb2c1c69e58c None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=75045) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 08 23:11:33 user nova-compute[75045]: DEBUG nova.virt.libvirt.host [None req-b1869e0d-6af1-4bcb-a839-fb2c1c69e58c None None] Getting domain capabilities for microblaze via machine types: {None} {{(pid=75045) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 08 23:11:33 user nova-compute[75045]: DEBUG nova.virt.libvirt.host [None req-b1869e0d-6af1-4bcb-a839-fb2c1c69e58c None None] Error from libvirt when retrieving domain capabilities for arch microblaze / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblaze' on this host {{(pid=75045) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 08 23:11:33 user nova-compute[75045]: DEBUG nova.virt.libvirt.host [None req-b1869e0d-6af1-4bcb-a839-fb2c1c69e58c None None] Getting domain capabilities for microblazeel via machine types: {None} {{(pid=75045) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 08 23:11:33 user nova-compute[75045]: DEBUG nova.virt.libvirt.host [None req-b1869e0d-6af1-4bcb-a839-fb2c1c69e58c None None] Error from libvirt when retrieving domain capabilities for arch microblazeel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblazeel' on this host {{(pid=75045) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 08 23:11:33 user nova-compute[75045]: DEBUG nova.virt.libvirt.host [None req-b1869e0d-6af1-4bcb-a839-fb2c1c69e58c None None] Getting domain capabilities for mips via machine types: {None} {{(pid=75045) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 08 23:11:33 user nova-compute[75045]: DEBUG nova.virt.libvirt.host [None req-b1869e0d-6af1-4bcb-a839-fb2c1c69e58c None None] Error from libvirt when retrieving domain capabilities for arch mips / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips' on this host {{(pid=75045) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 08 23:11:33 user nova-compute[75045]: DEBUG nova.virt.libvirt.host [None req-b1869e0d-6af1-4bcb-a839-fb2c1c69e58c None None] Getting domain capabilities for mipsel via machine types: {None} {{(pid=75045) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 08 23:11:33 user nova-compute[75045]: DEBUG nova.virt.libvirt.host [None req-b1869e0d-6af1-4bcb-a839-fb2c1c69e58c None None] Error from libvirt when retrieving domain capabilities for arch mipsel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mipsel' on this host {{(pid=75045) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 08 23:11:33 user nova-compute[75045]: DEBUG nova.virt.libvirt.host [None req-b1869e0d-6af1-4bcb-a839-fb2c1c69e58c None None] Getting domain capabilities for mips64 via machine types: {None} {{(pid=75045) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 08 23:11:33 user nova-compute[75045]: DEBUG nova.virt.libvirt.host [None req-b1869e0d-6af1-4bcb-a839-fb2c1c69e58c None None] Error from libvirt when retrieving domain capabilities for arch mips64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64' on this host {{(pid=75045) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 08 23:11:33 user nova-compute[75045]: DEBUG nova.virt.libvirt.host [None req-b1869e0d-6af1-4bcb-a839-fb2c1c69e58c None None] Getting domain capabilities for mips64el via machine types: {None} {{(pid=75045) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 08 23:11:33 user nova-compute[75045]: DEBUG nova.virt.libvirt.host [None req-b1869e0d-6af1-4bcb-a839-fb2c1c69e58c None None] Error from libvirt when retrieving domain capabilities for arch mips64el / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64el' on this host {{(pid=75045) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 08 23:11:33 user nova-compute[75045]: DEBUG nova.virt.libvirt.host [None req-b1869e0d-6af1-4bcb-a839-fb2c1c69e58c None None] Getting domain capabilities for ppc via machine types: {None} {{(pid=75045) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 08 23:11:33 user nova-compute[75045]: DEBUG nova.virt.libvirt.host [None req-b1869e0d-6af1-4bcb-a839-fb2c1c69e58c None None] Error from libvirt when retrieving domain capabilities for arch ppc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc' on this host {{(pid=75045) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 08 23:11:33 user nova-compute[75045]: DEBUG nova.virt.libvirt.host [None req-b1869e0d-6af1-4bcb-a839-fb2c1c69e58c None None] Getting domain capabilities for ppc64 via machine types: {'powernv', 'pseries', None} {{(pid=75045) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 08 23:11:33 user nova-compute[75045]: DEBUG nova.virt.libvirt.host [None req-b1869e0d-6af1-4bcb-a839-fb2c1c69e58c None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=75045) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 08 23:11:33 user nova-compute[75045]: DEBUG nova.virt.libvirt.host [None req-b1869e0d-6af1-4bcb-a839-fb2c1c69e58c None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=75045) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 08 23:11:33 user nova-compute[75045]: DEBUG nova.virt.libvirt.host [None req-b1869e0d-6af1-4bcb-a839-fb2c1c69e58c None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=75045) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 08 23:11:33 user nova-compute[75045]: DEBUG nova.virt.libvirt.host [None req-b1869e0d-6af1-4bcb-a839-fb2c1c69e58c None None] Getting domain capabilities for ppc64le via machine types: {'powernv', 'pseries'} {{(pid=75045) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 08 23:11:33 user nova-compute[75045]: DEBUG nova.virt.libvirt.host [None req-b1869e0d-6af1-4bcb-a839-fb2c1c69e58c None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=75045) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 08 23:11:33 user nova-compute[75045]: DEBUG nova.virt.libvirt.host [None req-b1869e0d-6af1-4bcb-a839-fb2c1c69e58c None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=75045) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 08 23:11:33 user nova-compute[75045]: DEBUG nova.virt.libvirt.host [None req-b1869e0d-6af1-4bcb-a839-fb2c1c69e58c None None] Getting domain capabilities for riscv32 via machine types: {None} {{(pid=75045) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 08 23:11:33 user nova-compute[75045]: DEBUG nova.virt.libvirt.host [None req-b1869e0d-6af1-4bcb-a839-fb2c1c69e58c None None] Error from libvirt when retrieving domain capabilities for arch riscv32 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv32' on this host {{(pid=75045) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 08 23:11:33 user nova-compute[75045]: DEBUG nova.virt.libvirt.host [None req-b1869e0d-6af1-4bcb-a839-fb2c1c69e58c None None] Getting domain capabilities for riscv64 via machine types: {None} {{(pid=75045) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 08 23:11:33 user nova-compute[75045]: DEBUG nova.virt.libvirt.host [None req-b1869e0d-6af1-4bcb-a839-fb2c1c69e58c None None] Error from libvirt when retrieving domain capabilities for arch riscv64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv64' on this host {{(pid=75045) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 08 23:11:33 user nova-compute[75045]: DEBUG nova.virt.libvirt.host [None req-b1869e0d-6af1-4bcb-a839-fb2c1c69e58c None None] Getting domain capabilities for s390x via machine types: {'s390-ccw-virtio'} {{(pid=75045) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 08 23:11:33 user nova-compute[75045]: DEBUG nova.virt.libvirt.host [None req-b1869e0d-6af1-4bcb-a839-fb2c1c69e58c None None] Error from libvirt when retrieving domain capabilities for arch s390x / virt_type kvm / machine_type s390-ccw-virtio: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-s390x' on this host {{(pid=75045) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 08 23:11:33 user nova-compute[75045]: DEBUG nova.virt.libvirt.host [None req-b1869e0d-6af1-4bcb-a839-fb2c1c69e58c None None] Getting domain capabilities for sh4 via machine types: {None} {{(pid=75045) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 08 23:11:33 user nova-compute[75045]: DEBUG nova.virt.libvirt.host [None req-b1869e0d-6af1-4bcb-a839-fb2c1c69e58c None None] Error from libvirt when retrieving domain capabilities for arch sh4 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4' on this host {{(pid=75045) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 08 23:11:33 user nova-compute[75045]: DEBUG nova.virt.libvirt.host [None req-b1869e0d-6af1-4bcb-a839-fb2c1c69e58c None None] Getting domain capabilities for sh4eb via machine types: {None} {{(pid=75045) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 08 23:11:33 user nova-compute[75045]: DEBUG nova.virt.libvirt.host [None req-b1869e0d-6af1-4bcb-a839-fb2c1c69e58c None None] Error from libvirt when retrieving domain capabilities for arch sh4eb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4eb' on this host {{(pid=75045) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 08 23:11:33 user nova-compute[75045]: DEBUG nova.virt.libvirt.host [None req-b1869e0d-6af1-4bcb-a839-fb2c1c69e58c None None] Getting domain capabilities for sparc via machine types: {None} {{(pid=75045) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 08 23:11:33 user nova-compute[75045]: DEBUG nova.virt.libvirt.host [None req-b1869e0d-6af1-4bcb-a839-fb2c1c69e58c None None] Error from libvirt when retrieving domain capabilities for arch sparc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc' on this host {{(pid=75045) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 08 23:11:33 user nova-compute[75045]: DEBUG nova.virt.libvirt.host [None req-b1869e0d-6af1-4bcb-a839-fb2c1c69e58c None None] Getting domain capabilities for sparc64 via machine types: {None} {{(pid=75045) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 08 23:11:33 user nova-compute[75045]: DEBUG nova.virt.libvirt.host [None req-b1869e0d-6af1-4bcb-a839-fb2c1c69e58c None None] Error from libvirt when retrieving domain capabilities for arch sparc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc64' on this host {{(pid=75045) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 08 23:11:33 user nova-compute[75045]: DEBUG nova.virt.libvirt.host [None req-b1869e0d-6af1-4bcb-a839-fb2c1c69e58c None None] Getting domain capabilities for x86_64 via machine types: {'ubuntu', 'ubuntu-q35', 'pc', 'q35'} {{(pid=75045) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 08 23:11:33 user nova-compute[75045]: DEBUG nova.virt.libvirt.host [None req-b1869e0d-6af1-4bcb-a839-fb2c1c69e58c None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu:
Nov 08 23:11:33 user nova-compute[75045]: <domainCapabilities>
Nov 08 23:11:33 user nova-compute[75045]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 08 23:11:33 user nova-compute[75045]:   <domain>kvm</domain>
Nov 08 23:11:33 user nova-compute[75045]:   <machine>pc-i440fx-jammy</machine>
Nov 08 23:11:33 user nova-compute[75045]:   <arch>x86_64</arch>
Nov 08 23:11:33 user nova-compute[75045]:   <vcpu max='255'/>
Nov 08 23:11:33 user nova-compute[75045]:   <iothreads supported='yes'/>
Nov 08 23:11:33 user nova-compute[75045]:   <os supported='yes'>
Nov 08 23:11:33 user nova-compute[75045]:     <enum name='firmware'>
Nov 08 23:11:33 user nova-compute[75045]:       <value>efi</value>
Nov 08 23:11:33 user nova-compute[75045]:     </enum>
Nov 08 23:11:33 user nova-compute[75045]:     <loader supported='yes'>
Nov 08 23:11:33 user nova-compute[75045]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 08 23:11:33 user nova-compute[75045]:       <enum name='type'>
Nov 08 23:11:33 user nova-compute[75045]:         <value>rom</value>
Nov 08 23:11:33 user nova-compute[75045]:         <value>pflash</value>
Nov 08 23:11:33 user nova-compute[75045]:       </enum>
Nov 08 23:11:33 user nova-compute[75045]:       <enum name='readonly'>
Nov 08 23:11:33 user nova-compute[75045]:         <value>yes</value>
Nov 08 23:11:33 user nova-compute[75045]:         <value>no</value>
Nov 08 23:11:33 user nova-compute[75045]:       </enum>
Nov 08 23:11:33 user nova-compute[75045]:       <enum name='secure'>
Nov 08 23:11:33 user nova-compute[75045]:         <value>no</value>
Nov 08 23:11:33 user nova-compute[75045]:       </enum>
Nov 08 23:11:33 user nova-compute[75045]:     </loader>
Nov 08 23:11:33 user nova-compute[75045]:   </os>
Nov 08 23:11:33 user nova-compute[75045]:   <cpu>
Nov 08 23:11:33 user nova-compute[75045]:     <mode name='host-passthrough' supported='yes'>
Nov 08 23:11:33 user nova-compute[75045]:       <enum name='hostPassthroughMigratable'>
Nov 08 23:11:33 user nova-compute[75045]:         <value>on</value>
Nov 08 23:11:33 user nova-compute[75045]:         <value>off</value>
Nov 08 23:11:33 user nova-compute[75045]:       </enum>
Nov 08 23:11:33 user nova-compute[75045]:     </mode>
Nov 08 23:11:33 user nova-compute[75045]:     <mode name='maximum' supported='yes'>
Nov 08 23:11:33 user nova-compute[75045]:       <enum name='maximumMigratable'>
Nov 08 23:11:33 user nova-compute[75045]:         <value>on</value>
Nov 08 23:11:33 user nova-compute[75045]:         <value>off</value>
Nov 08 23:11:33 user nova-compute[75045]:       </enum>
Nov 08 23:11:33 user nova-compute[75045]:     </mode>
Nov 08 23:11:33 user nova-compute[75045]:     <mode name='host-model' supported='yes'>
Nov 08 23:11:33 user nova-compute[75045]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 08 23:11:33 user nova-compute[75045]:       <vendor>Intel</vendor>
Nov 08 23:11:33 user nova-compute[75045]:       <feature policy='require' name='ss'/>
Nov 08 23:11:33 user nova-compute[75045]:       <feature policy='require' name='vmx'/>
Nov 08 23:11:33 user nova-compute[75045]:       <feature policy='require' name='pcid'/>
Nov 08 23:11:33 user nova-compute[75045]:       <feature policy='require' name='hypervisor'/>
Nov 08 23:11:33 user nova-compute[75045]:       <feature policy='require' name='arat'/>
Nov 08 23:11:33 user nova-compute[75045]:       <feature policy='require' name='tsc_adjust'/>
Nov 08 23:11:33 user nova-compute[75045]:       <feature policy='require' name='umip'/>
Nov 08 23:11:33 user nova-compute[75045]:       <feature policy='require' name='md-clear'/>
Nov 08 23:11:33 user nova-compute[75045]:       <feature policy='require' name='stibp'/>
Nov 08 23:11:33 user nova-compute[75045]:       <feature policy='require' name='arch-capabilities'/>
Nov 08 23:11:33 user nova-compute[75045]:       <feature policy='require' name='ssbd'/>
Nov 08 23:11:33 user nova-compute[75045]:       <feature policy='require' name='invtsc'/>
Nov 08 23:11:33 user nova-compute[75045]:       <feature policy='require' name='ibpb'/>
Nov 08 23:11:33 user nova-compute[75045]:       <feature policy='require' name='ibrs'/>
Nov 08 23:11:33 user nova-compute[75045]:       <feature policy='require' name='amd-stibp'/>
Nov 08 23:11:33 user nova-compute[75045]:       <feature policy='require' name='amd-ssbd'/>
Nov 08 23:11:33 user nova-compute[75045]:       <feature policy='require' name='rsba'/>
Nov 08 23:11:33 user nova-compute[75045]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 08 23:11:33 user nova-compute[75045]:       <feature policy='require' name='pschange-mc-no'/>
Nov 08 23:11:33 user nova-compute[75045]:       <feature policy='disable' name='erms'/>
Nov 08 23:11:33 user nova-compute[75045]:       <feature policy='disable' name='xsaveopt'/>
Nov 08 23:11:33 user nova-compute[75045]:     </mode>
Nov 08 23:11:33 user nova-compute[75045]:     <mode name='custom' supported='yes'>
Nov 08 23:11:33 user nova-compute[75045]:       <model usable='no'>qemu64</model>
Nov 08 23:11:33 user nova-compute[75045]:       <model usable='yes'>qemu32</model>
Nov 08 23:11:33 user nova-compute[75045]:       <model usable='no'>phenom</model>
Nov 08 23:11:33 user nova-compute[75045]:       <model usable='yes'>pentium3</model>
Nov 08 23:11:33 user nova-compute[75045]:       <model usable='yes'>pentium2</model>
Nov 08 23:11:33 user nova-compute[75045]:       <model usable='yes'>pentium</model>
Nov 08 23:11:33 user nova-compute[75045]:       <model usable='no'>n270</model>
Nov 08 23:11:33 user nova-compute[75045]:       <model usable='yes'>kvm64</model>
Nov 08 23:11:33 user nova-compute[75045]:       <model usable='yes'>kvm32</model>
Nov 08 23:11:33 user nova-compute[75045]:       <model usable='yes'>coreduo</model>
Nov 08 23:11:33 user nova-compute[75045]:       <model usable='yes'>core2duo</model>
Nov 08 23:11:33 user nova-compute[75045]:       <model usable='no'>athlon</model>
Nov 08 23:11:33 user nova-compute[75045]:       <model usable='yes'>Westmere-IBRS</model>
Nov 08 23:11:33 user nova-compute[75045]:       <model usable='yes'>Westmere</model>
Nov 08 23:11:33 user nova-compute[75045]:       <model usable='no'>Snowridge</model>
Nov 08 23:11:33 user nova-compute[75045]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 08 23:11:33 user nova-compute[75045]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 08 23:11:33 user nova-compute[75045]:       <model usable='no'>Skylake-Server</model>
Nov 08 23:11:33 user nova-compute[75045]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 08 23:11:33 user nova-compute[75045]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 08 23:11:33 user nova-compute[75045]:       <model usable='no'>Skylake-Client</model>
Nov 08 23:11:33 user nova-compute[75045]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 08 23:11:33 user nova-compute[75045]:       <model usable='no'>SandyBridge</model>
Nov 08 23:11:33 user nova-compute[75045]:       <model usable='yes'>Penryn</model>
Nov 08 23:11:33 user nova-compute[75045]:       <model usable='no'>Opteron_G5</model>
Nov 08 23:11:33 user nova-compute[75045]:       <model usable='no'>Opteron_G4</model>
Nov 08 23:11:33 user nova-compute[75045]:       <model usable='no'>Opteron_G3</model>
Nov 08 23:11:33 user nova-compute[75045]:       <model usable='no'>Opteron_G2</model>
Nov 08 23:11:33 user nova-compute[75045]:       <model usable='yes'>Opteron_G1</model>
Nov 08 23:11:33 user nova-compute[75045]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 08 23:11:33 user nova-compute[75045]:       <model usable='yes'>Nehalem</model>
Nov 08 23:11:33 user nova-compute[75045]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 08 23:11:33 user nova-compute[75045]:       <model usable='no'>IvyBridge</model>
Nov 08 23:11:33 user nova-compute[75045]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 08 23:11:33 user nova-compute[75045]:       <model usable='no'>Icelake-Server</model>
Nov 08 23:11:33 user nova-compute[75045]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 08 23:11:33 user nova-compute[75045]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 08 23:11:33 user nova-compute[75045]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 08 23:11:33 user nova-compute[75045]:       <model usable='no'>Haswell-noTSX</model>
Nov 08 23:11:33 user nova-compute[75045]:       <model usable='no'>Haswell-IBRS</model>
Nov 08 23:11:33 user nova-compute[75045]:       <model usable='no'>Haswell</model>
Nov 08 23:11:33 user nova-compute[75045]:       <model usable='no'>EPYC-Rome</model>
Nov 08 23:11:33 user nova-compute[75045]:       <model usable='no'>EPYC-Milan</model>
Nov 08 23:11:33 user nova-compute[75045]:       <model usable='no'>EPYC-IBPB</model>
Nov 08 23:11:33 user nova-compute[75045]:       <model usable='no'>EPYC</model>
Nov 08 23:11:33 user nova-compute[75045]:       <model usable='no'>Dhyana</model>
Nov 08 23:11:33 user nova-compute[75045]:       <model usable='no'>Cooperlake</model>
Nov 08 23:11:33 user nova-compute[75045]:       <model usable='yes'>Conroe</model>
Nov 08 23:11:33 user nova-compute[75045]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 08 23:11:33 user nova-compute[75045]:       <model usable='no'>Cascadelake-Server</model>
Nov 08 23:11:33 user nova-compute[75045]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 08 23:11:33 user nova-compute[75045]:       <model usable='no'>Broadwell-noTSX</model>
Nov 08 23:11:33 user nova-compute[75045]:       <model usable='no'>Broadwell-IBRS</model>
Nov 08 23:11:33 user nova-compute[75045]:       <model usable='no'>Broadwell</model>
Nov 08 23:11:33 user nova-compute[75045]:       <model usable='yes'>486</model>
Nov 08 23:11:33 user nova-compute[75045]:     </mode>
Nov 08 23:11:33 user nova-compute[75045]:   </cpu>
Nov 08 23:11:33 user nova-compute[75045]:   <memoryBacking supported='yes'>
Nov 08 23:11:33 user nova-compute[75045]:     <enum name='sourceType'>
Nov 08 23:11:33 user nova-compute[75045]:       <value>file</value>
Nov 08 23:11:33 user nova-compute[75045]:       <value>anonymous</value>
Nov 08 23:11:33 user nova-compute[75045]:       <value>memfd</value>
Nov 08 23:11:33 user nova-compute[75045]:     </enum>
Nov 08 23:11:33 user nova-compute[75045]:   </memoryBacking>
Nov 08 23:11:33 user nova-compute[75045]:   <devices>
Nov 08 23:11:33 user nova-compute[75045]:     <disk supported='yes'>
Nov 08 23:11:33 user nova-compute[75045]:       <enum name='diskDevice'>
Nov 08 23:11:33 user nova-compute[75045]:         <value>disk</value>
Nov 08 23:11:33 user nova-compute[75045]:         <value>cdrom</value>
Nov 08 23:11:33 user nova-compute[75045]:         <value>floppy</value>
Nov 08 23:11:33 user nova-compute[75045]:         <value>lun</value>
Nov 08 23:11:33 user nova-compute[75045]:       </enum>
Nov 08 23:11:33 user nova-compute[75045]:       <enum name='bus'>
Nov 08 23:11:33 user nova-compute[75045]:         <value>ide</value>
Nov 08 23:11:33 user nova-compute[75045]:         <value>fdc</value>
Nov 08 23:11:33 user nova-compute[75045]:         <value>scsi</value>
Nov 08 23:11:33 user nova-compute[75045]:         <value>virtio</value>
Nov 08 23:11:33 user nova-compute[75045]:         <value>usb</value>
Nov 08 23:11:33 user nova-compute[75045]:         <value>sata</value>
Nov 08 23:11:33 user nova-compute[75045]:       </enum>
Nov 08 23:11:33 user nova-compute[75045]:       <enum name='model'>
Nov 08 23:11:33 user nova-compute[75045]:         <value>virtio</value>
Nov 08 23:11:33 user nova-compute[75045]:         <value>virtio-transitional</value>
Nov 08 23:11:33 user nova-compute[75045]:         <value>virtio-non-transitional</value>
Nov 08 23:11:33 user nova-compute[75045]:       </enum>
Nov 08 23:11:33 user nova-compute[75045]:     </disk>
Nov 08 23:11:33 user nova-compute[75045]:     <graphics supported='yes'>
Nov 08 23:11:33 user nova-compute[75045]:       <enum name='type'>
Nov 08 23:11:33 user nova-compute[75045]:         <value>sdl</value>
Nov 08 23:11:33 user nova-compute[75045]:         <value>vnc</value>
Nov 08 23:11:33 user nova-compute[75045]:         <value>spice</value>
Nov 08 23:11:33 user nova-compute[75045]:         <value>egl-headless</value>
Nov 08 23:11:33 user nova-compute[75045]:       </enum>
Nov 08 23:11:33 user nova-compute[75045]:     </graphics>
Nov 08 23:11:33 user nova-compute[75045]:     <video supported='yes'>
Nov 08 23:11:33 user nova-compute[75045]:       <enum name='modelType'>
Nov 08 23:11:33 user nova-compute[75045]:         <value>vga</value>
Nov 08 23:11:33 user nova-compute[75045]:         <value>cirrus</value>
Nov 08 23:11:33 user nova-compute[75045]:         <value>vmvga</value>
Nov 08 23:11:33 user nova-compute[75045]:         <value>qxl</value>
Nov 08 23:11:33 user nova-compute[75045]:         <value>virtio</value>
Nov 08 23:11:33 user nova-compute[75045]:         <value>none</value>
Nov 08 23:11:33 user nova-compute[75045]:         <value>bochs</value>
Nov 08 23:11:33 user nova-compute[75045]:         <value>ramfb</value>
Nov 08 23:11:33 user nova-compute[75045]:       </enum>
Nov 08 23:11:33 user nova-compute[75045]:     </video>
Nov 08 23:11:33 user nova-compute[75045]:     <hostdev supported='yes'>
Nov 08 23:11:33 user nova-compute[75045]:       <enum name='mode'>
Nov 08 23:11:33 user nova-compute[75045]:         <value>subsystem</value>
Nov 08 23:11:33 user nova-compute[75045]:       </enum>
Nov 08 23:11:33 user nova-compute[75045]:       <enum name='startupPolicy'>
Nov 08 23:11:33 user nova-compute[75045]:         <value>default</value>
Nov 08 23:11:33 user nova-compute[75045]:         <value>mandatory</value>
Nov 08 23:11:33 user nova-compute[75045]:         <value>requisite</value>
Nov 08 23:11:33 user nova-compute[75045]:         <value>optional</value>
Nov 08 23:11:33 user nova-compute[75045]:       </enum>
Nov 08 23:11:33 user nova-compute[75045]:       <enum name='subsysType'>
Nov 08 23:11:33 user nova-compute[75045]:         <value>usb</value>
Nov 08 23:11:33 user nova-compute[75045]:         <value>pci</value>
Nov 08 23:11:33 user nova-compute[75045]:         <value>scsi</value>
Nov 08 23:11:33 user nova-compute[75045]:       </enum>
Nov 08 23:11:33 user nova-compute[75045]:       <enum name='capsType'/>
Nov 08 23:11:33 user nova-compute[75045]:       <enum name='pciBackend'/>
Nov 08 23:11:33 user nova-compute[75045]:     </hostdev>
Nov 08 23:11:33 user nova-compute[75045]:     <rng supported='yes'>
Nov 08 23:11:33 user nova-compute[75045]:       <enum name='model'>
Nov 08 23:11:33 user nova-compute[75045]:         <value>virtio</value>
Nov 08 23:11:33 user nova-compute[75045]:         <value>virtio-transitional</value>
Nov 08 23:11:33 user nova-compute[75045]:         <value>virtio-non-transitional</value>
Nov 08 23:11:33 user nova-compute[75045]:       </enum>
Nov 08 23:11:33 user nova-compute[75045]:       <enum name='backendModel'>
Nov 08 23:11:33 user nova-compute[75045]:         <value>random</value>
Nov 08 23:11:33 user nova-compute[75045]:         <value>egd</value>
Nov 08 23:11:33 user nova-compute[75045]:         <value>builtin</value>
Nov 08 23:11:33 user nova-compute[75045]:       </enum>
Nov 08 23:11:33 user nova-compute[75045]:     </rng>
Nov 08 23:11:33 user nova-compute[75045]:     <filesystem supported='yes'>
Nov 08 23:11:33 user nova-compute[75045]:       <enum name='driverType'>
Nov 08 23:11:33 user nova-compute[75045]:         <value>path</value>
Nov 08 23:11:33 user nova-compute[75045]:         <value>handle</value>
Nov 08 23:11:33 user nova-compute[75045]:         <value>virtiofs</value>
Nov 08 23:11:33 user nova-compute[75045]:       </enum>
Nov 08 23:11:33 user nova-compute[75045]:     </filesystem>
Nov 08 23:11:33 user nova-compute[75045]:     <tpm supported='yes'>
Nov 08 23:11:33 user nova-compute[75045]:       <enum name='model'>
Nov 08 23:11:33 user nova-compute[75045]:         <value>tpm-tis</value>
Nov 08 23:11:33 user nova-compute[75045]:         <value>tpm-crb</value>
Nov 08 23:11:33 user nova-compute[75045]:       </enum>
Nov 08 23:11:33 user nova-compute[75045]:       <enum name='backendModel'>
Nov 08 23:11:33 user nova-compute[75045]:         <value>passthrough</value>
Nov 08 23:11:33 user nova-compute[75045]:         <value>emulator</value>
Nov 08 23:11:33 user nova-compute[75045]:       </enum>
Nov 08 23:11:33 user nova-compute[75045]:     </tpm>
Nov 08 23:11:33 user nova-compute[75045]:   </devices>
Nov 08 23:11:33 user nova-compute[75045]:   <features>
Nov 08 23:11:33 user nova-compute[75045]:     <gic supported='no'/>
Nov 08 23:11:33 user nova-compute[75045]:     <vmcoreinfo supported='yes'/>
Nov 08 23:11:33 user nova-compute[75045]:     <genid supported='yes'/>
Nov 08 23:11:33 user nova-compute[75045]:     <backingStoreInput supported='yes'/>
Nov 08 23:11:33 user nova-compute[75045]:     <backup supported='yes'/>
Nov 08 23:11:33 user nova-compute[75045]:     <sev supported='no'/>
Nov 08 23:11:33 user nova-compute[75045]:   </features>
Nov 08 23:11:33 user nova-compute[75045]: </domainCapabilities>
Nov 08 23:11:33 user nova-compute[75045]:  {{(pid=75045) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 08 23:11:33 user nova-compute[75045]: DEBUG nova.virt.libvirt.host [None req-b1869e0d-6af1-4bcb-a839-fb2c1c69e58c None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu-q35:
Nov 08 23:11:33 user nova-compute[75045]: <domainCapabilities>
Nov 08 23:11:33 user nova-compute[75045]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 08 23:11:33 user nova-compute[75045]:   <domain>kvm</domain>
Nov 08 23:11:33 user nova-compute[75045]:   <machine>pc-q35-jammy</machine>
Nov 08 23:11:33 user nova-compute[75045]:   <arch>x86_64</arch>
Nov 08 23:11:33 user nova-compute[75045]:   <vcpu max='288'/>
Nov 08 23:11:33 user nova-compute[75045]:   <iothreads supported='yes'/>
Nov 08 23:11:33 user nova-compute[75045]:   <os supported='yes'>
Nov 08 23:11:33 user nova-compute[75045]:     <enum name='firmware'>
Nov 08 23:11:33 user nova-compute[75045]:       <value>efi</value>
Nov 08 23:11:33 user nova-compute[75045]:     </enum>
Nov 08 23:11:33 user nova-compute[75045]:     <loader supported='yes'>
Nov 08 23:11:33 user nova-compute[75045]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Nov 08 23:11:33 user nova-compute[75045]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Nov 08 23:11:33 user nova-compute[75045]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 08 23:11:33 user nova-compute[75045]:       <enum name='type'>
Nov 08 23:11:33 user nova-compute[75045]:         <value>rom</value>
Nov 08 23:11:33 user nova-compute[75045]:         <value>pflash</value>
Nov 08 23:11:33 user nova-compute[75045]:       </enum>
Nov 08 23:11:33 user nova-compute[75045]:       <enum name='readonly'>
Nov 08 23:11:33 user nova-compute[75045]:         <value>yes</value>
Nov 08 23:11:33 user nova-compute[75045]:         <value>no</value>
Nov 08 23:11:33 user nova-compute[75045]:       </enum>
Nov 08 23:11:33 user nova-compute[75045]:       <enum name='secure'>
Nov 08 23:11:33 user nova-compute[75045]:         <value>yes</value>
Nov 08 23:11:33 user nova-compute[75045]:         <value>no</value>
Nov 08 23:11:33 user nova-compute[75045]:       </enum>
Nov 08 23:11:33 user nova-compute[75045]:     </loader>
Nov 08 23:11:33 user nova-compute[75045]:   </os>
Nov 08 23:11:33 user nova-compute[75045]:   <cpu>
Nov 08 23:11:33 user nova-compute[75045]:     <mode name='host-passthrough' supported='yes'>
Nov 08 23:11:33 user nova-compute[75045]:       <enum name='hostPassthroughMigratable'>
Nov 08 23:11:33 user nova-compute[75045]:         <value>on</value>
Nov 08 23:11:33 user nova-compute[75045]:         <value>off</value>
Nov 08 23:11:33 user nova-compute[75045]:       </enum>
Nov 08 23:11:33 user nova-compute[75045]:     </mode>
Nov 08 23:11:33 user nova-compute[75045]:     <mode name='maximum' supported='yes'>
Nov 08 23:11:33 user nova-compute[75045]:       <enum name='maximumMigratable'>
Nov 08 23:11:33 user nova-compute[75045]:         <value>on</value>
Nov 08 23:11:33 user nova-compute[75045]:         <value>off</value>
Nov 08 23:11:33 user nova-compute[75045]:       </enum>
Nov 08 23:11:33 user nova-compute[75045]:     </mode>
Nov 08 23:11:33 user nova-compute[75045]:     <mode name='host-model' supported='yes'>
Nov 08 23:11:33 user nova-compute[75045]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 08 23:11:33 user nova-compute[75045]:       <vendor>Intel</vendor>
Nov 08 23:11:33 user nova-compute[75045]:       <feature policy='require' name='ss'/>
Nov 08 23:11:33 user nova-compute[75045]:       <feature policy='require' name='vmx'/>
Nov 08 23:11:33 user nova-compute[75045]:       <feature policy='require' name='pcid'/>
Nov 08 23:11:33 user nova-compute[75045]:       <feature policy='require' name='hypervisor'/>
Nov 08 23:11:33 user nova-compute[75045]:       <feature policy='require' name='arat'/>
Nov 08 23:11:33 user nova-compute[75045]:       <feature policy='require' name='tsc_adjust'/>
Nov 08 23:11:33 user nova-compute[75045]:       <feature policy='require' name='umip'/>
Nov 08 23:11:33 user nova-compute[75045]:       <feature policy='require' name='md-clear'/>
Nov 08 23:11:33 user nova-compute[75045]:       <feature policy='require' name='stibp'/>
Nov 08 23:11:33 user nova-compute[75045]:       <feature policy='require' name='arch-capabilities'/>
Nov 08 23:11:33 user nova-compute[75045]:       <feature policy='require' name='ssbd'/>
Nov 08 23:11:33 user nova-compute[75045]:       <feature policy='require' name='invtsc'/>
Nov 08 23:11:33 user nova-compute[75045]:       <feature policy='require' name='ibpb'/>
Nov 08 23:11:33 user nova-compute[75045]:       <feature policy='require' name='ibrs'/>
Nov 08 23:11:33 user nova-compute[75045]:       <feature policy='require' name='amd-stibp'/>
Nov 08 23:11:33 user nova-compute[75045]:       <feature policy='require' name='amd-ssbd'/>
Nov 08 23:11:33 user nova-compute[75045]:       <feature policy='require' name='rsba'/>
Nov 08 23:11:33 user nova-compute[75045]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 08 23:11:33 user nova-compute[75045]:       <feature policy='require' name='pschange-mc-no'/>
Nov 08 23:11:33 user nova-compute[75045]:       <feature policy='disable' name='erms'/>
Nov 08 23:11:33 user nova-compute[75045]:       <feature policy='disable' name='xsaveopt'/>
Nov 08 23:11:33 user nova-compute[75045]:     </mode>
Nov 08 23:11:33 user nova-compute[75045]:     <mode name='custom' supported='yes'>
Nov 08 23:11:33 user nova-compute[75045]:       <model usable='no'>qemu64</model>
Nov 08 23:11:33 user nova-compute[75045]:       <model usable='yes'>qemu32</model>
Nov 08 23:11:33 user nova-compute[75045]:       <model usable='no'>phenom</model>
Nov 08 23:11:33 user nova-compute[75045]:       <model usable='yes'>pentium3</model>
Nov 08 23:11:33 user nova-compute[75045]:       <model usable='yes'>pentium2</model>
Nov 08 23:11:33 user nova-compute[75045]:       <model usable='yes'>pentium</model>
Nov 08 23:11:33 user nova-compute[75045]:       <model usable='no'>n270</model>
Nov 08 23:11:33 user nova-compute[75045]:       <model usable='yes'>kvm64</model>
Nov 08 23:11:33 user nova-compute[75045]:       <model usable='yes'>kvm32</model>
Nov 08 23:11:33 user nova-compute[75045]:       <model usable='yes'>coreduo</model>
Nov 08 23:11:33 user nova-compute[75045]:       <model usable='yes'>core2duo</model>
Nov 08 23:11:33 user nova-compute[75045]:       <model usable='no'>athlon</model>
Nov 08 23:11:33 user nova-compute[75045]:       <model usable='yes'>Westmere-IBRS</model>
Nov 08 23:11:33 user nova-compute[75045]:       <model usable='yes'>Westmere</model>
Nov 08 23:11:33 user nova-compute[75045]:       <model usable='no'>Snowridge</model>
Nov 08 23:11:33 user nova-compute[75045]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 08 23:11:33 user nova-compute[75045]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 08 23:11:33 user nova-compute[75045]:       <model usable='no'>Skylake-Server</model>
Nov 08 23:11:33 user nova-compute[75045]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 08 23:11:33 user nova-compute[75045]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 08 23:11:33 user nova-compute[75045]:       <model usable='no'>Skylake-Client</model>
Nov 08 23:11:33 user nova-compute[75045]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 08 23:11:33 user nova-compute[75045]:       <model usable='no'>SandyBridge</model>
Nov 08 23:11:33 user nova-compute[75045]:       <model usable='yes'>Penryn</model>
Nov 08 23:11:33 user nova-compute[75045]:       <model usable='no'>Opteron_G5</model>
Nov 08 23:11:33 user nova-compute[75045]:       <model usable='no'>Opteron_G4</model>
Nov 08 23:11:33 user nova-compute[75045]:       <model usable='no'>Opteron_G3</model>
Nov 08 23:11:33 user nova-compute[75045]:       <model usable='no'>Opteron_G2</model>
Nov 08 23:11:33 user nova-compute[75045]:       <model usable='yes'>Opteron_G1</model>
Nov 08 23:11:33 user nova-compute[75045]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 08 23:11:33 user nova-compute[75045]:       <model usable='yes'>Nehalem</model>
Nov 08 23:11:33 user nova-compute[75045]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 08 23:11:33 user nova-compute[75045]:       <model usable='no'>IvyBridge</model>
Nov 08 23:11:33 user nova-compute[75045]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 08 23:11:33 user nova-compute[75045]:       <model usable='no'>Icelake-Server</model>
Nov 08 23:11:33 user nova-compute[75045]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 08 23:11:33 user nova-compute[75045]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 08 23:11:33 user nova-compute[75045]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 08 23:11:33 user nova-compute[75045]:       <model usable='no'>Haswell-noTSX</model>
Nov 08 23:11:33 user nova-compute[75045]:       <model usable='no'>Haswell-IBRS</model>
Nov 08 23:11:33 user nova-compute[75045]:       <model usable='no'>Haswell</model>
Nov 08 23:11:33 user nova-compute[75045]:       <model usable='no'>EPYC-Rome</model>
Nov 08 23:11:33 user nova-compute[75045]:       <model usable='no'>EPYC-Milan</model>
Nov 08 23:11:33 user nova-compute[75045]:       <model usable='no'>EPYC-IBPB</model>
Nov 08 23:11:33 user nova-compute[75045]:       <model usable='no'>EPYC</model>
Nov 08 23:11:33 user nova-compute[75045]:       <model usable='no'>Dhyana</model>
Nov 08 23:11:33 user nova-compute[75045]:       <model usable='no'>Cooperlake</model>
Nov 08 23:11:33 user nova-compute[75045]:       <model usable='yes'>Conroe</model>
Nov 08 23:11:33 user nova-compute[75045]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 08 23:11:33 user nova-compute[75045]:       <model usable='no'>Cascadelake-Server</model>
Nov 08 23:11:33 user nova-compute[75045]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 08 23:11:33 user nova-compute[75045]:       <model usable='no'>Broadwell-noTSX</model>
Nov 08 23:11:33 user nova-compute[75045]:       <model usable='no'>Broadwell-IBRS</model>
Nov 08 23:11:33 user nova-compute[75045]:       <model usable='no'>Broadwell</model>
Nov 08 23:11:33 user nova-compute[75045]:       <model usable='yes'>486</model>
Nov 08 23:11:33 user nova-compute[75045]:     </mode>
Nov 08 23:11:33 user nova-compute[75045]:   </cpu>
Nov 08 23:11:33 user nova-compute[75045]:   <memoryBacking supported='yes'>
Nov 08 23:11:33 user nova-compute[75045]:     <enum name='sourceType'>
Nov 08 23:11:33 user nova-compute[75045]:       <value>file</value>
Nov 08 23:11:33 user nova-compute[75045]:       <value>anonymous</value>
Nov 08 23:11:33 user nova-compute[75045]:       <value>memfd</value>
Nov 08 23:11:33 user nova-compute[75045]:     </enum>
Nov 08 23:11:33 user nova-compute[75045]:   </memoryBacking>
Nov 08 23:11:33 user nova-compute[75045]:   <devices>
Nov 08 23:11:33 user nova-compute[75045]:     <disk supported='yes'>
Nov 08 23:11:33 user nova-compute[75045]:       <enum name='diskDevice'>
Nov 08 23:11:33 user nova-compute[75045]:         <value>disk</value>
Nov 08 23:11:33 user nova-compute[75045]:         <value>cdrom</value>
Nov 08 23:11:33 user nova-compute[75045]:         <value>floppy</value>
Nov 08 23:11:33 user nova-compute[75045]:         <value>lun</value>
Nov 08 23:11:33 user nova-compute[75045]:       </enum>
Nov 08 23:11:33 user nova-compute[75045]:       <enum name='bus'>
Nov 08 23:11:33 user nova-compute[75045]:         <value>fdc</value>
Nov 08 23:11:33 user nova-compute[75045]:         <value>scsi</value>
Nov 08 23:11:33 user nova-compute[75045]:         <value>virtio</value>
Nov 08 23:11:33 user nova-compute[75045]:         <value>usb</value>
Nov 08 23:11:33 user nova-compute[75045]:         <value>sata</value>
Nov 08 23:11:33 user nova-compute[75045]:       </enum>
Nov 08 23:11:33 user nova-compute[75045]:       <enum name='model'>
Nov 08 23:11:33 user nova-compute[75045]:         <value>virtio</value>
Nov 08 23:11:33 user nova-compute[75045]:         <value>virtio-transitional</value>
Nov 08 23:11:33 user nova-compute[75045]:         <value>virtio-non-transitional</value>
Nov 08 23:11:33 user nova-compute[75045]:       </enum>
Nov 08 23:11:33 user nova-compute[75045]:     </disk>
Nov 08 23:11:33 user nova-compute[75045]:     <graphics supported='yes'>
Nov 08 23:11:33 user nova-compute[75045]:       <enum name='type'>
Nov 08 23:11:33 user nova-compute[75045]:         <value>sdl</value>
Nov 08 23:11:33 user nova-compute[75045]:         <value>vnc</value>
Nov 08 23:11:33 user nova-compute[75045]:         <value>spice</value>
Nov 08 23:11:33 user nova-compute[75045]:         <value>egl-headless</value>
Nov 08 23:11:33 user nova-compute[75045]:       </enum>
Nov 08 23:11:33 user nova-compute[75045]:     </graphics>
Nov 08 23:11:33 user nova-compute[75045]:     <video supported='yes'>
Nov 08 23:11:33 user nova-compute[75045]:       <enum name='modelType'>
Nov 08 23:11:33 user nova-compute[75045]:         <value>vga</value>
Nov 08 23:11:33 user nova-compute[75045]:         <value>cirrus</value>
Nov 08 23:11:33 user nova-compute[75045]:         <value>vmvga</value>
Nov 08 23:11:33 user nova-compute[75045]:         <value>qxl</value>
Nov 08 23:11:33 user nova-compute[75045]:         <value>virtio</value>
Nov 08 23:11:33 user nova-compute[75045]:         <value>none</value>
Nov 08 23:11:33 user nova-compute[75045]:         <value>bochs</value>
Nov 08 23:11:33 user nova-compute[75045]:         <value>ramfb</value>
Nov 08 23:11:33 user nova-compute[75045]:       </enum>
Nov 08 23:11:33 user nova-compute[75045]:     </video>
Nov 08 23:11:33 user nova-compute[75045]:     <hostdev supported='yes'>
Nov 08 23:11:33 user nova-compute[75045]:       <enum name='mode'>
Nov 08 23:11:33 user nova-compute[75045]:         <value>subsystem</value>
Nov 08 23:11:33 user nova-compute[75045]:       </enum>
Nov 08 23:11:33 user nova-compute[75045]:       <enum name='startupPolicy'>
Nov 08 23:11:33 user nova-compute[75045]:         <value>default</value>
Nov 08 23:11:33 user nova-compute[75045]:         <value>mandatory</value>
Nov 08 23:11:33 user nova-compute[75045]:         <value>requisite</value>
Nov 08 23:11:33 user nova-compute[75045]:         <value>optional</value>
Nov 08 23:11:33 user nova-compute[75045]:       </enum>
Nov 08 23:11:33 user nova-compute[75045]:       <enum name='subsysType'>
Nov 08 23:11:33 user nova-compute[75045]:         <value>usb</value>
Nov 08 23:11:33 user nova-compute[75045]:         <value>pci</value>
Nov 08 23:11:33 user nova-compute[75045]:         <value>scsi</value>
Nov 08 23:11:33 user nova-compute[75045]:       </enum>
Nov 08 23:11:33 user nova-compute[75045]:       <enum name='capsType'/>
Nov 08 23:11:33 user nova-compute[75045]:       <enum name='pciBackend'/>
Nov 08 23:11:33 user nova-compute[75045]:     </hostdev>
Nov 08 23:11:33 user nova-compute[75045]:     <rng supported='yes'>
Nov 08 23:11:33 user nova-compute[75045]:       <enum name='model'>
Nov 08 23:11:33 user nova-compute[75045]:         <value>virtio</value>
Nov 08 23:11:33 user nova-compute[75045]:         <value>virtio-transitional</value>
Nov 08 23:11:33 user nova-compute[75045]:         <value>virtio-non-transitional</value>
Nov 08 23:11:33 user nova-compute[75045]:       </enum>
Nov 08 23:11:33 user nova-compute[75045]:       <enum name='backendModel'>
Nov 08 23:11:33 user nova-compute[75045]:         <value>random</value>
Nov 08 23:11:33 user nova-compute[75045]:         <value>egd</value>
Nov 08 23:11:33 user nova-compute[75045]:         <value>builtin</value>
Nov 08 23:11:33 user nova-compute[75045]:       </enum>
Nov 08 23:11:33 user nova-compute[75045]:     </rng>
Nov 08 23:11:33 user nova-compute[75045]:     <filesystem supported='yes'>
Nov 08 23:11:33 user nova-compute[75045]:       <enum name='driverType'>
Nov 08 23:11:33 user nova-compute[75045]:         <value>path</value>
Nov 08 23:11:33 user nova-compute[75045]:         <value>handle</value>
Nov 08 23:11:33 user nova-compute[75045]:         <value>virtiofs</value>
Nov 08 23:11:33 user nova-compute[75045]:       </enum>
Nov 08 23:11:33 user nova-compute[75045]:     </filesystem>
Nov 08 23:11:33 user nova-compute[75045]:     <tpm supported='yes'>
Nov 08 23:11:33 user nova-compute[75045]:       <enum name='model'>
Nov 08 23:11:33 user nova-compute[75045]:         <value>tpm-tis</value>
Nov 08 23:11:33 user nova-compute[75045]:         <value>tpm-crb</value>
Nov 08 23:11:33 user nova-compute[75045]:       </enum>
Nov 08 23:11:33 user nova-compute[75045]:       <enum name='backendModel'>
Nov 08 23:11:33 user nova-compute[75045]:         <value>passthrough</value>
Nov 08 23:11:33 user nova-compute[75045]:         <value>emulator</value>
Nov 08 23:11:33 user nova-compute[75045]:       </enum>
Nov 08 23:11:33 user nova-compute[75045]:     </tpm>
Nov 08 23:11:33 user nova-compute[75045]:   </devices>
Nov 08 23:11:33 user nova-compute[75045]:   <features>
Nov 08 23:11:33 user nova-compute[75045]:     <gic supported='no'/>
Nov 08 23:11:33 user nova-compute[75045]:     <vmcoreinfo supported='yes'/>
Nov 08 23:11:33 user nova-compute[75045]:     <genid supported='yes'/>
Nov 08 23:11:33 user nova-compute[75045]:     <backingStoreInput supported='yes'/>
Nov 08 23:11:33 user nova-compute[75045]:     <backup supported='yes'/>
Nov 08 23:11:33 user nova-compute[75045]:     <sev supported='no'/>
Nov 08 23:11:33 user nova-compute[75045]:   </features>
Nov 08 23:11:33 user nova-compute[75045]: </domainCapabilities>
Nov 08 23:11:33 user nova-compute[75045]:  {{(pid=75045) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 08 23:11:33 user nova-compute[75045]: DEBUG nova.virt.libvirt.host [None req-b1869e0d-6af1-4bcb-a839-fb2c1c69e58c None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=pc:
Nov 08 23:11:33 user nova-compute[75045]: <domainCapabilities>
Nov 08 23:11:33 user nova-compute[75045]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 08 23:11:33 user nova-compute[75045]:   <domain>kvm</domain>
Nov 08 23:11:33 user nova-compute[75045]:   <machine>pc-i440fx-6.2</machine>
Nov 08 23:11:33 user nova-compute[75045]:   <arch>x86_64</arch>
Nov 08 23:11:33 user nova-compute[75045]:   <vcpu max='255'/>
Nov 08 23:11:33 user nova-compute[75045]:   <iothreads supported='yes'/>
Nov 08 23:11:33 user nova-compute[75045]:   <os supported='yes'>
Nov 08 23:11:33 user nova-compute[75045]:     <enum name='firmware'>
Nov 08 23:11:33 user nova-compute[75045]:       <value>efi</value>
Nov 08 23:11:33 user nova-compute[75045]:     </enum>
Nov 08 23:11:33 user nova-compute[75045]:     <loader supported='yes'>
Nov 08 23:11:33 user nova-compute[75045]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 08 23:11:33 user nova-compute[75045]:       <enum name='type'>
Nov 08 23:11:33 user nova-compute[75045]:         <value>rom</value>
Nov 08 23:11:33 user nova-compute[75045]:         <value>pflash</value>
Nov 08 23:11:33 user nova-compute[75045]:       </enum>
Nov 08 23:11:33 user nova-compute[75045]:       <enum name='readonly'>
Nov 08 23:11:33 user nova-compute[75045]:         <value>yes</value>
Nov 08 23:11:33 user nova-compute[75045]:         <value>no</value>
Nov 08 23:11:33 user nova-compute[75045]:       </enum>
Nov 08 23:11:33 user nova-compute[75045]:       <enum name='secure'>
Nov 08 23:11:33 user nova-compute[75045]:         <value>no</value>
Nov 08 23:11:33 user nova-compute[75045]:       </enum>
Nov 08 23:11:33 user nova-compute[75045]:     </loader>
Nov 08 23:11:33 user nova-compute[75045]:   </os>
Nov 08 23:11:33 user nova-compute[75045]:   <cpu>
Nov 08 23:11:33 user nova-compute[75045]:     <mode name='host-passthrough' supported='yes'>
Nov 08 23:11:33 user nova-compute[75045]:       <enum name='hostPassthroughMigratable'>
Nov 08 23:11:33 user nova-compute[75045]:         <value>on</value>
Nov 08 23:11:33 user nova-compute[75045]:         <value>off</value>
Nov 08 23:11:33 user nova-compute[75045]:       </enum>
Nov 08 23:11:33 user nova-compute[75045]:     </mode>
Nov 08 23:11:33 user nova-compute[75045]:     <mode name='maximum' supported='yes'>
Nov 08 23:11:33 user nova-compute[75045]:       <enum name='maximumMigratable'>
Nov 08 23:11:33 user nova-compute[75045]:         <value>on</value>
Nov 08 23:11:33 user nova-compute[75045]:         <value>off</value>
Nov 08 23:11:33 user nova-compute[75045]:       </enum>
Nov 08 23:11:33 user nova-compute[75045]:     </mode>
Nov 08 23:11:33 user nova-compute[75045]:     <mode name='host-model' supported='yes'>
Nov 08 23:11:33 user nova-compute[75045]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 08 23:11:33 user nova-compute[75045]:       <vendor>Intel</vendor>
Nov 08 23:11:33 user nova-compute[75045]:       <feature policy='require' name='ss'/>
Nov 08 23:11:33 user nova-compute[75045]:       <feature policy='require' name='vmx'/>
Nov 08 23:11:33 user nova-compute[75045]:       <feature policy='require' name='pcid'/>
Nov 08 23:11:33 user nova-compute[75045]:       <feature policy='require' name='hypervisor'/>
Nov 08 23:11:33 user nova-compute[75045]:       <feature policy='require' name='arat'/>
Nov 08 23:11:33 user nova-compute[75045]:       <feature policy='require' name='tsc_adjust'/>
Nov 08 23:11:33 user nova-compute[75045]:       <feature policy='require' name='umip'/>
Nov 08 23:11:33 user nova-compute[75045]:       <feature policy='require' name='md-clear'/>
Nov 08 23:11:33 user nova-compute[75045]:       <feature policy='require' name='stibp'/>
Nov 08 23:11:33 user nova-compute[75045]:       <feature policy='require' name='arch-capabilities'/>
Nov 08 23:11:33 user nova-compute[75045]:       <feature policy='require' name='ssbd'/>
Nov 08 23:11:33 user nova-compute[75045]:       <feature policy='require' name='invtsc'/>
Nov 08 23:11:33 user nova-compute[75045]:       <feature policy='require' name='ibpb'/>
Nov 08 23:11:33 user nova-compute[75045]:       <feature policy='require' name='ibrs'/>
Nov 08 23:11:33 user nova-compute[75045]:       <feature policy='require' name='amd-stibp'/>
Nov 08 23:11:33 user nova-compute[75045]:       <feature policy='require' name='amd-ssbd'/>
Nov 08 23:11:33 user nova-compute[75045]:       <feature policy='require' name='rsba'/>
Nov 08 23:11:33 user nova-compute[75045]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 08 23:11:33 user nova-compute[75045]:       <feature policy='require' name='pschange-mc-no'/>
Nov 08 23:11:33 user nova-compute[75045]:       <feature policy='disable' name='erms'/>
Nov 08 23:11:33 user nova-compute[75045]:       <feature policy='disable' name='xsaveopt'/>
Nov 08 23:11:33 user nova-compute[75045]:     </mode>
Nov 08 23:11:33 user nova-compute[75045]:     <mode name='custom' supported='yes'>
Nov 08 23:11:33 user nova-compute[75045]:       <model usable='no'>qemu64</model>
Nov 08 23:11:33 user nova-compute[75045]:       <model usable='yes'>qemu32</model>
Nov 08 23:11:33 user nova-compute[75045]:       <model usable='no'>phenom</model>
Nov 08 23:11:33 user nova-compute[75045]:       <model usable='yes'>pentium3</model>
Nov 08 23:11:33 user nova-compute[75045]:       <model usable='yes'>pentium2</model>
Nov 08 23:11:33 user nova-compute[75045]:       <model usable='yes'>pentium</model>
Nov 08 23:11:33 user nova-compute[75045]:       <model usable='no'>n270</model>
Nov 08 23:11:33 user nova-compute[75045]:       <model usable='yes'>kvm64</model>
Nov 08 23:11:33 user nova-compute[75045]:       <model usable='yes'>kvm32</model>
Nov 08 23:11:33 user nova-compute[75045]:       <model usable='yes'>coreduo</model>
Nov 08 23:11:33 user nova-compute[75045]:       <model usable='yes'>core2duo</model>
Nov 08 23:11:33 user nova-compute[75045]:       <model usable='no'>athlon</model>
Nov 08 23:11:33 user nova-compute[75045]:       <model usable='yes'>Westmere-IBRS</model>
Nov 08 23:11:33 user nova-compute[75045]:       <model usable='yes'>Westmere</model>
Nov 08 23:11:33 user nova-compute[75045]:       <model usable='no'>Snowridge</model>
Nov 08 23:11:33 user nova-compute[75045]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 08 23:11:33 user nova-compute[75045]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 08 23:11:33 user nova-compute[75045]:       <model usable='no'>Skylake-Server</model>
Nov 08 23:11:33 user nova-compute[75045]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 08 23:11:33 user nova-compute[75045]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 08 23:11:33 user nova-compute[75045]:       <model usable='no'>Skylake-Client</model>
Nov 08 23:11:33 user nova-compute[75045]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 08 23:11:33 user nova-compute[75045]:       <model usable='no'>SandyBridge</model>
Nov 08 23:11:33 user nova-compute[75045]:       <model usable='yes'>Penryn</model>
Nov 08 23:11:33 user nova-compute[75045]:       <model usable='no'>Opteron_G5</model>
Nov 08 23:11:33 user nova-compute[75045]:       <model usable='no'>Opteron_G4</model>
Nov 08 23:11:33 user nova-compute[75045]:       <model usable='no'>Opteron_G3</model>
Nov 08 23:11:33 user nova-compute[75045]:       <model usable='no'>Opteron_G2</model>
Nov 08 23:11:33 user nova-compute[75045]:       <model usable='yes'>Opteron_G1</model>
Nov 08 23:11:33 user nova-compute[75045]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 08 23:11:33 user nova-compute[75045]:       <model usable='yes'>Nehalem</model>
Nov 08 23:11:33 user nova-compute[75045]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 08 23:11:33 user nova-compute[75045]:       <model usable='no'>IvyBridge</model>
Nov 08 23:11:33 user nova-compute[75045]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 08 23:11:33 user nova-compute[75045]:       <model usable='no'>Icelake-Server</model>
Nov 08 23:11:33 user nova-compute[75045]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 08 23:11:33 user nova-compute[75045]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 08 23:11:33 user nova-compute[75045]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 08 23:11:33 user nova-compute[75045]:       <model usable='no'>Haswell-noTSX</model>
Nov 08 23:11:33 user nova-compute[75045]:       <model usable='no'>Haswell-IBRS</model>
Nov 08 23:11:33 user nova-compute[75045]:       <model usable='no'>Haswell</model>
Nov 08 23:11:33 user nova-compute[75045]:       <model usable='no'>EPYC-Rome</model>
Nov 08 23:11:33 user nova-compute[75045]:       <model usable='no'>EPYC-Milan</model>
Nov 08 23:11:33 user nova-compute[75045]:       <model usable='no'>EPYC-IBPB</model>
Nov 08 23:11:33 user nova-compute[75045]:       <model usable='no'>EPYC</model>
Nov 08 23:11:33 user nova-compute[75045]:       <model usable='no'>Dhyana</model>
Nov 08 23:11:33 user nova-compute[75045]:       <model usable='no'>Cooperlake</model>
Nov 08 23:11:33 user nova-compute[75045]:       <model usable='yes'>Conroe</model>
Nov 08 23:11:33 user nova-compute[75045]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 08 23:11:33 user nova-compute[75045]:       <model usable='no'>Cascadelake-Server</model>
Nov 08 23:11:33 user nova-compute[75045]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 08 23:11:33 user nova-compute[75045]:       <model usable='no'>Broadwell-noTSX</model>
Nov 08 23:11:33 user nova-compute[75045]:       <model usable='no'>Broadwell-IBRS</model>
Nov 08 23:11:33 user nova-compute[75045]:       <model usable='no'>Broadwell</model>
Nov 08 23:11:33 user nova-compute[75045]:       <model usable='yes'>486</model>
Nov 08 23:11:33 user nova-compute[75045]:     </mode>
Nov 08 23:11:33 user nova-compute[75045]:   </cpu>
Nov 08 23:11:33 user nova-compute[75045]:   <memoryBacking supported='yes'>
Nov 08 23:11:33 user nova-compute[75045]:     <enum name='sourceType'>
Nov 08 23:11:33 user nova-compute[75045]:       <value>file</value>
Nov 08 23:11:33 user nova-compute[75045]:       <value>anonymous</value>
Nov 08 23:11:33 user nova-compute[75045]:       <value>memfd</value>
Nov 08 23:11:33 user nova-compute[75045]:     </enum>
Nov 08 23:11:33 user nova-compute[75045]:   </memoryBacking>
Nov 08 23:11:33 user nova-compute[75045]:   <devices>
Nov 08 23:11:33 user nova-compute[75045]:     <disk supported='yes'>
Nov 08 23:11:33 user nova-compute[75045]:       <enum name='diskDevice'>
Nov 08 23:11:33 user nova-compute[75045]:         <value>disk</value>
Nov 08 23:11:33 user nova-compute[75045]:         <value>cdrom</value>
Nov 08 23:11:33 user nova-compute[75045]:         <value>floppy</value>
Nov 08 23:11:33 user nova-compute[75045]:         <value>lun</value>
Nov 08 23:11:33 user nova-compute[75045]:       </enum>
Nov 08 23:11:33 user nova-compute[75045]:       <enum name='bus'>
Nov 08 23:11:33 user nova-compute[75045]:         <value>ide</value>
Nov 08 23:11:33 user nova-compute[75045]:         <value>fdc</value>
Nov 08 23:11:33 user nova-compute[75045]:         <value>scsi</value>
Nov 08 23:11:33 user nova-compute[75045]:         <value>virtio</value>
Nov 08 23:11:33 user nova-compute[75045]:         <value>usb</value>
Nov 08 23:11:33 user nova-compute[75045]:         <value>sata</value>
Nov 08 23:11:33 user nova-compute[75045]:       </enum>
Nov 08 23:11:33 user nova-compute[75045]:       <enum name='model'>
Nov 08 23:11:33 user nova-compute[75045]:         <value>virtio</value>
Nov 08 23:11:33 user nova-compute[75045]:         <value>virtio-transitional</value>
Nov 08 23:11:33 user nova-compute[75045]:         <value>virtio-non-transitional</value>
Nov 08 23:11:33 user nova-compute[75045]:       </enum>
Nov 08 23:11:33 user nova-compute[75045]:     </disk>
Nov 08 23:11:33 user nova-compute[75045]:     <graphics supported='yes'>
Nov 08 23:11:33 user nova-compute[75045]:       <enum name='type'>
Nov 08 23:11:33 user nova-compute[75045]:         <value>sdl</value>
Nov 08 23:11:33 user nova-compute[75045]:         <value>vnc</value>
Nov 08 23:11:33 user nova-compute[75045]:         <value>spice</value>
Nov 08 23:11:33 user nova-compute[75045]:         <value>egl-headless</value>
Nov 08 23:11:33 user nova-compute[75045]:       </enum>
Nov 08 23:11:33 user nova-compute[75045]:     </graphics>
Nov 08 23:11:33 user nova-compute[75045]:     <video supported='yes'>
Nov 08 23:11:33 user nova-compute[75045]:       <enum name='modelType'>
Nov 08 23:11:33 user nova-compute[75045]:         <value>vga</value>
Nov 08 23:11:33 user nova-compute[75045]:         <value>cirrus</value>
Nov 08 23:11:33 user nova-compute[75045]:         <value>vmvga</value>
Nov 08 23:11:33 user nova-compute[75045]:         <value>qxl</value>
Nov 08 23:11:33 user nova-compute[75045]:         <value>virtio</value>
Nov 08 23:11:33 user nova-compute[75045]:         <value>none</value>
Nov 08 23:11:33 user nova-compute[75045]:         <value>bochs</value>
Nov 08 23:11:33 user nova-compute[75045]:         <value>ramfb</value>
Nov 08 23:11:33 user nova-compute[75045]:       </enum>
Nov 08 23:11:33 user nova-compute[75045]:     </video>
Nov 08 23:11:33 user nova-compute[75045]:     <hostdev supported='yes'>
Nov 08 23:11:33 user nova-compute[75045]:       <enum name='mode'>
Nov 08 23:11:33 user nova-compute[75045]:         <value>subsystem</value>
Nov 08 23:11:33 user nova-compute[75045]:       </enum>
Nov 08 23:11:33 user nova-compute[75045]:       <enum name='startupPolicy'>
Nov 08 23:11:33 user nova-compute[75045]:         <value>default</value>
Nov 08 23:11:33 user nova-compute[75045]:         <value>mandatory</value>
Nov 08 23:11:33 user nova-compute[75045]:         <value>requisite</value>
Nov 08 23:11:33 user nova-compute[75045]:         <value>optional</value>
Nov 08 23:11:33 user nova-compute[75045]:       </enum>
Nov 08 23:11:33 user nova-compute[75045]:       <enum name='subsysType'>
Nov 08 23:11:33 user nova-compute[75045]:         <value>usb</value>
Nov 08 23:11:33 user nova-compute[75045]:         <value>pci</value>
Nov 08 23:11:33 user nova-compute[75045]:         <value>scsi</value>
Nov 08 23:11:33 user nova-compute[75045]:       </enum>
Nov 08 23:11:33 user nova-compute[75045]:       <enum name='capsType'/>
Nov 08 23:11:33 user nova-compute[75045]:       <enum name='pciBackend'/>
Nov 08 23:11:33 user nova-compute[75045]:     </hostdev>
Nov 08 23:11:33 user nova-compute[75045]:     <rng supported='yes'>
Nov 08 23:11:33 user nova-compute[75045]:       <enum name='model'>
Nov 08 23:11:33 user nova-compute[75045]:         <value>virtio</value>
Nov 08 23:11:33 user nova-compute[75045]:         <value>virtio-transitional</value>
Nov 08 23:11:33 user nova-compute[75045]:         <value>virtio-non-transitional</value>
Nov 08 23:11:33 user nova-compute[75045]:       </enum>
Nov 08 23:11:33 user nova-compute[75045]:       <enum name='backendModel'>
Nov 08 23:11:33 user nova-compute[75045]:         <value>random</value>
Nov 08 23:11:33 user nova-compute[75045]:         <value>egd</value>
Nov 08 23:11:33 user nova-compute[75045]:         <value>builtin</value>
Nov 08 23:11:33 user nova-compute[75045]:       </enum>
Nov 08 23:11:33 user nova-compute[75045]:     </rng>
Nov 08 23:11:33 user nova-compute[75045]:     <filesystem supported='yes'>
Nov 08 23:11:33 user nova-compute[75045]:       <enum name='driverType'>
Nov 08 23:11:33 user nova-compute[75045]:         <value>path</value>
Nov 08 23:11:33 user nova-compute[75045]:         <value>handle</value>
Nov 08 23:11:33 user nova-compute[75045]:         <value>virtiofs</value>
Nov 08 23:11:33 user nova-compute[75045]:       </enum>
Nov 08 23:11:33 user nova-compute[75045]:     </filesystem>
Nov 08 23:11:33 user nova-compute[75045]:     <tpm supported='yes'>
Nov 08 23:11:33 user nova-compute[75045]:       <enum name='model'>
Nov 08 23:11:33 user nova-compute[75045]:         <value>tpm-tis</value>
Nov 08 23:11:33 user nova-compute[75045]:         <value>tpm-crb</value>
Nov 08 23:11:33 user nova-compute[75045]:       </enum>
Nov 08 23:11:33 user nova-compute[75045]:       <enum name='backendModel'>
Nov 08 23:11:33 user nova-compute[75045]:         <value>passthrough</value>
Nov 08 23:11:33 user nova-compute[75045]:         <value>emulator</value>
Nov 08 23:11:33 user nova-compute[75045]:       </enum>
Nov 08 23:11:33 user nova-compute[75045]:     </tpm>
Nov 08 23:11:33 user nova-compute[75045]:   </devices>
Nov 08 23:11:33 user nova-compute[75045]:   <features>
Nov 08 23:11:33 user nova-compute[75045]:     <gic supported='no'/>
Nov 08 23:11:33 user nova-compute[75045]:     <vmcoreinfo supported='yes'/>
Nov 08 23:11:33 user nova-compute[75045]:     <genid supported='yes'/>
Nov 08 23:11:33 user nova-compute[75045]:     <backingStoreInput supported='yes'/>
Nov 08 23:11:33 user nova-compute[75045]:     <backup supported='yes'/>
Nov 08 23:11:33 user nova-compute[75045]:     <sev supported='no'/>
Nov 08 23:11:33 user nova-compute[75045]:   </features>
Nov 08 23:11:33 user nova-compute[75045]: </domainCapabilities>
Nov 08 23:11:33 user nova-compute[75045]:  {{(pid=75045) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 08 23:11:33 user nova-compute[75045]: DEBUG nova.virt.libvirt.host [None req-b1869e0d-6af1-4bcb-a839-fb2c1c69e58c None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=q35:
Nov 08 23:11:33 user nova-compute[75045]: <domainCapabilities>
Nov 08 23:11:33 user nova-compute[75045]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 08 23:11:33 user nova-compute[75045]:   <domain>kvm</domain>
Nov 08 23:11:33 user nova-compute[75045]:   <machine>pc-q35-6.2</machine>
Nov 08 23:11:33 user nova-compute[75045]:   <arch>x86_64</arch>
Nov 08 23:11:33 user nova-compute[75045]:   <vcpu max='288'/>
Nov 08 23:11:33 user nova-compute[75045]:   <iothreads supported='yes'/>
Nov 08 23:11:33 user nova-compute[75045]:   <os supported='yes'>
Nov 08 23:11:33 user nova-compute[75045]:     <enum name='firmware'>
Nov 08 23:11:33 user nova-compute[75045]:       <value>efi</value>
Nov 08 23:11:33 user nova-compute[75045]:     </enum>
Nov 08 23:11:33 user nova-compute[75045]:     <loader supported='yes'>
Nov 08 23:11:33 user nova-compute[75045]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Nov 08 23:11:33 user nova-compute[75045]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Nov 08 23:11:33 user nova-compute[75045]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 08 23:11:33 user nova-compute[75045]:       <enum name='type'>
Nov 08 23:11:33 user nova-compute[75045]:         <value>rom</value>
Nov 08 23:11:33 user nova-compute[75045]:         <value>pflash</value>
Nov 08 23:11:33 user nova-compute[75045]:       </enum>
Nov 08 23:11:33 user nova-compute[75045]:       <enum name='readonly'>
Nov 08 23:11:33 user nova-compute[75045]:         <value>yes</value>
Nov 08 23:11:33 user nova-compute[75045]:         <value>no</value>
Nov 08 23:11:33 user nova-compute[75045]:       </enum>
Nov 08 23:11:33 user nova-compute[75045]:       <enum name='secure'>
Nov 08 23:11:33 user nova-compute[75045]:         <value>yes</value>
Nov 08 23:11:33 user nova-compute[75045]:         <value>no</value>
Nov 08 23:11:33 user nova-compute[75045]:       </enum>
Nov 08 23:11:33 user nova-compute[75045]:     </loader>
Nov 08 23:11:33 user nova-compute[75045]:   </os>
Nov 08 23:11:33 user nova-compute[75045]:   <cpu>
Nov 08 23:11:33 user nova-compute[75045]:     <mode name='host-passthrough' supported='yes'>
Nov 08 23:11:33 user nova-compute[75045]:       <enum name='hostPassthroughMigratable'>
Nov 08 23:11:33 user nova-compute[75045]:         <value>on</value>
Nov 08 23:11:33 user nova-compute[75045]:         <value>off</value>
Nov 08 23:11:33 user nova-compute[75045]:       </enum>
Nov 08 23:11:33 user nova-compute[75045]:     </mode>
Nov 08 23:11:33 user nova-compute[75045]:     <mode name='maximum' supported='yes'>
Nov 08 23:11:33 user nova-compute[75045]:       <enum name='maximumMigratable'>
Nov 08 23:11:33 user nova-compute[75045]:         <value>on</value>
Nov 08 23:11:33 user nova-compute[75045]:         <value>off</value>
Nov 08 23:11:33 user nova-compute[75045]:       </enum>
Nov 08 23:11:33 user nova-compute[75045]:     </mode>
Nov 08 23:11:33 user nova-compute[75045]:     <mode name='host-model' supported='yes'>
Nov 08 23:11:33 user nova-compute[75045]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 08 23:11:33 user nova-compute[75045]:       <vendor>Intel</vendor>
Nov 08 23:11:33 user nova-compute[75045]:       <feature policy='require' name='ss'/>
Nov 08 23:11:33 user nova-compute[75045]:       <feature policy='require' name='vmx'/>
Nov 08 23:11:33 user nova-compute[75045]:       <feature policy='require' name='pcid'/>
Nov 08 23:11:33 user nova-compute[75045]:       <feature policy='require' name='hypervisor'/>
Nov 08 23:11:33 user nova-compute[75045]:       <feature policy='require' name='arat'/>
Nov 08 23:11:33 user nova-compute[75045]:       <feature policy='require' name='tsc_adjust'/>
Nov 08 23:11:33 user nova-compute[75045]:       <feature policy='require' name='umip'/>
Nov 08 23:11:33 user nova-compute[75045]:       <feature policy='require' name='md-clear'/>
Nov 08 23:11:33 user nova-compute[75045]:       <feature policy='require' name='stibp'/>
Nov 08 23:11:33 user nova-compute[75045]:       <feature policy='require' name='arch-capabilities'/>
Nov 08 23:11:33 user nova-compute[75045]:       <feature policy='require' name='ssbd'/>
Nov 08 23:11:33 user nova-compute[75045]:       <feature policy='require' name='invtsc'/>
Nov 08 23:11:33 user nova-compute[75045]:       <feature policy='require' name='ibpb'/>
Nov 08 23:11:33 user nova-compute[75045]:       <feature policy='require' name='ibrs'/>
Nov 08 23:11:33 user nova-compute[75045]:       <feature policy='require' name='amd-stibp'/>
Nov 08 23:11:33 user nova-compute[75045]:       <feature policy='require' name='amd-ssbd'/>
Nov 08 23:11:33 user nova-compute[75045]:       <feature policy='require' name='rsba'/>
Nov 08 23:11:33 user nova-compute[75045]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 08 23:11:33 user nova-compute[75045]:       <feature policy='require' name='pschange-mc-no'/>
Nov 08 23:11:33 user nova-compute[75045]:       <feature policy='disable' name='erms'/>
Nov 08 23:11:33 user nova-compute[75045]:       <feature policy='disable' name='xsaveopt'/>
Nov 08 23:11:33 user nova-compute[75045]:     </mode>
Nov 08 23:11:33 user nova-compute[75045]:     <mode name='custom' supported='yes'>
Nov 08 23:11:33 user nova-compute[75045]:       <model usable='no'>qemu64</model>
Nov 08 23:11:33 user nova-compute[75045]:       <model usable='yes'>qemu32</model>
Nov 08 23:11:33 user nova-compute[75045]:       <model usable='no'>phenom</model>
Nov 08 23:11:33 user nova-compute[75045]:       <model usable='yes'>pentium3</model>
Nov 08 23:11:33 user nova-compute[75045]:       <model usable='yes'>pentium2</model>
Nov 08 23:11:33 user nova-compute[75045]:       <model usable='yes'>pentium</model>
Nov 08 23:11:33 user nova-compute[75045]:       <model usable='no'>n270</model>
Nov 08 23:11:33 user nova-compute[75045]:       <model usable='yes'>kvm64</model>
Nov 08 23:11:33 user nova-compute[75045]:       <model usable='yes'>kvm32</model>
Nov 08 23:11:33 user nova-compute[75045]:       <model usable='yes'>coreduo</model>
Nov 08 23:11:33 user nova-compute[75045]:       <model usable='yes'>core2duo</model>
Nov 08 23:11:33 user nova-compute[75045]:       <model usable='no'>athlon</model>
Nov 08 23:11:33 user nova-compute[75045]:       <model usable='yes'>Westmere-IBRS</model>
Nov 08 23:11:33 user nova-compute[75045]:       <model usable='yes'>Westmere</model>
Nov 08 23:11:33 user nova-compute[75045]:       <model usable='no'>Snowridge</model>
Nov 08 23:11:33 user nova-compute[75045]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 08 23:11:33 user nova-compute[75045]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 08 23:11:33 user nova-compute[75045]:       <model usable='no'>Skylake-Server</model>
Nov 08 23:11:33 user nova-compute[75045]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 08 23:11:33 user nova-compute[75045]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 08 23:11:33 user nova-compute[75045]:       <model usable='no'>Skylake-Client</model>
Nov 08 23:11:33 user nova-compute[75045]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 08 23:11:33 user nova-compute[75045]:       <model usable='no'>SandyBridge</model>
Nov 08 23:11:33 user nova-compute[75045]:       <model usable='yes'>Penryn</model>
Nov 08 23:11:33 user nova-compute[75045]:       <model usable='no'>Opteron_G5</model>
Nov 08 23:11:33 user nova-compute[75045]:       <model usable='no'>Opteron_G4</model>
Nov 08 23:11:33 user nova-compute[75045]:       <model usable='no'>Opteron_G3</model>
Nov 08 23:11:33 user nova-compute[75045]:       <model usable='no'>Opteron_G2</model>
Nov 08 23:11:33 user nova-compute[75045]:       <model usable='yes'>Opteron_G1</model>
Nov 08 23:11:33 user nova-compute[75045]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 08 23:11:33 user nova-compute[75045]:       <model usable='yes'>Nehalem</model>
Nov 08 23:11:33 user nova-compute[75045]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 08 23:11:33 user nova-compute[75045]:       <model usable='no'>IvyBridge</model>
Nov 08 23:11:33 user nova-compute[75045]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 08 23:11:33 user nova-compute[75045]:       <model usable='no'>Icelake-Server</model>
Nov 08 23:11:33 user nova-compute[75045]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 08 23:11:33 user nova-compute[75045]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 08 23:11:33 user nova-compute[75045]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 08 23:11:33 user nova-compute[75045]:       <model usable='no'>Haswell-noTSX</model>
Nov 08 23:11:33 user nova-compute[75045]:       <model usable='no'>Haswell-IBRS</model>
Nov 08 23:11:33 user nova-compute[75045]:       <model usable='no'>Haswell</model>
Nov 08 23:11:33 user nova-compute[75045]:       <model usable='no'>EPYC-Rome</model>
Nov 08 23:11:33 user nova-compute[75045]:       <model usable='no'>EPYC-Milan</model>
Nov 08 23:11:33 user nova-compute[75045]:       <model usable='no'>EPYC-IBPB</model>
Nov 08 23:11:33 user nova-compute[75045]:       <model usable='no'>EPYC</model>
Nov 08 23:11:33 user nova-compute[75045]:       <model usable='no'>Dhyana</model>
Nov 08 23:11:33 user nova-compute[75045]:       <model usable='no'>Cooperlake</model>
Nov 08 23:11:33 user nova-compute[75045]:       <model usable='yes'>Conroe</model>
Nov 08 23:11:33 user nova-compute[75045]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 08 23:11:33 user nova-compute[75045]:       <model usable='no'>Cascadelake-Server</model>
Nov 08 23:11:33 user nova-compute[75045]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 08 23:11:33 user nova-compute[75045]:       <model usable='no'>Broadwell-noTSX</model>
Nov 08 23:11:33 user nova-compute[75045]:       <model usable='no'>Broadwell-IBRS</model>
Nov 08 23:11:33 user nova-compute[75045]:       <model usable='no'>Broadwell</model>
Nov 08 23:11:33 user nova-compute[75045]:       <model usable='yes'>486</model>
Nov 08 23:11:33 user nova-compute[75045]:     </mode>
Nov 08 23:11:33 user nova-compute[75045]:   </cpu>
Nov 08 23:11:33 user nova-compute[75045]:   <memoryBacking supported='yes'>
Nov 08 23:11:33 user nova-compute[75045]:     <enum name='sourceType'>
Nov 08 23:11:33 user nova-compute[75045]:       <value>file</value>
Nov 08 23:11:33 user nova-compute[75045]:       <value>anonymous</value>
Nov 08 23:11:33 user nova-compute[75045]:       <value>memfd</value>
Nov 08 23:11:33 user nova-compute[75045]:     </enum>
Nov 08 23:11:33 user nova-compute[75045]:   </memoryBacking>
Nov 08 23:11:33 user nova-compute[75045]:   <devices>
Nov 08 23:11:33 user nova-compute[75045]:     <disk supported='yes'>
Nov 08 23:11:33 user nova-compute[75045]:       <enum name='diskDevice'>
Nov 08 23:11:33 user nova-compute[75045]:         <value>disk</value>
Nov 08 23:11:33 user nova-compute[75045]:         <value>cdrom</value>
Nov 08 23:11:33 user nova-compute[75045]:         <value>floppy</value>
Nov 08 23:11:33 user nova-compute[75045]:         <value>lun</value>
Nov 08 23:11:33 user nova-compute[75045]:       </enum>
Nov 08 23:11:33 user nova-compute[75045]:       <enum name='bus'>
Nov 08 23:11:33 user nova-compute[75045]:         <value>fdc</value>
Nov 08 23:11:33 user nova-compute[75045]:         <value>scsi</value>
Nov 08 23:11:33 user nova-compute[75045]:         <value>virtio</value>
Nov 08 23:11:33 user nova-compute[75045]:         <value>usb</value>
Nov 08 23:11:33 user nova-compute[75045]:         <value>sata</value>
Nov 08 23:11:33 user nova-compute[75045]:       </enum>
Nov 08 23:11:33 user nova-compute[75045]:       <enum name='model'>
Nov 08 23:11:33 user nova-compute[75045]:         <value>virtio</value>
Nov 08 23:11:33 user nova-compute[75045]:         <value>virtio-transitional</value>
Nov 08 23:11:33 user nova-compute[75045]:         <value>virtio-non-transitional</value>
Nov 08 23:11:33 user nova-compute[75045]:       </enum>
Nov 08 23:11:33 user nova-compute[75045]:     </disk>
Nov 08 23:11:33 user nova-compute[75045]:     <graphics supported='yes'>
Nov 08 23:11:33 user nova-compute[75045]:       <enum name='type'>
Nov 08 23:11:33 user nova-compute[75045]:         <value>sdl</value>
Nov 08 23:11:33 user nova-compute[75045]:         <value>vnc</value>
Nov 08 23:11:33 user nova-compute[75045]:         <value>spice</value>
Nov 08 23:11:33 user nova-compute[75045]:         <value>egl-headless</value>
Nov 08 23:11:33 user nova-compute[75045]:       </enum>
Nov 08 23:11:33 user nova-compute[75045]:     </graphics>
Nov 08 23:11:33 user nova-compute[75045]:     <video supported='yes'>
Nov 08 23:11:33 user nova-compute[75045]:       <enum name='modelType'>
Nov 08 23:11:33 user nova-compute[75045]:         <value>vga</value>
Nov 08 23:11:33 user nova-compute[75045]:         <value>cirrus</value>
Nov 08 23:11:33 user nova-compute[75045]:         <value>vmvga</value>
Nov 08 23:11:33 user nova-compute[75045]:         <value>qxl</value>
Nov 08 23:11:33 user nova-compute[75045]:         <value>virtio</value>
Nov 08 23:11:33 user nova-compute[75045]:         <value>none</value>
Nov 08 23:11:33 user nova-compute[75045]:         <value>bochs</value>
Nov 08 23:11:33 user nova-compute[75045]:         <value>ramfb</value>
Nov 08 23:11:33 user nova-compute[75045]:       </enum>
Nov 08 23:11:33 user nova-compute[75045]:     </video>
Nov 08 23:11:33 user nova-compute[75045]:     <hostdev supported='yes'>
Nov 08 23:11:33 user nova-compute[75045]:       <enum name='mode'>
Nov 08 23:11:33 user nova-compute[75045]:         <value>subsystem</value>
Nov 08 23:11:33 user nova-compute[75045]:       </enum>
Nov 08 23:11:33 user nova-compute[75045]:       <enum name='startupPolicy'>
Nov 08 23:11:33 user nova-compute[75045]:         <value>default</value>
Nov 08 23:11:33 user nova-compute[75045]:         <value>mandatory</value>
Nov 08 23:11:33 user nova-compute[75045]:         <value>requisite</value>
Nov 08 23:11:33 user nova-compute[75045]:         <value>optional</value>
Nov 08 23:11:33 user nova-compute[75045]:       </enum>
Nov 08 23:11:33 user nova-compute[75045]:       <enum name='subsysType'>
Nov 08 23:11:33 user nova-compute[75045]:         <value>usb</value>
Nov 08 23:11:33 user nova-compute[75045]:         <value>pci</value>
Nov 08 23:11:33 user nova-compute[75045]:         <value>scsi</value>
Nov 08 23:11:33 user nova-compute[75045]:       </enum>
Nov 08 23:11:33 user nova-compute[75045]:       <enum name='capsType'/>
Nov 08 23:11:33 user nova-compute[75045]:       <enum name='pciBackend'/>
Nov 08 23:11:33 user nova-compute[75045]:     </hostdev>
Nov 08 23:11:33 user nova-compute[75045]:     <rng supported='yes'>
Nov 08 23:11:33 user nova-compute[75045]:       <enum name='model'>
Nov 08 23:11:33 user nova-compute[75045]:         <value>virtio</value>
Nov 08 23:11:33 user nova-compute[75045]:         <value>virtio-transitional</value>
Nov 08 23:11:33 user nova-compute[75045]:         <value>virtio-non-transitional</value>
Nov 08 23:11:33 user nova-compute[75045]:       </enum>
Nov 08 23:11:33 user nova-compute[75045]:       <enum name='backendModel'>
Nov 08 23:11:33 user nova-compute[75045]:         <value>random</value>
Nov 08 23:11:33 user nova-compute[75045]:         <value>egd</value>
Nov 08 23:11:33 user nova-compute[75045]:         <value>builtin</value>
Nov 08 23:11:33 user nova-compute[75045]:       </enum>
Nov 08 23:11:33 user nova-compute[75045]:     </rng>
Nov 08 23:11:33 user nova-compute[75045]:     <filesystem supported='yes'>
Nov 08 23:11:33 user nova-compute[75045]:       <enum name='driverType'>
Nov 08 23:11:33 user nova-compute[75045]:         <value>path</value>
Nov 08 23:11:33 user nova-compute[75045]:         <value>handle</value>
Nov 08 23:11:33 user nova-compute[75045]:         <value>virtiofs</value>
Nov 08 23:11:33 user nova-compute[75045]:       </enum>
Nov 08 23:11:33 user nova-compute[75045]:     </filesystem>
Nov 08 23:11:33 user nova-compute[75045]:     <tpm supported='yes'>
Nov 08 23:11:33 user nova-compute[75045]:       <enum name='model'>
Nov 08 23:11:33 user nova-compute[75045]:         <value>tpm-tis</value>
Nov 08 23:11:33 user nova-compute[75045]:         <value>tpm-crb</value>
Nov 08 23:11:33 user nova-compute[75045]:       </enum>
Nov 08 23:11:33 user nova-compute[75045]:       <enum name='backendModel'>
Nov 08 23:11:33 user nova-compute[75045]:         <value>passthrough</value>
Nov 08 23:11:33 user nova-compute[75045]:         <value>emulator</value>
Nov 08 23:11:33 user nova-compute[75045]:       </enum>
Nov 08 23:11:33 user nova-compute[75045]:     </tpm>
Nov 08 23:11:33 user nova-compute[75045]:   </devices>
Nov 08 23:11:33 user nova-compute[75045]:   <features>
Nov 08 23:11:33 user nova-compute[75045]:     <gic supported='no'/>
Nov 08 23:11:33 user nova-compute[75045]:     <vmcoreinfo supported='yes'/>
Nov 08 23:11:33 user nova-compute[75045]:     <genid supported='yes'/>
Nov 08 23:11:33 user nova-compute[75045]:     <backingStoreInput supported='yes'/>
Nov 08 23:11:33 user nova-compute[75045]:     <backup supported='yes'/>
Nov 08 23:11:33 user nova-compute[75045]:     <sev supported='no'/>
Nov 08 23:11:33 user nova-compute[75045]:   </features>
Nov 08 23:11:33 user nova-compute[75045]: </domainCapabilities>
Nov 08 23:11:33 user nova-compute[75045]:  {{(pid=75045) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 08 23:11:33 user nova-compute[75045]: DEBUG nova.virt.libvirt.host [None req-b1869e0d-6af1-4bcb-a839-fb2c1c69e58c None None] Getting domain capabilities for xtensa via machine types: {None} {{(pid=75045) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 08 23:11:33 user nova-compute[75045]: DEBUG nova.virt.libvirt.host [None req-b1869e0d-6af1-4bcb-a839-fb2c1c69e58c None None] Error from libvirt when retrieving domain capabilities for arch xtensa / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensa' on this host {{(pid=75045) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 08 23:11:33 user nova-compute[75045]: DEBUG nova.virt.libvirt.host [None req-b1869e0d-6af1-4bcb-a839-fb2c1c69e58c None None] Getting domain capabilities for xtensaeb via machine types: {None} {{(pid=75045) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 08 23:11:33 user nova-compute[75045]: DEBUG nova.virt.libvirt.host [None req-b1869e0d-6af1-4bcb-a839-fb2c1c69e58c None None] Error from libvirt when retrieving domain capabilities for arch xtensaeb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensaeb' on this host {{(pid=75045) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 08 23:11:33 user nova-compute[75045]: DEBUG nova.virt.libvirt.host [None req-b1869e0d-6af1-4bcb-a839-fb2c1c69e58c None None] Checking secure boot support for host arch (x86_64) {{(pid=75045) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Nov 08 23:11:33 user nova-compute[75045]: DEBUG nova.virt.libvirt.host [None req-b1869e0d-6af1-4bcb-a839-fb2c1c69e58c None None] Checking secure boot support for host arch (x86_64) {{(pid=75045) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Nov 08 23:11:33 user nova-compute[75045]: DEBUG nova.virt.libvirt.host [None req-b1869e0d-6af1-4bcb-a839-fb2c1c69e58c None None] Checking secure boot support for host arch (x86_64) {{(pid=75045) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Nov 08 23:11:33 user nova-compute[75045]: INFO nova.virt.libvirt.host [None req-b1869e0d-6af1-4bcb-a839-fb2c1c69e58c None None] Secure Boot support detected
Nov 08 23:11:33 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-b1869e0d-6af1-4bcb-a839-fb2c1c69e58c None None] cpu compare xml: <cpu match="exact">
Nov 08 23:11:33 user nova-compute[75045]:   <model>Nehalem</model>
Nov 08 23:11:33 user nova-compute[75045]: </cpu>
Nov 08 23:11:33 user nova-compute[75045]:  {{(pid=75045) _compare_cpu /opt/stack/nova/nova/virt/libvirt/driver.py:10023}}
Nov 08 23:11:33 user nova-compute[75045]: INFO nova.virt.node [None req-b1869e0d-6af1-4bcb-a839-fb2c1c69e58c None None] Generated node identity 62ba5f85-c74d-4b58-986e-d4197e813fd7
Nov 08 23:11:33 user nova-compute[75045]: INFO nova.virt.node [None req-b1869e0d-6af1-4bcb-a839-fb2c1c69e58c None None] Wrote node identity 62ba5f85-c74d-4b58-986e-d4197e813fd7 to /opt/stack/data/nova/compute_id
Nov 08 23:11:33 user nova-compute[75045]: WARNING nova.compute.manager [None req-b1869e0d-6af1-4bcb-a839-fb2c1c69e58c None None] Compute nodes ['62ba5f85-c74d-4b58-986e-d4197e813fd7'] for host user were not found in the database. If this is the first time this service is starting on this host, then you can ignore this warning.
Nov 08 23:11:33 user nova-compute[75045]: INFO nova.compute.manager [None req-b1869e0d-6af1-4bcb-a839-fb2c1c69e58c None None] Looking for unclaimed instances stuck in BUILDING status for nodes managed by this host
Nov 08 23:11:33 user nova-compute[75045]: WARNING nova.compute.manager [None req-b1869e0d-6af1-4bcb-a839-fb2c1c69e58c None None] No compute node record found for host user. If this is the first time this service is starting on this host, then you can ignore this warning.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Nov 08 23:11:33 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-b1869e0d-6af1-4bcb-a839-fb2c1c69e58c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:11:33 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-b1869e0d-6af1-4bcb-a839-fb2c1c69e58c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:11:33 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-b1869e0d-6af1-4bcb-a839-fb2c1c69e58c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:11:33 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-b1869e0d-6af1-4bcb-a839-fb2c1c69e58c None None] Auditing locally available compute resources for user (node: user) {{(pid=75045) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 23:11:33 user nova-compute[75045]: WARNING nova.virt.libvirt.driver [None req-b1869e0d-6af1-4bcb-a839-fb2c1c69e58c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 23:11:33 user nova-compute[75045]: WARNING nova.virt.libvirt.driver [None req-b1869e0d-6af1-4bcb-a839-fb2c1c69e58c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 23:11:33 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-b1869e0d-6af1-4bcb-a839-fb2c1c69e58c None None] Hypervisor/Node resource view: name=user free_ram=10906MB free_disk=26.120975494384766GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75045) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 23:11:33 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-b1869e0d-6af1-4bcb-a839-fb2c1c69e58c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:11:33 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-b1869e0d-6af1-4bcb-a839-fb2c1c69e58c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:11:33 user nova-compute[75045]: WARNING nova.compute.resource_tracker [None req-b1869e0d-6af1-4bcb-a839-fb2c1c69e58c None None] No compute node record for user:62ba5f85-c74d-4b58-986e-d4197e813fd7: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host 62ba5f85-c74d-4b58-986e-d4197e813fd7 could not be found.
Nov 08 23:11:33 user nova-compute[75045]: INFO nova.compute.resource_tracker [None req-b1869e0d-6af1-4bcb-a839-fb2c1c69e58c None None] Compute node record created for user:user with uuid: 62ba5f85-c74d-4b58-986e-d4197e813fd7
Nov 08 23:11:33 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-b1869e0d-6af1-4bcb-a839-fb2c1c69e58c None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75045) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 23:11:33 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-b1869e0d-6af1-4bcb-a839-fb2c1c69e58c None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75045) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 23:11:33 user nova-compute[75045]: INFO nova.scheduler.client.report [None req-b1869e0d-6af1-4bcb-a839-fb2c1c69e58c None None] [req-e0367435-ca90-4119-a261-d10474000a23] Created resource provider record via placement API for resource provider with UUID 62ba5f85-c74d-4b58-986e-d4197e813fd7 and name user.
Nov 08 23:11:33 user nova-compute[75045]: DEBUG nova.virt.libvirt.host [None req-b1869e0d-6af1-4bcb-a839-fb2c1c69e58c None None] /sys/module/kvm_amd/parameters/sev does not exist {{(pid=75045) _kernel_supports_amd_sev /opt/stack/nova/nova/virt/libvirt/host.py:1795}}
Nov 08 23:11:33 user nova-compute[75045]: INFO nova.virt.libvirt.host [None req-b1869e0d-6af1-4bcb-a839-fb2c1c69e58c None None] kernel doesn't support AMD SEV
Nov 08 23:11:33 user nova-compute[75045]: DEBUG nova.compute.provider_tree [None req-b1869e0d-6af1-4bcb-a839-fb2c1c69e58c None None] Updating inventory in ProviderTree for provider 62ba5f85-c74d-4b58-986e-d4197e813fd7 with inventory: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=75045) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 08 23:11:33 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-b1869e0d-6af1-4bcb-a839-fb2c1c69e58c None None] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75045) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 23:11:33 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-b1869e0d-6af1-4bcb-a839-fb2c1c69e58c None None] Libvirt baseline CPU <cpu>
Nov 08 23:11:33 user nova-compute[75045]:   <arch>x86_64</arch>
Nov 08 23:11:33 user nova-compute[75045]:   <model>Nehalem</model>
Nov 08 23:11:33 user nova-compute[75045]:   <vendor>Intel</vendor>
Nov 08 23:11:33 user nova-compute[75045]:   <topology sockets="6" cores="1" threads="1"/>
Nov 08 23:11:33 user nova-compute[75045]: </cpu>
Nov 08 23:11:33 user nova-compute[75045]:  {{(pid=75045) _get_guest_baseline_cpu_features /opt/stack/nova/nova/virt/libvirt/driver.py:12513}}
Nov 08 23:11:33 user nova-compute[75045]: DEBUG nova.scheduler.client.report [None req-b1869e0d-6af1-4bcb-a839-fb2c1c69e58c None None] Updated inventory for provider 62ba5f85-c74d-4b58-986e-d4197e813fd7 with generation 0 in Placement from set_inventory_for_provider using data: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=75045) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}}
Nov 08 23:11:33 user nova-compute[75045]: DEBUG nova.compute.provider_tree [None req-b1869e0d-6af1-4bcb-a839-fb2c1c69e58c None None] Updating resource provider 62ba5f85-c74d-4b58-986e-d4197e813fd7 generation from 0 to 1 during operation: update_inventory {{(pid=75045) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Nov 08 23:11:33 user nova-compute[75045]: DEBUG nova.compute.provider_tree [None req-b1869e0d-6af1-4bcb-a839-fb2c1c69e58c None None] Updating inventory in ProviderTree for provider 62ba5f85-c74d-4b58-986e-d4197e813fd7 with inventory: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75045) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 08 23:11:34 user nova-compute[75045]: DEBUG nova.compute.provider_tree [None req-b1869e0d-6af1-4bcb-a839-fb2c1c69e58c None None] Updating resource provider 62ba5f85-c74d-4b58-986e-d4197e813fd7 generation from 1 to 2 during operation: update_traits {{(pid=75045) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Nov 08 23:11:34 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-b1869e0d-6af1-4bcb-a839-fb2c1c69e58c None None] Compute_service record updated for user:user {{(pid=75045) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 23:11:34 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-b1869e0d-6af1-4bcb-a839-fb2c1c69e58c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.617s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:11:34 user nova-compute[75045]: DEBUG nova.service [None req-b1869e0d-6af1-4bcb-a839-fb2c1c69e58c None None] Creating RPC server for service compute {{(pid=75045) start /opt/stack/nova/nova/service.py:182}}
Nov 08 23:11:34 user nova-compute[75045]: DEBUG nova.service [None req-b1869e0d-6af1-4bcb-a839-fb2c1c69e58c None None] Join ServiceGroup membership for this service compute {{(pid=75045) start /opt/stack/nova/nova/service.py:199}}
Nov 08 23:11:34 user nova-compute[75045]: DEBUG nova.servicegroup.drivers.db [None req-b1869e0d-6af1-4bcb-a839-fb2c1c69e58c None None] DB_Driver: join new ServiceGroup member user to the compute group, service = <Service: host=user, binary=nova-compute, manager_class_name=nova.compute.manager.ComputeManager> {{(pid=75045) join /opt/stack/nova/nova/servicegroup/drivers/db.py:44}}
Nov 08 23:11:48 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._sync_power_states {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:11:48 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:12:24 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:12:24 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:12:24 user nova-compute[75045]: DEBUG nova.compute.manager [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Starting heal instance info cache {{(pid=75045) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 23:12:24 user nova-compute[75045]: DEBUG nova.compute.manager [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Rebuilding the list of instances to heal {{(pid=75045) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 08 23:12:24 user nova-compute[75045]: DEBUG nova.compute.manager [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Didn't find any instances for network info cache update. {{(pid=75045) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 08 23:12:24 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:12:24 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:12:24 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:12:24 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:12:24 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:12:24 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:12:24 user nova-compute[75045]: DEBUG nova.compute.manager [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75045) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 23:12:25 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager.update_available_resource {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:12:25 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:12:25 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:12:25 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:12:25 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Auditing locally available compute resources for user (node: user) {{(pid=75045) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 23:12:25 user nova-compute[75045]: WARNING nova.virt.libvirt.driver [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 23:12:25 user nova-compute[75045]: WARNING nova.virt.libvirt.driver [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 23:12:25 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Hypervisor/Node resource view: name=user free_ram=10387MB free_disk=26.024948120117188GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75045) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 23:12:25 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:12:25 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:12:25 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75045) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 23:12:25 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75045) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 23:12:25 user nova-compute[75045]: DEBUG nova.compute.provider_tree [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Inventory has not changed in ProviderTree for provider: 62ba5f85-c74d-4b58-986e-d4197e813fd7 {{(pid=75045) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 23:12:25 user nova-compute[75045]: DEBUG nova.scheduler.client.report [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Inventory has not changed for provider 62ba5f85-c74d-4b58-986e-d4197e813fd7 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75045) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 23:12:25 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Compute_service record updated for user:user {{(pid=75045) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 23:12:25 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.192s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:13:25 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:13:25 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:13:25 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:13:26 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:13:26 user nova-compute[75045]: DEBUG nova.compute.manager [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Starting heal instance info cache {{(pid=75045) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 23:13:26 user nova-compute[75045]: DEBUG nova.compute.manager [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Rebuilding the list of instances to heal {{(pid=75045) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 08 23:13:26 user nova-compute[75045]: DEBUG nova.compute.manager [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Didn't find any instances for network info cache update. {{(pid=75045) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 08 23:13:26 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:13:26 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:13:26 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:13:26 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:13:26 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:13:26 user nova-compute[75045]: DEBUG nova.compute.manager [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75045) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 23:13:26 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager.update_available_resource {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:13:27 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:13:27 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:13:27 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:13:27 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Auditing locally available compute resources for user (node: user) {{(pid=75045) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 23:13:27 user nova-compute[75045]: WARNING nova.virt.libvirt.driver [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 23:13:27 user nova-compute[75045]: WARNING nova.virt.libvirt.driver [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 23:13:27 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Hypervisor/Node resource view: name=user free_ram=10309MB free_disk=26.089187622070312GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75045) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 23:13:27 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:13:27 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:13:27 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75045) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 23:13:27 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75045) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 23:13:27 user nova-compute[75045]: DEBUG nova.compute.provider_tree [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Inventory has not changed in ProviderTree for provider: 62ba5f85-c74d-4b58-986e-d4197e813fd7 {{(pid=75045) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 23:13:27 user nova-compute[75045]: DEBUG nova.scheduler.client.report [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Inventory has not changed for provider 62ba5f85-c74d-4b58-986e-d4197e813fd7 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75045) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 23:13:27 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Compute_service record updated for user:user {{(pid=75045) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 23:13:27 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.154s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:14:26 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:14:26 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:14:26 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:14:26 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager.update_available_resource {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:14:26 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:14:26 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:14:26 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:14:26 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Auditing locally available compute resources for user (node: user) {{(pid=75045) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 23:14:27 user nova-compute[75045]: WARNING nova.virt.libvirt.driver [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 23:14:27 user nova-compute[75045]: WARNING nova.virt.libvirt.driver [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 23:14:27 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Hypervisor/Node resource view: name=user free_ram=10320MB free_disk=25.841751098632812GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75045) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 23:14:27 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:14:27 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:14:27 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75045) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 23:14:27 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75045) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 23:14:27 user nova-compute[75045]: DEBUG nova.compute.provider_tree [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Inventory has not changed in ProviderTree for provider: 62ba5f85-c74d-4b58-986e-d4197e813fd7 {{(pid=75045) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 23:14:27 user nova-compute[75045]: DEBUG nova.scheduler.client.report [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Inventory has not changed for provider 62ba5f85-c74d-4b58-986e-d4197e813fd7 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75045) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 23:14:27 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Compute_service record updated for user:user {{(pid=75045) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 23:14:27 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.140s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:14:28 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:14:28 user nova-compute[75045]: DEBUG nova.compute.manager [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Starting heal instance info cache {{(pid=75045) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 23:14:28 user nova-compute[75045]: DEBUG nova.compute.manager [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Rebuilding the list of instances to heal {{(pid=75045) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 08 23:14:28 user nova-compute[75045]: DEBUG nova.compute.manager [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Didn't find any instances for network info cache update. {{(pid=75045) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 08 23:14:28 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:14:28 user nova-compute[75045]: DEBUG nova.compute.manager [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75045) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 23:14:28 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:14:28 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:14:28 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:15:26 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:15:26 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:15:26 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:15:27 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:15:27 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager.update_available_resource {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:15:28 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:15:28 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:15:28 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:15:28 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Auditing locally available compute resources for user (node: user) {{(pid=75045) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 23:15:28 user nova-compute[75045]: WARNING nova.virt.libvirt.driver [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 23:15:28 user nova-compute[75045]: WARNING nova.virt.libvirt.driver [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 23:15:28 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Hypervisor/Node resource view: name=user free_ram=9605MB free_disk=25.86948013305664GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75045) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 23:15:28 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:15:28 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:15:28 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75045) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 23:15:28 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75045) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 23:15:28 user nova-compute[75045]: DEBUG nova.compute.provider_tree [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Inventory has not changed in ProviderTree for provider: 62ba5f85-c74d-4b58-986e-d4197e813fd7 {{(pid=75045) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 23:15:28 user nova-compute[75045]: DEBUG nova.scheduler.client.report [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Inventory has not changed for provider 62ba5f85-c74d-4b58-986e-d4197e813fd7 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75045) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 23:15:28 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Compute_service record updated for user:user {{(pid=75045) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 23:15:28 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.118s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:15:30 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:15:30 user nova-compute[75045]: DEBUG nova.compute.manager [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Starting heal instance info cache {{(pid=75045) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 23:15:30 user nova-compute[75045]: DEBUG nova.compute.manager [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Rebuilding the list of instances to heal {{(pid=75045) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 08 23:15:30 user nova-compute[75045]: DEBUG nova.compute.manager [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Didn't find any instances for network info cache update. {{(pid=75045) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 08 23:15:30 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:15:30 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:15:30 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:15:30 user nova-compute[75045]: DEBUG nova.compute.manager [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75045) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 23:15:30 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:15:31 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-d1216da0-6db3-4a9e-91a1-9ee6dbd01a60 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Acquiring lock "4ae5ff6b-6f2c-4dfd-a4c6-da4809e2cf27" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:15:31 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-d1216da0-6db3-4a9e-91a1-9ee6dbd01a60 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Lock "4ae5ff6b-6f2c-4dfd-a4c6-da4809e2cf27" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:15:31 user nova-compute[75045]: DEBUG nova.compute.manager [None req-d1216da0-6db3-4a9e-91a1-9ee6dbd01a60 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] [instance: 4ae5ff6b-6f2c-4dfd-a4c6-da4809e2cf27] Starting instance... {{(pid=75045) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 23:15:32 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-d1216da0-6db3-4a9e-91a1-9ee6dbd01a60 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:15:32 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-d1216da0-6db3-4a9e-91a1-9ee6dbd01a60 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:15:32 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-d1216da0-6db3-4a9e-91a1-9ee6dbd01a60 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75045) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 23:15:32 user nova-compute[75045]: INFO nova.compute.claims [None req-d1216da0-6db3-4a9e-91a1-9ee6dbd01a60 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] [instance: 4ae5ff6b-6f2c-4dfd-a4c6-da4809e2cf27] Claim successful on node user
Nov 08 23:15:32 user nova-compute[75045]: DEBUG nova.compute.provider_tree [None req-d1216da0-6db3-4a9e-91a1-9ee6dbd01a60 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Inventory has not changed in ProviderTree for provider: 62ba5f85-c74d-4b58-986e-d4197e813fd7 {{(pid=75045) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 23:15:32 user nova-compute[75045]: DEBUG nova.scheduler.client.report [None req-d1216da0-6db3-4a9e-91a1-9ee6dbd01a60 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Inventory has not changed for provider 62ba5f85-c74d-4b58-986e-d4197e813fd7 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75045) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 23:15:32 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-d1216da0-6db3-4a9e-91a1-9ee6dbd01a60 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.324s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:15:32 user nova-compute[75045]: DEBUG nova.compute.manager [None req-d1216da0-6db3-4a9e-91a1-9ee6dbd01a60 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] [instance: 4ae5ff6b-6f2c-4dfd-a4c6-da4809e2cf27] Start building networks asynchronously for instance. {{(pid=75045) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 23:15:32 user nova-compute[75045]: DEBUG nova.compute.manager [None req-d1216da0-6db3-4a9e-91a1-9ee6dbd01a60 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] [instance: 4ae5ff6b-6f2c-4dfd-a4c6-da4809e2cf27] Allocating IP information in the background. {{(pid=75045) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 23:15:32 user nova-compute[75045]: DEBUG nova.network.neutron [None req-d1216da0-6db3-4a9e-91a1-9ee6dbd01a60 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] [instance: 4ae5ff6b-6f2c-4dfd-a4c6-da4809e2cf27] allocate_for_instance() {{(pid=75045) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 23:15:32 user nova-compute[75045]: INFO nova.virt.libvirt.driver [None req-d1216da0-6db3-4a9e-91a1-9ee6dbd01a60 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] [instance: 4ae5ff6b-6f2c-4dfd-a4c6-da4809e2cf27] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 23:15:33 user nova-compute[75045]: DEBUG nova.compute.manager [None req-d1216da0-6db3-4a9e-91a1-9ee6dbd01a60 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] [instance: 4ae5ff6b-6f2c-4dfd-a4c6-da4809e2cf27] Start building block device mappings for instance. {{(pid=75045) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 23:15:33 user nova-compute[75045]: DEBUG nova.compute.manager [None req-d1216da0-6db3-4a9e-91a1-9ee6dbd01a60 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] [instance: 4ae5ff6b-6f2c-4dfd-a4c6-da4809e2cf27] Start spawning the instance on the hypervisor. {{(pid=75045) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 23:15:33 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-d1216da0-6db3-4a9e-91a1-9ee6dbd01a60 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] [instance: 4ae5ff6b-6f2c-4dfd-a4c6-da4809e2cf27] Creating instance directory {{(pid=75045) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 23:15:33 user nova-compute[75045]: INFO nova.virt.libvirt.driver [None req-d1216da0-6db3-4a9e-91a1-9ee6dbd01a60 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] [instance: 4ae5ff6b-6f2c-4dfd-a4c6-da4809e2cf27] Creating image(s)
Nov 08 23:15:33 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-d1216da0-6db3-4a9e-91a1-9ee6dbd01a60 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Acquiring lock "/opt/stack/data/nova/instances/4ae5ff6b-6f2c-4dfd-a4c6-da4809e2cf27/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:15:33 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-d1216da0-6db3-4a9e-91a1-9ee6dbd01a60 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Lock "/opt/stack/data/nova/instances/4ae5ff6b-6f2c-4dfd-a4c6-da4809e2cf27/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:15:33 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-d1216da0-6db3-4a9e-91a1-9ee6dbd01a60 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Lock "/opt/stack/data/nova/instances/4ae5ff6b-6f2c-4dfd-a4c6-da4809e2cf27/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:15:33 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-d1216da0-6db3-4a9e-91a1-9ee6dbd01a60 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Acquiring lock "b59f52a99fff51c56dd1edfb83892fb8f647f2f3" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:15:33 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-d1216da0-6db3-4a9e-91a1-9ee6dbd01a60 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Lock "b59f52a99fff51c56dd1edfb83892fb8f647f2f3" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:15:33 user nova-compute[75045]: DEBUG nova.policy [None req-d1216da0-6db3-4a9e-91a1-9ee6dbd01a60 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '04bb3135250f4465a9947b47f9cde485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bfb6963a6c145d4a7b7e47c8fde7e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75045) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 23:15:34 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-d1216da0-6db3-4a9e-91a1-9ee6dbd01a60 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b59f52a99fff51c56dd1edfb83892fb8f647f2f3.part --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:15:34 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-d1216da0-6db3-4a9e-91a1-9ee6dbd01a60 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b59f52a99fff51c56dd1edfb83892fb8f647f2f3.part --force-share --output=json" returned: 0 in 0.164s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:15:34 user nova-compute[75045]: DEBUG nova.virt.images [None req-d1216da0-6db3-4a9e-91a1-9ee6dbd01a60 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb was qcow2, converting to raw {{(pid=75045) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 08 23:15:34 user nova-compute[75045]: DEBUG nova.privsep.utils [None req-d1216da0-6db3-4a9e-91a1-9ee6dbd01a60 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75045) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 08 23:15:34 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-d1216da0-6db3-4a9e-91a1-9ee6dbd01a60 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/b59f52a99fff51c56dd1edfb83892fb8f647f2f3.part /opt/stack/data/nova/instances/_base/b59f52a99fff51c56dd1edfb83892fb8f647f2f3.converted {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:15:34 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-d1216da0-6db3-4a9e-91a1-9ee6dbd01a60 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/b59f52a99fff51c56dd1edfb83892fb8f647f2f3.part /opt/stack/data/nova/instances/_base/b59f52a99fff51c56dd1edfb83892fb8f647f2f3.converted" returned: 0 in 0.171s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:15:34 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-d1216da0-6db3-4a9e-91a1-9ee6dbd01a60 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b59f52a99fff51c56dd1edfb83892fb8f647f2f3.converted --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:15:34 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-d1216da0-6db3-4a9e-91a1-9ee6dbd01a60 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b59f52a99fff51c56dd1edfb83892fb8f647f2f3.converted --force-share --output=json" returned: 0 in 0.186s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:15:34 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-d1216da0-6db3-4a9e-91a1-9ee6dbd01a60 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Lock "b59f52a99fff51c56dd1edfb83892fb8f647f2f3" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.509s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:15:34 user nova-compute[75045]: INFO oslo.privsep.daemon [None req-d1216da0-6db3-4a9e-91a1-9ee6dbd01a60 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'nova.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpcgzi9gc4/privsep.sock']
Nov 08 23:15:34 user sudo[84283]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context nova.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpcgzi9gc4/privsep.sock
Nov 08 23:15:34 user sudo[84283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Nov 08 23:15:35 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-6698730b-209f-4bc5-8519-9b9d0571d902 tempest-DeleteServersTestJSON-1018435513 tempest-DeleteServersTestJSON-1018435513-project-member] Acquiring lock "09cf15e6-1cec-4c55-b7dd-4311b5f87d32" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:15:35 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-6698730b-209f-4bc5-8519-9b9d0571d902 tempest-DeleteServersTestJSON-1018435513 tempest-DeleteServersTestJSON-1018435513-project-member] Lock "09cf15e6-1cec-4c55-b7dd-4311b5f87d32" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:15:35 user nova-compute[75045]: DEBUG nova.compute.manager [None req-6698730b-209f-4bc5-8519-9b9d0571d902 tempest-DeleteServersTestJSON-1018435513 tempest-DeleteServersTestJSON-1018435513-project-member] [instance: 09cf15e6-1cec-4c55-b7dd-4311b5f87d32] Starting instance... {{(pid=75045) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 23:15:35 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-6698730b-209f-4bc5-8519-9b9d0571d902 tempest-DeleteServersTestJSON-1018435513 tempest-DeleteServersTestJSON-1018435513-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:15:35 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-6698730b-209f-4bc5-8519-9b9d0571d902 tempest-DeleteServersTestJSON-1018435513 tempest-DeleteServersTestJSON-1018435513-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:15:35 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-6698730b-209f-4bc5-8519-9b9d0571d902 tempest-DeleteServersTestJSON-1018435513 tempest-DeleteServersTestJSON-1018435513-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75045) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 23:15:35 user nova-compute[75045]: INFO nova.compute.claims [None req-6698730b-209f-4bc5-8519-9b9d0571d902 tempest-DeleteServersTestJSON-1018435513 tempest-DeleteServersTestJSON-1018435513-project-member] [instance: 09cf15e6-1cec-4c55-b7dd-4311b5f87d32] Claim successful on node user
Nov 08 23:15:35 user nova-compute[75045]: DEBUG nova.compute.provider_tree [None req-6698730b-209f-4bc5-8519-9b9d0571d902 tempest-DeleteServersTestJSON-1018435513 tempest-DeleteServersTestJSON-1018435513-project-member] Inventory has not changed in ProviderTree for provider: 62ba5f85-c74d-4b58-986e-d4197e813fd7 {{(pid=75045) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 23:15:35 user nova-compute[75045]: DEBUG nova.scheduler.client.report [None req-6698730b-209f-4bc5-8519-9b9d0571d902 tempest-DeleteServersTestJSON-1018435513 tempest-DeleteServersTestJSON-1018435513-project-member] Inventory has not changed for provider 62ba5f85-c74d-4b58-986e-d4197e813fd7 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75045) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 23:15:35 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-6698730b-209f-4bc5-8519-9b9d0571d902 tempest-DeleteServersTestJSON-1018435513 tempest-DeleteServersTestJSON-1018435513-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.282s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:15:35 user nova-compute[75045]: DEBUG nova.compute.manager [None req-6698730b-209f-4bc5-8519-9b9d0571d902 tempest-DeleteServersTestJSON-1018435513 tempest-DeleteServersTestJSON-1018435513-project-member] [instance: 09cf15e6-1cec-4c55-b7dd-4311b5f87d32] Start building networks asynchronously for instance. {{(pid=75045) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 23:15:35 user nova-compute[75045]: DEBUG nova.compute.manager [None req-6698730b-209f-4bc5-8519-9b9d0571d902 tempest-DeleteServersTestJSON-1018435513 tempest-DeleteServersTestJSON-1018435513-project-member] [instance: 09cf15e6-1cec-4c55-b7dd-4311b5f87d32] Allocating IP information in the background. {{(pid=75045) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 23:15:35 user nova-compute[75045]: DEBUG nova.network.neutron [None req-6698730b-209f-4bc5-8519-9b9d0571d902 tempest-DeleteServersTestJSON-1018435513 tempest-DeleteServersTestJSON-1018435513-project-member] [instance: 09cf15e6-1cec-4c55-b7dd-4311b5f87d32] allocate_for_instance() {{(pid=75045) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 23:15:36 user nova-compute[75045]: INFO nova.virt.libvirt.driver [None req-6698730b-209f-4bc5-8519-9b9d0571d902 tempest-DeleteServersTestJSON-1018435513 tempest-DeleteServersTestJSON-1018435513-project-member] [instance: 09cf15e6-1cec-4c55-b7dd-4311b5f87d32] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 23:15:36 user nova-compute[75045]: DEBUG nova.compute.manager [None req-6698730b-209f-4bc5-8519-9b9d0571d902 tempest-DeleteServersTestJSON-1018435513 tempest-DeleteServersTestJSON-1018435513-project-member] [instance: 09cf15e6-1cec-4c55-b7dd-4311b5f87d32] Start building block device mappings for instance. {{(pid=75045) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 23:15:36 user nova-compute[75045]: DEBUG nova.network.neutron [None req-d1216da0-6db3-4a9e-91a1-9ee6dbd01a60 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] [instance: 4ae5ff6b-6f2c-4dfd-a4c6-da4809e2cf27] Successfully created port: cfa24a0c-4dce-4dae-a5d7-10ebfa1cc305 {{(pid=75045) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 23:15:36 user sudo[84283]: pam_unix(sudo:session): session closed for user root
Nov 08 23:15:36 user nova-compute[75045]: INFO oslo.privsep.daemon [None req-d1216da0-6db3-4a9e-91a1-9ee6dbd01a60 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Spawned new privsep daemon via rootwrap
Nov 08 23:15:36 user nova-compute[75045]: INFO oslo.privsep.daemon [-] privsep daemon starting
Nov 08 23:15:36 user nova-compute[75045]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Nov 08 23:15:36 user nova-compute[75045]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Nov 08 23:15:36 user nova-compute[75045]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 84295
Nov 08 23:15:36 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-d1216da0-6db3-4a9e-91a1-9ee6dbd01a60 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b59f52a99fff51c56dd1edfb83892fb8f647f2f3 --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:15:36 user nova-compute[75045]: DEBUG nova.compute.manager [None req-6698730b-209f-4bc5-8519-9b9d0571d902 tempest-DeleteServersTestJSON-1018435513 tempest-DeleteServersTestJSON-1018435513-project-member] [instance: 09cf15e6-1cec-4c55-b7dd-4311b5f87d32] Start spawning the instance on the hypervisor. {{(pid=75045) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 23:15:36 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-6698730b-209f-4bc5-8519-9b9d0571d902 tempest-DeleteServersTestJSON-1018435513 tempest-DeleteServersTestJSON-1018435513-project-member] [instance: 09cf15e6-1cec-4c55-b7dd-4311b5f87d32] Creating instance directory {{(pid=75045) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 23:15:36 user nova-compute[75045]: INFO nova.virt.libvirt.driver [None req-6698730b-209f-4bc5-8519-9b9d0571d902 tempest-DeleteServersTestJSON-1018435513 tempest-DeleteServersTestJSON-1018435513-project-member] [instance: 09cf15e6-1cec-4c55-b7dd-4311b5f87d32] Creating image(s)
Nov 08 23:15:36 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-6698730b-209f-4bc5-8519-9b9d0571d902 tempest-DeleteServersTestJSON-1018435513 tempest-DeleteServersTestJSON-1018435513-project-member] Acquiring lock "/opt/stack/data/nova/instances/09cf15e6-1cec-4c55-b7dd-4311b5f87d32/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:15:36 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-6698730b-209f-4bc5-8519-9b9d0571d902 tempest-DeleteServersTestJSON-1018435513 tempest-DeleteServersTestJSON-1018435513-project-member] Lock "/opt/stack/data/nova/instances/09cf15e6-1cec-4c55-b7dd-4311b5f87d32/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:15:36 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-6698730b-209f-4bc5-8519-9b9d0571d902 tempest-DeleteServersTestJSON-1018435513 tempest-DeleteServersTestJSON-1018435513-project-member] Lock "/opt/stack/data/nova/instances/09cf15e6-1cec-4c55-b7dd-4311b5f87d32/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:15:36 user nova-compute[75045]: DEBUG nova.policy [None req-6698730b-209f-4bc5-8519-9b9d0571d902 tempest-DeleteServersTestJSON-1018435513 tempest-DeleteServersTestJSON-1018435513-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4867afafcd4f48728d45af6ccdc40aaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec0b8a91a6ba43e6836d226ba9528100', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75045) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 23:15:36 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-6698730b-209f-4bc5-8519-9b9d0571d902 tempest-DeleteServersTestJSON-1018435513 tempest-DeleteServersTestJSON-1018435513-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b59f52a99fff51c56dd1edfb83892fb8f647f2f3 --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:15:36 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-d1216da0-6db3-4a9e-91a1-9ee6dbd01a60 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b59f52a99fff51c56dd1edfb83892fb8f647f2f3 --force-share --output=json" returned: 0 in 0.177s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:15:36 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-d1216da0-6db3-4a9e-91a1-9ee6dbd01a60 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Acquiring lock "b59f52a99fff51c56dd1edfb83892fb8f647f2f3" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:15:36 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-d1216da0-6db3-4a9e-91a1-9ee6dbd01a60 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Lock "b59f52a99fff51c56dd1edfb83892fb8f647f2f3" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:15:36 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-d1216da0-6db3-4a9e-91a1-9ee6dbd01a60 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b59f52a99fff51c56dd1edfb83892fb8f647f2f3 --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:15:36 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-6698730b-209f-4bc5-8519-9b9d0571d902 tempest-DeleteServersTestJSON-1018435513 tempest-DeleteServersTestJSON-1018435513-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b59f52a99fff51c56dd1edfb83892fb8f647f2f3 --force-share --output=json" returned: 0 in 0.224s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:15:36 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-6698730b-209f-4bc5-8519-9b9d0571d902 tempest-DeleteServersTestJSON-1018435513 tempest-DeleteServersTestJSON-1018435513-project-member] Acquiring lock "b59f52a99fff51c56dd1edfb83892fb8f647f2f3" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:15:36 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-d1216da0-6db3-4a9e-91a1-9ee6dbd01a60 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b59f52a99fff51c56dd1edfb83892fb8f647f2f3 --force-share --output=json" returned: 0 in 0.186s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:15:36 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-d1216da0-6db3-4a9e-91a1-9ee6dbd01a60 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b59f52a99fff51c56dd1edfb83892fb8f647f2f3,backing_fmt=raw /opt/stack/data/nova/instances/4ae5ff6b-6f2c-4dfd-a4c6-da4809e2cf27/disk 1073741824 {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:15:36 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-d1216da0-6db3-4a9e-91a1-9ee6dbd01a60 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b59f52a99fff51c56dd1edfb83892fb8f647f2f3,backing_fmt=raw /opt/stack/data/nova/instances/4ae5ff6b-6f2c-4dfd-a4c6-da4809e2cf27/disk 1073741824" returned: 0 in 0.052s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:15:36 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-d1216da0-6db3-4a9e-91a1-9ee6dbd01a60 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Lock "b59f52a99fff51c56dd1edfb83892fb8f647f2f3" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.241s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:15:36 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-d1216da0-6db3-4a9e-91a1-9ee6dbd01a60 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b59f52a99fff51c56dd1edfb83892fb8f647f2f3 --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:15:36 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-6698730b-209f-4bc5-8519-9b9d0571d902 tempest-DeleteServersTestJSON-1018435513 tempest-DeleteServersTestJSON-1018435513-project-member] Lock "b59f52a99fff51c56dd1edfb83892fb8f647f2f3" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.151s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:15:36 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-6698730b-209f-4bc5-8519-9b9d0571d902 tempest-DeleteServersTestJSON-1018435513 tempest-DeleteServersTestJSON-1018435513-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b59f52a99fff51c56dd1edfb83892fb8f647f2f3 --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:15:36 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-6698730b-209f-4bc5-8519-9b9d0571d902 tempest-DeleteServersTestJSON-1018435513 tempest-DeleteServersTestJSON-1018435513-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b59f52a99fff51c56dd1edfb83892fb8f647f2f3 --force-share --output=json" returned: 0 in 0.158s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:15:36 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-6698730b-209f-4bc5-8519-9b9d0571d902 tempest-DeleteServersTestJSON-1018435513 tempest-DeleteServersTestJSON-1018435513-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b59f52a99fff51c56dd1edfb83892fb8f647f2f3,backing_fmt=raw /opt/stack/data/nova/instances/09cf15e6-1cec-4c55-b7dd-4311b5f87d32/disk 1073741824 {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:15:36 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-d1216da0-6db3-4a9e-91a1-9ee6dbd01a60 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b59f52a99fff51c56dd1edfb83892fb8f647f2f3 --force-share --output=json" returned: 0 in 0.228s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:15:36 user nova-compute[75045]: DEBUG nova.virt.disk.api [None req-d1216da0-6db3-4a9e-91a1-9ee6dbd01a60 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4ae5ff6b-6f2c-4dfd-a4c6-da4809e2cf27/disk. size=1073741824 {{(pid=75045) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 23:15:36 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-d1216da0-6db3-4a9e-91a1-9ee6dbd01a60 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ae5ff6b-6f2c-4dfd-a4c6-da4809e2cf27/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:15:36 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-6698730b-209f-4bc5-8519-9b9d0571d902 tempest-DeleteServersTestJSON-1018435513 tempest-DeleteServersTestJSON-1018435513-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b59f52a99fff51c56dd1edfb83892fb8f647f2f3,backing_fmt=raw /opt/stack/data/nova/instances/09cf15e6-1cec-4c55-b7dd-4311b5f87d32/disk 1073741824" returned: 0 in 0.069s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:15:36 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-6698730b-209f-4bc5-8519-9b9d0571d902 tempest-DeleteServersTestJSON-1018435513 tempest-DeleteServersTestJSON-1018435513-project-member] Lock "b59f52a99fff51c56dd1edfb83892fb8f647f2f3" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.236s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:15:36 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-6698730b-209f-4bc5-8519-9b9d0571d902 tempest-DeleteServersTestJSON-1018435513 tempest-DeleteServersTestJSON-1018435513-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b59f52a99fff51c56dd1edfb83892fb8f647f2f3 --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:15:37 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-d1216da0-6db3-4a9e-91a1-9ee6dbd01a60 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ae5ff6b-6f2c-4dfd-a4c6-da4809e2cf27/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:15:37 user nova-compute[75045]: DEBUG nova.virt.disk.api [None req-d1216da0-6db3-4a9e-91a1-9ee6dbd01a60 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Cannot resize image /opt/stack/data/nova/instances/4ae5ff6b-6f2c-4dfd-a4c6-da4809e2cf27/disk to a smaller size. {{(pid=75045) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 08 23:15:37 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-d1216da0-6db3-4a9e-91a1-9ee6dbd01a60 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] [instance: 4ae5ff6b-6f2c-4dfd-a4c6-da4809e2cf27] Created local disks {{(pid=75045) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 23:15:37 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-d1216da0-6db3-4a9e-91a1-9ee6dbd01a60 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] [instance: 4ae5ff6b-6f2c-4dfd-a4c6-da4809e2cf27] Ensure instance console log exists: /opt/stack/data/nova/instances/4ae5ff6b-6f2c-4dfd-a4c6-da4809e2cf27/console.log {{(pid=75045) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 23:15:37 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-d1216da0-6db3-4a9e-91a1-9ee6dbd01a60 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:15:37 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-d1216da0-6db3-4a9e-91a1-9ee6dbd01a60 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:15:37 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-d1216da0-6db3-4a9e-91a1-9ee6dbd01a60 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:15:37 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-6698730b-209f-4bc5-8519-9b9d0571d902 tempest-DeleteServersTestJSON-1018435513 tempest-DeleteServersTestJSON-1018435513-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b59f52a99fff51c56dd1edfb83892fb8f647f2f3 --force-share --output=json" returned: 0 in 0.162s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:15:37 user nova-compute[75045]: DEBUG nova.virt.disk.api [None req-6698730b-209f-4bc5-8519-9b9d0571d902 tempest-DeleteServersTestJSON-1018435513 tempest-DeleteServersTestJSON-1018435513-project-member] Checking if we can resize image /opt/stack/data/nova/instances/09cf15e6-1cec-4c55-b7dd-4311b5f87d32/disk. size=1073741824 {{(pid=75045) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 23:15:37 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-6698730b-209f-4bc5-8519-9b9d0571d902 tempest-DeleteServersTestJSON-1018435513 tempest-DeleteServersTestJSON-1018435513-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09cf15e6-1cec-4c55-b7dd-4311b5f87d32/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:15:37 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-6698730b-209f-4bc5-8519-9b9d0571d902 tempest-DeleteServersTestJSON-1018435513 tempest-DeleteServersTestJSON-1018435513-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09cf15e6-1cec-4c55-b7dd-4311b5f87d32/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:15:37 user nova-compute[75045]: DEBUG nova.virt.disk.api [None req-6698730b-209f-4bc5-8519-9b9d0571d902 tempest-DeleteServersTestJSON-1018435513 tempest-DeleteServersTestJSON-1018435513-project-member] Cannot resize image /opt/stack/data/nova/instances/09cf15e6-1cec-4c55-b7dd-4311b5f87d32/disk to a smaller size. {{(pid=75045) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 08 23:15:37 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-6698730b-209f-4bc5-8519-9b9d0571d902 tempest-DeleteServersTestJSON-1018435513 tempest-DeleteServersTestJSON-1018435513-project-member] [instance: 09cf15e6-1cec-4c55-b7dd-4311b5f87d32] Created local disks {{(pid=75045) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 23:15:37 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-6698730b-209f-4bc5-8519-9b9d0571d902 tempest-DeleteServersTestJSON-1018435513 tempest-DeleteServersTestJSON-1018435513-project-member] [instance: 09cf15e6-1cec-4c55-b7dd-4311b5f87d32] Ensure instance console log exists: /opt/stack/data/nova/instances/09cf15e6-1cec-4c55-b7dd-4311b5f87d32/console.log {{(pid=75045) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 23:15:37 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-6698730b-209f-4bc5-8519-9b9d0571d902 tempest-DeleteServersTestJSON-1018435513 tempest-DeleteServersTestJSON-1018435513-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:15:37 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-6698730b-209f-4bc5-8519-9b9d0571d902 tempest-DeleteServersTestJSON-1018435513 tempest-DeleteServersTestJSON-1018435513-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:15:37 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-6698730b-209f-4bc5-8519-9b9d0571d902 tempest-DeleteServersTestJSON-1018435513 tempest-DeleteServersTestJSON-1018435513-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:15:38 user nova-compute[75045]: DEBUG nova.network.neutron [None req-d1216da0-6db3-4a9e-91a1-9ee6dbd01a60 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] [instance: 4ae5ff6b-6f2c-4dfd-a4c6-da4809e2cf27] Successfully updated port: cfa24a0c-4dce-4dae-a5d7-10ebfa1cc305 {{(pid=75045) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 23:15:38 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-d1216da0-6db3-4a9e-91a1-9ee6dbd01a60 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Acquiring lock "refresh_cache-4ae5ff6b-6f2c-4dfd-a4c6-da4809e2cf27" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 23:15:38 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-d1216da0-6db3-4a9e-91a1-9ee6dbd01a60 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Acquired lock "refresh_cache-4ae5ff6b-6f2c-4dfd-a4c6-da4809e2cf27" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 23:15:38 user nova-compute[75045]: DEBUG nova.network.neutron [None req-d1216da0-6db3-4a9e-91a1-9ee6dbd01a60 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] [instance: 4ae5ff6b-6f2c-4dfd-a4c6-da4809e2cf27] Building network info cache for instance {{(pid=75045) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 23:15:38 user nova-compute[75045]: DEBUG nova.network.neutron [None req-d1216da0-6db3-4a9e-91a1-9ee6dbd01a60 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] [instance: 4ae5ff6b-6f2c-4dfd-a4c6-da4809e2cf27] Instance cache missing network info. {{(pid=75045) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 23:15:38 user nova-compute[75045]: DEBUG nova.compute.manager [req-7d45f16f-91bc-42a2-afa7-318849297168 req-5bf0f168-4bd7-4f88-b227-0d5de31e786e service nova] [instance: 4ae5ff6b-6f2c-4dfd-a4c6-da4809e2cf27] Received event network-changed-cfa24a0c-4dce-4dae-a5d7-10ebfa1cc305 {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:15:38 user nova-compute[75045]: DEBUG nova.compute.manager [req-7d45f16f-91bc-42a2-afa7-318849297168 req-5bf0f168-4bd7-4f88-b227-0d5de31e786e service nova] [instance: 4ae5ff6b-6f2c-4dfd-a4c6-da4809e2cf27] Refreshing instance network info cache due to event network-changed-cfa24a0c-4dce-4dae-a5d7-10ebfa1cc305. {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 23:15:38 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-7d45f16f-91bc-42a2-afa7-318849297168 req-5bf0f168-4bd7-4f88-b227-0d5de31e786e service nova] Acquiring lock "refresh_cache-4ae5ff6b-6f2c-4dfd-a4c6-da4809e2cf27" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 23:15:39 user nova-compute[75045]: DEBUG nova.network.neutron [None req-d1216da0-6db3-4a9e-91a1-9ee6dbd01a60 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] [instance: 4ae5ff6b-6f2c-4dfd-a4c6-da4809e2cf27] Updating instance_info_cache with network_info: [{"id": "cfa24a0c-4dce-4dae-a5d7-10ebfa1cc305", "address": "fa:16:3e:33:11:13", "network": {"id": "d4cd6998-66d1-4389-bc82-dd000c8962de", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-323966879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bfb6963a6c145d4a7b7e47c8fde7e60", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcfa24a0c-4d", "ovs_interfaceid": "cfa24a0c-4dce-4dae-a5d7-10ebfa1cc305", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75045) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 23:15:39 user nova-compute[75045]: DEBUG nova.network.neutron [None req-6698730b-209f-4bc5-8519-9b9d0571d902 tempest-DeleteServersTestJSON-1018435513 tempest-DeleteServersTestJSON-1018435513-project-member] [instance: 09cf15e6-1cec-4c55-b7dd-4311b5f87d32] Successfully created port: a270cac5-2b8d-4eb7-a5ed-9338e6bb5e22 {{(pid=75045) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 23:15:39 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-d1216da0-6db3-4a9e-91a1-9ee6dbd01a60 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Releasing lock "refresh_cache-4ae5ff6b-6f2c-4dfd-a4c6-da4809e2cf27" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 23:15:39 user nova-compute[75045]: DEBUG nova.compute.manager [None req-d1216da0-6db3-4a9e-91a1-9ee6dbd01a60 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] [instance: 4ae5ff6b-6f2c-4dfd-a4c6-da4809e2cf27] Instance network_info: |[{"id": "cfa24a0c-4dce-4dae-a5d7-10ebfa1cc305", "address": "fa:16:3e:33:11:13", "network": {"id": "d4cd6998-66d1-4389-bc82-dd000c8962de", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-323966879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bfb6963a6c145d4a7b7e47c8fde7e60", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcfa24a0c-4d", "ovs_interfaceid": "cfa24a0c-4dce-4dae-a5d7-10ebfa1cc305", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75045) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 23:15:39 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-7d45f16f-91bc-42a2-afa7-318849297168 req-5bf0f168-4bd7-4f88-b227-0d5de31e786e service nova] Acquired lock "refresh_cache-4ae5ff6b-6f2c-4dfd-a4c6-da4809e2cf27" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 23:15:39 user nova-compute[75045]: DEBUG nova.network.neutron [req-7d45f16f-91bc-42a2-afa7-318849297168 req-5bf0f168-4bd7-4f88-b227-0d5de31e786e service nova] [instance: 4ae5ff6b-6f2c-4dfd-a4c6-da4809e2cf27] Refreshing network info cache for port cfa24a0c-4dce-4dae-a5d7-10ebfa1cc305 {{(pid=75045) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 23:15:39 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-d1216da0-6db3-4a9e-91a1-9ee6dbd01a60 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] [instance: 4ae5ff6b-6f2c-4dfd-a4c6-da4809e2cf27] Start _get_guest_xml network_info=[{"id": "cfa24a0c-4dce-4dae-a5d7-10ebfa1cc305", "address": "fa:16:3e:33:11:13", "network": {"id": "d4cd6998-66d1-4389-bc82-dd000c8962de", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-323966879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bfb6963a6c145d4a7b7e47c8fde7e60", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcfa24a0c-4d", "ovs_interfaceid": "cfa24a0c-4dce-4dae-a5d7-10ebfa1cc305", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T23:11:54Z,direct_url=<?>,disk_format='qcow2',id=a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b1beba2cc4e7465ea249e2225fb494dc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T23:11:56Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'disk_bus': 'virtio', 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': 'a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75045) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 23:15:39 user nova-compute[75045]: WARNING nova.virt.libvirt.driver [None req-d1216da0-6db3-4a9e-91a1-9ee6dbd01a60 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 23:15:39 user nova-compute[75045]: WARNING nova.virt.libvirt.driver [None req-d1216da0-6db3-4a9e-91a1-9ee6dbd01a60 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 23:15:39 user nova-compute[75045]: DEBUG nova.virt.libvirt.host [None req-d1216da0-6db3-4a9e-91a1-9ee6dbd01a60 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75045) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 23:15:39 user nova-compute[75045]: DEBUG nova.virt.libvirt.host [None req-d1216da0-6db3-4a9e-91a1-9ee6dbd01a60 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] CPU controller missing on host. {{(pid=75045) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 23:15:39 user nova-compute[75045]: DEBUG nova.virt.libvirt.host [None req-d1216da0-6db3-4a9e-91a1-9ee6dbd01a60 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75045) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 23:15:39 user nova-compute[75045]: DEBUG nova.virt.libvirt.host [None req-d1216da0-6db3-4a9e-91a1-9ee6dbd01a60 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] CPU controller found on host. {{(pid=75045) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 23:15:39 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-d1216da0-6db3-4a9e-91a1-9ee6dbd01a60 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75045) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 23:15:39 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-d1216da0-6db3-4a9e-91a1-9ee6dbd01a60 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T23:11:41Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T23:11:54Z,direct_url=<?>,disk_format='qcow2',id=a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b1beba2cc4e7465ea249e2225fb494dc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T23:11:56Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75045) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 23:15:39 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-d1216da0-6db3-4a9e-91a1-9ee6dbd01a60 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Flavor limits 0:0:0 {{(pid=75045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 23:15:39 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-d1216da0-6db3-4a9e-91a1-9ee6dbd01a60 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Image limits 0:0:0 {{(pid=75045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 23:15:39 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-d1216da0-6db3-4a9e-91a1-9ee6dbd01a60 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Flavor pref 0:0:0 {{(pid=75045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 23:15:39 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-d1216da0-6db3-4a9e-91a1-9ee6dbd01a60 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Image pref 0:0:0 {{(pid=75045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 23:15:39 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-d1216da0-6db3-4a9e-91a1-9ee6dbd01a60 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 23:15:39 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-d1216da0-6db3-4a9e-91a1-9ee6dbd01a60 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75045) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 23:15:39 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-d1216da0-6db3-4a9e-91a1-9ee6dbd01a60 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75045) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 23:15:39 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-d1216da0-6db3-4a9e-91a1-9ee6dbd01a60 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Got 1 possible topologies {{(pid=75045) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 23:15:39 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-d1216da0-6db3-4a9e-91a1-9ee6dbd01a60 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75045) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 23:15:39 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-d1216da0-6db3-4a9e-91a1-9ee6dbd01a60 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75045) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 23:15:39 user nova-compute[75045]: DEBUG nova.privsep.utils [None req-d1216da0-6db3-4a9e-91a1-9ee6dbd01a60 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75045) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 08 23:15:39 user nova-compute[75045]: DEBUG nova.virt.libvirt.vif [None req-d1216da0-6db3-4a9e-91a1-9ee6dbd01a60 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T23:15:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1262128998',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1262128998',id=1,image_ref='a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6bfb6963a6c145d4a7b7e47c8fde7e60',ramdisk_id='',reservation_id='r-29lhow1b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-474110917',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T23:15:33Z,user_data=None,user_id='04bb3135250f4465a9947b47f9cde485',uuid=4ae5ff6b-6f2c-4dfd-a4c6-da4809e2cf27,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cfa24a0c-4dce-4dae-a5d7-10ebfa1cc305", "address": "fa:16:3e:33:11:13", "network": {"id": "d4cd6998-66d1-4389-bc82-dd000c8962de", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-323966879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bfb6963a6c145d4a7b7e47c8fde7e60", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcfa24a0c-4d", "ovs_interfaceid": "cfa24a0c-4dce-4dae-a5d7-10ebfa1cc305", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75045) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 23:15:39 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-d1216da0-6db3-4a9e-91a1-9ee6dbd01a60 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Converting VIF {"id": "cfa24a0c-4dce-4dae-a5d7-10ebfa1cc305", "address": "fa:16:3e:33:11:13", "network": {"id": "d4cd6998-66d1-4389-bc82-dd000c8962de", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-323966879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bfb6963a6c145d4a7b7e47c8fde7e60", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcfa24a0c-4d", "ovs_interfaceid": "cfa24a0c-4dce-4dae-a5d7-10ebfa1cc305", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 23:15:39 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-d1216da0-6db3-4a9e-91a1-9ee6dbd01a60 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:33:11:13,bridge_name='br-int',has_traffic_filtering=True,id=cfa24a0c-4dce-4dae-a5d7-10ebfa1cc305,network=Network(d4cd6998-66d1-4389-bc82-dd000c8962de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcfa24a0c-4d') {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 23:15:39 user nova-compute[75045]: DEBUG nova.objects.instance [None req-d1216da0-6db3-4a9e-91a1-9ee6dbd01a60 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Lazy-loading 'pci_devices' on Instance uuid 4ae5ff6b-6f2c-4dfd-a4c6-da4809e2cf27 {{(pid=75045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 23:15:39 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-d1216da0-6db3-4a9e-91a1-9ee6dbd01a60 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] [instance: 4ae5ff6b-6f2c-4dfd-a4c6-da4809e2cf27] End _get_guest_xml xml=<domain type="kvm">
Nov 08 23:15:39 user nova-compute[75045]:   <uuid>4ae5ff6b-6f2c-4dfd-a4c6-da4809e2cf27</uuid>
Nov 08 23:15:39 user nova-compute[75045]:   <name>instance-00000001</name>
Nov 08 23:15:39 user nova-compute[75045]:   <memory>524288</memory>
Nov 08 23:15:39 user nova-compute[75045]:   <vcpu>1</vcpu>
Nov 08 23:15:39 user nova-compute[75045]:   <metadata>
Nov 08 23:15:39 user nova-compute[75045]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 23:15:39 user nova-compute[75045]:       <nova:package version="0.0.0"/>
Nov 08 23:15:39 user nova-compute[75045]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1262128998</nova:name>
Nov 08 23:15:39 user nova-compute[75045]:       <nova:creationTime>2023-11-08 23:15:39</nova:creationTime>
Nov 08 23:15:39 user nova-compute[75045]:       <nova:flavor name="m1.tiny">
Nov 08 23:15:39 user nova-compute[75045]:         <nova:memory>512</nova:memory>
Nov 08 23:15:39 user nova-compute[75045]:         <nova:disk>1</nova:disk>
Nov 08 23:15:39 user nova-compute[75045]:         <nova:swap>0</nova:swap>
Nov 08 23:15:39 user nova-compute[75045]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 23:15:39 user nova-compute[75045]:         <nova:vcpus>1</nova:vcpus>
Nov 08 23:15:39 user nova-compute[75045]:       </nova:flavor>
Nov 08 23:15:39 user nova-compute[75045]:       <nova:owner>
Nov 08 23:15:39 user nova-compute[75045]:         <nova:user uuid="04bb3135250f4465a9947b47f9cde485">tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member</nova:user>
Nov 08 23:15:39 user nova-compute[75045]:         <nova:project uuid="6bfb6963a6c145d4a7b7e47c8fde7e60">tempest-ServerBootFromVolumeStableRescueTest-474110917</nova:project>
Nov 08 23:15:39 user nova-compute[75045]:       </nova:owner>
Nov 08 23:15:39 user nova-compute[75045]:       <nova:root type="image" uuid="a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb"/>
Nov 08 23:15:39 user nova-compute[75045]:       <nova:ports>
Nov 08 23:15:39 user nova-compute[75045]:         <nova:port uuid="cfa24a0c-4dce-4dae-a5d7-10ebfa1cc305">
Nov 08 23:15:39 user nova-compute[75045]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 08 23:15:39 user nova-compute[75045]:         </nova:port>
Nov 08 23:15:39 user nova-compute[75045]:       </nova:ports>
Nov 08 23:15:39 user nova-compute[75045]:     </nova:instance>
Nov 08 23:15:39 user nova-compute[75045]:   </metadata>
Nov 08 23:15:39 user nova-compute[75045]:   <sysinfo type="smbios">
Nov 08 23:15:39 user nova-compute[75045]:     <system>
Nov 08 23:15:39 user nova-compute[75045]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 23:15:39 user nova-compute[75045]:       <entry name="product">OpenStack Nova</entry>
Nov 08 23:15:39 user nova-compute[75045]:       <entry name="version">0.0.0</entry>
Nov 08 23:15:39 user nova-compute[75045]:       <entry name="serial">4ae5ff6b-6f2c-4dfd-a4c6-da4809e2cf27</entry>
Nov 08 23:15:39 user nova-compute[75045]:       <entry name="uuid">4ae5ff6b-6f2c-4dfd-a4c6-da4809e2cf27</entry>
Nov 08 23:15:39 user nova-compute[75045]:       <entry name="family">Virtual Machine</entry>
Nov 08 23:15:39 user nova-compute[75045]:     </system>
Nov 08 23:15:39 user nova-compute[75045]:   </sysinfo>
Nov 08 23:15:39 user nova-compute[75045]:   <os>
Nov 08 23:15:39 user nova-compute[75045]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 23:15:39 user nova-compute[75045]:     <boot dev="hd"/>
Nov 08 23:15:39 user nova-compute[75045]:     <smbios mode="sysinfo"/>
Nov 08 23:15:39 user nova-compute[75045]:   </os>
Nov 08 23:15:39 user nova-compute[75045]:   <features>
Nov 08 23:15:39 user nova-compute[75045]:     <acpi/>
Nov 08 23:15:39 user nova-compute[75045]:     <apic/>
Nov 08 23:15:39 user nova-compute[75045]:     <vmcoreinfo/>
Nov 08 23:15:39 user nova-compute[75045]:   </features>
Nov 08 23:15:39 user nova-compute[75045]:   <clock offset="utc">
Nov 08 23:15:39 user nova-compute[75045]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 23:15:39 user nova-compute[75045]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 23:15:39 user nova-compute[75045]:     <timer name="hpet" present="no"/>
Nov 08 23:15:39 user nova-compute[75045]:   </clock>
Nov 08 23:15:39 user nova-compute[75045]:   <cpu mode="custom" match="exact">
Nov 08 23:15:39 user nova-compute[75045]:     <model>Nehalem</model>
Nov 08 23:15:39 user nova-compute[75045]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 23:15:39 user nova-compute[75045]:   </cpu>
Nov 08 23:15:39 user nova-compute[75045]:   <devices>
Nov 08 23:15:39 user nova-compute[75045]:     <disk type="file" device="disk">
Nov 08 23:15:39 user nova-compute[75045]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 23:15:39 user nova-compute[75045]:       <source file="/opt/stack/data/nova/instances/4ae5ff6b-6f2c-4dfd-a4c6-da4809e2cf27/disk"/>
Nov 08 23:15:39 user nova-compute[75045]:       <target dev="vda" bus="virtio"/>
Nov 08 23:15:39 user nova-compute[75045]:     </disk>
Nov 08 23:15:39 user nova-compute[75045]:     <interface type="ethernet">
Nov 08 23:15:39 user nova-compute[75045]:       <mac address="fa:16:3e:33:11:13"/>
Nov 08 23:15:39 user nova-compute[75045]:       <model type="virtio"/>
Nov 08 23:15:39 user nova-compute[75045]:       <mtu size="1442"/>
Nov 08 23:15:39 user nova-compute[75045]:       <target dev="tapcfa24a0c-4d"/>
Nov 08 23:15:39 user nova-compute[75045]:     </interface>
Nov 08 23:15:39 user nova-compute[75045]:     <serial type="pty">
Nov 08 23:15:39 user nova-compute[75045]:       <log file="/opt/stack/data/nova/instances/4ae5ff6b-6f2c-4dfd-a4c6-da4809e2cf27/console.log" append="off"/>
Nov 08 23:15:39 user nova-compute[75045]:     </serial>
Nov 08 23:15:39 user nova-compute[75045]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 23:15:39 user nova-compute[75045]:     <video>
Nov 08 23:15:39 user nova-compute[75045]:       <model type="virtio"/>
Nov 08 23:15:39 user nova-compute[75045]:     </video>
Nov 08 23:15:39 user nova-compute[75045]:     <rng model="virtio">
Nov 08 23:15:39 user nova-compute[75045]:       <backend model="random">/dev/urandom</backend>
Nov 08 23:15:39 user nova-compute[75045]:     </rng>
Nov 08 23:15:39 user nova-compute[75045]:     <controller type="usb" index="0" model="none"/>
Nov 08 23:15:39 user nova-compute[75045]:     <memballoon model="virtio">
Nov 08 23:15:39 user nova-compute[75045]:       <stats period="10"/>
Nov 08 23:15:39 user nova-compute[75045]:     </memballoon>
Nov 08 23:15:39 user nova-compute[75045]:   </devices>
Nov 08 23:15:39 user nova-compute[75045]: </domain>
Nov 08 23:15:39 user nova-compute[75045]:  {{(pid=75045) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 23:15:39 user nova-compute[75045]: DEBUG nova.virt.libvirt.vif [None req-d1216da0-6db3-4a9e-91a1-9ee6dbd01a60 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T23:15:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1262128998',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1262128998',id=1,image_ref='a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6bfb6963a6c145d4a7b7e47c8fde7e60',ramdisk_id='',reservation_id='r-29lhow1b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-474110917',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T23:15:33Z,user_data=None,user_id='04bb3135250f4465a9947b47f9cde485',uuid=4ae5ff6b-6f2c-4dfd-a4c6-da4809e2cf27,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cfa24a0c-4dce-4dae-a5d7-10ebfa1cc305", "address": "fa:16:3e:33:11:13", "network": {"id": "d4cd6998-66d1-4389-bc82-dd000c8962de", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-323966879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bfb6963a6c145d4a7b7e47c8fde7e60", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcfa24a0c-4d", "ovs_interfaceid": "cfa24a0c-4dce-4dae-a5d7-10ebfa1cc305", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75045) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 23:15:39 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-d1216da0-6db3-4a9e-91a1-9ee6dbd01a60 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Converting VIF {"id": "cfa24a0c-4dce-4dae-a5d7-10ebfa1cc305", "address": "fa:16:3e:33:11:13", "network": {"id": "d4cd6998-66d1-4389-bc82-dd000c8962de", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-323966879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bfb6963a6c145d4a7b7e47c8fde7e60", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcfa24a0c-4d", "ovs_interfaceid": "cfa24a0c-4dce-4dae-a5d7-10ebfa1cc305", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 23:15:39 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-d1216da0-6db3-4a9e-91a1-9ee6dbd01a60 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:33:11:13,bridge_name='br-int',has_traffic_filtering=True,id=cfa24a0c-4dce-4dae-a5d7-10ebfa1cc305,network=Network(d4cd6998-66d1-4389-bc82-dd000c8962de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcfa24a0c-4d') {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 23:15:39 user nova-compute[75045]: DEBUG os_vif [None req-d1216da0-6db3-4a9e-91a1-9ee6dbd01a60 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:33:11:13,bridge_name='br-int',has_traffic_filtering=True,id=cfa24a0c-4dce-4dae-a5d7-10ebfa1cc305,network=Network(d4cd6998-66d1-4389-bc82-dd000c8962de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcfa24a0c-4d') {{(pid=75045) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 23:15:39 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl [None req-d1216da0-6db3-4a9e-91a1-9ee6dbd01a60 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Created schema index Interface.name {{(pid=75045) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Nov 08 23:15:39 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl [None req-d1216da0-6db3-4a9e-91a1-9ee6dbd01a60 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Created schema index Port.name {{(pid=75045) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Nov 08 23:15:39 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl [None req-d1216da0-6db3-4a9e-91a1-9ee6dbd01a60 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Created schema index Bridge.name {{(pid=75045) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Nov 08 23:15:39 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-d1216da0-6db3-4a9e-91a1-9ee6dbd01a60 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] tcp:127.0.0.1:6640: entering CONNECTING {{(pid=75045) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 23:15:39 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-d1216da0-6db3-4a9e-91a1-9ee6dbd01a60 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] [POLLOUT] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:15:39 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-d1216da0-6db3-4a9e-91a1-9ee6dbd01a60 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75045) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 23:15:39 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-d1216da0-6db3-4a9e-91a1-9ee6dbd01a60 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:15:39 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:15:39 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:15:39 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 23:15:39 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:15:39 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '04cc45c5-5e87-541c-a94f-0388de369957', '_type': 'linux-noop'}}, row=False) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:15:39 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 23:15:39 user nova-compute[75045]: INFO oslo.privsep.daemon [None req-d1216da0-6db3-4a9e-91a1-9ee6dbd01a60 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'vif_plug_ovs.privsep.vif_plug', '--privsep_sock_path', '/tmp/tmpfs1zvbhi/privsep.sock']
Nov 08 23:15:39 user sudo[84330]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context vif_plug_ovs.privsep.vif_plug --privsep_sock_path /tmp/tmpfs1zvbhi/privsep.sock
Nov 08 23:15:39 user sudo[84330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Nov 08 23:15:40 user nova-compute[75045]: DEBUG nova.network.neutron [req-7d45f16f-91bc-42a2-afa7-318849297168 req-5bf0f168-4bd7-4f88-b227-0d5de31e786e service nova] [instance: 4ae5ff6b-6f2c-4dfd-a4c6-da4809e2cf27] Updated VIF entry in instance network info cache for port cfa24a0c-4dce-4dae-a5d7-10ebfa1cc305. {{(pid=75045) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 23:15:40 user nova-compute[75045]: DEBUG nova.network.neutron [req-7d45f16f-91bc-42a2-afa7-318849297168 req-5bf0f168-4bd7-4f88-b227-0d5de31e786e service nova] [instance: 4ae5ff6b-6f2c-4dfd-a4c6-da4809e2cf27] Updating instance_info_cache with network_info: [{"id": "cfa24a0c-4dce-4dae-a5d7-10ebfa1cc305", "address": "fa:16:3e:33:11:13", "network": {"id": "d4cd6998-66d1-4389-bc82-dd000c8962de", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-323966879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bfb6963a6c145d4a7b7e47c8fde7e60", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcfa24a0c-4d", "ovs_interfaceid": "cfa24a0c-4dce-4dae-a5d7-10ebfa1cc305", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75045) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 23:15:40 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-7d45f16f-91bc-42a2-afa7-318849297168 req-5bf0f168-4bd7-4f88-b227-0d5de31e786e service nova] Releasing lock "refresh_cache-4ae5ff6b-6f2c-4dfd-a4c6-da4809e2cf27" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 23:15:40 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:15:40 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:15:40 user sudo[84330]: pam_unix(sudo:session): session closed for user root
Nov 08 23:15:41 user nova-compute[75045]: INFO oslo.privsep.daemon [None req-d1216da0-6db3-4a9e-91a1-9ee6dbd01a60 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Spawned new privsep daemon via rootwrap
Nov 08 23:15:41 user nova-compute[75045]: INFO oslo.privsep.daemon [-] privsep daemon starting
Nov 08 23:15:41 user nova-compute[75045]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Nov 08 23:15:41 user nova-compute[75045]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_DAC_OVERRIDE|CAP_NET_ADMIN/CAP_DAC_OVERRIDE|CAP_NET_ADMIN/none
Nov 08 23:15:41 user nova-compute[75045]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 84333
Nov 08 23:15:41 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:15:41 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapcfa24a0c-4d, may_exist=True, interface_attrs={}) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:15:41 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapcfa24a0c-4d, col_values=(('qos', UUID('b0765290-b336-43e5-b5c3-5866e490ddad')),), if_exists=True) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:15:41 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapcfa24a0c-4d, col_values=(('external_ids', {'iface-id': 'cfa24a0c-4dce-4dae-a5d7-10ebfa1cc305', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:33:11:13', 'vm-uuid': '4ae5ff6b-6f2c-4dfd-a4c6-da4809e2cf27'}),), if_exists=True) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:15:41 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 23:15:41 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:15:41 user nova-compute[75045]: INFO os_vif [None req-d1216da0-6db3-4a9e-91a1-9ee6dbd01a60 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:33:11:13,bridge_name='br-int',has_traffic_filtering=True,id=cfa24a0c-4dce-4dae-a5d7-10ebfa1cc305,network=Network(d4cd6998-66d1-4389-bc82-dd000c8962de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcfa24a0c-4d')
Nov 08 23:15:41 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-d1216da0-6db3-4a9e-91a1-9ee6dbd01a60 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] No BDM found with device name vda, not building metadata. {{(pid=75045) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 23:15:41 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-d1216da0-6db3-4a9e-91a1-9ee6dbd01a60 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] No VIF found with MAC fa:16:3e:33:11:13, not building metadata {{(pid=75045) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 23:15:41 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:15:42 user nova-compute[75045]: DEBUG nova.network.neutron [None req-6698730b-209f-4bc5-8519-9b9d0571d902 tempest-DeleteServersTestJSON-1018435513 tempest-DeleteServersTestJSON-1018435513-project-member] [instance: 09cf15e6-1cec-4c55-b7dd-4311b5f87d32] Successfully updated port: a270cac5-2b8d-4eb7-a5ed-9338e6bb5e22 {{(pid=75045) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 23:15:42 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-7f2e992a-40d7-4935-97df-19f5b57ac588 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Acquiring lock "0f21fcd3-ac5f-499e-9c34-82af806fda1d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:15:42 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-7f2e992a-40d7-4935-97df-19f5b57ac588 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Lock "0f21fcd3-ac5f-499e-9c34-82af806fda1d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.003s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:15:42 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-6698730b-209f-4bc5-8519-9b9d0571d902 tempest-DeleteServersTestJSON-1018435513 tempest-DeleteServersTestJSON-1018435513-project-member] Acquiring lock "refresh_cache-09cf15e6-1cec-4c55-b7dd-4311b5f87d32" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 23:15:42 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-6698730b-209f-4bc5-8519-9b9d0571d902 tempest-DeleteServersTestJSON-1018435513 tempest-DeleteServersTestJSON-1018435513-project-member] Acquired lock "refresh_cache-09cf15e6-1cec-4c55-b7dd-4311b5f87d32" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 23:15:42 user nova-compute[75045]: DEBUG nova.network.neutron [None req-6698730b-209f-4bc5-8519-9b9d0571d902 tempest-DeleteServersTestJSON-1018435513 tempest-DeleteServersTestJSON-1018435513-project-member] [instance: 09cf15e6-1cec-4c55-b7dd-4311b5f87d32] Building network info cache for instance {{(pid=75045) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 23:15:42 user nova-compute[75045]: DEBUG nova.compute.manager [None req-7f2e992a-40d7-4935-97df-19f5b57ac588 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] [instance: 0f21fcd3-ac5f-499e-9c34-82af806fda1d] Starting instance... {{(pid=75045) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 23:15:42 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-7f2e992a-40d7-4935-97df-19f5b57ac588 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:15:42 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-7f2e992a-40d7-4935-97df-19f5b57ac588 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.003s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:15:42 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-7f2e992a-40d7-4935-97df-19f5b57ac588 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75045) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 23:15:42 user nova-compute[75045]: INFO nova.compute.claims [None req-7f2e992a-40d7-4935-97df-19f5b57ac588 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] [instance: 0f21fcd3-ac5f-499e-9c34-82af806fda1d] Claim successful on node user
Nov 08 23:15:42 user nova-compute[75045]: DEBUG nova.network.neutron [None req-6698730b-209f-4bc5-8519-9b9d0571d902 tempest-DeleteServersTestJSON-1018435513 tempest-DeleteServersTestJSON-1018435513-project-member] [instance: 09cf15e6-1cec-4c55-b7dd-4311b5f87d32] Instance cache missing network info. {{(pid=75045) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 23:15:42 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:15:42 user nova-compute[75045]: DEBUG nova.compute.manager [req-caf160d4-95f9-4a05-b37d-6cec731bf78d req-107d0294-1520-481e-82ee-093619ee05a5 service nova] [instance: 09cf15e6-1cec-4c55-b7dd-4311b5f87d32] Received event network-changed-a270cac5-2b8d-4eb7-a5ed-9338e6bb5e22 {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:15:42 user nova-compute[75045]: DEBUG nova.compute.manager [req-caf160d4-95f9-4a05-b37d-6cec731bf78d req-107d0294-1520-481e-82ee-093619ee05a5 service nova] [instance: 09cf15e6-1cec-4c55-b7dd-4311b5f87d32] Refreshing instance network info cache due to event network-changed-a270cac5-2b8d-4eb7-a5ed-9338e6bb5e22. {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 23:15:42 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-caf160d4-95f9-4a05-b37d-6cec731bf78d req-107d0294-1520-481e-82ee-093619ee05a5 service nova] Acquiring lock "refresh_cache-09cf15e6-1cec-4c55-b7dd-4311b5f87d32" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 23:15:42 user nova-compute[75045]: DEBUG nova.compute.provider_tree [None req-7f2e992a-40d7-4935-97df-19f5b57ac588 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Inventory has not changed in ProviderTree for provider: 62ba5f85-c74d-4b58-986e-d4197e813fd7 {{(pid=75045) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 23:15:42 user nova-compute[75045]: DEBUG nova.scheduler.client.report [None req-7f2e992a-40d7-4935-97df-19f5b57ac588 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Inventory has not changed for provider 62ba5f85-c74d-4b58-986e-d4197e813fd7 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75045) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 23:15:42 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-7f2e992a-40d7-4935-97df-19f5b57ac588 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.396s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:15:42 user nova-compute[75045]: DEBUG nova.compute.manager [None req-7f2e992a-40d7-4935-97df-19f5b57ac588 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] [instance: 0f21fcd3-ac5f-499e-9c34-82af806fda1d] Start building networks asynchronously for instance. {{(pid=75045) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 23:15:42 user nova-compute[75045]: DEBUG nova.compute.manager [None req-7f2e992a-40d7-4935-97df-19f5b57ac588 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] [instance: 0f21fcd3-ac5f-499e-9c34-82af806fda1d] Allocating IP information in the background. {{(pid=75045) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 23:15:42 user nova-compute[75045]: DEBUG nova.network.neutron [None req-7f2e992a-40d7-4935-97df-19f5b57ac588 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] [instance: 0f21fcd3-ac5f-499e-9c34-82af806fda1d] allocate_for_instance() {{(pid=75045) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 23:15:42 user nova-compute[75045]: INFO nova.virt.libvirt.driver [None req-7f2e992a-40d7-4935-97df-19f5b57ac588 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] [instance: 0f21fcd3-ac5f-499e-9c34-82af806fda1d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 23:15:43 user nova-compute[75045]: DEBUG nova.compute.manager [None req-7f2e992a-40d7-4935-97df-19f5b57ac588 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] [instance: 0f21fcd3-ac5f-499e-9c34-82af806fda1d] Start building block device mappings for instance. {{(pid=75045) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 23:15:43 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:15:43 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:15:43 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:15:43 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:15:43 user nova-compute[75045]: DEBUG nova.compute.manager [None req-7f2e992a-40d7-4935-97df-19f5b57ac588 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] [instance: 0f21fcd3-ac5f-499e-9c34-82af806fda1d] Start spawning the instance on the hypervisor. {{(pid=75045) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 23:15:43 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-7f2e992a-40d7-4935-97df-19f5b57ac588 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] [instance: 0f21fcd3-ac5f-499e-9c34-82af806fda1d] Creating instance directory {{(pid=75045) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 23:15:43 user nova-compute[75045]: INFO nova.virt.libvirt.driver [None req-7f2e992a-40d7-4935-97df-19f5b57ac588 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] [instance: 0f21fcd3-ac5f-499e-9c34-82af806fda1d] Creating image(s)
Nov 08 23:15:43 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-7f2e992a-40d7-4935-97df-19f5b57ac588 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Acquiring lock "/opt/stack/data/nova/instances/0f21fcd3-ac5f-499e-9c34-82af806fda1d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:15:43 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-7f2e992a-40d7-4935-97df-19f5b57ac588 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Lock "/opt/stack/data/nova/instances/0f21fcd3-ac5f-499e-9c34-82af806fda1d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:15:43 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-7f2e992a-40d7-4935-97df-19f5b57ac588 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Lock "/opt/stack/data/nova/instances/0f21fcd3-ac5f-499e-9c34-82af806fda1d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:15:43 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-7f2e992a-40d7-4935-97df-19f5b57ac588 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b59f52a99fff51c56dd1edfb83892fb8f647f2f3 --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:15:43 user nova-compute[75045]: DEBUG nova.policy [None req-7f2e992a-40d7-4935-97df-19f5b57ac588 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '75fc508f268d4a569ad78598ff019c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e63623113f11463d9035bb990de43510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75045) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 23:15:43 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-7f2e992a-40d7-4935-97df-19f5b57ac588 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b59f52a99fff51c56dd1edfb83892fb8f647f2f3 --force-share --output=json" returned: 0 in 0.234s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:15:43 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-7f2e992a-40d7-4935-97df-19f5b57ac588 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Acquiring lock "b59f52a99fff51c56dd1edfb83892fb8f647f2f3" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:15:43 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-7f2e992a-40d7-4935-97df-19f5b57ac588 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Lock "b59f52a99fff51c56dd1edfb83892fb8f647f2f3" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:15:43 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-7f2e992a-40d7-4935-97df-19f5b57ac588 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b59f52a99fff51c56dd1edfb83892fb8f647f2f3 --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:15:43 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-7f2e992a-40d7-4935-97df-19f5b57ac588 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b59f52a99fff51c56dd1edfb83892fb8f647f2f3 --force-share --output=json" returned: 0 in 0.250s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:15:43 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-7f2e992a-40d7-4935-97df-19f5b57ac588 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b59f52a99fff51c56dd1edfb83892fb8f647f2f3,backing_fmt=raw /opt/stack/data/nova/instances/0f21fcd3-ac5f-499e-9c34-82af806fda1d/disk 1073741824 {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:15:43 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-7f2e992a-40d7-4935-97df-19f5b57ac588 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b59f52a99fff51c56dd1edfb83892fb8f647f2f3,backing_fmt=raw /opt/stack/data/nova/instances/0f21fcd3-ac5f-499e-9c34-82af806fda1d/disk 1073741824" returned: 0 in 0.055s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:15:43 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-7f2e992a-40d7-4935-97df-19f5b57ac588 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Lock "b59f52a99fff51c56dd1edfb83892fb8f647f2f3" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.310s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:15:43 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-7f2e992a-40d7-4935-97df-19f5b57ac588 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b59f52a99fff51c56dd1edfb83892fb8f647f2f3 --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:15:43 user nova-compute[75045]: DEBUG nova.network.neutron [None req-6698730b-209f-4bc5-8519-9b9d0571d902 tempest-DeleteServersTestJSON-1018435513 tempest-DeleteServersTestJSON-1018435513-project-member] [instance: 09cf15e6-1cec-4c55-b7dd-4311b5f87d32] Updating instance_info_cache with network_info: [{"id": "a270cac5-2b8d-4eb7-a5ed-9338e6bb5e22", "address": "fa:16:3e:3e:0e:1d", "network": {"id": "8137fd46-49da-40ca-81e8-4ad6984ee6ae", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-668291672-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec0b8a91a6ba43e6836d226ba9528100", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa270cac5-2b", "ovs_interfaceid": "a270cac5-2b8d-4eb7-a5ed-9338e6bb5e22", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75045) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 23:15:43 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-6698730b-209f-4bc5-8519-9b9d0571d902 tempest-DeleteServersTestJSON-1018435513 tempest-DeleteServersTestJSON-1018435513-project-member] Releasing lock "refresh_cache-09cf15e6-1cec-4c55-b7dd-4311b5f87d32" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 23:15:43 user nova-compute[75045]: DEBUG nova.compute.manager [None req-6698730b-209f-4bc5-8519-9b9d0571d902 tempest-DeleteServersTestJSON-1018435513 tempest-DeleteServersTestJSON-1018435513-project-member] [instance: 09cf15e6-1cec-4c55-b7dd-4311b5f87d32] Instance network_info: |[{"id": "a270cac5-2b8d-4eb7-a5ed-9338e6bb5e22", "address": "fa:16:3e:3e:0e:1d", "network": {"id": "8137fd46-49da-40ca-81e8-4ad6984ee6ae", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-668291672-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec0b8a91a6ba43e6836d226ba9528100", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa270cac5-2b", "ovs_interfaceid": "a270cac5-2b8d-4eb7-a5ed-9338e6bb5e22", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75045) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 23:15:43 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-caf160d4-95f9-4a05-b37d-6cec731bf78d req-107d0294-1520-481e-82ee-093619ee05a5 service nova] Acquired lock "refresh_cache-09cf15e6-1cec-4c55-b7dd-4311b5f87d32" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 23:15:43 user nova-compute[75045]: DEBUG nova.network.neutron [req-caf160d4-95f9-4a05-b37d-6cec731bf78d req-107d0294-1520-481e-82ee-093619ee05a5 service nova] [instance: 09cf15e6-1cec-4c55-b7dd-4311b5f87d32] Refreshing network info cache for port a270cac5-2b8d-4eb7-a5ed-9338e6bb5e22 {{(pid=75045) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 23:15:43 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-6698730b-209f-4bc5-8519-9b9d0571d902 tempest-DeleteServersTestJSON-1018435513 tempest-DeleteServersTestJSON-1018435513-project-member] [instance: 09cf15e6-1cec-4c55-b7dd-4311b5f87d32] Start _get_guest_xml network_info=[{"id": "a270cac5-2b8d-4eb7-a5ed-9338e6bb5e22", "address": "fa:16:3e:3e:0e:1d", "network": {"id": "8137fd46-49da-40ca-81e8-4ad6984ee6ae", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-668291672-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec0b8a91a6ba43e6836d226ba9528100", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa270cac5-2b", "ovs_interfaceid": "a270cac5-2b8d-4eb7-a5ed-9338e6bb5e22", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T23:11:54Z,direct_url=<?>,disk_format='qcow2',id=a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b1beba2cc4e7465ea249e2225fb494dc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T23:11:56Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'disk_bus': 'virtio', 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': 'a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75045) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 23:15:43 user nova-compute[75045]: WARNING nova.virt.libvirt.driver [None req-6698730b-209f-4bc5-8519-9b9d0571d902 tempest-DeleteServersTestJSON-1018435513 tempest-DeleteServersTestJSON-1018435513-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 23:15:43 user nova-compute[75045]: WARNING nova.virt.libvirt.driver [None req-6698730b-209f-4bc5-8519-9b9d0571d902 tempest-DeleteServersTestJSON-1018435513 tempest-DeleteServersTestJSON-1018435513-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 23:15:43 user nova-compute[75045]: DEBUG nova.virt.libvirt.host [None req-6698730b-209f-4bc5-8519-9b9d0571d902 tempest-DeleteServersTestJSON-1018435513 tempest-DeleteServersTestJSON-1018435513-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75045) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 23:15:43 user nova-compute[75045]: DEBUG nova.virt.libvirt.host [None req-6698730b-209f-4bc5-8519-9b9d0571d902 tempest-DeleteServersTestJSON-1018435513 tempest-DeleteServersTestJSON-1018435513-project-member] CPU controller missing on host. {{(pid=75045) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 23:15:43 user nova-compute[75045]: DEBUG nova.virt.libvirt.host [None req-6698730b-209f-4bc5-8519-9b9d0571d902 tempest-DeleteServersTestJSON-1018435513 tempest-DeleteServersTestJSON-1018435513-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75045) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 23:15:43 user nova-compute[75045]: DEBUG nova.virt.libvirt.host [None req-6698730b-209f-4bc5-8519-9b9d0571d902 tempest-DeleteServersTestJSON-1018435513 tempest-DeleteServersTestJSON-1018435513-project-member] CPU controller found on host. {{(pid=75045) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 23:15:43 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-6698730b-209f-4bc5-8519-9b9d0571d902 tempest-DeleteServersTestJSON-1018435513 tempest-DeleteServersTestJSON-1018435513-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75045) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 23:15:43 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-6698730b-209f-4bc5-8519-9b9d0571d902 tempest-DeleteServersTestJSON-1018435513 tempest-DeleteServersTestJSON-1018435513-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T23:11:41Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T23:11:54Z,direct_url=<?>,disk_format='qcow2',id=a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b1beba2cc4e7465ea249e2225fb494dc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T23:11:56Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75045) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 23:15:43 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-6698730b-209f-4bc5-8519-9b9d0571d902 tempest-DeleteServersTestJSON-1018435513 tempest-DeleteServersTestJSON-1018435513-project-member] Flavor limits 0:0:0 {{(pid=75045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 23:15:43 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-6698730b-209f-4bc5-8519-9b9d0571d902 tempest-DeleteServersTestJSON-1018435513 tempest-DeleteServersTestJSON-1018435513-project-member] Image limits 0:0:0 {{(pid=75045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 23:15:43 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-6698730b-209f-4bc5-8519-9b9d0571d902 tempest-DeleteServersTestJSON-1018435513 tempest-DeleteServersTestJSON-1018435513-project-member] Flavor pref 0:0:0 {{(pid=75045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 23:15:43 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-6698730b-209f-4bc5-8519-9b9d0571d902 tempest-DeleteServersTestJSON-1018435513 tempest-DeleteServersTestJSON-1018435513-project-member] Image pref 0:0:0 {{(pid=75045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 23:15:43 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-6698730b-209f-4bc5-8519-9b9d0571d902 tempest-DeleteServersTestJSON-1018435513 tempest-DeleteServersTestJSON-1018435513-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 23:15:43 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-6698730b-209f-4bc5-8519-9b9d0571d902 tempest-DeleteServersTestJSON-1018435513 tempest-DeleteServersTestJSON-1018435513-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75045) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 23:15:43 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-6698730b-209f-4bc5-8519-9b9d0571d902 tempest-DeleteServersTestJSON-1018435513 tempest-DeleteServersTestJSON-1018435513-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75045) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 23:15:43 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-6698730b-209f-4bc5-8519-9b9d0571d902 tempest-DeleteServersTestJSON-1018435513 tempest-DeleteServersTestJSON-1018435513-project-member] Got 1 possible topologies {{(pid=75045) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 23:15:43 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-6698730b-209f-4bc5-8519-9b9d0571d902 tempest-DeleteServersTestJSON-1018435513 tempest-DeleteServersTestJSON-1018435513-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75045) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 23:15:43 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-6698730b-209f-4bc5-8519-9b9d0571d902 tempest-DeleteServersTestJSON-1018435513 tempest-DeleteServersTestJSON-1018435513-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75045) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 23:15:43 user nova-compute[75045]: DEBUG nova.virt.libvirt.vif [None req-6698730b-209f-4bc5-8519-9b9d0571d902 tempest-DeleteServersTestJSON-1018435513 tempest-DeleteServersTestJSON-1018435513-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T23:15:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-836211320',display_name='tempest-DeleteServersTestJSON-server-836211320',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-836211320',id=2,image_ref='a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ec0b8a91a6ba43e6836d226ba9528100',ramdisk_id='',reservation_id='r-jrw85gqg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-1018435513',owner_user_name='tempest-DeleteServersTestJSON-1018435513-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T23:15:36Z,user_data=None,user_id='4867afafcd4f48728d45af6ccdc40aaa',uuid=09cf15e6-1cec-4c55-b7dd-4311b5f87d32,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a270cac5-2b8d-4eb7-a5ed-9338e6bb5e22", "address": "fa:16:3e:3e:0e:1d", "network": {"id": "8137fd46-49da-40ca-81e8-4ad6984ee6ae", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-668291672-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec0b8a91a6ba43e6836d226ba9528100", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa270cac5-2b", "ovs_interfaceid": "a270cac5-2b8d-4eb7-a5ed-9338e6bb5e22", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75045) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 23:15:43 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-6698730b-209f-4bc5-8519-9b9d0571d902 tempest-DeleteServersTestJSON-1018435513 tempest-DeleteServersTestJSON-1018435513-project-member] Converting VIF {"id": "a270cac5-2b8d-4eb7-a5ed-9338e6bb5e22", "address": "fa:16:3e:3e:0e:1d", "network": {"id": "8137fd46-49da-40ca-81e8-4ad6984ee6ae", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-668291672-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec0b8a91a6ba43e6836d226ba9528100", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa270cac5-2b", "ovs_interfaceid": "a270cac5-2b8d-4eb7-a5ed-9338e6bb5e22", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 23:15:43 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-6698730b-209f-4bc5-8519-9b9d0571d902 tempest-DeleteServersTestJSON-1018435513 tempest-DeleteServersTestJSON-1018435513-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3e:0e:1d,bridge_name='br-int',has_traffic_filtering=True,id=a270cac5-2b8d-4eb7-a5ed-9338e6bb5e22,network=Network(8137fd46-49da-40ca-81e8-4ad6984ee6ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa270cac5-2b') {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 23:15:43 user nova-compute[75045]: DEBUG nova.objects.instance [None req-6698730b-209f-4bc5-8519-9b9d0571d902 tempest-DeleteServersTestJSON-1018435513 tempest-DeleteServersTestJSON-1018435513-project-member] Lazy-loading 'pci_devices' on Instance uuid 09cf15e6-1cec-4c55-b7dd-4311b5f87d32 {{(pid=75045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 23:15:43 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-6698730b-209f-4bc5-8519-9b9d0571d902 tempest-DeleteServersTestJSON-1018435513 tempest-DeleteServersTestJSON-1018435513-project-member] [instance: 09cf15e6-1cec-4c55-b7dd-4311b5f87d32] End _get_guest_xml xml=<domain type="kvm">
Nov 08 23:15:43 user nova-compute[75045]:   <uuid>09cf15e6-1cec-4c55-b7dd-4311b5f87d32</uuid>
Nov 08 23:15:43 user nova-compute[75045]:   <name>instance-00000002</name>
Nov 08 23:15:43 user nova-compute[75045]:   <memory>524288</memory>
Nov 08 23:15:43 user nova-compute[75045]:   <vcpu>1</vcpu>
Nov 08 23:15:43 user nova-compute[75045]:   <metadata>
Nov 08 23:15:43 user nova-compute[75045]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 23:15:43 user nova-compute[75045]:       <nova:package version="0.0.0"/>
Nov 08 23:15:43 user nova-compute[75045]:       <nova:name>tempest-DeleteServersTestJSON-server-836211320</nova:name>
Nov 08 23:15:43 user nova-compute[75045]:       <nova:creationTime>2023-11-08 23:15:43</nova:creationTime>
Nov 08 23:15:43 user nova-compute[75045]:       <nova:flavor name="m1.tiny">
Nov 08 23:15:43 user nova-compute[75045]:         <nova:memory>512</nova:memory>
Nov 08 23:15:43 user nova-compute[75045]:         <nova:disk>1</nova:disk>
Nov 08 23:15:43 user nova-compute[75045]:         <nova:swap>0</nova:swap>
Nov 08 23:15:43 user nova-compute[75045]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 23:15:43 user nova-compute[75045]:         <nova:vcpus>1</nova:vcpus>
Nov 08 23:15:43 user nova-compute[75045]:       </nova:flavor>
Nov 08 23:15:43 user nova-compute[75045]:       <nova:owner>
Nov 08 23:15:43 user nova-compute[75045]:         <nova:user uuid="4867afafcd4f48728d45af6ccdc40aaa">tempest-DeleteServersTestJSON-1018435513-project-member</nova:user>
Nov 08 23:15:43 user nova-compute[75045]:         <nova:project uuid="ec0b8a91a6ba43e6836d226ba9528100">tempest-DeleteServersTestJSON-1018435513</nova:project>
Nov 08 23:15:43 user nova-compute[75045]:       </nova:owner>
Nov 08 23:15:43 user nova-compute[75045]:       <nova:root type="image" uuid="a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb"/>
Nov 08 23:15:43 user nova-compute[75045]:       <nova:ports>
Nov 08 23:15:43 user nova-compute[75045]:         <nova:port uuid="a270cac5-2b8d-4eb7-a5ed-9338e6bb5e22">
Nov 08 23:15:43 user nova-compute[75045]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 08 23:15:43 user nova-compute[75045]:         </nova:port>
Nov 08 23:15:43 user nova-compute[75045]:       </nova:ports>
Nov 08 23:15:43 user nova-compute[75045]:     </nova:instance>
Nov 08 23:15:43 user nova-compute[75045]:   </metadata>
Nov 08 23:15:43 user nova-compute[75045]:   <sysinfo type="smbios">
Nov 08 23:15:43 user nova-compute[75045]:     <system>
Nov 08 23:15:43 user nova-compute[75045]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 23:15:43 user nova-compute[75045]:       <entry name="product">OpenStack Nova</entry>
Nov 08 23:15:43 user nova-compute[75045]:       <entry name="version">0.0.0</entry>
Nov 08 23:15:43 user nova-compute[75045]:       <entry name="serial">09cf15e6-1cec-4c55-b7dd-4311b5f87d32</entry>
Nov 08 23:15:43 user nova-compute[75045]:       <entry name="uuid">09cf15e6-1cec-4c55-b7dd-4311b5f87d32</entry>
Nov 08 23:15:43 user nova-compute[75045]:       <entry name="family">Virtual Machine</entry>
Nov 08 23:15:43 user nova-compute[75045]:     </system>
Nov 08 23:15:43 user nova-compute[75045]:   </sysinfo>
Nov 08 23:15:43 user nova-compute[75045]:   <os>
Nov 08 23:15:43 user nova-compute[75045]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 23:15:43 user nova-compute[75045]:     <boot dev="hd"/>
Nov 08 23:15:43 user nova-compute[75045]:     <smbios mode="sysinfo"/>
Nov 08 23:15:43 user nova-compute[75045]:   </os>
Nov 08 23:15:43 user nova-compute[75045]:   <features>
Nov 08 23:15:43 user nova-compute[75045]:     <acpi/>
Nov 08 23:15:43 user nova-compute[75045]:     <apic/>
Nov 08 23:15:43 user nova-compute[75045]:     <vmcoreinfo/>
Nov 08 23:15:43 user nova-compute[75045]:   </features>
Nov 08 23:15:43 user nova-compute[75045]:   <clock offset="utc">
Nov 08 23:15:43 user nova-compute[75045]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 23:15:43 user nova-compute[75045]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 23:15:43 user nova-compute[75045]:     <timer name="hpet" present="no"/>
Nov 08 23:15:43 user nova-compute[75045]:   </clock>
Nov 08 23:15:43 user nova-compute[75045]:   <cpu mode="custom" match="exact">
Nov 08 23:15:43 user nova-compute[75045]:     <model>Nehalem</model>
Nov 08 23:15:43 user nova-compute[75045]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 23:15:43 user nova-compute[75045]:   </cpu>
Nov 08 23:15:43 user nova-compute[75045]:   <devices>
Nov 08 23:15:43 user nova-compute[75045]:     <disk type="file" device="disk">
Nov 08 23:15:43 user nova-compute[75045]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 23:15:43 user nova-compute[75045]:       <source file="/opt/stack/data/nova/instances/09cf15e6-1cec-4c55-b7dd-4311b5f87d32/disk"/>
Nov 08 23:15:43 user nova-compute[75045]:       <target dev="vda" bus="virtio"/>
Nov 08 23:15:43 user nova-compute[75045]:     </disk>
Nov 08 23:15:43 user nova-compute[75045]:     <interface type="ethernet">
Nov 08 23:15:43 user nova-compute[75045]:       <mac address="fa:16:3e:3e:0e:1d"/>
Nov 08 23:15:43 user nova-compute[75045]:       <model type="virtio"/>
Nov 08 23:15:43 user nova-compute[75045]:       <mtu size="1442"/>
Nov 08 23:15:43 user nova-compute[75045]:       <target dev="tapa270cac5-2b"/>
Nov 08 23:15:43 user nova-compute[75045]:     </interface>
Nov 08 23:15:43 user nova-compute[75045]:     <serial type="pty">
Nov 08 23:15:43 user nova-compute[75045]:       <log file="/opt/stack/data/nova/instances/09cf15e6-1cec-4c55-b7dd-4311b5f87d32/console.log" append="off"/>
Nov 08 23:15:43 user nova-compute[75045]:     </serial>
Nov 08 23:15:43 user nova-compute[75045]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 23:15:43 user nova-compute[75045]:     <video>
Nov 08 23:15:43 user nova-compute[75045]:       <model type="virtio"/>
Nov 08 23:15:43 user nova-compute[75045]:     </video>
Nov 08 23:15:43 user nova-compute[75045]:     <rng model="virtio">
Nov 08 23:15:43 user nova-compute[75045]:       <backend model="random">/dev/urandom</backend>
Nov 08 23:15:43 user nova-compute[75045]:     </rng>
Nov 08 23:15:43 user nova-compute[75045]:     <controller type="usb" index="0" model="none"/>
Nov 08 23:15:43 user nova-compute[75045]:     <memballoon model="virtio">
Nov 08 23:15:43 user nova-compute[75045]:       <stats period="10"/>
Nov 08 23:15:43 user nova-compute[75045]:     </memballoon>
Nov 08 23:15:43 user nova-compute[75045]:   </devices>
Nov 08 23:15:43 user nova-compute[75045]: </domain>
Nov 08 23:15:43 user nova-compute[75045]:  {{(pid=75045) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 23:15:43 user nova-compute[75045]: DEBUG nova.virt.libvirt.vif [None req-6698730b-209f-4bc5-8519-9b9d0571d902 tempest-DeleteServersTestJSON-1018435513 tempest-DeleteServersTestJSON-1018435513-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T23:15:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-836211320',display_name='tempest-DeleteServersTestJSON-server-836211320',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-836211320',id=2,image_ref='a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ec0b8a91a6ba43e6836d226ba9528100',ramdisk_id='',reservation_id='r-jrw85gqg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-1018435513',owner_user_name='tempest-DeleteServersTestJSON-1018435513-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T23:15:36Z,user_data=None,user_id='4867afafcd4f48728d45af6ccdc40aaa',uuid=09cf15e6-1cec-4c55-b7dd-4311b5f87d32,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a270cac5-2b8d-4eb7-a5ed-9338e6bb5e22", "address": "fa:16:3e:3e:0e:1d", "network": {"id": "8137fd46-49da-40ca-81e8-4ad6984ee6ae", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-668291672-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec0b8a91a6ba43e6836d226ba9528100", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa270cac5-2b", "ovs_interfaceid": "a270cac5-2b8d-4eb7-a5ed-9338e6bb5e22", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75045) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 23:15:43 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-6698730b-209f-4bc5-8519-9b9d0571d902 tempest-DeleteServersTestJSON-1018435513 tempest-DeleteServersTestJSON-1018435513-project-member] Converting VIF {"id": "a270cac5-2b8d-4eb7-a5ed-9338e6bb5e22", "address": "fa:16:3e:3e:0e:1d", "network": {"id": "8137fd46-49da-40ca-81e8-4ad6984ee6ae", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-668291672-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec0b8a91a6ba43e6836d226ba9528100", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa270cac5-2b", "ovs_interfaceid": "a270cac5-2b8d-4eb7-a5ed-9338e6bb5e22", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 23:15:43 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-6698730b-209f-4bc5-8519-9b9d0571d902 tempest-DeleteServersTestJSON-1018435513 tempest-DeleteServersTestJSON-1018435513-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3e:0e:1d,bridge_name='br-int',has_traffic_filtering=True,id=a270cac5-2b8d-4eb7-a5ed-9338e6bb5e22,network=Network(8137fd46-49da-40ca-81e8-4ad6984ee6ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa270cac5-2b') {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 23:15:43 user nova-compute[75045]: DEBUG os_vif [None req-6698730b-209f-4bc5-8519-9b9d0571d902 tempest-DeleteServersTestJSON-1018435513 tempest-DeleteServersTestJSON-1018435513-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3e:0e:1d,bridge_name='br-int',has_traffic_filtering=True,id=a270cac5-2b8d-4eb7-a5ed-9338e6bb5e22,network=Network(8137fd46-49da-40ca-81e8-4ad6984ee6ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa270cac5-2b') {{(pid=75045) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 23:15:43 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:15:43 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:15:43 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 23:15:43 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:15:43 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f7c1a011-be5d-5ea6-8437-2a465fff0a25', '_type': 'linux-noop'}}, row=False) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:15:44 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-7f2e992a-40d7-4935-97df-19f5b57ac588 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b59f52a99fff51c56dd1edfb83892fb8f647f2f3 --force-share --output=json" returned: 0 in 0.223s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:15:44 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 23:15:44 user nova-compute[75045]: DEBUG nova.virt.disk.api [None req-7f2e992a-40d7-4935-97df-19f5b57ac588 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0f21fcd3-ac5f-499e-9c34-82af806fda1d/disk. size=1073741824 {{(pid=75045) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 23:15:44 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-7f2e992a-40d7-4935-97df-19f5b57ac588 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f21fcd3-ac5f-499e-9c34-82af806fda1d/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:15:44 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:15:44 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa270cac5-2b, may_exist=True, interface_attrs={}) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:15:44 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa270cac5-2b, col_values=(('qos', UUID('909bbde9-cd81-44b1-a6a0-272a6e630574')),), if_exists=True) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:15:44 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa270cac5-2b, col_values=(('external_ids', {'iface-id': 'a270cac5-2b8d-4eb7-a5ed-9338e6bb5e22', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3e:0e:1d', 'vm-uuid': '09cf15e6-1cec-4c55-b7dd-4311b5f87d32'}),), if_exists=True) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:15:44 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 23:15:44 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:15:44 user nova-compute[75045]: INFO os_vif [None req-6698730b-209f-4bc5-8519-9b9d0571d902 tempest-DeleteServersTestJSON-1018435513 tempest-DeleteServersTestJSON-1018435513-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3e:0e:1d,bridge_name='br-int',has_traffic_filtering=True,id=a270cac5-2b8d-4eb7-a5ed-9338e6bb5e22,network=Network(8137fd46-49da-40ca-81e8-4ad6984ee6ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa270cac5-2b')
Nov 08 23:15:44 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-6698730b-209f-4bc5-8519-9b9d0571d902 tempest-DeleteServersTestJSON-1018435513 tempest-DeleteServersTestJSON-1018435513-project-member] No BDM found with device name vda, not building metadata. {{(pid=75045) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 23:15:44 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-6698730b-209f-4bc5-8519-9b9d0571d902 tempest-DeleteServersTestJSON-1018435513 tempest-DeleteServersTestJSON-1018435513-project-member] No VIF found with MAC fa:16:3e:3e:0e:1d, not building metadata {{(pid=75045) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 23:15:44 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-7f2e992a-40d7-4935-97df-19f5b57ac588 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f21fcd3-ac5f-499e-9c34-82af806fda1d/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:15:44 user nova-compute[75045]: DEBUG nova.virt.disk.api [None req-7f2e992a-40d7-4935-97df-19f5b57ac588 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Cannot resize image /opt/stack/data/nova/instances/0f21fcd3-ac5f-499e-9c34-82af806fda1d/disk to a smaller size. {{(pid=75045) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 08 23:15:44 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-7f2e992a-40d7-4935-97df-19f5b57ac588 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] [instance: 0f21fcd3-ac5f-499e-9c34-82af806fda1d] Created local disks {{(pid=75045) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 23:15:44 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-7f2e992a-40d7-4935-97df-19f5b57ac588 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] [instance: 0f21fcd3-ac5f-499e-9c34-82af806fda1d] Ensure instance console log exists: /opt/stack/data/nova/instances/0f21fcd3-ac5f-499e-9c34-82af806fda1d/console.log {{(pid=75045) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 23:15:44 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-7f2e992a-40d7-4935-97df-19f5b57ac588 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:15:44 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-7f2e992a-40d7-4935-97df-19f5b57ac588 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:15:44 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-7f2e992a-40d7-4935-97df-19f5b57ac588 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:15:44 user nova-compute[75045]: DEBUG nova.compute.manager [req-1728ffa5-7bf8-47f5-84d2-a158797d178b req-5a8d0046-4321-4292-88d0-4139bcac3106 service nova] [instance: 4ae5ff6b-6f2c-4dfd-a4c6-da4809e2cf27] Received event network-vif-plugged-cfa24a0c-4dce-4dae-a5d7-10ebfa1cc305 {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:15:44 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-1728ffa5-7bf8-47f5-84d2-a158797d178b req-5a8d0046-4321-4292-88d0-4139bcac3106 service nova] Acquiring lock "4ae5ff6b-6f2c-4dfd-a4c6-da4809e2cf27-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:15:44 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-1728ffa5-7bf8-47f5-84d2-a158797d178b req-5a8d0046-4321-4292-88d0-4139bcac3106 service nova] Lock "4ae5ff6b-6f2c-4dfd-a4c6-da4809e2cf27-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:15:44 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-1728ffa5-7bf8-47f5-84d2-a158797d178b req-5a8d0046-4321-4292-88d0-4139bcac3106 service nova] Lock "4ae5ff6b-6f2c-4dfd-a4c6-da4809e2cf27-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:15:44 user nova-compute[75045]: DEBUG nova.compute.manager [req-1728ffa5-7bf8-47f5-84d2-a158797d178b req-5a8d0046-4321-4292-88d0-4139bcac3106 service nova] [instance: 4ae5ff6b-6f2c-4dfd-a4c6-da4809e2cf27] No waiting events found dispatching network-vif-plugged-cfa24a0c-4dce-4dae-a5d7-10ebfa1cc305 {{(pid=75045) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 23:15:44 user nova-compute[75045]: WARNING nova.compute.manager [req-1728ffa5-7bf8-47f5-84d2-a158797d178b req-5a8d0046-4321-4292-88d0-4139bcac3106 service nova] [instance: 4ae5ff6b-6f2c-4dfd-a4c6-da4809e2cf27] Received unexpected event network-vif-plugged-cfa24a0c-4dce-4dae-a5d7-10ebfa1cc305 for instance with vm_state building and task_state spawning.
Nov 08 23:15:44 user nova-compute[75045]: DEBUG nova.compute.manager [None req-d1216da0-6db3-4a9e-91a1-9ee6dbd01a60 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] [instance: 4ae5ff6b-6f2c-4dfd-a4c6-da4809e2cf27] Instance event wait completed in 0 seconds for  {{(pid=75045) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 23:15:44 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-d1216da0-6db3-4a9e-91a1-9ee6dbd01a60 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] [instance: 4ae5ff6b-6f2c-4dfd-a4c6-da4809e2cf27] Guest created on hypervisor {{(pid=75045) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 23:15:44 user nova-compute[75045]: INFO nova.virt.libvirt.driver [-] [instance: 4ae5ff6b-6f2c-4dfd-a4c6-da4809e2cf27] Instance spawned successfully.
Nov 08 23:15:44 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-d1216da0-6db3-4a9e-91a1-9ee6dbd01a60 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] [instance: 4ae5ff6b-6f2c-4dfd-a4c6-da4809e2cf27] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75045) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 23:15:44 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-d1216da0-6db3-4a9e-91a1-9ee6dbd01a60 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] [instance: 4ae5ff6b-6f2c-4dfd-a4c6-da4809e2cf27] Found default for hw_cdrom_bus of ide {{(pid=75045) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 23:15:44 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-d1216da0-6db3-4a9e-91a1-9ee6dbd01a60 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] [instance: 4ae5ff6b-6f2c-4dfd-a4c6-da4809e2cf27] Found default for hw_disk_bus of virtio {{(pid=75045) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 23:15:44 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-d1216da0-6db3-4a9e-91a1-9ee6dbd01a60 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] [instance: 4ae5ff6b-6f2c-4dfd-a4c6-da4809e2cf27] Found default for hw_input_bus of None {{(pid=75045) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 23:15:44 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-d1216da0-6db3-4a9e-91a1-9ee6dbd01a60 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] [instance: 4ae5ff6b-6f2c-4dfd-a4c6-da4809e2cf27] Found default for hw_pointer_model of None {{(pid=75045) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 23:15:44 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-d1216da0-6db3-4a9e-91a1-9ee6dbd01a60 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] [instance: 4ae5ff6b-6f2c-4dfd-a4c6-da4809e2cf27] Found default for hw_video_model of virtio {{(pid=75045) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 23:15:44 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-d1216da0-6db3-4a9e-91a1-9ee6dbd01a60 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] [instance: 4ae5ff6b-6f2c-4dfd-a4c6-da4809e2cf27] Found default for hw_vif_model of virtio {{(pid=75045) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 23:15:45 user nova-compute[75045]: INFO nova.compute.manager [None req-d1216da0-6db3-4a9e-91a1-9ee6dbd01a60 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] [instance: 4ae5ff6b-6f2c-4dfd-a4c6-da4809e2cf27] Took 11.94 seconds to spawn the instance on the hypervisor.
Nov 08 23:15:45 user nova-compute[75045]: DEBUG nova.compute.manager [None req-d1216da0-6db3-4a9e-91a1-9ee6dbd01a60 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] [instance: 4ae5ff6b-6f2c-4dfd-a4c6-da4809e2cf27] Checking state {{(pid=75045) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 23:15:45 user nova-compute[75045]: INFO nova.compute.manager [None req-d1216da0-6db3-4a9e-91a1-9ee6dbd01a60 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] [instance: 4ae5ff6b-6f2c-4dfd-a4c6-da4809e2cf27] Took 12.90 seconds to build instance.
Nov 08 23:15:45 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-d1216da0-6db3-4a9e-91a1-9ee6dbd01a60 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Lock "4ae5ff6b-6f2c-4dfd-a4c6-da4809e2cf27" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.635s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:15:45 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:15:45 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:15:45 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:15:45 user nova-compute[75045]: DEBUG nova.network.neutron [None req-7f2e992a-40d7-4935-97df-19f5b57ac588 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] [instance: 0f21fcd3-ac5f-499e-9c34-82af806fda1d] Successfully created port: ab02704d-73c2-409c-9d43-1a087ebf369a {{(pid=75045) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 23:15:45 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:15:45 user nova-compute[75045]: DEBUG nova.network.neutron [req-caf160d4-95f9-4a05-b37d-6cec731bf78d req-107d0294-1520-481e-82ee-093619ee05a5 service nova] [instance: 09cf15e6-1cec-4c55-b7dd-4311b5f87d32] Updated VIF entry in instance network info cache for port a270cac5-2b8d-4eb7-a5ed-9338e6bb5e22. {{(pid=75045) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 23:15:45 user nova-compute[75045]: DEBUG nova.network.neutron [req-caf160d4-95f9-4a05-b37d-6cec731bf78d req-107d0294-1520-481e-82ee-093619ee05a5 service nova] [instance: 09cf15e6-1cec-4c55-b7dd-4311b5f87d32] Updating instance_info_cache with network_info: [{"id": "a270cac5-2b8d-4eb7-a5ed-9338e6bb5e22", "address": "fa:16:3e:3e:0e:1d", "network": {"id": "8137fd46-49da-40ca-81e8-4ad6984ee6ae", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-668291672-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec0b8a91a6ba43e6836d226ba9528100", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa270cac5-2b", "ovs_interfaceid": "a270cac5-2b8d-4eb7-a5ed-9338e6bb5e22", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75045) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 23:15:45 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-caf160d4-95f9-4a05-b37d-6cec731bf78d req-107d0294-1520-481e-82ee-093619ee05a5 service nova] Releasing lock "refresh_cache-09cf15e6-1cec-4c55-b7dd-4311b5f87d32" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 23:15:45 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:15:45 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:15:46 user nova-compute[75045]: DEBUG nova.compute.manager [req-b1d32861-2cef-49e6-839f-695231d3b9bb req-636c3b49-1775-425b-84a1-2d6c3affd390 service nova] [instance: 4ae5ff6b-6f2c-4dfd-a4c6-da4809e2cf27] Received event network-vif-plugged-cfa24a0c-4dce-4dae-a5d7-10ebfa1cc305 {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:15:46 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-b1d32861-2cef-49e6-839f-695231d3b9bb req-636c3b49-1775-425b-84a1-2d6c3affd390 service nova] Acquiring lock "4ae5ff6b-6f2c-4dfd-a4c6-da4809e2cf27-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:15:46 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-b1d32861-2cef-49e6-839f-695231d3b9bb req-636c3b49-1775-425b-84a1-2d6c3affd390 service nova] Lock "4ae5ff6b-6f2c-4dfd-a4c6-da4809e2cf27-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:15:46 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-b1d32861-2cef-49e6-839f-695231d3b9bb req-636c3b49-1775-425b-84a1-2d6c3affd390 service nova] Lock "4ae5ff6b-6f2c-4dfd-a4c6-da4809e2cf27-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:15:46 user nova-compute[75045]: DEBUG nova.compute.manager [req-b1d32861-2cef-49e6-839f-695231d3b9bb req-636c3b49-1775-425b-84a1-2d6c3affd390 service nova] [instance: 4ae5ff6b-6f2c-4dfd-a4c6-da4809e2cf27] No waiting events found dispatching network-vif-plugged-cfa24a0c-4dce-4dae-a5d7-10ebfa1cc305 {{(pid=75045) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 23:15:46 user nova-compute[75045]: WARNING nova.compute.manager [req-b1d32861-2cef-49e6-839f-695231d3b9bb req-636c3b49-1775-425b-84a1-2d6c3affd390 service nova] [instance: 4ae5ff6b-6f2c-4dfd-a4c6-da4809e2cf27] Received unexpected event network-vif-plugged-cfa24a0c-4dce-4dae-a5d7-10ebfa1cc305 for instance with vm_state active and task_state None.
Nov 08 23:15:47 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:15:48 user nova-compute[75045]: DEBUG nova.network.neutron [None req-7f2e992a-40d7-4935-97df-19f5b57ac588 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] [instance: 0f21fcd3-ac5f-499e-9c34-82af806fda1d] Successfully updated port: ab02704d-73c2-409c-9d43-1a087ebf369a {{(pid=75045) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 23:15:48 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-7f2e992a-40d7-4935-97df-19f5b57ac588 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Acquiring lock "refresh_cache-0f21fcd3-ac5f-499e-9c34-82af806fda1d" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 23:15:48 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-7f2e992a-40d7-4935-97df-19f5b57ac588 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Acquired lock "refresh_cache-0f21fcd3-ac5f-499e-9c34-82af806fda1d" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 23:15:48 user nova-compute[75045]: DEBUG nova.network.neutron [None req-7f2e992a-40d7-4935-97df-19f5b57ac588 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] [instance: 0f21fcd3-ac5f-499e-9c34-82af806fda1d] Building network info cache for instance {{(pid=75045) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 23:15:48 user nova-compute[75045]: DEBUG nova.compute.manager [req-01bc17de-5f3c-4541-a79c-f74dad182093 req-0f630566-127c-4730-97fa-db3a46b2ffcf service nova] [instance: 0f21fcd3-ac5f-499e-9c34-82af806fda1d] Received event network-changed-ab02704d-73c2-409c-9d43-1a087ebf369a {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:15:48 user nova-compute[75045]: DEBUG nova.compute.manager [req-01bc17de-5f3c-4541-a79c-f74dad182093 req-0f630566-127c-4730-97fa-db3a46b2ffcf service nova] [instance: 0f21fcd3-ac5f-499e-9c34-82af806fda1d] Refreshing instance network info cache due to event network-changed-ab02704d-73c2-409c-9d43-1a087ebf369a. {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 23:15:48 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-01bc17de-5f3c-4541-a79c-f74dad182093 req-0f630566-127c-4730-97fa-db3a46b2ffcf service nova] Acquiring lock "refresh_cache-0f21fcd3-ac5f-499e-9c34-82af806fda1d" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 23:15:48 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:15:48 user nova-compute[75045]: DEBUG nova.compute.manager [None req-6698730b-209f-4bc5-8519-9b9d0571d902 tempest-DeleteServersTestJSON-1018435513 tempest-DeleteServersTestJSON-1018435513-project-member] [instance: 09cf15e6-1cec-4c55-b7dd-4311b5f87d32] Instance event wait completed in 0 seconds for  {{(pid=75045) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 23:15:48 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-6698730b-209f-4bc5-8519-9b9d0571d902 tempest-DeleteServersTestJSON-1018435513 tempest-DeleteServersTestJSON-1018435513-project-member] [instance: 09cf15e6-1cec-4c55-b7dd-4311b5f87d32] Guest created on hypervisor {{(pid=75045) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 23:15:48 user nova-compute[75045]: INFO nova.virt.libvirt.driver [-] [instance: 09cf15e6-1cec-4c55-b7dd-4311b5f87d32] Instance spawned successfully.
Nov 08 23:15:48 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-6698730b-209f-4bc5-8519-9b9d0571d902 tempest-DeleteServersTestJSON-1018435513 tempest-DeleteServersTestJSON-1018435513-project-member] [instance: 09cf15e6-1cec-4c55-b7dd-4311b5f87d32] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75045) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 23:15:48 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-6698730b-209f-4bc5-8519-9b9d0571d902 tempest-DeleteServersTestJSON-1018435513 tempest-DeleteServersTestJSON-1018435513-project-member] [instance: 09cf15e6-1cec-4c55-b7dd-4311b5f87d32] Found default for hw_cdrom_bus of ide {{(pid=75045) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 23:15:48 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-6698730b-209f-4bc5-8519-9b9d0571d902 tempest-DeleteServersTestJSON-1018435513 tempest-DeleteServersTestJSON-1018435513-project-member] [instance: 09cf15e6-1cec-4c55-b7dd-4311b5f87d32] Found default for hw_disk_bus of virtio {{(pid=75045) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 23:15:48 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-6698730b-209f-4bc5-8519-9b9d0571d902 tempest-DeleteServersTestJSON-1018435513 tempest-DeleteServersTestJSON-1018435513-project-member] [instance: 09cf15e6-1cec-4c55-b7dd-4311b5f87d32] Found default for hw_input_bus of None {{(pid=75045) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 23:15:48 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-6698730b-209f-4bc5-8519-9b9d0571d902 tempest-DeleteServersTestJSON-1018435513 tempest-DeleteServersTestJSON-1018435513-project-member] [instance: 09cf15e6-1cec-4c55-b7dd-4311b5f87d32] Found default for hw_pointer_model of None {{(pid=75045) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 23:15:48 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-6698730b-209f-4bc5-8519-9b9d0571d902 tempest-DeleteServersTestJSON-1018435513 tempest-DeleteServersTestJSON-1018435513-project-member] [instance: 09cf15e6-1cec-4c55-b7dd-4311b5f87d32] Found default for hw_video_model of virtio {{(pid=75045) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 23:15:48 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-6698730b-209f-4bc5-8519-9b9d0571d902 tempest-DeleteServersTestJSON-1018435513 tempest-DeleteServersTestJSON-1018435513-project-member] [instance: 09cf15e6-1cec-4c55-b7dd-4311b5f87d32] Found default for hw_vif_model of virtio {{(pid=75045) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 23:15:48 user nova-compute[75045]: DEBUG nova.network.neutron [None req-7f2e992a-40d7-4935-97df-19f5b57ac588 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] [instance: 0f21fcd3-ac5f-499e-9c34-82af806fda1d] Instance cache missing network info. {{(pid=75045) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 23:15:48 user nova-compute[75045]: INFO nova.compute.manager [None req-6698730b-209f-4bc5-8519-9b9d0571d902 tempest-DeleteServersTestJSON-1018435513 tempest-DeleteServersTestJSON-1018435513-project-member] [instance: 09cf15e6-1cec-4c55-b7dd-4311b5f87d32] Took 12.18 seconds to spawn the instance on the hypervisor.
Nov 08 23:15:48 user nova-compute[75045]: DEBUG nova.compute.manager [None req-6698730b-209f-4bc5-8519-9b9d0571d902 tempest-DeleteServersTestJSON-1018435513 tempest-DeleteServersTestJSON-1018435513-project-member] [instance: 09cf15e6-1cec-4c55-b7dd-4311b5f87d32] Checking state {{(pid=75045) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 23:15:48 user nova-compute[75045]: INFO nova.compute.manager [None req-6698730b-209f-4bc5-8519-9b9d0571d902 tempest-DeleteServersTestJSON-1018435513 tempest-DeleteServersTestJSON-1018435513-project-member] [instance: 09cf15e6-1cec-4c55-b7dd-4311b5f87d32] Took 13.09 seconds to build instance.
Nov 08 23:15:48 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-6698730b-209f-4bc5-8519-9b9d0571d902 tempest-DeleteServersTestJSON-1018435513 tempest-DeleteServersTestJSON-1018435513-project-member] Lock "09cf15e6-1cec-4c55-b7dd-4311b5f87d32" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.232s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:15:48 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:15:49 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:15:49 user nova-compute[75045]: DEBUG nova.network.neutron [None req-7f2e992a-40d7-4935-97df-19f5b57ac588 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] [instance: 0f21fcd3-ac5f-499e-9c34-82af806fda1d] Updating instance_info_cache with network_info: [{"id": "ab02704d-73c2-409c-9d43-1a087ebf369a", "address": "fa:16:3e:b3:b2:47", "network": {"id": "700b5784-d35b-45c0-a4d3-1ab8aa4c48aa", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-194469807-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e63623113f11463d9035bb990de43510", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab02704d-73", "ovs_interfaceid": "ab02704d-73c2-409c-9d43-1a087ebf369a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75045) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 23:15:49 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-7f2e992a-40d7-4935-97df-19f5b57ac588 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Releasing lock "refresh_cache-0f21fcd3-ac5f-499e-9c34-82af806fda1d" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 23:15:49 user nova-compute[75045]: DEBUG nova.compute.manager [None req-7f2e992a-40d7-4935-97df-19f5b57ac588 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] [instance: 0f21fcd3-ac5f-499e-9c34-82af806fda1d] Instance network_info: |[{"id": "ab02704d-73c2-409c-9d43-1a087ebf369a", "address": "fa:16:3e:b3:b2:47", "network": {"id": "700b5784-d35b-45c0-a4d3-1ab8aa4c48aa", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-194469807-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e63623113f11463d9035bb990de43510", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab02704d-73", "ovs_interfaceid": "ab02704d-73c2-409c-9d43-1a087ebf369a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75045) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 23:15:49 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-01bc17de-5f3c-4541-a79c-f74dad182093 req-0f630566-127c-4730-97fa-db3a46b2ffcf service nova] Acquired lock "refresh_cache-0f21fcd3-ac5f-499e-9c34-82af806fda1d" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 23:15:49 user nova-compute[75045]: DEBUG nova.network.neutron [req-01bc17de-5f3c-4541-a79c-f74dad182093 req-0f630566-127c-4730-97fa-db3a46b2ffcf service nova] [instance: 0f21fcd3-ac5f-499e-9c34-82af806fda1d] Refreshing network info cache for port ab02704d-73c2-409c-9d43-1a087ebf369a {{(pid=75045) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 23:15:49 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-7f2e992a-40d7-4935-97df-19f5b57ac588 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] [instance: 0f21fcd3-ac5f-499e-9c34-82af806fda1d] Start _get_guest_xml network_info=[{"id": "ab02704d-73c2-409c-9d43-1a087ebf369a", "address": "fa:16:3e:b3:b2:47", "network": {"id": "700b5784-d35b-45c0-a4d3-1ab8aa4c48aa", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-194469807-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e63623113f11463d9035bb990de43510", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab02704d-73", "ovs_interfaceid": "ab02704d-73c2-409c-9d43-1a087ebf369a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T23:11:54Z,direct_url=<?>,disk_format='qcow2',id=a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b1beba2cc4e7465ea249e2225fb494dc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T23:11:56Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'disk_bus': 'virtio', 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': 'a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75045) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 23:15:49 user nova-compute[75045]: WARNING nova.virt.libvirt.driver [None req-7f2e992a-40d7-4935-97df-19f5b57ac588 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 23:15:49 user nova-compute[75045]: WARNING nova.virt.libvirt.driver [None req-7f2e992a-40d7-4935-97df-19f5b57ac588 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 23:15:49 user nova-compute[75045]: DEBUG nova.virt.libvirt.host [None req-7f2e992a-40d7-4935-97df-19f5b57ac588 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75045) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 23:15:49 user nova-compute[75045]: DEBUG nova.virt.libvirt.host [None req-7f2e992a-40d7-4935-97df-19f5b57ac588 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] CPU controller missing on host. {{(pid=75045) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 23:15:49 user nova-compute[75045]: DEBUG nova.virt.libvirt.host [None req-7f2e992a-40d7-4935-97df-19f5b57ac588 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75045) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 23:15:49 user nova-compute[75045]: DEBUG nova.virt.libvirt.host [None req-7f2e992a-40d7-4935-97df-19f5b57ac588 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] CPU controller found on host. {{(pid=75045) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 23:15:49 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-7f2e992a-40d7-4935-97df-19f5b57ac588 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75045) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 23:15:49 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-7f2e992a-40d7-4935-97df-19f5b57ac588 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T23:11:41Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T23:11:54Z,direct_url=<?>,disk_format='qcow2',id=a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b1beba2cc4e7465ea249e2225fb494dc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T23:11:56Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75045) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 23:15:49 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-7f2e992a-40d7-4935-97df-19f5b57ac588 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Flavor limits 0:0:0 {{(pid=75045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 23:15:49 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-7f2e992a-40d7-4935-97df-19f5b57ac588 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Image limits 0:0:0 {{(pid=75045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 23:15:49 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-7f2e992a-40d7-4935-97df-19f5b57ac588 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Flavor pref 0:0:0 {{(pid=75045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 23:15:49 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-7f2e992a-40d7-4935-97df-19f5b57ac588 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Image pref 0:0:0 {{(pid=75045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 23:15:49 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-7f2e992a-40d7-4935-97df-19f5b57ac588 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 23:15:49 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-7f2e992a-40d7-4935-97df-19f5b57ac588 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75045) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 23:15:49 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-7f2e992a-40d7-4935-97df-19f5b57ac588 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75045) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 23:15:49 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-7f2e992a-40d7-4935-97df-19f5b57ac588 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Got 1 possible topologies {{(pid=75045) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 23:15:49 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-7f2e992a-40d7-4935-97df-19f5b57ac588 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75045) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 23:15:49 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-7f2e992a-40d7-4935-97df-19f5b57ac588 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75045) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 23:15:49 user nova-compute[75045]: DEBUG nova.virt.libvirt.vif [None req-7f2e992a-40d7-4935-97df-19f5b57ac588 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T23:15:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1980505455',display_name='tempest-ServerActionsTestOtherA-server-1980505455',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1980505455',id=3,image_ref='a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDODl/KmGTsZ/iebmo5xmCcXvI602I8HkxrrHYOCSHtu28wqdqp4sqz8GjX6RCkUTvwm3o1RrGN7CPAGp6yuNsTNNdTZNeJLiXbNPx6WnByfZzN9Q7qtNxToi4a9/5pZlg==',key_name='tempest-keypair-679582766',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e63623113f11463d9035bb990de43510',ramdisk_id='',reservation_id='r-szkzg0a8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-2056815713',owner_user_name='tempest-ServerActionsTestOtherA-2056815713-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T23:15:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='75fc508f268d4a569ad78598ff019c14',uuid=0f21fcd3-ac5f-499e-9c34-82af806fda1d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ab02704d-73c2-409c-9d43-1a087ebf369a", "address": "fa:16:3e:b3:b2:47", "network": {"id": "700b5784-d35b-45c0-a4d3-1ab8aa4c48aa", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-194469807-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e63623113f11463d9035bb990de43510", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab02704d-73", "ovs_interfaceid": "ab02704d-73c2-409c-9d43-1a087ebf369a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75045) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 23:15:49 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-7f2e992a-40d7-4935-97df-19f5b57ac588 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Converting VIF {"id": "ab02704d-73c2-409c-9d43-1a087ebf369a", "address": "fa:16:3e:b3:b2:47", "network": {"id": "700b5784-d35b-45c0-a4d3-1ab8aa4c48aa", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-194469807-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e63623113f11463d9035bb990de43510", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab02704d-73", "ovs_interfaceid": "ab02704d-73c2-409c-9d43-1a087ebf369a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 23:15:49 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-7f2e992a-40d7-4935-97df-19f5b57ac588 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b3:b2:47,bridge_name='br-int',has_traffic_filtering=True,id=ab02704d-73c2-409c-9d43-1a087ebf369a,network=Network(700b5784-d35b-45c0-a4d3-1ab8aa4c48aa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapab02704d-73') {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 23:15:49 user nova-compute[75045]: DEBUG nova.objects.instance [None req-7f2e992a-40d7-4935-97df-19f5b57ac588 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Lazy-loading 'pci_devices' on Instance uuid 0f21fcd3-ac5f-499e-9c34-82af806fda1d {{(pid=75045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 23:15:49 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-7f2e992a-40d7-4935-97df-19f5b57ac588 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] [instance: 0f21fcd3-ac5f-499e-9c34-82af806fda1d] End _get_guest_xml xml=<domain type="kvm">
Nov 08 23:15:49 user nova-compute[75045]:   <uuid>0f21fcd3-ac5f-499e-9c34-82af806fda1d</uuid>
Nov 08 23:15:49 user nova-compute[75045]:   <name>instance-00000003</name>
Nov 08 23:15:49 user nova-compute[75045]:   <memory>524288</memory>
Nov 08 23:15:49 user nova-compute[75045]:   <vcpu>1</vcpu>
Nov 08 23:15:49 user nova-compute[75045]:   <metadata>
Nov 08 23:15:49 user nova-compute[75045]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 23:15:49 user nova-compute[75045]:       <nova:package version="0.0.0"/>
Nov 08 23:15:49 user nova-compute[75045]:       <nova:name>tempest-ServerActionsTestOtherA-server-1980505455</nova:name>
Nov 08 23:15:49 user nova-compute[75045]:       <nova:creationTime>2023-11-08 23:15:49</nova:creationTime>
Nov 08 23:15:49 user nova-compute[75045]:       <nova:flavor name="m1.tiny">
Nov 08 23:15:49 user nova-compute[75045]:         <nova:memory>512</nova:memory>
Nov 08 23:15:49 user nova-compute[75045]:         <nova:disk>1</nova:disk>
Nov 08 23:15:49 user nova-compute[75045]:         <nova:swap>0</nova:swap>
Nov 08 23:15:49 user nova-compute[75045]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 23:15:49 user nova-compute[75045]:         <nova:vcpus>1</nova:vcpus>
Nov 08 23:15:49 user nova-compute[75045]:       </nova:flavor>
Nov 08 23:15:49 user nova-compute[75045]:       <nova:owner>
Nov 08 23:15:49 user nova-compute[75045]:         <nova:user uuid="75fc508f268d4a569ad78598ff019c14">tempest-ServerActionsTestOtherA-2056815713-project-member</nova:user>
Nov 08 23:15:49 user nova-compute[75045]:         <nova:project uuid="e63623113f11463d9035bb990de43510">tempest-ServerActionsTestOtherA-2056815713</nova:project>
Nov 08 23:15:49 user nova-compute[75045]:       </nova:owner>
Nov 08 23:15:49 user nova-compute[75045]:       <nova:root type="image" uuid="a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb"/>
Nov 08 23:15:49 user nova-compute[75045]:       <nova:ports>
Nov 08 23:15:49 user nova-compute[75045]:         <nova:port uuid="ab02704d-73c2-409c-9d43-1a087ebf369a">
Nov 08 23:15:49 user nova-compute[75045]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 08 23:15:49 user nova-compute[75045]:         </nova:port>
Nov 08 23:15:49 user nova-compute[75045]:       </nova:ports>
Nov 08 23:15:49 user nova-compute[75045]:     </nova:instance>
Nov 08 23:15:49 user nova-compute[75045]:   </metadata>
Nov 08 23:15:49 user nova-compute[75045]:   <sysinfo type="smbios">
Nov 08 23:15:49 user nova-compute[75045]:     <system>
Nov 08 23:15:49 user nova-compute[75045]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 23:15:49 user nova-compute[75045]:       <entry name="product">OpenStack Nova</entry>
Nov 08 23:15:49 user nova-compute[75045]:       <entry name="version">0.0.0</entry>
Nov 08 23:15:49 user nova-compute[75045]:       <entry name="serial">0f21fcd3-ac5f-499e-9c34-82af806fda1d</entry>
Nov 08 23:15:49 user nova-compute[75045]:       <entry name="uuid">0f21fcd3-ac5f-499e-9c34-82af806fda1d</entry>
Nov 08 23:15:49 user nova-compute[75045]:       <entry name="family">Virtual Machine</entry>
Nov 08 23:15:49 user nova-compute[75045]:     </system>
Nov 08 23:15:49 user nova-compute[75045]:   </sysinfo>
Nov 08 23:15:49 user nova-compute[75045]:   <os>
Nov 08 23:15:49 user nova-compute[75045]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 23:15:49 user nova-compute[75045]:     <boot dev="hd"/>
Nov 08 23:15:49 user nova-compute[75045]:     <smbios mode="sysinfo"/>
Nov 08 23:15:49 user nova-compute[75045]:   </os>
Nov 08 23:15:49 user nova-compute[75045]:   <features>
Nov 08 23:15:49 user nova-compute[75045]:     <acpi/>
Nov 08 23:15:49 user nova-compute[75045]:     <apic/>
Nov 08 23:15:49 user nova-compute[75045]:     <vmcoreinfo/>
Nov 08 23:15:49 user nova-compute[75045]:   </features>
Nov 08 23:15:49 user nova-compute[75045]:   <clock offset="utc">
Nov 08 23:15:49 user nova-compute[75045]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 23:15:49 user nova-compute[75045]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 23:15:49 user nova-compute[75045]:     <timer name="hpet" present="no"/>
Nov 08 23:15:49 user nova-compute[75045]:   </clock>
Nov 08 23:15:49 user nova-compute[75045]:   <cpu mode="custom" match="exact">
Nov 08 23:15:49 user nova-compute[75045]:     <model>Nehalem</model>
Nov 08 23:15:49 user nova-compute[75045]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 23:15:49 user nova-compute[75045]:   </cpu>
Nov 08 23:15:49 user nova-compute[75045]:   <devices>
Nov 08 23:15:49 user nova-compute[75045]:     <disk type="file" device="disk">
Nov 08 23:15:49 user nova-compute[75045]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 23:15:49 user nova-compute[75045]:       <source file="/opt/stack/data/nova/instances/0f21fcd3-ac5f-499e-9c34-82af806fda1d/disk"/>
Nov 08 23:15:49 user nova-compute[75045]:       <target dev="vda" bus="virtio"/>
Nov 08 23:15:49 user nova-compute[75045]:     </disk>
Nov 08 23:15:49 user nova-compute[75045]:     <interface type="ethernet">
Nov 08 23:15:49 user nova-compute[75045]:       <mac address="fa:16:3e:b3:b2:47"/>
Nov 08 23:15:49 user nova-compute[75045]:       <model type="virtio"/>
Nov 08 23:15:49 user nova-compute[75045]:       <mtu size="1442"/>
Nov 08 23:15:49 user nova-compute[75045]:       <target dev="tapab02704d-73"/>
Nov 08 23:15:49 user nova-compute[75045]:     </interface>
Nov 08 23:15:49 user nova-compute[75045]:     <serial type="pty">
Nov 08 23:15:49 user nova-compute[75045]:       <log file="/opt/stack/data/nova/instances/0f21fcd3-ac5f-499e-9c34-82af806fda1d/console.log" append="off"/>
Nov 08 23:15:49 user nova-compute[75045]:     </serial>
Nov 08 23:15:49 user nova-compute[75045]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 23:15:49 user nova-compute[75045]:     <video>
Nov 08 23:15:49 user nova-compute[75045]:       <model type="virtio"/>
Nov 08 23:15:49 user nova-compute[75045]:     </video>
Nov 08 23:15:49 user nova-compute[75045]:     <rng model="virtio">
Nov 08 23:15:49 user nova-compute[75045]:       <backend model="random">/dev/urandom</backend>
Nov 08 23:15:49 user nova-compute[75045]:     </rng>
Nov 08 23:15:49 user nova-compute[75045]:     <controller type="usb" index="0" model="none"/>
Nov 08 23:15:49 user nova-compute[75045]:     <memballoon model="virtio">
Nov 08 23:15:49 user nova-compute[75045]:       <stats period="10"/>
Nov 08 23:15:49 user nova-compute[75045]:     </memballoon>
Nov 08 23:15:49 user nova-compute[75045]:   </devices>
Nov 08 23:15:49 user nova-compute[75045]: </domain>
Nov 08 23:15:49 user nova-compute[75045]:  {{(pid=75045) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 23:15:49 user nova-compute[75045]: DEBUG nova.virt.libvirt.vif [None req-7f2e992a-40d7-4935-97df-19f5b57ac588 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T23:15:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1980505455',display_name='tempest-ServerActionsTestOtherA-server-1980505455',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1980505455',id=3,image_ref='a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDODl/KmGTsZ/iebmo5xmCcXvI602I8HkxrrHYOCSHtu28wqdqp4sqz8GjX6RCkUTvwm3o1RrGN7CPAGp6yuNsTNNdTZNeJLiXbNPx6WnByfZzN9Q7qtNxToi4a9/5pZlg==',key_name='tempest-keypair-679582766',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e63623113f11463d9035bb990de43510',ramdisk_id='',reservation_id='r-szkzg0a8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-2056815713',owner_user_name='tempest-ServerActionsTestOtherA-2056815713-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T23:15:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='75fc508f268d4a569ad78598ff019c14',uuid=0f21fcd3-ac5f-499e-9c34-82af806fda1d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ab02704d-73c2-409c-9d43-1a087ebf369a", "address": "fa:16:3e:b3:b2:47", "network": {"id": "700b5784-d35b-45c0-a4d3-1ab8aa4c48aa", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-194469807-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e63623113f11463d9035bb990de43510", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab02704d-73", "ovs_interfaceid": "ab02704d-73c2-409c-9d43-1a087ebf369a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75045) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 23:15:49 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-7f2e992a-40d7-4935-97df-19f5b57ac588 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Converting VIF {"id": "ab02704d-73c2-409c-9d43-1a087ebf369a", "address": "fa:16:3e:b3:b2:47", "network": {"id": "700b5784-d35b-45c0-a4d3-1ab8aa4c48aa", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-194469807-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e63623113f11463d9035bb990de43510", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab02704d-73", "ovs_interfaceid": "ab02704d-73c2-409c-9d43-1a087ebf369a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 23:15:49 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-7f2e992a-40d7-4935-97df-19f5b57ac588 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b3:b2:47,bridge_name='br-int',has_traffic_filtering=True,id=ab02704d-73c2-409c-9d43-1a087ebf369a,network=Network(700b5784-d35b-45c0-a4d3-1ab8aa4c48aa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapab02704d-73') {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 23:15:49 user nova-compute[75045]: DEBUG os_vif [None req-7f2e992a-40d7-4935-97df-19f5b57ac588 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b3:b2:47,bridge_name='br-int',has_traffic_filtering=True,id=ab02704d-73c2-409c-9d43-1a087ebf369a,network=Network(700b5784-d35b-45c0-a4d3-1ab8aa4c48aa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapab02704d-73') {{(pid=75045) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 23:15:49 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:15:49 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:15:49 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 23:15:49 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:15:49 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '81ffbd17-537f-5424-a260-d837d95bec76', '_type': 'linux-noop'}}, row=False) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:15:49 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:15:49 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 23:15:49 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:15:49 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapab02704d-73, may_exist=True, interface_attrs={}) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:15:49 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapab02704d-73, col_values=(('qos', UUID('55bce19c-b3dc-418e-81e5-83cdc9be408b')),), if_exists=True) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:15:49 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapab02704d-73, col_values=(('external_ids', {'iface-id': 'ab02704d-73c2-409c-9d43-1a087ebf369a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b3:b2:47', 'vm-uuid': '0f21fcd3-ac5f-499e-9c34-82af806fda1d'}),), if_exists=True) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:15:49 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:15:49 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 23:15:49 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:15:49 user nova-compute[75045]: INFO os_vif [None req-7f2e992a-40d7-4935-97df-19f5b57ac588 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b3:b2:47,bridge_name='br-int',has_traffic_filtering=True,id=ab02704d-73c2-409c-9d43-1a087ebf369a,network=Network(700b5784-d35b-45c0-a4d3-1ab8aa4c48aa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapab02704d-73')
Nov 08 23:15:49 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-7f2e992a-40d7-4935-97df-19f5b57ac588 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] No BDM found with device name vda, not building metadata. {{(pid=75045) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 23:15:49 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-7f2e992a-40d7-4935-97df-19f5b57ac588 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] No VIF found with MAC fa:16:3e:b3:b2:47, not building metadata {{(pid=75045) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 23:15:49 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:15:50 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:15:50 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:15:50 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:15:50 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:15:50 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:15:50 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:15:50 user nova-compute[75045]: DEBUG nova.network.neutron [req-01bc17de-5f3c-4541-a79c-f74dad182093 req-0f630566-127c-4730-97fa-db3a46b2ffcf service nova] [instance: 0f21fcd3-ac5f-499e-9c34-82af806fda1d] Updated VIF entry in instance network info cache for port ab02704d-73c2-409c-9d43-1a087ebf369a. {{(pid=75045) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 23:15:50 user nova-compute[75045]: DEBUG nova.network.neutron [req-01bc17de-5f3c-4541-a79c-f74dad182093 req-0f630566-127c-4730-97fa-db3a46b2ffcf service nova] [instance: 0f21fcd3-ac5f-499e-9c34-82af806fda1d] Updating instance_info_cache with network_info: [{"id": "ab02704d-73c2-409c-9d43-1a087ebf369a", "address": "fa:16:3e:b3:b2:47", "network": {"id": "700b5784-d35b-45c0-a4d3-1ab8aa4c48aa", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-194469807-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e63623113f11463d9035bb990de43510", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab02704d-73", "ovs_interfaceid": "ab02704d-73c2-409c-9d43-1a087ebf369a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75045) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 23:15:50 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-01bc17de-5f3c-4541-a79c-f74dad182093 req-0f630566-127c-4730-97fa-db3a46b2ffcf service nova] Releasing lock "refresh_cache-0f21fcd3-ac5f-499e-9c34-82af806fda1d" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 23:15:51 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:15:51 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:15:51 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:15:51 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:15:52 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:15:52 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:15:52 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:15:52 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:15:53 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:15:53 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:15:53 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:15:53 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:15:54 user nova-compute[75045]: DEBUG nova.compute.manager [None req-7f2e992a-40d7-4935-97df-19f5b57ac588 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] [instance: 0f21fcd3-ac5f-499e-9c34-82af806fda1d] Instance event wait completed in 0 seconds for  {{(pid=75045) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 23:15:54 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-7f2e992a-40d7-4935-97df-19f5b57ac588 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] [instance: 0f21fcd3-ac5f-499e-9c34-82af806fda1d] Guest created on hypervisor {{(pid=75045) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 23:15:54 user nova-compute[75045]: INFO nova.virt.libvirt.driver [-] [instance: 0f21fcd3-ac5f-499e-9c34-82af806fda1d] Instance spawned successfully.
Nov 08 23:15:54 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-7f2e992a-40d7-4935-97df-19f5b57ac588 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] [instance: 0f21fcd3-ac5f-499e-9c34-82af806fda1d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75045) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 23:15:54 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-7f2e992a-40d7-4935-97df-19f5b57ac588 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] [instance: 0f21fcd3-ac5f-499e-9c34-82af806fda1d] Found default for hw_cdrom_bus of ide {{(pid=75045) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 23:15:54 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-7f2e992a-40d7-4935-97df-19f5b57ac588 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] [instance: 0f21fcd3-ac5f-499e-9c34-82af806fda1d] Found default for hw_disk_bus of virtio {{(pid=75045) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 23:15:54 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-7f2e992a-40d7-4935-97df-19f5b57ac588 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] [instance: 0f21fcd3-ac5f-499e-9c34-82af806fda1d] Found default for hw_input_bus of None {{(pid=75045) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 23:15:54 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-7f2e992a-40d7-4935-97df-19f5b57ac588 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] [instance: 0f21fcd3-ac5f-499e-9c34-82af806fda1d] Found default for hw_pointer_model of None {{(pid=75045) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 23:15:54 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-7f2e992a-40d7-4935-97df-19f5b57ac588 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] [instance: 0f21fcd3-ac5f-499e-9c34-82af806fda1d] Found default for hw_video_model of virtio {{(pid=75045) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 23:15:54 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-7f2e992a-40d7-4935-97df-19f5b57ac588 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] [instance: 0f21fcd3-ac5f-499e-9c34-82af806fda1d] Found default for hw_vif_model of virtio {{(pid=75045) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 23:15:54 user nova-compute[75045]: DEBUG nova.compute.manager [req-389871b1-bb87-4f36-a509-65055942141a req-41c5d09e-c424-417b-9203-32f5125b6123 service nova] [instance: 09cf15e6-1cec-4c55-b7dd-4311b5f87d32] Received event network-vif-plugged-a270cac5-2b8d-4eb7-a5ed-9338e6bb5e22 {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:15:54 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-389871b1-bb87-4f36-a509-65055942141a req-41c5d09e-c424-417b-9203-32f5125b6123 service nova] Acquiring lock "09cf15e6-1cec-4c55-b7dd-4311b5f87d32-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:15:54 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-389871b1-bb87-4f36-a509-65055942141a req-41c5d09e-c424-417b-9203-32f5125b6123 service nova] Lock "09cf15e6-1cec-4c55-b7dd-4311b5f87d32-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.007s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:15:54 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-389871b1-bb87-4f36-a509-65055942141a req-41c5d09e-c424-417b-9203-32f5125b6123 service nova] Lock "09cf15e6-1cec-4c55-b7dd-4311b5f87d32-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:15:54 user nova-compute[75045]: DEBUG nova.compute.manager [req-389871b1-bb87-4f36-a509-65055942141a req-41c5d09e-c424-417b-9203-32f5125b6123 service nova] [instance: 09cf15e6-1cec-4c55-b7dd-4311b5f87d32] No waiting events found dispatching network-vif-plugged-a270cac5-2b8d-4eb7-a5ed-9338e6bb5e22 {{(pid=75045) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 23:15:54 user nova-compute[75045]: WARNING nova.compute.manager [req-389871b1-bb87-4f36-a509-65055942141a req-41c5d09e-c424-417b-9203-32f5125b6123 service nova] [instance: 09cf15e6-1cec-4c55-b7dd-4311b5f87d32] Received unexpected event network-vif-plugged-a270cac5-2b8d-4eb7-a5ed-9338e6bb5e22 for instance with vm_state active and task_state None.
Nov 08 23:15:54 user nova-compute[75045]: INFO nova.compute.manager [None req-7f2e992a-40d7-4935-97df-19f5b57ac588 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] [instance: 0f21fcd3-ac5f-499e-9c34-82af806fda1d] Took 11.24 seconds to spawn the instance on the hypervisor.
Nov 08 23:15:54 user nova-compute[75045]: DEBUG nova.compute.manager [None req-7f2e992a-40d7-4935-97df-19f5b57ac588 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] [instance: 0f21fcd3-ac5f-499e-9c34-82af806fda1d] Checking state {{(pid=75045) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 23:15:54 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:15:54 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:15:54 user nova-compute[75045]: INFO nova.compute.manager [None req-7f2e992a-40d7-4935-97df-19f5b57ac588 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] [instance: 0f21fcd3-ac5f-499e-9c34-82af806fda1d] Took 12.30 seconds to build instance.
Nov 08 23:15:54 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-7f2e992a-40d7-4935-97df-19f5b57ac588 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Lock "0f21fcd3-ac5f-499e-9c34-82af806fda1d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.472s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:15:55 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:15:56 user nova-compute[75045]: DEBUG nova.compute.manager [req-0af8d91f-de59-4baf-905c-e07c9a205815 req-ee893506-e964-4c8c-9eb5-350a59a4af4e service nova] [instance: 09cf15e6-1cec-4c55-b7dd-4311b5f87d32] Received event network-vif-plugged-a270cac5-2b8d-4eb7-a5ed-9338e6bb5e22 {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:15:56 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-0af8d91f-de59-4baf-905c-e07c9a205815 req-ee893506-e964-4c8c-9eb5-350a59a4af4e service nova] Acquiring lock "09cf15e6-1cec-4c55-b7dd-4311b5f87d32-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:15:56 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-0af8d91f-de59-4baf-905c-e07c9a205815 req-ee893506-e964-4c8c-9eb5-350a59a4af4e service nova] Lock "09cf15e6-1cec-4c55-b7dd-4311b5f87d32-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:15:56 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-0af8d91f-de59-4baf-905c-e07c9a205815 req-ee893506-e964-4c8c-9eb5-350a59a4af4e service nova] Lock "09cf15e6-1cec-4c55-b7dd-4311b5f87d32-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:15:56 user nova-compute[75045]: DEBUG nova.compute.manager [req-0af8d91f-de59-4baf-905c-e07c9a205815 req-ee893506-e964-4c8c-9eb5-350a59a4af4e service nova] [instance: 09cf15e6-1cec-4c55-b7dd-4311b5f87d32] No waiting events found dispatching network-vif-plugged-a270cac5-2b8d-4eb7-a5ed-9338e6bb5e22 {{(pid=75045) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 23:15:56 user nova-compute[75045]: WARNING nova.compute.manager [req-0af8d91f-de59-4baf-905c-e07c9a205815 req-ee893506-e964-4c8c-9eb5-350a59a4af4e service nova] [instance: 09cf15e6-1cec-4c55-b7dd-4311b5f87d32] Received unexpected event network-vif-plugged-a270cac5-2b8d-4eb7-a5ed-9338e6bb5e22 for instance with vm_state active and task_state None.
Nov 08 23:15:57 user nova-compute[75045]: DEBUG nova.compute.manager [req-e328f7ce-d7ba-41e2-b43f-5788fcdaf658 req-f2efd292-6486-4cde-a2a3-86488020653a service nova] [instance: 0f21fcd3-ac5f-499e-9c34-82af806fda1d] Received event network-vif-plugged-ab02704d-73c2-409c-9d43-1a087ebf369a {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:15:57 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-e328f7ce-d7ba-41e2-b43f-5788fcdaf658 req-f2efd292-6486-4cde-a2a3-86488020653a service nova] Acquiring lock "0f21fcd3-ac5f-499e-9c34-82af806fda1d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:15:57 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-e328f7ce-d7ba-41e2-b43f-5788fcdaf658 req-f2efd292-6486-4cde-a2a3-86488020653a service nova] Lock "0f21fcd3-ac5f-499e-9c34-82af806fda1d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:15:57 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-e328f7ce-d7ba-41e2-b43f-5788fcdaf658 req-f2efd292-6486-4cde-a2a3-86488020653a service nova] Lock "0f21fcd3-ac5f-499e-9c34-82af806fda1d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:15:57 user nova-compute[75045]: DEBUG nova.compute.manager [req-e328f7ce-d7ba-41e2-b43f-5788fcdaf658 req-f2efd292-6486-4cde-a2a3-86488020653a service nova] [instance: 0f21fcd3-ac5f-499e-9c34-82af806fda1d] No waiting events found dispatching network-vif-plugged-ab02704d-73c2-409c-9d43-1a087ebf369a {{(pid=75045) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 23:15:57 user nova-compute[75045]: WARNING nova.compute.manager [req-e328f7ce-d7ba-41e2-b43f-5788fcdaf658 req-f2efd292-6486-4cde-a2a3-86488020653a service nova] [instance: 0f21fcd3-ac5f-499e-9c34-82af806fda1d] Received unexpected event network-vif-plugged-ab02704d-73c2-409c-9d43-1a087ebf369a for instance with vm_state active and task_state None.
Nov 08 23:15:58 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:15:59 user nova-compute[75045]: DEBUG nova.compute.manager [req-40be7093-a0b1-4769-bb15-aaa1ef81600e req-2764743c-d8d1-41ea-ab63-ce38d575507e service nova] [instance: 0f21fcd3-ac5f-499e-9c34-82af806fda1d] Received event network-vif-plugged-ab02704d-73c2-409c-9d43-1a087ebf369a {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:15:59 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-40be7093-a0b1-4769-bb15-aaa1ef81600e req-2764743c-d8d1-41ea-ab63-ce38d575507e service nova] Acquiring lock "0f21fcd3-ac5f-499e-9c34-82af806fda1d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:15:59 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-40be7093-a0b1-4769-bb15-aaa1ef81600e req-2764743c-d8d1-41ea-ab63-ce38d575507e service nova] Lock "0f21fcd3-ac5f-499e-9c34-82af806fda1d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:15:59 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-40be7093-a0b1-4769-bb15-aaa1ef81600e req-2764743c-d8d1-41ea-ab63-ce38d575507e service nova] Lock "0f21fcd3-ac5f-499e-9c34-82af806fda1d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:15:59 user nova-compute[75045]: DEBUG nova.compute.manager [req-40be7093-a0b1-4769-bb15-aaa1ef81600e req-2764743c-d8d1-41ea-ab63-ce38d575507e service nova] [instance: 0f21fcd3-ac5f-499e-9c34-82af806fda1d] No waiting events found dispatching network-vif-plugged-ab02704d-73c2-409c-9d43-1a087ebf369a {{(pid=75045) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 23:15:59 user nova-compute[75045]: WARNING nova.compute.manager [req-40be7093-a0b1-4769-bb15-aaa1ef81600e req-2764743c-d8d1-41ea-ab63-ce38d575507e service nova] [instance: 0f21fcd3-ac5f-499e-9c34-82af806fda1d] Received unexpected event network-vif-plugged-ab02704d-73c2-409c-9d43-1a087ebf369a for instance with vm_state active and task_state None.
Nov 08 23:15:59 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:16:00 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:16:01 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:16:02 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-be169426-6821-480c-b591-4f9308b0015e tempest-AttachSCSIVolumeTestJSON-1576344526 tempest-AttachSCSIVolumeTestJSON-1576344526-project-member] Acquiring lock "b9bd3096-92eb-4aae-8619-2725ed9acc2b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:16:02 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-be169426-6821-480c-b591-4f9308b0015e tempest-AttachSCSIVolumeTestJSON-1576344526 tempest-AttachSCSIVolumeTestJSON-1576344526-project-member] Lock "b9bd3096-92eb-4aae-8619-2725ed9acc2b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:16:02 user nova-compute[75045]: DEBUG nova.compute.manager [None req-be169426-6821-480c-b591-4f9308b0015e tempest-AttachSCSIVolumeTestJSON-1576344526 tempest-AttachSCSIVolumeTestJSON-1576344526-project-member] [instance: b9bd3096-92eb-4aae-8619-2725ed9acc2b] Starting instance... {{(pid=75045) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 23:16:02 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-be169426-6821-480c-b591-4f9308b0015e tempest-AttachSCSIVolumeTestJSON-1576344526 tempest-AttachSCSIVolumeTestJSON-1576344526-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:16:02 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-be169426-6821-480c-b591-4f9308b0015e tempest-AttachSCSIVolumeTestJSON-1576344526 tempest-AttachSCSIVolumeTestJSON-1576344526-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:16:02 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-be169426-6821-480c-b591-4f9308b0015e tempest-AttachSCSIVolumeTestJSON-1576344526 tempest-AttachSCSIVolumeTestJSON-1576344526-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75045) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 23:16:02 user nova-compute[75045]: INFO nova.compute.claims [None req-be169426-6821-480c-b591-4f9308b0015e tempest-AttachSCSIVolumeTestJSON-1576344526 tempest-AttachSCSIVolumeTestJSON-1576344526-project-member] [instance: b9bd3096-92eb-4aae-8619-2725ed9acc2b] Claim successful on node user
Nov 08 23:16:03 user nova-compute[75045]: DEBUG nova.compute.provider_tree [None req-be169426-6821-480c-b591-4f9308b0015e tempest-AttachSCSIVolumeTestJSON-1576344526 tempest-AttachSCSIVolumeTestJSON-1576344526-project-member] Inventory has not changed in ProviderTree for provider: 62ba5f85-c74d-4b58-986e-d4197e813fd7 {{(pid=75045) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 23:16:03 user nova-compute[75045]: DEBUG nova.scheduler.client.report [None req-be169426-6821-480c-b591-4f9308b0015e tempest-AttachSCSIVolumeTestJSON-1576344526 tempest-AttachSCSIVolumeTestJSON-1576344526-project-member] Inventory has not changed for provider 62ba5f85-c74d-4b58-986e-d4197e813fd7 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75045) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 23:16:03 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-be169426-6821-480c-b591-4f9308b0015e tempest-AttachSCSIVolumeTestJSON-1576344526 tempest-AttachSCSIVolumeTestJSON-1576344526-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.650s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:16:03 user nova-compute[75045]: DEBUG nova.compute.manager [None req-be169426-6821-480c-b591-4f9308b0015e tempest-AttachSCSIVolumeTestJSON-1576344526 tempest-AttachSCSIVolumeTestJSON-1576344526-project-member] [instance: b9bd3096-92eb-4aae-8619-2725ed9acc2b] Start building networks asynchronously for instance. {{(pid=75045) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 23:16:03 user nova-compute[75045]: DEBUG nova.compute.manager [None req-be169426-6821-480c-b591-4f9308b0015e tempest-AttachSCSIVolumeTestJSON-1576344526 tempest-AttachSCSIVolumeTestJSON-1576344526-project-member] [instance: b9bd3096-92eb-4aae-8619-2725ed9acc2b] Allocating IP information in the background. {{(pid=75045) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 23:16:03 user nova-compute[75045]: DEBUG nova.network.neutron [None req-be169426-6821-480c-b591-4f9308b0015e tempest-AttachSCSIVolumeTestJSON-1576344526 tempest-AttachSCSIVolumeTestJSON-1576344526-project-member] [instance: b9bd3096-92eb-4aae-8619-2725ed9acc2b] allocate_for_instance() {{(pid=75045) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 23:16:03 user nova-compute[75045]: INFO nova.virt.libvirt.driver [None req-be169426-6821-480c-b591-4f9308b0015e tempest-AttachSCSIVolumeTestJSON-1576344526 tempest-AttachSCSIVolumeTestJSON-1576344526-project-member] [instance: b9bd3096-92eb-4aae-8619-2725ed9acc2b] Ignoring supplied device name: /dev/sda. Libvirt can't honour user-supplied dev names
Nov 08 23:16:03 user nova-compute[75045]: DEBUG nova.compute.manager [None req-be169426-6821-480c-b591-4f9308b0015e tempest-AttachSCSIVolumeTestJSON-1576344526 tempest-AttachSCSIVolumeTestJSON-1576344526-project-member] [instance: b9bd3096-92eb-4aae-8619-2725ed9acc2b] Start building block device mappings for instance. {{(pid=75045) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 23:16:03 user nova-compute[75045]: DEBUG nova.policy [None req-be169426-6821-480c-b591-4f9308b0015e tempest-AttachSCSIVolumeTestJSON-1576344526 tempest-AttachSCSIVolumeTestJSON-1576344526-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3579fcc0ca4d46dbb6f04ed8f3962ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8623aaa12b0b44928ef7391a460fcfe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75045) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 23:16:03 user nova-compute[75045]: DEBUG nova.compute.manager [None req-be169426-6821-480c-b591-4f9308b0015e tempest-AttachSCSIVolumeTestJSON-1576344526 tempest-AttachSCSIVolumeTestJSON-1576344526-project-member] [instance: b9bd3096-92eb-4aae-8619-2725ed9acc2b] Start spawning the instance on the hypervisor. {{(pid=75045) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 23:16:03 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-be169426-6821-480c-b591-4f9308b0015e tempest-AttachSCSIVolumeTestJSON-1576344526 tempest-AttachSCSIVolumeTestJSON-1576344526-project-member] [instance: b9bd3096-92eb-4aae-8619-2725ed9acc2b] Creating instance directory {{(pid=75045) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 23:16:03 user nova-compute[75045]: INFO nova.virt.libvirt.driver [None req-be169426-6821-480c-b591-4f9308b0015e tempest-AttachSCSIVolumeTestJSON-1576344526 tempest-AttachSCSIVolumeTestJSON-1576344526-project-member] [instance: b9bd3096-92eb-4aae-8619-2725ed9acc2b] Creating image(s)
Nov 08 23:16:03 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-be169426-6821-480c-b591-4f9308b0015e tempest-AttachSCSIVolumeTestJSON-1576344526 tempest-AttachSCSIVolumeTestJSON-1576344526-project-member] Acquiring lock "/opt/stack/data/nova/instances/b9bd3096-92eb-4aae-8619-2725ed9acc2b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:16:03 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-be169426-6821-480c-b591-4f9308b0015e tempest-AttachSCSIVolumeTestJSON-1576344526 tempest-AttachSCSIVolumeTestJSON-1576344526-project-member] Lock "/opt/stack/data/nova/instances/b9bd3096-92eb-4aae-8619-2725ed9acc2b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:16:03 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-be169426-6821-480c-b591-4f9308b0015e tempest-AttachSCSIVolumeTestJSON-1576344526 tempest-AttachSCSIVolumeTestJSON-1576344526-project-member] Lock "/opt/stack/data/nova/instances/b9bd3096-92eb-4aae-8619-2725ed9acc2b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:16:03 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-be169426-6821-480c-b591-4f9308b0015e tempest-AttachSCSIVolumeTestJSON-1576344526 tempest-AttachSCSIVolumeTestJSON-1576344526-project-member] Acquiring lock "fbc8816fee1dd209cdfd9e73c83a2f3b57e284bb" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:16:03 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-be169426-6821-480c-b591-4f9308b0015e tempest-AttachSCSIVolumeTestJSON-1576344526 tempest-AttachSCSIVolumeTestJSON-1576344526-project-member] Lock "fbc8816fee1dd209cdfd9e73c83a2f3b57e284bb" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:16:04 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-be169426-6821-480c-b591-4f9308b0015e tempest-AttachSCSIVolumeTestJSON-1576344526 tempest-AttachSCSIVolumeTestJSON-1576344526-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fbc8816fee1dd209cdfd9e73c83a2f3b57e284bb.part --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:16:04 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-be169426-6821-480c-b591-4f9308b0015e tempest-AttachSCSIVolumeTestJSON-1576344526 tempest-AttachSCSIVolumeTestJSON-1576344526-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fbc8816fee1dd209cdfd9e73c83a2f3b57e284bb.part --force-share --output=json" returned: 0 in 0.257s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:16:04 user nova-compute[75045]: DEBUG nova.virt.images [None req-be169426-6821-480c-b591-4f9308b0015e tempest-AttachSCSIVolumeTestJSON-1576344526 tempest-AttachSCSIVolumeTestJSON-1576344526-project-member] 7360a3b4-3739-4e8b-98be-8e9d960334e0 was qcow2, converting to raw {{(pid=75045) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 08 23:16:04 user nova-compute[75045]: DEBUG nova.privsep.utils [None req-be169426-6821-480c-b591-4f9308b0015e tempest-AttachSCSIVolumeTestJSON-1576344526 tempest-AttachSCSIVolumeTestJSON-1576344526-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75045) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 08 23:16:04 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-be169426-6821-480c-b591-4f9308b0015e tempest-AttachSCSIVolumeTestJSON-1576344526 tempest-AttachSCSIVolumeTestJSON-1576344526-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/fbc8816fee1dd209cdfd9e73c83a2f3b57e284bb.part /opt/stack/data/nova/instances/_base/fbc8816fee1dd209cdfd9e73c83a2f3b57e284bb.converted {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:16:04 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:16:04 user nova-compute[75045]: DEBUG nova.network.neutron [None req-be169426-6821-480c-b591-4f9308b0015e tempest-AttachSCSIVolumeTestJSON-1576344526 tempest-AttachSCSIVolumeTestJSON-1576344526-project-member] [instance: b9bd3096-92eb-4aae-8619-2725ed9acc2b] Successfully created port: aea70d63-158f-4f6e-ac36-1c342bd5be4d {{(pid=75045) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 23:16:04 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-be169426-6821-480c-b591-4f9308b0015e tempest-AttachSCSIVolumeTestJSON-1576344526 tempest-AttachSCSIVolumeTestJSON-1576344526-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/fbc8816fee1dd209cdfd9e73c83a2f3b57e284bb.part /opt/stack/data/nova/instances/_base/fbc8816fee1dd209cdfd9e73c83a2f3b57e284bb.converted" returned: 0 in 0.376s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:16:04 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-be169426-6821-480c-b591-4f9308b0015e tempest-AttachSCSIVolumeTestJSON-1576344526 tempest-AttachSCSIVolumeTestJSON-1576344526-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fbc8816fee1dd209cdfd9e73c83a2f3b57e284bb.converted --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:16:05 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-be169426-6821-480c-b591-4f9308b0015e tempest-AttachSCSIVolumeTestJSON-1576344526 tempest-AttachSCSIVolumeTestJSON-1576344526-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fbc8816fee1dd209cdfd9e73c83a2f3b57e284bb.converted --force-share --output=json" returned: 0 in 0.281s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:16:05 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-be169426-6821-480c-b591-4f9308b0015e tempest-AttachSCSIVolumeTestJSON-1576344526 tempest-AttachSCSIVolumeTestJSON-1576344526-project-member] Lock "fbc8816fee1dd209cdfd9e73c83a2f3b57e284bb" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.522s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:16:05 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-be169426-6821-480c-b591-4f9308b0015e tempest-AttachSCSIVolumeTestJSON-1576344526 tempest-AttachSCSIVolumeTestJSON-1576344526-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fbc8816fee1dd209cdfd9e73c83a2f3b57e284bb --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:16:05 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-be169426-6821-480c-b591-4f9308b0015e tempest-AttachSCSIVolumeTestJSON-1576344526 tempest-AttachSCSIVolumeTestJSON-1576344526-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fbc8816fee1dd209cdfd9e73c83a2f3b57e284bb --force-share --output=json" returned: 0 in 0.203s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:16:05 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-be169426-6821-480c-b591-4f9308b0015e tempest-AttachSCSIVolumeTestJSON-1576344526 tempest-AttachSCSIVolumeTestJSON-1576344526-project-member] Acquiring lock "fbc8816fee1dd209cdfd9e73c83a2f3b57e284bb" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:16:05 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-be169426-6821-480c-b591-4f9308b0015e tempest-AttachSCSIVolumeTestJSON-1576344526 tempest-AttachSCSIVolumeTestJSON-1576344526-project-member] Lock "fbc8816fee1dd209cdfd9e73c83a2f3b57e284bb" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:16:05 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-be169426-6821-480c-b591-4f9308b0015e tempest-AttachSCSIVolumeTestJSON-1576344526 tempest-AttachSCSIVolumeTestJSON-1576344526-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fbc8816fee1dd209cdfd9e73c83a2f3b57e284bb --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:16:05 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:16:05 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-be169426-6821-480c-b591-4f9308b0015e tempest-AttachSCSIVolumeTestJSON-1576344526 tempest-AttachSCSIVolumeTestJSON-1576344526-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fbc8816fee1dd209cdfd9e73c83a2f3b57e284bb --force-share --output=json" returned: 0 in 0.216s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:16:05 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-be169426-6821-480c-b591-4f9308b0015e tempest-AttachSCSIVolumeTestJSON-1576344526 tempest-AttachSCSIVolumeTestJSON-1576344526-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fbc8816fee1dd209cdfd9e73c83a2f3b57e284bb,backing_fmt=raw /opt/stack/data/nova/instances/b9bd3096-92eb-4aae-8619-2725ed9acc2b/disk 1073741824 {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:16:05 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-be169426-6821-480c-b591-4f9308b0015e tempest-AttachSCSIVolumeTestJSON-1576344526 tempest-AttachSCSIVolumeTestJSON-1576344526-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fbc8816fee1dd209cdfd9e73c83a2f3b57e284bb,backing_fmt=raw /opt/stack/data/nova/instances/b9bd3096-92eb-4aae-8619-2725ed9acc2b/disk 1073741824" returned: 0 in 0.063s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:16:05 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-be169426-6821-480c-b591-4f9308b0015e tempest-AttachSCSIVolumeTestJSON-1576344526 tempest-AttachSCSIVolumeTestJSON-1576344526-project-member] Lock "fbc8816fee1dd209cdfd9e73c83a2f3b57e284bb" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.289s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:16:05 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-be169426-6821-480c-b591-4f9308b0015e tempest-AttachSCSIVolumeTestJSON-1576344526 tempest-AttachSCSIVolumeTestJSON-1576344526-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fbc8816fee1dd209cdfd9e73c83a2f3b57e284bb --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:16:05 user nova-compute[75045]: DEBUG nova.network.neutron [None req-be169426-6821-480c-b591-4f9308b0015e tempest-AttachSCSIVolumeTestJSON-1576344526 tempest-AttachSCSIVolumeTestJSON-1576344526-project-member] [instance: b9bd3096-92eb-4aae-8619-2725ed9acc2b] Successfully updated port: aea70d63-158f-4f6e-ac36-1c342bd5be4d {{(pid=75045) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 23:16:05 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-be169426-6821-480c-b591-4f9308b0015e tempest-AttachSCSIVolumeTestJSON-1576344526 tempest-AttachSCSIVolumeTestJSON-1576344526-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fbc8816fee1dd209cdfd9e73c83a2f3b57e284bb --force-share --output=json" returned: 0 in 0.258s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:16:05 user nova-compute[75045]: DEBUG nova.virt.disk.api [None req-be169426-6821-480c-b591-4f9308b0015e tempest-AttachSCSIVolumeTestJSON-1576344526 tempest-AttachSCSIVolumeTestJSON-1576344526-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b9bd3096-92eb-4aae-8619-2725ed9acc2b/disk. size=1073741824 {{(pid=75045) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 23:16:05 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-be169426-6821-480c-b591-4f9308b0015e tempest-AttachSCSIVolumeTestJSON-1576344526 tempest-AttachSCSIVolumeTestJSON-1576344526-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9bd3096-92eb-4aae-8619-2725ed9acc2b/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:16:06 user nova-compute[75045]: DEBUG nova.compute.manager [req-7fc2618a-2838-4d1a-addc-0ceaced358f8 req-4b1b1fd9-1cb4-4ea2-9707-02cc74cfb831 service nova] [instance: b9bd3096-92eb-4aae-8619-2725ed9acc2b] Received event network-changed-aea70d63-158f-4f6e-ac36-1c342bd5be4d {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:16:06 user nova-compute[75045]: DEBUG nova.compute.manager [req-7fc2618a-2838-4d1a-addc-0ceaced358f8 req-4b1b1fd9-1cb4-4ea2-9707-02cc74cfb831 service nova] [instance: b9bd3096-92eb-4aae-8619-2725ed9acc2b] Refreshing instance network info cache due to event network-changed-aea70d63-158f-4f6e-ac36-1c342bd5be4d. {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 23:16:06 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-7fc2618a-2838-4d1a-addc-0ceaced358f8 req-4b1b1fd9-1cb4-4ea2-9707-02cc74cfb831 service nova] Acquiring lock "refresh_cache-b9bd3096-92eb-4aae-8619-2725ed9acc2b" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 23:16:06 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-7fc2618a-2838-4d1a-addc-0ceaced358f8 req-4b1b1fd9-1cb4-4ea2-9707-02cc74cfb831 service nova] Acquired lock "refresh_cache-b9bd3096-92eb-4aae-8619-2725ed9acc2b" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 23:16:06 user nova-compute[75045]: DEBUG nova.network.neutron [req-7fc2618a-2838-4d1a-addc-0ceaced358f8 req-4b1b1fd9-1cb4-4ea2-9707-02cc74cfb831 service nova] [instance: b9bd3096-92eb-4aae-8619-2725ed9acc2b] Refreshing network info cache for port aea70d63-158f-4f6e-ac36-1c342bd5be4d {{(pid=75045) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 23:16:06 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-be169426-6821-480c-b591-4f9308b0015e tempest-AttachSCSIVolumeTestJSON-1576344526 tempest-AttachSCSIVolumeTestJSON-1576344526-project-member] Acquiring lock "refresh_cache-b9bd3096-92eb-4aae-8619-2725ed9acc2b" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 23:16:06 user nova-compute[75045]: DEBUG nova.network.neutron [req-7fc2618a-2838-4d1a-addc-0ceaced358f8 req-4b1b1fd9-1cb4-4ea2-9707-02cc74cfb831 service nova] [instance: b9bd3096-92eb-4aae-8619-2725ed9acc2b] Instance cache missing network info. {{(pid=75045) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 23:16:06 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-be169426-6821-480c-b591-4f9308b0015e tempest-AttachSCSIVolumeTestJSON-1576344526 tempest-AttachSCSIVolumeTestJSON-1576344526-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9bd3096-92eb-4aae-8619-2725ed9acc2b/disk --force-share --output=json" returned: 0 in 0.358s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:16:06 user nova-compute[75045]: DEBUG nova.virt.disk.api [None req-be169426-6821-480c-b591-4f9308b0015e tempest-AttachSCSIVolumeTestJSON-1576344526 tempest-AttachSCSIVolumeTestJSON-1576344526-project-member] Cannot resize image /opt/stack/data/nova/instances/b9bd3096-92eb-4aae-8619-2725ed9acc2b/disk to a smaller size. {{(pid=75045) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 08 23:16:06 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-be169426-6821-480c-b591-4f9308b0015e tempest-AttachSCSIVolumeTestJSON-1576344526 tempest-AttachSCSIVolumeTestJSON-1576344526-project-member] [instance: b9bd3096-92eb-4aae-8619-2725ed9acc2b] Created local disks {{(pid=75045) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 23:16:06 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-be169426-6821-480c-b591-4f9308b0015e tempest-AttachSCSIVolumeTestJSON-1576344526 tempest-AttachSCSIVolumeTestJSON-1576344526-project-member] [instance: b9bd3096-92eb-4aae-8619-2725ed9acc2b] Ensure instance console log exists: /opt/stack/data/nova/instances/b9bd3096-92eb-4aae-8619-2725ed9acc2b/console.log {{(pid=75045) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 23:16:06 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-be169426-6821-480c-b591-4f9308b0015e tempest-AttachSCSIVolumeTestJSON-1576344526 tempest-AttachSCSIVolumeTestJSON-1576344526-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:16:06 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-be169426-6821-480c-b591-4f9308b0015e tempest-AttachSCSIVolumeTestJSON-1576344526 tempest-AttachSCSIVolumeTestJSON-1576344526-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:16:06 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-be169426-6821-480c-b591-4f9308b0015e tempest-AttachSCSIVolumeTestJSON-1576344526 tempest-AttachSCSIVolumeTestJSON-1576344526-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:16:06 user nova-compute[75045]: DEBUG nova.network.neutron [req-7fc2618a-2838-4d1a-addc-0ceaced358f8 req-4b1b1fd9-1cb4-4ea2-9707-02cc74cfb831 service nova] [instance: b9bd3096-92eb-4aae-8619-2725ed9acc2b] Updating instance_info_cache with network_info: [] {{(pid=75045) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 23:16:06 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-7fc2618a-2838-4d1a-addc-0ceaced358f8 req-4b1b1fd9-1cb4-4ea2-9707-02cc74cfb831 service nova] Releasing lock "refresh_cache-b9bd3096-92eb-4aae-8619-2725ed9acc2b" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 23:16:06 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-be169426-6821-480c-b591-4f9308b0015e tempest-AttachSCSIVolumeTestJSON-1576344526 tempest-AttachSCSIVolumeTestJSON-1576344526-project-member] Acquired lock "refresh_cache-b9bd3096-92eb-4aae-8619-2725ed9acc2b" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 23:16:06 user nova-compute[75045]: DEBUG nova.network.neutron [None req-be169426-6821-480c-b591-4f9308b0015e tempest-AttachSCSIVolumeTestJSON-1576344526 tempest-AttachSCSIVolumeTestJSON-1576344526-project-member] [instance: b9bd3096-92eb-4aae-8619-2725ed9acc2b] Building network info cache for instance {{(pid=75045) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 23:16:06 user nova-compute[75045]: DEBUG nova.network.neutron [None req-be169426-6821-480c-b591-4f9308b0015e tempest-AttachSCSIVolumeTestJSON-1576344526 tempest-AttachSCSIVolumeTestJSON-1576344526-project-member] [instance: b9bd3096-92eb-4aae-8619-2725ed9acc2b] Instance cache missing network info. {{(pid=75045) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 23:16:07 user nova-compute[75045]: DEBUG nova.network.neutron [None req-be169426-6821-480c-b591-4f9308b0015e tempest-AttachSCSIVolumeTestJSON-1576344526 tempest-AttachSCSIVolumeTestJSON-1576344526-project-member] [instance: b9bd3096-92eb-4aae-8619-2725ed9acc2b] Updating instance_info_cache with network_info: [{"id": "aea70d63-158f-4f6e-ac36-1c342bd5be4d", "address": "fa:16:3e:1e:64:12", "network": {"id": "c4c4a0db-a673-4145-852d-5ab102a81bf9", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-993346983-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8623aaa12b0b44928ef7391a460fcfe7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaea70d63-15", "ovs_interfaceid": "aea70d63-158f-4f6e-ac36-1c342bd5be4d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75045) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 23:16:07 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-3affb0f7-e0a0-4ae7-8009-13c232f58726 tempest-TaggedAttachmentsTest-1639503389 tempest-TaggedAttachmentsTest-1639503389-project-member] Acquiring lock "1cb1b440-0073-4a53-a0a2-e2781e021866" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:16:07 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-3affb0f7-e0a0-4ae7-8009-13c232f58726 tempest-TaggedAttachmentsTest-1639503389 tempest-TaggedAttachmentsTest-1639503389-project-member] Lock "1cb1b440-0073-4a53-a0a2-e2781e021866" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:16:07 user nova-compute[75045]: DEBUG nova.compute.manager [None req-3affb0f7-e0a0-4ae7-8009-13c232f58726 tempest-TaggedAttachmentsTest-1639503389 tempest-TaggedAttachmentsTest-1639503389-project-member] [instance: 1cb1b440-0073-4a53-a0a2-e2781e021866] Starting instance... {{(pid=75045) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 23:16:07 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-be169426-6821-480c-b591-4f9308b0015e tempest-AttachSCSIVolumeTestJSON-1576344526 tempest-AttachSCSIVolumeTestJSON-1576344526-project-member] Releasing lock "refresh_cache-b9bd3096-92eb-4aae-8619-2725ed9acc2b" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 23:16:07 user nova-compute[75045]: DEBUG nova.compute.manager [None req-be169426-6821-480c-b591-4f9308b0015e tempest-AttachSCSIVolumeTestJSON-1576344526 tempest-AttachSCSIVolumeTestJSON-1576344526-project-member] [instance: b9bd3096-92eb-4aae-8619-2725ed9acc2b] Instance network_info: |[{"id": "aea70d63-158f-4f6e-ac36-1c342bd5be4d", "address": "fa:16:3e:1e:64:12", "network": {"id": "c4c4a0db-a673-4145-852d-5ab102a81bf9", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-993346983-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8623aaa12b0b44928ef7391a460fcfe7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaea70d63-15", "ovs_interfaceid": "aea70d63-158f-4f6e-ac36-1c342bd5be4d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75045) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 23:16:07 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-be169426-6821-480c-b591-4f9308b0015e tempest-AttachSCSIVolumeTestJSON-1576344526 tempest-AttachSCSIVolumeTestJSON-1576344526-project-member] [instance: b9bd3096-92eb-4aae-8619-2725ed9acc2b] Start _get_guest_xml network_info=[{"id": "aea70d63-158f-4f6e-ac36-1c342bd5be4d", "address": "fa:16:3e:1e:64:12", "network": {"id": "c4c4a0db-a673-4145-852d-5ab102a81bf9", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-993346983-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8623aaa12b0b44928ef7391a460fcfe7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaea70d63-15", "ovs_interfaceid": "aea70d63-158f-4f6e-ac36-1c342bd5be4d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'scsi', 'cdrom_bus': 'scsi', 'mapping': {'root': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'scsi', 'dev': 'sdb', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T23:15:54Z,direct_url=<?>,disk_format='qcow2',id=7360a3b4-3739-4e8b-98be-8e9d960334e0,min_disk=0,min_ram=0,name='',owner='9cc95af28a9345aaa11d9c227c62255e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T23:15:58Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/sda', 'image': [{'size': 0, 'device_name': '/dev/sda', 'device_type': 'disk', 'guest_format': None, 'disk_bus': 'scsi', 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': '7360a3b4-3739-4e8b-98be-8e9d960334e0'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75045) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 23:16:07 user nova-compute[75045]: WARNING nova.virt.libvirt.driver [None req-be169426-6821-480c-b591-4f9308b0015e tempest-AttachSCSIVolumeTestJSON-1576344526 tempest-AttachSCSIVolumeTestJSON-1576344526-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 23:16:07 user nova-compute[75045]: WARNING nova.virt.libvirt.driver [None req-be169426-6821-480c-b591-4f9308b0015e tempest-AttachSCSIVolumeTestJSON-1576344526 tempest-AttachSCSIVolumeTestJSON-1576344526-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 23:16:07 user nova-compute[75045]: DEBUG nova.virt.libvirt.host [None req-be169426-6821-480c-b591-4f9308b0015e tempest-AttachSCSIVolumeTestJSON-1576344526 tempest-AttachSCSIVolumeTestJSON-1576344526-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75045) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 23:16:07 user nova-compute[75045]: DEBUG nova.virt.libvirt.host [None req-be169426-6821-480c-b591-4f9308b0015e tempest-AttachSCSIVolumeTestJSON-1576344526 tempest-AttachSCSIVolumeTestJSON-1576344526-project-member] CPU controller missing on host. {{(pid=75045) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 23:16:07 user nova-compute[75045]: DEBUG nova.virt.libvirt.host [None req-be169426-6821-480c-b591-4f9308b0015e tempest-AttachSCSIVolumeTestJSON-1576344526 tempest-AttachSCSIVolumeTestJSON-1576344526-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75045) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 23:16:07 user nova-compute[75045]: DEBUG nova.virt.libvirt.host [None req-be169426-6821-480c-b591-4f9308b0015e tempest-AttachSCSIVolumeTestJSON-1576344526 tempest-AttachSCSIVolumeTestJSON-1576344526-project-member] CPU controller found on host. {{(pid=75045) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 23:16:07 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-be169426-6821-480c-b591-4f9308b0015e tempest-AttachSCSIVolumeTestJSON-1576344526 tempest-AttachSCSIVolumeTestJSON-1576344526-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75045) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 23:16:07 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-be169426-6821-480c-b591-4f9308b0015e tempest-AttachSCSIVolumeTestJSON-1576344526 tempest-AttachSCSIVolumeTestJSON-1576344526-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T23:11:41Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T23:15:54Z,direct_url=<?>,disk_format='qcow2',id=7360a3b4-3739-4e8b-98be-8e9d960334e0,min_disk=0,min_ram=0,name='',owner='9cc95af28a9345aaa11d9c227c62255e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T23:15:58Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75045) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 23:16:07 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-be169426-6821-480c-b591-4f9308b0015e tempest-AttachSCSIVolumeTestJSON-1576344526 tempest-AttachSCSIVolumeTestJSON-1576344526-project-member] Flavor limits 0:0:0 {{(pid=75045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 23:16:07 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-be169426-6821-480c-b591-4f9308b0015e tempest-AttachSCSIVolumeTestJSON-1576344526 tempest-AttachSCSIVolumeTestJSON-1576344526-project-member] Image limits 0:0:0 {{(pid=75045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 23:16:07 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-be169426-6821-480c-b591-4f9308b0015e tempest-AttachSCSIVolumeTestJSON-1576344526 tempest-AttachSCSIVolumeTestJSON-1576344526-project-member] Flavor pref 0:0:0 {{(pid=75045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 23:16:07 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-be169426-6821-480c-b591-4f9308b0015e tempest-AttachSCSIVolumeTestJSON-1576344526 tempest-AttachSCSIVolumeTestJSON-1576344526-project-member] Image pref 0:0:0 {{(pid=75045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 23:16:07 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-be169426-6821-480c-b591-4f9308b0015e tempest-AttachSCSIVolumeTestJSON-1576344526 tempest-AttachSCSIVolumeTestJSON-1576344526-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 23:16:07 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-be169426-6821-480c-b591-4f9308b0015e tempest-AttachSCSIVolumeTestJSON-1576344526 tempest-AttachSCSIVolumeTestJSON-1576344526-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75045) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 23:16:07 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-be169426-6821-480c-b591-4f9308b0015e tempest-AttachSCSIVolumeTestJSON-1576344526 tempest-AttachSCSIVolumeTestJSON-1576344526-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75045) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 23:16:07 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-be169426-6821-480c-b591-4f9308b0015e tempest-AttachSCSIVolumeTestJSON-1576344526 tempest-AttachSCSIVolumeTestJSON-1576344526-project-member] Got 1 possible topologies {{(pid=75045) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 23:16:07 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-be169426-6821-480c-b591-4f9308b0015e tempest-AttachSCSIVolumeTestJSON-1576344526 tempest-AttachSCSIVolumeTestJSON-1576344526-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75045) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 23:16:07 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-be169426-6821-480c-b591-4f9308b0015e tempest-AttachSCSIVolumeTestJSON-1576344526 tempest-AttachSCSIVolumeTestJSON-1576344526-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75045) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 23:16:07 user nova-compute[75045]: DEBUG nova.virt.libvirt.vif [None req-be169426-6821-480c-b591-4f9308b0015e tempest-AttachSCSIVolumeTestJSON-1576344526 tempest-AttachSCSIVolumeTestJSON-1576344526-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T23:16:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-408021707',display_name='tempest-AttachSCSIVolumeTestJSON-server-408021707',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-408021707',id=4,image_ref='7360a3b4-3739-4e8b-98be-8e9d960334e0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMkusxQ2AIWt+q8cMtgxBO33WctNFiDwXbEZNqu4BBPA8YD6480ZXWebvyQxcoDq94VlU5EYWyi/TSp/ddm5krz+nTT/5O7uRcdrcOj3m+dMT9AVi9e6K7uWY/zixU3OiQ==',key_name='tempest-keypair-1133253416',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8623aaa12b0b44928ef7391a460fcfe7',ramdisk_id='',reservation_id='r-m1etkbx4',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7360a3b4-3739-4e8b-98be-8e9d960334e0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1576344526',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1576344526-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T23:16:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3579fcc0ca4d46dbb6f04ed8f3962ff9',uuid=b9bd3096-92eb-4aae-8619-2725ed9acc2b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "aea70d63-158f-4f6e-ac36-1c342bd5be4d", "address": "fa:16:3e:1e:64:12", "network": {"id": "c4c4a0db-a673-4145-852d-5ab102a81bf9", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-993346983-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8623aaa12b0b44928ef7391a460fcfe7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaea70d63-15", "ovs_interfaceid": "aea70d63-158f-4f6e-ac36-1c342bd5be4d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75045) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 23:16:07 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-be169426-6821-480c-b591-4f9308b0015e tempest-AttachSCSIVolumeTestJSON-1576344526 tempest-AttachSCSIVolumeTestJSON-1576344526-project-member] Converting VIF {"id": "aea70d63-158f-4f6e-ac36-1c342bd5be4d", "address": "fa:16:3e:1e:64:12", "network": {"id": "c4c4a0db-a673-4145-852d-5ab102a81bf9", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-993346983-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8623aaa12b0b44928ef7391a460fcfe7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaea70d63-15", "ovs_interfaceid": "aea70d63-158f-4f6e-ac36-1c342bd5be4d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 23:16:07 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-be169426-6821-480c-b591-4f9308b0015e tempest-AttachSCSIVolumeTestJSON-1576344526 tempest-AttachSCSIVolumeTestJSON-1576344526-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1e:64:12,bridge_name='br-int',has_traffic_filtering=True,id=aea70d63-158f-4f6e-ac36-1c342bd5be4d,network=Network(c4c4a0db-a673-4145-852d-5ab102a81bf9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaea70d63-15') {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 23:16:07 user nova-compute[75045]: DEBUG nova.objects.instance [None req-be169426-6821-480c-b591-4f9308b0015e tempest-AttachSCSIVolumeTestJSON-1576344526 tempest-AttachSCSIVolumeTestJSON-1576344526-project-member] Lazy-loading 'pci_devices' on Instance uuid b9bd3096-92eb-4aae-8619-2725ed9acc2b {{(pid=75045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 23:16:07 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-be169426-6821-480c-b591-4f9308b0015e tempest-AttachSCSIVolumeTestJSON-1576344526 tempest-AttachSCSIVolumeTestJSON-1576344526-project-member] [instance: b9bd3096-92eb-4aae-8619-2725ed9acc2b] End _get_guest_xml xml=<domain type="kvm">
Nov 08 23:16:07 user nova-compute[75045]:   <uuid>b9bd3096-92eb-4aae-8619-2725ed9acc2b</uuid>
Nov 08 23:16:07 user nova-compute[75045]:   <name>instance-00000004</name>
Nov 08 23:16:07 user nova-compute[75045]:   <memory>524288</memory>
Nov 08 23:16:07 user nova-compute[75045]:   <vcpu>1</vcpu>
Nov 08 23:16:07 user nova-compute[75045]:   <metadata>
Nov 08 23:16:07 user nova-compute[75045]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 23:16:07 user nova-compute[75045]:       <nova:package version="0.0.0"/>
Nov 08 23:16:07 user nova-compute[75045]:       <nova:name>tempest-AttachSCSIVolumeTestJSON-server-408021707</nova:name>
Nov 08 23:16:07 user nova-compute[75045]:       <nova:creationTime>2023-11-08 23:16:07</nova:creationTime>
Nov 08 23:16:07 user nova-compute[75045]:       <nova:flavor name="m1.tiny">
Nov 08 23:16:07 user nova-compute[75045]:         <nova:memory>512</nova:memory>
Nov 08 23:16:07 user nova-compute[75045]:         <nova:disk>1</nova:disk>
Nov 08 23:16:07 user nova-compute[75045]:         <nova:swap>0</nova:swap>
Nov 08 23:16:07 user nova-compute[75045]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 23:16:07 user nova-compute[75045]:         <nova:vcpus>1</nova:vcpus>
Nov 08 23:16:07 user nova-compute[75045]:       </nova:flavor>
Nov 08 23:16:07 user nova-compute[75045]:       <nova:owner>
Nov 08 23:16:07 user nova-compute[75045]:         <nova:user uuid="3579fcc0ca4d46dbb6f04ed8f3962ff9">tempest-AttachSCSIVolumeTestJSON-1576344526-project-member</nova:user>
Nov 08 23:16:07 user nova-compute[75045]:         <nova:project uuid="8623aaa12b0b44928ef7391a460fcfe7">tempest-AttachSCSIVolumeTestJSON-1576344526</nova:project>
Nov 08 23:16:07 user nova-compute[75045]:       </nova:owner>
Nov 08 23:16:07 user nova-compute[75045]:       <nova:root type="image" uuid="7360a3b4-3739-4e8b-98be-8e9d960334e0"/>
Nov 08 23:16:07 user nova-compute[75045]:       <nova:ports>
Nov 08 23:16:07 user nova-compute[75045]:         <nova:port uuid="aea70d63-158f-4f6e-ac36-1c342bd5be4d">
Nov 08 23:16:07 user nova-compute[75045]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 08 23:16:07 user nova-compute[75045]:         </nova:port>
Nov 08 23:16:07 user nova-compute[75045]:       </nova:ports>
Nov 08 23:16:07 user nova-compute[75045]:     </nova:instance>
Nov 08 23:16:07 user nova-compute[75045]:   </metadata>
Nov 08 23:16:07 user nova-compute[75045]:   <sysinfo type="smbios">
Nov 08 23:16:07 user nova-compute[75045]:     <system>
Nov 08 23:16:07 user nova-compute[75045]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 23:16:07 user nova-compute[75045]:       <entry name="product">OpenStack Nova</entry>
Nov 08 23:16:07 user nova-compute[75045]:       <entry name="version">0.0.0</entry>
Nov 08 23:16:07 user nova-compute[75045]:       <entry name="serial">b9bd3096-92eb-4aae-8619-2725ed9acc2b</entry>
Nov 08 23:16:07 user nova-compute[75045]:       <entry name="uuid">b9bd3096-92eb-4aae-8619-2725ed9acc2b</entry>
Nov 08 23:16:07 user nova-compute[75045]:       <entry name="family">Virtual Machine</entry>
Nov 08 23:16:07 user nova-compute[75045]:     </system>
Nov 08 23:16:07 user nova-compute[75045]:   </sysinfo>
Nov 08 23:16:07 user nova-compute[75045]:   <os>
Nov 08 23:16:07 user nova-compute[75045]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 23:16:07 user nova-compute[75045]:     <boot dev="hd"/>
Nov 08 23:16:07 user nova-compute[75045]:     <smbios mode="sysinfo"/>
Nov 08 23:16:07 user nova-compute[75045]:   </os>
Nov 08 23:16:07 user nova-compute[75045]:   <features>
Nov 08 23:16:07 user nova-compute[75045]:     <acpi/>
Nov 08 23:16:07 user nova-compute[75045]:     <apic/>
Nov 08 23:16:07 user nova-compute[75045]:     <vmcoreinfo/>
Nov 08 23:16:07 user nova-compute[75045]:   </features>
Nov 08 23:16:07 user nova-compute[75045]:   <clock offset="utc">
Nov 08 23:16:07 user nova-compute[75045]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 23:16:07 user nova-compute[75045]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 23:16:07 user nova-compute[75045]:     <timer name="hpet" present="no"/>
Nov 08 23:16:07 user nova-compute[75045]:   </clock>
Nov 08 23:16:07 user nova-compute[75045]:   <cpu mode="custom" match="exact">
Nov 08 23:16:07 user nova-compute[75045]:     <model>Nehalem</model>
Nov 08 23:16:07 user nova-compute[75045]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 23:16:07 user nova-compute[75045]:   </cpu>
Nov 08 23:16:07 user nova-compute[75045]:   <devices>
Nov 08 23:16:07 user nova-compute[75045]:     <disk type="file" device="disk">
Nov 08 23:16:07 user nova-compute[75045]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 23:16:07 user nova-compute[75045]:       <source file="/opt/stack/data/nova/instances/b9bd3096-92eb-4aae-8619-2725ed9acc2b/disk"/>
Nov 08 23:16:07 user nova-compute[75045]:       <target dev="sda" bus="scsi"/>
Nov 08 23:16:07 user nova-compute[75045]:       <address type="drive" controller="0" unit="0"/>
Nov 08 23:16:07 user nova-compute[75045]:     </disk>
Nov 08 23:16:07 user nova-compute[75045]:     <disk type="file" device="cdrom">
Nov 08 23:16:07 user nova-compute[75045]:       <driver name="qemu" type="raw" cache="none"/>
Nov 08 23:16:07 user nova-compute[75045]:       <source file="/opt/stack/data/nova/instances/b9bd3096-92eb-4aae-8619-2725ed9acc2b/disk.config"/>
Nov 08 23:16:07 user nova-compute[75045]:       <target dev="sdb" bus="scsi"/>
Nov 08 23:16:07 user nova-compute[75045]:       <address type="drive" controller="0" unit="1"/>
Nov 08 23:16:07 user nova-compute[75045]:     </disk>
Nov 08 23:16:07 user nova-compute[75045]:     <controller type="scsi" index="0" model="virtio-scsi"/>
Nov 08 23:16:07 user nova-compute[75045]:     <interface type="ethernet">
Nov 08 23:16:07 user nova-compute[75045]:       <mac address="fa:16:3e:1e:64:12"/>
Nov 08 23:16:07 user nova-compute[75045]:       <model type="virtio"/>
Nov 08 23:16:07 user nova-compute[75045]:       <mtu size="1442"/>
Nov 08 23:16:07 user nova-compute[75045]:       <target dev="tapaea70d63-15"/>
Nov 08 23:16:07 user nova-compute[75045]:     </interface>
Nov 08 23:16:07 user nova-compute[75045]:     <serial type="pty">
Nov 08 23:16:07 user nova-compute[75045]:       <log file="/opt/stack/data/nova/instances/b9bd3096-92eb-4aae-8619-2725ed9acc2b/console.log" append="off"/>
Nov 08 23:16:07 user nova-compute[75045]:     </serial>
Nov 08 23:16:07 user nova-compute[75045]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 23:16:07 user nova-compute[75045]:     <video>
Nov 08 23:16:07 user nova-compute[75045]:       <model type="virtio"/>
Nov 08 23:16:07 user nova-compute[75045]:     </video>
Nov 08 23:16:07 user nova-compute[75045]:     <rng model="virtio">
Nov 08 23:16:07 user nova-compute[75045]:       <backend model="random">/dev/urandom</backend>
Nov 08 23:16:07 user nova-compute[75045]:     </rng>
Nov 08 23:16:07 user nova-compute[75045]:     <controller type="usb" index="0" model="none"/>
Nov 08 23:16:07 user nova-compute[75045]:     <memballoon model="virtio">
Nov 08 23:16:07 user nova-compute[75045]:       <stats period="10"/>
Nov 08 23:16:07 user nova-compute[75045]:     </memballoon>
Nov 08 23:16:07 user nova-compute[75045]:   </devices>
Nov 08 23:16:07 user nova-compute[75045]: </domain>
Nov 08 23:16:07 user nova-compute[75045]:  {{(pid=75045) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 23:16:07 user nova-compute[75045]: DEBUG nova.virt.libvirt.vif [None req-be169426-6821-480c-b591-4f9308b0015e tempest-AttachSCSIVolumeTestJSON-1576344526 tempest-AttachSCSIVolumeTestJSON-1576344526-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T23:16:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-408021707',display_name='tempest-AttachSCSIVolumeTestJSON-server-408021707',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-408021707',id=4,image_ref='7360a3b4-3739-4e8b-98be-8e9d960334e0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMkusxQ2AIWt+q8cMtgxBO33WctNFiDwXbEZNqu4BBPA8YD6480ZXWebvyQxcoDq94VlU5EYWyi/TSp/ddm5krz+nTT/5O7uRcdrcOj3m+dMT9AVi9e6K7uWY/zixU3OiQ==',key_name='tempest-keypair-1133253416',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8623aaa12b0b44928ef7391a460fcfe7',ramdisk_id='',reservation_id='r-m1etkbx4',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7360a3b4-3739-4e8b-98be-8e9d960334e0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1576344526',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1576344526-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T23:16:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3579fcc0ca4d46dbb6f04ed8f3962ff9',uuid=b9bd3096-92eb-4aae-8619-2725ed9acc2b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "aea70d63-158f-4f6e-ac36-1c342bd5be4d", "address": "fa:16:3e:1e:64:12", "network": {"id": "c4c4a0db-a673-4145-852d-5ab102a81bf9", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-993346983-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8623aaa12b0b44928ef7391a460fcfe7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaea70d63-15", "ovs_interfaceid": "aea70d63-158f-4f6e-ac36-1c342bd5be4d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75045) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 23:16:07 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-be169426-6821-480c-b591-4f9308b0015e tempest-AttachSCSIVolumeTestJSON-1576344526 tempest-AttachSCSIVolumeTestJSON-1576344526-project-member] Converting VIF {"id": "aea70d63-158f-4f6e-ac36-1c342bd5be4d", "address": "fa:16:3e:1e:64:12", "network": {"id": "c4c4a0db-a673-4145-852d-5ab102a81bf9", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-993346983-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8623aaa12b0b44928ef7391a460fcfe7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaea70d63-15", "ovs_interfaceid": "aea70d63-158f-4f6e-ac36-1c342bd5be4d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 23:16:07 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-be169426-6821-480c-b591-4f9308b0015e tempest-AttachSCSIVolumeTestJSON-1576344526 tempest-AttachSCSIVolumeTestJSON-1576344526-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1e:64:12,bridge_name='br-int',has_traffic_filtering=True,id=aea70d63-158f-4f6e-ac36-1c342bd5be4d,network=Network(c4c4a0db-a673-4145-852d-5ab102a81bf9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaea70d63-15') {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 23:16:07 user nova-compute[75045]: DEBUG os_vif [None req-be169426-6821-480c-b591-4f9308b0015e tempest-AttachSCSIVolumeTestJSON-1576344526 tempest-AttachSCSIVolumeTestJSON-1576344526-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1e:64:12,bridge_name='br-int',has_traffic_filtering=True,id=aea70d63-158f-4f6e-ac36-1c342bd5be4d,network=Network(c4c4a0db-a673-4145-852d-5ab102a81bf9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaea70d63-15') {{(pid=75045) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 23:16:07 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:16:07 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:16:07 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 23:16:07 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:16:07 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '67e06072-6ac8-5319-95db-c375f45de5d8', '_type': 'linux-noop'}}, row=False) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:16:07 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:16:07 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:16:07 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:16:07 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapaea70d63-15, may_exist=True, interface_attrs={}) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:16:07 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapaea70d63-15, col_values=(('qos', UUID('02117c51-7f71-4096-841a-d479d78d2169')),), if_exists=True) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:16:07 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapaea70d63-15, col_values=(('external_ids', {'iface-id': 'aea70d63-158f-4f6e-ac36-1c342bd5be4d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1e:64:12', 'vm-uuid': 'b9bd3096-92eb-4aae-8619-2725ed9acc2b'}),), if_exists=True) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:16:07 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 23:16:07 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:16:07 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-3affb0f7-e0a0-4ae7-8009-13c232f58726 tempest-TaggedAttachmentsTest-1639503389 tempest-TaggedAttachmentsTest-1639503389-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:16:07 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-3affb0f7-e0a0-4ae7-8009-13c232f58726 tempest-TaggedAttachmentsTest-1639503389 tempest-TaggedAttachmentsTest-1639503389-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:16:07 user nova-compute[75045]: INFO os_vif [None req-be169426-6821-480c-b591-4f9308b0015e tempest-AttachSCSIVolumeTestJSON-1576344526 tempest-AttachSCSIVolumeTestJSON-1576344526-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1e:64:12,bridge_name='br-int',has_traffic_filtering=True,id=aea70d63-158f-4f6e-ac36-1c342bd5be4d,network=Network(c4c4a0db-a673-4145-852d-5ab102a81bf9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaea70d63-15')
Nov 08 23:16:07 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-3affb0f7-e0a0-4ae7-8009-13c232f58726 tempest-TaggedAttachmentsTest-1639503389 tempest-TaggedAttachmentsTest-1639503389-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75045) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 23:16:07 user nova-compute[75045]: INFO nova.compute.claims [None req-3affb0f7-e0a0-4ae7-8009-13c232f58726 tempest-TaggedAttachmentsTest-1639503389 tempest-TaggedAttachmentsTest-1639503389-project-member] [instance: 1cb1b440-0073-4a53-a0a2-e2781e021866] Claim successful on node user
Nov 08 23:16:07 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-be169426-6821-480c-b591-4f9308b0015e tempest-AttachSCSIVolumeTestJSON-1576344526 tempest-AttachSCSIVolumeTestJSON-1576344526-project-member] No BDM found with device name sda, not building metadata. {{(pid=75045) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 23:16:07 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-be169426-6821-480c-b591-4f9308b0015e tempest-AttachSCSIVolumeTestJSON-1576344526 tempest-AttachSCSIVolumeTestJSON-1576344526-project-member] No BDM found with device name sdb, not building metadata. {{(pid=75045) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 23:16:07 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-be169426-6821-480c-b591-4f9308b0015e tempest-AttachSCSIVolumeTestJSON-1576344526 tempest-AttachSCSIVolumeTestJSON-1576344526-project-member] No VIF found with MAC fa:16:3e:1e:64:12, not building metadata {{(pid=75045) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 23:16:07 user nova-compute[75045]: INFO nova.virt.libvirt.driver [None req-be169426-6821-480c-b591-4f9308b0015e tempest-AttachSCSIVolumeTestJSON-1576344526 tempest-AttachSCSIVolumeTestJSON-1576344526-project-member] [instance: b9bd3096-92eb-4aae-8619-2725ed9acc2b] Using config drive
Nov 08 23:16:07 user nova-compute[75045]: DEBUG nova.compute.provider_tree [None req-3affb0f7-e0a0-4ae7-8009-13c232f58726 tempest-TaggedAttachmentsTest-1639503389 tempest-TaggedAttachmentsTest-1639503389-project-member] Inventory has not changed in ProviderTree for provider: 62ba5f85-c74d-4b58-986e-d4197e813fd7 {{(pid=75045) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 23:16:07 user nova-compute[75045]: DEBUG nova.scheduler.client.report [None req-3affb0f7-e0a0-4ae7-8009-13c232f58726 tempest-TaggedAttachmentsTest-1639503389 tempest-TaggedAttachmentsTest-1639503389-project-member] Inventory has not changed for provider 62ba5f85-c74d-4b58-986e-d4197e813fd7 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75045) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 23:16:07 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-3affb0f7-e0a0-4ae7-8009-13c232f58726 tempest-TaggedAttachmentsTest-1639503389 tempest-TaggedAttachmentsTest-1639503389-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.452s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:16:07 user nova-compute[75045]: DEBUG nova.compute.manager [None req-3affb0f7-e0a0-4ae7-8009-13c232f58726 tempest-TaggedAttachmentsTest-1639503389 tempest-TaggedAttachmentsTest-1639503389-project-member] [instance: 1cb1b440-0073-4a53-a0a2-e2781e021866] Start building networks asynchronously for instance. {{(pid=75045) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 23:16:07 user nova-compute[75045]: INFO nova.virt.libvirt.driver [None req-be169426-6821-480c-b591-4f9308b0015e tempest-AttachSCSIVolumeTestJSON-1576344526 tempest-AttachSCSIVolumeTestJSON-1576344526-project-member] [instance: b9bd3096-92eb-4aae-8619-2725ed9acc2b] Creating config drive at /opt/stack/data/nova/instances/b9bd3096-92eb-4aae-8619-2725ed9acc2b/disk.config
Nov 08 23:16:07 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-be169426-6821-480c-b591-4f9308b0015e tempest-AttachSCSIVolumeTestJSON-1576344526 tempest-AttachSCSIVolumeTestJSON-1576344526-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/b9bd3096-92eb-4aae-8619-2725ed9acc2b/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpb23u5agq {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:16:07 user nova-compute[75045]: DEBUG nova.compute.manager [None req-3affb0f7-e0a0-4ae7-8009-13c232f58726 tempest-TaggedAttachmentsTest-1639503389 tempest-TaggedAttachmentsTest-1639503389-project-member] [instance: 1cb1b440-0073-4a53-a0a2-e2781e021866] Allocating IP information in the background. {{(pid=75045) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 23:16:07 user nova-compute[75045]: DEBUG nova.network.neutron [None req-3affb0f7-e0a0-4ae7-8009-13c232f58726 tempest-TaggedAttachmentsTest-1639503389 tempest-TaggedAttachmentsTest-1639503389-project-member] [instance: 1cb1b440-0073-4a53-a0a2-e2781e021866] allocate_for_instance() {{(pid=75045) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 23:16:07 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-be169426-6821-480c-b591-4f9308b0015e tempest-AttachSCSIVolumeTestJSON-1576344526 tempest-AttachSCSIVolumeTestJSON-1576344526-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/b9bd3096-92eb-4aae-8619-2725ed9acc2b/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpb23u5agq" returned: 0 in 0.066s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:16:07 user nova-compute[75045]: INFO nova.virt.libvirt.driver [None req-3affb0f7-e0a0-4ae7-8009-13c232f58726 tempest-TaggedAttachmentsTest-1639503389 tempest-TaggedAttachmentsTest-1639503389-project-member] [instance: 1cb1b440-0073-4a53-a0a2-e2781e021866] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 23:16:07 user nova-compute[75045]: DEBUG nova.compute.manager [None req-3affb0f7-e0a0-4ae7-8009-13c232f58726 tempest-TaggedAttachmentsTest-1639503389 tempest-TaggedAttachmentsTest-1639503389-project-member] [instance: 1cb1b440-0073-4a53-a0a2-e2781e021866] Start building block device mappings for instance. {{(pid=75045) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 23:16:08 user nova-compute[75045]: DEBUG nova.compute.manager [None req-3affb0f7-e0a0-4ae7-8009-13c232f58726 tempest-TaggedAttachmentsTest-1639503389 tempest-TaggedAttachmentsTest-1639503389-project-member] [instance: 1cb1b440-0073-4a53-a0a2-e2781e021866] Start spawning the instance on the hypervisor. {{(pid=75045) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 23:16:08 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-3affb0f7-e0a0-4ae7-8009-13c232f58726 tempest-TaggedAttachmentsTest-1639503389 tempest-TaggedAttachmentsTest-1639503389-project-member] [instance: 1cb1b440-0073-4a53-a0a2-e2781e021866] Creating instance directory {{(pid=75045) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 23:16:08 user nova-compute[75045]: INFO nova.virt.libvirt.driver [None req-3affb0f7-e0a0-4ae7-8009-13c232f58726 tempest-TaggedAttachmentsTest-1639503389 tempest-TaggedAttachmentsTest-1639503389-project-member] [instance: 1cb1b440-0073-4a53-a0a2-e2781e021866] Creating image(s)
Nov 08 23:16:08 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-3affb0f7-e0a0-4ae7-8009-13c232f58726 tempest-TaggedAttachmentsTest-1639503389 tempest-TaggedAttachmentsTest-1639503389-project-member] Acquiring lock "/opt/stack/data/nova/instances/1cb1b440-0073-4a53-a0a2-e2781e021866/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:16:08 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-3affb0f7-e0a0-4ae7-8009-13c232f58726 tempest-TaggedAttachmentsTest-1639503389 tempest-TaggedAttachmentsTest-1639503389-project-member] Lock "/opt/stack/data/nova/instances/1cb1b440-0073-4a53-a0a2-e2781e021866/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:16:08 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-3affb0f7-e0a0-4ae7-8009-13c232f58726 tempest-TaggedAttachmentsTest-1639503389 tempest-TaggedAttachmentsTest-1639503389-project-member] Lock "/opt/stack/data/nova/instances/1cb1b440-0073-4a53-a0a2-e2781e021866/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:16:08 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-3affb0f7-e0a0-4ae7-8009-13c232f58726 tempest-TaggedAttachmentsTest-1639503389 tempest-TaggedAttachmentsTest-1639503389-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b59f52a99fff51c56dd1edfb83892fb8f647f2f3 --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:16:08 user nova-compute[75045]: DEBUG nova.policy [None req-3affb0f7-e0a0-4ae7-8009-13c232f58726 tempest-TaggedAttachmentsTest-1639503389 tempest-TaggedAttachmentsTest-1639503389-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0c8d9cc387dc45d18ad1550ef6d3cfa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb18f0af92ec4de6a1fddb6c77ea030d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75045) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 23:16:08 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-3affb0f7-e0a0-4ae7-8009-13c232f58726 tempest-TaggedAttachmentsTest-1639503389 tempest-TaggedAttachmentsTest-1639503389-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b59f52a99fff51c56dd1edfb83892fb8f647f2f3 --force-share --output=json" returned: 0 in 0.249s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:16:08 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-3affb0f7-e0a0-4ae7-8009-13c232f58726 tempest-TaggedAttachmentsTest-1639503389 tempest-TaggedAttachmentsTest-1639503389-project-member] Acquiring lock "b59f52a99fff51c56dd1edfb83892fb8f647f2f3" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:16:08 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-3affb0f7-e0a0-4ae7-8009-13c232f58726 tempest-TaggedAttachmentsTest-1639503389 tempest-TaggedAttachmentsTest-1639503389-project-member] Lock "b59f52a99fff51c56dd1edfb83892fb8f647f2f3" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:16:08 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-3affb0f7-e0a0-4ae7-8009-13c232f58726 tempest-TaggedAttachmentsTest-1639503389 tempest-TaggedAttachmentsTest-1639503389-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b59f52a99fff51c56dd1edfb83892fb8f647f2f3 --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:16:08 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-3affb0f7-e0a0-4ae7-8009-13c232f58726 tempest-TaggedAttachmentsTest-1639503389 tempest-TaggedAttachmentsTest-1639503389-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b59f52a99fff51c56dd1edfb83892fb8f647f2f3 --force-share --output=json" returned: 0 in 0.211s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:16:08 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-3affb0f7-e0a0-4ae7-8009-13c232f58726 tempest-TaggedAttachmentsTest-1639503389 tempest-TaggedAttachmentsTest-1639503389-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b59f52a99fff51c56dd1edfb83892fb8f647f2f3,backing_fmt=raw /opt/stack/data/nova/instances/1cb1b440-0073-4a53-a0a2-e2781e021866/disk 1073741824 {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:16:08 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-3affb0f7-e0a0-4ae7-8009-13c232f58726 tempest-TaggedAttachmentsTest-1639503389 tempest-TaggedAttachmentsTest-1639503389-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b59f52a99fff51c56dd1edfb83892fb8f647f2f3,backing_fmt=raw /opt/stack/data/nova/instances/1cb1b440-0073-4a53-a0a2-e2781e021866/disk 1073741824" returned: 0 in 0.081s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:16:08 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-56afaf56-aa01-4413-89f2-23b32bd395cc tempest-TestVolumeSwap-1282852572 tempest-TestVolumeSwap-1282852572-project-member] Acquiring lock "fde91f7c-31e3-456c-b252-6ce37fa3b600" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:16:08 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-56afaf56-aa01-4413-89f2-23b32bd395cc tempest-TestVolumeSwap-1282852572 tempest-TestVolumeSwap-1282852572-project-member] Lock "fde91f7c-31e3-456c-b252-6ce37fa3b600" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:16:08 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-3affb0f7-e0a0-4ae7-8009-13c232f58726 tempest-TaggedAttachmentsTest-1639503389 tempest-TaggedAttachmentsTest-1639503389-project-member] Lock "b59f52a99fff51c56dd1edfb83892fb8f647f2f3" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.321s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:16:08 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-3affb0f7-e0a0-4ae7-8009-13c232f58726 tempest-TaggedAttachmentsTest-1639503389 tempest-TaggedAttachmentsTest-1639503389-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b59f52a99fff51c56dd1edfb83892fb8f647f2f3 --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:16:08 user nova-compute[75045]: DEBUG nova.compute.manager [None req-56afaf56-aa01-4413-89f2-23b32bd395cc tempest-TestVolumeSwap-1282852572 tempest-TestVolumeSwap-1282852572-project-member] [instance: fde91f7c-31e3-456c-b252-6ce37fa3b600] Starting instance... {{(pid=75045) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 23:16:08 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-56afaf56-aa01-4413-89f2-23b32bd395cc tempest-TestVolumeSwap-1282852572 tempest-TestVolumeSwap-1282852572-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:16:08 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-56afaf56-aa01-4413-89f2-23b32bd395cc tempest-TestVolumeSwap-1282852572 tempest-TestVolumeSwap-1282852572-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:16:08 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-56afaf56-aa01-4413-89f2-23b32bd395cc tempest-TestVolumeSwap-1282852572 tempest-TestVolumeSwap-1282852572-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75045) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 23:16:08 user nova-compute[75045]: INFO nova.compute.claims [None req-56afaf56-aa01-4413-89f2-23b32bd395cc tempest-TestVolumeSwap-1282852572 tempest-TestVolumeSwap-1282852572-project-member] [instance: fde91f7c-31e3-456c-b252-6ce37fa3b600] Claim successful on node user
Nov 08 23:16:08 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-3affb0f7-e0a0-4ae7-8009-13c232f58726 tempest-TaggedAttachmentsTest-1639503389 tempest-TaggedAttachmentsTest-1639503389-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b59f52a99fff51c56dd1edfb83892fb8f647f2f3 --force-share --output=json" returned: 0 in 0.262s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:16:08 user nova-compute[75045]: DEBUG nova.virt.disk.api [None req-3affb0f7-e0a0-4ae7-8009-13c232f58726 tempest-TaggedAttachmentsTest-1639503389 tempest-TaggedAttachmentsTest-1639503389-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1cb1b440-0073-4a53-a0a2-e2781e021866/disk. size=1073741824 {{(pid=75045) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 23:16:08 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-3affb0f7-e0a0-4ae7-8009-13c232f58726 tempest-TaggedAttachmentsTest-1639503389 tempest-TaggedAttachmentsTest-1639503389-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1cb1b440-0073-4a53-a0a2-e2781e021866/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:16:09 user nova-compute[75045]: DEBUG nova.network.neutron [None req-3affb0f7-e0a0-4ae7-8009-13c232f58726 tempest-TaggedAttachmentsTest-1639503389 tempest-TaggedAttachmentsTest-1639503389-project-member] [instance: 1cb1b440-0073-4a53-a0a2-e2781e021866] Successfully created port: 892284f7-b4b9-4b5b-82c7-62300cd8afb7 {{(pid=75045) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 23:16:09 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-3affb0f7-e0a0-4ae7-8009-13c232f58726 tempest-TaggedAttachmentsTest-1639503389 tempest-TaggedAttachmentsTest-1639503389-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1cb1b440-0073-4a53-a0a2-e2781e021866/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:16:09 user nova-compute[75045]: DEBUG nova.virt.disk.api [None req-3affb0f7-e0a0-4ae7-8009-13c232f58726 tempest-TaggedAttachmentsTest-1639503389 tempest-TaggedAttachmentsTest-1639503389-project-member] Cannot resize image /opt/stack/data/nova/instances/1cb1b440-0073-4a53-a0a2-e2781e021866/disk to a smaller size. {{(pid=75045) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 08 23:16:09 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-3affb0f7-e0a0-4ae7-8009-13c232f58726 tempest-TaggedAttachmentsTest-1639503389 tempest-TaggedAttachmentsTest-1639503389-project-member] [instance: 1cb1b440-0073-4a53-a0a2-e2781e021866] Created local disks {{(pid=75045) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 23:16:09 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-3affb0f7-e0a0-4ae7-8009-13c232f58726 tempest-TaggedAttachmentsTest-1639503389 tempest-TaggedAttachmentsTest-1639503389-project-member] [instance: 1cb1b440-0073-4a53-a0a2-e2781e021866] Ensure instance console log exists: /opt/stack/data/nova/instances/1cb1b440-0073-4a53-a0a2-e2781e021866/console.log {{(pid=75045) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 23:16:09 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-3affb0f7-e0a0-4ae7-8009-13c232f58726 tempest-TaggedAttachmentsTest-1639503389 tempest-TaggedAttachmentsTest-1639503389-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:16:09 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-3affb0f7-e0a0-4ae7-8009-13c232f58726 tempest-TaggedAttachmentsTest-1639503389 tempest-TaggedAttachmentsTest-1639503389-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:16:09 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-3affb0f7-e0a0-4ae7-8009-13c232f58726 tempest-TaggedAttachmentsTest-1639503389 tempest-TaggedAttachmentsTest-1639503389-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:16:09 user nova-compute[75045]: DEBUG nova.compute.provider_tree [None req-56afaf56-aa01-4413-89f2-23b32bd395cc tempest-TestVolumeSwap-1282852572 tempest-TestVolumeSwap-1282852572-project-member] Inventory has not changed in ProviderTree for provider: 62ba5f85-c74d-4b58-986e-d4197e813fd7 {{(pid=75045) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 23:16:09 user nova-compute[75045]: DEBUG nova.scheduler.client.report [None req-56afaf56-aa01-4413-89f2-23b32bd395cc tempest-TestVolumeSwap-1282852572 tempest-TestVolumeSwap-1282852572-project-member] Inventory has not changed for provider 62ba5f85-c74d-4b58-986e-d4197e813fd7 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75045) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 23:16:09 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-56afaf56-aa01-4413-89f2-23b32bd395cc tempest-TestVolumeSwap-1282852572 tempest-TestVolumeSwap-1282852572-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.484s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:16:09 user nova-compute[75045]: DEBUG nova.compute.manager [None req-56afaf56-aa01-4413-89f2-23b32bd395cc tempest-TestVolumeSwap-1282852572 tempest-TestVolumeSwap-1282852572-project-member] [instance: fde91f7c-31e3-456c-b252-6ce37fa3b600] Start building networks asynchronously for instance. {{(pid=75045) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 23:16:09 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:16:09 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:16:09 user nova-compute[75045]: DEBUG nova.compute.manager [None req-56afaf56-aa01-4413-89f2-23b32bd395cc tempest-TestVolumeSwap-1282852572 tempest-TestVolumeSwap-1282852572-project-member] [instance: fde91f7c-31e3-456c-b252-6ce37fa3b600] Allocating IP information in the background. {{(pid=75045) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 23:16:09 user nova-compute[75045]: DEBUG nova.network.neutron [None req-56afaf56-aa01-4413-89f2-23b32bd395cc tempest-TestVolumeSwap-1282852572 tempest-TestVolumeSwap-1282852572-project-member] [instance: fde91f7c-31e3-456c-b252-6ce37fa3b600] allocate_for_instance() {{(pid=75045) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 23:16:09 user nova-compute[75045]: INFO nova.virt.libvirt.driver [None req-56afaf56-aa01-4413-89f2-23b32bd395cc tempest-TestVolumeSwap-1282852572 tempest-TestVolumeSwap-1282852572-project-member] [instance: fde91f7c-31e3-456c-b252-6ce37fa3b600] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 23:16:09 user nova-compute[75045]: DEBUG nova.compute.manager [None req-56afaf56-aa01-4413-89f2-23b32bd395cc tempest-TestVolumeSwap-1282852572 tempest-TestVolumeSwap-1282852572-project-member] [instance: fde91f7c-31e3-456c-b252-6ce37fa3b600] Start building block device mappings for instance. {{(pid=75045) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 23:16:09 user nova-compute[75045]: DEBUG nova.policy [None req-56afaf56-aa01-4413-89f2-23b32bd395cc tempest-TestVolumeSwap-1282852572 tempest-TestVolumeSwap-1282852572-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'be84d5fb901848d5b5f2bd19c6bdf5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fc58c033ee9468fa80d2d84f19c2f4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75045) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 23:16:09 user nova-compute[75045]: DEBUG nova.compute.manager [None req-56afaf56-aa01-4413-89f2-23b32bd395cc tempest-TestVolumeSwap-1282852572 tempest-TestVolumeSwap-1282852572-project-member] [instance: fde91f7c-31e3-456c-b252-6ce37fa3b600] Start spawning the instance on the hypervisor. {{(pid=75045) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 23:16:09 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-56afaf56-aa01-4413-89f2-23b32bd395cc tempest-TestVolumeSwap-1282852572 tempest-TestVolumeSwap-1282852572-project-member] [instance: fde91f7c-31e3-456c-b252-6ce37fa3b600] Creating instance directory {{(pid=75045) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 23:16:09 user nova-compute[75045]: INFO nova.virt.libvirt.driver [None req-56afaf56-aa01-4413-89f2-23b32bd395cc tempest-TestVolumeSwap-1282852572 tempest-TestVolumeSwap-1282852572-project-member] [instance: fde91f7c-31e3-456c-b252-6ce37fa3b600] Creating image(s)
Nov 08 23:16:09 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-56afaf56-aa01-4413-89f2-23b32bd395cc tempest-TestVolumeSwap-1282852572 tempest-TestVolumeSwap-1282852572-project-member] Acquiring lock "/opt/stack/data/nova/instances/fde91f7c-31e3-456c-b252-6ce37fa3b600/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:16:09 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-56afaf56-aa01-4413-89f2-23b32bd395cc tempest-TestVolumeSwap-1282852572 tempest-TestVolumeSwap-1282852572-project-member] Lock "/opt/stack/data/nova/instances/fde91f7c-31e3-456c-b252-6ce37fa3b600/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:16:09 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-56afaf56-aa01-4413-89f2-23b32bd395cc tempest-TestVolumeSwap-1282852572 tempest-TestVolumeSwap-1282852572-project-member] Lock "/opt/stack/data/nova/instances/fde91f7c-31e3-456c-b252-6ce37fa3b600/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.015s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:16:09 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-56afaf56-aa01-4413-89f2-23b32bd395cc tempest-TestVolumeSwap-1282852572 tempest-TestVolumeSwap-1282852572-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b59f52a99fff51c56dd1edfb83892fb8f647f2f3 --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:16:10 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-56afaf56-aa01-4413-89f2-23b32bd395cc tempest-TestVolumeSwap-1282852572 tempest-TestVolumeSwap-1282852572-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b59f52a99fff51c56dd1edfb83892fb8f647f2f3 --force-share --output=json" returned: 0 in 0.260s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:16:10 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-56afaf56-aa01-4413-89f2-23b32bd395cc tempest-TestVolumeSwap-1282852572 tempest-TestVolumeSwap-1282852572-project-member] Acquiring lock "b59f52a99fff51c56dd1edfb83892fb8f647f2f3" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:16:10 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-56afaf56-aa01-4413-89f2-23b32bd395cc tempest-TestVolumeSwap-1282852572 tempest-TestVolumeSwap-1282852572-project-member] Lock "b59f52a99fff51c56dd1edfb83892fb8f647f2f3" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:16:10 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-56afaf56-aa01-4413-89f2-23b32bd395cc tempest-TestVolumeSwap-1282852572 tempest-TestVolumeSwap-1282852572-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b59f52a99fff51c56dd1edfb83892fb8f647f2f3 --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:16:10 user nova-compute[75045]: DEBUG nova.network.neutron [None req-3affb0f7-e0a0-4ae7-8009-13c232f58726 tempest-TaggedAttachmentsTest-1639503389 tempest-TaggedAttachmentsTest-1639503389-project-member] [instance: 1cb1b440-0073-4a53-a0a2-e2781e021866] Successfully updated port: 892284f7-b4b9-4b5b-82c7-62300cd8afb7 {{(pid=75045) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 23:16:10 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-3affb0f7-e0a0-4ae7-8009-13c232f58726 tempest-TaggedAttachmentsTest-1639503389 tempest-TaggedAttachmentsTest-1639503389-project-member] Acquiring lock "refresh_cache-1cb1b440-0073-4a53-a0a2-e2781e021866" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 23:16:10 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-3affb0f7-e0a0-4ae7-8009-13c232f58726 tempest-TaggedAttachmentsTest-1639503389 tempest-TaggedAttachmentsTest-1639503389-project-member] Acquired lock "refresh_cache-1cb1b440-0073-4a53-a0a2-e2781e021866" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 23:16:10 user nova-compute[75045]: DEBUG nova.network.neutron [None req-3affb0f7-e0a0-4ae7-8009-13c232f58726 tempest-TaggedAttachmentsTest-1639503389 tempest-TaggedAttachmentsTest-1639503389-project-member] [instance: 1cb1b440-0073-4a53-a0a2-e2781e021866] Building network info cache for instance {{(pid=75045) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 23:16:10 user nova-compute[75045]: DEBUG nova.compute.manager [req-1c3b0971-603c-4789-8b29-001197043384 req-20db4363-75f2-4465-be0d-04088f8edd99 service nova] [instance: 1cb1b440-0073-4a53-a0a2-e2781e021866] Received event network-changed-892284f7-b4b9-4b5b-82c7-62300cd8afb7 {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:16:10 user nova-compute[75045]: DEBUG nova.compute.manager [req-1c3b0971-603c-4789-8b29-001197043384 req-20db4363-75f2-4465-be0d-04088f8edd99 service nova] [instance: 1cb1b440-0073-4a53-a0a2-e2781e021866] Refreshing instance network info cache due to event network-changed-892284f7-b4b9-4b5b-82c7-62300cd8afb7. {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 23:16:10 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-1c3b0971-603c-4789-8b29-001197043384 req-20db4363-75f2-4465-be0d-04088f8edd99 service nova] Acquiring lock "refresh_cache-1cb1b440-0073-4a53-a0a2-e2781e021866" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 23:16:10 user nova-compute[75045]: DEBUG nova.network.neutron [None req-3affb0f7-e0a0-4ae7-8009-13c232f58726 tempest-TaggedAttachmentsTest-1639503389 tempest-TaggedAttachmentsTest-1639503389-project-member] [instance: 1cb1b440-0073-4a53-a0a2-e2781e021866] Instance cache missing network info. {{(pid=75045) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 23:16:10 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:16:10 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:16:10 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:16:10 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-56afaf56-aa01-4413-89f2-23b32bd395cc tempest-TestVolumeSwap-1282852572 tempest-TestVolumeSwap-1282852572-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b59f52a99fff51c56dd1edfb83892fb8f647f2f3 --force-share --output=json" returned: 0 in 0.273s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:16:10 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-56afaf56-aa01-4413-89f2-23b32bd395cc tempest-TestVolumeSwap-1282852572 tempest-TestVolumeSwap-1282852572-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b59f52a99fff51c56dd1edfb83892fb8f647f2f3,backing_fmt=raw /opt/stack/data/nova/instances/fde91f7c-31e3-456c-b252-6ce37fa3b600/disk 1073741824 {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:16:10 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:16:10 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-56afaf56-aa01-4413-89f2-23b32bd395cc tempest-TestVolumeSwap-1282852572 tempest-TestVolumeSwap-1282852572-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b59f52a99fff51c56dd1edfb83892fb8f647f2f3,backing_fmt=raw /opt/stack/data/nova/instances/fde91f7c-31e3-456c-b252-6ce37fa3b600/disk 1073741824" returned: 0 in 0.051s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:16:10 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-56afaf56-aa01-4413-89f2-23b32bd395cc tempest-TestVolumeSwap-1282852572 tempest-TestVolumeSwap-1282852572-project-member] Lock "b59f52a99fff51c56dd1edfb83892fb8f647f2f3" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.327s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:16:10 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-56afaf56-aa01-4413-89f2-23b32bd395cc tempest-TestVolumeSwap-1282852572 tempest-TestVolumeSwap-1282852572-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b59f52a99fff51c56dd1edfb83892fb8f647f2f3 --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:16:10 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-56afaf56-aa01-4413-89f2-23b32bd395cc tempest-TestVolumeSwap-1282852572 tempest-TestVolumeSwap-1282852572-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b59f52a99fff51c56dd1edfb83892fb8f647f2f3 --force-share --output=json" returned: 0 in 0.242s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:16:10 user nova-compute[75045]: DEBUG nova.virt.disk.api [None req-56afaf56-aa01-4413-89f2-23b32bd395cc tempest-TestVolumeSwap-1282852572 tempest-TestVolumeSwap-1282852572-project-member] Checking if we can resize image /opt/stack/data/nova/instances/fde91f7c-31e3-456c-b252-6ce37fa3b600/disk. size=1073741824 {{(pid=75045) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 23:16:10 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-56afaf56-aa01-4413-89f2-23b32bd395cc tempest-TestVolumeSwap-1282852572 tempest-TestVolumeSwap-1282852572-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fde91f7c-31e3-456c-b252-6ce37fa3b600/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:16:10 user nova-compute[75045]: DEBUG nova.network.neutron [None req-3affb0f7-e0a0-4ae7-8009-13c232f58726 tempest-TaggedAttachmentsTest-1639503389 tempest-TaggedAttachmentsTest-1639503389-project-member] [instance: 1cb1b440-0073-4a53-a0a2-e2781e021866] Updating instance_info_cache with network_info: [{"id": "892284f7-b4b9-4b5b-82c7-62300cd8afb7", "address": "fa:16:3e:e4:4d:f8", "network": {"id": "fa6f2c92-825d-46c6-a0ea-51f96da244cb", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-193868289-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb18f0af92ec4de6a1fddb6c77ea030d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap892284f7-b4", "ovs_interfaceid": "892284f7-b4b9-4b5b-82c7-62300cd8afb7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75045) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 23:16:10 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-3affb0f7-e0a0-4ae7-8009-13c232f58726 tempest-TaggedAttachmentsTest-1639503389 tempest-TaggedAttachmentsTest-1639503389-project-member] Releasing lock "refresh_cache-1cb1b440-0073-4a53-a0a2-e2781e021866" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 23:16:10 user nova-compute[75045]: DEBUG nova.compute.manager [None req-3affb0f7-e0a0-4ae7-8009-13c232f58726 tempest-TaggedAttachmentsTest-1639503389 tempest-TaggedAttachmentsTest-1639503389-project-member] [instance: 1cb1b440-0073-4a53-a0a2-e2781e021866] Instance network_info: |[{"id": "892284f7-b4b9-4b5b-82c7-62300cd8afb7", "address": "fa:16:3e:e4:4d:f8", "network": {"id": "fa6f2c92-825d-46c6-a0ea-51f96da244cb", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-193868289-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb18f0af92ec4de6a1fddb6c77ea030d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap892284f7-b4", "ovs_interfaceid": "892284f7-b4b9-4b5b-82c7-62300cd8afb7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75045) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 23:16:10 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-1c3b0971-603c-4789-8b29-001197043384 req-20db4363-75f2-4465-be0d-04088f8edd99 service nova] Acquired lock "refresh_cache-1cb1b440-0073-4a53-a0a2-e2781e021866" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 23:16:10 user nova-compute[75045]: DEBUG nova.network.neutron [req-1c3b0971-603c-4789-8b29-001197043384 req-20db4363-75f2-4465-be0d-04088f8edd99 service nova] [instance: 1cb1b440-0073-4a53-a0a2-e2781e021866] Refreshing network info cache for port 892284f7-b4b9-4b5b-82c7-62300cd8afb7 {{(pid=75045) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 23:16:10 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-3affb0f7-e0a0-4ae7-8009-13c232f58726 tempest-TaggedAttachmentsTest-1639503389 tempest-TaggedAttachmentsTest-1639503389-project-member] [instance: 1cb1b440-0073-4a53-a0a2-e2781e021866] Start _get_guest_xml network_info=[{"id": "892284f7-b4b9-4b5b-82c7-62300cd8afb7", "address": "fa:16:3e:e4:4d:f8", "network": {"id": "fa6f2c92-825d-46c6-a0ea-51f96da244cb", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-193868289-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb18f0af92ec4de6a1fddb6c77ea030d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap892284f7-b4", "ovs_interfaceid": "892284f7-b4b9-4b5b-82c7-62300cd8afb7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T23:11:54Z,direct_url=<?>,disk_format='qcow2',id=a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b1beba2cc4e7465ea249e2225fb494dc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T23:11:56Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'disk_bus': 'virtio', 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': 'a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75045) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 23:16:10 user nova-compute[75045]: WARNING nova.virt.libvirt.driver [None req-3affb0f7-e0a0-4ae7-8009-13c232f58726 tempest-TaggedAttachmentsTest-1639503389 tempest-TaggedAttachmentsTest-1639503389-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 23:16:10 user nova-compute[75045]: WARNING nova.virt.libvirt.driver [None req-3affb0f7-e0a0-4ae7-8009-13c232f58726 tempest-TaggedAttachmentsTest-1639503389 tempest-TaggedAttachmentsTest-1639503389-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 23:16:10 user nova-compute[75045]: DEBUG nova.virt.libvirt.host [None req-3affb0f7-e0a0-4ae7-8009-13c232f58726 tempest-TaggedAttachmentsTest-1639503389 tempest-TaggedAttachmentsTest-1639503389-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75045) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 23:16:10 user nova-compute[75045]: DEBUG nova.virt.libvirt.host [None req-3affb0f7-e0a0-4ae7-8009-13c232f58726 tempest-TaggedAttachmentsTest-1639503389 tempest-TaggedAttachmentsTest-1639503389-project-member] CPU controller missing on host. {{(pid=75045) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 23:16:10 user nova-compute[75045]: DEBUG nova.virt.libvirt.host [None req-3affb0f7-e0a0-4ae7-8009-13c232f58726 tempest-TaggedAttachmentsTest-1639503389 tempest-TaggedAttachmentsTest-1639503389-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75045) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 23:16:10 user nova-compute[75045]: DEBUG nova.virt.libvirt.host [None req-3affb0f7-e0a0-4ae7-8009-13c232f58726 tempest-TaggedAttachmentsTest-1639503389 tempest-TaggedAttachmentsTest-1639503389-project-member] CPU controller found on host. {{(pid=75045) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 23:16:10 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-3affb0f7-e0a0-4ae7-8009-13c232f58726 tempest-TaggedAttachmentsTest-1639503389 tempest-TaggedAttachmentsTest-1639503389-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75045) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 23:16:10 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-3affb0f7-e0a0-4ae7-8009-13c232f58726 tempest-TaggedAttachmentsTest-1639503389 tempest-TaggedAttachmentsTest-1639503389-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T23:11:41Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T23:11:54Z,direct_url=<?>,disk_format='qcow2',id=a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b1beba2cc4e7465ea249e2225fb494dc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T23:11:56Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75045) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 23:16:10 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-3affb0f7-e0a0-4ae7-8009-13c232f58726 tempest-TaggedAttachmentsTest-1639503389 tempest-TaggedAttachmentsTest-1639503389-project-member] Flavor limits 0:0:0 {{(pid=75045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 23:16:10 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-3affb0f7-e0a0-4ae7-8009-13c232f58726 tempest-TaggedAttachmentsTest-1639503389 tempest-TaggedAttachmentsTest-1639503389-project-member] Image limits 0:0:0 {{(pid=75045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 23:16:10 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-3affb0f7-e0a0-4ae7-8009-13c232f58726 tempest-TaggedAttachmentsTest-1639503389 tempest-TaggedAttachmentsTest-1639503389-project-member] Flavor pref 0:0:0 {{(pid=75045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 23:16:10 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-3affb0f7-e0a0-4ae7-8009-13c232f58726 tempest-TaggedAttachmentsTest-1639503389 tempest-TaggedAttachmentsTest-1639503389-project-member] Image pref 0:0:0 {{(pid=75045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 23:16:10 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-3affb0f7-e0a0-4ae7-8009-13c232f58726 tempest-TaggedAttachmentsTest-1639503389 tempest-TaggedAttachmentsTest-1639503389-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 23:16:10 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-3affb0f7-e0a0-4ae7-8009-13c232f58726 tempest-TaggedAttachmentsTest-1639503389 tempest-TaggedAttachmentsTest-1639503389-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75045) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 23:16:10 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-3affb0f7-e0a0-4ae7-8009-13c232f58726 tempest-TaggedAttachmentsTest-1639503389 tempest-TaggedAttachmentsTest-1639503389-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75045) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 23:16:10 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-3affb0f7-e0a0-4ae7-8009-13c232f58726 tempest-TaggedAttachmentsTest-1639503389 tempest-TaggedAttachmentsTest-1639503389-project-member] Got 1 possible topologies {{(pid=75045) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 23:16:10 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-3affb0f7-e0a0-4ae7-8009-13c232f58726 tempest-TaggedAttachmentsTest-1639503389 tempest-TaggedAttachmentsTest-1639503389-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75045) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 23:16:10 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-3affb0f7-e0a0-4ae7-8009-13c232f58726 tempest-TaggedAttachmentsTest-1639503389 tempest-TaggedAttachmentsTest-1639503389-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75045) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 23:16:10 user nova-compute[75045]: DEBUG nova.virt.libvirt.vif [None req-3affb0f7-e0a0-4ae7-8009-13c232f58726 tempest-TaggedAttachmentsTest-1639503389 tempest-TaggedAttachmentsTest-1639503389-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T23:16:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1008670319',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1008670319',id=5,image_ref='a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJHwrx1BGWhjjUX4+Byh1wjqwerHxYEs1Bi9i8sP+n0orNMkrqYiTdsqsEt8sTDzFkc1LBM09NOYtbQKa/c7KjqeCNDDUOdBi8LqOWMDeLuYXRRZIoptz+6bpxuTCZMmXg==',key_name='tempest-keypair-1418515873',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bb18f0af92ec4de6a1fddb6c77ea030d',ramdisk_id='',reservation_id='r-15oytm0c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-1639503389',owner_user_name='tempest-TaggedAttachmentsTest-1639503389-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T23:16:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0c8d9cc387dc45d18ad1550ef6d3cfa9',uuid=1cb1b440-0073-4a53-a0a2-e2781e021866,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "892284f7-b4b9-4b5b-82c7-62300cd8afb7", "address": "fa:16:3e:e4:4d:f8", "network": {"id": "fa6f2c92-825d-46c6-a0ea-51f96da244cb", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-193868289-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb18f0af92ec4de6a1fddb6c77ea030d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap892284f7-b4", "ovs_interfaceid": "892284f7-b4b9-4b5b-82c7-62300cd8afb7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75045) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 23:16:10 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-3affb0f7-e0a0-4ae7-8009-13c232f58726 tempest-TaggedAttachmentsTest-1639503389 tempest-TaggedAttachmentsTest-1639503389-project-member] Converting VIF {"id": "892284f7-b4b9-4b5b-82c7-62300cd8afb7", "address": "fa:16:3e:e4:4d:f8", "network": {"id": "fa6f2c92-825d-46c6-a0ea-51f96da244cb", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-193868289-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb18f0af92ec4de6a1fddb6c77ea030d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap892284f7-b4", "ovs_interfaceid": "892284f7-b4b9-4b5b-82c7-62300cd8afb7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 23:16:10 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-3affb0f7-e0a0-4ae7-8009-13c232f58726 tempest-TaggedAttachmentsTest-1639503389 tempest-TaggedAttachmentsTest-1639503389-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e4:4d:f8,bridge_name='br-int',has_traffic_filtering=True,id=892284f7-b4b9-4b5b-82c7-62300cd8afb7,network=Network(fa6f2c92-825d-46c6-a0ea-51f96da244cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap892284f7-b4') {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 23:16:10 user nova-compute[75045]: DEBUG nova.objects.instance [None req-3affb0f7-e0a0-4ae7-8009-13c232f58726 tempest-TaggedAttachmentsTest-1639503389 tempest-TaggedAttachmentsTest-1639503389-project-member] Lazy-loading 'pci_devices' on Instance uuid 1cb1b440-0073-4a53-a0a2-e2781e021866 {{(pid=75045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 23:16:10 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-56afaf56-aa01-4413-89f2-23b32bd395cc tempest-TestVolumeSwap-1282852572 tempest-TestVolumeSwap-1282852572-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fde91f7c-31e3-456c-b252-6ce37fa3b600/disk --force-share --output=json" returned: 0 in 0.261s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:16:10 user nova-compute[75045]: DEBUG nova.virt.disk.api [None req-56afaf56-aa01-4413-89f2-23b32bd395cc tempest-TestVolumeSwap-1282852572 tempest-TestVolumeSwap-1282852572-project-member] Cannot resize image /opt/stack/data/nova/instances/fde91f7c-31e3-456c-b252-6ce37fa3b600/disk to a smaller size. {{(pid=75045) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 08 23:16:10 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-56afaf56-aa01-4413-89f2-23b32bd395cc tempest-TestVolumeSwap-1282852572 tempest-TestVolumeSwap-1282852572-project-member] [instance: fde91f7c-31e3-456c-b252-6ce37fa3b600] Created local disks {{(pid=75045) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 23:16:10 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-56afaf56-aa01-4413-89f2-23b32bd395cc tempest-TestVolumeSwap-1282852572 tempest-TestVolumeSwap-1282852572-project-member] [instance: fde91f7c-31e3-456c-b252-6ce37fa3b600] Ensure instance console log exists: /opt/stack/data/nova/instances/fde91f7c-31e3-456c-b252-6ce37fa3b600/console.log {{(pid=75045) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 23:16:10 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-56afaf56-aa01-4413-89f2-23b32bd395cc tempest-TestVolumeSwap-1282852572 tempest-TestVolumeSwap-1282852572-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:16:10 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-56afaf56-aa01-4413-89f2-23b32bd395cc tempest-TestVolumeSwap-1282852572 tempest-TestVolumeSwap-1282852572-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:16:10 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-56afaf56-aa01-4413-89f2-23b32bd395cc tempest-TestVolumeSwap-1282852572 tempest-TestVolumeSwap-1282852572-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:16:11 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-3affb0f7-e0a0-4ae7-8009-13c232f58726 tempest-TaggedAttachmentsTest-1639503389 tempest-TaggedAttachmentsTest-1639503389-project-member] [instance: 1cb1b440-0073-4a53-a0a2-e2781e021866] End _get_guest_xml xml=<domain type="kvm">
Nov 08 23:16:11 user nova-compute[75045]:   <uuid>1cb1b440-0073-4a53-a0a2-e2781e021866</uuid>
Nov 08 23:16:11 user nova-compute[75045]:   <name>instance-00000005</name>
Nov 08 23:16:11 user nova-compute[75045]:   <memory>524288</memory>
Nov 08 23:16:11 user nova-compute[75045]:   <vcpu>1</vcpu>
Nov 08 23:16:11 user nova-compute[75045]:   <metadata>
Nov 08 23:16:11 user nova-compute[75045]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 23:16:11 user nova-compute[75045]:       <nova:package version="0.0.0"/>
Nov 08 23:16:11 user nova-compute[75045]:       <nova:name>tempest-device-tagging-server-1008670319</nova:name>
Nov 08 23:16:11 user nova-compute[75045]:       <nova:creationTime>2023-11-08 23:16:10</nova:creationTime>
Nov 08 23:16:11 user nova-compute[75045]:       <nova:flavor name="m1.tiny">
Nov 08 23:16:11 user nova-compute[75045]:         <nova:memory>512</nova:memory>
Nov 08 23:16:11 user nova-compute[75045]:         <nova:disk>1</nova:disk>
Nov 08 23:16:11 user nova-compute[75045]:         <nova:swap>0</nova:swap>
Nov 08 23:16:11 user nova-compute[75045]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 23:16:11 user nova-compute[75045]:         <nova:vcpus>1</nova:vcpus>
Nov 08 23:16:11 user nova-compute[75045]:       </nova:flavor>
Nov 08 23:16:11 user nova-compute[75045]:       <nova:owner>
Nov 08 23:16:11 user nova-compute[75045]:         <nova:user uuid="0c8d9cc387dc45d18ad1550ef6d3cfa9">tempest-TaggedAttachmentsTest-1639503389-project-member</nova:user>
Nov 08 23:16:11 user nova-compute[75045]:         <nova:project uuid="bb18f0af92ec4de6a1fddb6c77ea030d">tempest-TaggedAttachmentsTest-1639503389</nova:project>
Nov 08 23:16:11 user nova-compute[75045]:       </nova:owner>
Nov 08 23:16:11 user nova-compute[75045]:       <nova:root type="image" uuid="a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb"/>
Nov 08 23:16:11 user nova-compute[75045]:       <nova:ports>
Nov 08 23:16:11 user nova-compute[75045]:         <nova:port uuid="892284f7-b4b9-4b5b-82c7-62300cd8afb7">
Nov 08 23:16:11 user nova-compute[75045]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 08 23:16:11 user nova-compute[75045]:         </nova:port>
Nov 08 23:16:11 user nova-compute[75045]:       </nova:ports>
Nov 08 23:16:11 user nova-compute[75045]:     </nova:instance>
Nov 08 23:16:11 user nova-compute[75045]:   </metadata>
Nov 08 23:16:11 user nova-compute[75045]:   <sysinfo type="smbios">
Nov 08 23:16:11 user nova-compute[75045]:     <system>
Nov 08 23:16:11 user nova-compute[75045]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 23:16:11 user nova-compute[75045]:       <entry name="product">OpenStack Nova</entry>
Nov 08 23:16:11 user nova-compute[75045]:       <entry name="version">0.0.0</entry>
Nov 08 23:16:11 user nova-compute[75045]:       <entry name="serial">1cb1b440-0073-4a53-a0a2-e2781e021866</entry>
Nov 08 23:16:11 user nova-compute[75045]:       <entry name="uuid">1cb1b440-0073-4a53-a0a2-e2781e021866</entry>
Nov 08 23:16:11 user nova-compute[75045]:       <entry name="family">Virtual Machine</entry>
Nov 08 23:16:11 user nova-compute[75045]:     </system>
Nov 08 23:16:11 user nova-compute[75045]:   </sysinfo>
Nov 08 23:16:11 user nova-compute[75045]:   <os>
Nov 08 23:16:11 user nova-compute[75045]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 23:16:11 user nova-compute[75045]:     <boot dev="hd"/>
Nov 08 23:16:11 user nova-compute[75045]:     <smbios mode="sysinfo"/>
Nov 08 23:16:11 user nova-compute[75045]:   </os>
Nov 08 23:16:11 user nova-compute[75045]:   <features>
Nov 08 23:16:11 user nova-compute[75045]:     <acpi/>
Nov 08 23:16:11 user nova-compute[75045]:     <apic/>
Nov 08 23:16:11 user nova-compute[75045]:     <vmcoreinfo/>
Nov 08 23:16:11 user nova-compute[75045]:   </features>
Nov 08 23:16:11 user nova-compute[75045]:   <clock offset="utc">
Nov 08 23:16:11 user nova-compute[75045]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 23:16:11 user nova-compute[75045]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 23:16:11 user nova-compute[75045]:     <timer name="hpet" present="no"/>
Nov 08 23:16:11 user nova-compute[75045]:   </clock>
Nov 08 23:16:11 user nova-compute[75045]:   <cpu mode="custom" match="exact">
Nov 08 23:16:11 user nova-compute[75045]:     <model>Nehalem</model>
Nov 08 23:16:11 user nova-compute[75045]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 23:16:11 user nova-compute[75045]:   </cpu>
Nov 08 23:16:11 user nova-compute[75045]:   <devices>
Nov 08 23:16:11 user nova-compute[75045]:     <disk type="file" device="disk">
Nov 08 23:16:11 user nova-compute[75045]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 23:16:11 user nova-compute[75045]:       <source file="/opt/stack/data/nova/instances/1cb1b440-0073-4a53-a0a2-e2781e021866/disk"/>
Nov 08 23:16:11 user nova-compute[75045]:       <target dev="vda" bus="virtio"/>
Nov 08 23:16:11 user nova-compute[75045]:     </disk>
Nov 08 23:16:11 user nova-compute[75045]:     <disk type="file" device="cdrom">
Nov 08 23:16:11 user nova-compute[75045]:       <driver name="qemu" type="raw" cache="none"/>
Nov 08 23:16:11 user nova-compute[75045]:       <source file="/opt/stack/data/nova/instances/1cb1b440-0073-4a53-a0a2-e2781e021866/disk.config"/>
Nov 08 23:16:11 user nova-compute[75045]:       <target dev="hda" bus="ide"/>
Nov 08 23:16:11 user nova-compute[75045]:     </disk>
Nov 08 23:16:11 user nova-compute[75045]:     <interface type="ethernet">
Nov 08 23:16:11 user nova-compute[75045]:       <mac address="fa:16:3e:e4:4d:f8"/>
Nov 08 23:16:11 user nova-compute[75045]:       <model type="virtio"/>
Nov 08 23:16:11 user nova-compute[75045]:       <mtu size="1442"/>
Nov 08 23:16:11 user nova-compute[75045]:       <target dev="tap892284f7-b4"/>
Nov 08 23:16:11 user nova-compute[75045]:     </interface>
Nov 08 23:16:11 user nova-compute[75045]:     <serial type="pty">
Nov 08 23:16:11 user nova-compute[75045]:       <log file="/opt/stack/data/nova/instances/1cb1b440-0073-4a53-a0a2-e2781e021866/console.log" append="off"/>
Nov 08 23:16:11 user nova-compute[75045]:     </serial>
Nov 08 23:16:11 user nova-compute[75045]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 23:16:11 user nova-compute[75045]:     <video>
Nov 08 23:16:11 user nova-compute[75045]:       <model type="virtio"/>
Nov 08 23:16:11 user nova-compute[75045]:     </video>
Nov 08 23:16:11 user nova-compute[75045]:     <rng model="virtio">
Nov 08 23:16:11 user nova-compute[75045]:       <backend model="random">/dev/urandom</backend>
Nov 08 23:16:11 user nova-compute[75045]:     </rng>
Nov 08 23:16:11 user nova-compute[75045]:     <controller type="usb" index="0" model="none"/>
Nov 08 23:16:11 user nova-compute[75045]:     <memballoon model="virtio">
Nov 08 23:16:11 user nova-compute[75045]:       <stats period="10"/>
Nov 08 23:16:11 user nova-compute[75045]:     </memballoon>
Nov 08 23:16:11 user nova-compute[75045]:   </devices>
Nov 08 23:16:11 user nova-compute[75045]: </domain>
Nov 08 23:16:11 user nova-compute[75045]:  {{(pid=75045) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 23:16:11 user nova-compute[75045]: DEBUG nova.virt.libvirt.vif [None req-3affb0f7-e0a0-4ae7-8009-13c232f58726 tempest-TaggedAttachmentsTest-1639503389 tempest-TaggedAttachmentsTest-1639503389-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T23:16:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1008670319',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1008670319',id=5,image_ref='a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJHwrx1BGWhjjUX4+Byh1wjqwerHxYEs1Bi9i8sP+n0orNMkrqYiTdsqsEt8sTDzFkc1LBM09NOYtbQKa/c7KjqeCNDDUOdBi8LqOWMDeLuYXRRZIoptz+6bpxuTCZMmXg==',key_name='tempest-keypair-1418515873',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bb18f0af92ec4de6a1fddb6c77ea030d',ramdisk_id='',reservation_id='r-15oytm0c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-1639503389',owner_user_name='tempest-TaggedAttachmentsTest-1639503389-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T23:16:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0c8d9cc387dc45d18ad1550ef6d3cfa9',uuid=1cb1b440-0073-4a53-a0a2-e2781e021866,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "892284f7-b4b9-4b5b-82c7-62300cd8afb7", "address": "fa:16:3e:e4:4d:f8", "network": {"id": "fa6f2c92-825d-46c6-a0ea-51f96da244cb", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-193868289-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb18f0af92ec4de6a1fddb6c77ea030d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap892284f7-b4", "ovs_interfaceid": "892284f7-b4b9-4b5b-82c7-62300cd8afb7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75045) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 23:16:11 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-3affb0f7-e0a0-4ae7-8009-13c232f58726 tempest-TaggedAttachmentsTest-1639503389 tempest-TaggedAttachmentsTest-1639503389-project-member] Converting VIF {"id": "892284f7-b4b9-4b5b-82c7-62300cd8afb7", "address": "fa:16:3e:e4:4d:f8", "network": {"id": "fa6f2c92-825d-46c6-a0ea-51f96da244cb", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-193868289-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb18f0af92ec4de6a1fddb6c77ea030d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap892284f7-b4", "ovs_interfaceid": "892284f7-b4b9-4b5b-82c7-62300cd8afb7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 23:16:11 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-3affb0f7-e0a0-4ae7-8009-13c232f58726 tempest-TaggedAttachmentsTest-1639503389 tempest-TaggedAttachmentsTest-1639503389-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e4:4d:f8,bridge_name='br-int',has_traffic_filtering=True,id=892284f7-b4b9-4b5b-82c7-62300cd8afb7,network=Network(fa6f2c92-825d-46c6-a0ea-51f96da244cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap892284f7-b4') {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 23:16:11 user nova-compute[75045]: DEBUG os_vif [None req-3affb0f7-e0a0-4ae7-8009-13c232f58726 tempest-TaggedAttachmentsTest-1639503389 tempest-TaggedAttachmentsTest-1639503389-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e4:4d:f8,bridge_name='br-int',has_traffic_filtering=True,id=892284f7-b4b9-4b5b-82c7-62300cd8afb7,network=Network(fa6f2c92-825d-46c6-a0ea-51f96da244cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap892284f7-b4') {{(pid=75045) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 23:16:11 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:16:11 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:16:11 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 23:16:11 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:16:11 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2d80a554-15ef-5f32-b88b-16a324125ef7', '_type': 'linux-noop'}}, row=False) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:16:11 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 23:16:11 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:16:11 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap892284f7-b4, may_exist=True, interface_attrs={}) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:16:11 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap892284f7-b4, col_values=(('qos', UUID('bd9fa511-5bf7-41f7-9851-187b7003d946')),), if_exists=True) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:16:11 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap892284f7-b4, col_values=(('external_ids', {'iface-id': '892284f7-b4b9-4b5b-82c7-62300cd8afb7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e4:4d:f8', 'vm-uuid': '1cb1b440-0073-4a53-a0a2-e2781e021866'}),), if_exists=True) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:16:11 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:16:11 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 23:16:11 user nova-compute[75045]: INFO os_vif [None req-3affb0f7-e0a0-4ae7-8009-13c232f58726 tempest-TaggedAttachmentsTest-1639503389 tempest-TaggedAttachmentsTest-1639503389-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e4:4d:f8,bridge_name='br-int',has_traffic_filtering=True,id=892284f7-b4b9-4b5b-82c7-62300cd8afb7,network=Network(fa6f2c92-825d-46c6-a0ea-51f96da244cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap892284f7-b4')
Nov 08 23:16:11 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-3affb0f7-e0a0-4ae7-8009-13c232f58726 tempest-TaggedAttachmentsTest-1639503389 tempest-TaggedAttachmentsTest-1639503389-project-member] No BDM found with device name vda, not building metadata. {{(pid=75045) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 23:16:11 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-3affb0f7-e0a0-4ae7-8009-13c232f58726 tempest-TaggedAttachmentsTest-1639503389 tempest-TaggedAttachmentsTest-1639503389-project-member] No BDM found with device name hda, not building metadata. {{(pid=75045) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 23:16:11 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-3affb0f7-e0a0-4ae7-8009-13c232f58726 tempest-TaggedAttachmentsTest-1639503389 tempest-TaggedAttachmentsTest-1639503389-project-member] No VIF found with MAC fa:16:3e:e4:4d:f8, not building metadata {{(pid=75045) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 23:16:11 user nova-compute[75045]: INFO nova.virt.libvirt.driver [None req-3affb0f7-e0a0-4ae7-8009-13c232f58726 tempest-TaggedAttachmentsTest-1639503389 tempest-TaggedAttachmentsTest-1639503389-project-member] [instance: 1cb1b440-0073-4a53-a0a2-e2781e021866] Using config drive
Nov 08 23:16:11 user nova-compute[75045]: INFO nova.virt.libvirt.driver [None req-3affb0f7-e0a0-4ae7-8009-13c232f58726 tempest-TaggedAttachmentsTest-1639503389 tempest-TaggedAttachmentsTest-1639503389-project-member] [instance: 1cb1b440-0073-4a53-a0a2-e2781e021866] Creating config drive at /opt/stack/data/nova/instances/1cb1b440-0073-4a53-a0a2-e2781e021866/disk.config
Nov 08 23:16:11 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-3affb0f7-e0a0-4ae7-8009-13c232f58726 tempest-TaggedAttachmentsTest-1639503389 tempest-TaggedAttachmentsTest-1639503389-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/1cb1b440-0073-4a53-a0a2-e2781e021866/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpo70acoth {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:16:11 user nova-compute[75045]: DEBUG nova.network.neutron [None req-56afaf56-aa01-4413-89f2-23b32bd395cc tempest-TestVolumeSwap-1282852572 tempest-TestVolumeSwap-1282852572-project-member] [instance: fde91f7c-31e3-456c-b252-6ce37fa3b600] Successfully created port: cf7f2506-395a-4404-a256-6600a5c0a06e {{(pid=75045) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 23:16:11 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-3affb0f7-e0a0-4ae7-8009-13c232f58726 tempest-TaggedAttachmentsTest-1639503389 tempest-TaggedAttachmentsTest-1639503389-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/1cb1b440-0073-4a53-a0a2-e2781e021866/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpo70acoth" returned: 0 in 0.070s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:16:11 user nova-compute[75045]: DEBUG nova.network.neutron [req-1c3b0971-603c-4789-8b29-001197043384 req-20db4363-75f2-4465-be0d-04088f8edd99 service nova] [instance: 1cb1b440-0073-4a53-a0a2-e2781e021866] Updated VIF entry in instance network info cache for port 892284f7-b4b9-4b5b-82c7-62300cd8afb7. {{(pid=75045) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 23:16:11 user nova-compute[75045]: DEBUG nova.network.neutron [req-1c3b0971-603c-4789-8b29-001197043384 req-20db4363-75f2-4465-be0d-04088f8edd99 service nova] [instance: 1cb1b440-0073-4a53-a0a2-e2781e021866] Updating instance_info_cache with network_info: [{"id": "892284f7-b4b9-4b5b-82c7-62300cd8afb7", "address": "fa:16:3e:e4:4d:f8", "network": {"id": "fa6f2c92-825d-46c6-a0ea-51f96da244cb", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-193868289-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb18f0af92ec4de6a1fddb6c77ea030d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap892284f7-b4", "ovs_interfaceid": "892284f7-b4b9-4b5b-82c7-62300cd8afb7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75045) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 23:16:11 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-1c3b0971-603c-4789-8b29-001197043384 req-20db4363-75f2-4465-be0d-04088f8edd99 service nova] Releasing lock "refresh_cache-1cb1b440-0073-4a53-a0a2-e2781e021866" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 23:16:12 user nova-compute[75045]: DEBUG nova.compute.manager [None req-be169426-6821-480c-b591-4f9308b0015e tempest-AttachSCSIVolumeTestJSON-1576344526 tempest-AttachSCSIVolumeTestJSON-1576344526-project-member] [instance: b9bd3096-92eb-4aae-8619-2725ed9acc2b] Instance event wait completed in 0 seconds for  {{(pid=75045) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 23:16:12 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-be169426-6821-480c-b591-4f9308b0015e tempest-AttachSCSIVolumeTestJSON-1576344526 tempest-AttachSCSIVolumeTestJSON-1576344526-project-member] [instance: b9bd3096-92eb-4aae-8619-2725ed9acc2b] Guest created on hypervisor {{(pid=75045) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 23:16:12 user nova-compute[75045]: INFO nova.virt.libvirt.driver [-] [instance: b9bd3096-92eb-4aae-8619-2725ed9acc2b] Instance spawned successfully.
Nov 08 23:16:12 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-be169426-6821-480c-b591-4f9308b0015e tempest-AttachSCSIVolumeTestJSON-1576344526 tempest-AttachSCSIVolumeTestJSON-1576344526-project-member] [instance: b9bd3096-92eb-4aae-8619-2725ed9acc2b] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75045) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 23:16:12 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-be169426-6821-480c-b591-4f9308b0015e tempest-AttachSCSIVolumeTestJSON-1576344526 tempest-AttachSCSIVolumeTestJSON-1576344526-project-member] [instance: b9bd3096-92eb-4aae-8619-2725ed9acc2b] Found default for hw_input_bus of None {{(pid=75045) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 23:16:12 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-be169426-6821-480c-b591-4f9308b0015e tempest-AttachSCSIVolumeTestJSON-1576344526 tempest-AttachSCSIVolumeTestJSON-1576344526-project-member] [instance: b9bd3096-92eb-4aae-8619-2725ed9acc2b] Found default for hw_pointer_model of None {{(pid=75045) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 23:16:12 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-be169426-6821-480c-b591-4f9308b0015e tempest-AttachSCSIVolumeTestJSON-1576344526 tempest-AttachSCSIVolumeTestJSON-1576344526-project-member] [instance: b9bd3096-92eb-4aae-8619-2725ed9acc2b] Found default for hw_video_model of virtio {{(pid=75045) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 23:16:12 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-be169426-6821-480c-b591-4f9308b0015e tempest-AttachSCSIVolumeTestJSON-1576344526 tempest-AttachSCSIVolumeTestJSON-1576344526-project-member] [instance: b9bd3096-92eb-4aae-8619-2725ed9acc2b] Found default for hw_vif_model of virtio {{(pid=75045) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 23:16:12 user nova-compute[75045]: INFO nova.compute.manager [None req-be169426-6821-480c-b591-4f9308b0015e tempest-AttachSCSIVolumeTestJSON-1576344526 tempest-AttachSCSIVolumeTestJSON-1576344526-project-member] [instance: b9bd3096-92eb-4aae-8619-2725ed9acc2b] Took 8.69 seconds to spawn the instance on the hypervisor.
Nov 08 23:16:12 user nova-compute[75045]: DEBUG nova.compute.manager [None req-be169426-6821-480c-b591-4f9308b0015e tempest-AttachSCSIVolumeTestJSON-1576344526 tempest-AttachSCSIVolumeTestJSON-1576344526-project-member] [instance: b9bd3096-92eb-4aae-8619-2725ed9acc2b] Checking state {{(pid=75045) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 23:16:12 user nova-compute[75045]: INFO nova.compute.manager [None req-be169426-6821-480c-b591-4f9308b0015e tempest-AttachSCSIVolumeTestJSON-1576344526 tempest-AttachSCSIVolumeTestJSON-1576344526-project-member] [instance: b9bd3096-92eb-4aae-8619-2725ed9acc2b] Took 9.82 seconds to build instance.
Nov 08 23:16:12 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-be169426-6821-480c-b591-4f9308b0015e tempest-AttachSCSIVolumeTestJSON-1576344526 tempest-AttachSCSIVolumeTestJSON-1576344526-project-member] Lock "b9bd3096-92eb-4aae-8619-2725ed9acc2b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.983s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:16:12 user nova-compute[75045]: DEBUG nova.network.neutron [None req-56afaf56-aa01-4413-89f2-23b32bd395cc tempest-TestVolumeSwap-1282852572 tempest-TestVolumeSwap-1282852572-project-member] [instance: fde91f7c-31e3-456c-b252-6ce37fa3b600] Successfully updated port: cf7f2506-395a-4404-a256-6600a5c0a06e {{(pid=75045) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 23:16:12 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-56afaf56-aa01-4413-89f2-23b32bd395cc tempest-TestVolumeSwap-1282852572 tempest-TestVolumeSwap-1282852572-project-member] Acquiring lock "refresh_cache-fde91f7c-31e3-456c-b252-6ce37fa3b600" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 23:16:12 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-56afaf56-aa01-4413-89f2-23b32bd395cc tempest-TestVolumeSwap-1282852572 tempest-TestVolumeSwap-1282852572-project-member] Acquired lock "refresh_cache-fde91f7c-31e3-456c-b252-6ce37fa3b600" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 23:16:12 user nova-compute[75045]: DEBUG nova.network.neutron [None req-56afaf56-aa01-4413-89f2-23b32bd395cc tempest-TestVolumeSwap-1282852572 tempest-TestVolumeSwap-1282852572-project-member] [instance: fde91f7c-31e3-456c-b252-6ce37fa3b600] Building network info cache for instance {{(pid=75045) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 23:16:12 user nova-compute[75045]: DEBUG nova.compute.manager [req-efd0f4a3-b0ce-444e-8907-a8f14a45a2f6 req-6081b5c8-cb97-4bff-8b72-16f44f703be7 service nova] [instance: fde91f7c-31e3-456c-b252-6ce37fa3b600] Received event network-changed-cf7f2506-395a-4404-a256-6600a5c0a06e {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:16:12 user nova-compute[75045]: DEBUG nova.compute.manager [req-efd0f4a3-b0ce-444e-8907-a8f14a45a2f6 req-6081b5c8-cb97-4bff-8b72-16f44f703be7 service nova] [instance: fde91f7c-31e3-456c-b252-6ce37fa3b600] Refreshing instance network info cache due to event network-changed-cf7f2506-395a-4404-a256-6600a5c0a06e. {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 23:16:12 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-efd0f4a3-b0ce-444e-8907-a8f14a45a2f6 req-6081b5c8-cb97-4bff-8b72-16f44f703be7 service nova] Acquiring lock "refresh_cache-fde91f7c-31e3-456c-b252-6ce37fa3b600" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 23:16:12 user nova-compute[75045]: DEBUG nova.network.neutron [None req-56afaf56-aa01-4413-89f2-23b32bd395cc tempest-TestVolumeSwap-1282852572 tempest-TestVolumeSwap-1282852572-project-member] [instance: fde91f7c-31e3-456c-b252-6ce37fa3b600] Instance cache missing network info. {{(pid=75045) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 23:16:13 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:16:13 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:16:13 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:16:13 user nova-compute[75045]: DEBUG nova.network.neutron [None req-56afaf56-aa01-4413-89f2-23b32bd395cc tempest-TestVolumeSwap-1282852572 tempest-TestVolumeSwap-1282852572-project-member] [instance: fde91f7c-31e3-456c-b252-6ce37fa3b600] Updating instance_info_cache with network_info: [{"id": "cf7f2506-395a-4404-a256-6600a5c0a06e", "address": "fa:16:3e:a5:67:d3", "network": {"id": "d1b282d5-4d48-4a16-9f0d-82241f8add26", "bridge": "br-int", "label": "tempest-TestVolumeSwap-340739462-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8fc58c033ee9468fa80d2d84f19c2f4c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf7f2506-39", "ovs_interfaceid": "cf7f2506-395a-4404-a256-6600a5c0a06e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75045) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 23:16:13 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-56afaf56-aa01-4413-89f2-23b32bd395cc tempest-TestVolumeSwap-1282852572 tempest-TestVolumeSwap-1282852572-project-member] Releasing lock "refresh_cache-fde91f7c-31e3-456c-b252-6ce37fa3b600" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 23:16:13 user nova-compute[75045]: DEBUG nova.compute.manager [None req-56afaf56-aa01-4413-89f2-23b32bd395cc tempest-TestVolumeSwap-1282852572 tempest-TestVolumeSwap-1282852572-project-member] [instance: fde91f7c-31e3-456c-b252-6ce37fa3b600] Instance network_info: |[{"id": "cf7f2506-395a-4404-a256-6600a5c0a06e", "address": "fa:16:3e:a5:67:d3", "network": {"id": "d1b282d5-4d48-4a16-9f0d-82241f8add26", "bridge": "br-int", "label": "tempest-TestVolumeSwap-340739462-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8fc58c033ee9468fa80d2d84f19c2f4c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf7f2506-39", "ovs_interfaceid": "cf7f2506-395a-4404-a256-6600a5c0a06e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75045) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 23:16:13 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-efd0f4a3-b0ce-444e-8907-a8f14a45a2f6 req-6081b5c8-cb97-4bff-8b72-16f44f703be7 service nova] Acquired lock "refresh_cache-fde91f7c-31e3-456c-b252-6ce37fa3b600" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 23:16:13 user nova-compute[75045]: DEBUG nova.network.neutron [req-efd0f4a3-b0ce-444e-8907-a8f14a45a2f6 req-6081b5c8-cb97-4bff-8b72-16f44f703be7 service nova] [instance: fde91f7c-31e3-456c-b252-6ce37fa3b600] Refreshing network info cache for port cf7f2506-395a-4404-a256-6600a5c0a06e {{(pid=75045) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 23:16:13 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-56afaf56-aa01-4413-89f2-23b32bd395cc tempest-TestVolumeSwap-1282852572 tempest-TestVolumeSwap-1282852572-project-member] [instance: fde91f7c-31e3-456c-b252-6ce37fa3b600] Start _get_guest_xml network_info=[{"id": "cf7f2506-395a-4404-a256-6600a5c0a06e", "address": "fa:16:3e:a5:67:d3", "network": {"id": "d1b282d5-4d48-4a16-9f0d-82241f8add26", "bridge": "br-int", "label": "tempest-TestVolumeSwap-340739462-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8fc58c033ee9468fa80d2d84f19c2f4c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf7f2506-39", "ovs_interfaceid": "cf7f2506-395a-4404-a256-6600a5c0a06e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T23:11:54Z,direct_url=<?>,disk_format='qcow2',id=a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b1beba2cc4e7465ea249e2225fb494dc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T23:11:56Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'disk_bus': 'virtio', 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': 'a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75045) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 23:16:13 user nova-compute[75045]: WARNING nova.virt.libvirt.driver [None req-56afaf56-aa01-4413-89f2-23b32bd395cc tempest-TestVolumeSwap-1282852572 tempest-TestVolumeSwap-1282852572-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 23:16:13 user nova-compute[75045]: WARNING nova.virt.libvirt.driver [None req-56afaf56-aa01-4413-89f2-23b32bd395cc tempest-TestVolumeSwap-1282852572 tempest-TestVolumeSwap-1282852572-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 23:16:13 user nova-compute[75045]: DEBUG nova.virt.libvirt.host [None req-56afaf56-aa01-4413-89f2-23b32bd395cc tempest-TestVolumeSwap-1282852572 tempest-TestVolumeSwap-1282852572-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75045) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 23:16:13 user nova-compute[75045]: DEBUG nova.virt.libvirt.host [None req-56afaf56-aa01-4413-89f2-23b32bd395cc tempest-TestVolumeSwap-1282852572 tempest-TestVolumeSwap-1282852572-project-member] CPU controller missing on host. {{(pid=75045) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 23:16:13 user nova-compute[75045]: DEBUG nova.virt.libvirt.host [None req-56afaf56-aa01-4413-89f2-23b32bd395cc tempest-TestVolumeSwap-1282852572 tempest-TestVolumeSwap-1282852572-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75045) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 23:16:13 user nova-compute[75045]: DEBUG nova.virt.libvirt.host [None req-56afaf56-aa01-4413-89f2-23b32bd395cc tempest-TestVolumeSwap-1282852572 tempest-TestVolumeSwap-1282852572-project-member] CPU controller found on host. {{(pid=75045) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 23:16:13 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-56afaf56-aa01-4413-89f2-23b32bd395cc tempest-TestVolumeSwap-1282852572 tempest-TestVolumeSwap-1282852572-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75045) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 23:16:13 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-56afaf56-aa01-4413-89f2-23b32bd395cc tempest-TestVolumeSwap-1282852572 tempest-TestVolumeSwap-1282852572-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T23:11:41Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T23:11:54Z,direct_url=<?>,disk_format='qcow2',id=a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b1beba2cc4e7465ea249e2225fb494dc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T23:11:56Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75045) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 23:16:13 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-56afaf56-aa01-4413-89f2-23b32bd395cc tempest-TestVolumeSwap-1282852572 tempest-TestVolumeSwap-1282852572-project-member] Flavor limits 0:0:0 {{(pid=75045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 23:16:13 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-56afaf56-aa01-4413-89f2-23b32bd395cc tempest-TestVolumeSwap-1282852572 tempest-TestVolumeSwap-1282852572-project-member] Image limits 0:0:0 {{(pid=75045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 23:16:13 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-56afaf56-aa01-4413-89f2-23b32bd395cc tempest-TestVolumeSwap-1282852572 tempest-TestVolumeSwap-1282852572-project-member] Flavor pref 0:0:0 {{(pid=75045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 23:16:13 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-56afaf56-aa01-4413-89f2-23b32bd395cc tempest-TestVolumeSwap-1282852572 tempest-TestVolumeSwap-1282852572-project-member] Image pref 0:0:0 {{(pid=75045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 23:16:13 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-56afaf56-aa01-4413-89f2-23b32bd395cc tempest-TestVolumeSwap-1282852572 tempest-TestVolumeSwap-1282852572-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 23:16:13 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-56afaf56-aa01-4413-89f2-23b32bd395cc tempest-TestVolumeSwap-1282852572 tempest-TestVolumeSwap-1282852572-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75045) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 23:16:13 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-56afaf56-aa01-4413-89f2-23b32bd395cc tempest-TestVolumeSwap-1282852572 tempest-TestVolumeSwap-1282852572-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75045) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 23:16:13 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-56afaf56-aa01-4413-89f2-23b32bd395cc tempest-TestVolumeSwap-1282852572 tempest-TestVolumeSwap-1282852572-project-member] Got 1 possible topologies {{(pid=75045) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 23:16:13 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-56afaf56-aa01-4413-89f2-23b32bd395cc tempest-TestVolumeSwap-1282852572 tempest-TestVolumeSwap-1282852572-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75045) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 23:16:13 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-56afaf56-aa01-4413-89f2-23b32bd395cc tempest-TestVolumeSwap-1282852572 tempest-TestVolumeSwap-1282852572-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75045) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 23:16:13 user nova-compute[75045]: DEBUG nova.virt.libvirt.vif [None req-56afaf56-aa01-4413-89f2-23b32bd395cc tempest-TestVolumeSwap-1282852572 tempest-TestVolumeSwap-1282852572-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T23:16:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1418546643',display_name='tempest-TestVolumeSwap-server-1418546643',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1418546643',id=6,image_ref='a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN1W5rqC2nnvk7eMxQ2T5tQtsZDwK+TwKsWdIZ7qiVucbGH37x5tmeEhGGFYLh6qFb8AtpEA0f7Xzdq2TpYUmjQcpxylzIbfaQuZFI+0ZojI9YD5D8w0aSQGp5gnntIYyA==',key_name='tempest-keypair-616158558',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8fc58c033ee9468fa80d2d84f19c2f4c',ramdisk_id='',reservation_id='r-2bkhdz1g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-1282852572',owner_user_name='tempest-TestVolumeSwap-1282852572-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T23:16:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='be84d5fb901848d5b5f2bd19c6bdf5a1',uuid=fde91f7c-31e3-456c-b252-6ce37fa3b600,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cf7f2506-395a-4404-a256-6600a5c0a06e", "address": "fa:16:3e:a5:67:d3", "network": {"id": "d1b282d5-4d48-4a16-9f0d-82241f8add26", "bridge": "br-int", "label": "tempest-TestVolumeSwap-340739462-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8fc58c033ee9468fa80d2d84f19c2f4c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf7f2506-39", "ovs_interfaceid": "cf7f2506-395a-4404-a256-6600a5c0a06e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75045) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 23:16:13 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-56afaf56-aa01-4413-89f2-23b32bd395cc tempest-TestVolumeSwap-1282852572 tempest-TestVolumeSwap-1282852572-project-member] Converting VIF {"id": "cf7f2506-395a-4404-a256-6600a5c0a06e", "address": "fa:16:3e:a5:67:d3", "network": {"id": "d1b282d5-4d48-4a16-9f0d-82241f8add26", "bridge": "br-int", "label": "tempest-TestVolumeSwap-340739462-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8fc58c033ee9468fa80d2d84f19c2f4c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf7f2506-39", "ovs_interfaceid": "cf7f2506-395a-4404-a256-6600a5c0a06e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 23:16:13 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-56afaf56-aa01-4413-89f2-23b32bd395cc tempest-TestVolumeSwap-1282852572 tempest-TestVolumeSwap-1282852572-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a5:67:d3,bridge_name='br-int',has_traffic_filtering=True,id=cf7f2506-395a-4404-a256-6600a5c0a06e,network=Network(d1b282d5-4d48-4a16-9f0d-82241f8add26),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcf7f2506-39') {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 23:16:13 user nova-compute[75045]: DEBUG nova.objects.instance [None req-56afaf56-aa01-4413-89f2-23b32bd395cc tempest-TestVolumeSwap-1282852572 tempest-TestVolumeSwap-1282852572-project-member] Lazy-loading 'pci_devices' on Instance uuid fde91f7c-31e3-456c-b252-6ce37fa3b600 {{(pid=75045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 23:16:13 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-56afaf56-aa01-4413-89f2-23b32bd395cc tempest-TestVolumeSwap-1282852572 tempest-TestVolumeSwap-1282852572-project-member] [instance: fde91f7c-31e3-456c-b252-6ce37fa3b600] End _get_guest_xml xml=<domain type="kvm">
Nov 08 23:16:13 user nova-compute[75045]:   <uuid>fde91f7c-31e3-456c-b252-6ce37fa3b600</uuid>
Nov 08 23:16:13 user nova-compute[75045]:   <name>instance-00000006</name>
Nov 08 23:16:13 user nova-compute[75045]:   <memory>524288</memory>
Nov 08 23:16:13 user nova-compute[75045]:   <vcpu>1</vcpu>
Nov 08 23:16:13 user nova-compute[75045]:   <metadata>
Nov 08 23:16:13 user nova-compute[75045]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 23:16:13 user nova-compute[75045]:       <nova:package version="0.0.0"/>
Nov 08 23:16:13 user nova-compute[75045]:       <nova:name>tempest-TestVolumeSwap-server-1418546643</nova:name>
Nov 08 23:16:13 user nova-compute[75045]:       <nova:creationTime>2023-11-08 23:16:13</nova:creationTime>
Nov 08 23:16:13 user nova-compute[75045]:       <nova:flavor name="m1.tiny">
Nov 08 23:16:13 user nova-compute[75045]:         <nova:memory>512</nova:memory>
Nov 08 23:16:13 user nova-compute[75045]:         <nova:disk>1</nova:disk>
Nov 08 23:16:13 user nova-compute[75045]:         <nova:swap>0</nova:swap>
Nov 08 23:16:13 user nova-compute[75045]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 23:16:13 user nova-compute[75045]:         <nova:vcpus>1</nova:vcpus>
Nov 08 23:16:13 user nova-compute[75045]:       </nova:flavor>
Nov 08 23:16:13 user nova-compute[75045]:       <nova:owner>
Nov 08 23:16:13 user nova-compute[75045]:         <nova:user uuid="be84d5fb901848d5b5f2bd19c6bdf5a1">tempest-TestVolumeSwap-1282852572-project-member</nova:user>
Nov 08 23:16:13 user nova-compute[75045]:         <nova:project uuid="8fc58c033ee9468fa80d2d84f19c2f4c">tempest-TestVolumeSwap-1282852572</nova:project>
Nov 08 23:16:13 user nova-compute[75045]:       </nova:owner>
Nov 08 23:16:13 user nova-compute[75045]:       <nova:root type="image" uuid="a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb"/>
Nov 08 23:16:13 user nova-compute[75045]:       <nova:ports>
Nov 08 23:16:13 user nova-compute[75045]:         <nova:port uuid="cf7f2506-395a-4404-a256-6600a5c0a06e">
Nov 08 23:16:13 user nova-compute[75045]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 08 23:16:13 user nova-compute[75045]:         </nova:port>
Nov 08 23:16:13 user nova-compute[75045]:       </nova:ports>
Nov 08 23:16:13 user nova-compute[75045]:     </nova:instance>
Nov 08 23:16:13 user nova-compute[75045]:   </metadata>
Nov 08 23:16:13 user nova-compute[75045]:   <sysinfo type="smbios">
Nov 08 23:16:13 user nova-compute[75045]:     <system>
Nov 08 23:16:13 user nova-compute[75045]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 23:16:13 user nova-compute[75045]:       <entry name="product">OpenStack Nova</entry>
Nov 08 23:16:13 user nova-compute[75045]:       <entry name="version">0.0.0</entry>
Nov 08 23:16:13 user nova-compute[75045]:       <entry name="serial">fde91f7c-31e3-456c-b252-6ce37fa3b600</entry>
Nov 08 23:16:13 user nova-compute[75045]:       <entry name="uuid">fde91f7c-31e3-456c-b252-6ce37fa3b600</entry>
Nov 08 23:16:13 user nova-compute[75045]:       <entry name="family">Virtual Machine</entry>
Nov 08 23:16:13 user nova-compute[75045]:     </system>
Nov 08 23:16:13 user nova-compute[75045]:   </sysinfo>
Nov 08 23:16:13 user nova-compute[75045]:   <os>
Nov 08 23:16:13 user nova-compute[75045]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 23:16:13 user nova-compute[75045]:     <boot dev="hd"/>
Nov 08 23:16:13 user nova-compute[75045]:     <smbios mode="sysinfo"/>
Nov 08 23:16:13 user nova-compute[75045]:   </os>
Nov 08 23:16:13 user nova-compute[75045]:   <features>
Nov 08 23:16:13 user nova-compute[75045]:     <acpi/>
Nov 08 23:16:13 user nova-compute[75045]:     <apic/>
Nov 08 23:16:13 user nova-compute[75045]:     <vmcoreinfo/>
Nov 08 23:16:13 user nova-compute[75045]:   </features>
Nov 08 23:16:13 user nova-compute[75045]:   <clock offset="utc">
Nov 08 23:16:13 user nova-compute[75045]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 23:16:13 user nova-compute[75045]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 23:16:13 user nova-compute[75045]:     <timer name="hpet" present="no"/>
Nov 08 23:16:13 user nova-compute[75045]:   </clock>
Nov 08 23:16:13 user nova-compute[75045]:   <cpu mode="custom" match="exact">
Nov 08 23:16:13 user nova-compute[75045]:     <model>Nehalem</model>
Nov 08 23:16:13 user nova-compute[75045]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 23:16:13 user nova-compute[75045]:   </cpu>
Nov 08 23:16:13 user nova-compute[75045]:   <devices>
Nov 08 23:16:13 user nova-compute[75045]:     <disk type="file" device="disk">
Nov 08 23:16:13 user nova-compute[75045]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 23:16:13 user nova-compute[75045]:       <source file="/opt/stack/data/nova/instances/fde91f7c-31e3-456c-b252-6ce37fa3b600/disk"/>
Nov 08 23:16:13 user nova-compute[75045]:       <target dev="vda" bus="virtio"/>
Nov 08 23:16:13 user nova-compute[75045]:     </disk>
Nov 08 23:16:13 user nova-compute[75045]:     <interface type="ethernet">
Nov 08 23:16:13 user nova-compute[75045]:       <mac address="fa:16:3e:a5:67:d3"/>
Nov 08 23:16:13 user nova-compute[75045]:       <model type="virtio"/>
Nov 08 23:16:13 user nova-compute[75045]:       <mtu size="1442"/>
Nov 08 23:16:13 user nova-compute[75045]:       <target dev="tapcf7f2506-39"/>
Nov 08 23:16:13 user nova-compute[75045]:     </interface>
Nov 08 23:16:13 user nova-compute[75045]:     <serial type="pty">
Nov 08 23:16:13 user nova-compute[75045]:       <log file="/opt/stack/data/nova/instances/fde91f7c-31e3-456c-b252-6ce37fa3b600/console.log" append="off"/>
Nov 08 23:16:13 user nova-compute[75045]:     </serial>
Nov 08 23:16:13 user nova-compute[75045]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 23:16:13 user nova-compute[75045]:     <video>
Nov 08 23:16:13 user nova-compute[75045]:       <model type="virtio"/>
Nov 08 23:16:13 user nova-compute[75045]:     </video>
Nov 08 23:16:13 user nova-compute[75045]:     <rng model="virtio">
Nov 08 23:16:13 user nova-compute[75045]:       <backend model="random">/dev/urandom</backend>
Nov 08 23:16:13 user nova-compute[75045]:     </rng>
Nov 08 23:16:13 user nova-compute[75045]:     <controller type="usb" index="0" model="none"/>
Nov 08 23:16:13 user nova-compute[75045]:     <memballoon model="virtio">
Nov 08 23:16:13 user nova-compute[75045]:       <stats period="10"/>
Nov 08 23:16:13 user nova-compute[75045]:     </memballoon>
Nov 08 23:16:13 user nova-compute[75045]:   </devices>
Nov 08 23:16:13 user nova-compute[75045]: </domain>
Nov 08 23:16:13 user nova-compute[75045]:  {{(pid=75045) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 23:16:13 user nova-compute[75045]: DEBUG nova.virt.libvirt.vif [None req-56afaf56-aa01-4413-89f2-23b32bd395cc tempest-TestVolumeSwap-1282852572 tempest-TestVolumeSwap-1282852572-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T23:16:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1418546643',display_name='tempest-TestVolumeSwap-server-1418546643',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1418546643',id=6,image_ref='a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN1W5rqC2nnvk7eMxQ2T5tQtsZDwK+TwKsWdIZ7qiVucbGH37x5tmeEhGGFYLh6qFb8AtpEA0f7Xzdq2TpYUmjQcpxylzIbfaQuZFI+0ZojI9YD5D8w0aSQGp5gnntIYyA==',key_name='tempest-keypair-616158558',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8fc58c033ee9468fa80d2d84f19c2f4c',ramdisk_id='',reservation_id='r-2bkhdz1g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-1282852572',owner_user_name='tempest-TestVolumeSwap-1282852572-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T23:16:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='be84d5fb901848d5b5f2bd19c6bdf5a1',uuid=fde91f7c-31e3-456c-b252-6ce37fa3b600,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cf7f2506-395a-4404-a256-6600a5c0a06e", "address": "fa:16:3e:a5:67:d3", "network": {"id": "d1b282d5-4d48-4a16-9f0d-82241f8add26", "bridge": "br-int", "label": "tempest-TestVolumeSwap-340739462-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8fc58c033ee9468fa80d2d84f19c2f4c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf7f2506-39", "ovs_interfaceid": "cf7f2506-395a-4404-a256-6600a5c0a06e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75045) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 23:16:13 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-56afaf56-aa01-4413-89f2-23b32bd395cc tempest-TestVolumeSwap-1282852572 tempest-TestVolumeSwap-1282852572-project-member] Converting VIF {"id": "cf7f2506-395a-4404-a256-6600a5c0a06e", "address": "fa:16:3e:a5:67:d3", "network": {"id": "d1b282d5-4d48-4a16-9f0d-82241f8add26", "bridge": "br-int", "label": "tempest-TestVolumeSwap-340739462-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8fc58c033ee9468fa80d2d84f19c2f4c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf7f2506-39", "ovs_interfaceid": "cf7f2506-395a-4404-a256-6600a5c0a06e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 23:16:13 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-56afaf56-aa01-4413-89f2-23b32bd395cc tempest-TestVolumeSwap-1282852572 tempest-TestVolumeSwap-1282852572-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a5:67:d3,bridge_name='br-int',has_traffic_filtering=True,id=cf7f2506-395a-4404-a256-6600a5c0a06e,network=Network(d1b282d5-4d48-4a16-9f0d-82241f8add26),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcf7f2506-39') {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 23:16:13 user nova-compute[75045]: DEBUG os_vif [None req-56afaf56-aa01-4413-89f2-23b32bd395cc tempest-TestVolumeSwap-1282852572 tempest-TestVolumeSwap-1282852572-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a5:67:d3,bridge_name='br-int',has_traffic_filtering=True,id=cf7f2506-395a-4404-a256-6600a5c0a06e,network=Network(d1b282d5-4d48-4a16-9f0d-82241f8add26),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcf7f2506-39') {{(pid=75045) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 23:16:13 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:16:13 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:16:13 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 23:16:13 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:16:13 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '331386dd-89f5-59d8-af7c-68380481fc67', '_type': 'linux-noop'}}, row=False) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:16:13 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 23:16:13 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:16:13 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapcf7f2506-39, may_exist=True, interface_attrs={}) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:16:13 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapcf7f2506-39, col_values=(('qos', UUID('2a41b476-713f-4dd2-9f00-7fc2a7103c1a')),), if_exists=True) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:16:13 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapcf7f2506-39, col_values=(('external_ids', {'iface-id': 'cf7f2506-395a-4404-a256-6600a5c0a06e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a5:67:d3', 'vm-uuid': 'fde91f7c-31e3-456c-b252-6ce37fa3b600'}),), if_exists=True) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:16:13 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 23:16:13 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:16:13 user nova-compute[75045]: INFO os_vif [None req-56afaf56-aa01-4413-89f2-23b32bd395cc tempest-TestVolumeSwap-1282852572 tempest-TestVolumeSwap-1282852572-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a5:67:d3,bridge_name='br-int',has_traffic_filtering=True,id=cf7f2506-395a-4404-a256-6600a5c0a06e,network=Network(d1b282d5-4d48-4a16-9f0d-82241f8add26),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcf7f2506-39')
Nov 08 23:16:13 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-029e85ca-7e03-4020-8d79-5d02e89c22c3 tempest-VolumesAssistedSnapshotsTest-1158723798 tempest-VolumesAssistedSnapshotsTest-1158723798-project-member] Acquiring lock "07ec2c05-aaa9-46e8-8439-7aa5b9fca19d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:16:13 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-029e85ca-7e03-4020-8d79-5d02e89c22c3 tempest-VolumesAssistedSnapshotsTest-1158723798 tempest-VolumesAssistedSnapshotsTest-1158723798-project-member] Lock "07ec2c05-aaa9-46e8-8439-7aa5b9fca19d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:16:13 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-56afaf56-aa01-4413-89f2-23b32bd395cc tempest-TestVolumeSwap-1282852572 tempest-TestVolumeSwap-1282852572-project-member] No BDM found with device name vda, not building metadata. {{(pid=75045) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 23:16:13 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-56afaf56-aa01-4413-89f2-23b32bd395cc tempest-TestVolumeSwap-1282852572 tempest-TestVolumeSwap-1282852572-project-member] No VIF found with MAC fa:16:3e:a5:67:d3, not building metadata {{(pid=75045) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 23:16:13 user nova-compute[75045]: DEBUG nova.compute.manager [None req-029e85ca-7e03-4020-8d79-5d02e89c22c3 tempest-VolumesAssistedSnapshotsTest-1158723798 tempest-VolumesAssistedSnapshotsTest-1158723798-project-member] [instance: 07ec2c05-aaa9-46e8-8439-7aa5b9fca19d] Starting instance... {{(pid=75045) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 23:16:13 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:16:13 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:16:13 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-029e85ca-7e03-4020-8d79-5d02e89c22c3 tempest-VolumesAssistedSnapshotsTest-1158723798 tempest-VolumesAssistedSnapshotsTest-1158723798-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:16:13 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-029e85ca-7e03-4020-8d79-5d02e89c22c3 tempest-VolumesAssistedSnapshotsTest-1158723798 tempest-VolumesAssistedSnapshotsTest-1158723798-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:16:14 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:16:14 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-029e85ca-7e03-4020-8d79-5d02e89c22c3 tempest-VolumesAssistedSnapshotsTest-1158723798 tempest-VolumesAssistedSnapshotsTest-1158723798-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75045) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 23:16:14 user nova-compute[75045]: INFO nova.compute.claims [None req-029e85ca-7e03-4020-8d79-5d02e89c22c3 tempest-VolumesAssistedSnapshotsTest-1158723798 tempest-VolumesAssistedSnapshotsTest-1158723798-project-member] [instance: 07ec2c05-aaa9-46e8-8439-7aa5b9fca19d] Claim successful on node user
Nov 08 23:16:14 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:16:14 user nova-compute[75045]: DEBUG nova.network.neutron [req-efd0f4a3-b0ce-444e-8907-a8f14a45a2f6 req-6081b5c8-cb97-4bff-8b72-16f44f703be7 service nova] [instance: fde91f7c-31e3-456c-b252-6ce37fa3b600] Updated VIF entry in instance network info cache for port cf7f2506-395a-4404-a256-6600a5c0a06e. {{(pid=75045) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 23:16:14 user nova-compute[75045]: DEBUG nova.network.neutron [req-efd0f4a3-b0ce-444e-8907-a8f14a45a2f6 req-6081b5c8-cb97-4bff-8b72-16f44f703be7 service nova] [instance: fde91f7c-31e3-456c-b252-6ce37fa3b600] Updating instance_info_cache with network_info: [{"id": "cf7f2506-395a-4404-a256-6600a5c0a06e", "address": "fa:16:3e:a5:67:d3", "network": {"id": "d1b282d5-4d48-4a16-9f0d-82241f8add26", "bridge": "br-int", "label": "tempest-TestVolumeSwap-340739462-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8fc58c033ee9468fa80d2d84f19c2f4c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf7f2506-39", "ovs_interfaceid": "cf7f2506-395a-4404-a256-6600a5c0a06e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75045) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 23:16:14 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-efd0f4a3-b0ce-444e-8907-a8f14a45a2f6 req-6081b5c8-cb97-4bff-8b72-16f44f703be7 service nova] Releasing lock "refresh_cache-fde91f7c-31e3-456c-b252-6ce37fa3b600" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 23:16:14 user nova-compute[75045]: DEBUG nova.compute.provider_tree [None req-029e85ca-7e03-4020-8d79-5d02e89c22c3 tempest-VolumesAssistedSnapshotsTest-1158723798 tempest-VolumesAssistedSnapshotsTest-1158723798-project-member] Inventory has not changed in ProviderTree for provider: 62ba5f85-c74d-4b58-986e-d4197e813fd7 {{(pid=75045) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 23:16:14 user nova-compute[75045]: DEBUG nova.scheduler.client.report [None req-029e85ca-7e03-4020-8d79-5d02e89c22c3 tempest-VolumesAssistedSnapshotsTest-1158723798 tempest-VolumesAssistedSnapshotsTest-1158723798-project-member] Inventory has not changed for provider 62ba5f85-c74d-4b58-986e-d4197e813fd7 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75045) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 23:16:14 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-029e85ca-7e03-4020-8d79-5d02e89c22c3 tempest-VolumesAssistedSnapshotsTest-1158723798 tempest-VolumesAssistedSnapshotsTest-1158723798-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.511s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:16:14 user nova-compute[75045]: DEBUG nova.compute.manager [None req-029e85ca-7e03-4020-8d79-5d02e89c22c3 tempest-VolumesAssistedSnapshotsTest-1158723798 tempest-VolumesAssistedSnapshotsTest-1158723798-project-member] [instance: 07ec2c05-aaa9-46e8-8439-7aa5b9fca19d] Start building networks asynchronously for instance. {{(pid=75045) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 23:16:14 user nova-compute[75045]: DEBUG nova.compute.manager [None req-029e85ca-7e03-4020-8d79-5d02e89c22c3 tempest-VolumesAssistedSnapshotsTest-1158723798 tempest-VolumesAssistedSnapshotsTest-1158723798-project-member] [instance: 07ec2c05-aaa9-46e8-8439-7aa5b9fca19d] Allocating IP information in the background. {{(pid=75045) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 23:16:14 user nova-compute[75045]: DEBUG nova.network.neutron [None req-029e85ca-7e03-4020-8d79-5d02e89c22c3 tempest-VolumesAssistedSnapshotsTest-1158723798 tempest-VolumesAssistedSnapshotsTest-1158723798-project-member] [instance: 07ec2c05-aaa9-46e8-8439-7aa5b9fca19d] allocate_for_instance() {{(pid=75045) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 23:16:14 user nova-compute[75045]: INFO nova.virt.libvirt.driver [None req-029e85ca-7e03-4020-8d79-5d02e89c22c3 tempest-VolumesAssistedSnapshotsTest-1158723798 tempest-VolumesAssistedSnapshotsTest-1158723798-project-member] [instance: 07ec2c05-aaa9-46e8-8439-7aa5b9fca19d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 23:16:14 user nova-compute[75045]: DEBUG nova.compute.manager [None req-029e85ca-7e03-4020-8d79-5d02e89c22c3 tempest-VolumesAssistedSnapshotsTest-1158723798 tempest-VolumesAssistedSnapshotsTest-1158723798-project-member] [instance: 07ec2c05-aaa9-46e8-8439-7aa5b9fca19d] Start building block device mappings for instance. {{(pid=75045) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 23:16:14 user nova-compute[75045]: DEBUG nova.policy [None req-029e85ca-7e03-4020-8d79-5d02e89c22c3 tempest-VolumesAssistedSnapshotsTest-1158723798 tempest-VolumesAssistedSnapshotsTest-1158723798-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c45f30733b674d33ba6d18f50ac2ad0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07fac94bac644b72801b207a378f34ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75045) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 23:16:14 user nova-compute[75045]: DEBUG nova.compute.manager [None req-029e85ca-7e03-4020-8d79-5d02e89c22c3 tempest-VolumesAssistedSnapshotsTest-1158723798 tempest-VolumesAssistedSnapshotsTest-1158723798-project-member] [instance: 07ec2c05-aaa9-46e8-8439-7aa5b9fca19d] Start spawning the instance on the hypervisor. {{(pid=75045) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 23:16:14 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-029e85ca-7e03-4020-8d79-5d02e89c22c3 tempest-VolumesAssistedSnapshotsTest-1158723798 tempest-VolumesAssistedSnapshotsTest-1158723798-project-member] [instance: 07ec2c05-aaa9-46e8-8439-7aa5b9fca19d] Creating instance directory {{(pid=75045) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 23:16:14 user nova-compute[75045]: INFO nova.virt.libvirt.driver [None req-029e85ca-7e03-4020-8d79-5d02e89c22c3 tempest-VolumesAssistedSnapshotsTest-1158723798 tempest-VolumesAssistedSnapshotsTest-1158723798-project-member] [instance: 07ec2c05-aaa9-46e8-8439-7aa5b9fca19d] Creating image(s)
Nov 08 23:16:14 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-029e85ca-7e03-4020-8d79-5d02e89c22c3 tempest-VolumesAssistedSnapshotsTest-1158723798 tempest-VolumesAssistedSnapshotsTest-1158723798-project-member] Acquiring lock "/opt/stack/data/nova/instances/07ec2c05-aaa9-46e8-8439-7aa5b9fca19d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:16:14 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-029e85ca-7e03-4020-8d79-5d02e89c22c3 tempest-VolumesAssistedSnapshotsTest-1158723798 tempest-VolumesAssistedSnapshotsTest-1158723798-project-member] Lock "/opt/stack/data/nova/instances/07ec2c05-aaa9-46e8-8439-7aa5b9fca19d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:16:14 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-029e85ca-7e03-4020-8d79-5d02e89c22c3 tempest-VolumesAssistedSnapshotsTest-1158723798 tempest-VolumesAssistedSnapshotsTest-1158723798-project-member] Lock "/opt/stack/data/nova/instances/07ec2c05-aaa9-46e8-8439-7aa5b9fca19d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:16:14 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-029e85ca-7e03-4020-8d79-5d02e89c22c3 tempest-VolumesAssistedSnapshotsTest-1158723798 tempest-VolumesAssistedSnapshotsTest-1158723798-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b59f52a99fff51c56dd1edfb83892fb8f647f2f3 --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:16:15 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:16:15 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-029e85ca-7e03-4020-8d79-5d02e89c22c3 tempest-VolumesAssistedSnapshotsTest-1158723798 tempest-VolumesAssistedSnapshotsTest-1158723798-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b59f52a99fff51c56dd1edfb83892fb8f647f2f3 --force-share --output=json" returned: 0 in 0.250s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:16:15 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-029e85ca-7e03-4020-8d79-5d02e89c22c3 tempest-VolumesAssistedSnapshotsTest-1158723798 tempest-VolumesAssistedSnapshotsTest-1158723798-project-member] Acquiring lock "b59f52a99fff51c56dd1edfb83892fb8f647f2f3" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:16:15 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-029e85ca-7e03-4020-8d79-5d02e89c22c3 tempest-VolumesAssistedSnapshotsTest-1158723798 tempest-VolumesAssistedSnapshotsTest-1158723798-project-member] Lock "b59f52a99fff51c56dd1edfb83892fb8f647f2f3" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:16:15 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-029e85ca-7e03-4020-8d79-5d02e89c22c3 tempest-VolumesAssistedSnapshotsTest-1158723798 tempest-VolumesAssistedSnapshotsTest-1158723798-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b59f52a99fff51c56dd1edfb83892fb8f647f2f3 --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:16:15 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:16:15 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:16:15 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-029e85ca-7e03-4020-8d79-5d02e89c22c3 tempest-VolumesAssistedSnapshotsTest-1158723798 tempest-VolumesAssistedSnapshotsTest-1158723798-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b59f52a99fff51c56dd1edfb83892fb8f647f2f3 --force-share --output=json" returned: 0 in 0.268s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:16:15 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-029e85ca-7e03-4020-8d79-5d02e89c22c3 tempest-VolumesAssistedSnapshotsTest-1158723798 tempest-VolumesAssistedSnapshotsTest-1158723798-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b59f52a99fff51c56dd1edfb83892fb8f647f2f3,backing_fmt=raw /opt/stack/data/nova/instances/07ec2c05-aaa9-46e8-8439-7aa5b9fca19d/disk 1073741824 {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:16:15 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-029e85ca-7e03-4020-8d79-5d02e89c22c3 tempest-VolumesAssistedSnapshotsTest-1158723798 tempest-VolumesAssistedSnapshotsTest-1158723798-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b59f52a99fff51c56dd1edfb83892fb8f647f2f3,backing_fmt=raw /opt/stack/data/nova/instances/07ec2c05-aaa9-46e8-8439-7aa5b9fca19d/disk 1073741824" returned: 0 in 0.062s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:16:15 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-029e85ca-7e03-4020-8d79-5d02e89c22c3 tempest-VolumesAssistedSnapshotsTest-1158723798 tempest-VolumesAssistedSnapshotsTest-1158723798-project-member] Lock "b59f52a99fff51c56dd1edfb83892fb8f647f2f3" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.341s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:16:15 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-029e85ca-7e03-4020-8d79-5d02e89c22c3 tempest-VolumesAssistedSnapshotsTest-1158723798 tempest-VolumesAssistedSnapshotsTest-1158723798-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b59f52a99fff51c56dd1edfb83892fb8f647f2f3 --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:16:15 user nova-compute[75045]: DEBUG nova.network.neutron [None req-029e85ca-7e03-4020-8d79-5d02e89c22c3 tempest-VolumesAssistedSnapshotsTest-1158723798 tempest-VolumesAssistedSnapshotsTest-1158723798-project-member] [instance: 07ec2c05-aaa9-46e8-8439-7aa5b9fca19d] Successfully created port: 11c9f384-694c-41fc-b8b3-2db1d15ea84c {{(pid=75045) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 23:16:15 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-029e85ca-7e03-4020-8d79-5d02e89c22c3 tempest-VolumesAssistedSnapshotsTest-1158723798 tempest-VolumesAssistedSnapshotsTest-1158723798-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b59f52a99fff51c56dd1edfb83892fb8f647f2f3 --force-share --output=json" returned: 0 in 0.233s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:16:15 user nova-compute[75045]: DEBUG nova.virt.disk.api [None req-029e85ca-7e03-4020-8d79-5d02e89c22c3 tempest-VolumesAssistedSnapshotsTest-1158723798 tempest-VolumesAssistedSnapshotsTest-1158723798-project-member] Checking if we can resize image /opt/stack/data/nova/instances/07ec2c05-aaa9-46e8-8439-7aa5b9fca19d/disk. size=1073741824 {{(pid=75045) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 23:16:15 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-029e85ca-7e03-4020-8d79-5d02e89c22c3 tempest-VolumesAssistedSnapshotsTest-1158723798 tempest-VolumesAssistedSnapshotsTest-1158723798-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07ec2c05-aaa9-46e8-8439-7aa5b9fca19d/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:16:16 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:16:16 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:16:16 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-029e85ca-7e03-4020-8d79-5d02e89c22c3 tempest-VolumesAssistedSnapshotsTest-1158723798 tempest-VolumesAssistedSnapshotsTest-1158723798-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07ec2c05-aaa9-46e8-8439-7aa5b9fca19d/disk --force-share --output=json" returned: 0 in 0.281s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:16:16 user nova-compute[75045]: DEBUG nova.virt.disk.api [None req-029e85ca-7e03-4020-8d79-5d02e89c22c3 tempest-VolumesAssistedSnapshotsTest-1158723798 tempest-VolumesAssistedSnapshotsTest-1158723798-project-member] Cannot resize image /opt/stack/data/nova/instances/07ec2c05-aaa9-46e8-8439-7aa5b9fca19d/disk to a smaller size. {{(pid=75045) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 08 23:16:16 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-029e85ca-7e03-4020-8d79-5d02e89c22c3 tempest-VolumesAssistedSnapshotsTest-1158723798 tempest-VolumesAssistedSnapshotsTest-1158723798-project-member] [instance: 07ec2c05-aaa9-46e8-8439-7aa5b9fca19d] Created local disks {{(pid=75045) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 23:16:16 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-029e85ca-7e03-4020-8d79-5d02e89c22c3 tempest-VolumesAssistedSnapshotsTest-1158723798 tempest-VolumesAssistedSnapshotsTest-1158723798-project-member] [instance: 07ec2c05-aaa9-46e8-8439-7aa5b9fca19d] Ensure instance console log exists: /opt/stack/data/nova/instances/07ec2c05-aaa9-46e8-8439-7aa5b9fca19d/console.log {{(pid=75045) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 23:16:16 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-029e85ca-7e03-4020-8d79-5d02e89c22c3 tempest-VolumesAssistedSnapshotsTest-1158723798 tempest-VolumesAssistedSnapshotsTest-1158723798-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:16:16 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-029e85ca-7e03-4020-8d79-5d02e89c22c3 tempest-VolumesAssistedSnapshotsTest-1158723798 tempest-VolumesAssistedSnapshotsTest-1158723798-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:16:16 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-029e85ca-7e03-4020-8d79-5d02e89c22c3 tempest-VolumesAssistedSnapshotsTest-1158723798 tempest-VolumesAssistedSnapshotsTest-1158723798-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:16:16 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:16:16 user nova-compute[75045]: DEBUG nova.compute.manager [None req-3affb0f7-e0a0-4ae7-8009-13c232f58726 tempest-TaggedAttachmentsTest-1639503389 tempest-TaggedAttachmentsTest-1639503389-project-member] [instance: 1cb1b440-0073-4a53-a0a2-e2781e021866] Instance event wait completed in 0 seconds for  {{(pid=75045) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 23:16:16 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-3affb0f7-e0a0-4ae7-8009-13c232f58726 tempest-TaggedAttachmentsTest-1639503389 tempest-TaggedAttachmentsTest-1639503389-project-member] [instance: 1cb1b440-0073-4a53-a0a2-e2781e021866] Guest created on hypervisor {{(pid=75045) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 23:16:16 user nova-compute[75045]: INFO nova.virt.libvirt.driver [-] [instance: 1cb1b440-0073-4a53-a0a2-e2781e021866] Instance spawned successfully.
Nov 08 23:16:16 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-3affb0f7-e0a0-4ae7-8009-13c232f58726 tempest-TaggedAttachmentsTest-1639503389 tempest-TaggedAttachmentsTest-1639503389-project-member] [instance: 1cb1b440-0073-4a53-a0a2-e2781e021866] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75045) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 23:16:16 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-3affb0f7-e0a0-4ae7-8009-13c232f58726 tempest-TaggedAttachmentsTest-1639503389 tempest-TaggedAttachmentsTest-1639503389-project-member] [instance: 1cb1b440-0073-4a53-a0a2-e2781e021866] Found default for hw_cdrom_bus of ide {{(pid=75045) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 23:16:16 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-3affb0f7-e0a0-4ae7-8009-13c232f58726 tempest-TaggedAttachmentsTest-1639503389 tempest-TaggedAttachmentsTest-1639503389-project-member] [instance: 1cb1b440-0073-4a53-a0a2-e2781e021866] Found default for hw_disk_bus of virtio {{(pid=75045) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 23:16:16 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-3affb0f7-e0a0-4ae7-8009-13c232f58726 tempest-TaggedAttachmentsTest-1639503389 tempest-TaggedAttachmentsTest-1639503389-project-member] [instance: 1cb1b440-0073-4a53-a0a2-e2781e021866] Found default for hw_input_bus of None {{(pid=75045) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 23:16:16 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-3affb0f7-e0a0-4ae7-8009-13c232f58726 tempest-TaggedAttachmentsTest-1639503389 tempest-TaggedAttachmentsTest-1639503389-project-member] [instance: 1cb1b440-0073-4a53-a0a2-e2781e021866] Found default for hw_pointer_model of None {{(pid=75045) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 23:16:16 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-3affb0f7-e0a0-4ae7-8009-13c232f58726 tempest-TaggedAttachmentsTest-1639503389 tempest-TaggedAttachmentsTest-1639503389-project-member] [instance: 1cb1b440-0073-4a53-a0a2-e2781e021866] Found default for hw_video_model of virtio {{(pid=75045) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 23:16:16 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-3affb0f7-e0a0-4ae7-8009-13c232f58726 tempest-TaggedAttachmentsTest-1639503389 tempest-TaggedAttachmentsTest-1639503389-project-member] [instance: 1cb1b440-0073-4a53-a0a2-e2781e021866] Found default for hw_vif_model of virtio {{(pid=75045) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 23:16:16 user nova-compute[75045]: INFO nova.compute.manager [None req-3affb0f7-e0a0-4ae7-8009-13c232f58726 tempest-TaggedAttachmentsTest-1639503389 tempest-TaggedAttachmentsTest-1639503389-project-member] [instance: 1cb1b440-0073-4a53-a0a2-e2781e021866] Took 8.29 seconds to spawn the instance on the hypervisor.
Nov 08 23:16:16 user nova-compute[75045]: DEBUG nova.compute.manager [None req-3affb0f7-e0a0-4ae7-8009-13c232f58726 tempest-TaggedAttachmentsTest-1639503389 tempest-TaggedAttachmentsTest-1639503389-project-member] [instance: 1cb1b440-0073-4a53-a0a2-e2781e021866] Checking state {{(pid=75045) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 23:16:16 user nova-compute[75045]: INFO nova.compute.manager [None req-3affb0f7-e0a0-4ae7-8009-13c232f58726 tempest-TaggedAttachmentsTest-1639503389 tempest-TaggedAttachmentsTest-1639503389-project-member] [instance: 1cb1b440-0073-4a53-a0a2-e2781e021866] Took 9.25 seconds to build instance.
Nov 08 23:16:16 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-3affb0f7-e0a0-4ae7-8009-13c232f58726 tempest-TaggedAttachmentsTest-1639503389 tempest-TaggedAttachmentsTest-1639503389-project-member] Lock "1cb1b440-0073-4a53-a0a2-e2781e021866" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.434s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:16:16 user nova-compute[75045]: DEBUG nova.network.neutron [None req-029e85ca-7e03-4020-8d79-5d02e89c22c3 tempest-VolumesAssistedSnapshotsTest-1158723798 tempest-VolumesAssistedSnapshotsTest-1158723798-project-member] [instance: 07ec2c05-aaa9-46e8-8439-7aa5b9fca19d] Successfully updated port: 11c9f384-694c-41fc-b8b3-2db1d15ea84c {{(pid=75045) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 23:16:16 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-029e85ca-7e03-4020-8d79-5d02e89c22c3 tempest-VolumesAssistedSnapshotsTest-1158723798 tempest-VolumesAssistedSnapshotsTest-1158723798-project-member] Acquiring lock "refresh_cache-07ec2c05-aaa9-46e8-8439-7aa5b9fca19d" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 23:16:16 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-029e85ca-7e03-4020-8d79-5d02e89c22c3 tempest-VolumesAssistedSnapshotsTest-1158723798 tempest-VolumesAssistedSnapshotsTest-1158723798-project-member] Acquired lock "refresh_cache-07ec2c05-aaa9-46e8-8439-7aa5b9fca19d" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 23:16:16 user nova-compute[75045]: DEBUG nova.network.neutron [None req-029e85ca-7e03-4020-8d79-5d02e89c22c3 tempest-VolumesAssistedSnapshotsTest-1158723798 tempest-VolumesAssistedSnapshotsTest-1158723798-project-member] [instance: 07ec2c05-aaa9-46e8-8439-7aa5b9fca19d] Building network info cache for instance {{(pid=75045) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 23:16:16 user nova-compute[75045]: DEBUG nova.compute.manager [req-0d202830-310f-407d-aa6b-4d7e5c4046f5 req-78278da0-7ab7-48b8-ade3-c724a3bf9b38 service nova] [instance: 07ec2c05-aaa9-46e8-8439-7aa5b9fca19d] Received event network-changed-11c9f384-694c-41fc-b8b3-2db1d15ea84c {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:16:16 user nova-compute[75045]: DEBUG nova.compute.manager [req-0d202830-310f-407d-aa6b-4d7e5c4046f5 req-78278da0-7ab7-48b8-ade3-c724a3bf9b38 service nova] [instance: 07ec2c05-aaa9-46e8-8439-7aa5b9fca19d] Refreshing instance network info cache due to event network-changed-11c9f384-694c-41fc-b8b3-2db1d15ea84c. {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 23:16:16 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-0d202830-310f-407d-aa6b-4d7e5c4046f5 req-78278da0-7ab7-48b8-ade3-c724a3bf9b38 service nova] Acquiring lock "refresh_cache-07ec2c05-aaa9-46e8-8439-7aa5b9fca19d" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 23:16:16 user nova-compute[75045]: DEBUG nova.network.neutron [None req-029e85ca-7e03-4020-8d79-5d02e89c22c3 tempest-VolumesAssistedSnapshotsTest-1158723798 tempest-VolumesAssistedSnapshotsTest-1158723798-project-member] [instance: 07ec2c05-aaa9-46e8-8439-7aa5b9fca19d] Instance cache missing network info. {{(pid=75045) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 23:16:17 user nova-compute[75045]: DEBUG nova.network.neutron [None req-029e85ca-7e03-4020-8d79-5d02e89c22c3 tempest-VolumesAssistedSnapshotsTest-1158723798 tempest-VolumesAssistedSnapshotsTest-1158723798-project-member] [instance: 07ec2c05-aaa9-46e8-8439-7aa5b9fca19d] Updating instance_info_cache with network_info: [{"id": "11c9f384-694c-41fc-b8b3-2db1d15ea84c", "address": "fa:16:3e:22:d3:3d", "network": {"id": "c7d78679-f4e4-4060-86d0-ec146a216818", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-315788385-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07fac94bac644b72801b207a378f34ac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11c9f384-69", "ovs_interfaceid": "11c9f384-694c-41fc-b8b3-2db1d15ea84c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75045) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 23:16:17 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-029e85ca-7e03-4020-8d79-5d02e89c22c3 tempest-VolumesAssistedSnapshotsTest-1158723798 tempest-VolumesAssistedSnapshotsTest-1158723798-project-member] Releasing lock "refresh_cache-07ec2c05-aaa9-46e8-8439-7aa5b9fca19d" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 23:16:17 user nova-compute[75045]: DEBUG nova.compute.manager [None req-029e85ca-7e03-4020-8d79-5d02e89c22c3 tempest-VolumesAssistedSnapshotsTest-1158723798 tempest-VolumesAssistedSnapshotsTest-1158723798-project-member] [instance: 07ec2c05-aaa9-46e8-8439-7aa5b9fca19d] Instance network_info: |[{"id": "11c9f384-694c-41fc-b8b3-2db1d15ea84c", "address": "fa:16:3e:22:d3:3d", "network": {"id": "c7d78679-f4e4-4060-86d0-ec146a216818", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-315788385-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07fac94bac644b72801b207a378f34ac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11c9f384-69", "ovs_interfaceid": "11c9f384-694c-41fc-b8b3-2db1d15ea84c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75045) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 23:16:17 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-0d202830-310f-407d-aa6b-4d7e5c4046f5 req-78278da0-7ab7-48b8-ade3-c724a3bf9b38 service nova] Acquired lock "refresh_cache-07ec2c05-aaa9-46e8-8439-7aa5b9fca19d" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 23:16:17 user nova-compute[75045]: DEBUG nova.network.neutron [req-0d202830-310f-407d-aa6b-4d7e5c4046f5 req-78278da0-7ab7-48b8-ade3-c724a3bf9b38 service nova] [instance: 07ec2c05-aaa9-46e8-8439-7aa5b9fca19d] Refreshing network info cache for port 11c9f384-694c-41fc-b8b3-2db1d15ea84c {{(pid=75045) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 23:16:17 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-029e85ca-7e03-4020-8d79-5d02e89c22c3 tempest-VolumesAssistedSnapshotsTest-1158723798 tempest-VolumesAssistedSnapshotsTest-1158723798-project-member] [instance: 07ec2c05-aaa9-46e8-8439-7aa5b9fca19d] Start _get_guest_xml network_info=[{"id": "11c9f384-694c-41fc-b8b3-2db1d15ea84c", "address": "fa:16:3e:22:d3:3d", "network": {"id": "c7d78679-f4e4-4060-86d0-ec146a216818", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-315788385-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07fac94bac644b72801b207a378f34ac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11c9f384-69", "ovs_interfaceid": "11c9f384-694c-41fc-b8b3-2db1d15ea84c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T23:11:54Z,direct_url=<?>,disk_format='qcow2',id=a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b1beba2cc4e7465ea249e2225fb494dc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T23:11:56Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'disk_bus': 'virtio', 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': 'a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75045) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 23:16:17 user nova-compute[75045]: WARNING nova.virt.libvirt.driver [None req-029e85ca-7e03-4020-8d79-5d02e89c22c3 tempest-VolumesAssistedSnapshotsTest-1158723798 tempest-VolumesAssistedSnapshotsTest-1158723798-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 23:16:17 user nova-compute[75045]: WARNING nova.virt.libvirt.driver [None req-029e85ca-7e03-4020-8d79-5d02e89c22c3 tempest-VolumesAssistedSnapshotsTest-1158723798 tempest-VolumesAssistedSnapshotsTest-1158723798-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 23:16:17 user nova-compute[75045]: DEBUG nova.virt.libvirt.host [None req-029e85ca-7e03-4020-8d79-5d02e89c22c3 tempest-VolumesAssistedSnapshotsTest-1158723798 tempest-VolumesAssistedSnapshotsTest-1158723798-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75045) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 23:16:17 user nova-compute[75045]: DEBUG nova.virt.libvirt.host [None req-029e85ca-7e03-4020-8d79-5d02e89c22c3 tempest-VolumesAssistedSnapshotsTest-1158723798 tempest-VolumesAssistedSnapshotsTest-1158723798-project-member] CPU controller missing on host. {{(pid=75045) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 23:16:17 user nova-compute[75045]: DEBUG nova.virt.libvirt.host [None req-029e85ca-7e03-4020-8d79-5d02e89c22c3 tempest-VolumesAssistedSnapshotsTest-1158723798 tempest-VolumesAssistedSnapshotsTest-1158723798-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75045) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 23:16:17 user nova-compute[75045]: DEBUG nova.virt.libvirt.host [None req-029e85ca-7e03-4020-8d79-5d02e89c22c3 tempest-VolumesAssistedSnapshotsTest-1158723798 tempest-VolumesAssistedSnapshotsTest-1158723798-project-member] CPU controller found on host. {{(pid=75045) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 23:16:17 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-029e85ca-7e03-4020-8d79-5d02e89c22c3 tempest-VolumesAssistedSnapshotsTest-1158723798 tempest-VolumesAssistedSnapshotsTest-1158723798-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75045) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 23:16:17 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-029e85ca-7e03-4020-8d79-5d02e89c22c3 tempest-VolumesAssistedSnapshotsTest-1158723798 tempest-VolumesAssistedSnapshotsTest-1158723798-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T23:11:41Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T23:11:54Z,direct_url=<?>,disk_format='qcow2',id=a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b1beba2cc4e7465ea249e2225fb494dc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T23:11:56Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75045) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 23:16:17 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-029e85ca-7e03-4020-8d79-5d02e89c22c3 tempest-VolumesAssistedSnapshotsTest-1158723798 tempest-VolumesAssistedSnapshotsTest-1158723798-project-member] Flavor limits 0:0:0 {{(pid=75045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 23:16:17 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-029e85ca-7e03-4020-8d79-5d02e89c22c3 tempest-VolumesAssistedSnapshotsTest-1158723798 tempest-VolumesAssistedSnapshotsTest-1158723798-project-member] Image limits 0:0:0 {{(pid=75045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 23:16:17 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-029e85ca-7e03-4020-8d79-5d02e89c22c3 tempest-VolumesAssistedSnapshotsTest-1158723798 tempest-VolumesAssistedSnapshotsTest-1158723798-project-member] Flavor pref 0:0:0 {{(pid=75045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 23:16:17 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-029e85ca-7e03-4020-8d79-5d02e89c22c3 tempest-VolumesAssistedSnapshotsTest-1158723798 tempest-VolumesAssistedSnapshotsTest-1158723798-project-member] Image pref 0:0:0 {{(pid=75045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 23:16:17 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-029e85ca-7e03-4020-8d79-5d02e89c22c3 tempest-VolumesAssistedSnapshotsTest-1158723798 tempest-VolumesAssistedSnapshotsTest-1158723798-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 23:16:17 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-029e85ca-7e03-4020-8d79-5d02e89c22c3 tempest-VolumesAssistedSnapshotsTest-1158723798 tempest-VolumesAssistedSnapshotsTest-1158723798-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75045) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 23:16:17 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-029e85ca-7e03-4020-8d79-5d02e89c22c3 tempest-VolumesAssistedSnapshotsTest-1158723798 tempest-VolumesAssistedSnapshotsTest-1158723798-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75045) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 23:16:17 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-029e85ca-7e03-4020-8d79-5d02e89c22c3 tempest-VolumesAssistedSnapshotsTest-1158723798 tempest-VolumesAssistedSnapshotsTest-1158723798-project-member] Got 1 possible topologies {{(pid=75045) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 23:16:17 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-029e85ca-7e03-4020-8d79-5d02e89c22c3 tempest-VolumesAssistedSnapshotsTest-1158723798 tempest-VolumesAssistedSnapshotsTest-1158723798-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75045) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 23:16:17 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-029e85ca-7e03-4020-8d79-5d02e89c22c3 tempest-VolumesAssistedSnapshotsTest-1158723798 tempest-VolumesAssistedSnapshotsTest-1158723798-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75045) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 23:16:17 user nova-compute[75045]: DEBUG nova.virt.libvirt.vif [None req-029e85ca-7e03-4020-8d79-5d02e89c22c3 tempest-VolumesAssistedSnapshotsTest-1158723798 tempest-VolumesAssistedSnapshotsTest-1158723798-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T23:16:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-1746570331',display_name='tempest-VolumesAssistedSnapshotsTest-server-1746570331',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-1746570331',id=7,image_ref='a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMO+3rq+jd4dmTq/9fmMHTiEHe/EZDy55SNQ64pIFNsX69QCGFUEeJ0O+ELkMFRNoagvq20aUr1XhXUmotm4AMikPZwkMYAH+2+ja0MMjrIMlvdpd4dYwJ56c1cHeiFNhw==',key_name='tempest-keypair-1517163596',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='07fac94bac644b72801b207a378f34ac',ramdisk_id='',reservation_id='r-f2hec4rt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-1158723798',owner_user_name='tempest-VolumesAssistedSnapshotsTest-1158723798-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T23:16:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c45f30733b674d33ba6d18f50ac2ad0a',uuid=07ec2c05-aaa9-46e8-8439-7aa5b9fca19d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "11c9f384-694c-41fc-b8b3-2db1d15ea84c", "address": "fa:16:3e:22:d3:3d", "network": {"id": "c7d78679-f4e4-4060-86d0-ec146a216818", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-315788385-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07fac94bac644b72801b207a378f34ac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11c9f384-69", "ovs_interfaceid": "11c9f384-694c-41fc-b8b3-2db1d15ea84c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75045) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 23:16:17 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-029e85ca-7e03-4020-8d79-5d02e89c22c3 tempest-VolumesAssistedSnapshotsTest-1158723798 tempest-VolumesAssistedSnapshotsTest-1158723798-project-member] Converting VIF {"id": "11c9f384-694c-41fc-b8b3-2db1d15ea84c", "address": "fa:16:3e:22:d3:3d", "network": {"id": "c7d78679-f4e4-4060-86d0-ec146a216818", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-315788385-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07fac94bac644b72801b207a378f34ac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11c9f384-69", "ovs_interfaceid": "11c9f384-694c-41fc-b8b3-2db1d15ea84c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 23:16:17 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-029e85ca-7e03-4020-8d79-5d02e89c22c3 tempest-VolumesAssistedSnapshotsTest-1158723798 tempest-VolumesAssistedSnapshotsTest-1158723798-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:22:d3:3d,bridge_name='br-int',has_traffic_filtering=True,id=11c9f384-694c-41fc-b8b3-2db1d15ea84c,network=Network(c7d78679-f4e4-4060-86d0-ec146a216818),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap11c9f384-69') {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 23:16:17 user nova-compute[75045]: DEBUG nova.objects.instance [None req-029e85ca-7e03-4020-8d79-5d02e89c22c3 tempest-VolumesAssistedSnapshotsTest-1158723798 tempest-VolumesAssistedSnapshotsTest-1158723798-project-member] Lazy-loading 'pci_devices' on Instance uuid 07ec2c05-aaa9-46e8-8439-7aa5b9fca19d {{(pid=75045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 23:16:17 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-029e85ca-7e03-4020-8d79-5d02e89c22c3 tempest-VolumesAssistedSnapshotsTest-1158723798 tempest-VolumesAssistedSnapshotsTest-1158723798-project-member] [instance: 07ec2c05-aaa9-46e8-8439-7aa5b9fca19d] End _get_guest_xml xml=<domain type="kvm">
Nov 08 23:16:17 user nova-compute[75045]:   <uuid>07ec2c05-aaa9-46e8-8439-7aa5b9fca19d</uuid>
Nov 08 23:16:17 user nova-compute[75045]:   <name>instance-00000007</name>
Nov 08 23:16:17 user nova-compute[75045]:   <memory>524288</memory>
Nov 08 23:16:17 user nova-compute[75045]:   <vcpu>1</vcpu>
Nov 08 23:16:17 user nova-compute[75045]:   <metadata>
Nov 08 23:16:17 user nova-compute[75045]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 23:16:17 user nova-compute[75045]:       <nova:package version="0.0.0"/>
Nov 08 23:16:17 user nova-compute[75045]:       <nova:name>tempest-VolumesAssistedSnapshotsTest-server-1746570331</nova:name>
Nov 08 23:16:17 user nova-compute[75045]:       <nova:creationTime>2023-11-08 23:16:17</nova:creationTime>
Nov 08 23:16:17 user nova-compute[75045]:       <nova:flavor name="m1.tiny">
Nov 08 23:16:17 user nova-compute[75045]:         <nova:memory>512</nova:memory>
Nov 08 23:16:17 user nova-compute[75045]:         <nova:disk>1</nova:disk>
Nov 08 23:16:17 user nova-compute[75045]:         <nova:swap>0</nova:swap>
Nov 08 23:16:17 user nova-compute[75045]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 23:16:17 user nova-compute[75045]:         <nova:vcpus>1</nova:vcpus>
Nov 08 23:16:17 user nova-compute[75045]:       </nova:flavor>
Nov 08 23:16:17 user nova-compute[75045]:       <nova:owner>
Nov 08 23:16:17 user nova-compute[75045]:         <nova:user uuid="c45f30733b674d33ba6d18f50ac2ad0a">tempest-VolumesAssistedSnapshotsTest-1158723798-project-member</nova:user>
Nov 08 23:16:17 user nova-compute[75045]:         <nova:project uuid="07fac94bac644b72801b207a378f34ac">tempest-VolumesAssistedSnapshotsTest-1158723798</nova:project>
Nov 08 23:16:17 user nova-compute[75045]:       </nova:owner>
Nov 08 23:16:17 user nova-compute[75045]:       <nova:root type="image" uuid="a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb"/>
Nov 08 23:16:17 user nova-compute[75045]:       <nova:ports>
Nov 08 23:16:17 user nova-compute[75045]:         <nova:port uuid="11c9f384-694c-41fc-b8b3-2db1d15ea84c">
Nov 08 23:16:17 user nova-compute[75045]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 08 23:16:17 user nova-compute[75045]:         </nova:port>
Nov 08 23:16:17 user nova-compute[75045]:       </nova:ports>
Nov 08 23:16:17 user nova-compute[75045]:     </nova:instance>
Nov 08 23:16:17 user nova-compute[75045]:   </metadata>
Nov 08 23:16:17 user nova-compute[75045]:   <sysinfo type="smbios">
Nov 08 23:16:17 user nova-compute[75045]:     <system>
Nov 08 23:16:17 user nova-compute[75045]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 23:16:17 user nova-compute[75045]:       <entry name="product">OpenStack Nova</entry>
Nov 08 23:16:17 user nova-compute[75045]:       <entry name="version">0.0.0</entry>
Nov 08 23:16:17 user nova-compute[75045]:       <entry name="serial">07ec2c05-aaa9-46e8-8439-7aa5b9fca19d</entry>
Nov 08 23:16:17 user nova-compute[75045]:       <entry name="uuid">07ec2c05-aaa9-46e8-8439-7aa5b9fca19d</entry>
Nov 08 23:16:17 user nova-compute[75045]:       <entry name="family">Virtual Machine</entry>
Nov 08 23:16:17 user nova-compute[75045]:     </system>
Nov 08 23:16:17 user nova-compute[75045]:   </sysinfo>
Nov 08 23:16:17 user nova-compute[75045]:   <os>
Nov 08 23:16:17 user nova-compute[75045]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 23:16:17 user nova-compute[75045]:     <boot dev="hd"/>
Nov 08 23:16:17 user nova-compute[75045]:     <smbios mode="sysinfo"/>
Nov 08 23:16:17 user nova-compute[75045]:   </os>
Nov 08 23:16:17 user nova-compute[75045]:   <features>
Nov 08 23:16:17 user nova-compute[75045]:     <acpi/>
Nov 08 23:16:17 user nova-compute[75045]:     <apic/>
Nov 08 23:16:17 user nova-compute[75045]:     <vmcoreinfo/>
Nov 08 23:16:17 user nova-compute[75045]:   </features>
Nov 08 23:16:17 user nova-compute[75045]:   <clock offset="utc">
Nov 08 23:16:17 user nova-compute[75045]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 23:16:17 user nova-compute[75045]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 23:16:17 user nova-compute[75045]:     <timer name="hpet" present="no"/>
Nov 08 23:16:17 user nova-compute[75045]:   </clock>
Nov 08 23:16:17 user nova-compute[75045]:   <cpu mode="custom" match="exact">
Nov 08 23:16:17 user nova-compute[75045]:     <model>Nehalem</model>
Nov 08 23:16:17 user nova-compute[75045]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 23:16:17 user nova-compute[75045]:   </cpu>
Nov 08 23:16:17 user nova-compute[75045]:   <devices>
Nov 08 23:16:17 user nova-compute[75045]:     <disk type="file" device="disk">
Nov 08 23:16:17 user nova-compute[75045]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 23:16:17 user nova-compute[75045]:       <source file="/opt/stack/data/nova/instances/07ec2c05-aaa9-46e8-8439-7aa5b9fca19d/disk"/>
Nov 08 23:16:17 user nova-compute[75045]:       <target dev="vda" bus="virtio"/>
Nov 08 23:16:17 user nova-compute[75045]:     </disk>
Nov 08 23:16:17 user nova-compute[75045]:     <interface type="ethernet">
Nov 08 23:16:17 user nova-compute[75045]:       <mac address="fa:16:3e:22:d3:3d"/>
Nov 08 23:16:17 user nova-compute[75045]:       <model type="virtio"/>
Nov 08 23:16:17 user nova-compute[75045]:       <mtu size="1442"/>
Nov 08 23:16:17 user nova-compute[75045]:       <target dev="tap11c9f384-69"/>
Nov 08 23:16:17 user nova-compute[75045]:     </interface>
Nov 08 23:16:17 user nova-compute[75045]:     <serial type="pty">
Nov 08 23:16:17 user nova-compute[75045]:       <log file="/opt/stack/data/nova/instances/07ec2c05-aaa9-46e8-8439-7aa5b9fca19d/console.log" append="off"/>
Nov 08 23:16:17 user nova-compute[75045]:     </serial>
Nov 08 23:16:17 user nova-compute[75045]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 23:16:17 user nova-compute[75045]:     <video>
Nov 08 23:16:17 user nova-compute[75045]:       <model type="virtio"/>
Nov 08 23:16:17 user nova-compute[75045]:     </video>
Nov 08 23:16:17 user nova-compute[75045]:     <rng model="virtio">
Nov 08 23:16:17 user nova-compute[75045]:       <backend model="random">/dev/urandom</backend>
Nov 08 23:16:17 user nova-compute[75045]:     </rng>
Nov 08 23:16:17 user nova-compute[75045]:     <controller type="usb" index="0" model="none"/>
Nov 08 23:16:17 user nova-compute[75045]:     <memballoon model="virtio">
Nov 08 23:16:17 user nova-compute[75045]:       <stats period="10"/>
Nov 08 23:16:17 user nova-compute[75045]:     </memballoon>
Nov 08 23:16:17 user nova-compute[75045]:   </devices>
Nov 08 23:16:17 user nova-compute[75045]: </domain>
Nov 08 23:16:17 user nova-compute[75045]:  {{(pid=75045) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 23:16:17 user nova-compute[75045]: DEBUG nova.virt.libvirt.vif [None req-029e85ca-7e03-4020-8d79-5d02e89c22c3 tempest-VolumesAssistedSnapshotsTest-1158723798 tempest-VolumesAssistedSnapshotsTest-1158723798-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T23:16:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-1746570331',display_name='tempest-VolumesAssistedSnapshotsTest-server-1746570331',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-1746570331',id=7,image_ref='a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMO+3rq+jd4dmTq/9fmMHTiEHe/EZDy55SNQ64pIFNsX69QCGFUEeJ0O+ELkMFRNoagvq20aUr1XhXUmotm4AMikPZwkMYAH+2+ja0MMjrIMlvdpd4dYwJ56c1cHeiFNhw==',key_name='tempest-keypair-1517163596',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='07fac94bac644b72801b207a378f34ac',ramdisk_id='',reservation_id='r-f2hec4rt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-1158723798',owner_user_name='tempest-VolumesAssistedSnapshotsTest-1158723798-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T23:16:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c45f30733b674d33ba6d18f50ac2ad0a',uuid=07ec2c05-aaa9-46e8-8439-7aa5b9fca19d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "11c9f384-694c-41fc-b8b3-2db1d15ea84c", "address": "fa:16:3e:22:d3:3d", "network": {"id": "c7d78679-f4e4-4060-86d0-ec146a216818", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-315788385-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07fac94bac644b72801b207a378f34ac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11c9f384-69", "ovs_interfaceid": "11c9f384-694c-41fc-b8b3-2db1d15ea84c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75045) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 23:16:17 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-029e85ca-7e03-4020-8d79-5d02e89c22c3 tempest-VolumesAssistedSnapshotsTest-1158723798 tempest-VolumesAssistedSnapshotsTest-1158723798-project-member] Converting VIF {"id": "11c9f384-694c-41fc-b8b3-2db1d15ea84c", "address": "fa:16:3e:22:d3:3d", "network": {"id": "c7d78679-f4e4-4060-86d0-ec146a216818", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-315788385-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07fac94bac644b72801b207a378f34ac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11c9f384-69", "ovs_interfaceid": "11c9f384-694c-41fc-b8b3-2db1d15ea84c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 23:16:17 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-029e85ca-7e03-4020-8d79-5d02e89c22c3 tempest-VolumesAssistedSnapshotsTest-1158723798 tempest-VolumesAssistedSnapshotsTest-1158723798-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:22:d3:3d,bridge_name='br-int',has_traffic_filtering=True,id=11c9f384-694c-41fc-b8b3-2db1d15ea84c,network=Network(c7d78679-f4e4-4060-86d0-ec146a216818),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap11c9f384-69') {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 23:16:17 user nova-compute[75045]: DEBUG os_vif [None req-029e85ca-7e03-4020-8d79-5d02e89c22c3 tempest-VolumesAssistedSnapshotsTest-1158723798 tempest-VolumesAssistedSnapshotsTest-1158723798-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:22:d3:3d,bridge_name='br-int',has_traffic_filtering=True,id=11c9f384-694c-41fc-b8b3-2db1d15ea84c,network=Network(c7d78679-f4e4-4060-86d0-ec146a216818),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap11c9f384-69') {{(pid=75045) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 23:16:17 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:16:17 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:16:17 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 23:16:17 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:16:17 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd30fa50e-b8b4-572f-b7a7-7c15f3411725', '_type': 'linux-noop'}}, row=False) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:16:17 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 23:16:17 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:16:17 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap11c9f384-69, may_exist=True, interface_attrs={}) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:16:17 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap11c9f384-69, col_values=(('qos', UUID('28c0ff58-5bcb-4c55-80dc-13400db9be3c')),), if_exists=True) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:16:17 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap11c9f384-69, col_values=(('external_ids', {'iface-id': '11c9f384-694c-41fc-b8b3-2db1d15ea84c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:22:d3:3d', 'vm-uuid': '07ec2c05-aaa9-46e8-8439-7aa5b9fca19d'}),), if_exists=True) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:16:17 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 23:16:17 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:16:17 user nova-compute[75045]: INFO os_vif [None req-029e85ca-7e03-4020-8d79-5d02e89c22c3 tempest-VolumesAssistedSnapshotsTest-1158723798 tempest-VolumesAssistedSnapshotsTest-1158723798-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:22:d3:3d,bridge_name='br-int',has_traffic_filtering=True,id=11c9f384-694c-41fc-b8b3-2db1d15ea84c,network=Network(c7d78679-f4e4-4060-86d0-ec146a216818),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap11c9f384-69')
Nov 08 23:16:17 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-029e85ca-7e03-4020-8d79-5d02e89c22c3 tempest-VolumesAssistedSnapshotsTest-1158723798 tempest-VolumesAssistedSnapshotsTest-1158723798-project-member] No BDM found with device name vda, not building metadata. {{(pid=75045) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 23:16:17 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-029e85ca-7e03-4020-8d79-5d02e89c22c3 tempest-VolumesAssistedSnapshotsTest-1158723798 tempest-VolumesAssistedSnapshotsTest-1158723798-project-member] No VIF found with MAC fa:16:3e:22:d3:3d, not building metadata {{(pid=75045) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 23:16:17 user nova-compute[75045]: DEBUG nova.compute.manager [req-de4cc1a8-651e-486b-a7b2-38448307a8fc req-ce6b9efa-6d0f-4a49-9166-434cc896bdd3 service nova] [instance: b9bd3096-92eb-4aae-8619-2725ed9acc2b] Received event network-vif-plugged-aea70d63-158f-4f6e-ac36-1c342bd5be4d {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:16:17 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-de4cc1a8-651e-486b-a7b2-38448307a8fc req-ce6b9efa-6d0f-4a49-9166-434cc896bdd3 service nova] Acquiring lock "b9bd3096-92eb-4aae-8619-2725ed9acc2b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:16:17 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-de4cc1a8-651e-486b-a7b2-38448307a8fc req-ce6b9efa-6d0f-4a49-9166-434cc896bdd3 service nova] Lock "b9bd3096-92eb-4aae-8619-2725ed9acc2b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:16:17 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-de4cc1a8-651e-486b-a7b2-38448307a8fc req-ce6b9efa-6d0f-4a49-9166-434cc896bdd3 service nova] Lock "b9bd3096-92eb-4aae-8619-2725ed9acc2b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:16:17 user nova-compute[75045]: DEBUG nova.compute.manager [req-de4cc1a8-651e-486b-a7b2-38448307a8fc req-ce6b9efa-6d0f-4a49-9166-434cc896bdd3 service nova] [instance: b9bd3096-92eb-4aae-8619-2725ed9acc2b] No waiting events found dispatching network-vif-plugged-aea70d63-158f-4f6e-ac36-1c342bd5be4d {{(pid=75045) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 23:16:17 user nova-compute[75045]: WARNING nova.compute.manager [req-de4cc1a8-651e-486b-a7b2-38448307a8fc req-ce6b9efa-6d0f-4a49-9166-434cc896bdd3 service nova] [instance: b9bd3096-92eb-4aae-8619-2725ed9acc2b] Received unexpected event network-vif-plugged-aea70d63-158f-4f6e-ac36-1c342bd5be4d for instance with vm_state active and task_state None.
Nov 08 23:16:18 user nova-compute[75045]: DEBUG nova.network.neutron [req-0d202830-310f-407d-aa6b-4d7e5c4046f5 req-78278da0-7ab7-48b8-ade3-c724a3bf9b38 service nova] [instance: 07ec2c05-aaa9-46e8-8439-7aa5b9fca19d] Updated VIF entry in instance network info cache for port 11c9f384-694c-41fc-b8b3-2db1d15ea84c. {{(pid=75045) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 23:16:18 user nova-compute[75045]: DEBUG nova.network.neutron [req-0d202830-310f-407d-aa6b-4d7e5c4046f5 req-78278da0-7ab7-48b8-ade3-c724a3bf9b38 service nova] [instance: 07ec2c05-aaa9-46e8-8439-7aa5b9fca19d] Updating instance_info_cache with network_info: [{"id": "11c9f384-694c-41fc-b8b3-2db1d15ea84c", "address": "fa:16:3e:22:d3:3d", "network": {"id": "c7d78679-f4e4-4060-86d0-ec146a216818", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-315788385-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07fac94bac644b72801b207a378f34ac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11c9f384-69", "ovs_interfaceid": "11c9f384-694c-41fc-b8b3-2db1d15ea84c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75045) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 23:16:18 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-0d202830-310f-407d-aa6b-4d7e5c4046f5 req-78278da0-7ab7-48b8-ade3-c724a3bf9b38 service nova] Releasing lock "refresh_cache-07ec2c05-aaa9-46e8-8439-7aa5b9fca19d" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 23:16:18 user nova-compute[75045]: DEBUG nova.compute.manager [None req-56afaf56-aa01-4413-89f2-23b32bd395cc tempest-TestVolumeSwap-1282852572 tempest-TestVolumeSwap-1282852572-project-member] [instance: fde91f7c-31e3-456c-b252-6ce37fa3b600] Instance event wait completed in 0 seconds for  {{(pid=75045) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 23:16:18 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-56afaf56-aa01-4413-89f2-23b32bd395cc tempest-TestVolumeSwap-1282852572 tempest-TestVolumeSwap-1282852572-project-member] [instance: fde91f7c-31e3-456c-b252-6ce37fa3b600] Guest created on hypervisor {{(pid=75045) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 23:16:18 user nova-compute[75045]: INFO nova.virt.libvirt.driver [-] [instance: fde91f7c-31e3-456c-b252-6ce37fa3b600] Instance spawned successfully.
Nov 08 23:16:18 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-56afaf56-aa01-4413-89f2-23b32bd395cc tempest-TestVolumeSwap-1282852572 tempest-TestVolumeSwap-1282852572-project-member] [instance: fde91f7c-31e3-456c-b252-6ce37fa3b600] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75045) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 23:16:18 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-56afaf56-aa01-4413-89f2-23b32bd395cc tempest-TestVolumeSwap-1282852572 tempest-TestVolumeSwap-1282852572-project-member] [instance: fde91f7c-31e3-456c-b252-6ce37fa3b600] Found default for hw_cdrom_bus of ide {{(pid=75045) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 23:16:18 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-56afaf56-aa01-4413-89f2-23b32bd395cc tempest-TestVolumeSwap-1282852572 tempest-TestVolumeSwap-1282852572-project-member] [instance: fde91f7c-31e3-456c-b252-6ce37fa3b600] Found default for hw_disk_bus of virtio {{(pid=75045) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 23:16:18 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-56afaf56-aa01-4413-89f2-23b32bd395cc tempest-TestVolumeSwap-1282852572 tempest-TestVolumeSwap-1282852572-project-member] [instance: fde91f7c-31e3-456c-b252-6ce37fa3b600] Found default for hw_input_bus of None {{(pid=75045) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 23:16:18 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-56afaf56-aa01-4413-89f2-23b32bd395cc tempest-TestVolumeSwap-1282852572 tempest-TestVolumeSwap-1282852572-project-member] [instance: fde91f7c-31e3-456c-b252-6ce37fa3b600] Found default for hw_pointer_model of None {{(pid=75045) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 23:16:18 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-56afaf56-aa01-4413-89f2-23b32bd395cc tempest-TestVolumeSwap-1282852572 tempest-TestVolumeSwap-1282852572-project-member] [instance: fde91f7c-31e3-456c-b252-6ce37fa3b600] Found default for hw_video_model of virtio {{(pid=75045) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 23:16:18 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-56afaf56-aa01-4413-89f2-23b32bd395cc tempest-TestVolumeSwap-1282852572 tempest-TestVolumeSwap-1282852572-project-member] [instance: fde91f7c-31e3-456c-b252-6ce37fa3b600] Found default for hw_vif_model of virtio {{(pid=75045) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 23:16:18 user nova-compute[75045]: INFO nova.compute.manager [None req-56afaf56-aa01-4413-89f2-23b32bd395cc tempest-TestVolumeSwap-1282852572 tempest-TestVolumeSwap-1282852572-project-member] [instance: fde91f7c-31e3-456c-b252-6ce37fa3b600] Took 8.64 seconds to spawn the instance on the hypervisor.
Nov 08 23:16:18 user nova-compute[75045]: DEBUG nova.compute.manager [None req-56afaf56-aa01-4413-89f2-23b32bd395cc tempest-TestVolumeSwap-1282852572 tempest-TestVolumeSwap-1282852572-project-member] [instance: fde91f7c-31e3-456c-b252-6ce37fa3b600] Checking state {{(pid=75045) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 23:16:18 user nova-compute[75045]: INFO nova.compute.manager [None req-56afaf56-aa01-4413-89f2-23b32bd395cc tempest-TestVolumeSwap-1282852572 tempest-TestVolumeSwap-1282852572-project-member] [instance: fde91f7c-31e3-456c-b252-6ce37fa3b600] Took 9.81 seconds to build instance.
Nov 08 23:16:18 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-56afaf56-aa01-4413-89f2-23b32bd395cc tempest-TestVolumeSwap-1282852572 tempest-TestVolumeSwap-1282852572-project-member] Lock "fde91f7c-31e3-456c-b252-6ce37fa3b600" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.034s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:16:19 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:16:19 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:16:19 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:16:19 user nova-compute[75045]: DEBUG nova.compute.manager [req-996f4995-8ef7-4499-821f-efda1ddfe620 req-46158f93-add3-4a2a-847a-32342f076230 service nova] [instance: b9bd3096-92eb-4aae-8619-2725ed9acc2b] Received event network-vif-plugged-aea70d63-158f-4f6e-ac36-1c342bd5be4d {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:16:19 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-996f4995-8ef7-4499-821f-efda1ddfe620 req-46158f93-add3-4a2a-847a-32342f076230 service nova] Acquiring lock "b9bd3096-92eb-4aae-8619-2725ed9acc2b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:16:19 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-996f4995-8ef7-4499-821f-efda1ddfe620 req-46158f93-add3-4a2a-847a-32342f076230 service nova] Lock "b9bd3096-92eb-4aae-8619-2725ed9acc2b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:16:19 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-996f4995-8ef7-4499-821f-efda1ddfe620 req-46158f93-add3-4a2a-847a-32342f076230 service nova] Lock "b9bd3096-92eb-4aae-8619-2725ed9acc2b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:16:19 user nova-compute[75045]: DEBUG nova.compute.manager [req-996f4995-8ef7-4499-821f-efda1ddfe620 req-46158f93-add3-4a2a-847a-32342f076230 service nova] [instance: b9bd3096-92eb-4aae-8619-2725ed9acc2b] No waiting events found dispatching network-vif-plugged-aea70d63-158f-4f6e-ac36-1c342bd5be4d {{(pid=75045) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 23:16:19 user nova-compute[75045]: WARNING nova.compute.manager [req-996f4995-8ef7-4499-821f-efda1ddfe620 req-46158f93-add3-4a2a-847a-32342f076230 service nova] [instance: b9bd3096-92eb-4aae-8619-2725ed9acc2b] Received unexpected event network-vif-plugged-aea70d63-158f-4f6e-ac36-1c342bd5be4d for instance with vm_state active and task_state None.
Nov 08 23:16:19 user nova-compute[75045]: DEBUG nova.compute.manager [req-996f4995-8ef7-4499-821f-efda1ddfe620 req-46158f93-add3-4a2a-847a-32342f076230 service nova] [instance: 1cb1b440-0073-4a53-a0a2-e2781e021866] Received event network-vif-plugged-892284f7-b4b9-4b5b-82c7-62300cd8afb7 {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:16:19 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-996f4995-8ef7-4499-821f-efda1ddfe620 req-46158f93-add3-4a2a-847a-32342f076230 service nova] Acquiring lock "1cb1b440-0073-4a53-a0a2-e2781e021866-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:16:19 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-996f4995-8ef7-4499-821f-efda1ddfe620 req-46158f93-add3-4a2a-847a-32342f076230 service nova] Lock "1cb1b440-0073-4a53-a0a2-e2781e021866-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:16:19 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-996f4995-8ef7-4499-821f-efda1ddfe620 req-46158f93-add3-4a2a-847a-32342f076230 service nova] Lock "1cb1b440-0073-4a53-a0a2-e2781e021866-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:16:19 user nova-compute[75045]: DEBUG nova.compute.manager [req-996f4995-8ef7-4499-821f-efda1ddfe620 req-46158f93-add3-4a2a-847a-32342f076230 service nova] [instance: 1cb1b440-0073-4a53-a0a2-e2781e021866] No waiting events found dispatching network-vif-plugged-892284f7-b4b9-4b5b-82c7-62300cd8afb7 {{(pid=75045) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 23:16:19 user nova-compute[75045]: WARNING nova.compute.manager [req-996f4995-8ef7-4499-821f-efda1ddfe620 req-46158f93-add3-4a2a-847a-32342f076230 service nova] [instance: 1cb1b440-0073-4a53-a0a2-e2781e021866] Received unexpected event network-vif-plugged-892284f7-b4b9-4b5b-82c7-62300cd8afb7 for instance with vm_state active and task_state None.
Nov 08 23:16:19 user nova-compute[75045]: DEBUG nova.compute.manager [req-996f4995-8ef7-4499-821f-efda1ddfe620 req-46158f93-add3-4a2a-847a-32342f076230 service nova] [instance: 1cb1b440-0073-4a53-a0a2-e2781e021866] Received event network-vif-plugged-892284f7-b4b9-4b5b-82c7-62300cd8afb7 {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:16:19 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-996f4995-8ef7-4499-821f-efda1ddfe620 req-46158f93-add3-4a2a-847a-32342f076230 service nova] Acquiring lock "1cb1b440-0073-4a53-a0a2-e2781e021866-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:16:19 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-996f4995-8ef7-4499-821f-efda1ddfe620 req-46158f93-add3-4a2a-847a-32342f076230 service nova] Lock "1cb1b440-0073-4a53-a0a2-e2781e021866-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:16:19 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-996f4995-8ef7-4499-821f-efda1ddfe620 req-46158f93-add3-4a2a-847a-32342f076230 service nova] Lock "1cb1b440-0073-4a53-a0a2-e2781e021866-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:16:19 user nova-compute[75045]: DEBUG nova.compute.manager [req-996f4995-8ef7-4499-821f-efda1ddfe620 req-46158f93-add3-4a2a-847a-32342f076230 service nova] [instance: 1cb1b440-0073-4a53-a0a2-e2781e021866] No waiting events found dispatching network-vif-plugged-892284f7-b4b9-4b5b-82c7-62300cd8afb7 {{(pid=75045) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 23:16:19 user nova-compute[75045]: WARNING nova.compute.manager [req-996f4995-8ef7-4499-821f-efda1ddfe620 req-46158f93-add3-4a2a-847a-32342f076230 service nova] [instance: 1cb1b440-0073-4a53-a0a2-e2781e021866] Received unexpected event network-vif-plugged-892284f7-b4b9-4b5b-82c7-62300cd8afb7 for instance with vm_state active and task_state None.
Nov 08 23:16:19 user nova-compute[75045]: DEBUG nova.compute.manager [req-996f4995-8ef7-4499-821f-efda1ddfe620 req-46158f93-add3-4a2a-847a-32342f076230 service nova] [instance: fde91f7c-31e3-456c-b252-6ce37fa3b600] Received event network-vif-plugged-cf7f2506-395a-4404-a256-6600a5c0a06e {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:16:19 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-996f4995-8ef7-4499-821f-efda1ddfe620 req-46158f93-add3-4a2a-847a-32342f076230 service nova] Acquiring lock "fde91f7c-31e3-456c-b252-6ce37fa3b600-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:16:19 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-996f4995-8ef7-4499-821f-efda1ddfe620 req-46158f93-add3-4a2a-847a-32342f076230 service nova] Lock "fde91f7c-31e3-456c-b252-6ce37fa3b600-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:16:19 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-996f4995-8ef7-4499-821f-efda1ddfe620 req-46158f93-add3-4a2a-847a-32342f076230 service nova] Lock "fde91f7c-31e3-456c-b252-6ce37fa3b600-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:16:19 user nova-compute[75045]: DEBUG nova.compute.manager [req-996f4995-8ef7-4499-821f-efda1ddfe620 req-46158f93-add3-4a2a-847a-32342f076230 service nova] [instance: fde91f7c-31e3-456c-b252-6ce37fa3b600] No waiting events found dispatching network-vif-plugged-cf7f2506-395a-4404-a256-6600a5c0a06e {{(pid=75045) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 23:16:19 user nova-compute[75045]: WARNING nova.compute.manager [req-996f4995-8ef7-4499-821f-efda1ddfe620 req-46158f93-add3-4a2a-847a-32342f076230 service nova] [instance: fde91f7c-31e3-456c-b252-6ce37fa3b600] Received unexpected event network-vif-plugged-cf7f2506-395a-4404-a256-6600a5c0a06e for instance with vm_state active and task_state None.
Nov 08 23:16:19 user nova-compute[75045]: DEBUG nova.compute.manager [req-996f4995-8ef7-4499-821f-efda1ddfe620 req-46158f93-add3-4a2a-847a-32342f076230 service nova] [instance: fde91f7c-31e3-456c-b252-6ce37fa3b600] Received event network-vif-plugged-cf7f2506-395a-4404-a256-6600a5c0a06e {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:16:19 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-996f4995-8ef7-4499-821f-efda1ddfe620 req-46158f93-add3-4a2a-847a-32342f076230 service nova] Acquiring lock "fde91f7c-31e3-456c-b252-6ce37fa3b600-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:16:19 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-996f4995-8ef7-4499-821f-efda1ddfe620 req-46158f93-add3-4a2a-847a-32342f076230 service nova] Lock "fde91f7c-31e3-456c-b252-6ce37fa3b600-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:16:19 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-996f4995-8ef7-4499-821f-efda1ddfe620 req-46158f93-add3-4a2a-847a-32342f076230 service nova] Lock "fde91f7c-31e3-456c-b252-6ce37fa3b600-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:16:19 user nova-compute[75045]: DEBUG nova.compute.manager [req-996f4995-8ef7-4499-821f-efda1ddfe620 req-46158f93-add3-4a2a-847a-32342f076230 service nova] [instance: fde91f7c-31e3-456c-b252-6ce37fa3b600] No waiting events found dispatching network-vif-plugged-cf7f2506-395a-4404-a256-6600a5c0a06e {{(pid=75045) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 23:16:19 user nova-compute[75045]: WARNING nova.compute.manager [req-996f4995-8ef7-4499-821f-efda1ddfe620 req-46158f93-add3-4a2a-847a-32342f076230 service nova] [instance: fde91f7c-31e3-456c-b252-6ce37fa3b600] Received unexpected event network-vif-plugged-cf7f2506-395a-4404-a256-6600a5c0a06e for instance with vm_state active and task_state None.
Nov 08 23:16:19 user nova-compute[75045]: DEBUG nova.compute.manager [req-97ab2f39-7a8b-43fa-a563-6a0e12552d47 req-42411080-47b2-4e8d-8137-1c687d4bf3b5 service nova] [instance: 07ec2c05-aaa9-46e8-8439-7aa5b9fca19d] Received event network-vif-plugged-11c9f384-694c-41fc-b8b3-2db1d15ea84c {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:16:19 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-97ab2f39-7a8b-43fa-a563-6a0e12552d47 req-42411080-47b2-4e8d-8137-1c687d4bf3b5 service nova] Acquiring lock "07ec2c05-aaa9-46e8-8439-7aa5b9fca19d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:16:19 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-97ab2f39-7a8b-43fa-a563-6a0e12552d47 req-42411080-47b2-4e8d-8137-1c687d4bf3b5 service nova] Lock "07ec2c05-aaa9-46e8-8439-7aa5b9fca19d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:16:19 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-97ab2f39-7a8b-43fa-a563-6a0e12552d47 req-42411080-47b2-4e8d-8137-1c687d4bf3b5 service nova] Lock "07ec2c05-aaa9-46e8-8439-7aa5b9fca19d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:16:19 user nova-compute[75045]: DEBUG nova.compute.manager [req-97ab2f39-7a8b-43fa-a563-6a0e12552d47 req-42411080-47b2-4e8d-8137-1c687d4bf3b5 service nova] [instance: 07ec2c05-aaa9-46e8-8439-7aa5b9fca19d] No waiting events found dispatching network-vif-plugged-11c9f384-694c-41fc-b8b3-2db1d15ea84c {{(pid=75045) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 23:16:19 user nova-compute[75045]: WARNING nova.compute.manager [req-97ab2f39-7a8b-43fa-a563-6a0e12552d47 req-42411080-47b2-4e8d-8137-1c687d4bf3b5 service nova] [instance: 07ec2c05-aaa9-46e8-8439-7aa5b9fca19d] Received unexpected event network-vif-plugged-11c9f384-694c-41fc-b8b3-2db1d15ea84c for instance with vm_state building and task_state spawning.
Nov 08 23:16:20 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:16:20 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:16:20 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:16:20 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:16:20 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:16:21 user nova-compute[75045]: DEBUG nova.compute.manager [req-a2842f0e-17d1-4ab5-908a-61d6e995cc8d req-7038e4da-25cd-4817-878e-45d74c136bb4 service nova] [instance: 07ec2c05-aaa9-46e8-8439-7aa5b9fca19d] Received event network-vif-plugged-11c9f384-694c-41fc-b8b3-2db1d15ea84c {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:16:21 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-a2842f0e-17d1-4ab5-908a-61d6e995cc8d req-7038e4da-25cd-4817-878e-45d74c136bb4 service nova] Acquiring lock "07ec2c05-aaa9-46e8-8439-7aa5b9fca19d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:16:21 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-a2842f0e-17d1-4ab5-908a-61d6e995cc8d req-7038e4da-25cd-4817-878e-45d74c136bb4 service nova] Lock "07ec2c05-aaa9-46e8-8439-7aa5b9fca19d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:16:21 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-a2842f0e-17d1-4ab5-908a-61d6e995cc8d req-7038e4da-25cd-4817-878e-45d74c136bb4 service nova] Lock "07ec2c05-aaa9-46e8-8439-7aa5b9fca19d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:16:21 user nova-compute[75045]: DEBUG nova.compute.manager [req-a2842f0e-17d1-4ab5-908a-61d6e995cc8d req-7038e4da-25cd-4817-878e-45d74c136bb4 service nova] [instance: 07ec2c05-aaa9-46e8-8439-7aa5b9fca19d] No waiting events found dispatching network-vif-plugged-11c9f384-694c-41fc-b8b3-2db1d15ea84c {{(pid=75045) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 23:16:21 user nova-compute[75045]: WARNING nova.compute.manager [req-a2842f0e-17d1-4ab5-908a-61d6e995cc8d req-7038e4da-25cd-4817-878e-45d74c136bb4 service nova] [instance: 07ec2c05-aaa9-46e8-8439-7aa5b9fca19d] Received unexpected event network-vif-plugged-11c9f384-694c-41fc-b8b3-2db1d15ea84c for instance with vm_state building and task_state spawning.
Nov 08 23:16:22 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:16:22 user nova-compute[75045]: DEBUG nova.compute.manager [None req-029e85ca-7e03-4020-8d79-5d02e89c22c3 tempest-VolumesAssistedSnapshotsTest-1158723798 tempest-VolumesAssistedSnapshotsTest-1158723798-project-member] [instance: 07ec2c05-aaa9-46e8-8439-7aa5b9fca19d] Instance event wait completed in 0 seconds for  {{(pid=75045) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 23:16:22 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-029e85ca-7e03-4020-8d79-5d02e89c22c3 tempest-VolumesAssistedSnapshotsTest-1158723798 tempest-VolumesAssistedSnapshotsTest-1158723798-project-member] [instance: 07ec2c05-aaa9-46e8-8439-7aa5b9fca19d] Guest created on hypervisor {{(pid=75045) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 23:16:22 user nova-compute[75045]: INFO nova.virt.libvirt.driver [-] [instance: 07ec2c05-aaa9-46e8-8439-7aa5b9fca19d] Instance spawned successfully.
Nov 08 23:16:22 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-029e85ca-7e03-4020-8d79-5d02e89c22c3 tempest-VolumesAssistedSnapshotsTest-1158723798 tempest-VolumesAssistedSnapshotsTest-1158723798-project-member] [instance: 07ec2c05-aaa9-46e8-8439-7aa5b9fca19d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75045) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 23:16:22 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-029e85ca-7e03-4020-8d79-5d02e89c22c3 tempest-VolumesAssistedSnapshotsTest-1158723798 tempest-VolumesAssistedSnapshotsTest-1158723798-project-member] [instance: 07ec2c05-aaa9-46e8-8439-7aa5b9fca19d] Found default for hw_cdrom_bus of ide {{(pid=75045) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 23:16:22 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-029e85ca-7e03-4020-8d79-5d02e89c22c3 tempest-VolumesAssistedSnapshotsTest-1158723798 tempest-VolumesAssistedSnapshotsTest-1158723798-project-member] [instance: 07ec2c05-aaa9-46e8-8439-7aa5b9fca19d] Found default for hw_disk_bus of virtio {{(pid=75045) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 23:16:22 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-029e85ca-7e03-4020-8d79-5d02e89c22c3 tempest-VolumesAssistedSnapshotsTest-1158723798 tempest-VolumesAssistedSnapshotsTest-1158723798-project-member] [instance: 07ec2c05-aaa9-46e8-8439-7aa5b9fca19d] Found default for hw_input_bus of None {{(pid=75045) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 23:16:22 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-029e85ca-7e03-4020-8d79-5d02e89c22c3 tempest-VolumesAssistedSnapshotsTest-1158723798 tempest-VolumesAssistedSnapshotsTest-1158723798-project-member] [instance: 07ec2c05-aaa9-46e8-8439-7aa5b9fca19d] Found default for hw_pointer_model of None {{(pid=75045) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 23:16:22 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-029e85ca-7e03-4020-8d79-5d02e89c22c3 tempest-VolumesAssistedSnapshotsTest-1158723798 tempest-VolumesAssistedSnapshotsTest-1158723798-project-member] [instance: 07ec2c05-aaa9-46e8-8439-7aa5b9fca19d] Found default for hw_video_model of virtio {{(pid=75045) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 23:16:22 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-029e85ca-7e03-4020-8d79-5d02e89c22c3 tempest-VolumesAssistedSnapshotsTest-1158723798 tempest-VolumesAssistedSnapshotsTest-1158723798-project-member] [instance: 07ec2c05-aaa9-46e8-8439-7aa5b9fca19d] Found default for hw_vif_model of virtio {{(pid=75045) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 23:16:22 user nova-compute[75045]: INFO nova.compute.manager [None req-029e85ca-7e03-4020-8d79-5d02e89c22c3 tempest-VolumesAssistedSnapshotsTest-1158723798 tempest-VolumesAssistedSnapshotsTest-1158723798-project-member] [instance: 07ec2c05-aaa9-46e8-8439-7aa5b9fca19d] Took 7.72 seconds to spawn the instance on the hypervisor.
Nov 08 23:16:22 user nova-compute[75045]: DEBUG nova.compute.manager [None req-029e85ca-7e03-4020-8d79-5d02e89c22c3 tempest-VolumesAssistedSnapshotsTest-1158723798 tempest-VolumesAssistedSnapshotsTest-1158723798-project-member] [instance: 07ec2c05-aaa9-46e8-8439-7aa5b9fca19d] Checking state {{(pid=75045) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 23:16:22 user nova-compute[75045]: INFO nova.compute.manager [None req-029e85ca-7e03-4020-8d79-5d02e89c22c3 tempest-VolumesAssistedSnapshotsTest-1158723798 tempest-VolumesAssistedSnapshotsTest-1158723798-project-member] [instance: 07ec2c05-aaa9-46e8-8439-7aa5b9fca19d] Took 9.03 seconds to build instance.
Nov 08 23:16:22 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-029e85ca-7e03-4020-8d79-5d02e89c22c3 tempest-VolumesAssistedSnapshotsTest-1158723798 tempest-VolumesAssistedSnapshotsTest-1158723798-project-member] Lock "07ec2c05-aaa9-46e8-8439-7aa5b9fca19d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.213s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:16:24 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:16:24 user nova-compute[75045]: DEBUG nova.compute.manager [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Cleaning up deleted instances {{(pid=75045) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 08 23:16:25 user nova-compute[75045]: DEBUG nova.compute.manager [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] There are 0 instances to clean {{(pid=75045) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 08 23:16:25 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:16:25 user nova-compute[75045]: DEBUG nova.compute.manager [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Cleaning up deleted instances with incomplete migration  {{(pid=75045) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 08 23:16:25 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:16:25 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:16:26 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:16:27 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:16:28 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:16:28 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:16:28 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager.update_available_resource {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:16:29 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:16:29 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:16:29 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:16:29 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Auditing locally available compute resources for user (node: user) {{(pid=75045) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 23:16:29 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09cf15e6-1cec-4c55-b7dd-4311b5f87d32/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:16:29 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09cf15e6-1cec-4c55-b7dd-4311b5f87d32/disk --force-share --output=json" returned: 0 in 0.278s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:16:29 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09cf15e6-1cec-4c55-b7dd-4311b5f87d32/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:16:29 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:16:29 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09cf15e6-1cec-4c55-b7dd-4311b5f87d32/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:16:29 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07ec2c05-aaa9-46e8-8439-7aa5b9fca19d/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:16:30 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07ec2c05-aaa9-46e8-8439-7aa5b9fca19d/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:16:30 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07ec2c05-aaa9-46e8-8439-7aa5b9fca19d/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:16:30 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07ec2c05-aaa9-46e8-8439-7aa5b9fca19d/disk --force-share --output=json" returned: 0 in 0.311s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:16:30 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fde91f7c-31e3-456c-b252-6ce37fa3b600/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:16:30 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:16:30 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fde91f7c-31e3-456c-b252-6ce37fa3b600/disk --force-share --output=json" returned: 0 in 0.264s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:16:30 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fde91f7c-31e3-456c-b252-6ce37fa3b600/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:16:30 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fde91f7c-31e3-456c-b252-6ce37fa3b600/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:16:30 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ae5ff6b-6f2c-4dfd-a4c6-da4809e2cf27/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:16:31 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ae5ff6b-6f2c-4dfd-a4c6-da4809e2cf27/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:16:31 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ae5ff6b-6f2c-4dfd-a4c6-da4809e2cf27/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:16:31 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ae5ff6b-6f2c-4dfd-a4c6-da4809e2cf27/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:16:31 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9bd3096-92eb-4aae-8619-2725ed9acc2b/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:16:31 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:16:31 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9bd3096-92eb-4aae-8619-2725ed9acc2b/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:16:31 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9bd3096-92eb-4aae-8619-2725ed9acc2b/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:16:31 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9bd3096-92eb-4aae-8619-2725ed9acc2b/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:16:31 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f21fcd3-ac5f-499e-9c34-82af806fda1d/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:16:32 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f21fcd3-ac5f-499e-9c34-82af806fda1d/disk --force-share --output=json" returned: 0 in 0.242s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:16:32 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f21fcd3-ac5f-499e-9c34-82af806fda1d/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:16:32 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f21fcd3-ac5f-499e-9c34-82af806fda1d/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:16:32 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1cb1b440-0073-4a53-a0a2-e2781e021866/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:16:32 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:16:32 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1cb1b440-0073-4a53-a0a2-e2781e021866/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:16:32 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1cb1b440-0073-4a53-a0a2-e2781e021866/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:16:32 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1cb1b440-0073-4a53-a0a2-e2781e021866/disk --force-share --output=json" returned: 0 in 0.289s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:16:33 user nova-compute[75045]: WARNING nova.virt.libvirt.driver [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 23:16:33 user nova-compute[75045]: WARNING nova.virt.libvirt.driver [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 23:16:33 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Hypervisor/Node resource view: name=user free_ram=7908MB free_disk=25.630615234375GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75045) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 23:16:33 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:16:33 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.002s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:16:33 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Instance 4ae5ff6b-6f2c-4dfd-a4c6-da4809e2cf27 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75045) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 23:16:33 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Instance 09cf15e6-1cec-4c55-b7dd-4311b5f87d32 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75045) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 23:16:33 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Instance 0f21fcd3-ac5f-499e-9c34-82af806fda1d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75045) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 23:16:33 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Instance b9bd3096-92eb-4aae-8619-2725ed9acc2b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75045) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 23:16:33 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Instance 1cb1b440-0073-4a53-a0a2-e2781e021866 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75045) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 23:16:33 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Instance fde91f7c-31e3-456c-b252-6ce37fa3b600 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75045) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 23:16:33 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Instance 07ec2c05-aaa9-46e8-8439-7aa5b9fca19d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75045) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 23:16:33 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=75045) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 23:16:33 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=75045) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 23:16:33 user nova-compute[75045]: DEBUG nova.scheduler.client.report [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Refreshing inventories for resource provider 62ba5f85-c74d-4b58-986e-d4197e813fd7 {{(pid=75045) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 08 23:16:34 user nova-compute[75045]: DEBUG nova.scheduler.client.report [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Updating ProviderTree inventory for provider 62ba5f85-c74d-4b58-986e-d4197e813fd7 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75045) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 08 23:16:34 user nova-compute[75045]: DEBUG nova.compute.provider_tree [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Updating inventory in ProviderTree for provider 62ba5f85-c74d-4b58-986e-d4197e813fd7 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75045) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 08 23:16:34 user nova-compute[75045]: DEBUG nova.scheduler.client.report [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Refreshing aggregate associations for resource provider 62ba5f85-c74d-4b58-986e-d4197e813fd7, aggregates: None {{(pid=75045) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 08 23:16:34 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:16:34 user nova-compute[75045]: DEBUG nova.scheduler.client.report [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Refreshing trait associations for resource provider 62ba5f85-c74d-4b58-986e-d4197e813fd7, traits: COMPUTE_STORAGE_BUS_SCSI,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_TRUSTED_CERTS,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_VIRTIO,HW_CPU_X86_SSSE3,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_FDC,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_RESCUE_BFV,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSE2,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN {{(pid=75045) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 08 23:16:34 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:16:34 user nova-compute[75045]: DEBUG nova.compute.provider_tree [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Inventory has not changed in ProviderTree for provider: 62ba5f85-c74d-4b58-986e-d4197e813fd7 {{(pid=75045) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 23:16:34 user nova-compute[75045]: DEBUG nova.scheduler.client.report [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Inventory has not changed for provider 62ba5f85-c74d-4b58-986e-d4197e813fd7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75045) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 23:16:34 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Compute_service record updated for user:user {{(pid=75045) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 23:16:34 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.124s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:16:35 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:16:35 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:16:35 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:16:35 user nova-compute[75045]: DEBUG nova.compute.manager [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Starting heal instance info cache {{(pid=75045) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 23:16:35 user nova-compute[75045]: DEBUG nova.compute.manager [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Rebuilding the list of instances to heal {{(pid=75045) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 08 23:16:35 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Acquiring lock "refresh_cache-4ae5ff6b-6f2c-4dfd-a4c6-da4809e2cf27" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 23:16:35 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Acquired lock "refresh_cache-4ae5ff6b-6f2c-4dfd-a4c6-da4809e2cf27" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 23:16:35 user nova-compute[75045]: DEBUG nova.network.neutron [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] [instance: 4ae5ff6b-6f2c-4dfd-a4c6-da4809e2cf27] Forcefully refreshing network info cache for instance {{(pid=75045) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 23:16:35 user nova-compute[75045]: DEBUG nova.objects.instance [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Lazy-loading 'info_cache' on Instance uuid 4ae5ff6b-6f2c-4dfd-a4c6-da4809e2cf27 {{(pid=75045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 23:16:36 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:16:36 user nova-compute[75045]: DEBUG nova.network.neutron [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] [instance: 4ae5ff6b-6f2c-4dfd-a4c6-da4809e2cf27] Updating instance_info_cache with network_info: [{"id": "cfa24a0c-4dce-4dae-a5d7-10ebfa1cc305", "address": "fa:16:3e:33:11:13", "network": {"id": "d4cd6998-66d1-4389-bc82-dd000c8962de", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-323966879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bfb6963a6c145d4a7b7e47c8fde7e60", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcfa24a0c-4d", "ovs_interfaceid": "cfa24a0c-4dce-4dae-a5d7-10ebfa1cc305", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75045) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 23:16:37 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Releasing lock "refresh_cache-4ae5ff6b-6f2c-4dfd-a4c6-da4809e2cf27" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 23:16:37 user nova-compute[75045]: DEBUG nova.compute.manager [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] [instance: 4ae5ff6b-6f2c-4dfd-a4c6-da4809e2cf27] Updated the network info_cache for instance {{(pid=75045) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 23:16:37 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:16:37 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:16:37 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:16:37 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:16:37 user nova-compute[75045]: DEBUG nova.compute.manager [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75045) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 23:16:37 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:16:39 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-a3bc4917-4314-4754-b33a-e1b27f461959 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262-project-member] Acquiring lock "82bc5fd0-26c7-4f81-b966-54831393b617" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:16:39 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-a3bc4917-4314-4754-b33a-e1b27f461959 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262-project-member] Lock "82bc5fd0-26c7-4f81-b966-54831393b617" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:16:39 user nova-compute[75045]: DEBUG nova.compute.manager [None req-a3bc4917-4314-4754-b33a-e1b27f461959 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262-project-member] [instance: 82bc5fd0-26c7-4f81-b966-54831393b617] Starting instance... {{(pid=75045) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 23:16:39 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-a3bc4917-4314-4754-b33a-e1b27f461959 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:16:39 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-a3bc4917-4314-4754-b33a-e1b27f461959 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:16:39 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-a3bc4917-4314-4754-b33a-e1b27f461959 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75045) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 23:16:39 user nova-compute[75045]: INFO nova.compute.claims [None req-a3bc4917-4314-4754-b33a-e1b27f461959 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262-project-member] [instance: 82bc5fd0-26c7-4f81-b966-54831393b617] Claim successful on node user
Nov 08 23:16:39 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:16:40 user nova-compute[75045]: DEBUG nova.compute.provider_tree [None req-a3bc4917-4314-4754-b33a-e1b27f461959 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262-project-member] Inventory has not changed in ProviderTree for provider: 62ba5f85-c74d-4b58-986e-d4197e813fd7 {{(pid=75045) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 23:16:40 user nova-compute[75045]: DEBUG nova.scheduler.client.report [None req-a3bc4917-4314-4754-b33a-e1b27f461959 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262-project-member] Inventory has not changed for provider 62ba5f85-c74d-4b58-986e-d4197e813fd7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75045) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 23:16:40 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-a3bc4917-4314-4754-b33a-e1b27f461959 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.408s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:16:40 user nova-compute[75045]: DEBUG nova.compute.manager [None req-a3bc4917-4314-4754-b33a-e1b27f461959 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262-project-member] [instance: 82bc5fd0-26c7-4f81-b966-54831393b617] Start building networks asynchronously for instance. {{(pid=75045) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 23:16:40 user nova-compute[75045]: DEBUG nova.compute.manager [None req-a3bc4917-4314-4754-b33a-e1b27f461959 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262-project-member] [instance: 82bc5fd0-26c7-4f81-b966-54831393b617] Allocating IP information in the background. {{(pid=75045) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 23:16:40 user nova-compute[75045]: DEBUG nova.network.neutron [None req-a3bc4917-4314-4754-b33a-e1b27f461959 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262-project-member] [instance: 82bc5fd0-26c7-4f81-b966-54831393b617] allocate_for_instance() {{(pid=75045) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 23:16:40 user nova-compute[75045]: INFO nova.virt.libvirt.driver [None req-a3bc4917-4314-4754-b33a-e1b27f461959 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262-project-member] [instance: 82bc5fd0-26c7-4f81-b966-54831393b617] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 23:16:40 user nova-compute[75045]: DEBUG nova.compute.manager [None req-a3bc4917-4314-4754-b33a-e1b27f461959 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262-project-member] [instance: 82bc5fd0-26c7-4f81-b966-54831393b617] Start building block device mappings for instance. {{(pid=75045) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 23:16:40 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:16:40 user nova-compute[75045]: DEBUG nova.compute.manager [None req-a3bc4917-4314-4754-b33a-e1b27f461959 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262-project-member] [instance: 82bc5fd0-26c7-4f81-b966-54831393b617] Start spawning the instance on the hypervisor. {{(pid=75045) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 23:16:40 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-a3bc4917-4314-4754-b33a-e1b27f461959 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262-project-member] [instance: 82bc5fd0-26c7-4f81-b966-54831393b617] Creating instance directory {{(pid=75045) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 23:16:40 user nova-compute[75045]: INFO nova.virt.libvirt.driver [None req-a3bc4917-4314-4754-b33a-e1b27f461959 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262-project-member] [instance: 82bc5fd0-26c7-4f81-b966-54831393b617] Creating image(s)
Nov 08 23:16:40 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-a3bc4917-4314-4754-b33a-e1b27f461959 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262-project-member] Acquiring lock "/opt/stack/data/nova/instances/82bc5fd0-26c7-4f81-b966-54831393b617/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:16:40 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-a3bc4917-4314-4754-b33a-e1b27f461959 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262-project-member] Lock "/opt/stack/data/nova/instances/82bc5fd0-26c7-4f81-b966-54831393b617/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:16:40 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-a3bc4917-4314-4754-b33a-e1b27f461959 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262-project-member] Lock "/opt/stack/data/nova/instances/82bc5fd0-26c7-4f81-b966-54831393b617/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:16:40 user nova-compute[75045]: DEBUG nova.policy [None req-a3bc4917-4314-4754-b33a-e1b27f461959 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '61e83a029ebf498ca938bd1d248e5f03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8880c89fe3a444eb5e87aa0c0f82a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75045) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 23:16:40 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-a3bc4917-4314-4754-b33a-e1b27f461959 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b59f52a99fff51c56dd1edfb83892fb8f647f2f3 --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:16:40 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-a3bc4917-4314-4754-b33a-e1b27f461959 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b59f52a99fff51c56dd1edfb83892fb8f647f2f3 --force-share --output=json" returned: 0 in 0.189s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:16:40 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-a3bc4917-4314-4754-b33a-e1b27f461959 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262-project-member] Acquiring lock "b59f52a99fff51c56dd1edfb83892fb8f647f2f3" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:16:40 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-a3bc4917-4314-4754-b33a-e1b27f461959 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262-project-member] Lock "b59f52a99fff51c56dd1edfb83892fb8f647f2f3" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.007s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:16:40 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-a3bc4917-4314-4754-b33a-e1b27f461959 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b59f52a99fff51c56dd1edfb83892fb8f647f2f3 --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:16:40 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-a3bc4917-4314-4754-b33a-e1b27f461959 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b59f52a99fff51c56dd1edfb83892fb8f647f2f3 --force-share --output=json" returned: 0 in 0.183s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:16:40 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-a3bc4917-4314-4754-b33a-e1b27f461959 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b59f52a99fff51c56dd1edfb83892fb8f647f2f3,backing_fmt=raw /opt/stack/data/nova/instances/82bc5fd0-26c7-4f81-b966-54831393b617/disk 1073741824 {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:16:41 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-a3bc4917-4314-4754-b33a-e1b27f461959 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b59f52a99fff51c56dd1edfb83892fb8f647f2f3,backing_fmt=raw /opt/stack/data/nova/instances/82bc5fd0-26c7-4f81-b966-54831393b617/disk 1073741824" returned: 0 in 0.049s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:16:41 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-a3bc4917-4314-4754-b33a-e1b27f461959 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262-project-member] Lock "b59f52a99fff51c56dd1edfb83892fb8f647f2f3" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.239s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:16:41 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-a3bc4917-4314-4754-b33a-e1b27f461959 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b59f52a99fff51c56dd1edfb83892fb8f647f2f3 --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:16:41 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-a3bc4917-4314-4754-b33a-e1b27f461959 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b59f52a99fff51c56dd1edfb83892fb8f647f2f3 --force-share --output=json" returned: 0 in 0.178s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:16:41 user nova-compute[75045]: DEBUG nova.virt.disk.api [None req-a3bc4917-4314-4754-b33a-e1b27f461959 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262-project-member] Checking if we can resize image /opt/stack/data/nova/instances/82bc5fd0-26c7-4f81-b966-54831393b617/disk. size=1073741824 {{(pid=75045) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 23:16:41 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-a3bc4917-4314-4754-b33a-e1b27f461959 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82bc5fd0-26c7-4f81-b966-54831393b617/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:16:41 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-a3bc4917-4314-4754-b33a-e1b27f461959 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82bc5fd0-26c7-4f81-b966-54831393b617/disk --force-share --output=json" returned: 0 in 0.264s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:16:41 user nova-compute[75045]: DEBUG nova.virt.disk.api [None req-a3bc4917-4314-4754-b33a-e1b27f461959 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262-project-member] Cannot resize image /opt/stack/data/nova/instances/82bc5fd0-26c7-4f81-b966-54831393b617/disk to a smaller size. {{(pid=75045) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 08 23:16:41 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-a3bc4917-4314-4754-b33a-e1b27f461959 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262-project-member] [instance: 82bc5fd0-26c7-4f81-b966-54831393b617] Created local disks {{(pid=75045) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 23:16:41 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-a3bc4917-4314-4754-b33a-e1b27f461959 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262-project-member] [instance: 82bc5fd0-26c7-4f81-b966-54831393b617] Ensure instance console log exists: /opt/stack/data/nova/instances/82bc5fd0-26c7-4f81-b966-54831393b617/console.log {{(pid=75045) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 23:16:41 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-a3bc4917-4314-4754-b33a-e1b27f461959 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:16:41 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-a3bc4917-4314-4754-b33a-e1b27f461959 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.019s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:16:41 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-a3bc4917-4314-4754-b33a-e1b27f461959 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:16:41 user nova-compute[75045]: DEBUG nova.network.neutron [None req-a3bc4917-4314-4754-b33a-e1b27f461959 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262-project-member] [instance: 82bc5fd0-26c7-4f81-b966-54831393b617] Successfully created port: 5d77f7bf-dc8f-4aa2-9c4a-48d0e81d7451 {{(pid=75045) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 23:16:42 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:16:42 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:16:42 user nova-compute[75045]: DEBUG nova.network.neutron [None req-a3bc4917-4314-4754-b33a-e1b27f461959 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262-project-member] [instance: 82bc5fd0-26c7-4f81-b966-54831393b617] Successfully updated port: 5d77f7bf-dc8f-4aa2-9c4a-48d0e81d7451 {{(pid=75045) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 23:16:42 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-a3bc4917-4314-4754-b33a-e1b27f461959 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262-project-member] Acquiring lock "refresh_cache-82bc5fd0-26c7-4f81-b966-54831393b617" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 23:16:42 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-a3bc4917-4314-4754-b33a-e1b27f461959 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262-project-member] Acquired lock "refresh_cache-82bc5fd0-26c7-4f81-b966-54831393b617" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 23:16:42 user nova-compute[75045]: DEBUG nova.network.neutron [None req-a3bc4917-4314-4754-b33a-e1b27f461959 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262-project-member] [instance: 82bc5fd0-26c7-4f81-b966-54831393b617] Building network info cache for instance {{(pid=75045) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 23:16:42 user nova-compute[75045]: DEBUG nova.compute.manager [req-edb25945-221e-495d-8bbd-d9cd5677f4f7 req-52ffc3db-e81b-41a3-b1d6-d92637ad4579 service nova] [instance: 82bc5fd0-26c7-4f81-b966-54831393b617] Received event network-changed-5d77f7bf-dc8f-4aa2-9c4a-48d0e81d7451 {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:16:42 user nova-compute[75045]: DEBUG nova.compute.manager [req-edb25945-221e-495d-8bbd-d9cd5677f4f7 req-52ffc3db-e81b-41a3-b1d6-d92637ad4579 service nova] [instance: 82bc5fd0-26c7-4f81-b966-54831393b617] Refreshing instance network info cache due to event network-changed-5d77f7bf-dc8f-4aa2-9c4a-48d0e81d7451. {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 23:16:42 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-edb25945-221e-495d-8bbd-d9cd5677f4f7 req-52ffc3db-e81b-41a3-b1d6-d92637ad4579 service nova] Acquiring lock "refresh_cache-82bc5fd0-26c7-4f81-b966-54831393b617" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 23:16:43 user nova-compute[75045]: DEBUG nova.network.neutron [None req-a3bc4917-4314-4754-b33a-e1b27f461959 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262-project-member] [instance: 82bc5fd0-26c7-4f81-b966-54831393b617] Instance cache missing network info. {{(pid=75045) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 23:16:43 user nova-compute[75045]: DEBUG nova.network.neutron [None req-a3bc4917-4314-4754-b33a-e1b27f461959 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262-project-member] [instance: 82bc5fd0-26c7-4f81-b966-54831393b617] Updating instance_info_cache with network_info: [{"id": "5d77f7bf-dc8f-4aa2-9c4a-48d0e81d7451", "address": "fa:16:3e:4a:29:50", "network": {"id": "3f41081c-be28-40e3-bf5d-dd18368a2c49", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-102171439-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f8880c89fe3a444eb5e87aa0c0f82a19", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d77f7bf-dc", "ovs_interfaceid": "5d77f7bf-dc8f-4aa2-9c4a-48d0e81d7451", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75045) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 23:16:43 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-a3bc4917-4314-4754-b33a-e1b27f461959 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262-project-member] Releasing lock "refresh_cache-82bc5fd0-26c7-4f81-b966-54831393b617" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 23:16:43 user nova-compute[75045]: DEBUG nova.compute.manager [None req-a3bc4917-4314-4754-b33a-e1b27f461959 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262-project-member] [instance: 82bc5fd0-26c7-4f81-b966-54831393b617] Instance network_info: |[{"id": "5d77f7bf-dc8f-4aa2-9c4a-48d0e81d7451", "address": "fa:16:3e:4a:29:50", "network": {"id": "3f41081c-be28-40e3-bf5d-dd18368a2c49", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-102171439-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f8880c89fe3a444eb5e87aa0c0f82a19", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d77f7bf-dc", "ovs_interfaceid": "5d77f7bf-dc8f-4aa2-9c4a-48d0e81d7451", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75045) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 23:16:43 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-edb25945-221e-495d-8bbd-d9cd5677f4f7 req-52ffc3db-e81b-41a3-b1d6-d92637ad4579 service nova] Acquired lock "refresh_cache-82bc5fd0-26c7-4f81-b966-54831393b617" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 23:16:43 user nova-compute[75045]: DEBUG nova.network.neutron [req-edb25945-221e-495d-8bbd-d9cd5677f4f7 req-52ffc3db-e81b-41a3-b1d6-d92637ad4579 service nova] [instance: 82bc5fd0-26c7-4f81-b966-54831393b617] Refreshing network info cache for port 5d77f7bf-dc8f-4aa2-9c4a-48d0e81d7451 {{(pid=75045) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 23:16:43 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-a3bc4917-4314-4754-b33a-e1b27f461959 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262-project-member] [instance: 82bc5fd0-26c7-4f81-b966-54831393b617] Start _get_guest_xml network_info=[{"id": "5d77f7bf-dc8f-4aa2-9c4a-48d0e81d7451", "address": "fa:16:3e:4a:29:50", "network": {"id": "3f41081c-be28-40e3-bf5d-dd18368a2c49", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-102171439-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f8880c89fe3a444eb5e87aa0c0f82a19", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d77f7bf-dc", "ovs_interfaceid": "5d77f7bf-dc8f-4aa2-9c4a-48d0e81d7451", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T23:11:54Z,direct_url=<?>,disk_format='qcow2',id=a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b1beba2cc4e7465ea249e2225fb494dc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T23:11:56Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'disk_bus': 'virtio', 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': 'a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75045) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 23:16:43 user nova-compute[75045]: WARNING nova.virt.libvirt.driver [None req-a3bc4917-4314-4754-b33a-e1b27f461959 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 23:16:43 user nova-compute[75045]: WARNING nova.virt.libvirt.driver [None req-a3bc4917-4314-4754-b33a-e1b27f461959 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 23:16:43 user nova-compute[75045]: DEBUG nova.virt.libvirt.host [None req-a3bc4917-4314-4754-b33a-e1b27f461959 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75045) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 23:16:43 user nova-compute[75045]: DEBUG nova.virt.libvirt.host [None req-a3bc4917-4314-4754-b33a-e1b27f461959 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262-project-member] CPU controller missing on host. {{(pid=75045) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 23:16:43 user nova-compute[75045]: DEBUG nova.virt.libvirt.host [None req-a3bc4917-4314-4754-b33a-e1b27f461959 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75045) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 23:16:43 user nova-compute[75045]: DEBUG nova.virt.libvirt.host [None req-a3bc4917-4314-4754-b33a-e1b27f461959 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262-project-member] CPU controller found on host. {{(pid=75045) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 23:16:43 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-a3bc4917-4314-4754-b33a-e1b27f461959 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75045) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 23:16:43 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-a3bc4917-4314-4754-b33a-e1b27f461959 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T23:11:41Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T23:11:54Z,direct_url=<?>,disk_format='qcow2',id=a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b1beba2cc4e7465ea249e2225fb494dc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T23:11:56Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75045) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 23:16:43 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-a3bc4917-4314-4754-b33a-e1b27f461959 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262-project-member] Flavor limits 0:0:0 {{(pid=75045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 23:16:43 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-a3bc4917-4314-4754-b33a-e1b27f461959 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262-project-member] Image limits 0:0:0 {{(pid=75045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 23:16:43 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-a3bc4917-4314-4754-b33a-e1b27f461959 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262-project-member] Flavor pref 0:0:0 {{(pid=75045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 23:16:43 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-a3bc4917-4314-4754-b33a-e1b27f461959 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262-project-member] Image pref 0:0:0 {{(pid=75045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 23:16:43 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-a3bc4917-4314-4754-b33a-e1b27f461959 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 23:16:43 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-a3bc4917-4314-4754-b33a-e1b27f461959 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75045) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 23:16:43 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-a3bc4917-4314-4754-b33a-e1b27f461959 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75045) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 23:16:43 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-a3bc4917-4314-4754-b33a-e1b27f461959 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262-project-member] Got 1 possible topologies {{(pid=75045) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 23:16:43 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-a3bc4917-4314-4754-b33a-e1b27f461959 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75045) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 23:16:43 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-a3bc4917-4314-4754-b33a-e1b27f461959 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75045) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 23:16:43 user nova-compute[75045]: DEBUG nova.virt.libvirt.vif [None req-a3bc4917-4314-4754-b33a-e1b27f461959 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T23:16:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-2125080824',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-2125080824',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-2125080',id=8,image_ref='a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJB+N4c4RW1Mj/ZBcpZxNZKh8oAQlNrZ55bDfrddDIM0PKfYdL9vlhxn2vwFGUfAQ+5RB5nJAcQ4bYCYha3SZiJLy5/J8QONmDnSWa1k3TgGI2X5Sv/018bHDNHf9u3HcQ==',key_name='tempest-keypair-2084566665',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f8880c89fe3a444eb5e87aa0c0f82a19',ramdisk_id='',reservation_id='r-se9k226s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1679099262',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1679099262-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T23:16:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='61e83a029ebf498ca938bd1d248e5f03',uuid=82bc5fd0-26c7-4f81-b966-54831393b617,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5d77f7bf-dc8f-4aa2-9c4a-48d0e81d7451", "address": "fa:16:3e:4a:29:50", "network": {"id": "3f41081c-be28-40e3-bf5d-dd18368a2c49", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-102171439-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f8880c89fe3a444eb5e87aa0c0f82a19", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d77f7bf-dc", "ovs_interfaceid": "5d77f7bf-dc8f-4aa2-9c4a-48d0e81d7451", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75045) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 23:16:43 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-a3bc4917-4314-4754-b33a-e1b27f461959 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262-project-member] Converting VIF {"id": "5d77f7bf-dc8f-4aa2-9c4a-48d0e81d7451", "address": "fa:16:3e:4a:29:50", "network": {"id": "3f41081c-be28-40e3-bf5d-dd18368a2c49", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-102171439-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f8880c89fe3a444eb5e87aa0c0f82a19", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d77f7bf-dc", "ovs_interfaceid": "5d77f7bf-dc8f-4aa2-9c4a-48d0e81d7451", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 23:16:43 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-a3bc4917-4314-4754-b33a-e1b27f461959 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4a:29:50,bridge_name='br-int',has_traffic_filtering=True,id=5d77f7bf-dc8f-4aa2-9c4a-48d0e81d7451,network=Network(3f41081c-be28-40e3-bf5d-dd18368a2c49),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5d77f7bf-dc') {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 23:16:43 user nova-compute[75045]: DEBUG nova.objects.instance [None req-a3bc4917-4314-4754-b33a-e1b27f461959 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262-project-member] Lazy-loading 'pci_devices' on Instance uuid 82bc5fd0-26c7-4f81-b966-54831393b617 {{(pid=75045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 23:16:43 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-a3bc4917-4314-4754-b33a-e1b27f461959 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262-project-member] [instance: 82bc5fd0-26c7-4f81-b966-54831393b617] End _get_guest_xml xml=<domain type="kvm">
Nov 08 23:16:43 user nova-compute[75045]:   <uuid>82bc5fd0-26c7-4f81-b966-54831393b617</uuid>
Nov 08 23:16:43 user nova-compute[75045]:   <name>instance-00000008</name>
Nov 08 23:16:43 user nova-compute[75045]:   <memory>524288</memory>
Nov 08 23:16:43 user nova-compute[75045]:   <vcpu>1</vcpu>
Nov 08 23:16:43 user nova-compute[75045]:   <metadata>
Nov 08 23:16:43 user nova-compute[75045]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 23:16:43 user nova-compute[75045]:       <nova:package version="0.0.0"/>
Nov 08 23:16:43 user nova-compute[75045]:       <nova:name>tempest-TestServerVolumeAttachScenarioOldVersion-server-2125080824</nova:name>
Nov 08 23:16:43 user nova-compute[75045]:       <nova:creationTime>2023-11-08 23:16:43</nova:creationTime>
Nov 08 23:16:43 user nova-compute[75045]:       <nova:flavor name="m1.tiny">
Nov 08 23:16:43 user nova-compute[75045]:         <nova:memory>512</nova:memory>
Nov 08 23:16:43 user nova-compute[75045]:         <nova:disk>1</nova:disk>
Nov 08 23:16:43 user nova-compute[75045]:         <nova:swap>0</nova:swap>
Nov 08 23:16:43 user nova-compute[75045]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 23:16:43 user nova-compute[75045]:         <nova:vcpus>1</nova:vcpus>
Nov 08 23:16:43 user nova-compute[75045]:       </nova:flavor>
Nov 08 23:16:43 user nova-compute[75045]:       <nova:owner>
Nov 08 23:16:43 user nova-compute[75045]:         <nova:user uuid="61e83a029ebf498ca938bd1d248e5f03">tempest-TestServerVolumeAttachScenarioOldVersion-1679099262-project-member</nova:user>
Nov 08 23:16:43 user nova-compute[75045]:         <nova:project uuid="f8880c89fe3a444eb5e87aa0c0f82a19">tempest-TestServerVolumeAttachScenarioOldVersion-1679099262</nova:project>
Nov 08 23:16:43 user nova-compute[75045]:       </nova:owner>
Nov 08 23:16:43 user nova-compute[75045]:       <nova:root type="image" uuid="a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb"/>
Nov 08 23:16:43 user nova-compute[75045]:       <nova:ports>
Nov 08 23:16:43 user nova-compute[75045]:         <nova:port uuid="5d77f7bf-dc8f-4aa2-9c4a-48d0e81d7451">
Nov 08 23:16:43 user nova-compute[75045]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 08 23:16:43 user nova-compute[75045]:         </nova:port>
Nov 08 23:16:43 user nova-compute[75045]:       </nova:ports>
Nov 08 23:16:43 user nova-compute[75045]:     </nova:instance>
Nov 08 23:16:43 user nova-compute[75045]:   </metadata>
Nov 08 23:16:43 user nova-compute[75045]:   <sysinfo type="smbios">
Nov 08 23:16:43 user nova-compute[75045]:     <system>
Nov 08 23:16:43 user nova-compute[75045]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 23:16:43 user nova-compute[75045]:       <entry name="product">OpenStack Nova</entry>
Nov 08 23:16:43 user nova-compute[75045]:       <entry name="version">0.0.0</entry>
Nov 08 23:16:43 user nova-compute[75045]:       <entry name="serial">82bc5fd0-26c7-4f81-b966-54831393b617</entry>
Nov 08 23:16:43 user nova-compute[75045]:       <entry name="uuid">82bc5fd0-26c7-4f81-b966-54831393b617</entry>
Nov 08 23:16:43 user nova-compute[75045]:       <entry name="family">Virtual Machine</entry>
Nov 08 23:16:43 user nova-compute[75045]:     </system>
Nov 08 23:16:43 user nova-compute[75045]:   </sysinfo>
Nov 08 23:16:43 user nova-compute[75045]:   <os>
Nov 08 23:16:43 user nova-compute[75045]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 23:16:43 user nova-compute[75045]:     <boot dev="hd"/>
Nov 08 23:16:43 user nova-compute[75045]:     <smbios mode="sysinfo"/>
Nov 08 23:16:43 user nova-compute[75045]:   </os>
Nov 08 23:16:43 user nova-compute[75045]:   <features>
Nov 08 23:16:43 user nova-compute[75045]:     <acpi/>
Nov 08 23:16:43 user nova-compute[75045]:     <apic/>
Nov 08 23:16:43 user nova-compute[75045]:     <vmcoreinfo/>
Nov 08 23:16:43 user nova-compute[75045]:   </features>
Nov 08 23:16:43 user nova-compute[75045]:   <clock offset="utc">
Nov 08 23:16:43 user nova-compute[75045]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 23:16:43 user nova-compute[75045]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 23:16:43 user nova-compute[75045]:     <timer name="hpet" present="no"/>
Nov 08 23:16:43 user nova-compute[75045]:   </clock>
Nov 08 23:16:43 user nova-compute[75045]:   <cpu mode="custom" match="exact">
Nov 08 23:16:43 user nova-compute[75045]:     <model>Nehalem</model>
Nov 08 23:16:43 user nova-compute[75045]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 23:16:43 user nova-compute[75045]:   </cpu>
Nov 08 23:16:43 user nova-compute[75045]:   <devices>
Nov 08 23:16:43 user nova-compute[75045]:     <disk type="file" device="disk">
Nov 08 23:16:43 user nova-compute[75045]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 23:16:43 user nova-compute[75045]:       <source file="/opt/stack/data/nova/instances/82bc5fd0-26c7-4f81-b966-54831393b617/disk"/>
Nov 08 23:16:43 user nova-compute[75045]:       <target dev="vda" bus="virtio"/>
Nov 08 23:16:43 user nova-compute[75045]:     </disk>
Nov 08 23:16:43 user nova-compute[75045]:     <interface type="ethernet">
Nov 08 23:16:43 user nova-compute[75045]:       <mac address="fa:16:3e:4a:29:50"/>
Nov 08 23:16:43 user nova-compute[75045]:       <model type="virtio"/>
Nov 08 23:16:43 user nova-compute[75045]:       <mtu size="1442"/>
Nov 08 23:16:43 user nova-compute[75045]:       <target dev="tap5d77f7bf-dc"/>
Nov 08 23:16:43 user nova-compute[75045]:     </interface>
Nov 08 23:16:43 user nova-compute[75045]:     <serial type="pty">
Nov 08 23:16:43 user nova-compute[75045]:       <log file="/opt/stack/data/nova/instances/82bc5fd0-26c7-4f81-b966-54831393b617/console.log" append="off"/>
Nov 08 23:16:43 user nova-compute[75045]:     </serial>
Nov 08 23:16:43 user nova-compute[75045]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 23:16:43 user nova-compute[75045]:     <video>
Nov 08 23:16:43 user nova-compute[75045]:       <model type="virtio"/>
Nov 08 23:16:43 user nova-compute[75045]:     </video>
Nov 08 23:16:43 user nova-compute[75045]:     <rng model="virtio">
Nov 08 23:16:43 user nova-compute[75045]:       <backend model="random">/dev/urandom</backend>
Nov 08 23:16:43 user nova-compute[75045]:     </rng>
Nov 08 23:16:43 user nova-compute[75045]:     <controller type="usb" index="0" model="none"/>
Nov 08 23:16:43 user nova-compute[75045]:     <memballoon model="virtio">
Nov 08 23:16:43 user nova-compute[75045]:       <stats period="10"/>
Nov 08 23:16:43 user nova-compute[75045]:     </memballoon>
Nov 08 23:16:43 user nova-compute[75045]:   </devices>
Nov 08 23:16:43 user nova-compute[75045]: </domain>
Nov 08 23:16:43 user nova-compute[75045]:  {{(pid=75045) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 23:16:43 user nova-compute[75045]: DEBUG nova.virt.libvirt.vif [None req-a3bc4917-4314-4754-b33a-e1b27f461959 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T23:16:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-2125080824',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-2125080824',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-2125080',id=8,image_ref='a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJB+N4c4RW1Mj/ZBcpZxNZKh8oAQlNrZ55bDfrddDIM0PKfYdL9vlhxn2vwFGUfAQ+5RB5nJAcQ4bYCYha3SZiJLy5/J8QONmDnSWa1k3TgGI2X5Sv/018bHDNHf9u3HcQ==',key_name='tempest-keypair-2084566665',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f8880c89fe3a444eb5e87aa0c0f82a19',ramdisk_id='',reservation_id='r-se9k226s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1679099262',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1679099262-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T23:16:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='61e83a029ebf498ca938bd1d248e5f03',uuid=82bc5fd0-26c7-4f81-b966-54831393b617,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5d77f7bf-dc8f-4aa2-9c4a-48d0e81d7451", "address": "fa:16:3e:4a:29:50", "network": {"id": "3f41081c-be28-40e3-bf5d-dd18368a2c49", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-102171439-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f8880c89fe3a444eb5e87aa0c0f82a19", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d77f7bf-dc", "ovs_interfaceid": "5d77f7bf-dc8f-4aa2-9c4a-48d0e81d7451", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75045) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 23:16:43 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-a3bc4917-4314-4754-b33a-e1b27f461959 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262-project-member] Converting VIF {"id": "5d77f7bf-dc8f-4aa2-9c4a-48d0e81d7451", "address": "fa:16:3e:4a:29:50", "network": {"id": "3f41081c-be28-40e3-bf5d-dd18368a2c49", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-102171439-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f8880c89fe3a444eb5e87aa0c0f82a19", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d77f7bf-dc", "ovs_interfaceid": "5d77f7bf-dc8f-4aa2-9c4a-48d0e81d7451", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 23:16:43 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-a3bc4917-4314-4754-b33a-e1b27f461959 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4a:29:50,bridge_name='br-int',has_traffic_filtering=True,id=5d77f7bf-dc8f-4aa2-9c4a-48d0e81d7451,network=Network(3f41081c-be28-40e3-bf5d-dd18368a2c49),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5d77f7bf-dc') {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 23:16:43 user nova-compute[75045]: DEBUG os_vif [None req-a3bc4917-4314-4754-b33a-e1b27f461959 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4a:29:50,bridge_name='br-int',has_traffic_filtering=True,id=5d77f7bf-dc8f-4aa2-9c4a-48d0e81d7451,network=Network(3f41081c-be28-40e3-bf5d-dd18368a2c49),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5d77f7bf-dc') {{(pid=75045) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 23:16:43 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:16:43 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:16:43 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 23:16:43 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:16:43 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f3735d20-4b25-56b7-809a-b59866297878', '_type': 'linux-noop'}}, row=False) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:16:43 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:16:43 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 23:16:43 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:16:43 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5d77f7bf-dc, may_exist=True, interface_attrs={}) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:16:43 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5d77f7bf-dc, col_values=(('qos', UUID('487c8305-54bf-40b8-b5e6-aedc541a4807')),), if_exists=True) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:16:43 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5d77f7bf-dc, col_values=(('external_ids', {'iface-id': '5d77f7bf-dc8f-4aa2-9c4a-48d0e81d7451', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4a:29:50', 'vm-uuid': '82bc5fd0-26c7-4f81-b966-54831393b617'}),), if_exists=True) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:16:43 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:16:43 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 23:16:43 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:16:43 user nova-compute[75045]: INFO os_vif [None req-a3bc4917-4314-4754-b33a-e1b27f461959 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4a:29:50,bridge_name='br-int',has_traffic_filtering=True,id=5d77f7bf-dc8f-4aa2-9c4a-48d0e81d7451,network=Network(3f41081c-be28-40e3-bf5d-dd18368a2c49),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5d77f7bf-dc')
Nov 08 23:16:43 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-a3bc4917-4314-4754-b33a-e1b27f461959 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262-project-member] No BDM found with device name vda, not building metadata. {{(pid=75045) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 23:16:43 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-a3bc4917-4314-4754-b33a-e1b27f461959 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262-project-member] No VIF found with MAC fa:16:3e:4a:29:50, not building metadata {{(pid=75045) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 23:16:44 user nova-compute[75045]: DEBUG nova.network.neutron [req-edb25945-221e-495d-8bbd-d9cd5677f4f7 req-52ffc3db-e81b-41a3-b1d6-d92637ad4579 service nova] [instance: 82bc5fd0-26c7-4f81-b966-54831393b617] Updated VIF entry in instance network info cache for port 5d77f7bf-dc8f-4aa2-9c4a-48d0e81d7451. {{(pid=75045) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 23:16:44 user nova-compute[75045]: DEBUG nova.network.neutron [req-edb25945-221e-495d-8bbd-d9cd5677f4f7 req-52ffc3db-e81b-41a3-b1d6-d92637ad4579 service nova] [instance: 82bc5fd0-26c7-4f81-b966-54831393b617] Updating instance_info_cache with network_info: [{"id": "5d77f7bf-dc8f-4aa2-9c4a-48d0e81d7451", "address": "fa:16:3e:4a:29:50", "network": {"id": "3f41081c-be28-40e3-bf5d-dd18368a2c49", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-102171439-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f8880c89fe3a444eb5e87aa0c0f82a19", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d77f7bf-dc", "ovs_interfaceid": "5d77f7bf-dc8f-4aa2-9c4a-48d0e81d7451", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75045) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 23:16:44 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-edb25945-221e-495d-8bbd-d9cd5677f4f7 req-52ffc3db-e81b-41a3-b1d6-d92637ad4579 service nova] Releasing lock "refresh_cache-82bc5fd0-26c7-4f81-b966-54831393b617" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 23:16:45 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:16:45 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:16:45 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:16:45 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:16:45 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:16:45 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:16:45 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:16:45 user nova-compute[75045]: DEBUG nova.compute.manager [req-f672a46a-d114-4d7d-971e-9d2c82c38f3e req-27b1d6db-434a-4341-8acd-a2f8bec04fbb service nova] [instance: 82bc5fd0-26c7-4f81-b966-54831393b617] Received event network-vif-plugged-5d77f7bf-dc8f-4aa2-9c4a-48d0e81d7451 {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:16:45 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-f672a46a-d114-4d7d-971e-9d2c82c38f3e req-27b1d6db-434a-4341-8acd-a2f8bec04fbb service nova] Acquiring lock "82bc5fd0-26c7-4f81-b966-54831393b617-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:16:45 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-f672a46a-d114-4d7d-971e-9d2c82c38f3e req-27b1d6db-434a-4341-8acd-a2f8bec04fbb service nova] Lock "82bc5fd0-26c7-4f81-b966-54831393b617-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:16:45 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-f672a46a-d114-4d7d-971e-9d2c82c38f3e req-27b1d6db-434a-4341-8acd-a2f8bec04fbb service nova] Lock "82bc5fd0-26c7-4f81-b966-54831393b617-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:16:45 user nova-compute[75045]: DEBUG nova.compute.manager [req-f672a46a-d114-4d7d-971e-9d2c82c38f3e req-27b1d6db-434a-4341-8acd-a2f8bec04fbb service nova] [instance: 82bc5fd0-26c7-4f81-b966-54831393b617] No waiting events found dispatching network-vif-plugged-5d77f7bf-dc8f-4aa2-9c4a-48d0e81d7451 {{(pid=75045) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 23:16:45 user nova-compute[75045]: WARNING nova.compute.manager [req-f672a46a-d114-4d7d-971e-9d2c82c38f3e req-27b1d6db-434a-4341-8acd-a2f8bec04fbb service nova] [instance: 82bc5fd0-26c7-4f81-b966-54831393b617] Received unexpected event network-vif-plugged-5d77f7bf-dc8f-4aa2-9c4a-48d0e81d7451 for instance with vm_state building and task_state spawning.
Nov 08 23:16:45 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:16:47 user nova-compute[75045]: DEBUG nova.compute.manager [req-dd4b10f7-3fb2-49f2-8f13-6f426f8a15d9 req-1a5e9261-fe50-4eb4-83a9-b3ba02b06223 service nova] [instance: 82bc5fd0-26c7-4f81-b966-54831393b617] Received event network-vif-plugged-5d77f7bf-dc8f-4aa2-9c4a-48d0e81d7451 {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:16:47 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-dd4b10f7-3fb2-49f2-8f13-6f426f8a15d9 req-1a5e9261-fe50-4eb4-83a9-b3ba02b06223 service nova] Acquiring lock "82bc5fd0-26c7-4f81-b966-54831393b617-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:16:47 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-dd4b10f7-3fb2-49f2-8f13-6f426f8a15d9 req-1a5e9261-fe50-4eb4-83a9-b3ba02b06223 service nova] Lock "82bc5fd0-26c7-4f81-b966-54831393b617-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:16:47 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-dd4b10f7-3fb2-49f2-8f13-6f426f8a15d9 req-1a5e9261-fe50-4eb4-83a9-b3ba02b06223 service nova] Lock "82bc5fd0-26c7-4f81-b966-54831393b617-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:16:47 user nova-compute[75045]: DEBUG nova.compute.manager [req-dd4b10f7-3fb2-49f2-8f13-6f426f8a15d9 req-1a5e9261-fe50-4eb4-83a9-b3ba02b06223 service nova] [instance: 82bc5fd0-26c7-4f81-b966-54831393b617] No waiting events found dispatching network-vif-plugged-5d77f7bf-dc8f-4aa2-9c4a-48d0e81d7451 {{(pid=75045) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 23:16:47 user nova-compute[75045]: WARNING nova.compute.manager [req-dd4b10f7-3fb2-49f2-8f13-6f426f8a15d9 req-1a5e9261-fe50-4eb4-83a9-b3ba02b06223 service nova] [instance: 82bc5fd0-26c7-4f81-b966-54831393b617] Received unexpected event network-vif-plugged-5d77f7bf-dc8f-4aa2-9c4a-48d0e81d7451 for instance with vm_state building and task_state spawning.
Nov 08 23:16:48 user nova-compute[75045]: DEBUG nova.compute.manager [None req-a3bc4917-4314-4754-b33a-e1b27f461959 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262-project-member] [instance: 82bc5fd0-26c7-4f81-b966-54831393b617] Instance event wait completed in 0 seconds for  {{(pid=75045) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 23:16:48 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-a3bc4917-4314-4754-b33a-e1b27f461959 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262-project-member] [instance: 82bc5fd0-26c7-4f81-b966-54831393b617] Guest created on hypervisor {{(pid=75045) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 23:16:48 user nova-compute[75045]: INFO nova.virt.libvirt.driver [-] [instance: 82bc5fd0-26c7-4f81-b966-54831393b617] Instance spawned successfully.
Nov 08 23:16:48 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-a3bc4917-4314-4754-b33a-e1b27f461959 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262-project-member] [instance: 82bc5fd0-26c7-4f81-b966-54831393b617] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75045) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 23:16:48 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-a3bc4917-4314-4754-b33a-e1b27f461959 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262-project-member] [instance: 82bc5fd0-26c7-4f81-b966-54831393b617] Found default for hw_cdrom_bus of ide {{(pid=75045) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 23:16:48 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-a3bc4917-4314-4754-b33a-e1b27f461959 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262-project-member] [instance: 82bc5fd0-26c7-4f81-b966-54831393b617] Found default for hw_disk_bus of virtio {{(pid=75045) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 23:16:48 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-a3bc4917-4314-4754-b33a-e1b27f461959 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262-project-member] [instance: 82bc5fd0-26c7-4f81-b966-54831393b617] Found default for hw_input_bus of None {{(pid=75045) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 23:16:48 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-a3bc4917-4314-4754-b33a-e1b27f461959 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262-project-member] [instance: 82bc5fd0-26c7-4f81-b966-54831393b617] Found default for hw_pointer_model of None {{(pid=75045) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 23:16:48 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-a3bc4917-4314-4754-b33a-e1b27f461959 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262-project-member] [instance: 82bc5fd0-26c7-4f81-b966-54831393b617] Found default for hw_video_model of virtio {{(pid=75045) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 23:16:48 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-a3bc4917-4314-4754-b33a-e1b27f461959 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262-project-member] [instance: 82bc5fd0-26c7-4f81-b966-54831393b617] Found default for hw_vif_model of virtio {{(pid=75045) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 23:16:48 user nova-compute[75045]: INFO nova.compute.manager [None req-a3bc4917-4314-4754-b33a-e1b27f461959 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262-project-member] [instance: 82bc5fd0-26c7-4f81-b966-54831393b617] Took 7.72 seconds to spawn the instance on the hypervisor.
Nov 08 23:16:48 user nova-compute[75045]: DEBUG nova.compute.manager [None req-a3bc4917-4314-4754-b33a-e1b27f461959 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262-project-member] [instance: 82bc5fd0-26c7-4f81-b966-54831393b617] Checking state {{(pid=75045) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 23:16:48 user nova-compute[75045]: INFO nova.compute.manager [None req-a3bc4917-4314-4754-b33a-e1b27f461959 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262-project-member] [instance: 82bc5fd0-26c7-4f81-b966-54831393b617] Took 8.56 seconds to build instance.
Nov 08 23:16:48 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-a3bc4917-4314-4754-b33a-e1b27f461959 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262-project-member] Lock "82bc5fd0-26c7-4f81-b966-54831393b617" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.750s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:16:48 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:16:50 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:16:53 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:16:55 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:16:58 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:17:00 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:17:03 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:17:05 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:17:08 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:17:10 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:17:13 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:17:15 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:17:18 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:17:20 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:17:22 user nova-compute[75045]: DEBUG nova.compute.manager [None req-cd4ce09f-4b04-40c1-811d-acc29b510cfa tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] [instance: 4ae5ff6b-6f2c-4dfd-a4c6-da4809e2cf27] Checking state {{(pid=75045) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 23:17:23 user nova-compute[75045]: INFO nova.compute.manager [None req-cd4ce09f-4b04-40c1-811d-acc29b510cfa tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] [instance: 4ae5ff6b-6f2c-4dfd-a4c6-da4809e2cf27] instance snapshotting
Nov 08 23:17:23 user nova-compute[75045]: INFO nova.virt.libvirt.driver [None req-cd4ce09f-4b04-40c1-811d-acc29b510cfa tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] [instance: 4ae5ff6b-6f2c-4dfd-a4c6-da4809e2cf27] Beginning live snapshot process
Nov 08 23:17:23 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-cd4ce09f-4b04-40c1-811d-acc29b510cfa tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ae5ff6b-6f2c-4dfd-a4c6-da4809e2cf27/disk --force-share --output=json -f qcow2 {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:17:23 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-cd4ce09f-4b04-40c1-811d-acc29b510cfa tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ae5ff6b-6f2c-4dfd-a4c6-da4809e2cf27/disk --force-share --output=json -f qcow2" returned: 0 in 0.191s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:17:23 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-cd4ce09f-4b04-40c1-811d-acc29b510cfa tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ae5ff6b-6f2c-4dfd-a4c6-da4809e2cf27/disk --force-share --output=json -f qcow2 {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:17:23 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-cd4ce09f-4b04-40c1-811d-acc29b510cfa tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ae5ff6b-6f2c-4dfd-a4c6-da4809e2cf27/disk --force-share --output=json -f qcow2" returned: 0 in 0.184s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:17:23 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-cd4ce09f-4b04-40c1-811d-acc29b510cfa tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b59f52a99fff51c56dd1edfb83892fb8f647f2f3 --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:17:23 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-cd4ce09f-4b04-40c1-811d-acc29b510cfa tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b59f52a99fff51c56dd1edfb83892fb8f647f2f3 --force-share --output=json" returned: 0 in 0.177s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:17:23 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-cd4ce09f-4b04-40c1-811d-acc29b510cfa tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b59f52a99fff51c56dd1edfb83892fb8f647f2f3,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpps7on231/396d55b9270141d382b28329949c97a6.delta 1073741824 {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:17:23 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:17:23 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-cd4ce09f-4b04-40c1-811d-acc29b510cfa tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b59f52a99fff51c56dd1edfb83892fb8f647f2f3,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpps7on231/396d55b9270141d382b28329949c97a6.delta 1073741824" returned: 0 in 0.076s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:17:23 user nova-compute[75045]: INFO nova.virt.libvirt.driver [None req-cd4ce09f-4b04-40c1-811d-acc29b510cfa tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] [instance: 4ae5ff6b-6f2c-4dfd-a4c6-da4809e2cf27] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 08 23:17:23 user nova-compute[75045]: DEBUG nova.virt.libvirt.host [None req-cd4ce09f-4b04-40c1-811d-acc29b510cfa tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Checking UEFI support for host arch (x86_64) {{(pid=75045) supports_uefi /opt/stack/nova/nova/virt/libvirt/host.py:1751}}
Nov 08 23:17:23 user nova-compute[75045]: INFO nova.virt.libvirt.host [None req-cd4ce09f-4b04-40c1-811d-acc29b510cfa tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] UEFI support detected
Nov 08 23:17:23 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-f3f2356a-2491-4528-8f30-cbe1a8b03108 tempest-TestShelveInstance-1634360024 tempest-TestShelveInstance-1634360024-project-member] Acquiring lock "725866aa-0e2a-4af3-af20-48157e6d2fcb" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:17:23 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-f3f2356a-2491-4528-8f30-cbe1a8b03108 tempest-TestShelveInstance-1634360024 tempest-TestShelveInstance-1634360024-project-member] Lock "725866aa-0e2a-4af3-af20-48157e6d2fcb" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:17:23 user nova-compute[75045]: DEBUG nova.compute.manager [None req-f3f2356a-2491-4528-8f30-cbe1a8b03108 tempest-TestShelveInstance-1634360024 tempest-TestShelveInstance-1634360024-project-member] [instance: 725866aa-0e2a-4af3-af20-48157e6d2fcb] Starting instance... {{(pid=75045) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 23:17:24 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-f3f2356a-2491-4528-8f30-cbe1a8b03108 tempest-TestShelveInstance-1634360024 tempest-TestShelveInstance-1634360024-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:17:24 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-f3f2356a-2491-4528-8f30-cbe1a8b03108 tempest-TestShelveInstance-1634360024 tempest-TestShelveInstance-1634360024-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:17:24 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-f3f2356a-2491-4528-8f30-cbe1a8b03108 tempest-TestShelveInstance-1634360024 tempest-TestShelveInstance-1634360024-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75045) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 23:17:24 user nova-compute[75045]: INFO nova.compute.claims [None req-f3f2356a-2491-4528-8f30-cbe1a8b03108 tempest-TestShelveInstance-1634360024 tempest-TestShelveInstance-1634360024-project-member] [instance: 725866aa-0e2a-4af3-af20-48157e6d2fcb] Claim successful on node user
Nov 08 23:17:24 user nova-compute[75045]: DEBUG nova.compute.provider_tree [None req-f3f2356a-2491-4528-8f30-cbe1a8b03108 tempest-TestShelveInstance-1634360024 tempest-TestShelveInstance-1634360024-project-member] Inventory has not changed in ProviderTree for provider: 62ba5f85-c74d-4b58-986e-d4197e813fd7 {{(pid=75045) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 23:17:24 user nova-compute[75045]: DEBUG nova.scheduler.client.report [None req-f3f2356a-2491-4528-8f30-cbe1a8b03108 tempest-TestShelveInstance-1634360024 tempest-TestShelveInstance-1634360024-project-member] Inventory has not changed for provider 62ba5f85-c74d-4b58-986e-d4197e813fd7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75045) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 23:17:24 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-f3f2356a-2491-4528-8f30-cbe1a8b03108 tempest-TestShelveInstance-1634360024 tempest-TestShelveInstance-1634360024-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.446s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:17:24 user nova-compute[75045]: DEBUG nova.compute.manager [None req-f3f2356a-2491-4528-8f30-cbe1a8b03108 tempest-TestShelveInstance-1634360024 tempest-TestShelveInstance-1634360024-project-member] [instance: 725866aa-0e2a-4af3-af20-48157e6d2fcb] Start building networks asynchronously for instance. {{(pid=75045) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 23:17:24 user nova-compute[75045]: DEBUG nova.compute.manager [None req-f3f2356a-2491-4528-8f30-cbe1a8b03108 tempest-TestShelveInstance-1634360024 tempest-TestShelveInstance-1634360024-project-member] [instance: 725866aa-0e2a-4af3-af20-48157e6d2fcb] Allocating IP information in the background. {{(pid=75045) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 23:17:24 user nova-compute[75045]: DEBUG nova.network.neutron [None req-f3f2356a-2491-4528-8f30-cbe1a8b03108 tempest-TestShelveInstance-1634360024 tempest-TestShelveInstance-1634360024-project-member] [instance: 725866aa-0e2a-4af3-af20-48157e6d2fcb] allocate_for_instance() {{(pid=75045) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 23:17:24 user nova-compute[75045]: INFO nova.virt.libvirt.driver [None req-f3f2356a-2491-4528-8f30-cbe1a8b03108 tempest-TestShelveInstance-1634360024 tempest-TestShelveInstance-1634360024-project-member] [instance: 725866aa-0e2a-4af3-af20-48157e6d2fcb] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 23:17:24 user nova-compute[75045]: DEBUG nova.compute.manager [None req-f3f2356a-2491-4528-8f30-cbe1a8b03108 tempest-TestShelveInstance-1634360024 tempest-TestShelveInstance-1634360024-project-member] [instance: 725866aa-0e2a-4af3-af20-48157e6d2fcb] Start building block device mappings for instance. {{(pid=75045) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 23:17:24 user nova-compute[75045]: DEBUG nova.policy [None req-f3f2356a-2491-4528-8f30-cbe1a8b03108 tempest-TestShelveInstance-1634360024 tempest-TestShelveInstance-1634360024-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e30385ff71444d4f9a799c79e0ab67e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec089e7050c542c9860d9fc5f3ae9392', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75045) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 23:17:24 user nova-compute[75045]: DEBUG nova.virt.libvirt.guest [None req-cd4ce09f-4b04-40c1-811d-acc29b510cfa tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] COPY block job progress, current cursor: 196608 final cursor: 75497472 {{(pid=75045) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 08 23:17:24 user nova-compute[75045]: INFO nova.virt.block_device [None req-f3f2356a-2491-4528-8f30-cbe1a8b03108 tempest-TestShelveInstance-1634360024 tempest-TestShelveInstance-1634360024-project-member] [instance: 725866aa-0e2a-4af3-af20-48157e6d2fcb] Booting with volume d2068946-d374-45a4-9850-e3a690b13ef4 at /dev/vda
Nov 08 23:17:24 user nova-compute[75045]: DEBUG os_brick.utils [None req-f3f2356a-2491-4528-8f30-cbe1a8b03108 tempest-TestShelveInstance-1634360024 tempest-TestShelveInstance-1634360024-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75045) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 23:17:24 user nova-compute[75045]: INFO oslo.privsep.daemon [None req-f3f2356a-2491-4528-8f30-cbe1a8b03108 tempest-TestShelveInstance-1634360024 tempest-TestShelveInstance-1634360024-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'os_brick.privileged.default', '--privsep_sock_path', '/tmp/tmpkflyo2y1/privsep.sock']
Nov 08 23:17:24 user sudo[86117]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context os_brick.privileged.default --privsep_sock_path /tmp/tmpkflyo2y1/privsep.sock
Nov 08 23:17:24 user sudo[86117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Nov 08 23:17:25 user nova-compute[75045]: DEBUG nova.virt.libvirt.guest [None req-cd4ce09f-4b04-40c1-811d-acc29b510cfa tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=75045) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 08 23:17:25 user nova-compute[75045]: INFO nova.virt.libvirt.driver [None req-cd4ce09f-4b04-40c1-811d-acc29b510cfa tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] [instance: 4ae5ff6b-6f2c-4dfd-a4c6-da4809e2cf27] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 08 23:17:25 user nova-compute[75045]: DEBUG nova.privsep.utils [None req-cd4ce09f-4b04-40c1-811d-acc29b510cfa tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75045) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 08 23:17:25 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-cd4ce09f-4b04-40c1-811d-acc29b510cfa tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpps7on231/396d55b9270141d382b28329949c97a6.delta /opt/stack/data/nova/instances/snapshots/tmpps7on231/396d55b9270141d382b28329949c97a6 {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:17:25 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-cd4ce09f-4b04-40c1-811d-acc29b510cfa tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpps7on231/396d55b9270141d382b28329949c97a6.delta /opt/stack/data/nova/instances/snapshots/tmpps7on231/396d55b9270141d382b28329949c97a6" returned: 0 in 0.420s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:17:25 user nova-compute[75045]: INFO nova.virt.libvirt.driver [None req-cd4ce09f-4b04-40c1-811d-acc29b510cfa tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] [instance: 4ae5ff6b-6f2c-4dfd-a4c6-da4809e2cf27] Snapshot extracted, beginning image upload
Nov 08 23:17:25 user nova-compute[75045]: DEBUG nova.network.neutron [None req-f3f2356a-2491-4528-8f30-cbe1a8b03108 tempest-TestShelveInstance-1634360024 tempest-TestShelveInstance-1634360024-project-member] [instance: 725866aa-0e2a-4af3-af20-48157e6d2fcb] Successfully created port: 9a617e54-a69a-4204-b94e-dbe71b1432d2 {{(pid=75045) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 23:17:26 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-ac28c4dc-b349-4d76-b20f-521f64e4c39b tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] Acquiring lock "520eac4f-fa48-4e41-924d-840907e701b4" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:17:26 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-ac28c4dc-b349-4d76-b20f-521f64e4c39b tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] Lock "520eac4f-fa48-4e41-924d-840907e701b4" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:17:26 user nova-compute[75045]: DEBUG nova.compute.manager [None req-ac28c4dc-b349-4d76-b20f-521f64e4c39b tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] [instance: 520eac4f-fa48-4e41-924d-840907e701b4] Starting instance... {{(pid=75045) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 23:17:26 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-ac28c4dc-b349-4d76-b20f-521f64e4c39b tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:17:26 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-ac28c4dc-b349-4d76-b20f-521f64e4c39b tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:17:26 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-ac28c4dc-b349-4d76-b20f-521f64e4c39b tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75045) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 23:17:26 user nova-compute[75045]: INFO nova.compute.claims [None req-ac28c4dc-b349-4d76-b20f-521f64e4c39b tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] [instance: 520eac4f-fa48-4e41-924d-840907e701b4] Claim successful on node user
Nov 08 23:17:26 user sudo[86117]: pam_unix(sudo:session): session closed for user root
Nov 08 23:17:26 user nova-compute[75045]: INFO oslo.privsep.daemon [None req-f3f2356a-2491-4528-8f30-cbe1a8b03108 tempest-TestShelveInstance-1634360024 tempest-TestShelveInstance-1634360024-project-member] Spawned new privsep daemon via rootwrap
Nov 08 23:17:26 user nova-compute[75045]: INFO oslo.privsep.daemon [-] privsep daemon starting
Nov 08 23:17:26 user nova-compute[75045]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Nov 08 23:17:26 user nova-compute[75045]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_SYS_ADMIN/CAP_SYS_ADMIN/none
Nov 08 23:17:26 user nova-compute[75045]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 86132
Nov 08 23:17:26 user nova-compute[75045]: DEBUG nova.network.neutron [None req-f3f2356a-2491-4528-8f30-cbe1a8b03108 tempest-TestShelveInstance-1634360024 tempest-TestShelveInstance-1634360024-project-member] [instance: 725866aa-0e2a-4af3-af20-48157e6d2fcb] Successfully updated port: 9a617e54-a69a-4204-b94e-dbe71b1432d2 {{(pid=75045) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 23:17:26 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d6af84c-654b-4440-bd84-790cb32848fd]: (2,) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:17:26 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-f3f2356a-2491-4528-8f30-cbe1a8b03108 tempest-TestShelveInstance-1634360024 tempest-TestShelveInstance-1634360024-project-member] Acquiring lock "refresh_cache-725866aa-0e2a-4af3-af20-48157e6d2fcb" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 23:17:26 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-f3f2356a-2491-4528-8f30-cbe1a8b03108 tempest-TestShelveInstance-1634360024 tempest-TestShelveInstance-1634360024-project-member] Acquired lock "refresh_cache-725866aa-0e2a-4af3-af20-48157e6d2fcb" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 23:17:26 user nova-compute[75045]: DEBUG nova.network.neutron [None req-f3f2356a-2491-4528-8f30-cbe1a8b03108 tempest-TestShelveInstance-1634360024 tempest-TestShelveInstance-1634360024-project-member] [instance: 725866aa-0e2a-4af3-af20-48157e6d2fcb] Building network info cache for instance {{(pid=75045) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 23:17:26 user nova-compute[75045]: DEBUG nova.compute.manager [req-aeeccfb5-2a54-4621-a002-5829984ed7c2 req-6dda67df-75cb-4ce4-8a03-440324af16cc service nova] [instance: 725866aa-0e2a-4af3-af20-48157e6d2fcb] Received event network-changed-9a617e54-a69a-4204-b94e-dbe71b1432d2 {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:17:26 user nova-compute[75045]: DEBUG nova.compute.manager [req-aeeccfb5-2a54-4621-a002-5829984ed7c2 req-6dda67df-75cb-4ce4-8a03-440324af16cc service nova] [instance: 725866aa-0e2a-4af3-af20-48157e6d2fcb] Refreshing instance network info cache due to event network-changed-9a617e54-a69a-4204-b94e-dbe71b1432d2. {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 23:17:26 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-aeeccfb5-2a54-4621-a002-5829984ed7c2 req-6dda67df-75cb-4ce4-8a03-440324af16cc service nova] Acquiring lock "refresh_cache-725866aa-0e2a-4af3-af20-48157e6d2fcb" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 23:17:26 user nova-compute[75045]: DEBUG nova.network.neutron [None req-f3f2356a-2491-4528-8f30-cbe1a8b03108 tempest-TestShelveInstance-1634360024 tempest-TestShelveInstance-1634360024-project-member] [instance: 725866aa-0e2a-4af3-af20-48157e6d2fcb] Instance cache missing network info. {{(pid=75045) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 23:17:26 user nova-compute[75045]: DEBUG nova.compute.provider_tree [None req-ac28c4dc-b349-4d76-b20f-521f64e4c39b tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] Inventory has not changed in ProviderTree for provider: 62ba5f85-c74d-4b58-986e-d4197e813fd7 {{(pid=75045) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 23:17:26 user nova-compute[75045]: DEBUG nova.scheduler.client.report [None req-ac28c4dc-b349-4d76-b20f-521f64e4c39b tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] Inventory has not changed for provider 62ba5f85-c74d-4b58-986e-d4197e813fd7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75045) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 23:17:26 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:17:26 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-ac28c4dc-b349-4d76-b20f-521f64e4c39b tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.557s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:17:26 user nova-compute[75045]: DEBUG nova.compute.manager [None req-ac28c4dc-b349-4d76-b20f-521f64e4c39b tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] [instance: 520eac4f-fa48-4e41-924d-840907e701b4] Start building networks asynchronously for instance. {{(pid=75045) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 23:17:26 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:17:26 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3720c9d-3b83-4d91-9283-17f63f447524]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6217bd6e884\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:17:26 user nova-compute[75045]: WARNING os_brick.initiator.connectors.nvmeof [None req-f3f2356a-2491-4528-8f30-cbe1a8b03108 tempest-TestShelveInstance-1634360024 tempest-TestShelveInstance-1634360024-project-member] Could not find nvme_core/parameters/multipath: FileNotFoundError: [Errno 2] No such file or directory: '/sys/module/nvme_core/parameters/multipath'
Nov 08 23:17:26 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:17:26 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:17:26 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7e56cbc-a0de-4549-ab57-c0e51daf0f1d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:17:26 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:17:26 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:17:26 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7a669e7-016d-4182-ad37-71a18573bd6b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:17:26 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e8e3c64-60b0-46ad-82de-163b17b0ca40]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:17:26 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-f3f2356a-2491-4528-8f30-cbe1a8b03108 tempest-TestShelveInstance-1634360024 tempest-TestShelveInstance-1634360024-project-member] Running cmd (subprocess): nvme version {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:17:26 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-f3f2356a-2491-4528-8f30-cbe1a8b03108 tempest-TestShelveInstance-1634360024 tempest-TestShelveInstance-1634360024-project-member] 'nvme version' failed. Not Retrying. {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 23:17:26 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f3f2356a-2491-4528-8f30-cbe1a8b03108 tempest-TestShelveInstance-1634360024 tempest-TestShelveInstance-1634360024-project-member] nvme not present on system {{(pid=75045) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 23:17:26 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:17:26 user nova-compute[75045]: DEBUG nova.compute.manager [None req-ac28c4dc-b349-4d76-b20f-521f64e4c39b tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] [instance: 520eac4f-fa48-4e41-924d-840907e701b4] Allocating IP information in the background. {{(pid=75045) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 23:17:26 user nova-compute[75045]: DEBUG nova.network.neutron [None req-ac28c4dc-b349-4d76-b20f-521f64e4c39b tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] [instance: 520eac4f-fa48-4e41-924d-840907e701b4] allocate_for_instance() {{(pid=75045) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 23:17:26 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 23:17:26 user nova-compute[75045]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 23:17:26 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a89efb4-780a-4f8c-b48b-fc4108366582]: (4, '') {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:17:26 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.lightos [None req-f3f2356a-2491-4528-8f30-cbe1a8b03108 tempest-TestShelveInstance-1634360024 tempest-TestShelveInstance-1634360024-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75045) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 23:17:26 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.lightos [None req-f3f2356a-2491-4528-8f30-cbe1a8b03108 tempest-TestShelveInstance-1634360024 tempest-TestShelveInstance-1634360024-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75045) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 23:17:26 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.lightos [None req-f3f2356a-2491-4528-8f30-cbe1a8b03108 tempest-TestShelveInstance-1634360024 tempest-TestShelveInstance-1634360024-project-member] LIGHTOS: no hostnqn found. {{(pid=75045) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 23:17:26 user nova-compute[75045]: DEBUG os_brick.utils [None req-f3f2356a-2491-4528-8f30-cbe1a8b03108 tempest-TestShelveInstance-1634360024 tempest-TestShelveInstance-1634360024-project-member] <== get_connector_properties: return (1920ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6217bd6e884', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75045) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 23:17:26 user nova-compute[75045]: DEBUG nova.virt.block_device [None req-f3f2356a-2491-4528-8f30-cbe1a8b03108 tempest-TestShelveInstance-1634360024 tempest-TestShelveInstance-1634360024-project-member] [instance: 725866aa-0e2a-4af3-af20-48157e6d2fcb] Updating existing volume attachment record: 2768e0ab-35d7-4356-b620-bc634898d0a6 {{(pid=75045) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 23:17:26 user nova-compute[75045]: INFO nova.virt.libvirt.driver [None req-ac28c4dc-b349-4d76-b20f-521f64e4c39b tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] [instance: 520eac4f-fa48-4e41-924d-840907e701b4] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 23:17:26 user nova-compute[75045]: DEBUG nova.network.neutron [None req-f3f2356a-2491-4528-8f30-cbe1a8b03108 tempest-TestShelveInstance-1634360024 tempest-TestShelveInstance-1634360024-project-member] [instance: 725866aa-0e2a-4af3-af20-48157e6d2fcb] Updating instance_info_cache with network_info: [{"id": "9a617e54-a69a-4204-b94e-dbe71b1432d2", "address": "fa:16:3e:64:ef:b6", "network": {"id": "25b429b3-693b-4e72-9035-71c276706294", "bridge": "br-int", "label": "tempest-TestShelveInstance-437524717-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec089e7050c542c9860d9fc5f3ae9392", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a617e54-a6", "ovs_interfaceid": "9a617e54-a69a-4204-b94e-dbe71b1432d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75045) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 23:17:26 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-f3f2356a-2491-4528-8f30-cbe1a8b03108 tempest-TestShelveInstance-1634360024 tempest-TestShelveInstance-1634360024-project-member] Releasing lock "refresh_cache-725866aa-0e2a-4af3-af20-48157e6d2fcb" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 23:17:26 user nova-compute[75045]: DEBUG nova.compute.manager [None req-f3f2356a-2491-4528-8f30-cbe1a8b03108 tempest-TestShelveInstance-1634360024 tempest-TestShelveInstance-1634360024-project-member] [instance: 725866aa-0e2a-4af3-af20-48157e6d2fcb] Instance network_info: |[{"id": "9a617e54-a69a-4204-b94e-dbe71b1432d2", "address": "fa:16:3e:64:ef:b6", "network": {"id": "25b429b3-693b-4e72-9035-71c276706294", "bridge": "br-int", "label": "tempest-TestShelveInstance-437524717-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec089e7050c542c9860d9fc5f3ae9392", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a617e54-a6", "ovs_interfaceid": "9a617e54-a69a-4204-b94e-dbe71b1432d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75045) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 23:17:26 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-aeeccfb5-2a54-4621-a002-5829984ed7c2 req-6dda67df-75cb-4ce4-8a03-440324af16cc service nova] Acquired lock "refresh_cache-725866aa-0e2a-4af3-af20-48157e6d2fcb" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 23:17:26 user nova-compute[75045]: DEBUG nova.network.neutron [req-aeeccfb5-2a54-4621-a002-5829984ed7c2 req-6dda67df-75cb-4ce4-8a03-440324af16cc service nova] [instance: 725866aa-0e2a-4af3-af20-48157e6d2fcb] Refreshing network info cache for port 9a617e54-a69a-4204-b94e-dbe71b1432d2 {{(pid=75045) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 23:17:26 user nova-compute[75045]: DEBUG nova.compute.manager [None req-ac28c4dc-b349-4d76-b20f-521f64e4c39b tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] [instance: 520eac4f-fa48-4e41-924d-840907e701b4] Start building block device mappings for instance. {{(pid=75045) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 23:17:27 user nova-compute[75045]: INFO nova.virt.block_device [None req-ac28c4dc-b349-4d76-b20f-521f64e4c39b tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] [instance: 520eac4f-fa48-4e41-924d-840907e701b4] Booting with volume 175bb2c0-7767-4740-9350-7e3300681a43 at /dev/vda
Nov 08 23:17:27 user nova-compute[75045]: DEBUG nova.policy [None req-ac28c4dc-b349-4d76-b20f-521f64e4c39b tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8c4361faf9ee4444be0e061b8c8aee98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ebbe44152141368b22a9a7989d577a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75045) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 23:17:27 user nova-compute[75045]: DEBUG os_brick.utils [None req-ac28c4dc-b349-4d76-b20f-521f64e4c39b tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75045) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 23:17:27 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:17:27 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:17:27 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca0e89cf-d429-4b4b-b08e-1769116232cb]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6217bd6e884\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:17:27 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:17:27 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.021s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:17:27 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f6cb277-cfeb-43e5-851b-664c3a659626]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:17:27 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:17:27 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:17:27 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[b86b4ccf-4930-43bc-a066-0ec3b1e16c96]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:17:27 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[00b9a21e-7c53-4cf6-b51b-d976f3bd36d2]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:17:27 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-ac28c4dc-b349-4d76-b20f-521f64e4c39b tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] Running cmd (subprocess): nvme version {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:17:27 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-ac28c4dc-b349-4d76-b20f-521f64e4c39b tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] 'nvme version' failed. Not Retrying. {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 23:17:27 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ac28c4dc-b349-4d76-b20f-521f64e4c39b tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] nvme not present on system {{(pid=75045) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 23:17:27 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:17:27 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 23:17:27 user nova-compute[75045]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 23:17:27 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[19ad039c-e757-4a03-a250-dc8958ac4b61]: (4, '') {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:17:27 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.lightos [None req-ac28c4dc-b349-4d76-b20f-521f64e4c39b tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75045) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 23:17:27 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.lightos [None req-ac28c4dc-b349-4d76-b20f-521f64e4c39b tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75045) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 23:17:27 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.lightos [None req-ac28c4dc-b349-4d76-b20f-521f64e4c39b tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] LIGHTOS: no hostnqn found. {{(pid=75045) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 23:17:27 user nova-compute[75045]: DEBUG os_brick.utils [None req-ac28c4dc-b349-4d76-b20f-521f64e4c39b tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] <== get_connector_properties: return (149ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6217bd6e884', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75045) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 23:17:27 user nova-compute[75045]: DEBUG nova.virt.block_device [None req-ac28c4dc-b349-4d76-b20f-521f64e4c39b tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] [instance: 520eac4f-fa48-4e41-924d-840907e701b4] Updating existing volume attachment record: ea928ac6-518f-4ffa-8d90-41b4c7cb49b8 {{(pid=75045) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 23:17:27 user nova-compute[75045]: DEBUG nova.network.neutron [req-aeeccfb5-2a54-4621-a002-5829984ed7c2 req-6dda67df-75cb-4ce4-8a03-440324af16cc service nova] [instance: 725866aa-0e2a-4af3-af20-48157e6d2fcb] Updated VIF entry in instance network info cache for port 9a617e54-a69a-4204-b94e-dbe71b1432d2. {{(pid=75045) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 23:17:27 user nova-compute[75045]: DEBUG nova.network.neutron [req-aeeccfb5-2a54-4621-a002-5829984ed7c2 req-6dda67df-75cb-4ce4-8a03-440324af16cc service nova] [instance: 725866aa-0e2a-4af3-af20-48157e6d2fcb] Updating instance_info_cache with network_info: [{"id": "9a617e54-a69a-4204-b94e-dbe71b1432d2", "address": "fa:16:3e:64:ef:b6", "network": {"id": "25b429b3-693b-4e72-9035-71c276706294", "bridge": "br-int", "label": "tempest-TestShelveInstance-437524717-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec089e7050c542c9860d9fc5f3ae9392", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a617e54-a6", "ovs_interfaceid": "9a617e54-a69a-4204-b94e-dbe71b1432d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75045) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 23:17:27 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-aeeccfb5-2a54-4621-a002-5829984ed7c2 req-6dda67df-75cb-4ce4-8a03-440324af16cc service nova] Releasing lock "refresh_cache-725866aa-0e2a-4af3-af20-48157e6d2fcb" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 23:17:27 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:17:28 user nova-compute[75045]: DEBUG nova.network.neutron [None req-ac28c4dc-b349-4d76-b20f-521f64e4c39b tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] [instance: 520eac4f-fa48-4e41-924d-840907e701b4] Successfully created port: 25776e3e-60d6-457c-a78a-a59df0e3e7b5 {{(pid=75045) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 23:17:28 user nova-compute[75045]: DEBUG nova.network.neutron [None req-ac28c4dc-b349-4d76-b20f-521f64e4c39b tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] [instance: 520eac4f-fa48-4e41-924d-840907e701b4] Successfully created port: b3c645dd-a1ac-4780-a49d-916cb6a121c9 {{(pid=75045) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 23:17:28 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 23:17:29 user nova-compute[75045]: INFO nova.virt.libvirt.driver [None req-cd4ce09f-4b04-40c1-811d-acc29b510cfa tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] [instance: 4ae5ff6b-6f2c-4dfd-a4c6-da4809e2cf27] Snapshot image upload complete
Nov 08 23:17:29 user nova-compute[75045]: INFO nova.compute.manager [None req-cd4ce09f-4b04-40c1-811d-acc29b510cfa tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] [instance: 4ae5ff6b-6f2c-4dfd-a4c6-da4809e2cf27] Took 6.06 seconds to snapshot the instance on the hypervisor.
Nov 08 23:17:29 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:17:29 user nova-compute[75045]: DEBUG nova.network.neutron [None req-ac28c4dc-b349-4d76-b20f-521f64e4c39b tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] [instance: 520eac4f-fa48-4e41-924d-840907e701b4] Successfully created port: 3974ed79-74a5-4e9c-aa42-3aab1b234a39 {{(pid=75045) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 23:17:29 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:17:29 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:17:29 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager.update_available_resource {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:17:30 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:17:30 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.002s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:17:30 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:17:30 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Auditing locally available compute resources for user (node: user) {{(pid=75045) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 23:17:30 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82bc5fd0-26c7-4f81-b966-54831393b617/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:17:30 user nova-compute[75045]: DEBUG nova.network.neutron [None req-ac28c4dc-b349-4d76-b20f-521f64e4c39b tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] [instance: 520eac4f-fa48-4e41-924d-840907e701b4] Successfully created port: c2155ca8-d244-401d-a80f-8c53a68b6799 {{(pid=75045) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 23:17:30 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82bc5fd0-26c7-4f81-b966-54831393b617/disk --force-share --output=json" returned: 0 in 0.251s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:17:30 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82bc5fd0-26c7-4f81-b966-54831393b617/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:17:30 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82bc5fd0-26c7-4f81-b966-54831393b617/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:17:30 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09cf15e6-1cec-4c55-b7dd-4311b5f87d32/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:17:30 user nova-compute[75045]: DEBUG nova.network.neutron [None req-ac28c4dc-b349-4d76-b20f-521f64e4c39b tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] [instance: 520eac4f-fa48-4e41-924d-840907e701b4] Successfully created port: 768830de-7c2e-45ca-959e-398480b6ba29 {{(pid=75045) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 23:17:30 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09cf15e6-1cec-4c55-b7dd-4311b5f87d32/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:17:30 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09cf15e6-1cec-4c55-b7dd-4311b5f87d32/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:17:31 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09cf15e6-1cec-4c55-b7dd-4311b5f87d32/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:17:31 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ae5ff6b-6f2c-4dfd-a4c6-da4809e2cf27/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:17:31 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ae5ff6b-6f2c-4dfd-a4c6-da4809e2cf27/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:17:31 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ae5ff6b-6f2c-4dfd-a4c6-da4809e2cf27/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:17:31 user nova-compute[75045]: DEBUG nova.network.neutron [None req-ac28c4dc-b349-4d76-b20f-521f64e4c39b tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] [instance: 520eac4f-fa48-4e41-924d-840907e701b4] Successfully updated port: 25776e3e-60d6-457c-a78a-a59df0e3e7b5 {{(pid=75045) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 23:17:31 user nova-compute[75045]: DEBUG nova.compute.manager [req-25ace360-3840-4f75-945d-54210facc435 req-9638e100-81e4-4f53-acf0-c4699b7f7ccd service nova] [instance: 520eac4f-fa48-4e41-924d-840907e701b4] Received event network-changed-25776e3e-60d6-457c-a78a-a59df0e3e7b5 {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:17:31 user nova-compute[75045]: DEBUG nova.compute.manager [req-25ace360-3840-4f75-945d-54210facc435 req-9638e100-81e4-4f53-acf0-c4699b7f7ccd service nova] [instance: 520eac4f-fa48-4e41-924d-840907e701b4] Refreshing instance network info cache due to event network-changed-25776e3e-60d6-457c-a78a-a59df0e3e7b5. {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 23:17:31 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-25ace360-3840-4f75-945d-54210facc435 req-9638e100-81e4-4f53-acf0-c4699b7f7ccd service nova] Acquiring lock "refresh_cache-520eac4f-fa48-4e41-924d-840907e701b4" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 23:17:31 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-25ace360-3840-4f75-945d-54210facc435 req-9638e100-81e4-4f53-acf0-c4699b7f7ccd service nova] Acquired lock "refresh_cache-520eac4f-fa48-4e41-924d-840907e701b4" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 23:17:31 user nova-compute[75045]: DEBUG nova.network.neutron [req-25ace360-3840-4f75-945d-54210facc435 req-9638e100-81e4-4f53-acf0-c4699b7f7ccd service nova] [instance: 520eac4f-fa48-4e41-924d-840907e701b4] Refreshing network info cache for port 25776e3e-60d6-457c-a78a-a59df0e3e7b5 {{(pid=75045) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 23:17:31 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ae5ff6b-6f2c-4dfd-a4c6-da4809e2cf27/disk --force-share --output=json" returned: 0 in 0.234s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:17:31 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1cb1b440-0073-4a53-a0a2-e2781e021866/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:17:31 user nova-compute[75045]: DEBUG nova.network.neutron [req-25ace360-3840-4f75-945d-54210facc435 req-9638e100-81e4-4f53-acf0-c4699b7f7ccd service nova] [instance: 520eac4f-fa48-4e41-924d-840907e701b4] Instance cache missing network info. {{(pid=75045) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 23:17:31 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1cb1b440-0073-4a53-a0a2-e2781e021866/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:17:31 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1cb1b440-0073-4a53-a0a2-e2781e021866/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:17:31 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1cb1b440-0073-4a53-a0a2-e2781e021866/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:17:31 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f21fcd3-ac5f-499e-9c34-82af806fda1d/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:17:32 user nova-compute[75045]: DEBUG nova.network.neutron [req-25ace360-3840-4f75-945d-54210facc435 req-9638e100-81e4-4f53-acf0-c4699b7f7ccd service nova] [instance: 520eac4f-fa48-4e41-924d-840907e701b4] Updating instance_info_cache with network_info: [] {{(pid=75045) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 23:17:32 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-25ace360-3840-4f75-945d-54210facc435 req-9638e100-81e4-4f53-acf0-c4699b7f7ccd service nova] Releasing lock "refresh_cache-520eac4f-fa48-4e41-924d-840907e701b4" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 23:17:32 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f21fcd3-ac5f-499e-9c34-82af806fda1d/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:17:32 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f21fcd3-ac5f-499e-9c34-82af806fda1d/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:17:32 user nova-compute[75045]: DEBUG nova.network.neutron [None req-ac28c4dc-b349-4d76-b20f-521f64e4c39b tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] [instance: 520eac4f-fa48-4e41-924d-840907e701b4] Successfully updated port: bcd0d9eb-775a-4e28-b712-148c1fe99521 {{(pid=75045) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 23:17:32 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f21fcd3-ac5f-499e-9c34-82af806fda1d/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:17:32 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07ec2c05-aaa9-46e8-8439-7aa5b9fca19d/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:17:32 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07ec2c05-aaa9-46e8-8439-7aa5b9fca19d/disk --force-share --output=json" returned: 0 in 0.235s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:17:32 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07ec2c05-aaa9-46e8-8439-7aa5b9fca19d/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:17:32 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07ec2c05-aaa9-46e8-8439-7aa5b9fca19d/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:17:32 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fde91f7c-31e3-456c-b252-6ce37fa3b600/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:17:32 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-099dcd3c-5421-47c3-b271-c3b266b57fec tempest-DeleteServersTestJSON-1018435513 tempest-DeleteServersTestJSON-1018435513-project-member] Acquiring lock "09cf15e6-1cec-4c55-b7dd-4311b5f87d32" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:17:32 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-099dcd3c-5421-47c3-b271-c3b266b57fec tempest-DeleteServersTestJSON-1018435513 tempest-DeleteServersTestJSON-1018435513-project-member] Lock "09cf15e6-1cec-4c55-b7dd-4311b5f87d32" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:17:32 user nova-compute[75045]: DEBUG nova.objects.instance [None req-099dcd3c-5421-47c3-b271-c3b266b57fec tempest-DeleteServersTestJSON-1018435513 tempest-DeleteServersTestJSON-1018435513-project-member] Lazy-loading 'flavor' on Instance uuid 09cf15e6-1cec-4c55-b7dd-4311b5f87d32 {{(pid=75045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 23:17:32 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-099dcd3c-5421-47c3-b271-c3b266b57fec tempest-DeleteServersTestJSON-1018435513 tempest-DeleteServersTestJSON-1018435513-project-member] Lock "09cf15e6-1cec-4c55-b7dd-4311b5f87d32" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.116s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:17:33 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fde91f7c-31e3-456c-b252-6ce37fa3b600/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:17:33 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fde91f7c-31e3-456c-b252-6ce37fa3b600/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:17:33 user nova-compute[75045]: DEBUG nova.network.neutron [None req-ac28c4dc-b349-4d76-b20f-521f64e4c39b tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] [instance: 520eac4f-fa48-4e41-924d-840907e701b4] Successfully updated port: 04ae6531-75ef-4043-99f4-bfa5ef2bba59 {{(pid=75045) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 23:17:33 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fde91f7c-31e3-456c-b252-6ce37fa3b600/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:17:33 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9bd3096-92eb-4aae-8619-2725ed9acc2b/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:17:33 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-099dcd3c-5421-47c3-b271-c3b266b57fec tempest-DeleteServersTestJSON-1018435513 tempest-DeleteServersTestJSON-1018435513-project-member] Acquiring lock "09cf15e6-1cec-4c55-b7dd-4311b5f87d32" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:17:33 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-099dcd3c-5421-47c3-b271-c3b266b57fec tempest-DeleteServersTestJSON-1018435513 tempest-DeleteServersTestJSON-1018435513-project-member] Lock "09cf15e6-1cec-4c55-b7dd-4311b5f87d32" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:17:33 user nova-compute[75045]: INFO nova.compute.manager [None req-099dcd3c-5421-47c3-b271-c3b266b57fec tempest-DeleteServersTestJSON-1018435513 tempest-DeleteServersTestJSON-1018435513-project-member] [instance: 09cf15e6-1cec-4c55-b7dd-4311b5f87d32] Attaching volume 620828e2-bcb2-4fe0-be02-1cbd76c74b77 to /dev/vdb
Nov 08 23:17:33 user nova-compute[75045]: DEBUG os_brick.utils [None req-099dcd3c-5421-47c3-b271-c3b266b57fec tempest-DeleteServersTestJSON-1018435513 tempest-DeleteServersTestJSON-1018435513-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75045) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 23:17:33 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:17:33 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:17:33 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1314411-6e84-452d-a773-f6bef18d1473]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6217bd6e884\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:17:33 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:17:33 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9bd3096-92eb-4aae-8619-2725ed9acc2b/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:17:33 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9bd3096-92eb-4aae-8619-2725ed9acc2b/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:17:33 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:17:33 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[0117a8b6-fe3b-4eac-a3ad-0b5ffd7b45e8]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:17:33 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:17:33 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:17:33 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[60044476-6515-489e-8e9b-5f709ed571f3]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:17:33 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fddaa7b-b958-4a6e-bebb-e7651f85d630]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:17:33 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-099dcd3c-5421-47c3-b271-c3b266b57fec tempest-DeleteServersTestJSON-1018435513 tempest-DeleteServersTestJSON-1018435513-project-member] Running cmd (subprocess): nvme version {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:17:33 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-099dcd3c-5421-47c3-b271-c3b266b57fec tempest-DeleteServersTestJSON-1018435513 tempest-DeleteServersTestJSON-1018435513-project-member] 'nvme version' failed. Not Retrying. {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 23:17:33 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.nvmeof [None req-099dcd3c-5421-47c3-b271-c3b266b57fec tempest-DeleteServersTestJSON-1018435513 tempest-DeleteServersTestJSON-1018435513-project-member] nvme not present on system {{(pid=75045) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 23:17:33 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:17:33 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 23:17:33 user nova-compute[75045]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 23:17:33 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[b66602a7-9be9-481f-9952-5d90c43cb1f5]: (4, '') {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:17:33 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.lightos [None req-099dcd3c-5421-47c3-b271-c3b266b57fec tempest-DeleteServersTestJSON-1018435513 tempest-DeleteServersTestJSON-1018435513-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75045) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 23:17:33 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.lightos [None req-099dcd3c-5421-47c3-b271-c3b266b57fec tempest-DeleteServersTestJSON-1018435513 tempest-DeleteServersTestJSON-1018435513-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75045) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 23:17:33 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.lightos [None req-099dcd3c-5421-47c3-b271-c3b266b57fec tempest-DeleteServersTestJSON-1018435513 tempest-DeleteServersTestJSON-1018435513-project-member] LIGHTOS: no hostnqn found. {{(pid=75045) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 23:17:33 user nova-compute[75045]: DEBUG os_brick.utils [None req-099dcd3c-5421-47c3-b271-c3b266b57fec tempest-DeleteServersTestJSON-1018435513 tempest-DeleteServersTestJSON-1018435513-project-member] <== get_connector_properties: return (201ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6217bd6e884', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75045) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 23:17:33 user nova-compute[75045]: DEBUG nova.virt.block_device [None req-099dcd3c-5421-47c3-b271-c3b266b57fec tempest-DeleteServersTestJSON-1018435513 tempest-DeleteServersTestJSON-1018435513-project-member] [instance: 09cf15e6-1cec-4c55-b7dd-4311b5f87d32] Updating existing volume attachment record: b47295d5-a541-45a0-b994-6dda8ea1bf60 {{(pid=75045) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 23:17:33 user nova-compute[75045]: DEBUG nova.compute.manager [req-7eddb704-b0c0-49d0-afb3-f71e8e2dea6a req-7ad6dbd3-6169-4957-8d40-792dc0afae15 service nova] [instance: 520eac4f-fa48-4e41-924d-840907e701b4] Received event network-changed-bcd0d9eb-775a-4e28-b712-148c1fe99521 {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:17:33 user nova-compute[75045]: DEBUG nova.compute.manager [req-7eddb704-b0c0-49d0-afb3-f71e8e2dea6a req-7ad6dbd3-6169-4957-8d40-792dc0afae15 service nova] [instance: 520eac4f-fa48-4e41-924d-840907e701b4] Refreshing instance network info cache due to event network-changed-bcd0d9eb-775a-4e28-b712-148c1fe99521. {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 23:17:33 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-7eddb704-b0c0-49d0-afb3-f71e8e2dea6a req-7ad6dbd3-6169-4957-8d40-792dc0afae15 service nova] Acquiring lock "refresh_cache-520eac4f-fa48-4e41-924d-840907e701b4" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 23:17:33 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-7eddb704-b0c0-49d0-afb3-f71e8e2dea6a req-7ad6dbd3-6169-4957-8d40-792dc0afae15 service nova] Acquired lock "refresh_cache-520eac4f-fa48-4e41-924d-840907e701b4" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 23:17:33 user nova-compute[75045]: DEBUG nova.network.neutron [req-7eddb704-b0c0-49d0-afb3-f71e8e2dea6a req-7ad6dbd3-6169-4957-8d40-792dc0afae15 service nova] [instance: 520eac4f-fa48-4e41-924d-840907e701b4] Refreshing network info cache for port bcd0d9eb-775a-4e28-b712-148c1fe99521 {{(pid=75045) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 23:17:33 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9bd3096-92eb-4aae-8619-2725ed9acc2b/disk --force-share --output=json" returned: 0 in 0.243s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:17:33 user nova-compute[75045]: DEBUG nova.network.neutron [req-7eddb704-b0c0-49d0-afb3-f71e8e2dea6a req-7ad6dbd3-6169-4957-8d40-792dc0afae15 service nova] [instance: 520eac4f-fa48-4e41-924d-840907e701b4] Instance cache missing network info. {{(pid=75045) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 23:17:34 user nova-compute[75045]: DEBUG nova.network.neutron [None req-ac28c4dc-b349-4d76-b20f-521f64e4c39b tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] [instance: 520eac4f-fa48-4e41-924d-840907e701b4] Successfully updated port: b3c645dd-a1ac-4780-a49d-916cb6a121c9 {{(pid=75045) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 23:17:34 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:17:34 user nova-compute[75045]: WARNING nova.virt.libvirt.driver [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 23:17:34 user nova-compute[75045]: WARNING nova.virt.libvirt.driver [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 23:17:34 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Hypervisor/Node resource view: name=user free_ram=7579MB free_disk=25.448253631591797GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75045) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 23:17:34 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:17:34 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:17:34 user nova-compute[75045]: DEBUG nova.network.neutron [req-7eddb704-b0c0-49d0-afb3-f71e8e2dea6a req-7ad6dbd3-6169-4957-8d40-792dc0afae15 service nova] [instance: 520eac4f-fa48-4e41-924d-840907e701b4] Updating instance_info_cache with network_info: [] {{(pid=75045) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 23:17:34 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-7eddb704-b0c0-49d0-afb3-f71e8e2dea6a req-7ad6dbd3-6169-4957-8d40-792dc0afae15 service nova] Releasing lock "refresh_cache-520eac4f-fa48-4e41-924d-840907e701b4" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 23:17:34 user nova-compute[75045]: DEBUG nova.compute.manager [req-7eddb704-b0c0-49d0-afb3-f71e8e2dea6a req-7ad6dbd3-6169-4957-8d40-792dc0afae15 service nova] [instance: 520eac4f-fa48-4e41-924d-840907e701b4] Received event network-changed-04ae6531-75ef-4043-99f4-bfa5ef2bba59 {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:17:34 user nova-compute[75045]: DEBUG nova.compute.manager [req-7eddb704-b0c0-49d0-afb3-f71e8e2dea6a req-7ad6dbd3-6169-4957-8d40-792dc0afae15 service nova] [instance: 520eac4f-fa48-4e41-924d-840907e701b4] Refreshing instance network info cache due to event network-changed-04ae6531-75ef-4043-99f4-bfa5ef2bba59. {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 23:17:34 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-7eddb704-b0c0-49d0-afb3-f71e8e2dea6a req-7ad6dbd3-6169-4957-8d40-792dc0afae15 service nova] Acquiring lock "refresh_cache-520eac4f-fa48-4e41-924d-840907e701b4" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 23:17:34 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-7eddb704-b0c0-49d0-afb3-f71e8e2dea6a req-7ad6dbd3-6169-4957-8d40-792dc0afae15 service nova] Acquired lock "refresh_cache-520eac4f-fa48-4e41-924d-840907e701b4" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 23:17:34 user nova-compute[75045]: DEBUG nova.network.neutron [req-7eddb704-b0c0-49d0-afb3-f71e8e2dea6a req-7ad6dbd3-6169-4957-8d40-792dc0afae15 service nova] [instance: 520eac4f-fa48-4e41-924d-840907e701b4] Refreshing network info cache for port 04ae6531-75ef-4043-99f4-bfa5ef2bba59 {{(pid=75045) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 23:17:34 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Instance 4ae5ff6b-6f2c-4dfd-a4c6-da4809e2cf27 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75045) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 23:17:34 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Instance 09cf15e6-1cec-4c55-b7dd-4311b5f87d32 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75045) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 23:17:34 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Instance 0f21fcd3-ac5f-499e-9c34-82af806fda1d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75045) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 23:17:34 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Instance b9bd3096-92eb-4aae-8619-2725ed9acc2b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75045) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 23:17:34 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Instance 1cb1b440-0073-4a53-a0a2-e2781e021866 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75045) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 23:17:34 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Instance fde91f7c-31e3-456c-b252-6ce37fa3b600 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75045) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 23:17:34 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Instance 07ec2c05-aaa9-46e8-8439-7aa5b9fca19d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75045) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 23:17:34 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Instance 82bc5fd0-26c7-4f81-b966-54831393b617 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75045) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 23:17:34 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Instance 725866aa-0e2a-4af3-af20-48157e6d2fcb actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75045) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 23:17:34 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Instance 520eac4f-fa48-4e41-924d-840907e701b4 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75045) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 23:17:34 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=75045) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 23:17:34 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=75045) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 23:17:34 user nova-compute[75045]: DEBUG nova.network.neutron [req-7eddb704-b0c0-49d0-afb3-f71e8e2dea6a req-7ad6dbd3-6169-4957-8d40-792dc0afae15 service nova] [instance: 520eac4f-fa48-4e41-924d-840907e701b4] Instance cache missing network info. {{(pid=75045) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 23:17:34 user nova-compute[75045]: DEBUG nova.network.neutron [req-7eddb704-b0c0-49d0-afb3-f71e8e2dea6a req-7ad6dbd3-6169-4957-8d40-792dc0afae15 service nova] [instance: 520eac4f-fa48-4e41-924d-840907e701b4] Updating instance_info_cache with network_info: [] {{(pid=75045) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 23:17:34 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-7eddb704-b0c0-49d0-afb3-f71e8e2dea6a req-7ad6dbd3-6169-4957-8d40-792dc0afae15 service nova] Releasing lock "refresh_cache-520eac4f-fa48-4e41-924d-840907e701b4" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 23:17:34 user nova-compute[75045]: DEBUG nova.compute.provider_tree [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Inventory has not changed in ProviderTree for provider: 62ba5f85-c74d-4b58-986e-d4197e813fd7 {{(pid=75045) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 23:17:34 user nova-compute[75045]: DEBUG nova.scheduler.client.report [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Inventory has not changed for provider 62ba5f85-c74d-4b58-986e-d4197e813fd7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75045) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 23:17:34 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Compute_service record updated for user:user {{(pid=75045) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 23:17:34 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.632s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:17:34 user nova-compute[75045]: DEBUG nova.compute.manager [req-9b06a890-8d3f-4867-af28-93cfc2296d27 req-040dec94-b6d1-498d-bf0e-389286d0d8e5 service nova] [instance: 0f21fcd3-ac5f-499e-9c34-82af806fda1d] Received event network-changed-ab02704d-73c2-409c-9d43-1a087ebf369a {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:17:34 user nova-compute[75045]: DEBUG nova.compute.manager [req-9b06a890-8d3f-4867-af28-93cfc2296d27 req-040dec94-b6d1-498d-bf0e-389286d0d8e5 service nova] [instance: 0f21fcd3-ac5f-499e-9c34-82af806fda1d] Refreshing instance network info cache due to event network-changed-ab02704d-73c2-409c-9d43-1a087ebf369a. {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 23:17:34 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-9b06a890-8d3f-4867-af28-93cfc2296d27 req-040dec94-b6d1-498d-bf0e-389286d0d8e5 service nova] Acquiring lock "refresh_cache-0f21fcd3-ac5f-499e-9c34-82af806fda1d" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 23:17:34 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-9b06a890-8d3f-4867-af28-93cfc2296d27 req-040dec94-b6d1-498d-bf0e-389286d0d8e5 service nova] Acquired lock "refresh_cache-0f21fcd3-ac5f-499e-9c34-82af806fda1d" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 23:17:34 user nova-compute[75045]: DEBUG nova.network.neutron [req-9b06a890-8d3f-4867-af28-93cfc2296d27 req-040dec94-b6d1-498d-bf0e-389286d0d8e5 service nova] [instance: 0f21fcd3-ac5f-499e-9c34-82af806fda1d] Refreshing network info cache for port ab02704d-73c2-409c-9d43-1a087ebf369a {{(pid=75045) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 23:17:35 user nova-compute[75045]: DEBUG nova.network.neutron [None req-ac28c4dc-b349-4d76-b20f-521f64e4c39b tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] [instance: 520eac4f-fa48-4e41-924d-840907e701b4] Successfully updated port: 3974ed79-74a5-4e9c-aa42-3aab1b234a39 {{(pid=75045) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 23:17:35 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:17:35 user nova-compute[75045]: DEBUG nova.compute.manager [req-b8906deb-d248-43bd-98c4-e52411f4294f req-062bb1fb-baab-4326-adda-b798ede8663f service nova] [instance: 520eac4f-fa48-4e41-924d-840907e701b4] Received event network-changed-b3c645dd-a1ac-4780-a49d-916cb6a121c9 {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:17:35 user nova-compute[75045]: DEBUG nova.compute.manager [req-b8906deb-d248-43bd-98c4-e52411f4294f req-062bb1fb-baab-4326-adda-b798ede8663f service nova] [instance: 520eac4f-fa48-4e41-924d-840907e701b4] Refreshing instance network info cache due to event network-changed-b3c645dd-a1ac-4780-a49d-916cb6a121c9. {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 23:17:35 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-b8906deb-d248-43bd-98c4-e52411f4294f req-062bb1fb-baab-4326-adda-b798ede8663f service nova] Acquiring lock "refresh_cache-520eac4f-fa48-4e41-924d-840907e701b4" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 23:17:35 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-b8906deb-d248-43bd-98c4-e52411f4294f req-062bb1fb-baab-4326-adda-b798ede8663f service nova] Acquired lock "refresh_cache-520eac4f-fa48-4e41-924d-840907e701b4" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 23:17:35 user nova-compute[75045]: DEBUG nova.network.neutron [req-b8906deb-d248-43bd-98c4-e52411f4294f req-062bb1fb-baab-4326-adda-b798ede8663f service nova] [instance: 520eac4f-fa48-4e41-924d-840907e701b4] Refreshing network info cache for port b3c645dd-a1ac-4780-a49d-916cb6a121c9 {{(pid=75045) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 23:17:35 user nova-compute[75045]: DEBUG nova.network.neutron [req-9b06a890-8d3f-4867-af28-93cfc2296d27 req-040dec94-b6d1-498d-bf0e-389286d0d8e5 service nova] [instance: 0f21fcd3-ac5f-499e-9c34-82af806fda1d] Updated VIF entry in instance network info cache for port ab02704d-73c2-409c-9d43-1a087ebf369a. {{(pid=75045) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 23:17:35 user nova-compute[75045]: DEBUG nova.network.neutron [req-9b06a890-8d3f-4867-af28-93cfc2296d27 req-040dec94-b6d1-498d-bf0e-389286d0d8e5 service nova] [instance: 0f21fcd3-ac5f-499e-9c34-82af806fda1d] Updating instance_info_cache with network_info: [{"id": "ab02704d-73c2-409c-9d43-1a087ebf369a", "address": "fa:16:3e:b3:b2:47", "network": {"id": "700b5784-d35b-45c0-a4d3-1ab8aa4c48aa", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-194469807-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.175", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e63623113f11463d9035bb990de43510", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab02704d-73", "ovs_interfaceid": "ab02704d-73c2-409c-9d43-1a087ebf369a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75045) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 23:17:35 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-9b06a890-8d3f-4867-af28-93cfc2296d27 req-040dec94-b6d1-498d-bf0e-389286d0d8e5 service nova] Releasing lock "refresh_cache-0f21fcd3-ac5f-499e-9c34-82af806fda1d" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 23:17:35 user nova-compute[75045]: DEBUG nova.network.neutron [req-b8906deb-d248-43bd-98c4-e52411f4294f req-062bb1fb-baab-4326-adda-b798ede8663f service nova] [instance: 520eac4f-fa48-4e41-924d-840907e701b4] Instance cache missing network info. {{(pid=75045) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 23:17:35 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:17:35 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:17:35 user nova-compute[75045]: DEBUG nova.compute.manager [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Starting heal instance info cache {{(pid=75045) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 23:17:35 user nova-compute[75045]: DEBUG nova.network.neutron [req-b8906deb-d248-43bd-98c4-e52411f4294f req-062bb1fb-baab-4326-adda-b798ede8663f service nova] [instance: 520eac4f-fa48-4e41-924d-840907e701b4] Updating instance_info_cache with network_info: [] {{(pid=75045) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 23:17:35 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-b8906deb-d248-43bd-98c4-e52411f4294f req-062bb1fb-baab-4326-adda-b798ede8663f service nova] Releasing lock "refresh_cache-520eac4f-fa48-4e41-924d-840907e701b4" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 23:17:35 user nova-compute[75045]: DEBUG nova.compute.manager [req-b8906deb-d248-43bd-98c4-e52411f4294f req-062bb1fb-baab-4326-adda-b798ede8663f service nova] [instance: 520eac4f-fa48-4e41-924d-840907e701b4] Received event network-changed-3974ed79-74a5-4e9c-aa42-3aab1b234a39 {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:17:35 user nova-compute[75045]: DEBUG nova.compute.manager [req-b8906deb-d248-43bd-98c4-e52411f4294f req-062bb1fb-baab-4326-adda-b798ede8663f service nova] [instance: 520eac4f-fa48-4e41-924d-840907e701b4] Refreshing instance network info cache due to event network-changed-3974ed79-74a5-4e9c-aa42-3aab1b234a39. {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 23:17:35 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-b8906deb-d248-43bd-98c4-e52411f4294f req-062bb1fb-baab-4326-adda-b798ede8663f service nova] Acquiring lock "refresh_cache-520eac4f-fa48-4e41-924d-840907e701b4" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 23:17:35 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-b8906deb-d248-43bd-98c4-e52411f4294f req-062bb1fb-baab-4326-adda-b798ede8663f service nova] Acquired lock "refresh_cache-520eac4f-fa48-4e41-924d-840907e701b4" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 23:17:35 user nova-compute[75045]: DEBUG nova.network.neutron [req-b8906deb-d248-43bd-98c4-e52411f4294f req-062bb1fb-baab-4326-adda-b798ede8663f service nova] [instance: 520eac4f-fa48-4e41-924d-840907e701b4] Refreshing network info cache for port 3974ed79-74a5-4e9c-aa42-3aab1b234a39 {{(pid=75045) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 23:17:35 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Acquiring lock "refresh_cache-09cf15e6-1cec-4c55-b7dd-4311b5f87d32" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 23:17:35 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Acquired lock "refresh_cache-09cf15e6-1cec-4c55-b7dd-4311b5f87d32" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 23:17:35 user nova-compute[75045]: DEBUG nova.network.neutron [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] [instance: 09cf15e6-1cec-4c55-b7dd-4311b5f87d32] Forcefully refreshing network info cache for instance {{(pid=75045) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 23:17:35 user nova-compute[75045]: DEBUG nova.network.neutron [None req-ac28c4dc-b349-4d76-b20f-521f64e4c39b tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] [instance: 520eac4f-fa48-4e41-924d-840907e701b4] Successfully updated port: c2155ca8-d244-401d-a80f-8c53a68b6799 {{(pid=75045) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 23:17:36 user nova-compute[75045]: DEBUG nova.network.neutron [req-b8906deb-d248-43bd-98c4-e52411f4294f req-062bb1fb-baab-4326-adda-b798ede8663f service nova] [instance: 520eac4f-fa48-4e41-924d-840907e701b4] Instance cache missing network info. {{(pid=75045) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 23:17:36 user nova-compute[75045]: DEBUG nova.network.neutron [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] [instance: 09cf15e6-1cec-4c55-b7dd-4311b5f87d32] Updating instance_info_cache with network_info: [{"id": "a270cac5-2b8d-4eb7-a5ed-9338e6bb5e22", "address": "fa:16:3e:3e:0e:1d", "network": {"id": "8137fd46-49da-40ca-81e8-4ad6984ee6ae", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-668291672-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec0b8a91a6ba43e6836d226ba9528100", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa270cac5-2b", "ovs_interfaceid": "a270cac5-2b8d-4eb7-a5ed-9338e6bb5e22", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75045) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 23:17:36 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Releasing lock "refresh_cache-09cf15e6-1cec-4c55-b7dd-4311b5f87d32" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 23:17:36 user nova-compute[75045]: DEBUG nova.compute.manager [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] [instance: 09cf15e6-1cec-4c55-b7dd-4311b5f87d32] Updated the network info_cache for instance {{(pid=75045) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 23:17:36 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:17:36 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:17:36 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:17:36 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:17:36 user nova-compute[75045]: DEBUG nova.compute.manager [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75045) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 23:17:36 user nova-compute[75045]: DEBUG nova.network.neutron [req-b8906deb-d248-43bd-98c4-e52411f4294f req-062bb1fb-baab-4326-adda-b798ede8663f service nova] [instance: 520eac4f-fa48-4e41-924d-840907e701b4] Updating instance_info_cache with network_info: [] {{(pid=75045) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 23:17:36 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-b8906deb-d248-43bd-98c4-e52411f4294f req-062bb1fb-baab-4326-adda-b798ede8663f service nova] Releasing lock "refresh_cache-520eac4f-fa48-4e41-924d-840907e701b4" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 23:17:36 user nova-compute[75045]: DEBUG nova.network.neutron [None req-ac28c4dc-b349-4d76-b20f-521f64e4c39b tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] [instance: 520eac4f-fa48-4e41-924d-840907e701b4] Successfully updated port: 768830de-7c2e-45ca-959e-398480b6ba29 {{(pid=75045) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 23:17:36 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-ac28c4dc-b349-4d76-b20f-521f64e4c39b tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] Acquiring lock "refresh_cache-520eac4f-fa48-4e41-924d-840907e701b4" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 23:17:36 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-ac28c4dc-b349-4d76-b20f-521f64e4c39b tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] Acquired lock "refresh_cache-520eac4f-fa48-4e41-924d-840907e701b4" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 23:17:36 user nova-compute[75045]: DEBUG nova.network.neutron [None req-ac28c4dc-b349-4d76-b20f-521f64e4c39b tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] [instance: 520eac4f-fa48-4e41-924d-840907e701b4] Building network info cache for instance {{(pid=75045) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 23:17:36 user nova-compute[75045]: DEBUG nova.compute.manager [req-df57b28d-6717-4505-a102-ed19a5958fb9 req-1e226b32-c9cd-4f29-893f-b0308d3c60e3 service nova] [instance: 520eac4f-fa48-4e41-924d-840907e701b4] Received event network-changed-768830de-7c2e-45ca-959e-398480b6ba29 {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:17:36 user nova-compute[75045]: DEBUG nova.compute.manager [req-df57b28d-6717-4505-a102-ed19a5958fb9 req-1e226b32-c9cd-4f29-893f-b0308d3c60e3 service nova] [instance: 520eac4f-fa48-4e41-924d-840907e701b4] Refreshing instance network info cache due to event network-changed-768830de-7c2e-45ca-959e-398480b6ba29. {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 23:17:36 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-df57b28d-6717-4505-a102-ed19a5958fb9 req-1e226b32-c9cd-4f29-893f-b0308d3c60e3 service nova] Acquiring lock "refresh_cache-520eac4f-fa48-4e41-924d-840907e701b4" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 23:17:36 user nova-compute[75045]: DEBUG nova.network.neutron [None req-ac28c4dc-b349-4d76-b20f-521f64e4c39b tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] [instance: 520eac4f-fa48-4e41-924d-840907e701b4] Instance cache missing network info. {{(pid=75045) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 23:17:37 user nova-compute[75045]: DEBUG nova.compute.manager [req-9ff6d98e-8a8d-4992-b995-0472e24bda20 req-f3e18647-83f9-4ff5-9536-f85cb3224822 service nova] [instance: 520eac4f-fa48-4e41-924d-840907e701b4] Received event network-changed-c2155ca8-d244-401d-a80f-8c53a68b6799 {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:17:37 user nova-compute[75045]: DEBUG nova.compute.manager [req-9ff6d98e-8a8d-4992-b995-0472e24bda20 req-f3e18647-83f9-4ff5-9536-f85cb3224822 service nova] [instance: 520eac4f-fa48-4e41-924d-840907e701b4] Refreshing instance network info cache due to event network-changed-c2155ca8-d244-401d-a80f-8c53a68b6799. {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 23:17:37 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-9ff6d98e-8a8d-4992-b995-0472e24bda20 req-f3e18647-83f9-4ff5-9536-f85cb3224822 service nova] Acquiring lock "refresh_cache-520eac4f-fa48-4e41-924d-840907e701b4" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 23:17:38 user nova-compute[75045]: DEBUG nova.network.neutron [None req-ac28c4dc-b349-4d76-b20f-521f64e4c39b tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] [instance: 520eac4f-fa48-4e41-924d-840907e701b4] Updating instance_info_cache with network_info: [{"id": "25776e3e-60d6-457c-a78a-a59df0e3e7b5", "address": "fa:16:3e:3e:7f:60", "network": {"id": "13af9e02-7f74-4e9c-aea7-2e6f0701b1c2", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1067175210-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74ebbe44152141368b22a9a7989d577a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25776e3e-60", "ovs_interfaceid": "25776e3e-60d6-457c-a78a-a59df0e3e7b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "bcd0d9eb-775a-4e28-b712-148c1fe99521", "address": "fa:16:3e:21:f4:bc", "network": {"id": "0916556c-7a50-48cf-8ad0-56c20de9d89f", "bridge": "br-int", "label": "tempest-device-tagging-net1-573961537", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.137", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "74ebbe44152141368b22a9a7989d577a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbcd0d9eb-77", "ovs_interfaceid": "bcd0d9eb-775a-4e28-b712-148c1fe99521", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "04ae6531-75ef-4043-99f4-bfa5ef2bba59", "address": "fa:16:3e:9f:87:19", "network": {"id": "0916556c-7a50-48cf-8ad0-56c20de9d89f", "bridge": "br-int", "label": "tempest-device-tagging-net1-573961537", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.210", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "74ebbe44152141368b22a9a7989d577a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04ae6531-75", "ovs_interfaceid": "04ae6531-75ef-4043-99f4-bfa5ef2bba59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "b3c645dd-a1ac-4780-a49d-916cb6a121c9", "address": "fa:16:3e:e2:e6:e2", "network": {"id": "0916556c-7a50-48cf-8ad0-56c20de9d89f", "bridge": "br-int", "label": "tempest-device-tagging-net1-573961537", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.154", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "74ebbe44152141368b22a9a7989d577a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3c645dd-a1", "ovs_interfaceid": "b3c645dd-a1ac-4780-a49d-916cb6a121c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3974ed79-74a5-4e9c-aa42-3aab1b234a39", "address": "fa:16:3e:f3:1c:29", "network": {"id": "0916556c-7a50-48cf-8ad0-56c20de9d89f", "bridge": "br-int", "label": "tempest-device-tagging-net1-573961537", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.231", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "74ebbe44152141368b22a9a7989d577a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3974ed79-74", "ovs_interfaceid": "3974ed79-74a5-4e9c-aa42-3aab1b234a39", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c2155ca8-d244-401d-a80f-8c53a68b6799", "address": "fa:16:3e:a2:80:a4", "network": {"id": "5cfed969-3f78-4bc2-8d08-921447c01347", "bridge": "br-int", "label": "tempest-device-tagging-net2-1614620309", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "74ebbe44152141368b22a9a7989d577a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2155ca8-d2", "ovs_interfaceid": "c2155ca8-d244-401d-a80f-8c53a68b6799", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "768830de-7c2e-45ca-959e-398480b6ba29", "address": "fa:16:3e:bc:05:cc", "network": {"id": "5cfed969-3f78-4bc2-8d08-921447c01347", "bridge": "br-int", "label": "tempest-device-tagging-net2-1614620309", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "74ebbe44152141368b22a9a7989d577a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap768830de-7c", "ovs_interfaceid": "768830de-7c2e-45ca-959e-398480b6ba29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75045) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 23:17:38 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-ac28c4dc-b349-4d76-b20f-521f64e4c39b tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] Releasing lock "refresh_cache-520eac4f-fa48-4e41-924d-840907e701b4" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 23:17:38 user nova-compute[75045]: DEBUG nova.compute.manager [None req-ac28c4dc-b349-4d76-b20f-521f64e4c39b tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] [instance: 520eac4f-fa48-4e41-924d-840907e701b4] Instance network_info: |[{"id": "25776e3e-60d6-457c-a78a-a59df0e3e7b5", "address": "fa:16:3e:3e:7f:60", "network": {"id": "13af9e02-7f74-4e9c-aea7-2e6f0701b1c2", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1067175210-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74ebbe44152141368b22a9a7989d577a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25776e3e-60", "ovs_interfaceid": "25776e3e-60d6-457c-a78a-a59df0e3e7b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "bcd0d9eb-775a-4e28-b712-148c1fe99521", "address": "fa:16:3e:21:f4:bc", "network": {"id": "0916556c-7a50-48cf-8ad0-56c20de9d89f", "bridge": "br-int", "label": "tempest-device-tagging-net1-573961537", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.137", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "74ebbe44152141368b22a9a7989d577a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbcd0d9eb-77", "ovs_interfaceid": "bcd0d9eb-775a-4e28-b712-148c1fe99521", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "04ae6531-75ef-4043-99f4-bfa5ef2bba59", "address": "fa:16:3e:9f:87:19", "network": {"id": "0916556c-7a50-48cf-8ad0-56c20de9d89f", "bridge": "br-int", "label": "tempest-device-tagging-net1-573961537", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.210", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "74ebbe44152141368b22a9a7989d577a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04ae6531-75", "ovs_interfaceid": "04ae6531-75ef-4043-99f4-bfa5ef2bba59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "b3c645dd-a1ac-4780-a49d-916cb6a121c9", "address": "fa:16:3e:e2:e6:e2", "network": {"id": "0916556c-7a50-48cf-8ad0-56c20de9d89f", "bridge": "br-int", "label": "tempest-device-tagging-net1-573961537", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.154", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "74ebbe44152141368b22a9a7989d577a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3c645dd-a1", "ovs_interfaceid": "b3c645dd-a1ac-4780-a49d-916cb6a121c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3974ed79-74a5-4e9c-aa42-3aab1b234a39", "address": "fa:16:3e:f3:1c:29", "network": {"id": "0916556c-7a50-48cf-8ad0-56c20de9d89f", "bridge": "br-int", "label": "tempest-device-tagging-net1-573961537", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.231", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "74ebbe44152141368b22a9a7989d577a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3974ed79-74", "ovs_interfaceid": "3974ed79-74a5-4e9c-aa42-3aab1b234a39", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c2155ca8-d244-401d-a80f-8c53a68b6799", "address": "fa:16:3e:a2:80:a4", "network": {"id": "5cfed969-3f78-4bc2-8d08-921447c01347", "bridge": "br-int", "label": "tempest-device-tagging-net2-1614620309", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "74ebbe44152141368b22a9a7989d577a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2155ca8-d2", "ovs_interfaceid": "c2155ca8-d244-401d-a80f-8c53a68b6799", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "768830de-7c2e-45ca-959e-398480b6ba29", "address": "fa:16:3e:bc:05:cc", "network": {"id": "5cfed969-3f78-4bc2-8d08-921447c01347", "bridge": "br-int", "label": "tempest-device-tagging-net2-1614620309", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "74ebbe44152141368b22a9a7989d577a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap768830de-7c", "ovs_interfaceid": "768830de-7c2e-45ca-959e-398480b6ba29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75045) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 23:17:38 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-df57b28d-6717-4505-a102-ed19a5958fb9 req-1e226b32-c9cd-4f29-893f-b0308d3c60e3 service nova] Acquired lock "refresh_cache-520eac4f-fa48-4e41-924d-840907e701b4" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 23:17:38 user nova-compute[75045]: DEBUG nova.network.neutron [req-df57b28d-6717-4505-a102-ed19a5958fb9 req-1e226b32-c9cd-4f29-893f-b0308d3c60e3 service nova] [instance: 520eac4f-fa48-4e41-924d-840907e701b4] Refreshing network info cache for port 768830de-7c2e-45ca-959e-398480b6ba29 {{(pid=75045) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 23:17:39 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:17:39 user nova-compute[75045]: DEBUG nova.network.neutron [req-df57b28d-6717-4505-a102-ed19a5958fb9 req-1e226b32-c9cd-4f29-893f-b0308d3c60e3 service nova] [instance: 520eac4f-fa48-4e41-924d-840907e701b4] Updated VIF entry in instance network info cache for port 768830de-7c2e-45ca-959e-398480b6ba29. {{(pid=75045) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 23:17:39 user nova-compute[75045]: DEBUG nova.network.neutron [req-df57b28d-6717-4505-a102-ed19a5958fb9 req-1e226b32-c9cd-4f29-893f-b0308d3c60e3 service nova] [instance: 520eac4f-fa48-4e41-924d-840907e701b4] Updating instance_info_cache with network_info: [{"id": "25776e3e-60d6-457c-a78a-a59df0e3e7b5", "address": "fa:16:3e:3e:7f:60", "network": {"id": "13af9e02-7f74-4e9c-aea7-2e6f0701b1c2", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1067175210-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74ebbe44152141368b22a9a7989d577a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25776e3e-60", "ovs_interfaceid": "25776e3e-60d6-457c-a78a-a59df0e3e7b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "bcd0d9eb-775a-4e28-b712-148c1fe99521", "address": "fa:16:3e:21:f4:bc", "network": {"id": "0916556c-7a50-48cf-8ad0-56c20de9d89f", "bridge": "br-int", "label": "tempest-device-tagging-net1-573961537", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.137", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "74ebbe44152141368b22a9a7989d577a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbcd0d9eb-77", "ovs_interfaceid": "bcd0d9eb-775a-4e28-b712-148c1fe99521", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "04ae6531-75ef-4043-99f4-bfa5ef2bba59", "address": "fa:16:3e:9f:87:19", "network": {"id": "0916556c-7a50-48cf-8ad0-56c20de9d89f", "bridge": "br-int", "label": "tempest-device-tagging-net1-573961537", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.210", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "74ebbe44152141368b22a9a7989d577a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04ae6531-75", "ovs_interfaceid": "04ae6531-75ef-4043-99f4-bfa5ef2bba59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "b3c645dd-a1ac-4780-a49d-916cb6a121c9", "address": "fa:16:3e:e2:e6:e2", "network": {"id": "0916556c-7a50-48cf-8ad0-56c20de9d89f", "bridge": "br-int", "label": "tempest-device-tagging-net1-573961537", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.154", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "74ebbe44152141368b22a9a7989d577a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3c645dd-a1", "ovs_interfaceid": "b3c645dd-a1ac-4780-a49d-916cb6a121c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3974ed79-74a5-4e9c-aa42-3aab1b234a39", "address": "fa:16:3e:f3:1c:29", "network": {"id": "0916556c-7a50-48cf-8ad0-56c20de9d89f", "bridge": "br-int", "label": "tempest-device-tagging-net1-573961537", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.231", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "74ebbe44152141368b22a9a7989d577a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3974ed79-74", "ovs_interfaceid": "3974ed79-74a5-4e9c-aa42-3aab1b234a39", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c2155ca8-d244-401d-a80f-8c53a68b6799", "address": "fa:16:3e:a2:80:a4", "network": {"id": "5cfed969-3f78-4bc2-8d08-921447c01347", "bridge": "br-int", "label": "tempest-device-tagging-net2-1614620309", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "74ebbe44152141368b22a9a7989d577a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2155ca8-d2", "ovs_interfaceid": "c2155ca8-d244-401d-a80f-8c53a68b6799", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "768830de-7c2e-45ca-959e-398480b6ba29", "address": "fa:16:3e:bc:05:cc", "network": {"id": "5cfed969-3f78-4bc2-8d08-921447c01347", "bridge": "br-int", "label": "tempest-device-tagging-net2-1614620309", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "74ebbe44152141368b22a9a7989d577a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap768830de-7c", "ovs_interfaceid": "768830de-7c2e-45ca-959e-398480b6ba29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75045) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 23:17:39 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-df57b28d-6717-4505-a102-ed19a5958fb9 req-1e226b32-c9cd-4f29-893f-b0308d3c60e3 service nova] Releasing lock "refresh_cache-520eac4f-fa48-4e41-924d-840907e701b4" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 23:17:39 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-9ff6d98e-8a8d-4992-b995-0472e24bda20 req-f3e18647-83f9-4ff5-9536-f85cb3224822 service nova] Acquired lock "refresh_cache-520eac4f-fa48-4e41-924d-840907e701b4" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 23:17:39 user nova-compute[75045]: DEBUG nova.network.neutron [req-9ff6d98e-8a8d-4992-b995-0472e24bda20 req-f3e18647-83f9-4ff5-9536-f85cb3224822 service nova] [instance: 520eac4f-fa48-4e41-924d-840907e701b4] Refreshing network info cache for port c2155ca8-d244-401d-a80f-8c53a68b6799 {{(pid=75045) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 23:17:39 user nova-compute[75045]: DEBUG nova.network.neutron [req-9ff6d98e-8a8d-4992-b995-0472e24bda20 req-f3e18647-83f9-4ff5-9536-f85cb3224822 service nova] [instance: 520eac4f-fa48-4e41-924d-840907e701b4] Updated VIF entry in instance network info cache for port c2155ca8-d244-401d-a80f-8c53a68b6799. {{(pid=75045) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 23:17:39 user nova-compute[75045]: DEBUG nova.network.neutron [req-9ff6d98e-8a8d-4992-b995-0472e24bda20 req-f3e18647-83f9-4ff5-9536-f85cb3224822 service nova] [instance: 520eac4f-fa48-4e41-924d-840907e701b4] Updating instance_info_cache with network_info: [{"id": "25776e3e-60d6-457c-a78a-a59df0e3e7b5", "address": "fa:16:3e:3e:7f:60", "network": {"id": "13af9e02-7f74-4e9c-aea7-2e6f0701b1c2", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1067175210-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74ebbe44152141368b22a9a7989d577a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25776e3e-60", "ovs_interfaceid": "25776e3e-60d6-457c-a78a-a59df0e3e7b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "bcd0d9eb-775a-4e28-b712-148c1fe99521", "address": "fa:16:3e:21:f4:bc", "network": {"id": "0916556c-7a50-48cf-8ad0-56c20de9d89f", "bridge": "br-int", "label": "tempest-device-tagging-net1-573961537", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.137", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "74ebbe44152141368b22a9a7989d577a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbcd0d9eb-77", "ovs_interfaceid": "bcd0d9eb-775a-4e28-b712-148c1fe99521", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "04ae6531-75ef-4043-99f4-bfa5ef2bba59", "address": "fa:16:3e:9f:87:19", "network": {"id": "0916556c-7a50-48cf-8ad0-56c20de9d89f", "bridge": "br-int", "label": "tempest-device-tagging-net1-573961537", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.210", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "74ebbe44152141368b22a9a7989d577a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04ae6531-75", "ovs_interfaceid": "04ae6531-75ef-4043-99f4-bfa5ef2bba59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "b3c645dd-a1ac-4780-a49d-916cb6a121c9", "address": "fa:16:3e:e2:e6:e2", "network": {"id": "0916556c-7a50-48cf-8ad0-56c20de9d89f", "bridge": "br-int", "label": "tempest-device-tagging-net1-573961537", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.154", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "74ebbe44152141368b22a9a7989d577a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3c645dd-a1", "ovs_interfaceid": "b3c645dd-a1ac-4780-a49d-916cb6a121c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3974ed79-74a5-4e9c-aa42-3aab1b234a39", "address": "fa:16:3e:f3:1c:29", "network": {"id": "0916556c-7a50-48cf-8ad0-56c20de9d89f", "bridge": "br-int", "label": "tempest-device-tagging-net1-573961537", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.231", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "74ebbe44152141368b22a9a7989d577a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3974ed79-74", "ovs_interfaceid": "3974ed79-74a5-4e9c-aa42-3aab1b234a39", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c2155ca8-d244-401d-a80f-8c53a68b6799", "address": "fa:16:3e:a2:80:a4", "network": {"id": "5cfed969-3f78-4bc2-8d08-921447c01347", "bridge": "br-int", "label": "tempest-device-tagging-net2-1614620309", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "74ebbe44152141368b22a9a7989d577a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2155ca8-d2", "ovs_interfaceid": "c2155ca8-d244-401d-a80f-8c53a68b6799", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "768830de-7c2e-45ca-959e-398480b6ba29", "address": "fa:16:3e:bc:05:cc", "network": {"id": "5cfed969-3f78-4bc2-8d08-921447c01347", "bridge": "br-int", "label": "tempest-device-tagging-net2-1614620309", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "74ebbe44152141368b22a9a7989d577a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap768830de-7c", "ovs_interfaceid": "768830de-7c2e-45ca-959e-398480b6ba29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75045) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 23:17:39 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-9ff6d98e-8a8d-4992-b995-0472e24bda20 req-f3e18647-83f9-4ff5-9536-f85cb3224822 service nova] Releasing lock "refresh_cache-520eac4f-fa48-4e41-924d-840907e701b4" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 23:17:40 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:17:44 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:17:45 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:17:49 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:17:50 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:17:51 user nova-compute[75045]: DEBUG nova.compute.manager [None req-f3f2356a-2491-4528-8f30-cbe1a8b03108 tempest-TestShelveInstance-1634360024 tempest-TestShelveInstance-1634360024-project-member] [instance: 725866aa-0e2a-4af3-af20-48157e6d2fcb] Start spawning the instance on the hypervisor. {{(pid=75045) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 23:17:51 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-f3f2356a-2491-4528-8f30-cbe1a8b03108 tempest-TestShelveInstance-1634360024 tempest-TestShelveInstance-1634360024-project-member] [instance: 725866aa-0e2a-4af3-af20-48157e6d2fcb] Creating instance directory {{(pid=75045) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 23:17:51 user nova-compute[75045]: INFO nova.virt.libvirt.driver [None req-f3f2356a-2491-4528-8f30-cbe1a8b03108 tempest-TestShelveInstance-1634360024 tempest-TestShelveInstance-1634360024-project-member] [instance: 725866aa-0e2a-4af3-af20-48157e6d2fcb] Creating image(s)
Nov 08 23:17:51 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-f3f2356a-2491-4528-8f30-cbe1a8b03108 tempest-TestShelveInstance-1634360024 tempest-TestShelveInstance-1634360024-project-member] [instance: 725866aa-0e2a-4af3-af20-48157e6d2fcb] Did not create local disks {{(pid=75045) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 08 23:17:51 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-f3f2356a-2491-4528-8f30-cbe1a8b03108 tempest-TestShelveInstance-1634360024 tempest-TestShelveInstance-1634360024-project-member] [instance: 725866aa-0e2a-4af3-af20-48157e6d2fcb] Ensure instance console log exists: /opt/stack/data/nova/instances/725866aa-0e2a-4af3-af20-48157e6d2fcb/console.log {{(pid=75045) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 23:17:51 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-f3f2356a-2491-4528-8f30-cbe1a8b03108 tempest-TestShelveInstance-1634360024 tempest-TestShelveInstance-1634360024-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:17:51 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-f3f2356a-2491-4528-8f30-cbe1a8b03108 tempest-TestShelveInstance-1634360024 tempest-TestShelveInstance-1634360024-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:17:51 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-f3f2356a-2491-4528-8f30-cbe1a8b03108 tempest-TestShelveInstance-1634360024 tempest-TestShelveInstance-1634360024-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:17:51 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-f3f2356a-2491-4528-8f30-cbe1a8b03108 tempest-TestShelveInstance-1634360024 tempest-TestShelveInstance-1634360024-project-member] [instance: 725866aa-0e2a-4af3-af20-48157e6d2fcb] Start _get_guest_xml network_info=[{"id": "9a617e54-a69a-4204-b94e-dbe71b1432d2", "address": "fa:16:3e:64:ef:b6", "network": {"id": "25b429b3-693b-4e72-9035-71c276706294", "bridge": "br-int", "label": "tempest-TestShelveInstance-437524717-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec089e7050c542c9860d9fc5f3ae9392", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a617e54-a6", "ovs_interfaceid": "9a617e54-a69a-4204-b94e-dbe71b1432d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': True, 'device_type': 'disk', 'attachment_id': '2768e0ab-35d7-4356-b620-bc634898d0a6', 'guest_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:d2068946-d374-45a4-9850-e3a690b13ef4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eQScvmpf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '725866aa-0e2a-4af3-af20-48157e6d2fcb', 'attached_at': '', 'detached_at': '', 'volume_id': 'd2068946-d374-45a4-9850-e3a690b13ef4', 'serial': 'd2068946-d374-45a4-9850-e3a690b13ef4'}, 'volume_type': None} {{(pid=75045) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 23:17:51 user nova-compute[75045]: WARNING nova.virt.libvirt.driver [None req-f3f2356a-2491-4528-8f30-cbe1a8b03108 tempest-TestShelveInstance-1634360024 tempest-TestShelveInstance-1634360024-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 23:17:51 user nova-compute[75045]: WARNING nova.virt.libvirt.driver [None req-f3f2356a-2491-4528-8f30-cbe1a8b03108 tempest-TestShelveInstance-1634360024 tempest-TestShelveInstance-1634360024-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 23:17:51 user nova-compute[75045]: DEBUG nova.virt.libvirt.host [None req-f3f2356a-2491-4528-8f30-cbe1a8b03108 tempest-TestShelveInstance-1634360024 tempest-TestShelveInstance-1634360024-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75045) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 23:17:51 user nova-compute[75045]: DEBUG nova.virt.libvirt.host [None req-f3f2356a-2491-4528-8f30-cbe1a8b03108 tempest-TestShelveInstance-1634360024 tempest-TestShelveInstance-1634360024-project-member] CPU controller missing on host. {{(pid=75045) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 23:17:51 user nova-compute[75045]: DEBUG nova.virt.libvirt.host [None req-f3f2356a-2491-4528-8f30-cbe1a8b03108 tempest-TestShelveInstance-1634360024 tempest-TestShelveInstance-1634360024-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75045) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 23:17:51 user nova-compute[75045]: DEBUG nova.virt.libvirt.host [None req-f3f2356a-2491-4528-8f30-cbe1a8b03108 tempest-TestShelveInstance-1634360024 tempest-TestShelveInstance-1634360024-project-member] CPU controller found on host. {{(pid=75045) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 23:17:51 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-f3f2356a-2491-4528-8f30-cbe1a8b03108 tempest-TestShelveInstance-1634360024 tempest-TestShelveInstance-1634360024-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75045) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 23:17:51 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-f3f2356a-2491-4528-8f30-cbe1a8b03108 tempest-TestShelveInstance-1634360024 tempest-TestShelveInstance-1634360024-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T23:11:41Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75045) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 23:17:51 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-f3f2356a-2491-4528-8f30-cbe1a8b03108 tempest-TestShelveInstance-1634360024 tempest-TestShelveInstance-1634360024-project-member] Flavor limits 0:0:0 {{(pid=75045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 23:17:51 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-f3f2356a-2491-4528-8f30-cbe1a8b03108 tempest-TestShelveInstance-1634360024 tempest-TestShelveInstance-1634360024-project-member] Image limits 0:0:0 {{(pid=75045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 23:17:51 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-f3f2356a-2491-4528-8f30-cbe1a8b03108 tempest-TestShelveInstance-1634360024 tempest-TestShelveInstance-1634360024-project-member] Flavor pref 0:0:0 {{(pid=75045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 23:17:51 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-f3f2356a-2491-4528-8f30-cbe1a8b03108 tempest-TestShelveInstance-1634360024 tempest-TestShelveInstance-1634360024-project-member] Image pref 0:0:0 {{(pid=75045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 23:17:51 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-f3f2356a-2491-4528-8f30-cbe1a8b03108 tempest-TestShelveInstance-1634360024 tempest-TestShelveInstance-1634360024-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 23:17:51 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-f3f2356a-2491-4528-8f30-cbe1a8b03108 tempest-TestShelveInstance-1634360024 tempest-TestShelveInstance-1634360024-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75045) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 23:17:51 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-f3f2356a-2491-4528-8f30-cbe1a8b03108 tempest-TestShelveInstance-1634360024 tempest-TestShelveInstance-1634360024-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75045) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 23:17:51 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-f3f2356a-2491-4528-8f30-cbe1a8b03108 tempest-TestShelveInstance-1634360024 tempest-TestShelveInstance-1634360024-project-member] Got 1 possible topologies {{(pid=75045) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 23:17:51 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-f3f2356a-2491-4528-8f30-cbe1a8b03108 tempest-TestShelveInstance-1634360024 tempest-TestShelveInstance-1634360024-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75045) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 23:17:51 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-f3f2356a-2491-4528-8f30-cbe1a8b03108 tempest-TestShelveInstance-1634360024 tempest-TestShelveInstance-1634360024-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75045) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 23:17:51 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-f3f2356a-2491-4528-8f30-cbe1a8b03108 tempest-TestShelveInstance-1634360024 tempest-TestShelveInstance-1634360024-project-member] Acquiring lock "cache_volume_driver" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:17:51 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-f3f2356a-2491-4528-8f30-cbe1a8b03108 tempest-TestShelveInstance-1634360024 tempest-TestShelveInstance-1634360024-project-member] Lock "cache_volume_driver" acquired by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:17:51 user nova-compute[75045]: DEBUG os_brick.initiator.connector [None req-f3f2356a-2491-4528-8f30-cbe1a8b03108 tempest-TestShelveInstance-1634360024 tempest-TestShelveInstance-1634360024-project-member] Factory for ISCSI on None {{(pid=75045) factory /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connector.py:281}}
Nov 08 23:17:51 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-f3f2356a-2491-4528-8f30-cbe1a8b03108 tempest-TestShelveInstance-1634360024 tempest-TestShelveInstance-1634360024-project-member] Lock "cache_volume_driver" "released" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: held 0.008s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:17:51 user nova-compute[75045]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f3f2356a-2491-4528-8f30-cbe1a8b03108 tempest-TestShelveInstance-1634360024 tempest-TestShelveInstance-1634360024-project-member] [instance: 725866aa-0e2a-4af3-af20-48157e6d2fcb] Calling os-brick to attach iSCSI Volume {{(pid=75045) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 23:17:51 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3f2356a-2491-4528-8f30-cbe1a8b03108 tempest-TestShelveInstance-1634360024 tempest-TestShelveInstance-1634360024-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1b68210460>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d2068946-d374-45a4-9850-e3a690b13ef4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eQScvmpf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75045) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 23:17:51 user nova-compute[75045]: WARNING os_brick.initiator.connectors.base [None req-f3f2356a-2491-4528-8f30-cbe1a8b03108 tempest-TestShelveInstance-1634360024 tempest-TestShelveInstance-1634360024-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 23:17:51 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-f3f2356a-2491-4528-8f30-cbe1a8b03108 tempest-TestShelveInstance-1634360024 tempest-TestShelveInstance-1634360024-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 23:17:51 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-f3f2356a-2491-4528-8f30-cbe1a8b03108 tempest-TestShelveInstance-1634360024 tempest-TestShelveInstance-1634360024-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 23:17:51 user nova-compute[75045]: WARNING os_brick.initiator.connectors.base [None req-f3f2356a-2491-4528-8f30-cbe1a8b03108 tempest-TestShelveInstance-1634360024 tempest-TestShelveInstance-1634360024-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 23:17:51 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-f3f2356a-2491-4528-8f30-cbe1a8b03108 tempest-TestShelveInstance-1634360024 tempest-TestShelveInstance-1634360024-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d2068946-d374-45a4-9850-e3a690b13ef4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 23:17:51 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-f3f2356a-2491-4528-8f30-cbe1a8b03108 tempest-TestShelveInstance-1634360024 tempest-TestShelveInstance-1634360024-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d2068946-d374-45a4-9850-e3a690b13ef4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 23:17:51 user nova-compute[75045]: INFO os_brick.initiator.connectors.iscsi [None req-f3f2356a-2491-4528-8f30-cbe1a8b03108 tempest-TestShelveInstance-1634360024 tempest-TestShelveInstance-1634360024-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 23:17:51 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2068946-d374-45a4-9850-e3a690b13ef4 -p 172.16.0.220:3260 {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:17:52 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2068946-d374-45a4-9850-e3a690b13ef4 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:17:52 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbe81e5e-a963-4ecd-8f15-b6347e565618]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:17:52 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3f2356a-2491-4528-8f30-cbe1a8b03108 tempest-TestShelveInstance-1634360024 tempest-TestShelveInstance-1634360024-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 23:17:52 user nova-compute[75045]:  {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:17:52 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2068946-d374-45a4-9850-e3a690b13ef4 -p 172.16.0.220:3260 --interface default --op new {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:17:52 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2068946-d374-45a4-9850-e3a690b13ef4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:17:52 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3395a6a-9bd8-4164-9860-9ce2ffeea38e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d2068946-d374-45a4-9850-e3a690b13ef4] added\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:17:52 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3f2356a-2491-4528-8f30-cbe1a8b03108 tempest-TestShelveInstance-1634360024 tempest-TestShelveInstance-1634360024-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d2068946-d374-45a4-9850-e3a690b13ef4] added
Nov 08 23:17:52 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:17:52 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2068946-d374-45a4-9850-e3a690b13ef4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:17:52 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2068946-d374-45a4-9850-e3a690b13ef4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:17:52 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[d93d0c02-2bed-406e-9254-ebbee85fc6d0]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:17:52 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3f2356a-2491-4528-8f30-cbe1a8b03108 tempest-TestShelveInstance-1634360024 tempest-TestShelveInstance-1634360024-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:17:52 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2068946-d374-45a4-9850-e3a690b13ef4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:17:52 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2068946-d374-45a4-9850-e3a690b13ef4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:17:52 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[dec013fa-310f-4060-99a3-686325697cdb]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:17:52 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3f2356a-2491-4528-8f30-cbe1a8b03108 tempest-TestShelveInstance-1634360024 tempest-TestShelveInstance-1634360024-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:17:52 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2068946-d374-45a4-9850-e3a690b13ef4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eQScvmpf {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:17:52 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2068946-d374-45a4-9850-e3a690b13ef4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eQScvmpf" returned: 0 in 0.025s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:17:52 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[817a9d3b-5580-43b8-b15a-a66eb7d93e64]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:17:52 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3f2356a-2491-4528-8f30-cbe1a8b03108 tempest-TestShelveInstance-1634360024 tempest-TestShelveInstance-1634360024-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'eQScvmpf'): stdout= stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:17:52 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2068946-d374-45a4-9850-e3a690b13ef4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:17:52 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2068946-d374-45a4-9850-e3a690b13ef4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:17:52 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[45aa3acf-ae40-4a77-89d2-720ff0a59fb3]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:17:52 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3f2356a-2491-4528-8f30-cbe1a8b03108 tempest-TestShelveInstance-1634360024 tempest-TestShelveInstance-1634360024-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:17:52 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:17:52 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.015s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:17:52 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b5e131a-a258-4e95-a3db-d242d7dc361c]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:17:52 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3f2356a-2491-4528-8f30-cbe1a8b03108 tempest-TestShelveInstance-1634360024 tempest-TestShelveInstance-1634360024-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 08 23:17:52 user nova-compute[75045]:  {{(pid=75045) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 23:17:52 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3f2356a-2491-4528-8f30-cbe1a8b03108 tempest-TestShelveInstance-1634360024 tempest-TestShelveInstance-1634360024-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 08 23:17:52 user nova-compute[75045]:  {{(pid=75045) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 23:17:52 user nova-compute[75045]: WARNING os_brick.initiator.connectors.iscsi [None req-f3f2356a-2491-4528-8f30-cbe1a8b03108 tempest-TestShelveInstance-1634360024 tempest-TestShelveInstance-1634360024-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 08 23:17:52 user nova-compute[75045]: 
Nov 08 23:17:52 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2068946-d374-45a4-9850-e3a690b13ef4 -p 172.16.0.220:3260 --login {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:17:52 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2068946-d374-45a4-9850-e3a690b13ef4 -p 172.16.0.220:3260 --login" returned: 0 in 0.052s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:17:52 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d6aabd6-6cf8-4d0a-90a9-34f9be914ba3]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d2068946-d374-45a4-9850-e3a690b13ef4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d2068946-d374-45a4-9850-e3a690b13ef4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:17:52 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3f2356a-2491-4528-8f30-cbe1a8b03108 tempest-TestShelveInstance-1634360024 tempest-TestShelveInstance-1634360024-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d2068946-d374-45a4-9850-e3a690b13ef4, portal: 172.16.0.220,3260]
Nov 08 23:17:52 user nova-compute[75045]: Login to [iface: default, target: iqn.2010-10.org.openstack:d2068946-d374-45a4-9850-e3a690b13ef4, portal: 172.16.0.220,3260] successful.
Nov 08 23:17:52 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:17:52 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2068946-d374-45a4-9850-e3a690b13ef4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:17:52 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2068946-d374-45a4-9850-e3a690b13ef4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:17:52 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[c62c2c1c-c3ea-438b-9564-c22eb943400e]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:17:52 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3f2356a-2491-4528-8f30-cbe1a8b03108 tempest-TestShelveInstance-1634360024 tempest-TestShelveInstance-1634360024-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:17:52 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:17:52 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:17:52 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[26917606-273e-439d-a978-73b1a3df5407]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2068946-d374-45a4-9850-e3a690b13ef4 (non-flash)\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:17:52 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3f2356a-2491-4528-8f30-cbe1a8b03108 tempest-TestShelveInstance-1634360024 tempest-TestShelveInstance-1634360024-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2068946-d374-45a4-9850-e3a690b13ef4 (non-flash)
Nov 08 23:17:52 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 23:17:52 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3f2356a-2491-4528-8f30-cbe1a8b03108 tempest-TestShelveInstance-1634360024 tempest-TestShelveInstance-1634360024-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2068946-d374-45a4-9850-e3a690b13ef4 (non-flash)
Nov 08 23:17:52 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 23:17:52 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-f3f2356a-2491-4528-8f30-cbe1a8b03108 tempest-TestShelveInstance-1634360024 tempest-TestShelveInstance-1634360024-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d2068946-d374-45a4-9850-e3a690b13ef4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.295s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 23:17:52 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3f2356a-2491-4528-8f30-cbe1a8b03108 tempest-TestShelveInstance-1634360024 tempest-TestShelveInstance-1634360024-project-member] Connected to 172.16.0.220:3260 {{(pid=75045) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 23:17:52 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-f3f2356a-2491-4528-8f30-cbe1a8b03108 tempest-TestShelveInstance-1634360024 tempest-TestShelveInstance-1634360024-project-member] HCTL ('33', '-', '-', 0) found on session 2 with lun 0 {{(pid=75045) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 23:17:52 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-f3f2356a-2491-4528-8f30-cbe1a8b03108 tempest-TestShelveInstance-1634360024 tempest-TestShelveInstance-1634360024-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75045) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 23:17:52 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:17:52 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:17:52 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[956b926c-1776-4135-a7f8-85e2ffab7495]: (4, ('- - 0', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:17:52 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-f3f2356a-2491-4528-8f30-cbe1a8b03108 tempest-TestShelveInstance-1634360024 tempest-TestShelveInstance-1634360024-project-member] Searching for a device in session 2 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75045) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 23:17:52 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3f2356a-2491-4528-8f30-cbe1a8b03108 tempest-TestShelveInstance-1634360024 tempest-TestShelveInstance-1634360024-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:d2068946-d374-45a4-9850-e3a690b13ef4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eQScvmpf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75045) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 23:17:53 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-f3f2356a-2491-4528-8f30-cbe1a8b03108 tempest-TestShelveInstance-1634360024 tempest-TestShelveInstance-1634360024-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.334s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 23:17:53 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3f2356a-2491-4528-8f30-cbe1a8b03108 tempest-TestShelveInstance-1634360024 tempest-TestShelveInstance-1634360024-project-member] <== connect_volume: return (1336ms) {'type': 'block', 'scsi_wwn': '23235663362643230', 'path': '/dev/sdb'} {{(pid=75045) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 23:17:53 user nova-compute[75045]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f3f2356a-2491-4528-8f30-cbe1a8b03108 tempest-TestShelveInstance-1634360024 tempest-TestShelveInstance-1634360024-project-member] [instance: 725866aa-0e2a-4af3-af20-48157e6d2fcb] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23235663362643230', 'path': '/dev/sdb'} {{(pid=75045) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 23:17:53 user nova-compute[75045]: DEBUG nova.virt.libvirt.vif [None req-f3f2356a-2491-4528-8f30-cbe1a8b03108 tempest-TestShelveInstance-1634360024 tempest-TestShelveInstance-1634360024-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T23:17:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-961488157',display_name='tempest-TestShelveInstance-server-961488157',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-961488157',id=9,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPdSdRn8WciiiK68fvoPSG0DN5FXQxOXxXUm/XL4qxnEmO5qC4nYOWk8Lgcyp12BuaZBz/IIiTtq1Y4TgPZ8aXxKhhN+gEPxX15QF8o4xT2o0K09li/F7ysXt5rBzWL/Lw==',key_name='tempest-TestShelveInstance-1861694278',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ec089e7050c542c9860d9fc5f3ae9392',ramdisk_id='',reservation_id='r-2v3622zl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-1634360024',owner_user_name='tempest-TestShelveInstance-1634360024-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T23:17:25Z,user_data=None,user_id='e30385ff71444d4f9a799c79e0ab67e9',uuid=725866aa-0e2a-4af3-af20-48157e6d2fcb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9a617e54-a69a-4204-b94e-dbe71b1432d2", "address": "fa:16:3e:64:ef:b6", "network": {"id": "25b429b3-693b-4e72-9035-71c276706294", "bridge": "br-int", "label": "tempest-TestShelveInstance-437524717-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec089e7050c542c9860d9fc5f3ae9392", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a617e54-a6", "ovs_interfaceid": "9a617e54-a69a-4204-b94e-dbe71b1432d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75045) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 23:17:53 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-f3f2356a-2491-4528-8f30-cbe1a8b03108 tempest-TestShelveInstance-1634360024 tempest-TestShelveInstance-1634360024-project-member] Converting VIF {"id": "9a617e54-a69a-4204-b94e-dbe71b1432d2", "address": "fa:16:3e:64:ef:b6", "network": {"id": "25b429b3-693b-4e72-9035-71c276706294", "bridge": "br-int", "label": "tempest-TestShelveInstance-437524717-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec089e7050c542c9860d9fc5f3ae9392", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a617e54-a6", "ovs_interfaceid": "9a617e54-a69a-4204-b94e-dbe71b1432d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 23:17:53 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-f3f2356a-2491-4528-8f30-cbe1a8b03108 tempest-TestShelveInstance-1634360024 tempest-TestShelveInstance-1634360024-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:64:ef:b6,bridge_name='br-int',has_traffic_filtering=True,id=9a617e54-a69a-4204-b94e-dbe71b1432d2,network=Network(25b429b3-693b-4e72-9035-71c276706294),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9a617e54-a6') {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 23:17:53 user nova-compute[75045]: DEBUG nova.objects.instance [None req-f3f2356a-2491-4528-8f30-cbe1a8b03108 tempest-TestShelveInstance-1634360024 tempest-TestShelveInstance-1634360024-project-member] Lazy-loading 'pci_devices' on Instance uuid 725866aa-0e2a-4af3-af20-48157e6d2fcb {{(pid=75045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 23:17:53 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-f3f2356a-2491-4528-8f30-cbe1a8b03108 tempest-TestShelveInstance-1634360024 tempest-TestShelveInstance-1634360024-project-member] [instance: 725866aa-0e2a-4af3-af20-48157e6d2fcb] End _get_guest_xml xml=<domain type="kvm">
Nov 08 23:17:53 user nova-compute[75045]:   <uuid>725866aa-0e2a-4af3-af20-48157e6d2fcb</uuid>
Nov 08 23:17:53 user nova-compute[75045]:   <name>instance-00000009</name>
Nov 08 23:17:53 user nova-compute[75045]:   <memory>524288</memory>
Nov 08 23:17:53 user nova-compute[75045]:   <vcpu>1</vcpu>
Nov 08 23:17:53 user nova-compute[75045]:   <metadata>
Nov 08 23:17:53 user nova-compute[75045]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 23:17:53 user nova-compute[75045]:       <nova:package version="0.0.0"/>
Nov 08 23:17:53 user nova-compute[75045]:       <nova:name>tempest-TestShelveInstance-server-961488157</nova:name>
Nov 08 23:17:53 user nova-compute[75045]:       <nova:creationTime>2023-11-08 23:17:51</nova:creationTime>
Nov 08 23:17:53 user nova-compute[75045]:       <nova:flavor name="m1.tiny">
Nov 08 23:17:53 user nova-compute[75045]:         <nova:memory>512</nova:memory>
Nov 08 23:17:53 user nova-compute[75045]:         <nova:disk>1</nova:disk>
Nov 08 23:17:53 user nova-compute[75045]:         <nova:swap>0</nova:swap>
Nov 08 23:17:53 user nova-compute[75045]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 23:17:53 user nova-compute[75045]:         <nova:vcpus>1</nova:vcpus>
Nov 08 23:17:53 user nova-compute[75045]:       </nova:flavor>
Nov 08 23:17:53 user nova-compute[75045]:       <nova:owner>
Nov 08 23:17:53 user nova-compute[75045]:         <nova:user uuid="e30385ff71444d4f9a799c79e0ab67e9">tempest-TestShelveInstance-1634360024-project-member</nova:user>
Nov 08 23:17:53 user nova-compute[75045]:         <nova:project uuid="ec089e7050c542c9860d9fc5f3ae9392">tempest-TestShelveInstance-1634360024</nova:project>
Nov 08 23:17:53 user nova-compute[75045]:       </nova:owner>
Nov 08 23:17:53 user nova-compute[75045]:       <nova:ports>
Nov 08 23:17:53 user nova-compute[75045]:         <nova:port uuid="9a617e54-a69a-4204-b94e-dbe71b1432d2">
Nov 08 23:17:53 user nova-compute[75045]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 08 23:17:53 user nova-compute[75045]:         </nova:port>
Nov 08 23:17:53 user nova-compute[75045]:       </nova:ports>
Nov 08 23:17:53 user nova-compute[75045]:     </nova:instance>
Nov 08 23:17:53 user nova-compute[75045]:   </metadata>
Nov 08 23:17:53 user nova-compute[75045]:   <sysinfo type="smbios">
Nov 08 23:17:53 user nova-compute[75045]:     <system>
Nov 08 23:17:53 user nova-compute[75045]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 23:17:53 user nova-compute[75045]:       <entry name="product">OpenStack Nova</entry>
Nov 08 23:17:53 user nova-compute[75045]:       <entry name="version">0.0.0</entry>
Nov 08 23:17:53 user nova-compute[75045]:       <entry name="serial">725866aa-0e2a-4af3-af20-48157e6d2fcb</entry>
Nov 08 23:17:53 user nova-compute[75045]:       <entry name="uuid">725866aa-0e2a-4af3-af20-48157e6d2fcb</entry>
Nov 08 23:17:53 user nova-compute[75045]:       <entry name="family">Virtual Machine</entry>
Nov 08 23:17:53 user nova-compute[75045]:     </system>
Nov 08 23:17:53 user nova-compute[75045]:   </sysinfo>
Nov 08 23:17:53 user nova-compute[75045]:   <os>
Nov 08 23:17:53 user nova-compute[75045]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 23:17:53 user nova-compute[75045]:     <boot dev="hd"/>
Nov 08 23:17:53 user nova-compute[75045]:     <smbios mode="sysinfo"/>
Nov 08 23:17:53 user nova-compute[75045]:   </os>
Nov 08 23:17:53 user nova-compute[75045]:   <features>
Nov 08 23:17:53 user nova-compute[75045]:     <acpi/>
Nov 08 23:17:53 user nova-compute[75045]:     <apic/>
Nov 08 23:17:53 user nova-compute[75045]:     <vmcoreinfo/>
Nov 08 23:17:53 user nova-compute[75045]:   </features>
Nov 08 23:17:53 user nova-compute[75045]:   <clock offset="utc">
Nov 08 23:17:53 user nova-compute[75045]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 23:17:53 user nova-compute[75045]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 23:17:53 user nova-compute[75045]:     <timer name="hpet" present="no"/>
Nov 08 23:17:53 user nova-compute[75045]:   </clock>
Nov 08 23:17:53 user nova-compute[75045]:   <cpu mode="custom" match="exact">
Nov 08 23:17:53 user nova-compute[75045]:     <model>Nehalem</model>
Nov 08 23:17:53 user nova-compute[75045]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 23:17:53 user nova-compute[75045]:   </cpu>
Nov 08 23:17:53 user nova-compute[75045]:   <devices>
Nov 08 23:17:53 user nova-compute[75045]:     <disk type="block" device="disk">
Nov 08 23:17:53 user nova-compute[75045]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 23:17:53 user nova-compute[75045]:       <source dev="/dev/sdb"/>
Nov 08 23:17:53 user nova-compute[75045]:       <target dev="vda" bus="virtio"/>
Nov 08 23:17:53 user nova-compute[75045]:       <serial>d2068946-d374-45a4-9850-e3a690b13ef4</serial>
Nov 08 23:17:53 user nova-compute[75045]:     </disk>
Nov 08 23:17:53 user nova-compute[75045]:     <interface type="ethernet">
Nov 08 23:17:53 user nova-compute[75045]:       <mac address="fa:16:3e:64:ef:b6"/>
Nov 08 23:17:53 user nova-compute[75045]:       <model type="virtio"/>
Nov 08 23:17:53 user nova-compute[75045]:       <mtu size="1442"/>
Nov 08 23:17:53 user nova-compute[75045]:       <target dev="tap9a617e54-a6"/>
Nov 08 23:17:53 user nova-compute[75045]:     </interface>
Nov 08 23:17:53 user nova-compute[75045]:     <serial type="pty">
Nov 08 23:17:53 user nova-compute[75045]:       <log file="/opt/stack/data/nova/instances/725866aa-0e2a-4af3-af20-48157e6d2fcb/console.log" append="off"/>
Nov 08 23:17:53 user nova-compute[75045]:     </serial>
Nov 08 23:17:53 user nova-compute[75045]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 23:17:53 user nova-compute[75045]:     <video>
Nov 08 23:17:53 user nova-compute[75045]:       <model type="virtio"/>
Nov 08 23:17:53 user nova-compute[75045]:     </video>
Nov 08 23:17:53 user nova-compute[75045]:     <rng model="virtio">
Nov 08 23:17:53 user nova-compute[75045]:       <backend model="random">/dev/urandom</backend>
Nov 08 23:17:53 user nova-compute[75045]:     </rng>
Nov 08 23:17:53 user nova-compute[75045]:     <controller type="usb" index="0" model="none"/>
Nov 08 23:17:53 user nova-compute[75045]:     <memballoon model="virtio">
Nov 08 23:17:53 user nova-compute[75045]:       <stats period="10"/>
Nov 08 23:17:53 user nova-compute[75045]:     </memballoon>
Nov 08 23:17:53 user nova-compute[75045]:   </devices>
Nov 08 23:17:53 user nova-compute[75045]: </domain>
Nov 08 23:17:53 user nova-compute[75045]:  {{(pid=75045) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 23:17:53 user nova-compute[75045]: DEBUG nova.virt.libvirt.vif [None req-f3f2356a-2491-4528-8f30-cbe1a8b03108 tempest-TestShelveInstance-1634360024 tempest-TestShelveInstance-1634360024-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T23:17:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-961488157',display_name='tempest-TestShelveInstance-server-961488157',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-961488157',id=9,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPdSdRn8WciiiK68fvoPSG0DN5FXQxOXxXUm/XL4qxnEmO5qC4nYOWk8Lgcyp12BuaZBz/IIiTtq1Y4TgPZ8aXxKhhN+gEPxX15QF8o4xT2o0K09li/F7ysXt5rBzWL/Lw==',key_name='tempest-TestShelveInstance-1861694278',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ec089e7050c542c9860d9fc5f3ae9392',ramdisk_id='',reservation_id='r-2v3622zl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-1634360024',owner_user_name='tempest-TestShelveInstance-1634360024-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T23:17:25Z,user_data=None,user_id='e30385ff71444d4f9a799c79e0ab67e9',uuid=725866aa-0e2a-4af3-af20-48157e6d2fcb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9a617e54-a69a-4204-b94e-dbe71b1432d2", "address": "fa:16:3e:64:ef:b6", "network": {"id": "25b429b3-693b-4e72-9035-71c276706294", "bridge": "br-int", "label": "tempest-TestShelveInstance-437524717-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec089e7050c542c9860d9fc5f3ae9392", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a617e54-a6", "ovs_interfaceid": "9a617e54-a69a-4204-b94e-dbe71b1432d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75045) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 23:17:53 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-f3f2356a-2491-4528-8f30-cbe1a8b03108 tempest-TestShelveInstance-1634360024 tempest-TestShelveInstance-1634360024-project-member] Converting VIF {"id": "9a617e54-a69a-4204-b94e-dbe71b1432d2", "address": "fa:16:3e:64:ef:b6", "network": {"id": "25b429b3-693b-4e72-9035-71c276706294", "bridge": "br-int", "label": "tempest-TestShelveInstance-437524717-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec089e7050c542c9860d9fc5f3ae9392", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a617e54-a6", "ovs_interfaceid": "9a617e54-a69a-4204-b94e-dbe71b1432d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 23:17:53 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-f3f2356a-2491-4528-8f30-cbe1a8b03108 tempest-TestShelveInstance-1634360024 tempest-TestShelveInstance-1634360024-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:64:ef:b6,bridge_name='br-int',has_traffic_filtering=True,id=9a617e54-a69a-4204-b94e-dbe71b1432d2,network=Network(25b429b3-693b-4e72-9035-71c276706294),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9a617e54-a6') {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 23:17:53 user nova-compute[75045]: DEBUG os_vif [None req-f3f2356a-2491-4528-8f30-cbe1a8b03108 tempest-TestShelveInstance-1634360024 tempest-TestShelveInstance-1634360024-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:64:ef:b6,bridge_name='br-int',has_traffic_filtering=True,id=9a617e54-a69a-4204-b94e-dbe71b1432d2,network=Network(25b429b3-693b-4e72-9035-71c276706294),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9a617e54-a6') {{(pid=75045) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 23:17:53 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:17:53 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:17:53 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 23:17:53 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:17:53 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd5946e1a-9bbd-5676-9568-a82716adc008', '_type': 'linux-noop'}}, row=False) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:17:53 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:17:53 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 23:17:53 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:17:53 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9a617e54-a6, may_exist=True, interface_attrs={}) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:17:53 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9a617e54-a6, col_values=(('qos', UUID('b01b735d-3cbc-4987-ba60-1ccfc376b0d2')),), if_exists=True) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:17:53 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9a617e54-a6, col_values=(('external_ids', {'iface-id': '9a617e54-a69a-4204-b94e-dbe71b1432d2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:64:ef:b6', 'vm-uuid': '725866aa-0e2a-4af3-af20-48157e6d2fcb'}),), if_exists=True) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:17:53 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:17:53 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 23:17:53 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:17:53 user nova-compute[75045]: INFO os_vif [None req-f3f2356a-2491-4528-8f30-cbe1a8b03108 tempest-TestShelveInstance-1634360024 tempest-TestShelveInstance-1634360024-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:64:ef:b6,bridge_name='br-int',has_traffic_filtering=True,id=9a617e54-a69a-4204-b94e-dbe71b1432d2,network=Network(25b429b3-693b-4e72-9035-71c276706294),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9a617e54-a6')
Nov 08 23:17:53 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-f3f2356a-2491-4528-8f30-cbe1a8b03108 tempest-TestShelveInstance-1634360024 tempest-TestShelveInstance-1634360024-project-member] No BDM found with device name vda, not building metadata. {{(pid=75045) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 23:17:53 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-f3f2356a-2491-4528-8f30-cbe1a8b03108 tempest-TestShelveInstance-1634360024 tempest-TestShelveInstance-1634360024-project-member] No VIF found with MAC fa:16:3e:64:ef:b6, not building metadata {{(pid=75045) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 23:17:54 user nova-compute[75045]: DEBUG nova.compute.manager [req-92d34d94-f04b-4fa0-8553-845dbd514361 req-1b8d1423-bd35-4c72-a8d7-ef164da087a7 service nova] [instance: b9bd3096-92eb-4aae-8619-2725ed9acc2b] Received event network-changed-aea70d63-158f-4f6e-ac36-1c342bd5be4d {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:17:54 user nova-compute[75045]: DEBUG nova.compute.manager [req-92d34d94-f04b-4fa0-8553-845dbd514361 req-1b8d1423-bd35-4c72-a8d7-ef164da087a7 service nova] [instance: b9bd3096-92eb-4aae-8619-2725ed9acc2b] Refreshing instance network info cache due to event network-changed-aea70d63-158f-4f6e-ac36-1c342bd5be4d. {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 23:17:54 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-92d34d94-f04b-4fa0-8553-845dbd514361 req-1b8d1423-bd35-4c72-a8d7-ef164da087a7 service nova] Acquiring lock "refresh_cache-b9bd3096-92eb-4aae-8619-2725ed9acc2b" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 23:17:54 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-92d34d94-f04b-4fa0-8553-845dbd514361 req-1b8d1423-bd35-4c72-a8d7-ef164da087a7 service nova] Acquired lock "refresh_cache-b9bd3096-92eb-4aae-8619-2725ed9acc2b" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 23:17:54 user nova-compute[75045]: DEBUG nova.network.neutron [req-92d34d94-f04b-4fa0-8553-845dbd514361 req-1b8d1423-bd35-4c72-a8d7-ef164da087a7 service nova] [instance: b9bd3096-92eb-4aae-8619-2725ed9acc2b] Refreshing network info cache for port aea70d63-158f-4f6e-ac36-1c342bd5be4d {{(pid=75045) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 23:17:54 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:17:54 user nova-compute[75045]: DEBUG nova.network.neutron [req-92d34d94-f04b-4fa0-8553-845dbd514361 req-1b8d1423-bd35-4c72-a8d7-ef164da087a7 service nova] [instance: b9bd3096-92eb-4aae-8619-2725ed9acc2b] Updated VIF entry in instance network info cache for port aea70d63-158f-4f6e-ac36-1c342bd5be4d. {{(pid=75045) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 23:17:54 user nova-compute[75045]: DEBUG nova.network.neutron [req-92d34d94-f04b-4fa0-8553-845dbd514361 req-1b8d1423-bd35-4c72-a8d7-ef164da087a7 service nova] [instance: b9bd3096-92eb-4aae-8619-2725ed9acc2b] Updating instance_info_cache with network_info: [{"id": "aea70d63-158f-4f6e-ac36-1c342bd5be4d", "address": "fa:16:3e:1e:64:12", "network": {"id": "c4c4a0db-a673-4145-852d-5ab102a81bf9", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-993346983-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.169", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8623aaa12b0b44928ef7391a460fcfe7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaea70d63-15", "ovs_interfaceid": "aea70d63-158f-4f6e-ac36-1c342bd5be4d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75045) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 23:17:54 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-92d34d94-f04b-4fa0-8553-845dbd514361 req-1b8d1423-bd35-4c72-a8d7-ef164da087a7 service nova] Releasing lock "refresh_cache-b9bd3096-92eb-4aae-8619-2725ed9acc2b" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 23:17:54 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:17:54 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:17:55 user nova-compute[75045]: DEBUG nova.compute.manager [req-fc73b5e6-6436-4ac0-a1f0-f9e17da1b01e req-72d9387c-72b0-4826-9a66-bcc11ab0a2f8 service nova] [instance: 725866aa-0e2a-4af3-af20-48157e6d2fcb] Received event network-vif-plugged-9a617e54-a69a-4204-b94e-dbe71b1432d2 {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:17:55 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-fc73b5e6-6436-4ac0-a1f0-f9e17da1b01e req-72d9387c-72b0-4826-9a66-bcc11ab0a2f8 service nova] Acquiring lock "725866aa-0e2a-4af3-af20-48157e6d2fcb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:17:55 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-fc73b5e6-6436-4ac0-a1f0-f9e17da1b01e req-72d9387c-72b0-4826-9a66-bcc11ab0a2f8 service nova] Lock "725866aa-0e2a-4af3-af20-48157e6d2fcb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:17:55 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-fc73b5e6-6436-4ac0-a1f0-f9e17da1b01e req-72d9387c-72b0-4826-9a66-bcc11ab0a2f8 service nova] Lock "725866aa-0e2a-4af3-af20-48157e6d2fcb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:17:55 user nova-compute[75045]: DEBUG nova.compute.manager [req-fc73b5e6-6436-4ac0-a1f0-f9e17da1b01e req-72d9387c-72b0-4826-9a66-bcc11ab0a2f8 service nova] [instance: 725866aa-0e2a-4af3-af20-48157e6d2fcb] No waiting events found dispatching network-vif-plugged-9a617e54-a69a-4204-b94e-dbe71b1432d2 {{(pid=75045) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 23:17:55 user nova-compute[75045]: WARNING nova.compute.manager [req-fc73b5e6-6436-4ac0-a1f0-f9e17da1b01e req-72d9387c-72b0-4826-9a66-bcc11ab0a2f8 service nova] [instance: 725866aa-0e2a-4af3-af20-48157e6d2fcb] Received unexpected event network-vif-plugged-9a617e54-a69a-4204-b94e-dbe71b1432d2 for instance with vm_state building and task_state spawning.
Nov 08 23:17:55 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:17:55 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:17:55 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:17:55 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:17:57 user nova-compute[75045]: DEBUG nova.compute.manager [req-f4420a91-dccd-42af-ae65-c8d807606730 req-3c50f012-cde2-430d-baee-46d260ecf21d service nova] [instance: 725866aa-0e2a-4af3-af20-48157e6d2fcb] Received event network-vif-plugged-9a617e54-a69a-4204-b94e-dbe71b1432d2 {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:17:57 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-f4420a91-dccd-42af-ae65-c8d807606730 req-3c50f012-cde2-430d-baee-46d260ecf21d service nova] Acquiring lock "725866aa-0e2a-4af3-af20-48157e6d2fcb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:17:57 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-f4420a91-dccd-42af-ae65-c8d807606730 req-3c50f012-cde2-430d-baee-46d260ecf21d service nova] Lock "725866aa-0e2a-4af3-af20-48157e6d2fcb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:17:57 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-f4420a91-dccd-42af-ae65-c8d807606730 req-3c50f012-cde2-430d-baee-46d260ecf21d service nova] Lock "725866aa-0e2a-4af3-af20-48157e6d2fcb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:17:57 user nova-compute[75045]: DEBUG nova.compute.manager [req-f4420a91-dccd-42af-ae65-c8d807606730 req-3c50f012-cde2-430d-baee-46d260ecf21d service nova] [instance: 725866aa-0e2a-4af3-af20-48157e6d2fcb] No waiting events found dispatching network-vif-plugged-9a617e54-a69a-4204-b94e-dbe71b1432d2 {{(pid=75045) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 23:17:57 user nova-compute[75045]: WARNING nova.compute.manager [req-f4420a91-dccd-42af-ae65-c8d807606730 req-3c50f012-cde2-430d-baee-46d260ecf21d service nova] [instance: 725866aa-0e2a-4af3-af20-48157e6d2fcb] Received unexpected event network-vif-plugged-9a617e54-a69a-4204-b94e-dbe71b1432d2 for instance with vm_state building and task_state spawning.
Nov 08 23:17:57 user nova-compute[75045]: DEBUG nova.compute.manager [None req-f3f2356a-2491-4528-8f30-cbe1a8b03108 tempest-TestShelveInstance-1634360024 tempest-TestShelveInstance-1634360024-project-member] [instance: 725866aa-0e2a-4af3-af20-48157e6d2fcb] Instance event wait completed in 0 seconds for  {{(pid=75045) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 23:17:57 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-f3f2356a-2491-4528-8f30-cbe1a8b03108 tempest-TestShelveInstance-1634360024 tempest-TestShelveInstance-1634360024-project-member] [instance: 725866aa-0e2a-4af3-af20-48157e6d2fcb] Guest created on hypervisor {{(pid=75045) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 23:17:57 user nova-compute[75045]: INFO nova.virt.libvirt.driver [-] [instance: 725866aa-0e2a-4af3-af20-48157e6d2fcb] Instance spawned successfully.
Nov 08 23:17:57 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-f3f2356a-2491-4528-8f30-cbe1a8b03108 tempest-TestShelveInstance-1634360024 tempest-TestShelveInstance-1634360024-project-member] [instance: 725866aa-0e2a-4af3-af20-48157e6d2fcb] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75045) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 23:17:57 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-f3f2356a-2491-4528-8f30-cbe1a8b03108 tempest-TestShelveInstance-1634360024 tempest-TestShelveInstance-1634360024-project-member] [instance: 725866aa-0e2a-4af3-af20-48157e6d2fcb] Found default for hw_cdrom_bus of ide {{(pid=75045) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 23:17:57 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-f3f2356a-2491-4528-8f30-cbe1a8b03108 tempest-TestShelveInstance-1634360024 tempest-TestShelveInstance-1634360024-project-member] [instance: 725866aa-0e2a-4af3-af20-48157e6d2fcb] Found default for hw_disk_bus of virtio {{(pid=75045) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 23:17:57 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-f3f2356a-2491-4528-8f30-cbe1a8b03108 tempest-TestShelveInstance-1634360024 tempest-TestShelveInstance-1634360024-project-member] [instance: 725866aa-0e2a-4af3-af20-48157e6d2fcb] Found default for hw_input_bus of None {{(pid=75045) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 23:17:57 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-f3f2356a-2491-4528-8f30-cbe1a8b03108 tempest-TestShelveInstance-1634360024 tempest-TestShelveInstance-1634360024-project-member] [instance: 725866aa-0e2a-4af3-af20-48157e6d2fcb] Found default for hw_pointer_model of None {{(pid=75045) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 23:17:57 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-f3f2356a-2491-4528-8f30-cbe1a8b03108 tempest-TestShelveInstance-1634360024 tempest-TestShelveInstance-1634360024-project-member] [instance: 725866aa-0e2a-4af3-af20-48157e6d2fcb] Found default for hw_video_model of virtio {{(pid=75045) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 23:17:57 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-f3f2356a-2491-4528-8f30-cbe1a8b03108 tempest-TestShelveInstance-1634360024 tempest-TestShelveInstance-1634360024-project-member] [instance: 725866aa-0e2a-4af3-af20-48157e6d2fcb] Found default for hw_vif_model of virtio {{(pid=75045) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 23:17:57 user nova-compute[75045]: INFO nova.compute.manager [None req-f3f2356a-2491-4528-8f30-cbe1a8b03108 tempest-TestShelveInstance-1634360024 tempest-TestShelveInstance-1634360024-project-member] [instance: 725866aa-0e2a-4af3-af20-48157e6d2fcb] Took 5.74 seconds to spawn the instance on the hypervisor.
Nov 08 23:17:57 user nova-compute[75045]: DEBUG nova.compute.manager [None req-f3f2356a-2491-4528-8f30-cbe1a8b03108 tempest-TestShelveInstance-1634360024 tempest-TestShelveInstance-1634360024-project-member] [instance: 725866aa-0e2a-4af3-af20-48157e6d2fcb] Checking state {{(pid=75045) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 23:17:57 user nova-compute[75045]: INFO nova.compute.manager [None req-f3f2356a-2491-4528-8f30-cbe1a8b03108 tempest-TestShelveInstance-1634360024 tempest-TestShelveInstance-1634360024-project-member] [instance: 725866aa-0e2a-4af3-af20-48157e6d2fcb] Took 33.66 seconds to build instance.
Nov 08 23:17:57 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-f3f2356a-2491-4528-8f30-cbe1a8b03108 tempest-TestShelveInstance-1634360024 tempest-TestShelveInstance-1634360024-project-member] Lock "725866aa-0e2a-4af3-af20-48157e6d2fcb" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 33.789s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:17:58 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:17:58 user nova-compute[75045]: DEBUG nova.virt.libvirt.volume.iscsi [None req-099dcd3c-5421-47c3-b271-c3b266b57fec tempest-DeleteServersTestJSON-1018435513 tempest-DeleteServersTestJSON-1018435513-project-member] [instance: 09cf15e6-1cec-4c55-b7dd-4311b5f87d32] Calling os-brick to attach iSCSI Volume {{(pid=75045) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 23:17:58 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-099dcd3c-5421-47c3-b271-c3b266b57fec tempest-DeleteServersTestJSON-1018435513 tempest-DeleteServersTestJSON-1018435513-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1b68210460>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:620828e2-bcb2-4fe0-be02-1cbd76c74b77', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'POYBjktw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75045) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 23:17:58 user nova-compute[75045]: WARNING os_brick.initiator.connectors.base [None req-099dcd3c-5421-47c3-b271-c3b266b57fec tempest-DeleteServersTestJSON-1018435513 tempest-DeleteServersTestJSON-1018435513-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 23:17:58 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-099dcd3c-5421-47c3-b271-c3b266b57fec tempest-DeleteServersTestJSON-1018435513 tempest-DeleteServersTestJSON-1018435513-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 23:17:58 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-099dcd3c-5421-47c3-b271-c3b266b57fec tempest-DeleteServersTestJSON-1018435513 tempest-DeleteServersTestJSON-1018435513-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 23:17:58 user nova-compute[75045]: WARNING os_brick.initiator.connectors.base [None req-099dcd3c-5421-47c3-b271-c3b266b57fec tempest-DeleteServersTestJSON-1018435513 tempest-DeleteServersTestJSON-1018435513-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 23:17:58 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-099dcd3c-5421-47c3-b271-c3b266b57fec tempest-DeleteServersTestJSON-1018435513 tempest-DeleteServersTestJSON-1018435513-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:620828e2-bcb2-4fe0-be02-1cbd76c74b77" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 23:17:58 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-099dcd3c-5421-47c3-b271-c3b266b57fec tempest-DeleteServersTestJSON-1018435513 tempest-DeleteServersTestJSON-1018435513-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:620828e2-bcb2-4fe0-be02-1cbd76c74b77" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 23:17:58 user nova-compute[75045]: INFO os_brick.initiator.connectors.iscsi [None req-099dcd3c-5421-47c3-b271-c3b266b57fec tempest-DeleteServersTestJSON-1018435513 tempest-DeleteServersTestJSON-1018435513-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 23:17:58 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:620828e2-bcb2-4fe0-be02-1cbd76c74b77 -p 172.16.0.220:3260 {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:17:58 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:620828e2-bcb2-4fe0-be02-1cbd76c74b77 -p 172.16.0.220:3260" returned: 21 in 0.025s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:17:58 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa707543-cd94-4870-97c1-0f0665d2289d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:17:58 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-099dcd3c-5421-47c3-b271-c3b266b57fec tempest-DeleteServersTestJSON-1018435513 tempest-DeleteServersTestJSON-1018435513-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 23:17:58 user nova-compute[75045]:  {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:17:58 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:620828e2-bcb2-4fe0-be02-1cbd76c74b77 -p 172.16.0.220:3260 --interface default --op new {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:17:58 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:620828e2-bcb2-4fe0-be02-1cbd76c74b77 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:17:58 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[5df79377-0ee2-4152-985e-7a3418ab99cd]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:620828e2-bcb2-4fe0-be02-1cbd76c74b77] added\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:17:58 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-099dcd3c-5421-47c3-b271-c3b266b57fec tempest-DeleteServersTestJSON-1018435513 tempest-DeleteServersTestJSON-1018435513-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:620828e2-bcb2-4fe0-be02-1cbd76c74b77] added
Nov 08 23:17:58 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:17:58 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:620828e2-bcb2-4fe0-be02-1cbd76c74b77 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:17:58 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:620828e2-bcb2-4fe0-be02-1cbd76c74b77 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:17:58 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a8aab7f-1aa8-4937-9340-8eb07e1c45f7]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:17:58 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-099dcd3c-5421-47c3-b271-c3b266b57fec tempest-DeleteServersTestJSON-1018435513 tempest-DeleteServersTestJSON-1018435513-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:17:58 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:620828e2-bcb2-4fe0-be02-1cbd76c74b77 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:17:58 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:620828e2-bcb2-4fe0-be02-1cbd76c74b77 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:17:58 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[f78a379c-46e8-42be-bf41-27142802f593]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:17:58 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-099dcd3c-5421-47c3-b271-c3b266b57fec tempest-DeleteServersTestJSON-1018435513 tempest-DeleteServersTestJSON-1018435513-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:17:58 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:620828e2-bcb2-4fe0-be02-1cbd76c74b77 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v POYBjktw {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:17:58 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:620828e2-bcb2-4fe0-be02-1cbd76c74b77 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v POYBjktw" returned: 0 in 0.032s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:17:58 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dce631d-adbb-4efd-9992-df960c6ac07e]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:17:58 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-099dcd3c-5421-47c3-b271-c3b266b57fec tempest-DeleteServersTestJSON-1018435513 tempest-DeleteServersTestJSON-1018435513-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'POYBjktw'): stdout= stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:17:58 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:620828e2-bcb2-4fe0-be02-1cbd76c74b77 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:17:58 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:620828e2-bcb2-4fe0-be02-1cbd76c74b77 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:17:58 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[920cca3e-8a1e-47ea-858d-fba83dcb0383]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:17:58 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-099dcd3c-5421-47c3-b271-c3b266b57fec tempest-DeleteServersTestJSON-1018435513 tempest-DeleteServersTestJSON-1018435513-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:17:58 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:17:59 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:17:59 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f99431f-160e-42f1-80a2-e1ea5d5bcea1]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2068946-d374-45a4-9850-e3a690b13ef4 (non-flash)\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:17:59 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-099dcd3c-5421-47c3-b271-c3b266b57fec tempest-DeleteServersTestJSON-1018435513 tempest-DeleteServersTestJSON-1018435513-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2068946-d374-45a4-9850-e3a690b13ef4 (non-flash)
Nov 08 23:17:59 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 23:17:59 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-099dcd3c-5421-47c3-b271-c3b266b57fec tempest-DeleteServersTestJSON-1018435513 tempest-DeleteServersTestJSON-1018435513-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2068946-d374-45a4-9850-e3a690b13ef4 (non-flash)
Nov 08 23:17:59 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 23:17:59 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:620828e2-bcb2-4fe0-be02-1cbd76c74b77 -p 172.16.0.220:3260 --login {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:17:59 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:620828e2-bcb2-4fe0-be02-1cbd76c74b77 -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:17:59 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[25dcb8d3-a7d7-4f96-913d-c04fda0b4994]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:620828e2-bcb2-4fe0-be02-1cbd76c74b77, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:620828e2-bcb2-4fe0-be02-1cbd76c74b77, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:17:59 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-099dcd3c-5421-47c3-b271-c3b266b57fec tempest-DeleteServersTestJSON-1018435513 tempest-DeleteServersTestJSON-1018435513-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:620828e2-bcb2-4fe0-be02-1cbd76c74b77, portal: 172.16.0.220,3260]
Nov 08 23:17:59 user nova-compute[75045]: Login to [iface: default, target: iqn.2010-10.org.openstack:620828e2-bcb2-4fe0-be02-1cbd76c74b77, portal: 172.16.0.220,3260] successful.
Nov 08 23:17:59 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:17:59 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:620828e2-bcb2-4fe0-be02-1cbd76c74b77 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:17:59 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:620828e2-bcb2-4fe0-be02-1cbd76c74b77 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:17:59 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[797d9ed7-0fd5-41de-83a9-5d1f8d83a6b8]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:17:59 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-099dcd3c-5421-47c3-b271-c3b266b57fec tempest-DeleteServersTestJSON-1018435513 tempest-DeleteServersTestJSON-1018435513-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:17:59 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:17:59 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:17:59 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[a79753a0-2b60-416a-a081-6a7eee859fe5]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2068946-d374-45a4-9850-e3a690b13ef4 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:620828e2-bcb2-4fe0-be02-1cbd76c74b77 (non-flash)\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:17:59 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-099dcd3c-5421-47c3-b271-c3b266b57fec tempest-DeleteServersTestJSON-1018435513 tempest-DeleteServersTestJSON-1018435513-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2068946-d374-45a4-9850-e3a690b13ef4 (non-flash)
Nov 08 23:17:59 user nova-compute[75045]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:620828e2-bcb2-4fe0-be02-1cbd76c74b77 (non-flash)
Nov 08 23:17:59 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 23:17:59 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-099dcd3c-5421-47c3-b271-c3b266b57fec tempest-DeleteServersTestJSON-1018435513 tempest-DeleteServersTestJSON-1018435513-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2068946-d374-45a4-9850-e3a690b13ef4 (non-flash)
Nov 08 23:17:59 user nova-compute[75045]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:620828e2-bcb2-4fe0-be02-1cbd76c74b77 (non-flash)
Nov 08 23:17:59 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 23:17:59 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-099dcd3c-5421-47c3-b271-c3b266b57fec tempest-DeleteServersTestJSON-1018435513 tempest-DeleteServersTestJSON-1018435513-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:620828e2-bcb2-4fe0-be02-1cbd76c74b77" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.328s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 23:17:59 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-099dcd3c-5421-47c3-b271-c3b266b57fec tempest-DeleteServersTestJSON-1018435513 tempest-DeleteServersTestJSON-1018435513-project-member] Connected to 172.16.0.220:3260 {{(pid=75045) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 23:17:59 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-099dcd3c-5421-47c3-b271-c3b266b57fec tempest-DeleteServersTestJSON-1018435513 tempest-DeleteServersTestJSON-1018435513-project-member] HCTL ('34', '-', '-', 0) found on session 3 with lun 0 {{(pid=75045) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 23:17:59 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-099dcd3c-5421-47c3-b271-c3b266b57fec tempest-DeleteServersTestJSON-1018435513 tempest-DeleteServersTestJSON-1018435513-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75045) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 23:17:59 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:17:59 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.020s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:17:59 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[c20bbc8d-d419-44a9-9c1a-c82d4511d416]: (4, ('- - 0', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:17:59 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-099dcd3c-5421-47c3-b271-c3b266b57fec tempest-DeleteServersTestJSON-1018435513 tempest-DeleteServersTestJSON-1018435513-project-member] Searching for a device in session 3 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75045) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 23:17:59 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-099dcd3c-5421-47c3-b271-c3b266b57fec tempest-DeleteServersTestJSON-1018435513 tempest-DeleteServersTestJSON-1018435513-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:620828e2-bcb2-4fe0-be02-1cbd76c74b77', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'POYBjktw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75045) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 23:17:59 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-e5bbf3c5-97db-43fa-af36-8e76c991adbc tempest-TaggedAttachmentsTest-1639503389 tempest-TaggedAttachmentsTest-1639503389-project-member] Acquiring lock "interface-1cb1b440-0073-4a53-a0a2-e2781e021866-None" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:17:59 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-e5bbf3c5-97db-43fa-af36-8e76c991adbc tempest-TaggedAttachmentsTest-1639503389 tempest-TaggedAttachmentsTest-1639503389-project-member] Lock "interface-1cb1b440-0073-4a53-a0a2-e2781e021866-None" acquired by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:17:59 user nova-compute[75045]: DEBUG nova.objects.instance [None req-e5bbf3c5-97db-43fa-af36-8e76c991adbc tempest-TaggedAttachmentsTest-1639503389 tempest-TaggedAttachmentsTest-1639503389-project-member] Lazy-loading 'flavor' on Instance uuid 1cb1b440-0073-4a53-a0a2-e2781e021866 {{(pid=75045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 23:17:59 user nova-compute[75045]: DEBUG nova.compute.manager [req-4da0fc19-9cdb-4e44-ba1e-4e55992ddcbd req-496bbf13-f5aa-4cf0-bae8-bc4df1cf212b service nova] [instance: 1cb1b440-0073-4a53-a0a2-e2781e021866] Received event network-changed-892284f7-b4b9-4b5b-82c7-62300cd8afb7 {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:17:59 user nova-compute[75045]: DEBUG nova.compute.manager [req-4da0fc19-9cdb-4e44-ba1e-4e55992ddcbd req-496bbf13-f5aa-4cf0-bae8-bc4df1cf212b service nova] [instance: 1cb1b440-0073-4a53-a0a2-e2781e021866] Refreshing instance network info cache due to event network-changed-892284f7-b4b9-4b5b-82c7-62300cd8afb7. {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 23:17:59 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-4da0fc19-9cdb-4e44-ba1e-4e55992ddcbd req-496bbf13-f5aa-4cf0-bae8-bc4df1cf212b service nova] Acquiring lock "refresh_cache-1cb1b440-0073-4a53-a0a2-e2781e021866" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 23:17:59 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-4da0fc19-9cdb-4e44-ba1e-4e55992ddcbd req-496bbf13-f5aa-4cf0-bae8-bc4df1cf212b service nova] Acquired lock "refresh_cache-1cb1b440-0073-4a53-a0a2-e2781e021866" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 23:17:59 user nova-compute[75045]: DEBUG nova.network.neutron [req-4da0fc19-9cdb-4e44-ba1e-4e55992ddcbd req-496bbf13-f5aa-4cf0-bae8-bc4df1cf212b service nova] [instance: 1cb1b440-0073-4a53-a0a2-e2781e021866] Refreshing network info cache for port 892284f7-b4b9-4b5b-82c7-62300cd8afb7 {{(pid=75045) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 23:17:59 user nova-compute[75045]: DEBUG nova.objects.instance [None req-e5bbf3c5-97db-43fa-af36-8e76c991adbc tempest-TaggedAttachmentsTest-1639503389 tempest-TaggedAttachmentsTest-1639503389-project-member] Lazy-loading 'pci_requests' on Instance uuid 1cb1b440-0073-4a53-a0a2-e2781e021866 {{(pid=75045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 23:17:59 user nova-compute[75045]: DEBUG nova.objects.base [None req-e5bbf3c5-97db-43fa-af36-8e76c991adbc tempest-TaggedAttachmentsTest-1639503389 tempest-TaggedAttachmentsTest-1639503389-project-member] Object Instance<1cb1b440-0073-4a53-a0a2-e2781e021866> lazy-loaded attributes: flavor,pci_requests {{(pid=75045) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 23:17:59 user nova-compute[75045]: DEBUG nova.network.neutron [None req-e5bbf3c5-97db-43fa-af36-8e76c991adbc tempest-TaggedAttachmentsTest-1639503389 tempest-TaggedAttachmentsTest-1639503389-project-member] [instance: 1cb1b440-0073-4a53-a0a2-e2781e021866] allocate_for_instance() {{(pid=75045) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 23:17:59 user nova-compute[75045]: DEBUG nova.policy [None req-e5bbf3c5-97db-43fa-af36-8e76c991adbc tempest-TaggedAttachmentsTest-1639503389 tempest-TaggedAttachmentsTest-1639503389-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0c8d9cc387dc45d18ad1550ef6d3cfa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb18f0af92ec4de6a1fddb6c77ea030d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75045) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 23:18:00 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-099dcd3c-5421-47c3-b271-c3b266b57fec tempest-DeleteServersTestJSON-1018435513 tempest-DeleteServersTestJSON-1018435513-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.372s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 23:18:00 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-099dcd3c-5421-47c3-b271-c3b266b57fec tempest-DeleteServersTestJSON-1018435513 tempest-DeleteServersTestJSON-1018435513-project-member] <== connect_volume: return (1374ms) {'type': 'block', 'scsi_wwn': '23164353738366230', 'path': '/dev/sdc'} {{(pid=75045) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 23:18:00 user nova-compute[75045]: DEBUG nova.virt.libvirt.volume.iscsi [None req-099dcd3c-5421-47c3-b271-c3b266b57fec tempest-DeleteServersTestJSON-1018435513 tempest-DeleteServersTestJSON-1018435513-project-member] [instance: 09cf15e6-1cec-4c55-b7dd-4311b5f87d32] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23164353738366230', 'path': '/dev/sdc'} {{(pid=75045) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 23:18:00 user nova-compute[75045]: DEBUG nova.objects.instance [None req-099dcd3c-5421-47c3-b271-c3b266b57fec tempest-DeleteServersTestJSON-1018435513 tempest-DeleteServersTestJSON-1018435513-project-member] Lazy-loading 'flavor' on Instance uuid 09cf15e6-1cec-4c55-b7dd-4311b5f87d32 {{(pid=75045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 23:18:00 user nova-compute[75045]: DEBUG nova.virt.libvirt.guest [None req-099dcd3c-5421-47c3-b271-c3b266b57fec tempest-DeleteServersTestJSON-1018435513 tempest-DeleteServersTestJSON-1018435513-project-member] attach device xml: <disk type="block" device="disk">
Nov 08 23:18:00 user nova-compute[75045]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 23:18:00 user nova-compute[75045]:   <source dev="/dev/sdc"/>
Nov 08 23:18:00 user nova-compute[75045]:   <target dev="vdb" bus="virtio"/>
Nov 08 23:18:00 user nova-compute[75045]:   <serial>620828e2-bcb2-4fe0-be02-1cbd76c74b77</serial>
Nov 08 23:18:00 user nova-compute[75045]: </disk>
Nov 08 23:18:00 user nova-compute[75045]:  {{(pid=75045) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 08 23:18:00 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:18:00 user nova-compute[75045]: DEBUG nova.network.neutron [None req-e5bbf3c5-97db-43fa-af36-8e76c991adbc tempest-TaggedAttachmentsTest-1639503389 tempest-TaggedAttachmentsTest-1639503389-project-member] [instance: 1cb1b440-0073-4a53-a0a2-e2781e021866] Successfully created port: 2baf0a88-fd3e-45ae-95f8-9d568be4211b {{(pid=75045) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 23:18:00 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-099dcd3c-5421-47c3-b271-c3b266b57fec tempest-DeleteServersTestJSON-1018435513 tempest-DeleteServersTestJSON-1018435513-project-member] No BDM found with device name vda, not building metadata. {{(pid=75045) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 23:18:00 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-099dcd3c-5421-47c3-b271-c3b266b57fec tempest-DeleteServersTestJSON-1018435513 tempest-DeleteServersTestJSON-1018435513-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75045) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 23:18:00 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-099dcd3c-5421-47c3-b271-c3b266b57fec tempest-DeleteServersTestJSON-1018435513 tempest-DeleteServersTestJSON-1018435513-project-member] No VIF found with MAC fa:16:3e:3e:0e:1d, not building metadata {{(pid=75045) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 23:18:00 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-099dcd3c-5421-47c3-b271-c3b266b57fec tempest-DeleteServersTestJSON-1018435513 tempest-DeleteServersTestJSON-1018435513-project-member] Lock "09cf15e6-1cec-4c55-b7dd-4311b5f87d32" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 27.598s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:18:01 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-acf7f888-75c1-4764-a679-61493c54e5ab tempest-AttachSCSIVolumeTestJSON-1576344526 tempest-AttachSCSIVolumeTestJSON-1576344526-project-member] Acquiring lock "b9bd3096-92eb-4aae-8619-2725ed9acc2b" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:18:01 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-acf7f888-75c1-4764-a679-61493c54e5ab tempest-AttachSCSIVolumeTestJSON-1576344526 tempest-AttachSCSIVolumeTestJSON-1576344526-project-member] Lock "b9bd3096-92eb-4aae-8619-2725ed9acc2b" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:18:01 user nova-compute[75045]: DEBUG nova.objects.instance [None req-acf7f888-75c1-4764-a679-61493c54e5ab tempest-AttachSCSIVolumeTestJSON-1576344526 tempest-AttachSCSIVolumeTestJSON-1576344526-project-member] Lazy-loading 'flavor' on Instance uuid b9bd3096-92eb-4aae-8619-2725ed9acc2b {{(pid=75045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 23:18:01 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-acf7f888-75c1-4764-a679-61493c54e5ab tempest-AttachSCSIVolumeTestJSON-1576344526 tempest-AttachSCSIVolumeTestJSON-1576344526-project-member] Lock "b9bd3096-92eb-4aae-8619-2725ed9acc2b" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.104s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:18:01 user nova-compute[75045]: DEBUG nova.network.neutron [req-4da0fc19-9cdb-4e44-ba1e-4e55992ddcbd req-496bbf13-f5aa-4cf0-bae8-bc4df1cf212b service nova] [instance: 1cb1b440-0073-4a53-a0a2-e2781e021866] Updated VIF entry in instance network info cache for port 892284f7-b4b9-4b5b-82c7-62300cd8afb7. {{(pid=75045) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 23:18:01 user nova-compute[75045]: DEBUG nova.network.neutron [req-4da0fc19-9cdb-4e44-ba1e-4e55992ddcbd req-496bbf13-f5aa-4cf0-bae8-bc4df1cf212b service nova] [instance: 1cb1b440-0073-4a53-a0a2-e2781e021866] Updating instance_info_cache with network_info: [{"id": "892284f7-b4b9-4b5b-82c7-62300cd8afb7", "address": "fa:16:3e:e4:4d:f8", "network": {"id": "fa6f2c92-825d-46c6-a0ea-51f96da244cb", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-193868289-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.235", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb18f0af92ec4de6a1fddb6c77ea030d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap892284f7-b4", "ovs_interfaceid": "892284f7-b4b9-4b5b-82c7-62300cd8afb7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75045) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 23:18:01 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-4da0fc19-9cdb-4e44-ba1e-4e55992ddcbd req-496bbf13-f5aa-4cf0-bae8-bc4df1cf212b service nova] Releasing lock "refresh_cache-1cb1b440-0073-4a53-a0a2-e2781e021866" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 23:18:01 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-acf7f888-75c1-4764-a679-61493c54e5ab tempest-AttachSCSIVolumeTestJSON-1576344526 tempest-AttachSCSIVolumeTestJSON-1576344526-project-member] Acquiring lock "b9bd3096-92eb-4aae-8619-2725ed9acc2b" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:18:01 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-acf7f888-75c1-4764-a679-61493c54e5ab tempest-AttachSCSIVolumeTestJSON-1576344526 tempest-AttachSCSIVolumeTestJSON-1576344526-project-member] Lock "b9bd3096-92eb-4aae-8619-2725ed9acc2b" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:18:01 user nova-compute[75045]: INFO nova.compute.manager [None req-acf7f888-75c1-4764-a679-61493c54e5ab tempest-AttachSCSIVolumeTestJSON-1576344526 tempest-AttachSCSIVolumeTestJSON-1576344526-project-member] [instance: b9bd3096-92eb-4aae-8619-2725ed9acc2b] Attaching volume 8c532e3b-4f3c-4809-bd49-fd7c2ea7f6cd to /dev/sdc
Nov 08 23:18:01 user nova-compute[75045]: DEBUG nova.network.neutron [None req-e5bbf3c5-97db-43fa-af36-8e76c991adbc tempest-TaggedAttachmentsTest-1639503389 tempest-TaggedAttachmentsTest-1639503389-project-member] [instance: 1cb1b440-0073-4a53-a0a2-e2781e021866] Successfully updated port: 2baf0a88-fd3e-45ae-95f8-9d568be4211b {{(pid=75045) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 23:18:01 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-e5bbf3c5-97db-43fa-af36-8e76c991adbc tempest-TaggedAttachmentsTest-1639503389 tempest-TaggedAttachmentsTest-1639503389-project-member] Acquiring lock "refresh_cache-1cb1b440-0073-4a53-a0a2-e2781e021866" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 23:18:01 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-e5bbf3c5-97db-43fa-af36-8e76c991adbc tempest-TaggedAttachmentsTest-1639503389 tempest-TaggedAttachmentsTest-1639503389-project-member] Acquired lock "refresh_cache-1cb1b440-0073-4a53-a0a2-e2781e021866" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 23:18:01 user nova-compute[75045]: DEBUG nova.network.neutron [None req-e5bbf3c5-97db-43fa-af36-8e76c991adbc tempest-TaggedAttachmentsTest-1639503389 tempest-TaggedAttachmentsTest-1639503389-project-member] [instance: 1cb1b440-0073-4a53-a0a2-e2781e021866] Building network info cache for instance {{(pid=75045) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 23:18:01 user nova-compute[75045]: DEBUG os_brick.utils [None req-acf7f888-75c1-4764-a679-61493c54e5ab tempest-AttachSCSIVolumeTestJSON-1576344526 tempest-AttachSCSIVolumeTestJSON-1576344526-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75045) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 23:18:01 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:18:01 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:18:01 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[a225bec1-7408-4489-982a-cf1d3640513b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6217bd6e884\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:18:01 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:18:01 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:18:01 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[e86df0b1-8c7e-42c3-b96a-5685a677608b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:18:01 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:18:01 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:18:01 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[1060ca59-f8eb-467c-b744-9e4d53833537]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:18:01 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9d30e3c-515a-437d-9289-81e75d704e41]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:18:01 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-acf7f888-75c1-4764-a679-61493c54e5ab tempest-AttachSCSIVolumeTestJSON-1576344526 tempest-AttachSCSIVolumeTestJSON-1576344526-project-member] Running cmd (subprocess): nvme version {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:18:01 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-acf7f888-75c1-4764-a679-61493c54e5ab tempest-AttachSCSIVolumeTestJSON-1576344526 tempest-AttachSCSIVolumeTestJSON-1576344526-project-member] 'nvme version' failed. Not Retrying. {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 23:18:01 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.nvmeof [None req-acf7f888-75c1-4764-a679-61493c54e5ab tempest-AttachSCSIVolumeTestJSON-1576344526 tempest-AttachSCSIVolumeTestJSON-1576344526-project-member] nvme not present on system {{(pid=75045) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 23:18:01 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:18:01 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 23:18:01 user nova-compute[75045]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 23:18:01 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[efce1f24-4e08-46d1-b146-440b35d8fbf6]: (4, '') {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:18:01 user nova-compute[75045]: DEBUG nova.compute.manager [req-e2ed1890-c070-4ea6-b4fd-9b50b9ae3ae5 req-c26b1493-92dd-40d8-8076-43115ce2dd2f service nova] [instance: 1cb1b440-0073-4a53-a0a2-e2781e021866] Received event network-changed-2baf0a88-fd3e-45ae-95f8-9d568be4211b {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:18:01 user nova-compute[75045]: DEBUG nova.compute.manager [req-e2ed1890-c070-4ea6-b4fd-9b50b9ae3ae5 req-c26b1493-92dd-40d8-8076-43115ce2dd2f service nova] [instance: 1cb1b440-0073-4a53-a0a2-e2781e021866] Refreshing instance network info cache due to event network-changed-2baf0a88-fd3e-45ae-95f8-9d568be4211b. {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 23:18:01 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-e2ed1890-c070-4ea6-b4fd-9b50b9ae3ae5 req-c26b1493-92dd-40d8-8076-43115ce2dd2f service nova] Acquiring lock "refresh_cache-1cb1b440-0073-4a53-a0a2-e2781e021866" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 23:18:01 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.lightos [None req-acf7f888-75c1-4764-a679-61493c54e5ab tempest-AttachSCSIVolumeTestJSON-1576344526 tempest-AttachSCSIVolumeTestJSON-1576344526-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75045) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 23:18:01 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.lightos [None req-acf7f888-75c1-4764-a679-61493c54e5ab tempest-AttachSCSIVolumeTestJSON-1576344526 tempest-AttachSCSIVolumeTestJSON-1576344526-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75045) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 23:18:01 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.lightos [None req-acf7f888-75c1-4764-a679-61493c54e5ab tempest-AttachSCSIVolumeTestJSON-1576344526 tempest-AttachSCSIVolumeTestJSON-1576344526-project-member] LIGHTOS: no hostnqn found. {{(pid=75045) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 23:18:01 user nova-compute[75045]: DEBUG os_brick.utils [None req-acf7f888-75c1-4764-a679-61493c54e5ab tempest-AttachSCSIVolumeTestJSON-1576344526 tempest-AttachSCSIVolumeTestJSON-1576344526-project-member] <== get_connector_properties: return (171ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6217bd6e884', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75045) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 23:18:01 user nova-compute[75045]: DEBUG nova.virt.block_device [None req-acf7f888-75c1-4764-a679-61493c54e5ab tempest-AttachSCSIVolumeTestJSON-1576344526 tempest-AttachSCSIVolumeTestJSON-1576344526-project-member] [instance: b9bd3096-92eb-4aae-8619-2725ed9acc2b] Updating existing volume attachment record: 60883c95-3c04-4aaa-8b00-e55584d9143f {{(pid=75045) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 23:18:01 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-70ab85f2-9ee9-424d-bd5a-9f0752bc2c51 tempest-DeleteServersTestJSON-1018435513 tempest-DeleteServersTestJSON-1018435513-project-member] Acquiring lock "09cf15e6-1cec-4c55-b7dd-4311b5f87d32" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:18:01 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-70ab85f2-9ee9-424d-bd5a-9f0752bc2c51 tempest-DeleteServersTestJSON-1018435513 tempest-DeleteServersTestJSON-1018435513-project-member] Lock "09cf15e6-1cec-4c55-b7dd-4311b5f87d32" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:18:01 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-70ab85f2-9ee9-424d-bd5a-9f0752bc2c51 tempest-DeleteServersTestJSON-1018435513 tempest-DeleteServersTestJSON-1018435513-project-member] Acquiring lock "09cf15e6-1cec-4c55-b7dd-4311b5f87d32-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:18:01 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-70ab85f2-9ee9-424d-bd5a-9f0752bc2c51 tempest-DeleteServersTestJSON-1018435513 tempest-DeleteServersTestJSON-1018435513-project-member] Lock "09cf15e6-1cec-4c55-b7dd-4311b5f87d32-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:18:01 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-70ab85f2-9ee9-424d-bd5a-9f0752bc2c51 tempest-DeleteServersTestJSON-1018435513 tempest-DeleteServersTestJSON-1018435513-project-member] Lock "09cf15e6-1cec-4c55-b7dd-4311b5f87d32-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:18:01 user nova-compute[75045]: INFO nova.compute.manager [None req-70ab85f2-9ee9-424d-bd5a-9f0752bc2c51 tempest-DeleteServersTestJSON-1018435513 tempest-DeleteServersTestJSON-1018435513-project-member] [instance: 09cf15e6-1cec-4c55-b7dd-4311b5f87d32] Terminating instance
Nov 08 23:18:01 user nova-compute[75045]: DEBUG nova.compute.manager [None req-70ab85f2-9ee9-424d-bd5a-9f0752bc2c51 tempest-DeleteServersTestJSON-1018435513 tempest-DeleteServersTestJSON-1018435513-project-member] [instance: 09cf15e6-1cec-4c55-b7dd-4311b5f87d32] Start destroying the instance on the hypervisor. {{(pid=75045) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 23:18:01 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:18:01 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:18:01 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:18:01 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:18:02 user nova-compute[75045]: DEBUG nova.compute.manager [req-bb4d5a53-55b7-4046-8a5d-deb4d96c0f10 req-c62b0d08-5d1c-4d35-99c5-b762eb1553cd service nova] [instance: fde91f7c-31e3-456c-b252-6ce37fa3b600] Received event network-changed-cf7f2506-395a-4404-a256-6600a5c0a06e {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:18:02 user nova-compute[75045]: DEBUG nova.compute.manager [req-bb4d5a53-55b7-4046-8a5d-deb4d96c0f10 req-c62b0d08-5d1c-4d35-99c5-b762eb1553cd service nova] [instance: fde91f7c-31e3-456c-b252-6ce37fa3b600] Refreshing instance network info cache due to event network-changed-cf7f2506-395a-4404-a256-6600a5c0a06e. {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 23:18:02 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-bb4d5a53-55b7-4046-8a5d-deb4d96c0f10 req-c62b0d08-5d1c-4d35-99c5-b762eb1553cd service nova] Acquiring lock "refresh_cache-fde91f7c-31e3-456c-b252-6ce37fa3b600" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 23:18:02 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-bb4d5a53-55b7-4046-8a5d-deb4d96c0f10 req-c62b0d08-5d1c-4d35-99c5-b762eb1553cd service nova] Acquired lock "refresh_cache-fde91f7c-31e3-456c-b252-6ce37fa3b600" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 23:18:02 user nova-compute[75045]: DEBUG nova.network.neutron [req-bb4d5a53-55b7-4046-8a5d-deb4d96c0f10 req-c62b0d08-5d1c-4d35-99c5-b762eb1553cd service nova] [instance: fde91f7c-31e3-456c-b252-6ce37fa3b600] Refreshing network info cache for port cf7f2506-395a-4404-a256-6600a5c0a06e {{(pid=75045) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 23:18:02 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-ab95380e-7bf8-4df0-b646-129b1e213962 tempest-TestVolumeSwap-1282852572 tempest-TestVolumeSwap-1282852572-project-member] Acquiring lock "fde91f7c-31e3-456c-b252-6ce37fa3b600" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:18:02 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-ab95380e-7bf8-4df0-b646-129b1e213962 tempest-TestVolumeSwap-1282852572 tempest-TestVolumeSwap-1282852572-project-member] Lock "fde91f7c-31e3-456c-b252-6ce37fa3b600" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:18:02 user nova-compute[75045]: DEBUG nova.objects.instance [None req-ab95380e-7bf8-4df0-b646-129b1e213962 tempest-TestVolumeSwap-1282852572 tempest-TestVolumeSwap-1282852572-project-member] Lazy-loading 'flavor' on Instance uuid fde91f7c-31e3-456c-b252-6ce37fa3b600 {{(pid=75045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 23:18:02 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-ab95380e-7bf8-4df0-b646-129b1e213962 tempest-TestVolumeSwap-1282852572 tempest-TestVolumeSwap-1282852572-project-member] Lock "fde91f7c-31e3-456c-b252-6ce37fa3b600" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.079s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:18:02 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:18:02 user nova-compute[75045]: INFO nova.virt.libvirt.driver [-] [instance: 09cf15e6-1cec-4c55-b7dd-4311b5f87d32] Instance destroyed successfully.
Nov 08 23:18:02 user nova-compute[75045]: DEBUG nova.objects.instance [None req-70ab85f2-9ee9-424d-bd5a-9f0752bc2c51 tempest-DeleteServersTestJSON-1018435513 tempest-DeleteServersTestJSON-1018435513-project-member] Lazy-loading 'resources' on Instance uuid 09cf15e6-1cec-4c55-b7dd-4311b5f87d32 {{(pid=75045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 23:18:02 user nova-compute[75045]: DEBUG nova.virt.libvirt.vif [None req-70ab85f2-9ee9-424d-bd5a-9f0752bc2c51 tempest-DeleteServersTestJSON-1018435513 tempest-DeleteServersTestJSON-1018435513-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T23:15:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-836211320',display_name='tempest-DeleteServersTestJSON-server-836211320',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-836211320',id=2,image_ref='a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-08T23:15:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ec0b8a91a6ba43e6836d226ba9528100',ramdisk_id='',reservation_id='r-jrw85gqg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-DeleteServersTestJSON-1018435513',owner_user_name='tempest-DeleteServersTestJSON-1018435513-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T23:15:49Z,user_data=None,user_id='4867afafcd4f48728d45af6ccdc40aaa',uuid=09cf15e6-1cec-4c55-b7dd-4311b5f87d32,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a270cac5-2b8d-4eb7-a5ed-9338e6bb5e22", "address": "fa:16:3e:3e:0e:1d", "network": {"id": "8137fd46-49da-40ca-81e8-4ad6984ee6ae", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-668291672-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec0b8a91a6ba43e6836d226ba9528100", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa270cac5-2b", "ovs_interfaceid": "a270cac5-2b8d-4eb7-a5ed-9338e6bb5e22", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75045) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 23:18:02 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-70ab85f2-9ee9-424d-bd5a-9f0752bc2c51 tempest-DeleteServersTestJSON-1018435513 tempest-DeleteServersTestJSON-1018435513-project-member] Converting VIF {"id": "a270cac5-2b8d-4eb7-a5ed-9338e6bb5e22", "address": "fa:16:3e:3e:0e:1d", "network": {"id": "8137fd46-49da-40ca-81e8-4ad6984ee6ae", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-668291672-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec0b8a91a6ba43e6836d226ba9528100", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa270cac5-2b", "ovs_interfaceid": "a270cac5-2b8d-4eb7-a5ed-9338e6bb5e22", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 23:18:02 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-70ab85f2-9ee9-424d-bd5a-9f0752bc2c51 tempest-DeleteServersTestJSON-1018435513 tempest-DeleteServersTestJSON-1018435513-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3e:0e:1d,bridge_name='br-int',has_traffic_filtering=True,id=a270cac5-2b8d-4eb7-a5ed-9338e6bb5e22,network=Network(8137fd46-49da-40ca-81e8-4ad6984ee6ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa270cac5-2b') {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 23:18:02 user nova-compute[75045]: DEBUG os_vif [None req-70ab85f2-9ee9-424d-bd5a-9f0752bc2c51 tempest-DeleteServersTestJSON-1018435513 tempest-DeleteServersTestJSON-1018435513-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:3e:0e:1d,bridge_name='br-int',has_traffic_filtering=True,id=a270cac5-2b8d-4eb7-a5ed-9338e6bb5e22,network=Network(8137fd46-49da-40ca-81e8-4ad6984ee6ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa270cac5-2b') {{(pid=75045) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 23:18:02 user nova-compute[75045]: DEBUG nova.network.neutron [None req-e5bbf3c5-97db-43fa-af36-8e76c991adbc tempest-TaggedAttachmentsTest-1639503389 tempest-TaggedAttachmentsTest-1639503389-project-member] [instance: 1cb1b440-0073-4a53-a0a2-e2781e021866] Updating instance_info_cache with network_info: [{"id": "892284f7-b4b9-4b5b-82c7-62300cd8afb7", "address": "fa:16:3e:e4:4d:f8", "network": {"id": "fa6f2c92-825d-46c6-a0ea-51f96da244cb", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-193868289-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.235", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb18f0af92ec4de6a1fddb6c77ea030d", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap892284f7-b4", "ovs_interfaceid": "892284f7-b4b9-4b5b-82c7-62300cd8afb7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2baf0a88-fd3e-45ae-95f8-9d568be4211b", "address": "fa:16:3e:9e:7d:b7", "network": {"id": "3ffe4edb-8137-442f-9c3e-231775c7527c", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1585434856", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.184", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "bb18f0af92ec4de6a1fddb6c77ea030d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2baf0a88-fd", "ovs_interfaceid": "2baf0a88-fd3e-45ae-95f8-9d568be4211b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75045) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 23:18:02 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:18:02 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa270cac5-2b, bridge=br-int, if_exists=True) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:18:02 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:18:02 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 23:18:02 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:18:02 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=909bbde9-cd81-44b1-a6a0-272a6e630574) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:18:02 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:18:02 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:18:02 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-e5bbf3c5-97db-43fa-af36-8e76c991adbc tempest-TaggedAttachmentsTest-1639503389 tempest-TaggedAttachmentsTest-1639503389-project-member] Releasing lock "refresh_cache-1cb1b440-0073-4a53-a0a2-e2781e021866" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 23:18:02 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-e2ed1890-c070-4ea6-b4fd-9b50b9ae3ae5 req-c26b1493-92dd-40d8-8076-43115ce2dd2f service nova] Acquired lock "refresh_cache-1cb1b440-0073-4a53-a0a2-e2781e021866" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 23:18:02 user nova-compute[75045]: DEBUG nova.network.neutron [req-e2ed1890-c070-4ea6-b4fd-9b50b9ae3ae5 req-c26b1493-92dd-40d8-8076-43115ce2dd2f service nova] [instance: 1cb1b440-0073-4a53-a0a2-e2781e021866] Refreshing network info cache for port 2baf0a88-fd3e-45ae-95f8-9d568be4211b {{(pid=75045) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 23:18:02 user nova-compute[75045]: INFO os_vif [None req-70ab85f2-9ee9-424d-bd5a-9f0752bc2c51 tempest-DeleteServersTestJSON-1018435513 tempest-DeleteServersTestJSON-1018435513-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:3e:0e:1d,bridge_name='br-int',has_traffic_filtering=True,id=a270cac5-2b8d-4eb7-a5ed-9338e6bb5e22,network=Network(8137fd46-49da-40ca-81e8-4ad6984ee6ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa270cac5-2b')
Nov 08 23:18:02 user nova-compute[75045]: DEBUG nova.virt.libvirt.vif [None req-e5bbf3c5-97db-43fa-af36-8e76c991adbc tempest-TaggedAttachmentsTest-1639503389 tempest-TaggedAttachmentsTest-1639503389-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T23:16:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1008670319',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1008670319',id=5,image_ref='a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJHwrx1BGWhjjUX4+Byh1wjqwerHxYEs1Bi9i8sP+n0orNMkrqYiTdsqsEt8sTDzFkc1LBM09NOYtbQKa/c7KjqeCNDDUOdBi8LqOWMDeLuYXRRZIoptz+6bpxuTCZMmXg==',key_name='tempest-keypair-1418515873',keypairs=<?>,launch_index=0,launched_at=2023-11-08T23:16:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='bb18f0af92ec4de6a1fddb6c77ea030d',ramdisk_id='',reservation_id='r-15oytm0c',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1639503389',owner_user_name='tempest-TaggedAttachmentsTest-1639503389-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T23:16:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0c8d9cc387dc45d18ad1550ef6d3cfa9',uuid=1cb1b440-0073-4a53-a0a2-e2781e021866,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2baf0a88-fd3e-45ae-95f8-9d568be4211b", "address": "fa:16:3e:9e:7d:b7", "network": {"id": "3ffe4edb-8137-442f-9c3e-231775c7527c", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1585434856", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.184", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "bb18f0af92ec4de6a1fddb6c77ea030d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2baf0a88-fd", "ovs_interfaceid": "2baf0a88-fd3e-45ae-95f8-9d568be4211b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75045) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 23:18:02 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-e5bbf3c5-97db-43fa-af36-8e76c991adbc tempest-TaggedAttachmentsTest-1639503389 tempest-TaggedAttachmentsTest-1639503389-project-member] Converting VIF {"id": "2baf0a88-fd3e-45ae-95f8-9d568be4211b", "address": "fa:16:3e:9e:7d:b7", "network": {"id": "3ffe4edb-8137-442f-9c3e-231775c7527c", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1585434856", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.184", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "bb18f0af92ec4de6a1fddb6c77ea030d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2baf0a88-fd", "ovs_interfaceid": "2baf0a88-fd3e-45ae-95f8-9d568be4211b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 23:18:02 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-e5bbf3c5-97db-43fa-af36-8e76c991adbc tempest-TaggedAttachmentsTest-1639503389 tempest-TaggedAttachmentsTest-1639503389-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9e:7d:b7,bridge_name='br-int',has_traffic_filtering=True,id=2baf0a88-fd3e-45ae-95f8-9d568be4211b,network=Network(3ffe4edb-8137-442f-9c3e-231775c7527c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2baf0a88-fd') {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 23:18:02 user nova-compute[75045]: DEBUG os_vif [None req-e5bbf3c5-97db-43fa-af36-8e76c991adbc tempest-TaggedAttachmentsTest-1639503389 tempest-TaggedAttachmentsTest-1639503389-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9e:7d:b7,bridge_name='br-int',has_traffic_filtering=True,id=2baf0a88-fd3e-45ae-95f8-9d568be4211b,network=Network(3ffe4edb-8137-442f-9c3e-231775c7527c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2baf0a88-fd') {{(pid=75045) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 23:18:02 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:18:02 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:18:02 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 23:18:02 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:18:02 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'bc669752-8537-5439-9cd4-ec452bfc6399', '_type': 'linux-noop'}}, row=False) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:18:02 user nova-compute[75045]: DEBUG nova.virt.libvirt.volume.iscsi [None req-70ab85f2-9ee9-424d-bd5a-9f0752bc2c51 tempest-DeleteServersTestJSON-1018435513 tempest-DeleteServersTestJSON-1018435513-project-member] [instance: 09cf15e6-1cec-4c55-b7dd-4311b5f87d32] calling os-brick to detach iSCSI Volume {{(pid=75045) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 23:18:02 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-70ab85f2-9ee9-424d-bd5a-9f0752bc2c51 tempest-DeleteServersTestJSON-1018435513 tempest-DeleteServersTestJSON-1018435513-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1b68210460>, {'target_iqn': 'iqn.2010-10.org.openstack:620828e2-bcb2-4fe0-be02-1cbd76c74b77', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'POYBjktw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75045) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 23:18:02 user nova-compute[75045]: WARNING os_brick.initiator.connectors.base [None req-70ab85f2-9ee9-424d-bd5a-9f0752bc2c51 tempest-DeleteServersTestJSON-1018435513 tempest-DeleteServersTestJSON-1018435513-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 23:18:02 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-70ab85f2-9ee9-424d-bd5a-9f0752bc2c51 tempest-DeleteServersTestJSON-1018435513 tempest-DeleteServersTestJSON-1018435513-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 23:18:02 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-70ab85f2-9ee9-424d-bd5a-9f0752bc2c51 tempest-DeleteServersTestJSON-1018435513 tempest-DeleteServersTestJSON-1018435513-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 23:18:02 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:18:02 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:18:02 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 23:18:02 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:18:02 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2baf0a88-fd, may_exist=True, interface_attrs={}) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:18:02 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2baf0a88-fd, col_values=(('qos', UUID('9e236a60-cba6-4c7d-b36b-f1a8c6eeea95')),), if_exists=True) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:18:02 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2baf0a88-fd, col_values=(('external_ids', {'iface-id': '2baf0a88-fd3e-45ae-95f8-9d568be4211b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9e:7d:b7', 'vm-uuid': '1cb1b440-0073-4a53-a0a2-e2781e021866'}),), if_exists=True) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:18:02 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:18:02 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.028s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:18:02 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff7c0ecd-7fea-49c8-b115-34feffb3cd91]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:620828e2-bcb2-4fe0-be02-1cbd76c74b77\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d2068946-d374-45a4-9850-e3a690b13ef4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:18:02 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 23:18:02 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-70ab85f2-9ee9-424d-bd5a-9f0752bc2c51 tempest-DeleteServersTestJSON-1018435513 tempest-DeleteServersTestJSON-1018435513-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 23:18:02 user nova-compute[75045]: No targets found.
Nov 08 23:18:02 user nova-compute[75045]: iSNS:
Nov 08 23:18:02 user nova-compute[75045]: No targets found.
Nov 08 23:18:02 user nova-compute[75045]: STATIC:
Nov 08 23:18:02 user nova-compute[75045]: Target: iqn.2010-10.org.openstack:620828e2-bcb2-4fe0-be02-1cbd76c74b77
Nov 08 23:18:02 user nova-compute[75045]:         Portal: 172.16.0.220:3260,-1
Nov 08 23:18:02 user nova-compute[75045]:                 Iface Name: default
Nov 08 23:18:02 user nova-compute[75045]: Target: iqn.2010-10.org.openstack:d2068946-d374-45a4-9850-e3a690b13ef4
Nov 08 23:18:02 user nova-compute[75045]:         Portal: 172.16.0.220:3260,-1
Nov 08 23:18:02 user nova-compute[75045]:                 Iface Name: default
Nov 08 23:18:02 user nova-compute[75045]: FIRMWARE:
Nov 08 23:18:02 user nova-compute[75045]: No targets found.
Nov 08 23:18:02 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 23:18:02 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-70ab85f2-9ee9-424d-bd5a-9f0752bc2c51 tempest-DeleteServersTestJSON-1018435513 tempest-DeleteServersTestJSON-1018435513-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 23:18:02 user nova-compute[75045]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 23:18:02 user nova-compute[75045]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75045) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 23:18:02 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-70ab85f2-9ee9-424d-bd5a-9f0752bc2c51 tempest-DeleteServersTestJSON-1018435513 tempest-DeleteServersTestJSON-1018435513-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:620828e2-bcb2-4fe0-be02-1cbd76c74b77', 0)] {{(pid=75045) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 23:18:02 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:18:02 user nova-compute[75045]: INFO os_vif [None req-e5bbf3c5-97db-43fa-af36-8e76c991adbc tempest-TaggedAttachmentsTest-1639503389 tempest-TaggedAttachmentsTest-1639503389-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9e:7d:b7,bridge_name='br-int',has_traffic_filtering=True,id=2baf0a88-fd3e-45ae-95f8-9d568be4211b,network=Network(3ffe4edb-8137-442f-9c3e-231775c7527c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2baf0a88-fd')
Nov 08 23:18:02 user nova-compute[75045]: DEBUG nova.virt.libvirt.vif [None req-e5bbf3c5-97db-43fa-af36-8e76c991adbc tempest-TaggedAttachmentsTest-1639503389 tempest-TaggedAttachmentsTest-1639503389-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T23:16:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1008670319',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1008670319',id=5,image_ref='a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJHwrx1BGWhjjUX4+Byh1wjqwerHxYEs1Bi9i8sP+n0orNMkrqYiTdsqsEt8sTDzFkc1LBM09NOYtbQKa/c7KjqeCNDDUOdBi8LqOWMDeLuYXRRZIoptz+6bpxuTCZMmXg==',key_name='tempest-keypair-1418515873',keypairs=<?>,launch_index=0,launched_at=2023-11-08T23:16:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='bb18f0af92ec4de6a1fddb6c77ea030d',ramdisk_id='',reservation_id='r-15oytm0c',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1639503389',owner_user_name='tempest-TaggedAttachmentsTest-1639503389-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T23:16:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0c8d9cc387dc45d18ad1550ef6d3cfa9',uuid=1cb1b440-0073-4a53-a0a2-e2781e021866,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2baf0a88-fd3e-45ae-95f8-9d568be4211b", "address": "fa:16:3e:9e:7d:b7", "network": {"id": "3ffe4edb-8137-442f-9c3e-231775c7527c", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1585434856", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.184", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "bb18f0af92ec4de6a1fddb6c77ea030d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2baf0a88-fd", "ovs_interfaceid": "2baf0a88-fd3e-45ae-95f8-9d568be4211b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75045) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 23:18:02 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-e5bbf3c5-97db-43fa-af36-8e76c991adbc tempest-TaggedAttachmentsTest-1639503389 tempest-TaggedAttachmentsTest-1639503389-project-member] Converting VIF {"id": "2baf0a88-fd3e-45ae-95f8-9d568be4211b", "address": "fa:16:3e:9e:7d:b7", "network": {"id": "3ffe4edb-8137-442f-9c3e-231775c7527c", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1585434856", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.184", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "bb18f0af92ec4de6a1fddb6c77ea030d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2baf0a88-fd", "ovs_interfaceid": "2baf0a88-fd3e-45ae-95f8-9d568be4211b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 23:18:02 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-e5bbf3c5-97db-43fa-af36-8e76c991adbc tempest-TaggedAttachmentsTest-1639503389 tempest-TaggedAttachmentsTest-1639503389-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9e:7d:b7,bridge_name='br-int',has_traffic_filtering=True,id=2baf0a88-fd3e-45ae-95f8-9d568be4211b,network=Network(3ffe4edb-8137-442f-9c3e-231775c7527c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2baf0a88-fd') {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 23:18:02 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:18:02 user nova-compute[75045]: DEBUG nova.virt.libvirt.guest [None req-e5bbf3c5-97db-43fa-af36-8e76c991adbc tempest-TaggedAttachmentsTest-1639503389 tempest-TaggedAttachmentsTest-1639503389-project-member] attach device xml: <interface type="ethernet">
Nov 08 23:18:02 user nova-compute[75045]:   <mac address="fa:16:3e:9e:7d:b7"/>
Nov 08 23:18:02 user nova-compute[75045]:   <model type="virtio"/>
Nov 08 23:18:02 user nova-compute[75045]:   <mtu size="1442"/>
Nov 08 23:18:02 user nova-compute[75045]:   <target dev="tap2baf0a88-fd"/>
Nov 08 23:18:02 user nova-compute[75045]: </interface>
Nov 08 23:18:02 user nova-compute[75045]:  {{(pid=75045) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 08 23:18:02 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:18:02 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[61217322-28ab-4473-bf63-f55058355743]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:620828e2-bcb2-4fe0-be02-1cbd76c74b77\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d2068946-d374-45a4-9850-e3a690b13ef4\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:18:02 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:18:02 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:18:02 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.038s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:18:02 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[51bc3a29-c7bb-4be7-ac5b-b27f3ccf6706]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2068946-d374-45a4-9850-e3a690b13ef4 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:620828e2-bcb2-4fe0-be02-1cbd76c74b77 (non-flash)\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:18:02 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-70ab85f2-9ee9-424d-bd5a-9f0752bc2c51 tempest-DeleteServersTestJSON-1018435513 tempest-DeleteServersTestJSON-1018435513-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2068946-d374-45a4-9850-e3a690b13ef4 (non-flash)
Nov 08 23:18:02 user nova-compute[75045]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:620828e2-bcb2-4fe0-be02-1cbd76c74b77 (non-flash)
Nov 08 23:18:02 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 23:18:02 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-70ab85f2-9ee9-424d-bd5a-9f0752bc2c51 tempest-DeleteServersTestJSON-1018435513 tempest-DeleteServersTestJSON-1018435513-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2068946-d374-45a4-9850-e3a690b13ef4 (non-flash)
Nov 08 23:18:02 user nova-compute[75045]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:620828e2-bcb2-4fe0-be02-1cbd76c74b77 (non-flash)
Nov 08 23:18:02 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 23:18:02 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-70ab85f2-9ee9-424d-bd5a-9f0752bc2c51 tempest-DeleteServersTestJSON-1018435513 tempest-DeleteServersTestJSON-1018435513-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1b685e7e20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:620828e2-bcb2-4fe0-be02-1cbd76c74b77'): ({'sdc'}, set())}) {{(pid=75045) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 23:18:02 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-70ab85f2-9ee9-424d-bd5a-9f0752bc2c51 tempest-DeleteServersTestJSON-1018435513 tempest-DeleteServersTestJSON-1018435513-project-member] Removing single pathed devices sdc {{(pid=75045) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 23:18:02 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:18:02 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.029s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:18:02 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a9e15e0-2db9-4f1a-86e8-069b26cbdaa8]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:18:02 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-ab95380e-7bf8-4df0-b646-129b1e213962 tempest-TestVolumeSwap-1282852572 tempest-TestVolumeSwap-1282852572-project-member] Acquiring lock "fde91f7c-31e3-456c-b252-6ce37fa3b600" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:18:02 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-ab95380e-7bf8-4df0-b646-129b1e213962 tempest-TestVolumeSwap-1282852572 tempest-TestVolumeSwap-1282852572-project-member] Lock "fde91f7c-31e3-456c-b252-6ce37fa3b600" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:18:02 user nova-compute[75045]: INFO nova.compute.manager [None req-ab95380e-7bf8-4df0-b646-129b1e213962 tempest-TestVolumeSwap-1282852572 tempest-TestVolumeSwap-1282852572-project-member] [instance: fde91f7c-31e3-456c-b252-6ce37fa3b600] Attaching volume 4d7a4df0-bfc5-4952-8454-97b703b68f28 to /dev/vdb
Nov 08 23:18:02 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:18:02 user nova-compute[75045]: DEBUG nova.compute.manager [req-542a42c2-70b8-4dc5-aeee-6493a78dcac3 req-12a8b8af-8b10-4b31-8aee-7d7524858ecc service nova] [instance: 09cf15e6-1cec-4c55-b7dd-4311b5f87d32] Received event network-vif-unplugged-a270cac5-2b8d-4eb7-a5ed-9338e6bb5e22 {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:18:02 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-542a42c2-70b8-4dc5-aeee-6493a78dcac3 req-12a8b8af-8b10-4b31-8aee-7d7524858ecc service nova] Acquiring lock "09cf15e6-1cec-4c55-b7dd-4311b5f87d32-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:18:02 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-542a42c2-70b8-4dc5-aeee-6493a78dcac3 req-12a8b8af-8b10-4b31-8aee-7d7524858ecc service nova] Lock "09cf15e6-1cec-4c55-b7dd-4311b5f87d32-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:18:02 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-542a42c2-70b8-4dc5-aeee-6493a78dcac3 req-12a8b8af-8b10-4b31-8aee-7d7524858ecc service nova] Lock "09cf15e6-1cec-4c55-b7dd-4311b5f87d32-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:18:02 user nova-compute[75045]: DEBUG nova.compute.manager [req-542a42c2-70b8-4dc5-aeee-6493a78dcac3 req-12a8b8af-8b10-4b31-8aee-7d7524858ecc service nova] [instance: 09cf15e6-1cec-4c55-b7dd-4311b5f87d32] No waiting events found dispatching network-vif-unplugged-a270cac5-2b8d-4eb7-a5ed-9338e6bb5e22 {{(pid=75045) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 23:18:02 user nova-compute[75045]: DEBUG nova.compute.manager [req-542a42c2-70b8-4dc5-aeee-6493a78dcac3 req-12a8b8af-8b10-4b31-8aee-7d7524858ecc service nova] [instance: 09cf15e6-1cec-4c55-b7dd-4311b5f87d32] Received event network-vif-unplugged-a270cac5-2b8d-4eb7-a5ed-9338e6bb5e22 for instance with task_state deleting. {{(pid=75045) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 23:18:02 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:18:02 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.045s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:18:02 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3f7d881-b9a5-4711-a289-d8162d6ac8da]: (4, ('ok\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:18:02 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-70ab85f2-9ee9-424d-bd5a-9f0752bc2c51 tempest-DeleteServersTestJSON-1018435513 tempest-DeleteServersTestJSON-1018435513-project-member] Flushing IO for device /dev/sdc {{(pid=75045) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 23:18:02 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:18:02 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.017s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:18:02 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[36913f2e-7aa1-43ac-8830-450f8106ee01]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:18:02 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-70ab85f2-9ee9-424d-bd5a-9f0752bc2c51 tempest-DeleteServersTestJSON-1018435513 tempest-DeleteServersTestJSON-1018435513-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75045) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 23:18:02 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:18:02 user nova-compute[75045]: DEBUG os_brick.utils [None req-ab95380e-7bf8-4df0-b646-129b1e213962 tempest-TestVolumeSwap-1282852572 tempest-TestVolumeSwap-1282852572-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75045) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 23:18:02 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:18:02 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.054s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:18:02 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[c60d13d3-d94a-41b2-8ddc-39fe4e9cf29c]: (4, ('1', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:18:02 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-70ab85f2-9ee9-424d-bd5a-9f0752bc2c51 tempest-DeleteServersTestJSON-1018435513 tempest-DeleteServersTestJSON-1018435513-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75045) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 23:18:02 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-70ab85f2-9ee9-424d-bd5a-9f0752bc2c51 tempest-DeleteServersTestJSON-1018435513 tempest-DeleteServersTestJSON-1018435513-project-member] SCSI volumes sdc have been removed. {{(pid=75045) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 23:18:03 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-70ab85f2-9ee9-424d-bd5a-9f0752bc2c51 tempest-DeleteServersTestJSON-1018435513 tempest-DeleteServersTestJSON-1018435513-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:620828e2-bcb2-4fe0-be02-1cbd76c74b77')] {{(pid=75045) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 23:18:03 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:620828e2-bcb2-4fe0-be02-1cbd76c74b77 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:18:03 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.046s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:18:03 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[64080a04-9354-44e2-8b40-b95c9249aad3]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6217bd6e884\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:18:03 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:620828e2-bcb2-4fe0-be02-1cbd76c74b77 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.033s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:18:03 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[313d8807-f35c-4a3b-b1de-b7e2c0ee397d]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:18:03 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-70ab85f2-9ee9-424d-bd5a-9f0752bc2c51 tempest-DeleteServersTestJSON-1018435513 tempest-DeleteServersTestJSON-1018435513-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:18:03 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:18:03 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:620828e2-bcb2-4fe0-be02-1cbd76c74b77 -p 172.16.0.220:3260 --logout {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:18:03 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.025s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:18:03 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[308db702-e850-4181-ae4e-5ce5cba1a2fb]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:18:03 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:18:03 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.024s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:18:03 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e6f061a-37e3-48cd-b34e-ae1ec8a743a8]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:18:03 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5587e64-4c82-4738-b985-9a2620b0e065]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:18:03 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-ab95380e-7bf8-4df0-b646-129b1e213962 tempest-TestVolumeSwap-1282852572 tempest-TestVolumeSwap-1282852572-project-member] Running cmd (subprocess): nvme version {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:18:03 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-ab95380e-7bf8-4df0-b646-129b1e213962 tempest-TestVolumeSwap-1282852572 tempest-TestVolumeSwap-1282852572-project-member] 'nvme version' failed. Not Retrying. {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 23:18:03 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ab95380e-7bf8-4df0-b646-129b1e213962 tempest-TestVolumeSwap-1282852572 tempest-TestVolumeSwap-1282852572-project-member] nvme not present on system {{(pid=75045) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 23:18:03 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:620828e2-bcb2-4fe0-be02-1cbd76c74b77 -p 172.16.0.220:3260 --logout" returned: 0 in 0.098s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:18:03 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[e27daa2d-2742-41f7-86ea-b692f474cefe]: (4, ('Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:620828e2-bcb2-4fe0-be02-1cbd76c74b77, portal: 172.16.0.220,3260]\nLogout of [sid: 3, target: iqn.2010-10.org.openstack:620828e2-bcb2-4fe0-be02-1cbd76c74b77, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:18:03 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:18:03 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-70ab85f2-9ee9-424d-bd5a-9f0752bc2c51 tempest-DeleteServersTestJSON-1018435513 tempest-DeleteServersTestJSON-1018435513-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:620828e2-bcb2-4fe0-be02-1cbd76c74b77, portal: 172.16.0.220,3260]
Nov 08 23:18:03 user nova-compute[75045]: Logout of [sid: 3, target: iqn.2010-10.org.openstack:620828e2-bcb2-4fe0-be02-1cbd76c74b77, portal: 172.16.0.220,3260] successful.
Nov 08 23:18:03 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:18:03 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:620828e2-bcb2-4fe0-be02-1cbd76c74b77 -p 172.16.0.220:3260 --op delete {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:18:03 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 23:18:03 user nova-compute[75045]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 23:18:03 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b4bc9dd-53ff-477f-a0aa-f61cfadef53c]: (4, '') {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:18:03 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.lightos [None req-ab95380e-7bf8-4df0-b646-129b1e213962 tempest-TestVolumeSwap-1282852572 tempest-TestVolumeSwap-1282852572-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75045) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 23:18:03 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.lightos [None req-ab95380e-7bf8-4df0-b646-129b1e213962 tempest-TestVolumeSwap-1282852572 tempest-TestVolumeSwap-1282852572-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75045) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 23:18:03 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.lightos [None req-ab95380e-7bf8-4df0-b646-129b1e213962 tempest-TestVolumeSwap-1282852572 tempest-TestVolumeSwap-1282852572-project-member] LIGHTOS: no hostnqn found. {{(pid=75045) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 23:18:03 user nova-compute[75045]: DEBUG os_brick.utils [None req-ab95380e-7bf8-4df0-b646-129b1e213962 tempest-TestVolumeSwap-1282852572 tempest-TestVolumeSwap-1282852572-project-member] <== get_connector_properties: return (233ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6217bd6e884', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75045) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 23:18:03 user nova-compute[75045]: DEBUG nova.virt.block_device [None req-ab95380e-7bf8-4df0-b646-129b1e213962 tempest-TestVolumeSwap-1282852572 tempest-TestVolumeSwap-1282852572-project-member] [instance: fde91f7c-31e3-456c-b252-6ce37fa3b600] Updating existing volume attachment record: a4971324-4f32-4227-bf27-3640ae060b22 {{(pid=75045) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 23:18:03 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:620828e2-bcb2-4fe0-be02-1cbd76c74b77 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:18:03 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ccbd548-a51f-4120-b02f-2816243ce987]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:18:03 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-70ab85f2-9ee9-424d-bd5a-9f0752bc2c51 tempest-DeleteServersTestJSON-1018435513 tempest-DeleteServersTestJSON-1018435513-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:18:03 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-70ab85f2-9ee9-424d-bd5a-9f0752bc2c51 tempest-DeleteServersTestJSON-1018435513 tempest-DeleteServersTestJSON-1018435513-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.582s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 23:18:03 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-70ab85f2-9ee9-424d-bd5a-9f0752bc2c51 tempest-DeleteServersTestJSON-1018435513 tempest-DeleteServersTestJSON-1018435513-project-member] <== disconnect_volume: return (584ms) None {{(pid=75045) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 23:18:03 user nova-compute[75045]: DEBUG nova.virt.libvirt.volume.iscsi [None req-70ab85f2-9ee9-424d-bd5a-9f0752bc2c51 tempest-DeleteServersTestJSON-1018435513 tempest-DeleteServersTestJSON-1018435513-project-member] [instance: 09cf15e6-1cec-4c55-b7dd-4311b5f87d32] Disconnected iSCSI Volume {{(pid=75045) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 23:18:03 user nova-compute[75045]: INFO nova.virt.libvirt.driver [None req-70ab85f2-9ee9-424d-bd5a-9f0752bc2c51 tempest-DeleteServersTestJSON-1018435513 tempest-DeleteServersTestJSON-1018435513-project-member] [instance: 09cf15e6-1cec-4c55-b7dd-4311b5f87d32] Deleting instance files /opt/stack/data/nova/instances/09cf15e6-1cec-4c55-b7dd-4311b5f87d32_del
Nov 08 23:18:03 user nova-compute[75045]: INFO nova.virt.libvirt.driver [None req-70ab85f2-9ee9-424d-bd5a-9f0752bc2c51 tempest-DeleteServersTestJSON-1018435513 tempest-DeleteServersTestJSON-1018435513-project-member] [instance: 09cf15e6-1cec-4c55-b7dd-4311b5f87d32] Deletion of /opt/stack/data/nova/instances/09cf15e6-1cec-4c55-b7dd-4311b5f87d32_del complete
Nov 08 23:18:03 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-e5bbf3c5-97db-43fa-af36-8e76c991adbc tempest-TaggedAttachmentsTest-1639503389 tempest-TaggedAttachmentsTest-1639503389-project-member] No BDM found with device name vda, not building metadata. {{(pid=75045) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 23:18:03 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-e5bbf3c5-97db-43fa-af36-8e76c991adbc tempest-TaggedAttachmentsTest-1639503389 tempest-TaggedAttachmentsTest-1639503389-project-member] No BDM found with device name hda, not building metadata. {{(pid=75045) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 23:18:03 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-e5bbf3c5-97db-43fa-af36-8e76c991adbc tempest-TaggedAttachmentsTest-1639503389 tempest-TaggedAttachmentsTest-1639503389-project-member] No VIF found with MAC fa:16:3e:e4:4d:f8, not building metadata {{(pid=75045) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 23:18:03 user nova-compute[75045]: DEBUG nova.virt.libvirt.guest [None req-e5bbf3c5-97db-43fa-af36-8e76c991adbc tempest-TaggedAttachmentsTest-1639503389 tempest-TaggedAttachmentsTest-1639503389-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 23:18:03 user nova-compute[75045]:   <nova:package version="0.0.0"/>
Nov 08 23:18:03 user nova-compute[75045]:   <nova:name>tempest-device-tagging-server-1008670319</nova:name>
Nov 08 23:18:03 user nova-compute[75045]:   <nova:creationTime>2023-11-08 23:18:03</nova:creationTime>
Nov 08 23:18:03 user nova-compute[75045]:   <nova:flavor name="m1.tiny">
Nov 08 23:18:03 user nova-compute[75045]:     <nova:memory>512</nova:memory>
Nov 08 23:18:03 user nova-compute[75045]:     <nova:disk>1</nova:disk>
Nov 08 23:18:03 user nova-compute[75045]:     <nova:swap>0</nova:swap>
Nov 08 23:18:03 user nova-compute[75045]:     <nova:ephemeral>0</nova:ephemeral>
Nov 08 23:18:03 user nova-compute[75045]:     <nova:vcpus>1</nova:vcpus>
Nov 08 23:18:03 user nova-compute[75045]:   </nova:flavor>
Nov 08 23:18:03 user nova-compute[75045]:   <nova:owner>
Nov 08 23:18:03 user nova-compute[75045]:     <nova:user uuid="0c8d9cc387dc45d18ad1550ef6d3cfa9">tempest-TaggedAttachmentsTest-1639503389-project-member</nova:user>
Nov 08 23:18:03 user nova-compute[75045]:     <nova:project uuid="bb18f0af92ec4de6a1fddb6c77ea030d">tempest-TaggedAttachmentsTest-1639503389</nova:project>
Nov 08 23:18:03 user nova-compute[75045]:   </nova:owner>
Nov 08 23:18:03 user nova-compute[75045]:   <nova:root type="image" uuid="a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb"/>
Nov 08 23:18:03 user nova-compute[75045]:   <nova:ports>
Nov 08 23:18:03 user nova-compute[75045]:     <nova:port uuid="892284f7-b4b9-4b5b-82c7-62300cd8afb7">
Nov 08 23:18:03 user nova-compute[75045]:       <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 08 23:18:03 user nova-compute[75045]:     </nova:port>
Nov 08 23:18:03 user nova-compute[75045]:     <nova:port uuid="2baf0a88-fd3e-45ae-95f8-9d568be4211b">
Nov 08 23:18:03 user nova-compute[75045]:       <nova:ip type="fixed" address="10.10.10.184" ipVersion="4"/>
Nov 08 23:18:03 user nova-compute[75045]:     </nova:port>
Nov 08 23:18:03 user nova-compute[75045]:   </nova:ports>
Nov 08 23:18:03 user nova-compute[75045]: </nova:instance>
Nov 08 23:18:03 user nova-compute[75045]:  {{(pid=75045) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Nov 08 23:18:03 user nova-compute[75045]: DEBUG nova.network.neutron [req-bb4d5a53-55b7-4046-8a5d-deb4d96c0f10 req-c62b0d08-5d1c-4d35-99c5-b762eb1553cd service nova] [instance: fde91f7c-31e3-456c-b252-6ce37fa3b600] Updated VIF entry in instance network info cache for port cf7f2506-395a-4404-a256-6600a5c0a06e. {{(pid=75045) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 23:18:03 user nova-compute[75045]: DEBUG nova.network.neutron [req-bb4d5a53-55b7-4046-8a5d-deb4d96c0f10 req-c62b0d08-5d1c-4d35-99c5-b762eb1553cd service nova] [instance: fde91f7c-31e3-456c-b252-6ce37fa3b600] Updating instance_info_cache with network_info: [{"id": "cf7f2506-395a-4404-a256-6600a5c0a06e", "address": "fa:16:3e:a5:67:d3", "network": {"id": "d1b282d5-4d48-4a16-9f0d-82241f8add26", "bridge": "br-int", "label": "tempest-TestVolumeSwap-340739462-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.52", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8fc58c033ee9468fa80d2d84f19c2f4c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf7f2506-39", "ovs_interfaceid": "cf7f2506-395a-4404-a256-6600a5c0a06e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75045) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 23:18:03 user nova-compute[75045]: INFO nova.compute.manager [None req-70ab85f2-9ee9-424d-bd5a-9f0752bc2c51 tempest-DeleteServersTestJSON-1018435513 tempest-DeleteServersTestJSON-1018435513-project-member] [instance: 09cf15e6-1cec-4c55-b7dd-4311b5f87d32] Took 1.71 seconds to destroy the instance on the hypervisor.
Nov 08 23:18:03 user nova-compute[75045]: DEBUG oslo.service.loopingcall [None req-70ab85f2-9ee9-424d-bd5a-9f0752bc2c51 tempest-DeleteServersTestJSON-1018435513 tempest-DeleteServersTestJSON-1018435513-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75045) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 23:18:03 user nova-compute[75045]: DEBUG nova.compute.manager [-] [instance: 09cf15e6-1cec-4c55-b7dd-4311b5f87d32] Deallocating network for instance {{(pid=75045) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 23:18:03 user nova-compute[75045]: DEBUG nova.network.neutron [-] [instance: 09cf15e6-1cec-4c55-b7dd-4311b5f87d32] deallocate_for_instance() {{(pid=75045) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 23:18:03 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-bb4d5a53-55b7-4046-8a5d-deb4d96c0f10 req-c62b0d08-5d1c-4d35-99c5-b762eb1553cd service nova] Releasing lock "refresh_cache-fde91f7c-31e3-456c-b252-6ce37fa3b600" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 23:18:03 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-e5bbf3c5-97db-43fa-af36-8e76c991adbc tempest-TaggedAttachmentsTest-1639503389 tempest-TaggedAttachmentsTest-1639503389-project-member] Lock "interface-1cb1b440-0073-4a53-a0a2-e2781e021866-None" "released" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: held 4.116s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:18:03 user nova-compute[75045]: DEBUG nova.network.neutron [req-e2ed1890-c070-4ea6-b4fd-9b50b9ae3ae5 req-c26b1493-92dd-40d8-8076-43115ce2dd2f service nova] [instance: 1cb1b440-0073-4a53-a0a2-e2781e021866] Updated VIF entry in instance network info cache for port 2baf0a88-fd3e-45ae-95f8-9d568be4211b. {{(pid=75045) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 23:18:03 user nova-compute[75045]: DEBUG nova.network.neutron [req-e2ed1890-c070-4ea6-b4fd-9b50b9ae3ae5 req-c26b1493-92dd-40d8-8076-43115ce2dd2f service nova] [instance: 1cb1b440-0073-4a53-a0a2-e2781e021866] Updating instance_info_cache with network_info: [{"id": "892284f7-b4b9-4b5b-82c7-62300cd8afb7", "address": "fa:16:3e:e4:4d:f8", "network": {"id": "fa6f2c92-825d-46c6-a0ea-51f96da244cb", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-193868289-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.235", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb18f0af92ec4de6a1fddb6c77ea030d", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap892284f7-b4", "ovs_interfaceid": "892284f7-b4b9-4b5b-82c7-62300cd8afb7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2baf0a88-fd3e-45ae-95f8-9d568be4211b", "address": "fa:16:3e:9e:7d:b7", "network": {"id": "3ffe4edb-8137-442f-9c3e-231775c7527c", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1585434856", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.184", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "bb18f0af92ec4de6a1fddb6c77ea030d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2baf0a88-fd", "ovs_interfaceid": "2baf0a88-fd3e-45ae-95f8-9d568be4211b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75045) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 23:18:03 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-e2ed1890-c070-4ea6-b4fd-9b50b9ae3ae5 req-c26b1493-92dd-40d8-8076-43115ce2dd2f service nova] Releasing lock "refresh_cache-1cb1b440-0073-4a53-a0a2-e2781e021866" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 23:18:03 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:18:03 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:18:03 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:18:04 user nova-compute[75045]: DEBUG nova.network.neutron [-] [instance: 09cf15e6-1cec-4c55-b7dd-4311b5f87d32] Updating instance_info_cache with network_info: [] {{(pid=75045) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 23:18:04 user nova-compute[75045]: INFO nova.compute.manager [-] [instance: 09cf15e6-1cec-4c55-b7dd-4311b5f87d32] Took 1.04 seconds to deallocate network for instance.
Nov 08 23:18:04 user nova-compute[75045]: DEBUG nova.compute.manager [req-71878b20-4f08-4f5d-a4f6-47e4c3ec6e37 req-164dada2-8e2c-4c5a-ad9e-7a6718019bd3 service nova] [instance: 09cf15e6-1cec-4c55-b7dd-4311b5f87d32] Received event network-vif-deleted-a270cac5-2b8d-4eb7-a5ed-9338e6bb5e22 {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:18:04 user nova-compute[75045]: INFO nova.compute.manager [req-71878b20-4f08-4f5d-a4f6-47e4c3ec6e37 req-164dada2-8e2c-4c5a-ad9e-7a6718019bd3 service nova] [instance: 09cf15e6-1cec-4c55-b7dd-4311b5f87d32] Neutron deleted interface a270cac5-2b8d-4eb7-a5ed-9338e6bb5e22; detaching it from the instance and deleting it from the info cache
Nov 08 23:18:04 user nova-compute[75045]: DEBUG nova.network.neutron [req-71878b20-4f08-4f5d-a4f6-47e4c3ec6e37 req-164dada2-8e2c-4c5a-ad9e-7a6718019bd3 service nova] [instance: 09cf15e6-1cec-4c55-b7dd-4311b5f87d32] Updating instance_info_cache with network_info: [] {{(pid=75045) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 23:18:04 user nova-compute[75045]: DEBUG nova.compute.manager [req-71878b20-4f08-4f5d-a4f6-47e4c3ec6e37 req-164dada2-8e2c-4c5a-ad9e-7a6718019bd3 service nova] [instance: 09cf15e6-1cec-4c55-b7dd-4311b5f87d32] Detach interface failed, port_id=a270cac5-2b8d-4eb7-a5ed-9338e6bb5e22, reason: Instance 09cf15e6-1cec-4c55-b7dd-4311b5f87d32 could not be found. {{(pid=75045) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 08 23:18:04 user nova-compute[75045]: DEBUG nova.compute.manager [req-018ce0b1-e10b-43ca-ae63-90b3010e7693 req-1a68d476-4152-46eb-a3e2-fd1c5251646b service nova] [instance: 09cf15e6-1cec-4c55-b7dd-4311b5f87d32] Received event network-vif-plugged-a270cac5-2b8d-4eb7-a5ed-9338e6bb5e22 {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:18:04 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-018ce0b1-e10b-43ca-ae63-90b3010e7693 req-1a68d476-4152-46eb-a3e2-fd1c5251646b service nova] Acquiring lock "09cf15e6-1cec-4c55-b7dd-4311b5f87d32-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:18:04 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-018ce0b1-e10b-43ca-ae63-90b3010e7693 req-1a68d476-4152-46eb-a3e2-fd1c5251646b service nova] Lock "09cf15e6-1cec-4c55-b7dd-4311b5f87d32-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:18:04 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-018ce0b1-e10b-43ca-ae63-90b3010e7693 req-1a68d476-4152-46eb-a3e2-fd1c5251646b service nova] Lock "09cf15e6-1cec-4c55-b7dd-4311b5f87d32-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:18:04 user nova-compute[75045]: DEBUG nova.compute.manager [req-018ce0b1-e10b-43ca-ae63-90b3010e7693 req-1a68d476-4152-46eb-a3e2-fd1c5251646b service nova] [instance: 09cf15e6-1cec-4c55-b7dd-4311b5f87d32] No waiting events found dispatching network-vif-plugged-a270cac5-2b8d-4eb7-a5ed-9338e6bb5e22 {{(pid=75045) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 23:18:04 user nova-compute[75045]: WARNING nova.compute.manager [req-018ce0b1-e10b-43ca-ae63-90b3010e7693 req-1a68d476-4152-46eb-a3e2-fd1c5251646b service nova] [instance: 09cf15e6-1cec-4c55-b7dd-4311b5f87d32] Received unexpected event network-vif-plugged-a270cac5-2b8d-4eb7-a5ed-9338e6bb5e22 for instance with vm_state active and task_state deleting.
Nov 08 23:18:04 user nova-compute[75045]: DEBUG nova.compute.manager [req-018ce0b1-e10b-43ca-ae63-90b3010e7693 req-1a68d476-4152-46eb-a3e2-fd1c5251646b service nova] [instance: 1cb1b440-0073-4a53-a0a2-e2781e021866] Received event network-vif-plugged-2baf0a88-fd3e-45ae-95f8-9d568be4211b {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:18:04 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-018ce0b1-e10b-43ca-ae63-90b3010e7693 req-1a68d476-4152-46eb-a3e2-fd1c5251646b service nova] Acquiring lock "1cb1b440-0073-4a53-a0a2-e2781e021866-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:18:04 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-018ce0b1-e10b-43ca-ae63-90b3010e7693 req-1a68d476-4152-46eb-a3e2-fd1c5251646b service nova] Lock "1cb1b440-0073-4a53-a0a2-e2781e021866-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:18:04 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-018ce0b1-e10b-43ca-ae63-90b3010e7693 req-1a68d476-4152-46eb-a3e2-fd1c5251646b service nova] Lock "1cb1b440-0073-4a53-a0a2-e2781e021866-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:18:04 user nova-compute[75045]: DEBUG nova.compute.manager [req-018ce0b1-e10b-43ca-ae63-90b3010e7693 req-1a68d476-4152-46eb-a3e2-fd1c5251646b service nova] [instance: 1cb1b440-0073-4a53-a0a2-e2781e021866] No waiting events found dispatching network-vif-plugged-2baf0a88-fd3e-45ae-95f8-9d568be4211b {{(pid=75045) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 23:18:04 user nova-compute[75045]: WARNING nova.compute.manager [req-018ce0b1-e10b-43ca-ae63-90b3010e7693 req-1a68d476-4152-46eb-a3e2-fd1c5251646b service nova] [instance: 1cb1b440-0073-4a53-a0a2-e2781e021866] Received unexpected event network-vif-plugged-2baf0a88-fd3e-45ae-95f8-9d568be4211b for instance with vm_state active and task_state None.
Nov 08 23:18:04 user nova-compute[75045]: DEBUG nova.compute.manager [req-018ce0b1-e10b-43ca-ae63-90b3010e7693 req-1a68d476-4152-46eb-a3e2-fd1c5251646b service nova] [instance: 1cb1b440-0073-4a53-a0a2-e2781e021866] Received event network-vif-plugged-2baf0a88-fd3e-45ae-95f8-9d568be4211b {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:18:04 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-018ce0b1-e10b-43ca-ae63-90b3010e7693 req-1a68d476-4152-46eb-a3e2-fd1c5251646b service nova] Acquiring lock "1cb1b440-0073-4a53-a0a2-e2781e021866-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:18:04 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-018ce0b1-e10b-43ca-ae63-90b3010e7693 req-1a68d476-4152-46eb-a3e2-fd1c5251646b service nova] Lock "1cb1b440-0073-4a53-a0a2-e2781e021866-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:18:04 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-018ce0b1-e10b-43ca-ae63-90b3010e7693 req-1a68d476-4152-46eb-a3e2-fd1c5251646b service nova] Lock "1cb1b440-0073-4a53-a0a2-e2781e021866-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:18:04 user nova-compute[75045]: DEBUG nova.compute.manager [req-018ce0b1-e10b-43ca-ae63-90b3010e7693 req-1a68d476-4152-46eb-a3e2-fd1c5251646b service nova] [instance: 1cb1b440-0073-4a53-a0a2-e2781e021866] No waiting events found dispatching network-vif-plugged-2baf0a88-fd3e-45ae-95f8-9d568be4211b {{(pid=75045) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 23:18:04 user nova-compute[75045]: WARNING nova.compute.manager [req-018ce0b1-e10b-43ca-ae63-90b3010e7693 req-1a68d476-4152-46eb-a3e2-fd1c5251646b service nova] [instance: 1cb1b440-0073-4a53-a0a2-e2781e021866] Received unexpected event network-vif-plugged-2baf0a88-fd3e-45ae-95f8-9d568be4211b for instance with vm_state active and task_state None.
Nov 08 23:18:05 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:18:05 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-f44af977-35eb-44a0-bf36-9092d9d8a0e7 tempest-TaggedAttachmentsTest-1639503389 tempest-TaggedAttachmentsTest-1639503389-project-member] Acquiring lock "1cb1b440-0073-4a53-a0a2-e2781e021866" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:18:05 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-f44af977-35eb-44a0-bf36-9092d9d8a0e7 tempest-TaggedAttachmentsTest-1639503389 tempest-TaggedAttachmentsTest-1639503389-project-member] Lock "1cb1b440-0073-4a53-a0a2-e2781e021866" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:18:05 user nova-compute[75045]: DEBUG nova.objects.instance [None req-f44af977-35eb-44a0-bf36-9092d9d8a0e7 tempest-TaggedAttachmentsTest-1639503389 tempest-TaggedAttachmentsTest-1639503389-project-member] Lazy-loading 'flavor' on Instance uuid 1cb1b440-0073-4a53-a0a2-e2781e021866 {{(pid=75045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 23:18:05 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-f44af977-35eb-44a0-bf36-9092d9d8a0e7 tempest-TaggedAttachmentsTest-1639503389 tempest-TaggedAttachmentsTest-1639503389-project-member] Lock "1cb1b440-0073-4a53-a0a2-e2781e021866" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.058s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:18:06 user nova-compute[75045]: INFO nova.compute.manager [None req-70ab85f2-9ee9-424d-bd5a-9f0752bc2c51 tempest-DeleteServersTestJSON-1018435513 tempest-DeleteServersTestJSON-1018435513-project-member] [instance: 09cf15e6-1cec-4c55-b7dd-4311b5f87d32] Took 2.16 seconds to detach 1 volumes for instance.
Nov 08 23:18:06 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-70ab85f2-9ee9-424d-bd5a-9f0752bc2c51 tempest-DeleteServersTestJSON-1018435513 tempest-DeleteServersTestJSON-1018435513-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:18:06 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-70ab85f2-9ee9-424d-bd5a-9f0752bc2c51 tempest-DeleteServersTestJSON-1018435513 tempest-DeleteServersTestJSON-1018435513-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:18:06 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-f2c73ce0-f7d6-4e24-96e6-70de9b487fc2 tempest-VolumesAssistedSnapshotsTest-1482710492 tempest-VolumesAssistedSnapshotsTest-1482710492-project-admin] Acquiring lock "07ec2c05-aaa9-46e8-8439-7aa5b9fca19d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:18:06 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-f2c73ce0-f7d6-4e24-96e6-70de9b487fc2 tempest-VolumesAssistedSnapshotsTest-1482710492 tempest-VolumesAssistedSnapshotsTest-1482710492-project-admin] Lock "07ec2c05-aaa9-46e8-8439-7aa5b9fca19d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:18:06 user nova-compute[75045]: DEBUG nova.objects.instance [None req-f2c73ce0-f7d6-4e24-96e6-70de9b487fc2 tempest-VolumesAssistedSnapshotsTest-1482710492 tempest-VolumesAssistedSnapshotsTest-1482710492-project-admin] Lazy-loading 'flavor' on Instance uuid 07ec2c05-aaa9-46e8-8439-7aa5b9fca19d {{(pid=75045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 23:18:06 user nova-compute[75045]: INFO nova.virt.block_device [None req-ac28c4dc-b349-4d76-b20f-521f64e4c39b tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] [instance: 520eac4f-fa48-4e41-924d-840907e701b4] Booting with volume 6ed77146-5ae0-400d-8116-7f9eb1322808 at /dev/vdb
Nov 08 23:18:06 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-f2c73ce0-f7d6-4e24-96e6-70de9b487fc2 tempest-VolumesAssistedSnapshotsTest-1482710492 tempest-VolumesAssistedSnapshotsTest-1482710492-project-admin] Lock "07ec2c05-aaa9-46e8-8439-7aa5b9fca19d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.103s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:18:07 user nova-compute[75045]: DEBUG nova.compute.provider_tree [None req-70ab85f2-9ee9-424d-bd5a-9f0752bc2c51 tempest-DeleteServersTestJSON-1018435513 tempest-DeleteServersTestJSON-1018435513-project-member] Inventory has not changed in ProviderTree for provider: 62ba5f85-c74d-4b58-986e-d4197e813fd7 {{(pid=75045) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 23:18:07 user nova-compute[75045]: DEBUG nova.scheduler.client.report [None req-70ab85f2-9ee9-424d-bd5a-9f0752bc2c51 tempest-DeleteServersTestJSON-1018435513 tempest-DeleteServersTestJSON-1018435513-project-member] Inventory has not changed for provider 62ba5f85-c74d-4b58-986e-d4197e813fd7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75045) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 23:18:07 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-70ab85f2-9ee9-424d-bd5a-9f0752bc2c51 tempest-DeleteServersTestJSON-1018435513 tempest-DeleteServersTestJSON-1018435513-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.404s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:18:07 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-f44af977-35eb-44a0-bf36-9092d9d8a0e7 tempest-TaggedAttachmentsTest-1639503389 tempest-TaggedAttachmentsTest-1639503389-project-member] Acquiring lock "1cb1b440-0073-4a53-a0a2-e2781e021866" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:18:07 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-f44af977-35eb-44a0-bf36-9092d9d8a0e7 tempest-TaggedAttachmentsTest-1639503389 tempest-TaggedAttachmentsTest-1639503389-project-member] Lock "1cb1b440-0073-4a53-a0a2-e2781e021866" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:18:07 user nova-compute[75045]: INFO nova.compute.manager [None req-f44af977-35eb-44a0-bf36-9092d9d8a0e7 tempest-TaggedAttachmentsTest-1639503389 tempest-TaggedAttachmentsTest-1639503389-project-member] [instance: 1cb1b440-0073-4a53-a0a2-e2781e021866] Attaching volume 528866cb-30dd-40ac-9a81-4c6afc93cdd9 to /dev/vdb
Nov 08 23:18:07 user nova-compute[75045]: DEBUG nova.compute.manager [req-210a21a0-8e92-450b-bfce-cd144da2e8fd req-c2701e49-1dd6-45a2-a1b7-68b559cae0ab service nova] [instance: 07ec2c05-aaa9-46e8-8439-7aa5b9fca19d] Received event network-changed-11c9f384-694c-41fc-b8b3-2db1d15ea84c {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:18:07 user nova-compute[75045]: DEBUG nova.compute.manager [req-210a21a0-8e92-450b-bfce-cd144da2e8fd req-c2701e49-1dd6-45a2-a1b7-68b559cae0ab service nova] [instance: 07ec2c05-aaa9-46e8-8439-7aa5b9fca19d] Refreshing instance network info cache due to event network-changed-11c9f384-694c-41fc-b8b3-2db1d15ea84c. {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 23:18:07 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-210a21a0-8e92-450b-bfce-cd144da2e8fd req-c2701e49-1dd6-45a2-a1b7-68b559cae0ab service nova] Acquiring lock "refresh_cache-07ec2c05-aaa9-46e8-8439-7aa5b9fca19d" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 23:18:07 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-210a21a0-8e92-450b-bfce-cd144da2e8fd req-c2701e49-1dd6-45a2-a1b7-68b559cae0ab service nova] Acquired lock "refresh_cache-07ec2c05-aaa9-46e8-8439-7aa5b9fca19d" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 23:18:07 user nova-compute[75045]: DEBUG nova.network.neutron [req-210a21a0-8e92-450b-bfce-cd144da2e8fd req-c2701e49-1dd6-45a2-a1b7-68b559cae0ab service nova] [instance: 07ec2c05-aaa9-46e8-8439-7aa5b9fca19d] Refreshing network info cache for port 11c9f384-694c-41fc-b8b3-2db1d15ea84c {{(pid=75045) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 23:18:07 user nova-compute[75045]: INFO nova.scheduler.client.report [None req-70ab85f2-9ee9-424d-bd5a-9f0752bc2c51 tempest-DeleteServersTestJSON-1018435513 tempest-DeleteServersTestJSON-1018435513-project-member] Deleted allocations for instance 09cf15e6-1cec-4c55-b7dd-4311b5f87d32
Nov 08 23:18:07 user nova-compute[75045]: DEBUG os_brick.utils [None req-ac28c4dc-b349-4d76-b20f-521f64e4c39b tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75045) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 23:18:07 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:18:07 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:18:07 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[be5f1591-06e6-480f-9934-335201fcd8e9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6217bd6e884\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:18:07 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:18:07 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:18:07 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbcbc28c-2277-4f26-ab66-0e34a904ff62]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:18:07 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:18:07 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:18:07 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ffcf9fc-7814-447b-a5ab-6923092a70f3]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:18:07 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7344dcd-e9e0-4e41-a7d9-e2a430b51e3b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:18:07 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-ac28c4dc-b349-4d76-b20f-521f64e4c39b tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] Running cmd (subprocess): nvme version {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:18:07 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-ac28c4dc-b349-4d76-b20f-521f64e4c39b tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] 'nvme version' failed. Not Retrying. {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 23:18:07 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ac28c4dc-b349-4d76-b20f-521f64e4c39b tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] nvme not present on system {{(pid=75045) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 23:18:07 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-70ab85f2-9ee9-424d-bd5a-9f0752bc2c51 tempest-DeleteServersTestJSON-1018435513 tempest-DeleteServersTestJSON-1018435513-project-member] Lock "09cf15e6-1cec-4c55-b7dd-4311b5f87d32" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 5.664s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:18:07 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:18:07 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 23:18:07 user nova-compute[75045]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 23:18:07 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6e5ed93-caf5-433a-ba40-dd4c8a4c729b]: (4, '') {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:18:07 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.lightos [None req-ac28c4dc-b349-4d76-b20f-521f64e4c39b tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75045) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 23:18:07 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.lightos [None req-ac28c4dc-b349-4d76-b20f-521f64e4c39b tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75045) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 23:18:07 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.lightos [None req-ac28c4dc-b349-4d76-b20f-521f64e4c39b tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] LIGHTOS: no hostnqn found. {{(pid=75045) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 23:18:07 user nova-compute[75045]: DEBUG os_brick.utils [None req-ac28c4dc-b349-4d76-b20f-521f64e4c39b tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] <== get_connector_properties: return (143ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6217bd6e884', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75045) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 23:18:07 user nova-compute[75045]: DEBUG nova.virt.block_device [None req-ac28c4dc-b349-4d76-b20f-521f64e4c39b tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] [instance: 520eac4f-fa48-4e41-924d-840907e701b4] Updating existing volume attachment record: b9856fce-a3e2-484d-9464-f5581a6c5311 {{(pid=75045) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 23:18:07 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-f2c73ce0-f7d6-4e24-96e6-70de9b487fc2 tempest-VolumesAssistedSnapshotsTest-1482710492 tempest-VolumesAssistedSnapshotsTest-1482710492-project-admin] Acquiring lock "07ec2c05-aaa9-46e8-8439-7aa5b9fca19d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:18:07 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-f2c73ce0-f7d6-4e24-96e6-70de9b487fc2 tempest-VolumesAssistedSnapshotsTest-1482710492 tempest-VolumesAssistedSnapshotsTest-1482710492-project-admin] Lock "07ec2c05-aaa9-46e8-8439-7aa5b9fca19d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:18:07 user nova-compute[75045]: INFO nova.compute.manager [None req-f2c73ce0-f7d6-4e24-96e6-70de9b487fc2 tempest-VolumesAssistedSnapshotsTest-1482710492 tempest-VolumesAssistedSnapshotsTest-1482710492-project-admin] [instance: 07ec2c05-aaa9-46e8-8439-7aa5b9fca19d] Attaching volume f829f03c-8f1a-45f1-a715-b9d769201d1b to /dev/vdb
Nov 08 23:18:07 user nova-compute[75045]: DEBUG os_brick.utils [None req-f44af977-35eb-44a0-bf36-9092d9d8a0e7 tempest-TaggedAttachmentsTest-1639503389 tempest-TaggedAttachmentsTest-1639503389-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75045) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 23:18:07 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:18:07 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:18:07 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea1556d6-1978-47fd-88f6-fcc8adad19f4]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6217bd6e884\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:18:07 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:18:07 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:18:07 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[59411b6b-81b9-49fb-9429-490d91422a0f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:18:07 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:18:07 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:18:07 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[80a7cd0d-c241-4a1c-9df6-58a1ba6a28b5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:18:07 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1441081-81b6-4ff8-9c48-60c7c0a871e5]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:18:07 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-f44af977-35eb-44a0-bf36-9092d9d8a0e7 tempest-TaggedAttachmentsTest-1639503389 tempest-TaggedAttachmentsTest-1639503389-project-member] Running cmd (subprocess): nvme version {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:18:07 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-f44af977-35eb-44a0-bf36-9092d9d8a0e7 tempest-TaggedAttachmentsTest-1639503389 tempest-TaggedAttachmentsTest-1639503389-project-member] 'nvme version' failed. Not Retrying. {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 23:18:07 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f44af977-35eb-44a0-bf36-9092d9d8a0e7 tempest-TaggedAttachmentsTest-1639503389 tempest-TaggedAttachmentsTest-1639503389-project-member] nvme not present on system {{(pid=75045) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 23:18:07 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:18:07 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 23:18:07 user nova-compute[75045]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 23:18:07 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fbcfc3c-e901-47bb-9293-e183e68e3fa5]: (4, '') {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:18:07 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.lightos [None req-f44af977-35eb-44a0-bf36-9092d9d8a0e7 tempest-TaggedAttachmentsTest-1639503389 tempest-TaggedAttachmentsTest-1639503389-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75045) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 23:18:07 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.lightos [None req-f44af977-35eb-44a0-bf36-9092d9d8a0e7 tempest-TaggedAttachmentsTest-1639503389 tempest-TaggedAttachmentsTest-1639503389-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75045) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 23:18:07 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.lightos [None req-f44af977-35eb-44a0-bf36-9092d9d8a0e7 tempest-TaggedAttachmentsTest-1639503389 tempest-TaggedAttachmentsTest-1639503389-project-member] LIGHTOS: no hostnqn found. {{(pid=75045) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 23:18:07 user nova-compute[75045]: DEBUG os_brick.utils [None req-f44af977-35eb-44a0-bf36-9092d9d8a0e7 tempest-TaggedAttachmentsTest-1639503389 tempest-TaggedAttachmentsTest-1639503389-project-member] <== get_connector_properties: return (147ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6217bd6e884', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75045) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 23:18:07 user nova-compute[75045]: DEBUG nova.virt.block_device [None req-f44af977-35eb-44a0-bf36-9092d9d8a0e7 tempest-TaggedAttachmentsTest-1639503389 tempest-TaggedAttachmentsTest-1639503389-project-member] [instance: 1cb1b440-0073-4a53-a0a2-e2781e021866] Updating existing volume attachment record: ad590d84-babc-4166-991c-3e3f63a116d0 {{(pid=75045) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 23:18:07 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:18:07 user nova-compute[75045]: DEBUG nova.network.neutron [req-210a21a0-8e92-450b-bfce-cd144da2e8fd req-c2701e49-1dd6-45a2-a1b7-68b559cae0ab service nova] [instance: 07ec2c05-aaa9-46e8-8439-7aa5b9fca19d] Updated VIF entry in instance network info cache for port 11c9f384-694c-41fc-b8b3-2db1d15ea84c. {{(pid=75045) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 23:18:07 user nova-compute[75045]: DEBUG nova.network.neutron [req-210a21a0-8e92-450b-bfce-cd144da2e8fd req-c2701e49-1dd6-45a2-a1b7-68b559cae0ab service nova] [instance: 07ec2c05-aaa9-46e8-8439-7aa5b9fca19d] Updating instance_info_cache with network_info: [{"id": "11c9f384-694c-41fc-b8b3-2db1d15ea84c", "address": "fa:16:3e:22:d3:3d", "network": {"id": "c7d78679-f4e4-4060-86d0-ec146a216818", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-315788385-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.207", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07fac94bac644b72801b207a378f34ac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11c9f384-69", "ovs_interfaceid": "11c9f384-694c-41fc-b8b3-2db1d15ea84c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75045) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 23:18:07 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-210a21a0-8e92-450b-bfce-cd144da2e8fd req-c2701e49-1dd6-45a2-a1b7-68b559cae0ab service nova] Releasing lock "refresh_cache-07ec2c05-aaa9-46e8-8439-7aa5b9fca19d" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 23:18:10 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:18:12 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:18:15 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:18:17 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:18:20 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:18:22 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:18:25 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:18:26 user nova-compute[75045]: DEBUG nova.virt.libvirt.volume.iscsi [None req-acf7f888-75c1-4764-a679-61493c54e5ab tempest-AttachSCSIVolumeTestJSON-1576344526 tempest-AttachSCSIVolumeTestJSON-1576344526-project-member] [instance: b9bd3096-92eb-4aae-8619-2725ed9acc2b] Calling os-brick to attach iSCSI Volume {{(pid=75045) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 23:18:26 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-acf7f888-75c1-4764-a679-61493c54e5ab tempest-AttachSCSIVolumeTestJSON-1576344526 tempest-AttachSCSIVolumeTestJSON-1576344526-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1b68210460>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:8c532e3b-4f3c-4809-bd49-fd7c2ea7f6cd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SVvdYuWa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75045) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 23:18:26 user nova-compute[75045]: WARNING os_brick.initiator.connectors.base [None req-acf7f888-75c1-4764-a679-61493c54e5ab tempest-AttachSCSIVolumeTestJSON-1576344526 tempest-AttachSCSIVolumeTestJSON-1576344526-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 23:18:26 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-acf7f888-75c1-4764-a679-61493c54e5ab tempest-AttachSCSIVolumeTestJSON-1576344526 tempest-AttachSCSIVolumeTestJSON-1576344526-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 23:18:26 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-acf7f888-75c1-4764-a679-61493c54e5ab tempest-AttachSCSIVolumeTestJSON-1576344526 tempest-AttachSCSIVolumeTestJSON-1576344526-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 23:18:26 user nova-compute[75045]: WARNING os_brick.initiator.connectors.base [None req-acf7f888-75c1-4764-a679-61493c54e5ab tempest-AttachSCSIVolumeTestJSON-1576344526 tempest-AttachSCSIVolumeTestJSON-1576344526-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 23:18:26 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-acf7f888-75c1-4764-a679-61493c54e5ab tempest-AttachSCSIVolumeTestJSON-1576344526 tempest-AttachSCSIVolumeTestJSON-1576344526-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8c532e3b-4f3c-4809-bd49-fd7c2ea7f6cd" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 23:18:26 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-acf7f888-75c1-4764-a679-61493c54e5ab tempest-AttachSCSIVolumeTestJSON-1576344526 tempest-AttachSCSIVolumeTestJSON-1576344526-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8c532e3b-4f3c-4809-bd49-fd7c2ea7f6cd" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 23:18:26 user nova-compute[75045]: INFO os_brick.initiator.connectors.iscsi [None req-acf7f888-75c1-4764-a679-61493c54e5ab tempest-AttachSCSIVolumeTestJSON-1576344526 tempest-AttachSCSIVolumeTestJSON-1576344526-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 23:18:26 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c532e3b-4f3c-4809-bd49-fd7c2ea7f6cd -p 172.16.0.220:3260 {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:18:26 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c532e3b-4f3c-4809-bd49-fd7c2ea7f6cd -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:18:26 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[b927f332-b2ff-41d4-9b86-856a80e45254]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:18:26 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-acf7f888-75c1-4764-a679-61493c54e5ab tempest-AttachSCSIVolumeTestJSON-1576344526 tempest-AttachSCSIVolumeTestJSON-1576344526-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 23:18:26 user nova-compute[75045]:  {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:18:26 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c532e3b-4f3c-4809-bd49-fd7c2ea7f6cd -p 172.16.0.220:3260 --interface default --op new {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:18:26 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c532e3b-4f3c-4809-bd49-fd7c2ea7f6cd -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:18:26 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[e482aac5-294d-446d-b6cf-003089b14a91]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8c532e3b-4f3c-4809-bd49-fd7c2ea7f6cd] added\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:18:26 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-acf7f888-75c1-4764-a679-61493c54e5ab tempest-AttachSCSIVolumeTestJSON-1576344526 tempest-AttachSCSIVolumeTestJSON-1576344526-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8c532e3b-4f3c-4809-bd49-fd7c2ea7f6cd] added
Nov 08 23:18:26 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:18:26 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c532e3b-4f3c-4809-bd49-fd7c2ea7f6cd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:18:26 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c532e3b-4f3c-4809-bd49-fd7c2ea7f6cd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:18:26 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[3330b785-42c1-420b-84d9-0ac9ee53e61b]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:18:26 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-acf7f888-75c1-4764-a679-61493c54e5ab tempest-AttachSCSIVolumeTestJSON-1576344526 tempest-AttachSCSIVolumeTestJSON-1576344526-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:18:26 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c532e3b-4f3c-4809-bd49-fd7c2ea7f6cd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:18:26 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c532e3b-4f3c-4809-bd49-fd7c2ea7f6cd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:18:26 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[b25fec19-1dc6-44ee-b2b8-fc58f8653dbc]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:18:26 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-acf7f888-75c1-4764-a679-61493c54e5ab tempest-AttachSCSIVolumeTestJSON-1576344526 tempest-AttachSCSIVolumeTestJSON-1576344526-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:18:26 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c532e3b-4f3c-4809-bd49-fd7c2ea7f6cd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SVvdYuWa {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:18:26 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c532e3b-4f3c-4809-bd49-fd7c2ea7f6cd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SVvdYuWa" returned: 0 in 0.021s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:18:26 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c9d1471-7d16-4009-84fb-6e37c629242d]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:18:26 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-acf7f888-75c1-4764-a679-61493c54e5ab tempest-AttachSCSIVolumeTestJSON-1576344526 tempest-AttachSCSIVolumeTestJSON-1576344526-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'SVvdYuWa'): stdout= stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:18:26 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c532e3b-4f3c-4809-bd49-fd7c2ea7f6cd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:18:26 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c532e3b-4f3c-4809-bd49-fd7c2ea7f6cd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:18:26 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[9046027c-f5ad-4e6d-b110-4c8ac12a03a8]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:18:26 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-acf7f888-75c1-4764-a679-61493c54e5ab tempest-AttachSCSIVolumeTestJSON-1576344526 tempest-AttachSCSIVolumeTestJSON-1576344526-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:18:26 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:18:26 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:18:26 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cdf19b9-8e9f-4dfa-b060-2ecdf0e7c9d4]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2068946-d374-45a4-9850-e3a690b13ef4 (non-flash)\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:18:26 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-acf7f888-75c1-4764-a679-61493c54e5ab tempest-AttachSCSIVolumeTestJSON-1576344526 tempest-AttachSCSIVolumeTestJSON-1576344526-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2068946-d374-45a4-9850-e3a690b13ef4 (non-flash)
Nov 08 23:18:26 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 23:18:26 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-acf7f888-75c1-4764-a679-61493c54e5ab tempest-AttachSCSIVolumeTestJSON-1576344526 tempest-AttachSCSIVolumeTestJSON-1576344526-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2068946-d374-45a4-9850-e3a690b13ef4 (non-flash)
Nov 08 23:18:26 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 23:18:26 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c532e3b-4f3c-4809-bd49-fd7c2ea7f6cd -p 172.16.0.220:3260 --login {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:18:26 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c532e3b-4f3c-4809-bd49-fd7c2ea7f6cd -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:18:26 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ec2a682-a33c-4b7c-abcc-6dbce9b1157f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8c532e3b-4f3c-4809-bd49-fd7c2ea7f6cd, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8c532e3b-4f3c-4809-bd49-fd7c2ea7f6cd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:18:26 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-acf7f888-75c1-4764-a679-61493c54e5ab tempest-AttachSCSIVolumeTestJSON-1576344526 tempest-AttachSCSIVolumeTestJSON-1576344526-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8c532e3b-4f3c-4809-bd49-fd7c2ea7f6cd, portal: 172.16.0.220,3260]
Nov 08 23:18:26 user nova-compute[75045]: Login to [iface: default, target: iqn.2010-10.org.openstack:8c532e3b-4f3c-4809-bd49-fd7c2ea7f6cd, portal: 172.16.0.220,3260] successful.
Nov 08 23:18:26 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:18:26 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c532e3b-4f3c-4809-bd49-fd7c2ea7f6cd -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:18:26 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c532e3b-4f3c-4809-bd49-fd7c2ea7f6cd -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:18:26 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[d13ceb2f-cf2e-4ba9-8939-05b7a8435408]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:18:26 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-acf7f888-75c1-4764-a679-61493c54e5ab tempest-AttachSCSIVolumeTestJSON-1576344526 tempest-AttachSCSIVolumeTestJSON-1576344526-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:18:26 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:18:26 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:18:26 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b8a39c4-1891-4ecc-94d1-f685213daf86]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2068946-d374-45a4-9850-e3a690b13ef4 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c532e3b-4f3c-4809-bd49-fd7c2ea7f6cd (non-flash)\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:18:26 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-acf7f888-75c1-4764-a679-61493c54e5ab tempest-AttachSCSIVolumeTestJSON-1576344526 tempest-AttachSCSIVolumeTestJSON-1576344526-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2068946-d374-45a4-9850-e3a690b13ef4 (non-flash)
Nov 08 23:18:26 user nova-compute[75045]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c532e3b-4f3c-4809-bd49-fd7c2ea7f6cd (non-flash)
Nov 08 23:18:26 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 23:18:26 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-acf7f888-75c1-4764-a679-61493c54e5ab tempest-AttachSCSIVolumeTestJSON-1576344526 tempest-AttachSCSIVolumeTestJSON-1576344526-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2068946-d374-45a4-9850-e3a690b13ef4 (non-flash)
Nov 08 23:18:26 user nova-compute[75045]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c532e3b-4f3c-4809-bd49-fd7c2ea7f6cd (non-flash)
Nov 08 23:18:26 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 23:18:26 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-acf7f888-75c1-4764-a679-61493c54e5ab tempest-AttachSCSIVolumeTestJSON-1576344526 tempest-AttachSCSIVolumeTestJSON-1576344526-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8c532e3b-4f3c-4809-bd49-fd7c2ea7f6cd" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.291s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 23:18:26 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-acf7f888-75c1-4764-a679-61493c54e5ab tempest-AttachSCSIVolumeTestJSON-1576344526 tempest-AttachSCSIVolumeTestJSON-1576344526-project-member] Connected to 172.16.0.220:3260 {{(pid=75045) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 23:18:26 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-acf7f888-75c1-4764-a679-61493c54e5ab tempest-AttachSCSIVolumeTestJSON-1576344526 tempest-AttachSCSIVolumeTestJSON-1576344526-project-member] HCTL ('34', '-', '-', 0) found on session 4 with lun 0 {{(pid=75045) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 23:18:26 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-acf7f888-75c1-4764-a679-61493c54e5ab tempest-AttachSCSIVolumeTestJSON-1576344526 tempest-AttachSCSIVolumeTestJSON-1576344526-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75045) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 23:18:26 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:18:26 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:18:26 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[54181821-093b-4d3d-9664-891293325e68]: (4, ('- - 0', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:18:26 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-acf7f888-75c1-4764-a679-61493c54e5ab tempest-AttachSCSIVolumeTestJSON-1576344526 tempest-AttachSCSIVolumeTestJSON-1576344526-project-member] Searching for a device in session 4 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75045) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 23:18:26 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-acf7f888-75c1-4764-a679-61493c54e5ab tempest-AttachSCSIVolumeTestJSON-1576344526 tempest-AttachSCSIVolumeTestJSON-1576344526-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:8c532e3b-4f3c-4809-bd49-fd7c2ea7f6cd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SVvdYuWa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75045) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 23:18:27 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-acf7f888-75c1-4764-a679-61493c54e5ab tempest-AttachSCSIVolumeTestJSON-1576344526 tempest-AttachSCSIVolumeTestJSON-1576344526-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.326s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 23:18:27 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-acf7f888-75c1-4764-a679-61493c54e5ab tempest-AttachSCSIVolumeTestJSON-1576344526 tempest-AttachSCSIVolumeTestJSON-1576344526-project-member] <== connect_volume: return (1329ms) {'type': 'block', 'scsi_wwn': '26237376166623931', 'path': '/dev/sdc'} {{(pid=75045) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 23:18:27 user nova-compute[75045]: DEBUG nova.virt.libvirt.volume.iscsi [None req-acf7f888-75c1-4764-a679-61493c54e5ab tempest-AttachSCSIVolumeTestJSON-1576344526 tempest-AttachSCSIVolumeTestJSON-1576344526-project-member] [instance: b9bd3096-92eb-4aae-8619-2725ed9acc2b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26237376166623931', 'path': '/dev/sdc'} {{(pid=75045) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 23:18:27 user nova-compute[75045]: DEBUG nova.objects.instance [None req-acf7f888-75c1-4764-a679-61493c54e5ab tempest-AttachSCSIVolumeTestJSON-1576344526 tempest-AttachSCSIVolumeTestJSON-1576344526-project-member] Lazy-loading 'flavor' on Instance uuid b9bd3096-92eb-4aae-8619-2725ed9acc2b {{(pid=75045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 23:18:27 user nova-compute[75045]: DEBUG nova.virt.libvirt.guest [None req-acf7f888-75c1-4764-a679-61493c54e5ab tempest-AttachSCSIVolumeTestJSON-1576344526 tempest-AttachSCSIVolumeTestJSON-1576344526-project-member] attach device xml: <disk type="block" device="disk">
Nov 08 23:18:27 user nova-compute[75045]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 23:18:27 user nova-compute[75045]:   <source dev="/dev/sdc"/>
Nov 08 23:18:27 user nova-compute[75045]:   <target dev="sdc" bus="scsi"/>
Nov 08 23:18:27 user nova-compute[75045]:   <serial>8c532e3b-4f3c-4809-bd49-fd7c2ea7f6cd</serial>
Nov 08 23:18:27 user nova-compute[75045]:   <address type="drive" controller="0" unit="2"/>
Nov 08 23:18:27 user nova-compute[75045]: </disk>
Nov 08 23:18:27 user nova-compute[75045]:  {{(pid=75045) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 08 23:18:27 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:18:27 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:18:28 user nova-compute[75045]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ab95380e-7bf8-4df0-b646-129b1e213962 tempest-TestVolumeSwap-1282852572 tempest-TestVolumeSwap-1282852572-project-member] [instance: fde91f7c-31e3-456c-b252-6ce37fa3b600] Calling os-brick to attach iSCSI Volume {{(pid=75045) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 23:18:28 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab95380e-7bf8-4df0-b646-129b1e213962 tempest-TestVolumeSwap-1282852572 tempest-TestVolumeSwap-1282852572-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1b68210460>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:4d7a4df0-bfc5-4952-8454-97b703b68f28', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MzmZAnHp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75045) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 23:18:28 user nova-compute[75045]: WARNING os_brick.initiator.connectors.base [None req-ab95380e-7bf8-4df0-b646-129b1e213962 tempest-TestVolumeSwap-1282852572 tempest-TestVolumeSwap-1282852572-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 23:18:28 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-ab95380e-7bf8-4df0-b646-129b1e213962 tempest-TestVolumeSwap-1282852572 tempest-TestVolumeSwap-1282852572-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 23:18:28 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-ab95380e-7bf8-4df0-b646-129b1e213962 tempest-TestVolumeSwap-1282852572 tempest-TestVolumeSwap-1282852572-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 23:18:28 user nova-compute[75045]: WARNING os_brick.initiator.connectors.base [None req-ab95380e-7bf8-4df0-b646-129b1e213962 tempest-TestVolumeSwap-1282852572 tempest-TestVolumeSwap-1282852572-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 23:18:28 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-ab95380e-7bf8-4df0-b646-129b1e213962 tempest-TestVolumeSwap-1282852572 tempest-TestVolumeSwap-1282852572-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4d7a4df0-bfc5-4952-8454-97b703b68f28" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 23:18:28 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-ab95380e-7bf8-4df0-b646-129b1e213962 tempest-TestVolumeSwap-1282852572 tempest-TestVolumeSwap-1282852572-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4d7a4df0-bfc5-4952-8454-97b703b68f28" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 23:18:28 user nova-compute[75045]: INFO os_brick.initiator.connectors.iscsi [None req-ab95380e-7bf8-4df0-b646-129b1e213962 tempest-TestVolumeSwap-1282852572 tempest-TestVolumeSwap-1282852572-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 23:18:28 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d7a4df0-bfc5-4952-8454-97b703b68f28 -p 172.16.0.220:3260 {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:18:28 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-acf7f888-75c1-4764-a679-61493c54e5ab tempest-AttachSCSIVolumeTestJSON-1576344526 tempest-AttachSCSIVolumeTestJSON-1576344526-project-member] No BDM found with device name sda, not building metadata. {{(pid=75045) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 23:18:28 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-acf7f888-75c1-4764-a679-61493c54e5ab tempest-AttachSCSIVolumeTestJSON-1576344526 tempest-AttachSCSIVolumeTestJSON-1576344526-project-member] No BDM found with device name sdb, not building metadata. {{(pid=75045) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 23:18:28 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-acf7f888-75c1-4764-a679-61493c54e5ab tempest-AttachSCSIVolumeTestJSON-1576344526 tempest-AttachSCSIVolumeTestJSON-1576344526-project-member] No BDM found with device name sdc, not building metadata. {{(pid=75045) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 23:18:28 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-acf7f888-75c1-4764-a679-61493c54e5ab tempest-AttachSCSIVolumeTestJSON-1576344526 tempest-AttachSCSIVolumeTestJSON-1576344526-project-member] No VIF found with MAC fa:16:3e:1e:64:12, not building metadata {{(pid=75045) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 23:18:28 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d7a4df0-bfc5-4952-8454-97b703b68f28 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:18:28 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[0962111c-d35b-477b-ba26-c7e9a5e5fb7e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:18:28 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab95380e-7bf8-4df0-b646-129b1e213962 tempest-TestVolumeSwap-1282852572 tempest-TestVolumeSwap-1282852572-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 23:18:28 user nova-compute[75045]:  {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:18:28 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d7a4df0-bfc5-4952-8454-97b703b68f28 -p 172.16.0.220:3260 --interface default --op new {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:18:28 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d7a4df0-bfc5-4952-8454-97b703b68f28 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:18:28 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5f60577-d574-4398-81aa-57b9611da480]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4d7a4df0-bfc5-4952-8454-97b703b68f28] added\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:18:28 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab95380e-7bf8-4df0-b646-129b1e213962 tempest-TestVolumeSwap-1282852572 tempest-TestVolumeSwap-1282852572-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4d7a4df0-bfc5-4952-8454-97b703b68f28] added
Nov 08 23:18:28 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:18:28 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d7a4df0-bfc5-4952-8454-97b703b68f28 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:18:28 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d7a4df0-bfc5-4952-8454-97b703b68f28 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:18:28 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[24b9ee0f-53a6-4f4b-a256-790344eabdd4]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:18:28 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab95380e-7bf8-4df0-b646-129b1e213962 tempest-TestVolumeSwap-1282852572 tempest-TestVolumeSwap-1282852572-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:18:28 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d7a4df0-bfc5-4952-8454-97b703b68f28 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:18:28 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d7a4df0-bfc5-4952-8454-97b703b68f28 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:18:28 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[cce6c034-40c6-414b-a133-c7d56d1c683c]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:18:28 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab95380e-7bf8-4df0-b646-129b1e213962 tempest-TestVolumeSwap-1282852572 tempest-TestVolumeSwap-1282852572-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:18:28 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d7a4df0-bfc5-4952-8454-97b703b68f28 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MzmZAnHp {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:18:28 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d7a4df0-bfc5-4952-8454-97b703b68f28 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MzmZAnHp" returned: 0 in 0.018s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:18:28 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[aba8e3c2-6f59-40bf-803d-6b15f9c8cdc6]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:18:28 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab95380e-7bf8-4df0-b646-129b1e213962 tempest-TestVolumeSwap-1282852572 tempest-TestVolumeSwap-1282852572-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'MzmZAnHp'): stdout= stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:18:28 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d7a4df0-bfc5-4952-8454-97b703b68f28 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:18:28 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d7a4df0-bfc5-4952-8454-97b703b68f28 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:18:28 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fdaddd7-16f8-48d4-8206-a4c08318bfa9]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:18:28 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab95380e-7bf8-4df0-b646-129b1e213962 tempest-TestVolumeSwap-1282852572 tempest-TestVolumeSwap-1282852572-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:18:28 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:18:28 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:18:28 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fe77e7b-0f2f-4135-adff-ab95e94fa528]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2068946-d374-45a4-9850-e3a690b13ef4 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c532e3b-4f3c-4809-bd49-fd7c2ea7f6cd (non-flash)\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:18:28 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab95380e-7bf8-4df0-b646-129b1e213962 tempest-TestVolumeSwap-1282852572 tempest-TestVolumeSwap-1282852572-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2068946-d374-45a4-9850-e3a690b13ef4 (non-flash)
Nov 08 23:18:28 user nova-compute[75045]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c532e3b-4f3c-4809-bd49-fd7c2ea7f6cd (non-flash)
Nov 08 23:18:28 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 23:18:28 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab95380e-7bf8-4df0-b646-129b1e213962 tempest-TestVolumeSwap-1282852572 tempest-TestVolumeSwap-1282852572-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2068946-d374-45a4-9850-e3a690b13ef4 (non-flash)
Nov 08 23:18:28 user nova-compute[75045]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c532e3b-4f3c-4809-bd49-fd7c2ea7f6cd (non-flash)
Nov 08 23:18:28 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 23:18:28 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d7a4df0-bfc5-4952-8454-97b703b68f28 -p 172.16.0.220:3260 --login {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:18:28 user nova-compute[75045]: DEBUG os_brick.utils [None req-f2c73ce0-f7d6-4e24-96e6-70de9b487fc2 tempest-VolumesAssistedSnapshotsTest-1482710492 tempest-VolumesAssistedSnapshotsTest-1482710492-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75045) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 23:18:28 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:18:28 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d7a4df0-bfc5-4952-8454-97b703b68f28 -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:18:28 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2288ac8-11e0-4560-80c1-8ded6a4b9783]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4d7a4df0-bfc5-4952-8454-97b703b68f28, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4d7a4df0-bfc5-4952-8454-97b703b68f28, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:18:28 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab95380e-7bf8-4df0-b646-129b1e213962 tempest-TestVolumeSwap-1282852572 tempest-TestVolumeSwap-1282852572-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4d7a4df0-bfc5-4952-8454-97b703b68f28, portal: 172.16.0.220,3260]
Nov 08 23:18:28 user nova-compute[75045]: Login to [iface: default, target: iqn.2010-10.org.openstack:4d7a4df0-bfc5-4952-8454-97b703b68f28, portal: 172.16.0.220,3260] successful.
Nov 08 23:18:28 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:18:28 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d7a4df0-bfc5-4952-8454-97b703b68f28 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:18:28 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:18:28 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[908ef9a3-727a-43ba-b1bd-b3e87e59342b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6217bd6e884\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:18:28 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:18:28 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d7a4df0-bfc5-4952-8454-97b703b68f28 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:18:28 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[00012c42-3937-40db-a290-28196c349d6f]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:18:28 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab95380e-7bf8-4df0-b646-129b1e213962 tempest-TestVolumeSwap-1282852572 tempest-TestVolumeSwap-1282852572-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:18:28 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:18:28 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.023s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:18:28 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c2a2ede-a523-4de8-981a-b84b2e8a0c5a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:18:28 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:18:28 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:18:28 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[15e5aa4e-35c3-4ec8-8d15-1281f9900757]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2068946-d374-45a4-9850-e3a690b13ef4 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c532e3b-4f3c-4809-bd49-fd7c2ea7f6cd (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d7a4df0-bfc5-4952-8454-97b703b68f28 (non-flash)\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:18:28 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab95380e-7bf8-4df0-b646-129b1e213962 tempest-TestVolumeSwap-1282852572 tempest-TestVolumeSwap-1282852572-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2068946-d374-45a4-9850-e3a690b13ef4 (non-flash)
Nov 08 23:18:28 user nova-compute[75045]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c532e3b-4f3c-4809-bd49-fd7c2ea7f6cd (non-flash)
Nov 08 23:18:28 user nova-compute[75045]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d7a4df0-bfc5-4952-8454-97b703b68f28 (non-flash)
Nov 08 23:18:28 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 23:18:28 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab95380e-7bf8-4df0-b646-129b1e213962 tempest-TestVolumeSwap-1282852572 tempest-TestVolumeSwap-1282852572-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2068946-d374-45a4-9850-e3a690b13ef4 (non-flash)
Nov 08 23:18:28 user nova-compute[75045]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c532e3b-4f3c-4809-bd49-fd7c2ea7f6cd (non-flash)
Nov 08 23:18:28 user nova-compute[75045]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d7a4df0-bfc5-4952-8454-97b703b68f28 (non-flash)
Nov 08 23:18:28 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 23:18:28 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-ab95380e-7bf8-4df0-b646-129b1e213962 tempest-TestVolumeSwap-1282852572 tempest-TestVolumeSwap-1282852572-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4d7a4df0-bfc5-4952-8454-97b703b68f28" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.306s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 23:18:28 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab95380e-7bf8-4df0-b646-129b1e213962 tempest-TestVolumeSwap-1282852572 tempest-TestVolumeSwap-1282852572-project-member] Connected to 172.16.0.220:3260 {{(pid=75045) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 23:18:28 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-ab95380e-7bf8-4df0-b646-129b1e213962 tempest-TestVolumeSwap-1282852572 tempest-TestVolumeSwap-1282852572-project-member] HCTL ('35', '-', '-', 0) found on session 5 with lun 0 {{(pid=75045) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 23:18:28 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-ab95380e-7bf8-4df0-b646-129b1e213962 tempest-TestVolumeSwap-1282852572 tempest-TestVolumeSwap-1282852572-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75045) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 23:18:28 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:18:28 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e7cc549-968d-4bd7-b5c7-be2ca29e3782]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:18:28 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:18:28 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[6996aa6e-c446-4aa2-a666-0871e375eb27]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:18:28 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-f2c73ce0-f7d6-4e24-96e6-70de9b487fc2 tempest-VolumesAssistedSnapshotsTest-1482710492 tempest-VolumesAssistedSnapshotsTest-1482710492-project-admin] Running cmd (subprocess): nvme version {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:18:28 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-f2c73ce0-f7d6-4e24-96e6-70de9b487fc2 tempest-VolumesAssistedSnapshotsTest-1482710492 tempest-VolumesAssistedSnapshotsTest-1482710492-project-admin] 'nvme version' failed. Not Retrying. {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 23:18:28 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:18:28 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[d08c5177-0e47-47be-bdf4-7191417ccfb3]: (4, ('- - 0', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:18:28 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f2c73ce0-f7d6-4e24-96e6-70de9b487fc2 tempest-VolumesAssistedSnapshotsTest-1482710492 tempest-VolumesAssistedSnapshotsTest-1482710492-project-admin] nvme not present on system {{(pid=75045) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 23:18:28 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-ab95380e-7bf8-4df0-b646-129b1e213962 tempest-TestVolumeSwap-1282852572 tempest-TestVolumeSwap-1282852572-project-member] Searching for a device in session 5 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75045) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 23:18:28 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab95380e-7bf8-4df0-b646-129b1e213962 tempest-TestVolumeSwap-1282852572 tempest-TestVolumeSwap-1282852572-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:4d7a4df0-bfc5-4952-8454-97b703b68f28', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MzmZAnHp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75045) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 23:18:28 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:18:28 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 23:18:28 user nova-compute[75045]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 23:18:28 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed8cec7d-c95f-4410-b39e-d2f9fd85a25c]: (4, '') {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:18:28 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.lightos [None req-f2c73ce0-f7d6-4e24-96e6-70de9b487fc2 tempest-VolumesAssistedSnapshotsTest-1482710492 tempest-VolumesAssistedSnapshotsTest-1482710492-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75045) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 23:18:28 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.lightos [None req-f2c73ce0-f7d6-4e24-96e6-70de9b487fc2 tempest-VolumesAssistedSnapshotsTest-1482710492 tempest-VolumesAssistedSnapshotsTest-1482710492-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75045) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 23:18:28 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.lightos [None req-f2c73ce0-f7d6-4e24-96e6-70de9b487fc2 tempest-VolumesAssistedSnapshotsTest-1482710492 tempest-VolumesAssistedSnapshotsTest-1482710492-project-admin] LIGHTOS: no hostnqn found. {{(pid=75045) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 23:18:28 user nova-compute[75045]: DEBUG os_brick.utils [None req-f2c73ce0-f7d6-4e24-96e6-70de9b487fc2 tempest-VolumesAssistedSnapshotsTest-1482710492 tempest-VolumesAssistedSnapshotsTest-1482710492-project-admin] <== get_connector_properties: return (153ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6217bd6e884', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75045) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 23:18:28 user nova-compute[75045]: DEBUG nova.virt.block_device [None req-f2c73ce0-f7d6-4e24-96e6-70de9b487fc2 tempest-VolumesAssistedSnapshotsTest-1482710492 tempest-VolumesAssistedSnapshotsTest-1482710492-project-admin] [instance: 07ec2c05-aaa9-46e8-8439-7aa5b9fca19d] Updating existing volume attachment record: 26c69f9b-0d17-4287-be1d-869123134253 {{(pid=75045) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 23:18:28 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-acf7f888-75c1-4764-a679-61493c54e5ab tempest-AttachSCSIVolumeTestJSON-1576344526 tempest-AttachSCSIVolumeTestJSON-1576344526-project-member] Lock "b9bd3096-92eb-4aae-8619-2725ed9acc2b" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 27.030s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:18:29 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-ab95380e-7bf8-4df0-b646-129b1e213962 tempest-TestVolumeSwap-1282852572 tempest-TestVolumeSwap-1282852572-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.374s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 23:18:29 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab95380e-7bf8-4df0-b646-129b1e213962 tempest-TestVolumeSwap-1282852572 tempest-TestVolumeSwap-1282852572-project-member] <== connect_volume: return (1375ms) {'type': 'block', 'scsi_wwn': '23634643064613665', 'path': '/dev/sdd'} {{(pid=75045) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 23:18:29 user nova-compute[75045]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ab95380e-7bf8-4df0-b646-129b1e213962 tempest-TestVolumeSwap-1282852572 tempest-TestVolumeSwap-1282852572-project-member] [instance: fde91f7c-31e3-456c-b252-6ce37fa3b600] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23634643064613665', 'path': '/dev/sdd'} {{(pid=75045) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 23:18:29 user nova-compute[75045]: DEBUG nova.objects.instance [None req-ab95380e-7bf8-4df0-b646-129b1e213962 tempest-TestVolumeSwap-1282852572 tempest-TestVolumeSwap-1282852572-project-member] Lazy-loading 'flavor' on Instance uuid fde91f7c-31e3-456c-b252-6ce37fa3b600 {{(pid=75045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 23:18:29 user nova-compute[75045]: DEBUG nova.virt.libvirt.guest [None req-ab95380e-7bf8-4df0-b646-129b1e213962 tempest-TestVolumeSwap-1282852572 tempest-TestVolumeSwap-1282852572-project-member] attach device xml: <disk type="block" device="disk">
Nov 08 23:18:29 user nova-compute[75045]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 23:18:29 user nova-compute[75045]:   <source dev="/dev/sdd"/>
Nov 08 23:18:29 user nova-compute[75045]:   <target dev="vdb" bus="virtio"/>
Nov 08 23:18:29 user nova-compute[75045]:   <serial>4d7a4df0-bfc5-4952-8454-97b703b68f28</serial>
Nov 08 23:18:29 user nova-compute[75045]: </disk>
Nov 08 23:18:29 user nova-compute[75045]:  {{(pid=75045) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 08 23:18:29 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:18:29 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-ab95380e-7bf8-4df0-b646-129b1e213962 tempest-TestVolumeSwap-1282852572 tempest-TestVolumeSwap-1282852572-project-member] No BDM found with device name vda, not building metadata. {{(pid=75045) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 23:18:29 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-ab95380e-7bf8-4df0-b646-129b1e213962 tempest-TestVolumeSwap-1282852572 tempest-TestVolumeSwap-1282852572-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75045) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 23:18:29 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-ab95380e-7bf8-4df0-b646-129b1e213962 tempest-TestVolumeSwap-1282852572 tempest-TestVolumeSwap-1282852572-project-member] No VIF found with MAC fa:16:3e:a5:67:d3, not building metadata {{(pid=75045) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 23:18:29 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:18:29 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:18:30 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:18:30 user nova-compute[75045]: DEBUG nova.compute.manager [req-ff1d0063-78be-4476-b720-305e414204bb req-971b0924-45ec-4110-84d6-a4e1ce82488c service nova] [instance: 82bc5fd0-26c7-4f81-b966-54831393b617] Received event network-changed-5d77f7bf-dc8f-4aa2-9c4a-48d0e81d7451 {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:18:30 user nova-compute[75045]: DEBUG nova.compute.manager [req-ff1d0063-78be-4476-b720-305e414204bb req-971b0924-45ec-4110-84d6-a4e1ce82488c service nova] [instance: 82bc5fd0-26c7-4f81-b966-54831393b617] Refreshing instance network info cache due to event network-changed-5d77f7bf-dc8f-4aa2-9c4a-48d0e81d7451. {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 23:18:30 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-ff1d0063-78be-4476-b720-305e414204bb req-971b0924-45ec-4110-84d6-a4e1ce82488c service nova] Acquiring lock "refresh_cache-82bc5fd0-26c7-4f81-b966-54831393b617" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 23:18:30 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-ff1d0063-78be-4476-b720-305e414204bb req-971b0924-45ec-4110-84d6-a4e1ce82488c service nova] Acquired lock "refresh_cache-82bc5fd0-26c7-4f81-b966-54831393b617" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 23:18:30 user nova-compute[75045]: DEBUG nova.network.neutron [req-ff1d0063-78be-4476-b720-305e414204bb req-971b0924-45ec-4110-84d6-a4e1ce82488c service nova] [instance: 82bc5fd0-26c7-4f81-b966-54831393b617] Refreshing network info cache for port 5d77f7bf-dc8f-4aa2-9c4a-48d0e81d7451 {{(pid=75045) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 23:18:30 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager.update_available_resource {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:18:31 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:18:31 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:18:31 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:18:31 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Auditing locally available compute resources for user (node: user) {{(pid=75045) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 23:18:31 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82bc5fd0-26c7-4f81-b966-54831393b617/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:18:31 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82bc5fd0-26c7-4f81-b966-54831393b617/disk --force-share --output=json" returned: 0 in 0.282s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:18:31 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82bc5fd0-26c7-4f81-b966-54831393b617/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:18:31 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82bc5fd0-26c7-4f81-b966-54831393b617/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:18:31 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ae5ff6b-6f2c-4dfd-a4c6-da4809e2cf27/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:18:31 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ae5ff6b-6f2c-4dfd-a4c6-da4809e2cf27/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:18:31 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ae5ff6b-6f2c-4dfd-a4c6-da4809e2cf27/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:18:31 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-082394c4-e179-437a-8b30-c03773aae2a3 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Acquiring lock "d2c911cf-d5f4-4c19-8335-8c7834184a7e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:18:31 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-082394c4-e179-437a-8b30-c03773aae2a3 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Lock "d2c911cf-d5f4-4c19-8335-8c7834184a7e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:18:31 user nova-compute[75045]: DEBUG nova.compute.manager [None req-082394c4-e179-437a-8b30-c03773aae2a3 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] [instance: d2c911cf-d5f4-4c19-8335-8c7834184a7e] Starting instance... {{(pid=75045) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 23:18:32 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ae5ff6b-6f2c-4dfd-a4c6-da4809e2cf27/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:18:32 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1cb1b440-0073-4a53-a0a2-e2781e021866/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:18:32 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-082394c4-e179-437a-8b30-c03773aae2a3 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:18:32 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-082394c4-e179-437a-8b30-c03773aae2a3 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.004s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:18:32 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-082394c4-e179-437a-8b30-c03773aae2a3 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75045) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 23:18:32 user nova-compute[75045]: INFO nova.compute.claims [None req-082394c4-e179-437a-8b30-c03773aae2a3 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] [instance: d2c911cf-d5f4-4c19-8335-8c7834184a7e] Claim successful on node user
Nov 08 23:18:32 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1cb1b440-0073-4a53-a0a2-e2781e021866/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:18:32 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1cb1b440-0073-4a53-a0a2-e2781e021866/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:18:32 user nova-compute[75045]: DEBUG nova.network.neutron [req-ff1d0063-78be-4476-b720-305e414204bb req-971b0924-45ec-4110-84d6-a4e1ce82488c service nova] [instance: 82bc5fd0-26c7-4f81-b966-54831393b617] Updated VIF entry in instance network info cache for port 5d77f7bf-dc8f-4aa2-9c4a-48d0e81d7451. {{(pid=75045) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 23:18:32 user nova-compute[75045]: DEBUG nova.network.neutron [req-ff1d0063-78be-4476-b720-305e414204bb req-971b0924-45ec-4110-84d6-a4e1ce82488c service nova] [instance: 82bc5fd0-26c7-4f81-b966-54831393b617] Updating instance_info_cache with network_info: [{"id": "5d77f7bf-dc8f-4aa2-9c4a-48d0e81d7451", "address": "fa:16:3e:4a:29:50", "network": {"id": "3f41081c-be28-40e3-bf5d-dd18368a2c49", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-102171439-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.170", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f8880c89fe3a444eb5e87aa0c0f82a19", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d77f7bf-dc", "ovs_interfaceid": "5d77f7bf-dc8f-4aa2-9c4a-48d0e81d7451", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75045) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 23:18:32 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1cb1b440-0073-4a53-a0a2-e2781e021866/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:18:32 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-ff1d0063-78be-4476-b720-305e414204bb req-971b0924-45ec-4110-84d6-a4e1ce82488c service nova] Releasing lock "refresh_cache-82bc5fd0-26c7-4f81-b966-54831393b617" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 23:18:32 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f21fcd3-ac5f-499e-9c34-82af806fda1d/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:18:32 user nova-compute[75045]: DEBUG nova.compute.provider_tree [None req-082394c4-e179-437a-8b30-c03773aae2a3 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Inventory has not changed in ProviderTree for provider: 62ba5f85-c74d-4b58-986e-d4197e813fd7 {{(pid=75045) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 23:18:32 user nova-compute[75045]: DEBUG nova.scheduler.client.report [None req-082394c4-e179-437a-8b30-c03773aae2a3 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Inventory has not changed for provider 62ba5f85-c74d-4b58-986e-d4197e813fd7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75045) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 23:18:32 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:18:32 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-082394c4-e179-437a-8b30-c03773aae2a3 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.595s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:18:32 user nova-compute[75045]: DEBUG nova.compute.manager [None req-082394c4-e179-437a-8b30-c03773aae2a3 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] [instance: d2c911cf-d5f4-4c19-8335-8c7834184a7e] Start building networks asynchronously for instance. {{(pid=75045) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 23:18:32 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f21fcd3-ac5f-499e-9c34-82af806fda1d/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:18:32 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f21fcd3-ac5f-499e-9c34-82af806fda1d/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:18:32 user nova-compute[75045]: DEBUG nova.compute.manager [None req-082394c4-e179-437a-8b30-c03773aae2a3 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] [instance: d2c911cf-d5f4-4c19-8335-8c7834184a7e] Allocating IP information in the background. {{(pid=75045) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 23:18:32 user nova-compute[75045]: DEBUG nova.network.neutron [None req-082394c4-e179-437a-8b30-c03773aae2a3 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] [instance: d2c911cf-d5f4-4c19-8335-8c7834184a7e] allocate_for_instance() {{(pid=75045) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 23:18:32 user nova-compute[75045]: INFO nova.virt.libvirt.driver [None req-082394c4-e179-437a-8b30-c03773aae2a3 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] [instance: d2c911cf-d5f4-4c19-8335-8c7834184a7e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 23:18:32 user nova-compute[75045]: DEBUG nova.compute.manager [None req-082394c4-e179-437a-8b30-c03773aae2a3 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] [instance: d2c911cf-d5f4-4c19-8335-8c7834184a7e] Start building block device mappings for instance. {{(pid=75045) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 23:18:32 user nova-compute[75045]: INFO nova.virt.block_device [None req-082394c4-e179-437a-8b30-c03773aae2a3 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] [instance: d2c911cf-d5f4-4c19-8335-8c7834184a7e] Booting with blank volume at /dev/vda
Nov 08 23:18:32 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f21fcd3-ac5f-499e-9c34-82af806fda1d/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:18:32 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07ec2c05-aaa9-46e8-8439-7aa5b9fca19d/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:18:32 user nova-compute[75045]: DEBUG nova.policy [None req-082394c4-e179-437a-8b30-c03773aae2a3 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '04bb3135250f4465a9947b47f9cde485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bfb6963a6c145d4a7b7e47c8fde7e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75045) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 23:18:33 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07ec2c05-aaa9-46e8-8439-7aa5b9fca19d/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:18:33 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07ec2c05-aaa9-46e8-8439-7aa5b9fca19d/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:18:33 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07ec2c05-aaa9-46e8-8439-7aa5b9fca19d/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:18:33 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fde91f7c-31e3-456c-b252-6ce37fa3b600/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:18:33 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fde91f7c-31e3-456c-b252-6ce37fa3b600/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:18:33 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fde91f7c-31e3-456c-b252-6ce37fa3b600/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:18:33 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fde91f7c-31e3-456c-b252-6ce37fa3b600/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:18:33 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75045) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 23:18:33 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9bd3096-92eb-4aae-8619-2725ed9acc2b/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:18:33 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:18:33 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9bd3096-92eb-4aae-8619-2725ed9acc2b/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:18:33 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9bd3096-92eb-4aae-8619-2725ed9acc2b/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:18:33 user nova-compute[75045]: DEBUG nova.network.neutron [None req-082394c4-e179-437a-8b30-c03773aae2a3 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] [instance: d2c911cf-d5f4-4c19-8335-8c7834184a7e] Successfully created port: f4321c52-b9d5-434c-820f-25cab4239ef4 {{(pid=75045) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 23:18:34 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9bd3096-92eb-4aae-8619-2725ed9acc2b/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:18:34 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] skipping disk /dev/sdc (sdc) as it is a volume {{(pid=75045) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 23:18:34 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75045) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 23:18:34 user nova-compute[75045]: WARNING nova.virt.libvirt.driver [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 23:18:34 user nova-compute[75045]: WARNING nova.virt.libvirt.driver [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 23:18:34 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Hypervisor/Node resource view: name=user free_ram=7805MB free_disk=25.462955474853516GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75045) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 23:18:34 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:18:34 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:18:34 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Instance 4ae5ff6b-6f2c-4dfd-a4c6-da4809e2cf27 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75045) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 23:18:34 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Instance 0f21fcd3-ac5f-499e-9c34-82af806fda1d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75045) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 23:18:34 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Instance b9bd3096-92eb-4aae-8619-2725ed9acc2b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75045) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 23:18:34 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Instance 1cb1b440-0073-4a53-a0a2-e2781e021866 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75045) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 23:18:34 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Instance fde91f7c-31e3-456c-b252-6ce37fa3b600 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75045) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 23:18:34 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Instance 07ec2c05-aaa9-46e8-8439-7aa5b9fca19d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75045) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 23:18:34 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Instance 82bc5fd0-26c7-4f81-b966-54831393b617 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75045) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 23:18:34 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Instance 725866aa-0e2a-4af3-af20-48157e6d2fcb actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75045) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 23:18:34 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Instance 520eac4f-fa48-4e41-924d-840907e701b4 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75045) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 23:18:34 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Instance d2c911cf-d5f4-4c19-8335-8c7834184a7e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75045) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 23:18:34 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=75045) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 23:18:34 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=75045) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 23:18:35 user nova-compute[75045]: DEBUG nova.compute.provider_tree [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Inventory has not changed in ProviderTree for provider: 62ba5f85-c74d-4b58-986e-d4197e813fd7 {{(pid=75045) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 23:18:35 user nova-compute[75045]: DEBUG nova.scheduler.client.report [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Inventory has not changed for provider 62ba5f85-c74d-4b58-986e-d4197e813fd7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75045) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 23:18:35 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Compute_service record updated for user:user {{(pid=75045) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 23:18:35 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.556s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:18:35 user nova-compute[75045]: DEBUG nova.network.neutron [None req-082394c4-e179-437a-8b30-c03773aae2a3 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] [instance: d2c911cf-d5f4-4c19-8335-8c7834184a7e] Successfully updated port: f4321c52-b9d5-434c-820f-25cab4239ef4 {{(pid=75045) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 23:18:35 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-082394c4-e179-437a-8b30-c03773aae2a3 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Acquiring lock "refresh_cache-d2c911cf-d5f4-4c19-8335-8c7834184a7e" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 23:18:35 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-082394c4-e179-437a-8b30-c03773aae2a3 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Acquired lock "refresh_cache-d2c911cf-d5f4-4c19-8335-8c7834184a7e" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 23:18:35 user nova-compute[75045]: DEBUG nova.network.neutron [None req-082394c4-e179-437a-8b30-c03773aae2a3 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] [instance: d2c911cf-d5f4-4c19-8335-8c7834184a7e] Building network info cache for instance {{(pid=75045) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 23:18:35 user nova-compute[75045]: DEBUG nova.compute.manager [req-2fc73ec3-86d9-4530-8f11-6ce68aa98185 req-d752febe-c32f-4b35-bd5f-9ac6c9b9cf3f service nova] [instance: d2c911cf-d5f4-4c19-8335-8c7834184a7e] Received event network-changed-f4321c52-b9d5-434c-820f-25cab4239ef4 {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:18:35 user nova-compute[75045]: DEBUG nova.compute.manager [req-2fc73ec3-86d9-4530-8f11-6ce68aa98185 req-d752febe-c32f-4b35-bd5f-9ac6c9b9cf3f service nova] [instance: d2c911cf-d5f4-4c19-8335-8c7834184a7e] Refreshing instance network info cache due to event network-changed-f4321c52-b9d5-434c-820f-25cab4239ef4. {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 23:18:35 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-2fc73ec3-86d9-4530-8f11-6ce68aa98185 req-d752febe-c32f-4b35-bd5f-9ac6c9b9cf3f service nova] Acquiring lock "refresh_cache-d2c911cf-d5f4-4c19-8335-8c7834184a7e" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 23:18:35 user nova-compute[75045]: DEBUG nova.network.neutron [None req-082394c4-e179-437a-8b30-c03773aae2a3 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] [instance: d2c911cf-d5f4-4c19-8335-8c7834184a7e] Instance cache missing network info. {{(pid=75045) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 23:18:35 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:18:36 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:18:36 user nova-compute[75045]: DEBUG nova.network.neutron [None req-082394c4-e179-437a-8b30-c03773aae2a3 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] [instance: d2c911cf-d5f4-4c19-8335-8c7834184a7e] Updating instance_info_cache with network_info: [{"id": "f4321c52-b9d5-434c-820f-25cab4239ef4", "address": "fa:16:3e:49:6b:27", "network": {"id": "d4cd6998-66d1-4389-bc82-dd000c8962de", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-323966879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bfb6963a6c145d4a7b7e47c8fde7e60", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4321c52-b9", "ovs_interfaceid": "f4321c52-b9d5-434c-820f-25cab4239ef4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75045) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 23:18:36 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-082394c4-e179-437a-8b30-c03773aae2a3 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Releasing lock "refresh_cache-d2c911cf-d5f4-4c19-8335-8c7834184a7e" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 23:18:36 user nova-compute[75045]: DEBUG nova.compute.manager [None req-082394c4-e179-437a-8b30-c03773aae2a3 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] [instance: d2c911cf-d5f4-4c19-8335-8c7834184a7e] Instance network_info: |[{"id": "f4321c52-b9d5-434c-820f-25cab4239ef4", "address": "fa:16:3e:49:6b:27", "network": {"id": "d4cd6998-66d1-4389-bc82-dd000c8962de", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-323966879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bfb6963a6c145d4a7b7e47c8fde7e60", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4321c52-b9", "ovs_interfaceid": "f4321c52-b9d5-434c-820f-25cab4239ef4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75045) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 23:18:36 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-2fc73ec3-86d9-4530-8f11-6ce68aa98185 req-d752febe-c32f-4b35-bd5f-9ac6c9b9cf3f service nova] Acquired lock "refresh_cache-d2c911cf-d5f4-4c19-8335-8c7834184a7e" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 23:18:36 user nova-compute[75045]: DEBUG nova.network.neutron [req-2fc73ec3-86d9-4530-8f11-6ce68aa98185 req-d752febe-c32f-4b35-bd5f-9ac6c9b9cf3f service nova] [instance: d2c911cf-d5f4-4c19-8335-8c7834184a7e] Refreshing network info cache for port f4321c52-b9d5-434c-820f-25cab4239ef4 {{(pid=75045) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 23:18:37 user nova-compute[75045]: DEBUG nova.network.neutron [req-2fc73ec3-86d9-4530-8f11-6ce68aa98185 req-d752febe-c32f-4b35-bd5f-9ac6c9b9cf3f service nova] [instance: d2c911cf-d5f4-4c19-8335-8c7834184a7e] Updated VIF entry in instance network info cache for port f4321c52-b9d5-434c-820f-25cab4239ef4. {{(pid=75045) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 23:18:37 user nova-compute[75045]: DEBUG nova.network.neutron [req-2fc73ec3-86d9-4530-8f11-6ce68aa98185 req-d752febe-c32f-4b35-bd5f-9ac6c9b9cf3f service nova] [instance: d2c911cf-d5f4-4c19-8335-8c7834184a7e] Updating instance_info_cache with network_info: [{"id": "f4321c52-b9d5-434c-820f-25cab4239ef4", "address": "fa:16:3e:49:6b:27", "network": {"id": "d4cd6998-66d1-4389-bc82-dd000c8962de", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-323966879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bfb6963a6c145d4a7b7e47c8fde7e60", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4321c52-b9", "ovs_interfaceid": "f4321c52-b9d5-434c-820f-25cab4239ef4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75045) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 23:18:37 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-2fc73ec3-86d9-4530-8f11-6ce68aa98185 req-d752febe-c32f-4b35-bd5f-9ac6c9b9cf3f service nova] Releasing lock "refresh_cache-d2c911cf-d5f4-4c19-8335-8c7834184a7e" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 23:18:37 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:18:37 user nova-compute[75045]: DEBUG nova.compute.manager [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Starting heal instance info cache {{(pid=75045) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 23:18:37 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Acquiring lock "refresh_cache-0f21fcd3-ac5f-499e-9c34-82af806fda1d" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 23:18:37 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Acquired lock "refresh_cache-0f21fcd3-ac5f-499e-9c34-82af806fda1d" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 23:18:37 user nova-compute[75045]: DEBUG nova.network.neutron [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] [instance: 0f21fcd3-ac5f-499e-9c34-82af806fda1d] Forcefully refreshing network info cache for instance {{(pid=75045) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 23:18:37 user nova-compute[75045]: DEBUG nova.network.neutron [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] [instance: 0f21fcd3-ac5f-499e-9c34-82af806fda1d] Updating instance_info_cache with network_info: [{"id": "ab02704d-73c2-409c-9d43-1a087ebf369a", "address": "fa:16:3e:b3:b2:47", "network": {"id": "700b5784-d35b-45c0-a4d3-1ab8aa4c48aa", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-194469807-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.175", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e63623113f11463d9035bb990de43510", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab02704d-73", "ovs_interfaceid": "ab02704d-73c2-409c-9d43-1a087ebf369a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75045) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 23:18:37 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Releasing lock "refresh_cache-0f21fcd3-ac5f-499e-9c34-82af806fda1d" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 23:18:37 user nova-compute[75045]: DEBUG nova.compute.manager [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] [instance: 0f21fcd3-ac5f-499e-9c34-82af806fda1d] Updated the network info_cache for instance {{(pid=75045) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 23:18:37 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:18:37 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:18:37 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:18:37 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:18:37 user nova-compute[75045]: DEBUG nova.compute.manager [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75045) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 23:18:37 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:18:40 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:18:42 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:18:44 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-ab95380e-7bf8-4df0-b646-129b1e213962 tempest-TestVolumeSwap-1282852572 tempest-TestVolumeSwap-1282852572-project-member] Lock "fde91f7c-31e3-456c-b252-6ce37fa3b600" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 41.211s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:18:45 user nova-compute[75045]: INFO nova.virt.block_device [None req-ac28c4dc-b349-4d76-b20f-521f64e4c39b tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] [instance: 520eac4f-fa48-4e41-924d-840907e701b4] Booting with volume 8d2ff5d0-0b89-42ba-92eb-1e12c9cce205 at /dev/vdc
Nov 08 23:18:45 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:18:45 user nova-compute[75045]: DEBUG os_brick.utils [None req-ac28c4dc-b349-4d76-b20f-521f64e4c39b tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75045) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 23:18:45 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:18:45 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.021s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:18:45 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f632c10-6eb7-4662-83ed-1e7ee05d84c7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6217bd6e884\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:18:45 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:18:45 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:18:45 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[16bcd0e7-a014-4573-9839-8719e2458398]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:18:45 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:18:45 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:18:45 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[6acfecba-c4ce-4ca5-aa95-8681e84794df]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:18:45 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[75dfee47-73b6-4008-97b2-9b51eab538bd]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:18:45 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-ac28c4dc-b349-4d76-b20f-521f64e4c39b tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] Running cmd (subprocess): nvme version {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:18:45 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-ac28c4dc-b349-4d76-b20f-521f64e4c39b tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] 'nvme version' failed. Not Retrying. {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 23:18:45 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ac28c4dc-b349-4d76-b20f-521f64e4c39b tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] nvme not present on system {{(pid=75045) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 23:18:45 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:18:45 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 23:18:45 user nova-compute[75045]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 23:18:45 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[568ad24a-0d2b-414b-9ff3-e9b03438170f]: (4, '') {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:18:45 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.lightos [None req-ac28c4dc-b349-4d76-b20f-521f64e4c39b tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75045) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 23:18:45 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.lightos [None req-ac28c4dc-b349-4d76-b20f-521f64e4c39b tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75045) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 23:18:45 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.lightos [None req-ac28c4dc-b349-4d76-b20f-521f64e4c39b tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] LIGHTOS: no hostnqn found. {{(pid=75045) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 23:18:45 user nova-compute[75045]: DEBUG os_brick.utils [None req-ac28c4dc-b349-4d76-b20f-521f64e4c39b tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] <== get_connector_properties: return (150ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6217bd6e884', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75045) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 23:18:45 user nova-compute[75045]: DEBUG nova.virt.block_device [None req-ac28c4dc-b349-4d76-b20f-521f64e4c39b tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] [instance: 520eac4f-fa48-4e41-924d-840907e701b4] Updating existing volume attachment record: fabc07cf-caf4-4261-b1a7-10f44ceb7174 {{(pid=75045) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 23:18:45 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-3e20b61e-19c4-460d-831a-0137ef420f72 tempest-TaggedBootDevicesTest_v242-1022497165 tempest-TaggedBootDevicesTest_v242-1022497165-project-member] Acquiring lock "84f0b650-5f58-443d-92a2-bbd5240a0b6f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:18:45 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-3e20b61e-19c4-460d-831a-0137ef420f72 tempest-TaggedBootDevicesTest_v242-1022497165 tempest-TaggedBootDevicesTest_v242-1022497165-project-member] Lock "84f0b650-5f58-443d-92a2-bbd5240a0b6f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:18:45 user nova-compute[75045]: DEBUG nova.compute.manager [None req-3e20b61e-19c4-460d-831a-0137ef420f72 tempest-TaggedBootDevicesTest_v242-1022497165 tempest-TaggedBootDevicesTest_v242-1022497165-project-member] [instance: 84f0b650-5f58-443d-92a2-bbd5240a0b6f] Starting instance... {{(pid=75045) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 23:18:46 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-3e20b61e-19c4-460d-831a-0137ef420f72 tempest-TaggedBootDevicesTest_v242-1022497165 tempest-TaggedBootDevicesTest_v242-1022497165-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:18:46 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-3e20b61e-19c4-460d-831a-0137ef420f72 tempest-TaggedBootDevicesTest_v242-1022497165 tempest-TaggedBootDevicesTest_v242-1022497165-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:18:46 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-3e20b61e-19c4-460d-831a-0137ef420f72 tempest-TaggedBootDevicesTest_v242-1022497165 tempest-TaggedBootDevicesTest_v242-1022497165-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75045) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 23:18:46 user nova-compute[75045]: INFO nova.compute.claims [None req-3e20b61e-19c4-460d-831a-0137ef420f72 tempest-TaggedBootDevicesTest_v242-1022497165 tempest-TaggedBootDevicesTest_v242-1022497165-project-member] [instance: 84f0b650-5f58-443d-92a2-bbd5240a0b6f] Claim successful on node user
Nov 08 23:18:46 user nova-compute[75045]: DEBUG nova.compute.provider_tree [None req-3e20b61e-19c4-460d-831a-0137ef420f72 tempest-TaggedBootDevicesTest_v242-1022497165 tempest-TaggedBootDevicesTest_v242-1022497165-project-member] Inventory has not changed in ProviderTree for provider: 62ba5f85-c74d-4b58-986e-d4197e813fd7 {{(pid=75045) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 23:18:46 user nova-compute[75045]: DEBUG nova.scheduler.client.report [None req-3e20b61e-19c4-460d-831a-0137ef420f72 tempest-TaggedBootDevicesTest_v242-1022497165 tempest-TaggedBootDevicesTest_v242-1022497165-project-member] Inventory has not changed for provider 62ba5f85-c74d-4b58-986e-d4197e813fd7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75045) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 23:18:46 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-3e20b61e-19c4-460d-831a-0137ef420f72 tempest-TaggedBootDevicesTest_v242-1022497165 tempest-TaggedBootDevicesTest_v242-1022497165-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.483s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:18:46 user nova-compute[75045]: DEBUG nova.compute.manager [None req-3e20b61e-19c4-460d-831a-0137ef420f72 tempest-TaggedBootDevicesTest_v242-1022497165 tempest-TaggedBootDevicesTest_v242-1022497165-project-member] [instance: 84f0b650-5f58-443d-92a2-bbd5240a0b6f] Start building networks asynchronously for instance. {{(pid=75045) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 23:18:46 user nova-compute[75045]: DEBUG nova.compute.manager [None req-3e20b61e-19c4-460d-831a-0137ef420f72 tempest-TaggedBootDevicesTest_v242-1022497165 tempest-TaggedBootDevicesTest_v242-1022497165-project-member] [instance: 84f0b650-5f58-443d-92a2-bbd5240a0b6f] Allocating IP information in the background. {{(pid=75045) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 23:18:46 user nova-compute[75045]: DEBUG nova.network.neutron [None req-3e20b61e-19c4-460d-831a-0137ef420f72 tempest-TaggedBootDevicesTest_v242-1022497165 tempest-TaggedBootDevicesTest_v242-1022497165-project-member] [instance: 84f0b650-5f58-443d-92a2-bbd5240a0b6f] allocate_for_instance() {{(pid=75045) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 23:18:47 user nova-compute[75045]: INFO nova.virt.libvirt.driver [None req-3e20b61e-19c4-460d-831a-0137ef420f72 tempest-TaggedBootDevicesTest_v242-1022497165 tempest-TaggedBootDevicesTest_v242-1022497165-project-member] [instance: 84f0b650-5f58-443d-92a2-bbd5240a0b6f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 23:18:47 user nova-compute[75045]: DEBUG nova.compute.manager [None req-3e20b61e-19c4-460d-831a-0137ef420f72 tempest-TaggedBootDevicesTest_v242-1022497165 tempest-TaggedBootDevicesTest_v242-1022497165-project-member] [instance: 84f0b650-5f58-443d-92a2-bbd5240a0b6f] Start building block device mappings for instance. {{(pid=75045) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 23:18:47 user nova-compute[75045]: DEBUG nova.policy [None req-3e20b61e-19c4-460d-831a-0137ef420f72 tempest-TaggedBootDevicesTest_v242-1022497165 tempest-TaggedBootDevicesTest_v242-1022497165-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '138a510eaf5a489790a3ebc21fde5481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2adf8b4b78eb494d8fa806e9d7c592a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75045) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 23:18:47 user nova-compute[75045]: INFO nova.virt.block_device [None req-3e20b61e-19c4-460d-831a-0137ef420f72 tempest-TaggedBootDevicesTest_v242-1022497165 tempest-TaggedBootDevicesTest_v242-1022497165-project-member] [instance: 84f0b650-5f58-443d-92a2-bbd5240a0b6f] Booting with volume 48ebf6bb-f8ec-45f7-aa58-04e071193771 at /dev/vda
Nov 08 23:18:47 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:18:48 user nova-compute[75045]: DEBUG nova.network.neutron [None req-3e20b61e-19c4-460d-831a-0137ef420f72 tempest-TaggedBootDevicesTest_v242-1022497165 tempest-TaggedBootDevicesTest_v242-1022497165-project-member] [instance: 84f0b650-5f58-443d-92a2-bbd5240a0b6f] Successfully created port: fc4db695-a5ec-4a17-ae30-8d21e4f4824e {{(pid=75045) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 23:18:48 user nova-compute[75045]: DEBUG nova.network.neutron [None req-3e20b61e-19c4-460d-831a-0137ef420f72 tempest-TaggedBootDevicesTest_v242-1022497165 tempest-TaggedBootDevicesTest_v242-1022497165-project-member] [instance: 84f0b650-5f58-443d-92a2-bbd5240a0b6f] Successfully created port: b9c4728f-f4cc-49c9-aca5-288b818b9c34 {{(pid=75045) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 23:18:49 user nova-compute[75045]: DEBUG nova.network.neutron [None req-3e20b61e-19c4-460d-831a-0137ef420f72 tempest-TaggedBootDevicesTest_v242-1022497165 tempest-TaggedBootDevicesTest_v242-1022497165-project-member] [instance: 84f0b650-5f58-443d-92a2-bbd5240a0b6f] Successfully created port: ddf04b42-4dcd-4981-a301-5b51c3a5a86e {{(pid=75045) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 23:18:50 user nova-compute[75045]: DEBUG nova.network.neutron [None req-3e20b61e-19c4-460d-831a-0137ef420f72 tempest-TaggedBootDevicesTest_v242-1022497165 tempest-TaggedBootDevicesTest_v242-1022497165-project-member] [instance: 84f0b650-5f58-443d-92a2-bbd5240a0b6f] Successfully created port: 5ba5ecd6-5bf3-4be1-b79b-d00e7d98d9f8 {{(pid=75045) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 23:18:50 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:18:50 user nova-compute[75045]: DEBUG nova.network.neutron [None req-3e20b61e-19c4-460d-831a-0137ef420f72 tempest-TaggedBootDevicesTest_v242-1022497165 tempest-TaggedBootDevicesTest_v242-1022497165-project-member] [instance: 84f0b650-5f58-443d-92a2-bbd5240a0b6f] Successfully created port: 1e76bdd5-2edb-4f5e-baa8-8d82ace77cf3 {{(pid=75045) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 23:18:51 user nova-compute[75045]: DEBUG nova.network.neutron [None req-3e20b61e-19c4-460d-831a-0137ef420f72 tempest-TaggedBootDevicesTest_v242-1022497165 tempest-TaggedBootDevicesTest_v242-1022497165-project-member] [instance: 84f0b650-5f58-443d-92a2-bbd5240a0b6f] Successfully updated port: fc4db695-a5ec-4a17-ae30-8d21e4f4824e {{(pid=75045) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 23:18:51 user nova-compute[75045]: DEBUG nova.compute.manager [req-9abd778b-3e06-4b88-8ea5-b2f1946ae08c req-c9d66f9e-aac4-4b23-afd2-513b3282b1a9 service nova] [instance: 84f0b650-5f58-443d-92a2-bbd5240a0b6f] Received event network-changed-fc4db695-a5ec-4a17-ae30-8d21e4f4824e {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:18:51 user nova-compute[75045]: DEBUG nova.compute.manager [req-9abd778b-3e06-4b88-8ea5-b2f1946ae08c req-c9d66f9e-aac4-4b23-afd2-513b3282b1a9 service nova] [instance: 84f0b650-5f58-443d-92a2-bbd5240a0b6f] Refreshing instance network info cache due to event network-changed-fc4db695-a5ec-4a17-ae30-8d21e4f4824e. {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 23:18:51 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-9abd778b-3e06-4b88-8ea5-b2f1946ae08c req-c9d66f9e-aac4-4b23-afd2-513b3282b1a9 service nova] Acquiring lock "refresh_cache-84f0b650-5f58-443d-92a2-bbd5240a0b6f" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 23:18:51 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-9abd778b-3e06-4b88-8ea5-b2f1946ae08c req-c9d66f9e-aac4-4b23-afd2-513b3282b1a9 service nova] Acquired lock "refresh_cache-84f0b650-5f58-443d-92a2-bbd5240a0b6f" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 23:18:51 user nova-compute[75045]: DEBUG nova.network.neutron [req-9abd778b-3e06-4b88-8ea5-b2f1946ae08c req-c9d66f9e-aac4-4b23-afd2-513b3282b1a9 service nova] [instance: 84f0b650-5f58-443d-92a2-bbd5240a0b6f] Refreshing network info cache for port fc4db695-a5ec-4a17-ae30-8d21e4f4824e {{(pid=75045) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 23:18:51 user nova-compute[75045]: DEBUG nova.network.neutron [req-9abd778b-3e06-4b88-8ea5-b2f1946ae08c req-c9d66f9e-aac4-4b23-afd2-513b3282b1a9 service nova] [instance: 84f0b650-5f58-443d-92a2-bbd5240a0b6f] Instance cache missing network info. {{(pid=75045) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 23:18:51 user nova-compute[75045]: DEBUG nova.network.neutron [req-9abd778b-3e06-4b88-8ea5-b2f1946ae08c req-c9d66f9e-aac4-4b23-afd2-513b3282b1a9 service nova] [instance: 84f0b650-5f58-443d-92a2-bbd5240a0b6f] Updating instance_info_cache with network_info: [] {{(pid=75045) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 23:18:51 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-9abd778b-3e06-4b88-8ea5-b2f1946ae08c req-c9d66f9e-aac4-4b23-afd2-513b3282b1a9 service nova] Releasing lock "refresh_cache-84f0b650-5f58-443d-92a2-bbd5240a0b6f" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 23:18:51 user nova-compute[75045]: DEBUG nova.network.neutron [None req-3e20b61e-19c4-460d-831a-0137ef420f72 tempest-TaggedBootDevicesTest_v242-1022497165 tempest-TaggedBootDevicesTest_v242-1022497165-project-member] [instance: 84f0b650-5f58-443d-92a2-bbd5240a0b6f] Successfully updated port: 3bf6df35-9e21-4f9b-8d1f-1d0bea146bd4 {{(pid=75045) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 23:18:52 user nova-compute[75045]: DEBUG nova.network.neutron [None req-3e20b61e-19c4-460d-831a-0137ef420f72 tempest-TaggedBootDevicesTest_v242-1022497165 tempest-TaggedBootDevicesTest_v242-1022497165-project-member] [instance: 84f0b650-5f58-443d-92a2-bbd5240a0b6f] Successfully updated port: 61b1ec8c-48bc-413b-b19f-48909a05358d {{(pid=75045) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 23:18:52 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:18:52 user nova-compute[75045]: DEBUG nova.network.neutron [None req-3e20b61e-19c4-460d-831a-0137ef420f72 tempest-TaggedBootDevicesTest_v242-1022497165 tempest-TaggedBootDevicesTest_v242-1022497165-project-member] [instance: 84f0b650-5f58-443d-92a2-bbd5240a0b6f] Successfully updated port: b9c4728f-f4cc-49c9-aca5-288b818b9c34 {{(pid=75045) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 23:18:53 user nova-compute[75045]: DEBUG nova.compute.manager [req-1e3bc501-88d6-4814-93fa-b713a5738689 req-941e7ba8-50ed-4706-9554-02bc901645dd service nova] [instance: 84f0b650-5f58-443d-92a2-bbd5240a0b6f] Received event network-changed-3bf6df35-9e21-4f9b-8d1f-1d0bea146bd4 {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:18:53 user nova-compute[75045]: DEBUG nova.compute.manager [req-1e3bc501-88d6-4814-93fa-b713a5738689 req-941e7ba8-50ed-4706-9554-02bc901645dd service nova] [instance: 84f0b650-5f58-443d-92a2-bbd5240a0b6f] Refreshing instance network info cache due to event network-changed-3bf6df35-9e21-4f9b-8d1f-1d0bea146bd4. {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 23:18:53 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-1e3bc501-88d6-4814-93fa-b713a5738689 req-941e7ba8-50ed-4706-9554-02bc901645dd service nova] Acquiring lock "refresh_cache-84f0b650-5f58-443d-92a2-bbd5240a0b6f" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 23:18:53 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-1e3bc501-88d6-4814-93fa-b713a5738689 req-941e7ba8-50ed-4706-9554-02bc901645dd service nova] Acquired lock "refresh_cache-84f0b650-5f58-443d-92a2-bbd5240a0b6f" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 23:18:53 user nova-compute[75045]: DEBUG nova.network.neutron [req-1e3bc501-88d6-4814-93fa-b713a5738689 req-941e7ba8-50ed-4706-9554-02bc901645dd service nova] [instance: 84f0b650-5f58-443d-92a2-bbd5240a0b6f] Refreshing network info cache for port 3bf6df35-9e21-4f9b-8d1f-1d0bea146bd4 {{(pid=75045) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 23:18:53 user nova-compute[75045]: DEBUG nova.network.neutron [req-1e3bc501-88d6-4814-93fa-b713a5738689 req-941e7ba8-50ed-4706-9554-02bc901645dd service nova] [instance: 84f0b650-5f58-443d-92a2-bbd5240a0b6f] Instance cache missing network info. {{(pid=75045) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 23:18:54 user nova-compute[75045]: DEBUG nova.network.neutron [None req-3e20b61e-19c4-460d-831a-0137ef420f72 tempest-TaggedBootDevicesTest_v242-1022497165 tempest-TaggedBootDevicesTest_v242-1022497165-project-member] [instance: 84f0b650-5f58-443d-92a2-bbd5240a0b6f] Successfully updated port: ddf04b42-4dcd-4981-a301-5b51c3a5a86e {{(pid=75045) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 23:18:54 user nova-compute[75045]: DEBUG nova.network.neutron [req-1e3bc501-88d6-4814-93fa-b713a5738689 req-941e7ba8-50ed-4706-9554-02bc901645dd service nova] [instance: 84f0b650-5f58-443d-92a2-bbd5240a0b6f] Updating instance_info_cache with network_info: [] {{(pid=75045) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 23:18:54 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-1e3bc501-88d6-4814-93fa-b713a5738689 req-941e7ba8-50ed-4706-9554-02bc901645dd service nova] Releasing lock "refresh_cache-84f0b650-5f58-443d-92a2-bbd5240a0b6f" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 23:18:54 user nova-compute[75045]: DEBUG nova.compute.manager [req-1e3bc501-88d6-4814-93fa-b713a5738689 req-941e7ba8-50ed-4706-9554-02bc901645dd service nova] [instance: 84f0b650-5f58-443d-92a2-bbd5240a0b6f] Received event network-changed-61b1ec8c-48bc-413b-b19f-48909a05358d {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:18:54 user nova-compute[75045]: DEBUG nova.compute.manager [req-1e3bc501-88d6-4814-93fa-b713a5738689 req-941e7ba8-50ed-4706-9554-02bc901645dd service nova] [instance: 84f0b650-5f58-443d-92a2-bbd5240a0b6f] Refreshing instance network info cache due to event network-changed-61b1ec8c-48bc-413b-b19f-48909a05358d. {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 23:18:54 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-1e3bc501-88d6-4814-93fa-b713a5738689 req-941e7ba8-50ed-4706-9554-02bc901645dd service nova] Acquiring lock "refresh_cache-84f0b650-5f58-443d-92a2-bbd5240a0b6f" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 23:18:54 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-1e3bc501-88d6-4814-93fa-b713a5738689 req-941e7ba8-50ed-4706-9554-02bc901645dd service nova] Acquired lock "refresh_cache-84f0b650-5f58-443d-92a2-bbd5240a0b6f" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 23:18:54 user nova-compute[75045]: DEBUG nova.network.neutron [req-1e3bc501-88d6-4814-93fa-b713a5738689 req-941e7ba8-50ed-4706-9554-02bc901645dd service nova] [instance: 84f0b650-5f58-443d-92a2-bbd5240a0b6f] Refreshing network info cache for port 61b1ec8c-48bc-413b-b19f-48909a05358d {{(pid=75045) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 23:18:54 user nova-compute[75045]: DEBUG nova.network.neutron [req-1e3bc501-88d6-4814-93fa-b713a5738689 req-941e7ba8-50ed-4706-9554-02bc901645dd service nova] [instance: 84f0b650-5f58-443d-92a2-bbd5240a0b6f] Instance cache missing network info. {{(pid=75045) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 23:18:54 user nova-compute[75045]: DEBUG nova.network.neutron [req-1e3bc501-88d6-4814-93fa-b713a5738689 req-941e7ba8-50ed-4706-9554-02bc901645dd service nova] [instance: 84f0b650-5f58-443d-92a2-bbd5240a0b6f] Updating instance_info_cache with network_info: [] {{(pid=75045) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 23:18:54 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-1e3bc501-88d6-4814-93fa-b713a5738689 req-941e7ba8-50ed-4706-9554-02bc901645dd service nova] Releasing lock "refresh_cache-84f0b650-5f58-443d-92a2-bbd5240a0b6f" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 23:18:54 user nova-compute[75045]: DEBUG nova.compute.manager [req-1e3bc501-88d6-4814-93fa-b713a5738689 req-941e7ba8-50ed-4706-9554-02bc901645dd service nova] [instance: 84f0b650-5f58-443d-92a2-bbd5240a0b6f] Received event network-changed-b9c4728f-f4cc-49c9-aca5-288b818b9c34 {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:18:54 user nova-compute[75045]: DEBUG nova.compute.manager [req-1e3bc501-88d6-4814-93fa-b713a5738689 req-941e7ba8-50ed-4706-9554-02bc901645dd service nova] [instance: 84f0b650-5f58-443d-92a2-bbd5240a0b6f] Refreshing instance network info cache due to event network-changed-b9c4728f-f4cc-49c9-aca5-288b818b9c34. {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 23:18:54 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-1e3bc501-88d6-4814-93fa-b713a5738689 req-941e7ba8-50ed-4706-9554-02bc901645dd service nova] Acquiring lock "refresh_cache-84f0b650-5f58-443d-92a2-bbd5240a0b6f" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 23:18:54 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-1e3bc501-88d6-4814-93fa-b713a5738689 req-941e7ba8-50ed-4706-9554-02bc901645dd service nova] Acquired lock "refresh_cache-84f0b650-5f58-443d-92a2-bbd5240a0b6f" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 23:18:54 user nova-compute[75045]: DEBUG nova.network.neutron [req-1e3bc501-88d6-4814-93fa-b713a5738689 req-941e7ba8-50ed-4706-9554-02bc901645dd service nova] [instance: 84f0b650-5f58-443d-92a2-bbd5240a0b6f] Refreshing network info cache for port b9c4728f-f4cc-49c9-aca5-288b818b9c34 {{(pid=75045) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 23:18:54 user nova-compute[75045]: DEBUG nova.network.neutron [req-1e3bc501-88d6-4814-93fa-b713a5738689 req-941e7ba8-50ed-4706-9554-02bc901645dd service nova] [instance: 84f0b650-5f58-443d-92a2-bbd5240a0b6f] Instance cache missing network info. {{(pid=75045) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 23:18:54 user nova-compute[75045]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f2c73ce0-f7d6-4e24-96e6-70de9b487fc2 tempest-VolumesAssistedSnapshotsTest-1482710492 tempest-VolumesAssistedSnapshotsTest-1482710492-project-admin] [instance: 07ec2c05-aaa9-46e8-8439-7aa5b9fca19d] Calling os-brick to attach iSCSI Volume {{(pid=75045) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 23:18:54 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2c73ce0-f7d6-4e24-96e6-70de9b487fc2 tempest-VolumesAssistedSnapshotsTest-1482710492 tempest-VolumesAssistedSnapshotsTest-1482710492-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1b68210460>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f829f03c-8f1a-45f1-a715-b9d769201d1b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PmvVbZrA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75045) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 23:18:54 user nova-compute[75045]: WARNING os_brick.initiator.connectors.base [None req-f2c73ce0-f7d6-4e24-96e6-70de9b487fc2 tempest-VolumesAssistedSnapshotsTest-1482710492 tempest-VolumesAssistedSnapshotsTest-1482710492-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 23:18:54 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-f2c73ce0-f7d6-4e24-96e6-70de9b487fc2 tempest-VolumesAssistedSnapshotsTest-1482710492 tempest-VolumesAssistedSnapshotsTest-1482710492-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 23:18:54 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-f2c73ce0-f7d6-4e24-96e6-70de9b487fc2 tempest-VolumesAssistedSnapshotsTest-1482710492 tempest-VolumesAssistedSnapshotsTest-1482710492-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.006s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 23:18:54 user nova-compute[75045]: WARNING os_brick.initiator.connectors.base [None req-f2c73ce0-f7d6-4e24-96e6-70de9b487fc2 tempest-VolumesAssistedSnapshotsTest-1482710492 tempest-VolumesAssistedSnapshotsTest-1482710492-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 23:18:54 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-f2c73ce0-f7d6-4e24-96e6-70de9b487fc2 tempest-VolumesAssistedSnapshotsTest-1482710492 tempest-VolumesAssistedSnapshotsTest-1482710492-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f829f03c-8f1a-45f1-a715-b9d769201d1b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 23:18:54 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-f2c73ce0-f7d6-4e24-96e6-70de9b487fc2 tempest-VolumesAssistedSnapshotsTest-1482710492 tempest-VolumesAssistedSnapshotsTest-1482710492-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f829f03c-8f1a-45f1-a715-b9d769201d1b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 23:18:54 user nova-compute[75045]: INFO os_brick.initiator.connectors.iscsi [None req-f2c73ce0-f7d6-4e24-96e6-70de9b487fc2 tempest-VolumesAssistedSnapshotsTest-1482710492 tempest-VolumesAssistedSnapshotsTest-1482710492-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 23:18:54 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f829f03c-8f1a-45f1-a715-b9d769201d1b -p 172.16.0.220:3260 {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:18:54 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f829f03c-8f1a-45f1-a715-b9d769201d1b -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:18:54 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0ff4c6f-c971-4483-91ab-517bd1875aa2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:18:54 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2c73ce0-f7d6-4e24-96e6-70de9b487fc2 tempest-VolumesAssistedSnapshotsTest-1482710492 tempest-VolumesAssistedSnapshotsTest-1482710492-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 23:18:54 user nova-compute[75045]:  {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:18:54 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f829f03c-8f1a-45f1-a715-b9d769201d1b -p 172.16.0.220:3260 --interface default --op new {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:18:54 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f829f03c-8f1a-45f1-a715-b9d769201d1b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:18:54 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[94e8f6c2-f876-4b7b-b83e-2599941617fa]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f829f03c-8f1a-45f1-a715-b9d769201d1b] added\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:18:54 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2c73ce0-f7d6-4e24-96e6-70de9b487fc2 tempest-VolumesAssistedSnapshotsTest-1482710492 tempest-VolumesAssistedSnapshotsTest-1482710492-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f829f03c-8f1a-45f1-a715-b9d769201d1b] added
Nov 08 23:18:54 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:18:54 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f829f03c-8f1a-45f1-a715-b9d769201d1b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:18:54 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f829f03c-8f1a-45f1-a715-b9d769201d1b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.030s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:18:54 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7b2f44d-e8f3-42aa-a43c-f243d79f9974]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:18:54 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2c73ce0-f7d6-4e24-96e6-70de9b487fc2 tempest-VolumesAssistedSnapshotsTest-1482710492 tempest-VolumesAssistedSnapshotsTest-1482710492-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:18:54 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f829f03c-8f1a-45f1-a715-b9d769201d1b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:18:54 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f829f03c-8f1a-45f1-a715-b9d769201d1b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.029s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:18:54 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[da47304e-bd9d-418c-96b8-3edfb0f469bb]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:18:54 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2c73ce0-f7d6-4e24-96e6-70de9b487fc2 tempest-VolumesAssistedSnapshotsTest-1482710492 tempest-VolumesAssistedSnapshotsTest-1482710492-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:18:54 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f829f03c-8f1a-45f1-a715-b9d769201d1b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PmvVbZrA {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:18:54 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-6c41194c-864d-4a5a-a7f2-b7c9367b17c9 tempest-AttachSCSIVolumeTestJSON-1576344526 tempest-AttachSCSIVolumeTestJSON-1576344526-project-member] Acquiring lock "b9bd3096-92eb-4aae-8619-2725ed9acc2b" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:18:54 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-6c41194c-864d-4a5a-a7f2-b7c9367b17c9 tempest-AttachSCSIVolumeTestJSON-1576344526 tempest-AttachSCSIVolumeTestJSON-1576344526-project-member] Lock "b9bd3096-92eb-4aae-8619-2725ed9acc2b" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:18:54 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f829f03c-8f1a-45f1-a715-b9d769201d1b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PmvVbZrA" returned: 0 in 0.022s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:18:54 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[6aa52bcc-49df-4500-8bf6-977d4a98c741]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:18:54 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2c73ce0-f7d6-4e24-96e6-70de9b487fc2 tempest-VolumesAssistedSnapshotsTest-1482710492 tempest-VolumesAssistedSnapshotsTest-1482710492-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'PmvVbZrA'): stdout= stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:18:54 user nova-compute[75045]: DEBUG nova.network.neutron [req-1e3bc501-88d6-4814-93fa-b713a5738689 req-941e7ba8-50ed-4706-9554-02bc901645dd service nova] [instance: 84f0b650-5f58-443d-92a2-bbd5240a0b6f] Updating instance_info_cache with network_info: [] {{(pid=75045) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 23:18:54 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f829f03c-8f1a-45f1-a715-b9d769201d1b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:18:54 user nova-compute[75045]: INFO nova.compute.manager [None req-6c41194c-864d-4a5a-a7f2-b7c9367b17c9 tempest-AttachSCSIVolumeTestJSON-1576344526 tempest-AttachSCSIVolumeTestJSON-1576344526-project-member] [instance: b9bd3096-92eb-4aae-8619-2725ed9acc2b] Detaching volume 8c532e3b-4f3c-4809-bd49-fd7c2ea7f6cd
Nov 08 23:18:54 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f829f03c-8f1a-45f1-a715-b9d769201d1b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:18:54 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[fabad4df-c4de-4dc5-b79f-690824458258]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:18:54 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2c73ce0-f7d6-4e24-96e6-70de9b487fc2 tempest-VolumesAssistedSnapshotsTest-1482710492 tempest-VolumesAssistedSnapshotsTest-1482710492-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:18:54 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:18:54 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-1e3bc501-88d6-4814-93fa-b713a5738689 req-941e7ba8-50ed-4706-9554-02bc901645dd service nova] Releasing lock "refresh_cache-84f0b650-5f58-443d-92a2-bbd5240a0b6f" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 23:18:54 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:18:54 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[608c2302-a6d3-4e1c-b2fd-5e2b3ee18f8c]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2068946-d374-45a4-9850-e3a690b13ef4 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c532e3b-4f3c-4809-bd49-fd7c2ea7f6cd (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d7a4df0-bfc5-4952-8454-97b703b68f28 (non-flash)\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:18:54 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2c73ce0-f7d6-4e24-96e6-70de9b487fc2 tempest-VolumesAssistedSnapshotsTest-1482710492 tempest-VolumesAssistedSnapshotsTest-1482710492-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2068946-d374-45a4-9850-e3a690b13ef4 (non-flash)
Nov 08 23:18:54 user nova-compute[75045]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c532e3b-4f3c-4809-bd49-fd7c2ea7f6cd (non-flash)
Nov 08 23:18:54 user nova-compute[75045]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d7a4df0-bfc5-4952-8454-97b703b68f28 (non-flash)
Nov 08 23:18:54 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 23:18:54 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2c73ce0-f7d6-4e24-96e6-70de9b487fc2 tempest-VolumesAssistedSnapshotsTest-1482710492 tempest-VolumesAssistedSnapshotsTest-1482710492-project-admin] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2068946-d374-45a4-9850-e3a690b13ef4 (non-flash)
Nov 08 23:18:54 user nova-compute[75045]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c532e3b-4f3c-4809-bd49-fd7c2ea7f6cd (non-flash)
Nov 08 23:18:54 user nova-compute[75045]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d7a4df0-bfc5-4952-8454-97b703b68f28 (non-flash)
Nov 08 23:18:54 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 23:18:54 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f829f03c-8f1a-45f1-a715-b9d769201d1b -p 172.16.0.220:3260 --login {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:18:54 user nova-compute[75045]: DEBUG nova.network.neutron [None req-3e20b61e-19c4-460d-831a-0137ef420f72 tempest-TaggedBootDevicesTest_v242-1022497165 tempest-TaggedBootDevicesTest_v242-1022497165-project-member] [instance: 84f0b650-5f58-443d-92a2-bbd5240a0b6f] Successfully updated port: 5ba5ecd6-5bf3-4be1-b79b-d00e7d98d9f8 {{(pid=75045) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 23:18:54 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f829f03c-8f1a-45f1-a715-b9d769201d1b -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:18:54 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ca726a1-cfeb-4bf4-b46d-33a67020610f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f829f03c-8f1a-45f1-a715-b9d769201d1b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f829f03c-8f1a-45f1-a715-b9d769201d1b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:18:54 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2c73ce0-f7d6-4e24-96e6-70de9b487fc2 tempest-VolumesAssistedSnapshotsTest-1482710492 tempest-VolumesAssistedSnapshotsTest-1482710492-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f829f03c-8f1a-45f1-a715-b9d769201d1b, portal: 172.16.0.220,3260]
Nov 08 23:18:54 user nova-compute[75045]: Login to [iface: default, target: iqn.2010-10.org.openstack:f829f03c-8f1a-45f1-a715-b9d769201d1b, portal: 172.16.0.220,3260] successful.
Nov 08 23:18:54 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:18:54 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f829f03c-8f1a-45f1-a715-b9d769201d1b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:18:54 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f829f03c-8f1a-45f1-a715-b9d769201d1b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.028s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:18:54 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[efe45cf7-a1d0-4937-9bd0-938658bfabfc]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:18:54 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2c73ce0-f7d6-4e24-96e6-70de9b487fc2 tempest-VolumesAssistedSnapshotsTest-1482710492 tempest-VolumesAssistedSnapshotsTest-1482710492-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:18:54 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:18:54 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:18:54 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[3be16513-a1fe-4d5b-8b22-7f30bd38790d]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2068946-d374-45a4-9850-e3a690b13ef4 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c532e3b-4f3c-4809-bd49-fd7c2ea7f6cd (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d7a4df0-bfc5-4952-8454-97b703b68f28 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f829f03c-8f1a-45f1-a715-b9d769201d1b (non-flash)\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:18:54 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2c73ce0-f7d6-4e24-96e6-70de9b487fc2 tempest-VolumesAssistedSnapshotsTest-1482710492 tempest-VolumesAssistedSnapshotsTest-1482710492-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2068946-d374-45a4-9850-e3a690b13ef4 (non-flash)
Nov 08 23:18:54 user nova-compute[75045]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c532e3b-4f3c-4809-bd49-fd7c2ea7f6cd (non-flash)
Nov 08 23:18:54 user nova-compute[75045]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d7a4df0-bfc5-4952-8454-97b703b68f28 (non-flash)
Nov 08 23:18:54 user nova-compute[75045]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f829f03c-8f1a-45f1-a715-b9d769201d1b (non-flash)
Nov 08 23:18:54 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 23:18:54 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2c73ce0-f7d6-4e24-96e6-70de9b487fc2 tempest-VolumesAssistedSnapshotsTest-1482710492 tempest-VolumesAssistedSnapshotsTest-1482710492-project-admin] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2068946-d374-45a4-9850-e3a690b13ef4 (non-flash)
Nov 08 23:18:54 user nova-compute[75045]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c532e3b-4f3c-4809-bd49-fd7c2ea7f6cd (non-flash)
Nov 08 23:18:54 user nova-compute[75045]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d7a4df0-bfc5-4952-8454-97b703b68f28 (non-flash)
Nov 08 23:18:54 user nova-compute[75045]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f829f03c-8f1a-45f1-a715-b9d769201d1b (non-flash)
Nov 08 23:18:54 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 23:18:54 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-f2c73ce0-f7d6-4e24-96e6-70de9b487fc2 tempest-VolumesAssistedSnapshotsTest-1482710492 tempest-VolumesAssistedSnapshotsTest-1482710492-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f829f03c-8f1a-45f1-a715-b9d769201d1b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.331s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 23:18:54 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2c73ce0-f7d6-4e24-96e6-70de9b487fc2 tempest-VolumesAssistedSnapshotsTest-1482710492 tempest-VolumesAssistedSnapshotsTest-1482710492-project-admin] Connected to 172.16.0.220:3260 {{(pid=75045) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 23:18:54 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-f2c73ce0-f7d6-4e24-96e6-70de9b487fc2 tempest-VolumesAssistedSnapshotsTest-1482710492 tempest-VolumesAssistedSnapshotsTest-1482710492-project-admin] HCTL ('36', '-', '-', 0) found on session 6 with lun 0 {{(pid=75045) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 23:18:54 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-f2c73ce0-f7d6-4e24-96e6-70de9b487fc2 tempest-VolumesAssistedSnapshotsTest-1482710492 tempest-VolumesAssistedSnapshotsTest-1482710492-project-admin] Scanning host 36 c: -, t: -, l: 0) {{(pid=75045) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 23:18:54 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:18:55 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.023s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:18:55 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9dca6f6-f8cf-48b3-bbbb-35950db799fe]: (4, ('- - 0', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:18:55 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-f2c73ce0-f7d6-4e24-96e6-70de9b487fc2 tempest-VolumesAssistedSnapshotsTest-1482710492 tempest-VolumesAssistedSnapshotsTest-1482710492-project-admin] Searching for a device in session 6 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75045) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 23:18:55 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2c73ce0-f7d6-4e24-96e6-70de9b487fc2 tempest-VolumesAssistedSnapshotsTest-1482710492 tempest-VolumesAssistedSnapshotsTest-1482710492-project-admin] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:f829f03c-8f1a-45f1-a715-b9d769201d1b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PmvVbZrA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75045) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 23:18:55 user nova-compute[75045]: DEBUG os_brick.utils [None req-3e20b61e-19c4-460d-831a-0137ef420f72 tempest-TaggedBootDevicesTest_v242-1022497165 tempest-TaggedBootDevicesTest_v242-1022497165-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75045) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 23:18:55 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:18:55 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:18:55 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa61bce5-af7f-4cf2-b6c7-47d23725f862]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6217bd6e884\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:18:55 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:18:55 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:18:55 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d30cfff-8b88-4546-986f-f05e6d23fb6d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:18:55 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:18:55 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:18:55 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[81eab3ba-83d3-42e0-b855-19a3f84197ba]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:18:55 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[46b12593-aa45-4872-9667-66710515d05b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:18:55 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-3e20b61e-19c4-460d-831a-0137ef420f72 tempest-TaggedBootDevicesTest_v242-1022497165 tempest-TaggedBootDevicesTest_v242-1022497165-project-member] Running cmd (subprocess): nvme version {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:18:55 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-3e20b61e-19c4-460d-831a-0137ef420f72 tempest-TaggedBootDevicesTest_v242-1022497165 tempest-TaggedBootDevicesTest_v242-1022497165-project-member] 'nvme version' failed. Not Retrying. {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 23:18:55 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3e20b61e-19c4-460d-831a-0137ef420f72 tempest-TaggedBootDevicesTest_v242-1022497165 tempest-TaggedBootDevicesTest_v242-1022497165-project-member] nvme not present on system {{(pid=75045) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 23:18:55 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:18:55 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 23:18:55 user nova-compute[75045]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 23:18:55 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b72fef9-9597-417c-a8a8-bbd3d8d854f0]: (4, '') {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:18:55 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.lightos [None req-3e20b61e-19c4-460d-831a-0137ef420f72 tempest-TaggedBootDevicesTest_v242-1022497165 tempest-TaggedBootDevicesTest_v242-1022497165-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75045) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 23:18:55 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.lightos [None req-3e20b61e-19c4-460d-831a-0137ef420f72 tempest-TaggedBootDevicesTest_v242-1022497165 tempest-TaggedBootDevicesTest_v242-1022497165-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75045) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 23:18:55 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.lightos [None req-3e20b61e-19c4-460d-831a-0137ef420f72 tempest-TaggedBootDevicesTest_v242-1022497165 tempest-TaggedBootDevicesTest_v242-1022497165-project-member] LIGHTOS: no hostnqn found. {{(pid=75045) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 23:18:55 user nova-compute[75045]: DEBUG os_brick.utils [None req-3e20b61e-19c4-460d-831a-0137ef420f72 tempest-TaggedBootDevicesTest_v242-1022497165 tempest-TaggedBootDevicesTest_v242-1022497165-project-member] <== get_connector_properties: return (149ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6217bd6e884', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75045) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 23:18:55 user nova-compute[75045]: DEBUG nova.virt.block_device [None req-3e20b61e-19c4-460d-831a-0137ef420f72 tempest-TaggedBootDevicesTest_v242-1022497165 tempest-TaggedBootDevicesTest_v242-1022497165-project-member] [instance: 84f0b650-5f58-443d-92a2-bbd5240a0b6f] Updating existing volume attachment record: 19c45a63-97ae-4f38-8bc0-48600c0e2938 {{(pid=75045) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 23:18:55 user nova-compute[75045]: INFO nova.virt.block_device [None req-6c41194c-864d-4a5a-a7f2-b7c9367b17c9 tempest-AttachSCSIVolumeTestJSON-1576344526 tempest-AttachSCSIVolumeTestJSON-1576344526-project-member] [instance: b9bd3096-92eb-4aae-8619-2725ed9acc2b] Attempting to driver detach volume 8c532e3b-4f3c-4809-bd49-fd7c2ea7f6cd from mountpoint /dev/sdc
Nov 08 23:18:55 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-6c41194c-864d-4a5a-a7f2-b7c9367b17c9 tempest-AttachSCSIVolumeTestJSON-1576344526 tempest-AttachSCSIVolumeTestJSON-1576344526-project-member] Attempting to detach device sdc from instance b9bd3096-92eb-4aae-8619-2725ed9acc2b from the persistent domain config. {{(pid=75045) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 08 23:18:55 user nova-compute[75045]: DEBUG nova.virt.libvirt.guest [None req-6c41194c-864d-4a5a-a7f2-b7c9367b17c9 tempest-AttachSCSIVolumeTestJSON-1576344526 tempest-AttachSCSIVolumeTestJSON-1576344526-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 23:18:55 user nova-compute[75045]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 23:18:55 user nova-compute[75045]:   <source dev="/dev/sdc"/>
Nov 08 23:18:55 user nova-compute[75045]:   <target dev="sdc" bus="scsi"/>
Nov 08 23:18:55 user nova-compute[75045]:   <serial>8c532e3b-4f3c-4809-bd49-fd7c2ea7f6cd</serial>
Nov 08 23:18:55 user nova-compute[75045]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Nov 08 23:18:55 user nova-compute[75045]: </disk>
Nov 08 23:18:55 user nova-compute[75045]:  {{(pid=75045) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 23:18:55 user nova-compute[75045]: INFO nova.virt.libvirt.driver [None req-6c41194c-864d-4a5a-a7f2-b7c9367b17c9 tempest-AttachSCSIVolumeTestJSON-1576344526 tempest-AttachSCSIVolumeTestJSON-1576344526-project-member] Successfully detached device sdc from instance b9bd3096-92eb-4aae-8619-2725ed9acc2b from the persistent domain config.
Nov 08 23:18:55 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-6c41194c-864d-4a5a-a7f2-b7c9367b17c9 tempest-AttachSCSIVolumeTestJSON-1576344526 tempest-AttachSCSIVolumeTestJSON-1576344526-project-member] (1/8): Attempting to detach device sdc with device alias scsi0-0-0-2 from instance b9bd3096-92eb-4aae-8619-2725ed9acc2b from the live domain config. {{(pid=75045) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 08 23:18:55 user nova-compute[75045]: DEBUG nova.virt.libvirt.guest [None req-6c41194c-864d-4a5a-a7f2-b7c9367b17c9 tempest-AttachSCSIVolumeTestJSON-1576344526 tempest-AttachSCSIVolumeTestJSON-1576344526-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 23:18:55 user nova-compute[75045]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 23:18:55 user nova-compute[75045]:   <source dev="/dev/sdc"/>
Nov 08 23:18:55 user nova-compute[75045]:   <target dev="sdc" bus="scsi"/>
Nov 08 23:18:55 user nova-compute[75045]:   <serial>8c532e3b-4f3c-4809-bd49-fd7c2ea7f6cd</serial>
Nov 08 23:18:55 user nova-compute[75045]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Nov 08 23:18:55 user nova-compute[75045]: </disk>
Nov 08 23:18:55 user nova-compute[75045]:  {{(pid=75045) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 23:18:55 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-cc2764da-d4bb-4f4b-b69a-c9c557549c98 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262-project-member] Acquiring lock "82bc5fd0-26c7-4f81-b966-54831393b617" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:18:55 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-cc2764da-d4bb-4f4b-b69a-c9c557549c98 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262-project-member] Lock "82bc5fd0-26c7-4f81-b966-54831393b617" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:18:55 user nova-compute[75045]: DEBUG nova.objects.instance [None req-cc2764da-d4bb-4f4b-b69a-c9c557549c98 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262-project-member] Lazy-loading 'flavor' on Instance uuid 82bc5fd0-26c7-4f81-b966-54831393b617 {{(pid=75045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 23:18:55 user nova-compute[75045]: DEBUG nova.compute.manager [req-118c55d3-1254-4df1-8643-a6a1adf4d6a8 req-f9473751-2c3d-497a-8844-c6c206dceffb service nova] [instance: 84f0b650-5f58-443d-92a2-bbd5240a0b6f] Received event network-changed-ddf04b42-4dcd-4981-a301-5b51c3a5a86e {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:18:55 user nova-compute[75045]: DEBUG nova.compute.manager [req-118c55d3-1254-4df1-8643-a6a1adf4d6a8 req-f9473751-2c3d-497a-8844-c6c206dceffb service nova] [instance: 84f0b650-5f58-443d-92a2-bbd5240a0b6f] Refreshing instance network info cache due to event network-changed-ddf04b42-4dcd-4981-a301-5b51c3a5a86e. {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 23:18:55 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-118c55d3-1254-4df1-8643-a6a1adf4d6a8 req-f9473751-2c3d-497a-8844-c6c206dceffb service nova] Acquiring lock "refresh_cache-84f0b650-5f58-443d-92a2-bbd5240a0b6f" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 23:18:55 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-118c55d3-1254-4df1-8643-a6a1adf4d6a8 req-f9473751-2c3d-497a-8844-c6c206dceffb service nova] Acquired lock "refresh_cache-84f0b650-5f58-443d-92a2-bbd5240a0b6f" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 23:18:55 user nova-compute[75045]: DEBUG nova.network.neutron [req-118c55d3-1254-4df1-8643-a6a1adf4d6a8 req-f9473751-2c3d-497a-8844-c6c206dceffb service nova] [instance: 84f0b650-5f58-443d-92a2-bbd5240a0b6f] Refreshing network info cache for port ddf04b42-4dcd-4981-a301-5b51c3a5a86e {{(pid=75045) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 23:18:55 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-cc2764da-d4bb-4f4b-b69a-c9c557549c98 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262-project-member] Lock "82bc5fd0-26c7-4f81-b966-54831393b617" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.087s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:18:55 user nova-compute[75045]: DEBUG nova.network.neutron [req-118c55d3-1254-4df1-8643-a6a1adf4d6a8 req-f9473751-2c3d-497a-8844-c6c206dceffb service nova] [instance: 84f0b650-5f58-443d-92a2-bbd5240a0b6f] Instance cache missing network info. {{(pid=75045) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 23:18:55 user nova-compute[75045]: DEBUG nova.network.neutron [None req-3e20b61e-19c4-460d-831a-0137ef420f72 tempest-TaggedBootDevicesTest_v242-1022497165 tempest-TaggedBootDevicesTest_v242-1022497165-project-member] [instance: 84f0b650-5f58-443d-92a2-bbd5240a0b6f] Successfully updated port: 1e76bdd5-2edb-4f5e-baa8-8d82ace77cf3 {{(pid=75045) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 23:18:55 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-3e20b61e-19c4-460d-831a-0137ef420f72 tempest-TaggedBootDevicesTest_v242-1022497165 tempest-TaggedBootDevicesTest_v242-1022497165-project-member] Acquiring lock "refresh_cache-84f0b650-5f58-443d-92a2-bbd5240a0b6f" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 23:18:55 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-6c41194c-864d-4a5a-a7f2-b7c9367b17c9 tempest-AttachSCSIVolumeTestJSON-1576344526 tempest-AttachSCSIVolumeTestJSON-1576344526-project-member] Start waiting for the detach event from libvirt for device sdc with device alias scsi0-0-0-2 for instance b9bd3096-92eb-4aae-8619-2725ed9acc2b {{(pid=75045) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 08 23:18:56 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-f2c73ce0-f7d6-4e24-96e6-70de9b487fc2 tempest-VolumesAssistedSnapshotsTest-1482710492 tempest-VolumesAssistedSnapshotsTest-1482710492-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.379s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 23:18:56 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2c73ce0-f7d6-4e24-96e6-70de9b487fc2 tempest-VolumesAssistedSnapshotsTest-1482710492 tempest-VolumesAssistedSnapshotsTest-1482710492-project-admin] <== connect_volume: return (1386ms) {'type': 'block', 'scsi_wwn': '23736663063383230', 'path': '/dev/sde'} {{(pid=75045) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 23:18:56 user nova-compute[75045]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f2c73ce0-f7d6-4e24-96e6-70de9b487fc2 tempest-VolumesAssistedSnapshotsTest-1482710492 tempest-VolumesAssistedSnapshotsTest-1482710492-project-admin] [instance: 07ec2c05-aaa9-46e8-8439-7aa5b9fca19d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23736663063383230', 'path': '/dev/sde'} {{(pid=75045) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 23:18:56 user nova-compute[75045]: DEBUG nova.objects.instance [None req-f2c73ce0-f7d6-4e24-96e6-70de9b487fc2 tempest-VolumesAssistedSnapshotsTest-1482710492 tempest-VolumesAssistedSnapshotsTest-1482710492-project-admin] Lazy-loading 'flavor' on Instance uuid 07ec2c05-aaa9-46e8-8439-7aa5b9fca19d {{(pid=75045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 23:18:56 user nova-compute[75045]: DEBUG nova.virt.libvirt.guest [None req-f2c73ce0-f7d6-4e24-96e6-70de9b487fc2 tempest-VolumesAssistedSnapshotsTest-1482710492 tempest-VolumesAssistedSnapshotsTest-1482710492-project-admin] attach device xml: <disk type="block" device="disk">
Nov 08 23:18:56 user nova-compute[75045]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 23:18:56 user nova-compute[75045]:   <source dev="/dev/sde"/>
Nov 08 23:18:56 user nova-compute[75045]:   <target dev="vdb" bus="virtio"/>
Nov 08 23:18:56 user nova-compute[75045]:   <serial>f829f03c-8f1a-45f1-a715-b9d769201d1b</serial>
Nov 08 23:18:56 user nova-compute[75045]: </disk>
Nov 08 23:18:56 user nova-compute[75045]:  {{(pid=75045) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 08 23:18:56 user nova-compute[75045]: DEBUG nova.network.neutron [req-118c55d3-1254-4df1-8643-a6a1adf4d6a8 req-f9473751-2c3d-497a-8844-c6c206dceffb service nova] [instance: 84f0b650-5f58-443d-92a2-bbd5240a0b6f] Updating instance_info_cache with network_info: [] {{(pid=75045) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 23:18:56 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-118c55d3-1254-4df1-8643-a6a1adf4d6a8 req-f9473751-2c3d-497a-8844-c6c206dceffb service nova] Releasing lock "refresh_cache-84f0b650-5f58-443d-92a2-bbd5240a0b6f" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 23:18:56 user nova-compute[75045]: DEBUG nova.compute.manager [req-118c55d3-1254-4df1-8643-a6a1adf4d6a8 req-f9473751-2c3d-497a-8844-c6c206dceffb service nova] [instance: 84f0b650-5f58-443d-92a2-bbd5240a0b6f] Received event network-changed-5ba5ecd6-5bf3-4be1-b79b-d00e7d98d9f8 {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:18:56 user nova-compute[75045]: DEBUG nova.compute.manager [req-118c55d3-1254-4df1-8643-a6a1adf4d6a8 req-f9473751-2c3d-497a-8844-c6c206dceffb service nova] [instance: 84f0b650-5f58-443d-92a2-bbd5240a0b6f] Refreshing instance network info cache due to event network-changed-5ba5ecd6-5bf3-4be1-b79b-d00e7d98d9f8. {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 23:18:56 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-118c55d3-1254-4df1-8643-a6a1adf4d6a8 req-f9473751-2c3d-497a-8844-c6c206dceffb service nova] Acquiring lock "refresh_cache-84f0b650-5f58-443d-92a2-bbd5240a0b6f" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 23:18:56 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-118c55d3-1254-4df1-8643-a6a1adf4d6a8 req-f9473751-2c3d-497a-8844-c6c206dceffb service nova] Acquired lock "refresh_cache-84f0b650-5f58-443d-92a2-bbd5240a0b6f" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 23:18:56 user nova-compute[75045]: DEBUG nova.network.neutron [req-118c55d3-1254-4df1-8643-a6a1adf4d6a8 req-f9473751-2c3d-497a-8844-c6c206dceffb service nova] [instance: 84f0b650-5f58-443d-92a2-bbd5240a0b6f] Refreshing network info cache for port 5ba5ecd6-5bf3-4be1-b79b-d00e7d98d9f8 {{(pid=75045) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 23:18:56 user nova-compute[75045]: DEBUG nova.network.neutron [req-118c55d3-1254-4df1-8643-a6a1adf4d6a8 req-f9473751-2c3d-497a-8844-c6c206dceffb service nova] [instance: 84f0b650-5f58-443d-92a2-bbd5240a0b6f] Instance cache missing network info. {{(pid=75045) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 23:18:56 user nova-compute[75045]: DEBUG nova.network.neutron [req-118c55d3-1254-4df1-8643-a6a1adf4d6a8 req-f9473751-2c3d-497a-8844-c6c206dceffb service nova] [instance: 84f0b650-5f58-443d-92a2-bbd5240a0b6f] Updating instance_info_cache with network_info: [] {{(pid=75045) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 23:18:56 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-118c55d3-1254-4df1-8643-a6a1adf4d6a8 req-f9473751-2c3d-497a-8844-c6c206dceffb service nova] Releasing lock "refresh_cache-84f0b650-5f58-443d-92a2-bbd5240a0b6f" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 23:18:56 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-3e20b61e-19c4-460d-831a-0137ef420f72 tempest-TaggedBootDevicesTest_v242-1022497165 tempest-TaggedBootDevicesTest_v242-1022497165-project-member] Acquired lock "refresh_cache-84f0b650-5f58-443d-92a2-bbd5240a0b6f" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 23:18:56 user nova-compute[75045]: DEBUG nova.network.neutron [None req-3e20b61e-19c4-460d-831a-0137ef420f72 tempest-TaggedBootDevicesTest_v242-1022497165 tempest-TaggedBootDevicesTest_v242-1022497165-project-member] [instance: 84f0b650-5f58-443d-92a2-bbd5240a0b6f] Building network info cache for instance {{(pid=75045) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 23:18:56 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-f2c73ce0-f7d6-4e24-96e6-70de9b487fc2 tempest-VolumesAssistedSnapshotsTest-1482710492 tempest-VolumesAssistedSnapshotsTest-1482710492-project-admin] No BDM found with device name vda, not building metadata. {{(pid=75045) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 23:18:56 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-f2c73ce0-f7d6-4e24-96e6-70de9b487fc2 tempest-VolumesAssistedSnapshotsTest-1482710492 tempest-VolumesAssistedSnapshotsTest-1482710492-project-admin] No BDM found with device name vdb, not building metadata. {{(pid=75045) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 23:18:56 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-f2c73ce0-f7d6-4e24-96e6-70de9b487fc2 tempest-VolumesAssistedSnapshotsTest-1482710492 tempest-VolumesAssistedSnapshotsTest-1482710492-project-admin] No VIF found with MAC fa:16:3e:22:d3:3d, not building metadata {{(pid=75045) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 23:18:56 user nova-compute[75045]: DEBUG nova.network.neutron [None req-3e20b61e-19c4-460d-831a-0137ef420f72 tempest-TaggedBootDevicesTest_v242-1022497165 tempest-TaggedBootDevicesTest_v242-1022497165-project-member] [instance: 84f0b650-5f58-443d-92a2-bbd5240a0b6f] Instance cache missing network info. {{(pid=75045) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 23:18:56 user nova-compute[75045]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f44af977-35eb-44a0-bf36-9092d9d8a0e7 tempest-TaggedAttachmentsTest-1639503389 tempest-TaggedAttachmentsTest-1639503389-project-member] [instance: 1cb1b440-0073-4a53-a0a2-e2781e021866] Calling os-brick to attach iSCSI Volume {{(pid=75045) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 23:18:56 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-f44af977-35eb-44a0-bf36-9092d9d8a0e7 tempest-TaggedAttachmentsTest-1639503389 tempest-TaggedAttachmentsTest-1639503389-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1b68210460>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:528866cb-30dd-40ac-9a81-4c6afc93cdd9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mpVfHWuQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75045) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 23:18:56 user nova-compute[75045]: WARNING os_brick.initiator.connectors.base [None req-f44af977-35eb-44a0-bf36-9092d9d8a0e7 tempest-TaggedAttachmentsTest-1639503389 tempest-TaggedAttachmentsTest-1639503389-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 23:18:56 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-f44af977-35eb-44a0-bf36-9092d9d8a0e7 tempest-TaggedAttachmentsTest-1639503389 tempest-TaggedAttachmentsTest-1639503389-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 23:18:56 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-f44af977-35eb-44a0-bf36-9092d9d8a0e7 tempest-TaggedAttachmentsTest-1639503389 tempest-TaggedAttachmentsTest-1639503389-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 23:18:56 user nova-compute[75045]: WARNING os_brick.initiator.connectors.base [None req-f44af977-35eb-44a0-bf36-9092d9d8a0e7 tempest-TaggedAttachmentsTest-1639503389 tempest-TaggedAttachmentsTest-1639503389-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 23:18:56 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-f44af977-35eb-44a0-bf36-9092d9d8a0e7 tempest-TaggedAttachmentsTest-1639503389 tempest-TaggedAttachmentsTest-1639503389-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:528866cb-30dd-40ac-9a81-4c6afc93cdd9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 23:18:56 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-f44af977-35eb-44a0-bf36-9092d9d8a0e7 tempest-TaggedAttachmentsTest-1639503389 tempest-TaggedAttachmentsTest-1639503389-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:528866cb-30dd-40ac-9a81-4c6afc93cdd9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 23:18:56 user nova-compute[75045]: INFO os_brick.initiator.connectors.iscsi [None req-f44af977-35eb-44a0-bf36-9092d9d8a0e7 tempest-TaggedAttachmentsTest-1639503389 tempest-TaggedAttachmentsTest-1639503389-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 23:18:56 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:528866cb-30dd-40ac-9a81-4c6afc93cdd9 -p 172.16.0.220:3260 {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:18:56 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:528866cb-30dd-40ac-9a81-4c6afc93cdd9 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:18:56 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[15b4f732-2525-480f-80e9-80912c3d5d09]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:18:56 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-f44af977-35eb-44a0-bf36-9092d9d8a0e7 tempest-TaggedAttachmentsTest-1639503389 tempest-TaggedAttachmentsTest-1639503389-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 23:18:56 user nova-compute[75045]:  {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:18:56 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:528866cb-30dd-40ac-9a81-4c6afc93cdd9 -p 172.16.0.220:3260 --interface default --op new {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:18:56 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:528866cb-30dd-40ac-9a81-4c6afc93cdd9 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:18:56 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1cc4b11-c156-4247-9999-12b3ce2e17d4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:528866cb-30dd-40ac-9a81-4c6afc93cdd9] added\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:18:56 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-f44af977-35eb-44a0-bf36-9092d9d8a0e7 tempest-TaggedAttachmentsTest-1639503389 tempest-TaggedAttachmentsTest-1639503389-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:528866cb-30dd-40ac-9a81-4c6afc93cdd9] added
Nov 08 23:18:56 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:18:56 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:528866cb-30dd-40ac-9a81-4c6afc93cdd9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:18:56 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:528866cb-30dd-40ac-9a81-4c6afc93cdd9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:18:56 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[3165bb31-23bf-40e9-9319-3f92e5bc45ed]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:18:56 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-f44af977-35eb-44a0-bf36-9092d9d8a0e7 tempest-TaggedAttachmentsTest-1639503389 tempest-TaggedAttachmentsTest-1639503389-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:18:56 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:528866cb-30dd-40ac-9a81-4c6afc93cdd9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:18:56 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:528866cb-30dd-40ac-9a81-4c6afc93cdd9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:18:56 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[674f7081-6385-4f9f-898c-71ceafb764f1]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:18:56 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-f44af977-35eb-44a0-bf36-9092d9d8a0e7 tempest-TaggedAttachmentsTest-1639503389 tempest-TaggedAttachmentsTest-1639503389-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:18:56 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:528866cb-30dd-40ac-9a81-4c6afc93cdd9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mpVfHWuQ {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:18:56 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:528866cb-30dd-40ac-9a81-4c6afc93cdd9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mpVfHWuQ" returned: 0 in 0.024s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:18:56 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[2df30c8a-b38d-4ca9-841d-deba165675f2]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:18:56 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-f44af977-35eb-44a0-bf36-9092d9d8a0e7 tempest-TaggedAttachmentsTest-1639503389 tempest-TaggedAttachmentsTest-1639503389-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'mpVfHWuQ'): stdout= stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:18:56 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:528866cb-30dd-40ac-9a81-4c6afc93cdd9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:18:57 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-0e7deb14-eb81-45e0-9c30-1322b63950a4 tempest-TestVolumeSwap-1091185069 tempest-TestVolumeSwap-1091185069-project-admin] Acquiring lock "fde91f7c-31e3-456c-b252-6ce37fa3b600" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:18:57 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-0e7deb14-eb81-45e0-9c30-1322b63950a4 tempest-TestVolumeSwap-1091185069 tempest-TestVolumeSwap-1091185069-project-admin] Lock "fde91f7c-31e3-456c-b252-6ce37fa3b600" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:18:57 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:528866cb-30dd-40ac-9a81-4c6afc93cdd9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:18:57 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[36c19f99-f17f-4fc9-9e6b-1387984295ac]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:18:57 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-f44af977-35eb-44a0-bf36-9092d9d8a0e7 tempest-TaggedAttachmentsTest-1639503389 tempest-TaggedAttachmentsTest-1639503389-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:18:57 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:18:57 user nova-compute[75045]: DEBUG os_brick.utils [None req-0e7deb14-eb81-45e0-9c30-1322b63950a4 tempest-TestVolumeSwap-1091185069 tempest-TestVolumeSwap-1091185069-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75045) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 23:18:57 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:18:57 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:18:57 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b5145ec-e045-4566-8c16-44c38810ed23]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2068946-d374-45a4-9850-e3a690b13ef4 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c532e3b-4f3c-4809-bd49-fd7c2ea7f6cd (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d7a4df0-bfc5-4952-8454-97b703b68f28 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f829f03c-8f1a-45f1-a715-b9d769201d1b (non-flash)\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:18:57 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-f44af977-35eb-44a0-bf36-9092d9d8a0e7 tempest-TaggedAttachmentsTest-1639503389 tempest-TaggedAttachmentsTest-1639503389-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2068946-d374-45a4-9850-e3a690b13ef4 (non-flash)
Nov 08 23:18:57 user nova-compute[75045]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c532e3b-4f3c-4809-bd49-fd7c2ea7f6cd (non-flash)
Nov 08 23:18:57 user nova-compute[75045]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d7a4df0-bfc5-4952-8454-97b703b68f28 (non-flash)
Nov 08 23:18:57 user nova-compute[75045]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f829f03c-8f1a-45f1-a715-b9d769201d1b (non-flash)
Nov 08 23:18:57 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 23:18:57 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-f44af977-35eb-44a0-bf36-9092d9d8a0e7 tempest-TaggedAttachmentsTest-1639503389 tempest-TaggedAttachmentsTest-1639503389-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2068946-d374-45a4-9850-e3a690b13ef4 (non-flash)
Nov 08 23:18:57 user nova-compute[75045]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c532e3b-4f3c-4809-bd49-fd7c2ea7f6cd (non-flash)
Nov 08 23:18:57 user nova-compute[75045]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d7a4df0-bfc5-4952-8454-97b703b68f28 (non-flash)
Nov 08 23:18:57 user nova-compute[75045]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f829f03c-8f1a-45f1-a715-b9d769201d1b (non-flash)
Nov 08 23:18:57 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 23:18:57 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:528866cb-30dd-40ac-9a81-4c6afc93cdd9 -p 172.16.0.220:3260 --login {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:18:57 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.023s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:18:57 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[35a2d06c-0c30-4242-b3ed-ffbe415084ab]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6217bd6e884\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:18:57 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:18:57 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:18:57 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[93bc9518-1cf0-447a-9f46-2838d1114b2a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:18:57 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:18:57 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:18:57 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc024958-9a1c-40f9-b07a-189e98db9587]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:18:57 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ef34100-d75c-4ae5-88b7-11d2431b1904]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:18:57 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-0e7deb14-eb81-45e0-9c30-1322b63950a4 tempest-TestVolumeSwap-1091185069 tempest-TestVolumeSwap-1091185069-project-admin] Running cmd (subprocess): nvme version {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:18:57 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-0e7deb14-eb81-45e0-9c30-1322b63950a4 tempest-TestVolumeSwap-1091185069 tempest-TestVolumeSwap-1091185069-project-admin] 'nvme version' failed. Not Retrying. {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 23:18:57 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:528866cb-30dd-40ac-9a81-4c6afc93cdd9 -p 172.16.0.220:3260 --login" returned: 0 in 0.079s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:18:57 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[799ce755-3527-4b3f-9119-151c1b61e6b2]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:528866cb-30dd-40ac-9a81-4c6afc93cdd9, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:528866cb-30dd-40ac-9a81-4c6afc93cdd9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:18:57 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0e7deb14-eb81-45e0-9c30-1322b63950a4 tempest-TestVolumeSwap-1091185069 tempest-TestVolumeSwap-1091185069-project-admin] nvme not present on system {{(pid=75045) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 23:18:57 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-f44af977-35eb-44a0-bf36-9092d9d8a0e7 tempest-TaggedAttachmentsTest-1639503389 tempest-TaggedAttachmentsTest-1639503389-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:528866cb-30dd-40ac-9a81-4c6afc93cdd9, portal: 172.16.0.220,3260]
Nov 08 23:18:57 user nova-compute[75045]: Login to [iface: default, target: iqn.2010-10.org.openstack:528866cb-30dd-40ac-9a81-4c6afc93cdd9, portal: 172.16.0.220,3260] successful.
Nov 08 23:18:57 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:18:57 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:18:57 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:528866cb-30dd-40ac-9a81-4c6afc93cdd9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:18:57 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 23:18:57 user nova-compute[75045]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 23:18:57 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[f814618e-d1e0-41db-b2ad-0cd7fc00a462]: (4, '') {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:18:57 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.lightos [None req-0e7deb14-eb81-45e0-9c30-1322b63950a4 tempest-TestVolumeSwap-1091185069 tempest-TestVolumeSwap-1091185069-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75045) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 23:18:57 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.lightos [None req-0e7deb14-eb81-45e0-9c30-1322b63950a4 tempest-TestVolumeSwap-1091185069 tempest-TestVolumeSwap-1091185069-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75045) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 23:18:57 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.lightos [None req-0e7deb14-eb81-45e0-9c30-1322b63950a4 tempest-TestVolumeSwap-1091185069 tempest-TestVolumeSwap-1091185069-project-admin] LIGHTOS: no hostnqn found. {{(pid=75045) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 23:18:57 user nova-compute[75045]: DEBUG os_brick.utils [None req-0e7deb14-eb81-45e0-9c30-1322b63950a4 tempest-TestVolumeSwap-1091185069 tempest-TestVolumeSwap-1091185069-project-admin] <== get_connector_properties: return (150ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6217bd6e884', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75045) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 23:18:57 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:528866cb-30dd-40ac-9a81-4c6afc93cdd9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:18:57 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[61608d21-6c2a-460b-acd3-5a1a4a6ce4f1]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:18:57 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-f44af977-35eb-44a0-bf36-9092d9d8a0e7 tempest-TaggedAttachmentsTest-1639503389 tempest-TaggedAttachmentsTest-1639503389-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:18:57 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:18:57 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:18:57 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[3943ca09-53c1-4e87-9ab0-5ca04eb5a896]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2068946-d374-45a4-9850-e3a690b13ef4 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c532e3b-4f3c-4809-bd49-fd7c2ea7f6cd (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d7a4df0-bfc5-4952-8454-97b703b68f28 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f829f03c-8f1a-45f1-a715-b9d769201d1b (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:528866cb-30dd-40ac-9a81-4c6afc93cdd9 (non-flash)\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:18:57 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-f44af977-35eb-44a0-bf36-9092d9d8a0e7 tempest-TaggedAttachmentsTest-1639503389 tempest-TaggedAttachmentsTest-1639503389-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2068946-d374-45a4-9850-e3a690b13ef4 (non-flash)
Nov 08 23:18:57 user nova-compute[75045]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c532e3b-4f3c-4809-bd49-fd7c2ea7f6cd (non-flash)
Nov 08 23:18:57 user nova-compute[75045]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d7a4df0-bfc5-4952-8454-97b703b68f28 (non-flash)
Nov 08 23:18:57 user nova-compute[75045]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f829f03c-8f1a-45f1-a715-b9d769201d1b (non-flash)
Nov 08 23:18:57 user nova-compute[75045]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:528866cb-30dd-40ac-9a81-4c6afc93cdd9 (non-flash)
Nov 08 23:18:57 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 23:18:57 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-f44af977-35eb-44a0-bf36-9092d9d8a0e7 tempest-TaggedAttachmentsTest-1639503389 tempest-TaggedAttachmentsTest-1639503389-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2068946-d374-45a4-9850-e3a690b13ef4 (non-flash)
Nov 08 23:18:57 user nova-compute[75045]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c532e3b-4f3c-4809-bd49-fd7c2ea7f6cd (non-flash)
Nov 08 23:18:57 user nova-compute[75045]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d7a4df0-bfc5-4952-8454-97b703b68f28 (non-flash)
Nov 08 23:18:57 user nova-compute[75045]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f829f03c-8f1a-45f1-a715-b9d769201d1b (non-flash)
Nov 08 23:18:57 user nova-compute[75045]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:528866cb-30dd-40ac-9a81-4c6afc93cdd9 (non-flash)
Nov 08 23:18:57 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 23:18:57 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-f44af977-35eb-44a0-bf36-9092d9d8a0e7 tempest-TaggedAttachmentsTest-1639503389 tempest-TaggedAttachmentsTest-1639503389-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:528866cb-30dd-40ac-9a81-4c6afc93cdd9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.392s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 23:18:57 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-f44af977-35eb-44a0-bf36-9092d9d8a0e7 tempest-TaggedAttachmentsTest-1639503389 tempest-TaggedAttachmentsTest-1639503389-project-member] Connected to 172.16.0.220:3260 {{(pid=75045) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 23:18:57 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-f44af977-35eb-44a0-bf36-9092d9d8a0e7 tempest-TaggedAttachmentsTest-1639503389 tempest-TaggedAttachmentsTest-1639503389-project-member] HCTL ('37', '-', '-', 0) found on session 7 with lun 0 {{(pid=75045) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 23:18:57 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-f44af977-35eb-44a0-bf36-9092d9d8a0e7 tempest-TaggedAttachmentsTest-1639503389 tempest-TaggedAttachmentsTest-1639503389-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=75045) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 23:18:57 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:18:57 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-f2c73ce0-f7d6-4e24-96e6-70de9b487fc2 tempest-VolumesAssistedSnapshotsTest-1482710492 tempest-VolumesAssistedSnapshotsTest-1482710492-project-admin] Lock "07ec2c05-aaa9-46e8-8439-7aa5b9fca19d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 49.816s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:18:57 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.028s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:18:57 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6ba5239-358f-4eeb-a58f-fc63e98cbf28]: (4, ('- - 0', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:18:57 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-f44af977-35eb-44a0-bf36-9092d9d8a0e7 tempest-TaggedAttachmentsTest-1639503389 tempest-TaggedAttachmentsTest-1639503389-project-member] Searching for a device in session 7 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=75045) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 23:18:57 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-f44af977-35eb-44a0-bf36-9092d9d8a0e7 tempest-TaggedAttachmentsTest-1639503389 tempest-TaggedAttachmentsTest-1639503389-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:528866cb-30dd-40ac-9a81-4c6afc93cdd9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mpVfHWuQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75045) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 23:18:57 user nova-compute[75045]: DEBUG os_brick.utils [None req-082394c4-e179-437a-8b30-c03773aae2a3 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75045) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 23:18:57 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:18:57 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:18:57 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[4baeb710-59eb-4b7c-8b57-fc534828c858]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6217bd6e884\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:18:57 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:18:57 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.021s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:18:57 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[19492bf1-f13e-4918-896c-ed553c742bb0]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:18:57 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:18:57 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:18:57 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[072fc269-aa38-40f8-b848-5c6021ebe45b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:18:57 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[394c6491-e68e-4cf2-835a-a2a2e9b7079e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:18:57 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-082394c4-e179-437a-8b30-c03773aae2a3 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Running cmd (subprocess): nvme version {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:18:57 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-082394c4-e179-437a-8b30-c03773aae2a3 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] 'nvme version' failed. Not Retrying. {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 23:18:57 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.nvmeof [None req-082394c4-e179-437a-8b30-c03773aae2a3 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] nvme not present on system {{(pid=75045) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 23:18:57 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:18:57 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 23:18:57 user nova-compute[75045]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 23:18:57 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c8421dd-5f46-45af-b670-ea95d4d3cac3]: (4, '') {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:18:57 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.lightos [None req-082394c4-e179-437a-8b30-c03773aae2a3 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75045) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 23:18:57 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.lightos [None req-082394c4-e179-437a-8b30-c03773aae2a3 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75045) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 23:18:57 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.lightos [None req-082394c4-e179-437a-8b30-c03773aae2a3 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] LIGHTOS: no hostnqn found. {{(pid=75045) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 23:18:57 user nova-compute[75045]: DEBUG os_brick.utils [None req-082394c4-e179-437a-8b30-c03773aae2a3 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] <== get_connector_properties: return (159ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6217bd6e884', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75045) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 23:18:57 user nova-compute[75045]: DEBUG nova.virt.block_device [None req-082394c4-e179-437a-8b30-c03773aae2a3 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] [instance: d2c911cf-d5f4-4c19-8335-8c7834184a7e] Updating existing volume attachment record: b8b630c0-8906-4d08-b1b6-910bbbf5fca7 {{(pid=75045) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 23:18:57 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-cc2764da-d4bb-4f4b-b69a-c9c557549c98 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262-project-member] Acquiring lock "82bc5fd0-26c7-4f81-b966-54831393b617" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:18:57 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-cc2764da-d4bb-4f4b-b69a-c9c557549c98 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262-project-member] Lock "82bc5fd0-26c7-4f81-b966-54831393b617" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:18:57 user nova-compute[75045]: INFO nova.compute.manager [None req-cc2764da-d4bb-4f4b-b69a-c9c557549c98 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262-project-member] [instance: 82bc5fd0-26c7-4f81-b966-54831393b617] Attaching volume 1bec3976-0b2c-436e-9c4a-eeb6b8badbae to /dev/vdb
Nov 08 23:18:57 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 23:18:57 user nova-compute[75045]: DEBUG nova.compute.manager [req-24ab0e63-24b5-439f-abe6-31ce292ea4c6 req-e8700c1c-93a8-4ba7-84f8-bf541827192b service nova] [instance: 84f0b650-5f58-443d-92a2-bbd5240a0b6f] Received event network-changed-1e76bdd5-2edb-4f5e-baa8-8d82ace77cf3 {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:18:57 user nova-compute[75045]: DEBUG nova.compute.manager [req-24ab0e63-24b5-439f-abe6-31ce292ea4c6 req-e8700c1c-93a8-4ba7-84f8-bf541827192b service nova] [instance: 84f0b650-5f58-443d-92a2-bbd5240a0b6f] Refreshing instance network info cache due to event network-changed-1e76bdd5-2edb-4f5e-baa8-8d82ace77cf3. {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 23:18:57 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-24ab0e63-24b5-439f-abe6-31ce292ea4c6 req-e8700c1c-93a8-4ba7-84f8-bf541827192b service nova] Acquiring lock "refresh_cache-84f0b650-5f58-443d-92a2-bbd5240a0b6f" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 23:18:58 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-5d639bd9-cf48-4d55-adbf-797a9cf83e48 tempest-VolumesActionsTest-1040491269 tempest-VolumesActionsTest-1040491269-project-member] Acquiring lock "0de15211-d094-479a-86ce-292389441fa8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:18:58 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-5d639bd9-cf48-4d55-adbf-797a9cf83e48 tempest-VolumesActionsTest-1040491269 tempest-VolumesActionsTest-1040491269-project-member] Lock "0de15211-d094-479a-86ce-292389441fa8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:18:58 user nova-compute[75045]: DEBUG nova.compute.manager [None req-5d639bd9-cf48-4d55-adbf-797a9cf83e48 tempest-VolumesActionsTest-1040491269 tempest-VolumesActionsTest-1040491269-project-member] [instance: 0de15211-d094-479a-86ce-292389441fa8] Starting instance... {{(pid=75045) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 23:18:58 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-f44af977-35eb-44a0-bf36-9092d9d8a0e7 tempest-TaggedAttachmentsTest-1639503389 tempest-TaggedAttachmentsTest-1639503389-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.444s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 23:18:58 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-f44af977-35eb-44a0-bf36-9092d9d8a0e7 tempest-TaggedAttachmentsTest-1639503389 tempest-TaggedAttachmentsTest-1639503389-project-member] <== connect_volume: return (1446ms) {'type': 'block', 'scsi_wwn': '23162303363383430', 'path': '/dev/sdf'} {{(pid=75045) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 23:18:58 user nova-compute[75045]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f44af977-35eb-44a0-bf36-9092d9d8a0e7 tempest-TaggedAttachmentsTest-1639503389 tempest-TaggedAttachmentsTest-1639503389-project-member] [instance: 1cb1b440-0073-4a53-a0a2-e2781e021866] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23162303363383430', 'path': '/dev/sdf'} {{(pid=75045) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 23:18:58 user nova-compute[75045]: DEBUG nova.objects.instance [None req-f44af977-35eb-44a0-bf36-9092d9d8a0e7 tempest-TaggedAttachmentsTest-1639503389 tempest-TaggedAttachmentsTest-1639503389-project-member] Lazy-loading 'flavor' on Instance uuid 1cb1b440-0073-4a53-a0a2-e2781e021866 {{(pid=75045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 23:18:58 user nova-compute[75045]: DEBUG nova.virt.libvirt.guest [None req-f44af977-35eb-44a0-bf36-9092d9d8a0e7 tempest-TaggedAttachmentsTest-1639503389 tempest-TaggedAttachmentsTest-1639503389-project-member] attach device xml: <disk type="block" device="disk">
Nov 08 23:18:58 user nova-compute[75045]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 23:18:58 user nova-compute[75045]:   <source dev="/dev/sdf"/>
Nov 08 23:18:58 user nova-compute[75045]:   <target dev="vdb" bus="virtio"/>
Nov 08 23:18:58 user nova-compute[75045]:   <serial>528866cb-30dd-40ac-9a81-4c6afc93cdd9</serial>
Nov 08 23:18:58 user nova-compute[75045]: </disk>
Nov 08 23:18:58 user nova-compute[75045]:  {{(pid=75045) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 08 23:18:58 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-5d639bd9-cf48-4d55-adbf-797a9cf83e48 tempest-VolumesActionsTest-1040491269 tempest-VolumesActionsTest-1040491269-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:18:58 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-5d639bd9-cf48-4d55-adbf-797a9cf83e48 tempest-VolumesActionsTest-1040491269 tempest-VolumesActionsTest-1040491269-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:18:58 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-5d639bd9-cf48-4d55-adbf-797a9cf83e48 tempest-VolumesActionsTest-1040491269 tempest-VolumesActionsTest-1040491269-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75045) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 23:18:58 user nova-compute[75045]: INFO nova.compute.claims [None req-5d639bd9-cf48-4d55-adbf-797a9cf83e48 tempest-VolumesActionsTest-1040491269 tempest-VolumesActionsTest-1040491269-project-member] [instance: 0de15211-d094-479a-86ce-292389441fa8] Claim successful on node user
Nov 08 23:18:58 user nova-compute[75045]: DEBUG nova.network.neutron [None req-3e20b61e-19c4-460d-831a-0137ef420f72 tempest-TaggedBootDevicesTest_v242-1022497165 tempest-TaggedBootDevicesTest_v242-1022497165-project-member] [instance: 84f0b650-5f58-443d-92a2-bbd5240a0b6f] Updating instance_info_cache with network_info: [{"id": "fc4db695-a5ec-4a17-ae30-8d21e4f4824e", "address": "fa:16:3e:a4:55:a2", "network": {"id": "b2e474ab-b3aa-48a0-ba26-dc0b42cf38ab", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-265119296-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2adf8b4b78eb494d8fa806e9d7c592a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc4db695-a5", "ovs_interfaceid": "fc4db695-a5ec-4a17-ae30-8d21e4f4824e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3bf6df35-9e21-4f9b-8d1f-1d0bea146bd4", "address": "fa:16:3e:ac:8e:d8", "network": {"id": "ae6d1517-a734-498b-bb06-554fe0816868", "bridge": "br-int", "label": "tempest-device-tagging-net1-228754202", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.51", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2adf8b4b78eb494d8fa806e9d7c592a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3bf6df35-9e", "ovs_interfaceid": "3bf6df35-9e21-4f9b-8d1f-1d0bea146bd4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "61b1ec8c-48bc-413b-b19f-48909a05358d", "address": "fa:16:3e:70:d1:5b", "network": {"id": "ae6d1517-a734-498b-bb06-554fe0816868", "bridge": "br-int", "label": "tempest-device-tagging-net1-228754202", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.18", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2adf8b4b78eb494d8fa806e9d7c592a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61b1ec8c-48", "ovs_interfaceid": "61b1ec8c-48bc-413b-b19f-48909a05358d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "b9c4728f-f4cc-49c9-aca5-288b818b9c34", "address": "fa:16:3e:d0:f0:01", "network": {"id": "ae6d1517-a734-498b-bb06-554fe0816868", "bridge": "br-int", "label": "tempest-device-tagging-net1-228754202", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.205", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2adf8b4b78eb494d8fa806e9d7c592a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9c4728f-f4", "ovs_interfaceid": "b9c4728f-f4cc-49c9-aca5-288b818b9c34", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ddf04b42-4dcd-4981-a301-5b51c3a5a86e", "address": "fa:16:3e:e8:be:34", "network": {"id": "ae6d1517-a734-498b-bb06-554fe0816868", "bridge": "br-int", "label": "tempest-device-tagging-net1-228754202", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.125", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2adf8b4b78eb494d8fa806e9d7c592a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapddf04b42-4d", "ovs_interfaceid": "ddf04b42-4dcd-4981-a301-5b51c3a5a86e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5ba5ecd6-5bf3-4be1-b79b-d00e7d98d9f8", "address": "fa:16:3e:54:ad:a7", "network": {"id": "926152b1-a3c8-4610-8378-5f00a5878df1", "bridge": "br-int", "label": "tempest-device-tagging-net2-614981566", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2adf8b4b78eb494d8fa806e9d7c592a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ba5ecd6-5b", "ovs_interfaceid": "5ba5ecd6-5bf3-4be1-b79b-d00e7d98d9f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1e76bdd5-2edb-4f5e-baa8-8d82ace77cf3", "address": "fa:16:3e:79:d3:78", "network": {"id": "926152b1-a3c8-4610-8378-5f00a5878df1", "bridge": "br-int", "label": "tempest-device-tagging-net2-614981566", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2adf8b4b78eb494d8fa806e9d7c592a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e76bdd5-2e", "ovs_interfaceid": "1e76bdd5-2edb-4f5e-baa8-8d82ace77cf3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75045) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 23:18:58 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-f44af977-35eb-44a0-bf36-9092d9d8a0e7 tempest-TaggedAttachmentsTest-1639503389 tempest-TaggedAttachmentsTest-1639503389-project-member] No BDM found with device name vda, not building metadata. {{(pid=75045) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 23:18:58 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-f44af977-35eb-44a0-bf36-9092d9d8a0e7 tempest-TaggedAttachmentsTest-1639503389 tempest-TaggedAttachmentsTest-1639503389-project-member] No BDM found with device name hda, not building metadata. {{(pid=75045) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 23:18:58 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-f44af977-35eb-44a0-bf36-9092d9d8a0e7 tempest-TaggedAttachmentsTest-1639503389 tempest-TaggedAttachmentsTest-1639503389-project-member] No VIF found with MAC fa:16:3e:e4:4d:f8, not building metadata {{(pid=75045) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 23:18:58 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-3e20b61e-19c4-460d-831a-0137ef420f72 tempest-TaggedBootDevicesTest_v242-1022497165 tempest-TaggedBootDevicesTest_v242-1022497165-project-member] Releasing lock "refresh_cache-84f0b650-5f58-443d-92a2-bbd5240a0b6f" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 23:18:58 user nova-compute[75045]: DEBUG nova.compute.manager [None req-3e20b61e-19c4-460d-831a-0137ef420f72 tempest-TaggedBootDevicesTest_v242-1022497165 tempest-TaggedBootDevicesTest_v242-1022497165-project-member] [instance: 84f0b650-5f58-443d-92a2-bbd5240a0b6f] Instance network_info: |[{"id": "fc4db695-a5ec-4a17-ae30-8d21e4f4824e", "address": "fa:16:3e:a4:55:a2", "network": {"id": "b2e474ab-b3aa-48a0-ba26-dc0b42cf38ab", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-265119296-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2adf8b4b78eb494d8fa806e9d7c592a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc4db695-a5", "ovs_interfaceid": "fc4db695-a5ec-4a17-ae30-8d21e4f4824e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3bf6df35-9e21-4f9b-8d1f-1d0bea146bd4", "address": "fa:16:3e:ac:8e:d8", "network": {"id": "ae6d1517-a734-498b-bb06-554fe0816868", "bridge": "br-int", "label": "tempest-device-tagging-net1-228754202", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.51", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2adf8b4b78eb494d8fa806e9d7c592a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3bf6df35-9e", "ovs_interfaceid": "3bf6df35-9e21-4f9b-8d1f-1d0bea146bd4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "61b1ec8c-48bc-413b-b19f-48909a05358d", "address": "fa:16:3e:70:d1:5b", "network": {"id": "ae6d1517-a734-498b-bb06-554fe0816868", "bridge": "br-int", "label": "tempest-device-tagging-net1-228754202", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.18", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2adf8b4b78eb494d8fa806e9d7c592a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61b1ec8c-48", "ovs_interfaceid": "61b1ec8c-48bc-413b-b19f-48909a05358d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "b9c4728f-f4cc-49c9-aca5-288b818b9c34", "address": "fa:16:3e:d0:f0:01", "network": {"id": "ae6d1517-a734-498b-bb06-554fe0816868", "bridge": "br-int", "label": "tempest-device-tagging-net1-228754202", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.205", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2adf8b4b78eb494d8fa806e9d7c592a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9c4728f-f4", "ovs_interfaceid": "b9c4728f-f4cc-49c9-aca5-288b818b9c34", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ddf04b42-4dcd-4981-a301-5b51c3a5a86e", "address": "fa:16:3e:e8:be:34", "network": {"id": "ae6d1517-a734-498b-bb06-554fe0816868", "bridge": "br-int", "label": "tempest-device-tagging-net1-228754202", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.125", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2adf8b4b78eb494d8fa806e9d7c592a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapddf04b42-4d", "ovs_interfaceid": "ddf04b42-4dcd-4981-a301-5b51c3a5a86e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5ba5ecd6-5bf3-4be1-b79b-d00e7d98d9f8", "address": "fa:16:3e:54:ad:a7", "network": {"id": "926152b1-a3c8-4610-8378-5f00a5878df1", "bridge": "br-int", "label": "tempest-device-tagging-net2-614981566", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2adf8b4b78eb494d8fa806e9d7c592a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ba5ecd6-5b", "ovs_interfaceid": "5ba5ecd6-5bf3-4be1-b79b-d00e7d98d9f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1e76bdd5-2edb-4f5e-baa8-8d82ace77cf3", "address": "fa:16:3e:79:d3:78", "network": {"id": "926152b1-a3c8-4610-8378-5f00a5878df1", "bridge": "br-int", "label": "tempest-device-tagging-net2-614981566", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2adf8b4b78eb494d8fa806e9d7c592a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e76bdd5-2e", "ovs_interfaceid": "1e76bdd5-2edb-4f5e-baa8-8d82ace77cf3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75045) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 23:18:58 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-24ab0e63-24b5-439f-abe6-31ce292ea4c6 req-e8700c1c-93a8-4ba7-84f8-bf541827192b service nova] Acquired lock "refresh_cache-84f0b650-5f58-443d-92a2-bbd5240a0b6f" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 23:18:58 user nova-compute[75045]: DEBUG nova.network.neutron [req-24ab0e63-24b5-439f-abe6-31ce292ea4c6 req-e8700c1c-93a8-4ba7-84f8-bf541827192b service nova] [instance: 84f0b650-5f58-443d-92a2-bbd5240a0b6f] Refreshing network info cache for port 1e76bdd5-2edb-4f5e-baa8-8d82ace77cf3 {{(pid=75045) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 23:18:58 user nova-compute[75045]: DEBUG nova.compute.provider_tree [None req-5d639bd9-cf48-4d55-adbf-797a9cf83e48 tempest-VolumesActionsTest-1040491269 tempest-VolumesActionsTest-1040491269-project-member] Inventory has not changed in ProviderTree for provider: 62ba5f85-c74d-4b58-986e-d4197e813fd7 {{(pid=75045) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 23:18:58 user nova-compute[75045]: DEBUG nova.scheduler.client.report [None req-5d639bd9-cf48-4d55-adbf-797a9cf83e48 tempest-VolumesActionsTest-1040491269 tempest-VolumesActionsTest-1040491269-project-member] Inventory has not changed for provider 62ba5f85-c74d-4b58-986e-d4197e813fd7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75045) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 23:18:59 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-5d639bd9-cf48-4d55-adbf-797a9cf83e48 tempest-VolumesActionsTest-1040491269 tempest-VolumesActionsTest-1040491269-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.605s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:18:59 user nova-compute[75045]: DEBUG nova.compute.manager [None req-5d639bd9-cf48-4d55-adbf-797a9cf83e48 tempest-VolumesActionsTest-1040491269 tempest-VolumesActionsTest-1040491269-project-member] [instance: 0de15211-d094-479a-86ce-292389441fa8] Start building networks asynchronously for instance. {{(pid=75045) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 23:18:59 user nova-compute[75045]: DEBUG nova.compute.manager [None req-5d639bd9-cf48-4d55-adbf-797a9cf83e48 tempest-VolumesActionsTest-1040491269 tempest-VolumesActionsTest-1040491269-project-member] [instance: 0de15211-d094-479a-86ce-292389441fa8] Allocating IP information in the background. {{(pid=75045) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 23:18:59 user nova-compute[75045]: DEBUG nova.network.neutron [None req-5d639bd9-cf48-4d55-adbf-797a9cf83e48 tempest-VolumesActionsTest-1040491269 tempest-VolumesActionsTest-1040491269-project-member] [instance: 0de15211-d094-479a-86ce-292389441fa8] allocate_for_instance() {{(pid=75045) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 23:18:59 user nova-compute[75045]: INFO nova.virt.libvirt.driver [None req-5d639bd9-cf48-4d55-adbf-797a9cf83e48 tempest-VolumesActionsTest-1040491269 tempest-VolumesActionsTest-1040491269-project-member] [instance: 0de15211-d094-479a-86ce-292389441fa8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 23:18:59 user nova-compute[75045]: DEBUG nova.compute.manager [None req-5d639bd9-cf48-4d55-adbf-797a9cf83e48 tempest-VolumesActionsTest-1040491269 tempest-VolumesActionsTest-1040491269-project-member] [instance: 0de15211-d094-479a-86ce-292389441fa8] Start building block device mappings for instance. {{(pid=75045) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 23:18:59 user nova-compute[75045]: DEBUG nova.policy [None req-5d639bd9-cf48-4d55-adbf-797a9cf83e48 tempest-VolumesActionsTest-1040491269 tempest-VolumesActionsTest-1040491269-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '47fd89109eff4cf9a4a5d8b5f53b8980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd400c9e6a57b4b8b830b7fd7a83bc8c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75045) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 23:18:59 user nova-compute[75045]: DEBUG nova.compute.manager [None req-5d639bd9-cf48-4d55-adbf-797a9cf83e48 tempest-VolumesActionsTest-1040491269 tempest-VolumesActionsTest-1040491269-project-member] [instance: 0de15211-d094-479a-86ce-292389441fa8] Start spawning the instance on the hypervisor. {{(pid=75045) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 23:18:59 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-5d639bd9-cf48-4d55-adbf-797a9cf83e48 tempest-VolumesActionsTest-1040491269 tempest-VolumesActionsTest-1040491269-project-member] [instance: 0de15211-d094-479a-86ce-292389441fa8] Creating instance directory {{(pid=75045) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 23:18:59 user nova-compute[75045]: INFO nova.virt.libvirt.driver [None req-5d639bd9-cf48-4d55-adbf-797a9cf83e48 tempest-VolumesActionsTest-1040491269 tempest-VolumesActionsTest-1040491269-project-member] [instance: 0de15211-d094-479a-86ce-292389441fa8] Creating image(s)
Nov 08 23:18:59 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-5d639bd9-cf48-4d55-adbf-797a9cf83e48 tempest-VolumesActionsTest-1040491269 tempest-VolumesActionsTest-1040491269-project-member] Acquiring lock "/opt/stack/data/nova/instances/0de15211-d094-479a-86ce-292389441fa8/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:18:59 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-5d639bd9-cf48-4d55-adbf-797a9cf83e48 tempest-VolumesActionsTest-1040491269 tempest-VolumesActionsTest-1040491269-project-member] Lock "/opt/stack/data/nova/instances/0de15211-d094-479a-86ce-292389441fa8/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.002s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:18:59 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-5d639bd9-cf48-4d55-adbf-797a9cf83e48 tempest-VolumesActionsTest-1040491269 tempest-VolumesActionsTest-1040491269-project-member] Lock "/opt/stack/data/nova/instances/0de15211-d094-479a-86ce-292389441fa8/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:18:59 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-5d639bd9-cf48-4d55-adbf-797a9cf83e48 tempest-VolumesActionsTest-1040491269 tempest-VolumesActionsTest-1040491269-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b59f52a99fff51c56dd1edfb83892fb8f647f2f3 --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:18:59 user nova-compute[75045]: DEBUG nova.network.neutron [req-24ab0e63-24b5-439f-abe6-31ce292ea4c6 req-e8700c1c-93a8-4ba7-84f8-bf541827192b service nova] [instance: 84f0b650-5f58-443d-92a2-bbd5240a0b6f] Updated VIF entry in instance network info cache for port 1e76bdd5-2edb-4f5e-baa8-8d82ace77cf3. {{(pid=75045) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 23:18:59 user nova-compute[75045]: DEBUG nova.network.neutron [req-24ab0e63-24b5-439f-abe6-31ce292ea4c6 req-e8700c1c-93a8-4ba7-84f8-bf541827192b service nova] [instance: 84f0b650-5f58-443d-92a2-bbd5240a0b6f] Updating instance_info_cache with network_info: [{"id": "fc4db695-a5ec-4a17-ae30-8d21e4f4824e", "address": "fa:16:3e:a4:55:a2", "network": {"id": "b2e474ab-b3aa-48a0-ba26-dc0b42cf38ab", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-265119296-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2adf8b4b78eb494d8fa806e9d7c592a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc4db695-a5", "ovs_interfaceid": "fc4db695-a5ec-4a17-ae30-8d21e4f4824e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3bf6df35-9e21-4f9b-8d1f-1d0bea146bd4", "address": "fa:16:3e:ac:8e:d8", "network": {"id": "ae6d1517-a734-498b-bb06-554fe0816868", "bridge": "br-int", "label": "tempest-device-tagging-net1-228754202", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.51", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2adf8b4b78eb494d8fa806e9d7c592a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3bf6df35-9e", "ovs_interfaceid": "3bf6df35-9e21-4f9b-8d1f-1d0bea146bd4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "61b1ec8c-48bc-413b-b19f-48909a05358d", "address": "fa:16:3e:70:d1:5b", "network": {"id": "ae6d1517-a734-498b-bb06-554fe0816868", "bridge": "br-int", "label": "tempest-device-tagging-net1-228754202", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.18", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2adf8b4b78eb494d8fa806e9d7c592a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61b1ec8c-48", "ovs_interfaceid": "61b1ec8c-48bc-413b-b19f-48909a05358d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "b9c4728f-f4cc-49c9-aca5-288b818b9c34", "address": "fa:16:3e:d0:f0:01", "network": {"id": "ae6d1517-a734-498b-bb06-554fe0816868", "bridge": "br-int", "label": "tempest-device-tagging-net1-228754202", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.205", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2adf8b4b78eb494d8fa806e9d7c592a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9c4728f-f4", "ovs_interfaceid": "b9c4728f-f4cc-49c9-aca5-288b818b9c34", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ddf04b42-4dcd-4981-a301-5b51c3a5a86e", "address": "fa:16:3e:e8:be:34", "network": {"id": "ae6d1517-a734-498b-bb06-554fe0816868", "bridge": "br-int", "label": "tempest-device-tagging-net1-228754202", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.125", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2adf8b4b78eb494d8fa806e9d7c592a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapddf04b42-4d", "ovs_interfaceid": "ddf04b42-4dcd-4981-a301-5b51c3a5a86e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5ba5ecd6-5bf3-4be1-b79b-d00e7d98d9f8", "address": "fa:16:3e:54:ad:a7", "network": {"id": "926152b1-a3c8-4610-8378-5f00a5878df1", "bridge": "br-int", "label": "tempest-device-tagging-net2-614981566", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2adf8b4b78eb494d8fa806e9d7c592a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ba5ecd6-5b", "ovs_interfaceid": "5ba5ecd6-5bf3-4be1-b79b-d00e7d98d9f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1e76bdd5-2edb-4f5e-baa8-8d82ace77cf3", "address": "fa:16:3e:79:d3:78", "network": {"id": "926152b1-a3c8-4610-8378-5f00a5878df1", "bridge": "br-int", "label": "tempest-device-tagging-net2-614981566", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2adf8b4b78eb494d8fa806e9d7c592a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e76bdd5-2e", "ovs_interfaceid": "1e76bdd5-2edb-4f5e-baa8-8d82ace77cf3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75045) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 23:18:59 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-5d639bd9-cf48-4d55-adbf-797a9cf83e48 tempest-VolumesActionsTest-1040491269 tempest-VolumesActionsTest-1040491269-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b59f52a99fff51c56dd1edfb83892fb8f647f2f3 --force-share --output=json" returned: 0 in 0.185s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:18:59 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-5d639bd9-cf48-4d55-adbf-797a9cf83e48 tempest-VolumesActionsTest-1040491269 tempest-VolumesActionsTest-1040491269-project-member] Acquiring lock "b59f52a99fff51c56dd1edfb83892fb8f647f2f3" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:18:59 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-5d639bd9-cf48-4d55-adbf-797a9cf83e48 tempest-VolumesActionsTest-1040491269 tempest-VolumesActionsTest-1040491269-project-member] Lock "b59f52a99fff51c56dd1edfb83892fb8f647f2f3" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:18:59 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-5d639bd9-cf48-4d55-adbf-797a9cf83e48 tempest-VolumesActionsTest-1040491269 tempest-VolumesActionsTest-1040491269-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b59f52a99fff51c56dd1edfb83892fb8f647f2f3 --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:18:59 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-24ab0e63-24b5-439f-abe6-31ce292ea4c6 req-e8700c1c-93a8-4ba7-84f8-bf541827192b service nova] Releasing lock "refresh_cache-84f0b650-5f58-443d-92a2-bbd5240a0b6f" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 23:18:59 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-5d639bd9-cf48-4d55-adbf-797a9cf83e48 tempest-VolumesActionsTest-1040491269 tempest-VolumesActionsTest-1040491269-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b59f52a99fff51c56dd1edfb83892fb8f647f2f3 --force-share --output=json" returned: 0 in 0.170s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:18:59 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-5d639bd9-cf48-4d55-adbf-797a9cf83e48 tempest-VolumesActionsTest-1040491269 tempest-VolumesActionsTest-1040491269-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b59f52a99fff51c56dd1edfb83892fb8f647f2f3,backing_fmt=raw /opt/stack/data/nova/instances/0de15211-d094-479a-86ce-292389441fa8/disk 1073741824 {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:18:59 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-5d639bd9-cf48-4d55-adbf-797a9cf83e48 tempest-VolumesActionsTest-1040491269 tempest-VolumesActionsTest-1040491269-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b59f52a99fff51c56dd1edfb83892fb8f647f2f3,backing_fmt=raw /opt/stack/data/nova/instances/0de15211-d094-479a-86ce-292389441fa8/disk 1073741824" returned: 0 in 0.057s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:18:59 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-5d639bd9-cf48-4d55-adbf-797a9cf83e48 tempest-VolumesActionsTest-1040491269 tempest-VolumesActionsTest-1040491269-project-member] Lock "b59f52a99fff51c56dd1edfb83892fb8f647f2f3" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.232s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:18:59 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-5d639bd9-cf48-4d55-adbf-797a9cf83e48 tempest-VolumesActionsTest-1040491269 tempest-VolumesActionsTest-1040491269-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b59f52a99fff51c56dd1edfb83892fb8f647f2f3 --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:18:59 user nova-compute[75045]: DEBUG nova.network.neutron [None req-5d639bd9-cf48-4d55-adbf-797a9cf83e48 tempest-VolumesActionsTest-1040491269 tempest-VolumesActionsTest-1040491269-project-member] [instance: 0de15211-d094-479a-86ce-292389441fa8] Successfully created port: ddc3ddff-13ab-48d7-b4fc-8196ec7d2485 {{(pid=75045) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 23:18:59 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-5d639bd9-cf48-4d55-adbf-797a9cf83e48 tempest-VolumesActionsTest-1040491269 tempest-VolumesActionsTest-1040491269-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b59f52a99fff51c56dd1edfb83892fb8f647f2f3 --force-share --output=json" returned: 0 in 0.214s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:18:59 user nova-compute[75045]: DEBUG nova.virt.disk.api [None req-5d639bd9-cf48-4d55-adbf-797a9cf83e48 tempest-VolumesActionsTest-1040491269 tempest-VolumesActionsTest-1040491269-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0de15211-d094-479a-86ce-292389441fa8/disk. size=1073741824 {{(pid=75045) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 23:18:59 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-5d639bd9-cf48-4d55-adbf-797a9cf83e48 tempest-VolumesActionsTest-1040491269 tempest-VolumesActionsTest-1040491269-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0de15211-d094-479a-86ce-292389441fa8/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:19:00 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-5d639bd9-cf48-4d55-adbf-797a9cf83e48 tempest-VolumesActionsTest-1040491269 tempest-VolumesActionsTest-1040491269-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0de15211-d094-479a-86ce-292389441fa8/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:19:00 user nova-compute[75045]: DEBUG nova.virt.disk.api [None req-5d639bd9-cf48-4d55-adbf-797a9cf83e48 tempest-VolumesActionsTest-1040491269 tempest-VolumesActionsTest-1040491269-project-member] Cannot resize image /opt/stack/data/nova/instances/0de15211-d094-479a-86ce-292389441fa8/disk to a smaller size. {{(pid=75045) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 08 23:19:00 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-5d639bd9-cf48-4d55-adbf-797a9cf83e48 tempest-VolumesActionsTest-1040491269 tempest-VolumesActionsTest-1040491269-project-member] [instance: 0de15211-d094-479a-86ce-292389441fa8] Created local disks {{(pid=75045) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 23:19:00 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-5d639bd9-cf48-4d55-adbf-797a9cf83e48 tempest-VolumesActionsTest-1040491269 tempest-VolumesActionsTest-1040491269-project-member] [instance: 0de15211-d094-479a-86ce-292389441fa8] Ensure instance console log exists: /opt/stack/data/nova/instances/0de15211-d094-479a-86ce-292389441fa8/console.log {{(pid=75045) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 23:19:00 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-5d639bd9-cf48-4d55-adbf-797a9cf83e48 tempest-VolumesActionsTest-1040491269 tempest-VolumesActionsTest-1040491269-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:19:00 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-5d639bd9-cf48-4d55-adbf-797a9cf83e48 tempest-VolumesActionsTest-1040491269 tempest-VolumesActionsTest-1040491269-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:19:00 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-5d639bd9-cf48-4d55-adbf-797a9cf83e48 tempest-VolumesActionsTest-1040491269 tempest-VolumesActionsTest-1040491269-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:19:00 user nova-compute[75045]: DEBUG nova.network.neutron [None req-5d639bd9-cf48-4d55-adbf-797a9cf83e48 tempest-VolumesActionsTest-1040491269 tempest-VolumesActionsTest-1040491269-project-member] [instance: 0de15211-d094-479a-86ce-292389441fa8] Successfully updated port: ddc3ddff-13ab-48d7-b4fc-8196ec7d2485 {{(pid=75045) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 23:19:00 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-5d639bd9-cf48-4d55-adbf-797a9cf83e48 tempest-VolumesActionsTest-1040491269 tempest-VolumesActionsTest-1040491269-project-member] Acquiring lock "refresh_cache-0de15211-d094-479a-86ce-292389441fa8" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 23:19:00 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-5d639bd9-cf48-4d55-adbf-797a9cf83e48 tempest-VolumesActionsTest-1040491269 tempest-VolumesActionsTest-1040491269-project-member] Acquired lock "refresh_cache-0de15211-d094-479a-86ce-292389441fa8" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 23:19:00 user nova-compute[75045]: DEBUG nova.network.neutron [None req-5d639bd9-cf48-4d55-adbf-797a9cf83e48 tempest-VolumesActionsTest-1040491269 tempest-VolumesActionsTest-1040491269-project-member] [instance: 0de15211-d094-479a-86ce-292389441fa8] Building network info cache for instance {{(pid=75045) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 23:19:00 user nova-compute[75045]: DEBUG nova.compute.manager [req-fb27f430-0b5b-441b-9cc1-c6b57cc52610 req-87f1ef6e-08da-49e8-a017-05b91feaa9e0 service nova] [instance: 0de15211-d094-479a-86ce-292389441fa8] Received event network-changed-ddc3ddff-13ab-48d7-b4fc-8196ec7d2485 {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:19:00 user nova-compute[75045]: DEBUG nova.compute.manager [req-fb27f430-0b5b-441b-9cc1-c6b57cc52610 req-87f1ef6e-08da-49e8-a017-05b91feaa9e0 service nova] [instance: 0de15211-d094-479a-86ce-292389441fa8] Refreshing instance network info cache due to event network-changed-ddc3ddff-13ab-48d7-b4fc-8196ec7d2485. {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 23:19:00 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-fb27f430-0b5b-441b-9cc1-c6b57cc52610 req-87f1ef6e-08da-49e8-a017-05b91feaa9e0 service nova] Acquiring lock "refresh_cache-0de15211-d094-479a-86ce-292389441fa8" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 23:19:00 user nova-compute[75045]: DEBUG nova.network.neutron [None req-5d639bd9-cf48-4d55-adbf-797a9cf83e48 tempest-VolumesActionsTest-1040491269 tempest-VolumesActionsTest-1040491269-project-member] [instance: 0de15211-d094-479a-86ce-292389441fa8] Instance cache missing network info. {{(pid=75045) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 23:19:01 user nova-compute[75045]: DEBUG nova.network.neutron [None req-5d639bd9-cf48-4d55-adbf-797a9cf83e48 tempest-VolumesActionsTest-1040491269 tempest-VolumesActionsTest-1040491269-project-member] [instance: 0de15211-d094-479a-86ce-292389441fa8] Updating instance_info_cache with network_info: [{"id": "ddc3ddff-13ab-48d7-b4fc-8196ec7d2485", "address": "fa:16:3e:ba:cb:fb", "network": {"id": "8f7dd756-4715-4085-bfab-8432f99f2e77", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1836278743-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d400c9e6a57b4b8b830b7fd7a83bc8c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapddc3ddff-13", "ovs_interfaceid": "ddc3ddff-13ab-48d7-b4fc-8196ec7d2485", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75045) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 23:19:01 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-5d639bd9-cf48-4d55-adbf-797a9cf83e48 tempest-VolumesActionsTest-1040491269 tempest-VolumesActionsTest-1040491269-project-member] Releasing lock "refresh_cache-0de15211-d094-479a-86ce-292389441fa8" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 23:19:01 user nova-compute[75045]: DEBUG nova.compute.manager [None req-5d639bd9-cf48-4d55-adbf-797a9cf83e48 tempest-VolumesActionsTest-1040491269 tempest-VolumesActionsTest-1040491269-project-member] [instance: 0de15211-d094-479a-86ce-292389441fa8] Instance network_info: |[{"id": "ddc3ddff-13ab-48d7-b4fc-8196ec7d2485", "address": "fa:16:3e:ba:cb:fb", "network": {"id": "8f7dd756-4715-4085-bfab-8432f99f2e77", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1836278743-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d400c9e6a57b4b8b830b7fd7a83bc8c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapddc3ddff-13", "ovs_interfaceid": "ddc3ddff-13ab-48d7-b4fc-8196ec7d2485", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75045) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 23:19:01 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-fb27f430-0b5b-441b-9cc1-c6b57cc52610 req-87f1ef6e-08da-49e8-a017-05b91feaa9e0 service nova] Acquired lock "refresh_cache-0de15211-d094-479a-86ce-292389441fa8" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 23:19:01 user nova-compute[75045]: DEBUG nova.network.neutron [req-fb27f430-0b5b-441b-9cc1-c6b57cc52610 req-87f1ef6e-08da-49e8-a017-05b91feaa9e0 service nova] [instance: 0de15211-d094-479a-86ce-292389441fa8] Refreshing network info cache for port ddc3ddff-13ab-48d7-b4fc-8196ec7d2485 {{(pid=75045) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 23:19:01 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-5d639bd9-cf48-4d55-adbf-797a9cf83e48 tempest-VolumesActionsTest-1040491269 tempest-VolumesActionsTest-1040491269-project-member] [instance: 0de15211-d094-479a-86ce-292389441fa8] Start _get_guest_xml network_info=[{"id": "ddc3ddff-13ab-48d7-b4fc-8196ec7d2485", "address": "fa:16:3e:ba:cb:fb", "network": {"id": "8f7dd756-4715-4085-bfab-8432f99f2e77", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1836278743-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d400c9e6a57b4b8b830b7fd7a83bc8c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapddc3ddff-13", "ovs_interfaceid": "ddc3ddff-13ab-48d7-b4fc-8196ec7d2485", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T23:11:54Z,direct_url=<?>,disk_format='qcow2',id=a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b1beba2cc4e7465ea249e2225fb494dc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T23:11:56Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'disk_bus': 'virtio', 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': 'a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75045) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 23:19:01 user nova-compute[75045]: WARNING nova.virt.libvirt.driver [None req-5d639bd9-cf48-4d55-adbf-797a9cf83e48 tempest-VolumesActionsTest-1040491269 tempest-VolumesActionsTest-1040491269-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 23:19:01 user nova-compute[75045]: WARNING nova.virt.libvirt.driver [None req-5d639bd9-cf48-4d55-adbf-797a9cf83e48 tempest-VolumesActionsTest-1040491269 tempest-VolumesActionsTest-1040491269-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 23:19:01 user nova-compute[75045]: DEBUG nova.virt.libvirt.host [None req-5d639bd9-cf48-4d55-adbf-797a9cf83e48 tempest-VolumesActionsTest-1040491269 tempest-VolumesActionsTest-1040491269-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75045) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 23:19:01 user nova-compute[75045]: DEBUG nova.virt.libvirt.host [None req-5d639bd9-cf48-4d55-adbf-797a9cf83e48 tempest-VolumesActionsTest-1040491269 tempest-VolumesActionsTest-1040491269-project-member] CPU controller missing on host. {{(pid=75045) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 23:19:01 user nova-compute[75045]: DEBUG nova.virt.libvirt.host [None req-5d639bd9-cf48-4d55-adbf-797a9cf83e48 tempest-VolumesActionsTest-1040491269 tempest-VolumesActionsTest-1040491269-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75045) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 23:19:01 user nova-compute[75045]: DEBUG nova.virt.libvirt.host [None req-5d639bd9-cf48-4d55-adbf-797a9cf83e48 tempest-VolumesActionsTest-1040491269 tempest-VolumesActionsTest-1040491269-project-member] CPU controller found on host. {{(pid=75045) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 23:19:01 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-5d639bd9-cf48-4d55-adbf-797a9cf83e48 tempest-VolumesActionsTest-1040491269 tempest-VolumesActionsTest-1040491269-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75045) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 23:19:01 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-5d639bd9-cf48-4d55-adbf-797a9cf83e48 tempest-VolumesActionsTest-1040491269 tempest-VolumesActionsTest-1040491269-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T23:11:41Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T23:11:54Z,direct_url=<?>,disk_format='qcow2',id=a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b1beba2cc4e7465ea249e2225fb494dc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T23:11:56Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75045) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 23:19:01 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-5d639bd9-cf48-4d55-adbf-797a9cf83e48 tempest-VolumesActionsTest-1040491269 tempest-VolumesActionsTest-1040491269-project-member] Flavor limits 0:0:0 {{(pid=75045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 23:19:01 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-5d639bd9-cf48-4d55-adbf-797a9cf83e48 tempest-VolumesActionsTest-1040491269 tempest-VolumesActionsTest-1040491269-project-member] Image limits 0:0:0 {{(pid=75045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 23:19:01 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-5d639bd9-cf48-4d55-adbf-797a9cf83e48 tempest-VolumesActionsTest-1040491269 tempest-VolumesActionsTest-1040491269-project-member] Flavor pref 0:0:0 {{(pid=75045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 23:19:01 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-5d639bd9-cf48-4d55-adbf-797a9cf83e48 tempest-VolumesActionsTest-1040491269 tempest-VolumesActionsTest-1040491269-project-member] Image pref 0:0:0 {{(pid=75045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 23:19:01 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-5d639bd9-cf48-4d55-adbf-797a9cf83e48 tempest-VolumesActionsTest-1040491269 tempest-VolumesActionsTest-1040491269-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 23:19:01 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-5d639bd9-cf48-4d55-adbf-797a9cf83e48 tempest-VolumesActionsTest-1040491269 tempest-VolumesActionsTest-1040491269-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75045) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 23:19:01 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-5d639bd9-cf48-4d55-adbf-797a9cf83e48 tempest-VolumesActionsTest-1040491269 tempest-VolumesActionsTest-1040491269-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75045) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 23:19:01 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-5d639bd9-cf48-4d55-adbf-797a9cf83e48 tempest-VolumesActionsTest-1040491269 tempest-VolumesActionsTest-1040491269-project-member] Got 1 possible topologies {{(pid=75045) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 23:19:01 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-5d639bd9-cf48-4d55-adbf-797a9cf83e48 tempest-VolumesActionsTest-1040491269 tempest-VolumesActionsTest-1040491269-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75045) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 23:19:01 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-5d639bd9-cf48-4d55-adbf-797a9cf83e48 tempest-VolumesActionsTest-1040491269 tempest-VolumesActionsTest-1040491269-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75045) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 23:19:01 user nova-compute[75045]: DEBUG nova.virt.libvirt.vif [None req-5d639bd9-cf48-4d55-adbf-797a9cf83e48 tempest-VolumesActionsTest-1040491269 tempest-VolumesActionsTest-1040491269-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T23:18:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1418708991',display_name='tempest-VolumesActionsTest-instance-1418708991',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1418708991',id=13,image_ref='a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d400c9e6a57b4b8b830b7fd7a83bc8c5',ramdisk_id='',reservation_id='r-quukbsfo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1040491269',owner_user_name='tempest-VolumesActionsTest-1040491269-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T23:18:59Z,user_data=None,user_id='47fd89109eff4cf9a4a5d8b5f53b8980',uuid=0de15211-d094-479a-86ce-292389441fa8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ddc3ddff-13ab-48d7-b4fc-8196ec7d2485", "address": "fa:16:3e:ba:cb:fb", "network": {"id": "8f7dd756-4715-4085-bfab-8432f99f2e77", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1836278743-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d400c9e6a57b4b8b830b7fd7a83bc8c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapddc3ddff-13", "ovs_interfaceid": "ddc3ddff-13ab-48d7-b4fc-8196ec7d2485", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75045) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 23:19:01 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-5d639bd9-cf48-4d55-adbf-797a9cf83e48 tempest-VolumesActionsTest-1040491269 tempest-VolumesActionsTest-1040491269-project-member] Converting VIF {"id": "ddc3ddff-13ab-48d7-b4fc-8196ec7d2485", "address": "fa:16:3e:ba:cb:fb", "network": {"id": "8f7dd756-4715-4085-bfab-8432f99f2e77", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1836278743-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d400c9e6a57b4b8b830b7fd7a83bc8c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapddc3ddff-13", "ovs_interfaceid": "ddc3ddff-13ab-48d7-b4fc-8196ec7d2485", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 23:19:01 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-5d639bd9-cf48-4d55-adbf-797a9cf83e48 tempest-VolumesActionsTest-1040491269 tempest-VolumesActionsTest-1040491269-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ba:cb:fb,bridge_name='br-int',has_traffic_filtering=True,id=ddc3ddff-13ab-48d7-b4fc-8196ec7d2485,network=Network(8f7dd756-4715-4085-bfab-8432f99f2e77),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapddc3ddff-13') {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 23:19:01 user nova-compute[75045]: DEBUG nova.objects.instance [None req-5d639bd9-cf48-4d55-adbf-797a9cf83e48 tempest-VolumesActionsTest-1040491269 tempest-VolumesActionsTest-1040491269-project-member] Lazy-loading 'pci_devices' on Instance uuid 0de15211-d094-479a-86ce-292389441fa8 {{(pid=75045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 23:19:01 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-5d639bd9-cf48-4d55-adbf-797a9cf83e48 tempest-VolumesActionsTest-1040491269 tempest-VolumesActionsTest-1040491269-project-member] [instance: 0de15211-d094-479a-86ce-292389441fa8] End _get_guest_xml xml=<domain type="kvm">
Nov 08 23:19:01 user nova-compute[75045]:   <uuid>0de15211-d094-479a-86ce-292389441fa8</uuid>
Nov 08 23:19:01 user nova-compute[75045]:   <name>instance-0000000d</name>
Nov 08 23:19:01 user nova-compute[75045]:   <memory>524288</memory>
Nov 08 23:19:01 user nova-compute[75045]:   <vcpu>1</vcpu>
Nov 08 23:19:01 user nova-compute[75045]:   <metadata>
Nov 08 23:19:01 user nova-compute[75045]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 23:19:01 user nova-compute[75045]:       <nova:package version="0.0.0"/>
Nov 08 23:19:01 user nova-compute[75045]:       <nova:name>tempest-VolumesActionsTest-instance-1418708991</nova:name>
Nov 08 23:19:01 user nova-compute[75045]:       <nova:creationTime>2023-11-08 23:19:01</nova:creationTime>
Nov 08 23:19:01 user nova-compute[75045]:       <nova:flavor name="m1.tiny">
Nov 08 23:19:01 user nova-compute[75045]:         <nova:memory>512</nova:memory>
Nov 08 23:19:01 user nova-compute[75045]:         <nova:disk>1</nova:disk>
Nov 08 23:19:01 user nova-compute[75045]:         <nova:swap>0</nova:swap>
Nov 08 23:19:01 user nova-compute[75045]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 23:19:01 user nova-compute[75045]:         <nova:vcpus>1</nova:vcpus>
Nov 08 23:19:01 user nova-compute[75045]:       </nova:flavor>
Nov 08 23:19:01 user nova-compute[75045]:       <nova:owner>
Nov 08 23:19:01 user nova-compute[75045]:         <nova:user uuid="47fd89109eff4cf9a4a5d8b5f53b8980">tempest-VolumesActionsTest-1040491269-project-member</nova:user>
Nov 08 23:19:01 user nova-compute[75045]:         <nova:project uuid="d400c9e6a57b4b8b830b7fd7a83bc8c5">tempest-VolumesActionsTest-1040491269</nova:project>
Nov 08 23:19:01 user nova-compute[75045]:       </nova:owner>
Nov 08 23:19:01 user nova-compute[75045]:       <nova:root type="image" uuid="a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb"/>
Nov 08 23:19:01 user nova-compute[75045]:       <nova:ports>
Nov 08 23:19:01 user nova-compute[75045]:         <nova:port uuid="ddc3ddff-13ab-48d7-b4fc-8196ec7d2485">
Nov 08 23:19:01 user nova-compute[75045]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 08 23:19:01 user nova-compute[75045]:         </nova:port>
Nov 08 23:19:01 user nova-compute[75045]:       </nova:ports>
Nov 08 23:19:01 user nova-compute[75045]:     </nova:instance>
Nov 08 23:19:01 user nova-compute[75045]:   </metadata>
Nov 08 23:19:01 user nova-compute[75045]:   <sysinfo type="smbios">
Nov 08 23:19:01 user nova-compute[75045]:     <system>
Nov 08 23:19:01 user nova-compute[75045]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 23:19:01 user nova-compute[75045]:       <entry name="product">OpenStack Nova</entry>
Nov 08 23:19:01 user nova-compute[75045]:       <entry name="version">0.0.0</entry>
Nov 08 23:19:01 user nova-compute[75045]:       <entry name="serial">0de15211-d094-479a-86ce-292389441fa8</entry>
Nov 08 23:19:01 user nova-compute[75045]:       <entry name="uuid">0de15211-d094-479a-86ce-292389441fa8</entry>
Nov 08 23:19:01 user nova-compute[75045]:       <entry name="family">Virtual Machine</entry>
Nov 08 23:19:01 user nova-compute[75045]:     </system>
Nov 08 23:19:01 user nova-compute[75045]:   </sysinfo>
Nov 08 23:19:01 user nova-compute[75045]:   <os>
Nov 08 23:19:01 user nova-compute[75045]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 23:19:01 user nova-compute[75045]:     <boot dev="hd"/>
Nov 08 23:19:01 user nova-compute[75045]:     <smbios mode="sysinfo"/>
Nov 08 23:19:01 user nova-compute[75045]:   </os>
Nov 08 23:19:01 user nova-compute[75045]:   <features>
Nov 08 23:19:01 user nova-compute[75045]:     <acpi/>
Nov 08 23:19:01 user nova-compute[75045]:     <apic/>
Nov 08 23:19:01 user nova-compute[75045]:     <vmcoreinfo/>
Nov 08 23:19:01 user nova-compute[75045]:   </features>
Nov 08 23:19:01 user nova-compute[75045]:   <clock offset="utc">
Nov 08 23:19:01 user nova-compute[75045]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 23:19:01 user nova-compute[75045]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 23:19:01 user nova-compute[75045]:     <timer name="hpet" present="no"/>
Nov 08 23:19:01 user nova-compute[75045]:   </clock>
Nov 08 23:19:01 user nova-compute[75045]:   <cpu mode="custom" match="exact">
Nov 08 23:19:01 user nova-compute[75045]:     <model>Nehalem</model>
Nov 08 23:19:01 user nova-compute[75045]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 23:19:01 user nova-compute[75045]:   </cpu>
Nov 08 23:19:01 user nova-compute[75045]:   <devices>
Nov 08 23:19:01 user nova-compute[75045]:     <disk type="file" device="disk">
Nov 08 23:19:01 user nova-compute[75045]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 23:19:01 user nova-compute[75045]:       <source file="/opt/stack/data/nova/instances/0de15211-d094-479a-86ce-292389441fa8/disk"/>
Nov 08 23:19:01 user nova-compute[75045]:       <target dev="vda" bus="virtio"/>
Nov 08 23:19:01 user nova-compute[75045]:     </disk>
Nov 08 23:19:01 user nova-compute[75045]:     <interface type="ethernet">
Nov 08 23:19:01 user nova-compute[75045]:       <mac address="fa:16:3e:ba:cb:fb"/>
Nov 08 23:19:01 user nova-compute[75045]:       <model type="virtio"/>
Nov 08 23:19:01 user nova-compute[75045]:       <mtu size="1442"/>
Nov 08 23:19:01 user nova-compute[75045]:       <target dev="tapddc3ddff-13"/>
Nov 08 23:19:01 user nova-compute[75045]:     </interface>
Nov 08 23:19:01 user nova-compute[75045]:     <serial type="pty">
Nov 08 23:19:01 user nova-compute[75045]:       <log file="/opt/stack/data/nova/instances/0de15211-d094-479a-86ce-292389441fa8/console.log" append="off"/>
Nov 08 23:19:01 user nova-compute[75045]:     </serial>
Nov 08 23:19:01 user nova-compute[75045]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 23:19:01 user nova-compute[75045]:     <video>
Nov 08 23:19:01 user nova-compute[75045]:       <model type="virtio"/>
Nov 08 23:19:01 user nova-compute[75045]:     </video>
Nov 08 23:19:01 user nova-compute[75045]:     <rng model="virtio">
Nov 08 23:19:01 user nova-compute[75045]:       <backend model="random">/dev/urandom</backend>
Nov 08 23:19:01 user nova-compute[75045]:     </rng>
Nov 08 23:19:01 user nova-compute[75045]:     <controller type="usb" index="0" model="none"/>
Nov 08 23:19:01 user nova-compute[75045]:     <memballoon model="virtio">
Nov 08 23:19:01 user nova-compute[75045]:       <stats period="10"/>
Nov 08 23:19:01 user nova-compute[75045]:     </memballoon>
Nov 08 23:19:01 user nova-compute[75045]:   </devices>
Nov 08 23:19:01 user nova-compute[75045]: </domain>
Nov 08 23:19:01 user nova-compute[75045]:  {{(pid=75045) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 23:19:01 user nova-compute[75045]: DEBUG nova.virt.libvirt.vif [None req-5d639bd9-cf48-4d55-adbf-797a9cf83e48 tempest-VolumesActionsTest-1040491269 tempest-VolumesActionsTest-1040491269-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T23:18:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1418708991',display_name='tempest-VolumesActionsTest-instance-1418708991',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1418708991',id=13,image_ref='a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d400c9e6a57b4b8b830b7fd7a83bc8c5',ramdisk_id='',reservation_id='r-quukbsfo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1040491269',owner_user_name='tempest-VolumesActionsTest-1040491269-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T23:18:59Z,user_data=None,user_id='47fd89109eff4cf9a4a5d8b5f53b8980',uuid=0de15211-d094-479a-86ce-292389441fa8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ddc3ddff-13ab-48d7-b4fc-8196ec7d2485", "address": "fa:16:3e:ba:cb:fb", "network": {"id": "8f7dd756-4715-4085-bfab-8432f99f2e77", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1836278743-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d400c9e6a57b4b8b830b7fd7a83bc8c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapddc3ddff-13", "ovs_interfaceid": "ddc3ddff-13ab-48d7-b4fc-8196ec7d2485", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75045) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 23:19:01 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-5d639bd9-cf48-4d55-adbf-797a9cf83e48 tempest-VolumesActionsTest-1040491269 tempest-VolumesActionsTest-1040491269-project-member] Converting VIF {"id": "ddc3ddff-13ab-48d7-b4fc-8196ec7d2485", "address": "fa:16:3e:ba:cb:fb", "network": {"id": "8f7dd756-4715-4085-bfab-8432f99f2e77", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1836278743-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d400c9e6a57b4b8b830b7fd7a83bc8c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapddc3ddff-13", "ovs_interfaceid": "ddc3ddff-13ab-48d7-b4fc-8196ec7d2485", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 23:19:01 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-5d639bd9-cf48-4d55-adbf-797a9cf83e48 tempest-VolumesActionsTest-1040491269 tempest-VolumesActionsTest-1040491269-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ba:cb:fb,bridge_name='br-int',has_traffic_filtering=True,id=ddc3ddff-13ab-48d7-b4fc-8196ec7d2485,network=Network(8f7dd756-4715-4085-bfab-8432f99f2e77),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapddc3ddff-13') {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 23:19:01 user nova-compute[75045]: DEBUG os_vif [None req-5d639bd9-cf48-4d55-adbf-797a9cf83e48 tempest-VolumesActionsTest-1040491269 tempest-VolumesActionsTest-1040491269-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ba:cb:fb,bridge_name='br-int',has_traffic_filtering=True,id=ddc3ddff-13ab-48d7-b4fc-8196ec7d2485,network=Network(8f7dd756-4715-4085-bfab-8432f99f2e77),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapddc3ddff-13') {{(pid=75045) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 23:19:01 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:19:01 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:19:01 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 23:19:01 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:19:01 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f460695c-bfce-5b58-9951-dd6e43d8dd97', '_type': 'linux-noop'}}, row=False) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:19:01 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:19:01 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:19:01 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:19:01 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapddc3ddff-13, may_exist=True, interface_attrs={}) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:19:01 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapddc3ddff-13, col_values=(('qos', UUID('4a2fbdd8-042e-44c3-b026-f3821a840873')),), if_exists=True) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:19:01 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapddc3ddff-13, col_values=(('external_ids', {'iface-id': 'ddc3ddff-13ab-48d7-b4fc-8196ec7d2485', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ba:cb:fb', 'vm-uuid': '0de15211-d094-479a-86ce-292389441fa8'}),), if_exists=True) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:19:01 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:19:01 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 23:19:01 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:19:01 user nova-compute[75045]: INFO os_vif [None req-5d639bd9-cf48-4d55-adbf-797a9cf83e48 tempest-VolumesActionsTest-1040491269 tempest-VolumesActionsTest-1040491269-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ba:cb:fb,bridge_name='br-int',has_traffic_filtering=True,id=ddc3ddff-13ab-48d7-b4fc-8196ec7d2485,network=Network(8f7dd756-4715-4085-bfab-8432f99f2e77),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapddc3ddff-13')
Nov 08 23:19:01 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-5d639bd9-cf48-4d55-adbf-797a9cf83e48 tempest-VolumesActionsTest-1040491269 tempest-VolumesActionsTest-1040491269-project-member] No BDM found with device name vda, not building metadata. {{(pid=75045) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 23:19:01 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-5d639bd9-cf48-4d55-adbf-797a9cf83e48 tempest-VolumesActionsTest-1040491269 tempest-VolumesActionsTest-1040491269-project-member] No VIF found with MAC fa:16:3e:ba:cb:fb, not building metadata {{(pid=75045) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 23:19:01 user nova-compute[75045]: DEBUG nova.network.neutron [req-fb27f430-0b5b-441b-9cc1-c6b57cc52610 req-87f1ef6e-08da-49e8-a017-05b91feaa9e0 service nova] [instance: 0de15211-d094-479a-86ce-292389441fa8] Updated VIF entry in instance network info cache for port ddc3ddff-13ab-48d7-b4fc-8196ec7d2485. {{(pid=75045) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 23:19:01 user nova-compute[75045]: DEBUG nova.network.neutron [req-fb27f430-0b5b-441b-9cc1-c6b57cc52610 req-87f1ef6e-08da-49e8-a017-05b91feaa9e0 service nova] [instance: 0de15211-d094-479a-86ce-292389441fa8] Updating instance_info_cache with network_info: [{"id": "ddc3ddff-13ab-48d7-b4fc-8196ec7d2485", "address": "fa:16:3e:ba:cb:fb", "network": {"id": "8f7dd756-4715-4085-bfab-8432f99f2e77", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1836278743-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d400c9e6a57b4b8b830b7fd7a83bc8c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapddc3ddff-13", "ovs_interfaceid": "ddc3ddff-13ab-48d7-b4fc-8196ec7d2485", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75045) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 23:19:01 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-fb27f430-0b5b-441b-9cc1-c6b57cc52610 req-87f1ef6e-08da-49e8-a017-05b91feaa9e0 service nova] Releasing lock "refresh_cache-0de15211-d094-479a-86ce-292389441fa8" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 23:19:02 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:19:02 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:19:02 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:19:02 user nova-compute[75045]: DEBUG nova.compute.manager [req-c09d5c10-945b-4cb2-9b0e-16dedca284ab req-9c9b40a4-8296-49b4-9b96-33f381e071d7 service nova] [instance: 0de15211-d094-479a-86ce-292389441fa8] Received event network-vif-plugged-ddc3ddff-13ab-48d7-b4fc-8196ec7d2485 {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:19:02 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-c09d5c10-945b-4cb2-9b0e-16dedca284ab req-9c9b40a4-8296-49b4-9b96-33f381e071d7 service nova] Acquiring lock "0de15211-d094-479a-86ce-292389441fa8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:19:02 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-c09d5c10-945b-4cb2-9b0e-16dedca284ab req-9c9b40a4-8296-49b4-9b96-33f381e071d7 service nova] Lock "0de15211-d094-479a-86ce-292389441fa8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:19:02 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-c09d5c10-945b-4cb2-9b0e-16dedca284ab req-9c9b40a4-8296-49b4-9b96-33f381e071d7 service nova] Lock "0de15211-d094-479a-86ce-292389441fa8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:19:02 user nova-compute[75045]: DEBUG nova.compute.manager [req-c09d5c10-945b-4cb2-9b0e-16dedca284ab req-9c9b40a4-8296-49b4-9b96-33f381e071d7 service nova] [instance: 0de15211-d094-479a-86ce-292389441fa8] No waiting events found dispatching network-vif-plugged-ddc3ddff-13ab-48d7-b4fc-8196ec7d2485 {{(pid=75045) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 23:19:02 user nova-compute[75045]: WARNING nova.compute.manager [req-c09d5c10-945b-4cb2-9b0e-16dedca284ab req-9c9b40a4-8296-49b4-9b96-33f381e071d7 service nova] [instance: 0de15211-d094-479a-86ce-292389441fa8] Received unexpected event network-vif-plugged-ddc3ddff-13ab-48d7-b4fc-8196ec7d2485 for instance with vm_state building and task_state spawning.
Nov 08 23:19:03 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:19:03 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:19:03 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:19:04 user nova-compute[75045]: DEBUG nova.compute.manager [None req-5d639bd9-cf48-4d55-adbf-797a9cf83e48 tempest-VolumesActionsTest-1040491269 tempest-VolumesActionsTest-1040491269-project-member] [instance: 0de15211-d094-479a-86ce-292389441fa8] Instance event wait completed in 0 seconds for  {{(pid=75045) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 23:19:04 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-5d639bd9-cf48-4d55-adbf-797a9cf83e48 tempest-VolumesActionsTest-1040491269 tempest-VolumesActionsTest-1040491269-project-member] [instance: 0de15211-d094-479a-86ce-292389441fa8] Guest created on hypervisor {{(pid=75045) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 23:19:04 user nova-compute[75045]: INFO nova.virt.libvirt.driver [-] [instance: 0de15211-d094-479a-86ce-292389441fa8] Instance spawned successfully.
Nov 08 23:19:04 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-5d639bd9-cf48-4d55-adbf-797a9cf83e48 tempest-VolumesActionsTest-1040491269 tempest-VolumesActionsTest-1040491269-project-member] [instance: 0de15211-d094-479a-86ce-292389441fa8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75045) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 23:19:04 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-5d639bd9-cf48-4d55-adbf-797a9cf83e48 tempest-VolumesActionsTest-1040491269 tempest-VolumesActionsTest-1040491269-project-member] [instance: 0de15211-d094-479a-86ce-292389441fa8] Found default for hw_cdrom_bus of ide {{(pid=75045) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 23:19:04 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-5d639bd9-cf48-4d55-adbf-797a9cf83e48 tempest-VolumesActionsTest-1040491269 tempest-VolumesActionsTest-1040491269-project-member] [instance: 0de15211-d094-479a-86ce-292389441fa8] Found default for hw_disk_bus of virtio {{(pid=75045) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 23:19:04 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-5d639bd9-cf48-4d55-adbf-797a9cf83e48 tempest-VolumesActionsTest-1040491269 tempest-VolumesActionsTest-1040491269-project-member] [instance: 0de15211-d094-479a-86ce-292389441fa8] Found default for hw_input_bus of None {{(pid=75045) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 23:19:04 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-5d639bd9-cf48-4d55-adbf-797a9cf83e48 tempest-VolumesActionsTest-1040491269 tempest-VolumesActionsTest-1040491269-project-member] [instance: 0de15211-d094-479a-86ce-292389441fa8] Found default for hw_pointer_model of None {{(pid=75045) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 23:19:04 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-5d639bd9-cf48-4d55-adbf-797a9cf83e48 tempest-VolumesActionsTest-1040491269 tempest-VolumesActionsTest-1040491269-project-member] [instance: 0de15211-d094-479a-86ce-292389441fa8] Found default for hw_video_model of virtio {{(pid=75045) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 23:19:04 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-5d639bd9-cf48-4d55-adbf-797a9cf83e48 tempest-VolumesActionsTest-1040491269 tempest-VolumesActionsTest-1040491269-project-member] [instance: 0de15211-d094-479a-86ce-292389441fa8] Found default for hw_vif_model of virtio {{(pid=75045) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 23:19:04 user nova-compute[75045]: DEBUG nova.compute.manager [req-810c7f7a-432d-4a37-bf0a-82b2a456d9d6 req-fc15e972-5b60-403e-b276-6d91e53c9346 service nova] [instance: 0de15211-d094-479a-86ce-292389441fa8] Received event network-vif-plugged-ddc3ddff-13ab-48d7-b4fc-8196ec7d2485 {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:19:04 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-810c7f7a-432d-4a37-bf0a-82b2a456d9d6 req-fc15e972-5b60-403e-b276-6d91e53c9346 service nova] Acquiring lock "0de15211-d094-479a-86ce-292389441fa8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:19:04 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-810c7f7a-432d-4a37-bf0a-82b2a456d9d6 req-fc15e972-5b60-403e-b276-6d91e53c9346 service nova] Lock "0de15211-d094-479a-86ce-292389441fa8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:19:04 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-810c7f7a-432d-4a37-bf0a-82b2a456d9d6 req-fc15e972-5b60-403e-b276-6d91e53c9346 service nova] Lock "0de15211-d094-479a-86ce-292389441fa8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:19:04 user nova-compute[75045]: DEBUG nova.compute.manager [req-810c7f7a-432d-4a37-bf0a-82b2a456d9d6 req-fc15e972-5b60-403e-b276-6d91e53c9346 service nova] [instance: 0de15211-d094-479a-86ce-292389441fa8] No waiting events found dispatching network-vif-plugged-ddc3ddff-13ab-48d7-b4fc-8196ec7d2485 {{(pid=75045) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 23:19:04 user nova-compute[75045]: WARNING nova.compute.manager [req-810c7f7a-432d-4a37-bf0a-82b2a456d9d6 req-fc15e972-5b60-403e-b276-6d91e53c9346 service nova] [instance: 0de15211-d094-479a-86ce-292389441fa8] Received unexpected event network-vif-plugged-ddc3ddff-13ab-48d7-b4fc-8196ec7d2485 for instance with vm_state building and task_state spawning.
Nov 08 23:19:04 user nova-compute[75045]: INFO nova.compute.manager [None req-5d639bd9-cf48-4d55-adbf-797a9cf83e48 tempest-VolumesActionsTest-1040491269 tempest-VolumesActionsTest-1040491269-project-member] [instance: 0de15211-d094-479a-86ce-292389441fa8] Took 5.52 seconds to spawn the instance on the hypervisor.
Nov 08 23:19:04 user nova-compute[75045]: DEBUG nova.compute.manager [None req-5d639bd9-cf48-4d55-adbf-797a9cf83e48 tempest-VolumesActionsTest-1040491269 tempest-VolumesActionsTest-1040491269-project-member] [instance: 0de15211-d094-479a-86ce-292389441fa8] Checking state {{(pid=75045) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 23:19:04 user nova-compute[75045]: INFO nova.compute.manager [None req-5d639bd9-cf48-4d55-adbf-797a9cf83e48 tempest-VolumesActionsTest-1040491269 tempest-VolumesActionsTest-1040491269-project-member] [instance: 0de15211-d094-479a-86ce-292389441fa8] Took 6.55 seconds to build instance.
Nov 08 23:19:04 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-5d639bd9-cf48-4d55-adbf-797a9cf83e48 tempest-VolumesActionsTest-1040491269 tempest-VolumesActionsTest-1040491269-project-member] Lock "0de15211-d094-479a-86ce-292389441fa8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.691s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:19:05 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:19:06 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:19:11 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 23:19:15 user nova-compute[75045]: DEBUG nova.compute.manager [req-9b053273-2900-4d05-9d98-998b434e3472 req-930415e3-e349-4aba-a4cc-112d9ba456e0 service nova] [instance: 725866aa-0e2a-4af3-af20-48157e6d2fcb] Received event network-changed-9a617e54-a69a-4204-b94e-dbe71b1432d2 {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:19:15 user nova-compute[75045]: DEBUG nova.compute.manager [req-9b053273-2900-4d05-9d98-998b434e3472 req-930415e3-e349-4aba-a4cc-112d9ba456e0 service nova] [instance: 725866aa-0e2a-4af3-af20-48157e6d2fcb] Refreshing instance network info cache due to event network-changed-9a617e54-a69a-4204-b94e-dbe71b1432d2. {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 23:19:15 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-9b053273-2900-4d05-9d98-998b434e3472 req-930415e3-e349-4aba-a4cc-112d9ba456e0 service nova] Acquiring lock "refresh_cache-725866aa-0e2a-4af3-af20-48157e6d2fcb" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 23:19:15 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-9b053273-2900-4d05-9d98-998b434e3472 req-930415e3-e349-4aba-a4cc-112d9ba456e0 service nova] Acquired lock "refresh_cache-725866aa-0e2a-4af3-af20-48157e6d2fcb" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 23:19:15 user nova-compute[75045]: DEBUG nova.network.neutron [req-9b053273-2900-4d05-9d98-998b434e3472 req-930415e3-e349-4aba-a4cc-112d9ba456e0 service nova] [instance: 725866aa-0e2a-4af3-af20-48157e6d2fcb] Refreshing network info cache for port 9a617e54-a69a-4204-b94e-dbe71b1432d2 {{(pid=75045) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 23:19:15 user nova-compute[75045]: WARNING nova.virt.libvirt.driver [None req-6c41194c-864d-4a5a-a7f2-b7c9367b17c9 tempest-AttachSCSIVolumeTestJSON-1576344526 tempest-AttachSCSIVolumeTestJSON-1576344526-project-member] Waiting for libvirt event about the detach of device sdc with device alias scsi0-0-0-2 from instance b9bd3096-92eb-4aae-8619-2725ed9acc2b is timed out.
Nov 08 23:19:15 user nova-compute[75045]: INFO nova.virt.libvirt.driver [None req-6c41194c-864d-4a5a-a7f2-b7c9367b17c9 tempest-AttachSCSIVolumeTestJSON-1576344526 tempest-AttachSCSIVolumeTestJSON-1576344526-project-member] Successfully detached device sdc from instance b9bd3096-92eb-4aae-8619-2725ed9acc2b from the live domain config.
Nov 08 23:19:15 user nova-compute[75045]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6c41194c-864d-4a5a-a7f2-b7c9367b17c9 tempest-AttachSCSIVolumeTestJSON-1576344526 tempest-AttachSCSIVolumeTestJSON-1576344526-project-member] [instance: b9bd3096-92eb-4aae-8619-2725ed9acc2b] calling os-brick to detach iSCSI Volume {{(pid=75045) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 23:19:15 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c41194c-864d-4a5a-a7f2-b7c9367b17c9 tempest-AttachSCSIVolumeTestJSON-1576344526 tempest-AttachSCSIVolumeTestJSON-1576344526-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1b68210460>, {'target_iqn': 'iqn.2010-10.org.openstack:8c532e3b-4f3c-4809-bd49-fd7c2ea7f6cd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SVvdYuWa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75045) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 23:19:15 user nova-compute[75045]: WARNING os_brick.initiator.connectors.base [None req-6c41194c-864d-4a5a-a7f2-b7c9367b17c9 tempest-AttachSCSIVolumeTestJSON-1576344526 tempest-AttachSCSIVolumeTestJSON-1576344526-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 23:19:15 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-6c41194c-864d-4a5a-a7f2-b7c9367b17c9 tempest-AttachSCSIVolumeTestJSON-1576344526 tempest-AttachSCSIVolumeTestJSON-1576344526-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 23:19:15 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-6c41194c-864d-4a5a-a7f2-b7c9367b17c9 tempest-AttachSCSIVolumeTestJSON-1576344526 tempest-AttachSCSIVolumeTestJSON-1576344526-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 23:19:15 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:19:15 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.028s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:19:15 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[b046d6d1-6786-4aed-9a8c-c916a65f3039]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:528866cb-30dd-40ac-9a81-4c6afc93cdd9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8c532e3b-4f3c-4809-bd49-fd7c2ea7f6cd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d2068946-d374-45a4-9850-e3a690b13ef4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4d7a4df0-bfc5-4952-8454-97b703b68f28\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f829f03c-8f1a-45f1-a715-b9d769201d1b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:19:15 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c41194c-864d-4a5a-a7f2-b7c9367b17c9 tempest-AttachSCSIVolumeTestJSON-1576344526 tempest-AttachSCSIVolumeTestJSON-1576344526-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 23:19:15 user nova-compute[75045]: No targets found.
Nov 08 23:19:15 user nova-compute[75045]: iSNS:
Nov 08 23:19:15 user nova-compute[75045]: No targets found.
Nov 08 23:19:15 user nova-compute[75045]: STATIC:
Nov 08 23:19:15 user nova-compute[75045]: Target: iqn.2010-10.org.openstack:528866cb-30dd-40ac-9a81-4c6afc93cdd9
Nov 08 23:19:15 user nova-compute[75045]:         Portal: 172.16.0.220:3260,-1
Nov 08 23:19:15 user nova-compute[75045]:                 Iface Name: default
Nov 08 23:19:15 user nova-compute[75045]: Target: iqn.2010-10.org.openstack:8c532e3b-4f3c-4809-bd49-fd7c2ea7f6cd
Nov 08 23:19:15 user nova-compute[75045]:         Portal: 172.16.0.220:3260,-1
Nov 08 23:19:15 user nova-compute[75045]:                 Iface Name: default
Nov 08 23:19:15 user nova-compute[75045]: Target: iqn.2010-10.org.openstack:d2068946-d374-45a4-9850-e3a690b13ef4
Nov 08 23:19:15 user nova-compute[75045]:         Portal: 172.16.0.220:3260,-1
Nov 08 23:19:15 user nova-compute[75045]:                 Iface Name: default
Nov 08 23:19:15 user nova-compute[75045]: Target: iqn.2010-10.org.openstack:4d7a4df0-bfc5-4952-8454-97b703b68f28
Nov 08 23:19:15 user nova-compute[75045]:         Portal: 172.16.0.220:3260,-1
Nov 08 23:19:15 user nova-compute[75045]:                 Iface Name: default
Nov 08 23:19:15 user nova-compute[75045]: Target: iqn.2010-10.org.openstack:f829f03c-8f1a-45f1-a715-b9d769201d1b
Nov 08 23:19:15 user nova-compute[75045]:         Portal: 172.16.0.220:3260,-1
Nov 08 23:19:15 user nova-compute[75045]:                 Iface Name: default
Nov 08 23:19:15 user nova-compute[75045]: FIRMWARE:
Nov 08 23:19:15 user nova-compute[75045]: No targets found.
Nov 08 23:19:15 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 23:19:15 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c41194c-864d-4a5a-a7f2-b7c9367b17c9 tempest-AttachSCSIVolumeTestJSON-1576344526 tempest-AttachSCSIVolumeTestJSON-1576344526-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 23:19:15 user nova-compute[75045]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 23:19:15 user nova-compute[75045]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75045) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 23:19:15 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c41194c-864d-4a5a-a7f2-b7c9367b17c9 tempest-AttachSCSIVolumeTestJSON-1576344526 tempest-AttachSCSIVolumeTestJSON-1576344526-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8c532e3b-4f3c-4809-bd49-fd7c2ea7f6cd', 0)] {{(pid=75045) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 23:19:15 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:19:16 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:19:16 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf436461-1a70-49f4-afee-cf32cd915058]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4d7a4df0-bfc5-4952-8454-97b703b68f28\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:528866cb-30dd-40ac-9a81-4c6afc93cdd9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8c532e3b-4f3c-4809-bd49-fd7c2ea7f6cd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d2068946-d374-45a4-9850-e3a690b13ef4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f829f03c-8f1a-45f1-a715-b9d769201d1b\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:19:16 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:19:16 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:19:16 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[20f8e388-d266-4780-bf2c-501e717555ba]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2068946-d374-45a4-9850-e3a690b13ef4 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c532e3b-4f3c-4809-bd49-fd7c2ea7f6cd (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d7a4df0-bfc5-4952-8454-97b703b68f28 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f829f03c-8f1a-45f1-a715-b9d769201d1b (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:528866cb-30dd-40ac-9a81-4c6afc93cdd9 (non-flash)\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:19:16 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c41194c-864d-4a5a-a7f2-b7c9367b17c9 tempest-AttachSCSIVolumeTestJSON-1576344526 tempest-AttachSCSIVolumeTestJSON-1576344526-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2068946-d374-45a4-9850-e3a690b13ef4 (non-flash)
Nov 08 23:19:16 user nova-compute[75045]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c532e3b-4f3c-4809-bd49-fd7c2ea7f6cd (non-flash)
Nov 08 23:19:16 user nova-compute[75045]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d7a4df0-bfc5-4952-8454-97b703b68f28 (non-flash)
Nov 08 23:19:16 user nova-compute[75045]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f829f03c-8f1a-45f1-a715-b9d769201d1b (non-flash)
Nov 08 23:19:16 user nova-compute[75045]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:528866cb-30dd-40ac-9a81-4c6afc93cdd9 (non-flash)
Nov 08 23:19:16 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 23:19:16 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c41194c-864d-4a5a-a7f2-b7c9367b17c9 tempest-AttachSCSIVolumeTestJSON-1576344526 tempest-AttachSCSIVolumeTestJSON-1576344526-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2068946-d374-45a4-9850-e3a690b13ef4 (non-flash)
Nov 08 23:19:16 user nova-compute[75045]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c532e3b-4f3c-4809-bd49-fd7c2ea7f6cd (non-flash)
Nov 08 23:19:16 user nova-compute[75045]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d7a4df0-bfc5-4952-8454-97b703b68f28 (non-flash)
Nov 08 23:19:16 user nova-compute[75045]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f829f03c-8f1a-45f1-a715-b9d769201d1b (non-flash)
Nov 08 23:19:16 user nova-compute[75045]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:528866cb-30dd-40ac-9a81-4c6afc93cdd9 (non-flash)
Nov 08 23:19:16 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 23:19:16 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c41194c-864d-4a5a-a7f2-b7c9367b17c9 tempest-AttachSCSIVolumeTestJSON-1576344526 tempest-AttachSCSIVolumeTestJSON-1576344526-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1b709560e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8c532e3b-4f3c-4809-bd49-fd7c2ea7f6cd'): ({'sdc'}, set())}) {{(pid=75045) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 23:19:16 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-6c41194c-864d-4a5a-a7f2-b7c9367b17c9 tempest-AttachSCSIVolumeTestJSON-1576344526 tempest-AttachSCSIVolumeTestJSON-1576344526-project-member] Removing single pathed devices sdc {{(pid=75045) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 23:19:16 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:19:16 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:19:16 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e6f7275-4fdb-4f8f-8b09-245b52dab718]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:19:16 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:19:16 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.027s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:19:16 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b78c62b-1a96-438b-adde-517ea8b5f0bf]: (4, ('ok\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:19:16 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-6c41194c-864d-4a5a-a7f2-b7c9367b17c9 tempest-AttachSCSIVolumeTestJSON-1576344526 tempest-AttachSCSIVolumeTestJSON-1576344526-project-member] Flushing IO for device /dev/sdc {{(pid=75045) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 23:19:16 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:19:16 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.016s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:19:16 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[47a997d5-9be1-4673-9620-4c1ed7a7c873]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:19:16 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-6c41194c-864d-4a5a-a7f2-b7c9367b17c9 tempest-AttachSCSIVolumeTestJSON-1576344526 tempest-AttachSCSIVolumeTestJSON-1576344526-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75045) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 23:19:16 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:19:16 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 23:19:16 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:19:16 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75045) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 23:19:16 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75045) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 23:19:16 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75045) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 23:19:16 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:19:16 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.046s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:19:16 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e28d1e1-9bbc-4134-9dd5-ba5c575bfafc]: (4, ('1', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:19:16 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-6c41194c-864d-4a5a-a7f2-b7c9367b17c9 tempest-AttachSCSIVolumeTestJSON-1576344526 tempest-AttachSCSIVolumeTestJSON-1576344526-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75045) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 23:19:16 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-6c41194c-864d-4a5a-a7f2-b7c9367b17c9 tempest-AttachSCSIVolumeTestJSON-1576344526 tempest-AttachSCSIVolumeTestJSON-1576344526-project-member] SCSI volumes sdc have been removed. {{(pid=75045) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 23:19:16 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c41194c-864d-4a5a-a7f2-b7c9367b17c9 tempest-AttachSCSIVolumeTestJSON-1576344526 tempest-AttachSCSIVolumeTestJSON-1576344526-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8c532e3b-4f3c-4809-bd49-fd7c2ea7f6cd')] {{(pid=75045) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 23:19:16 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c532e3b-4f3c-4809-bd49-fd7c2ea7f6cd -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:19:16 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c532e3b-4f3c-4809-bd49-fd7c2ea7f6cd -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.031s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:19:16 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[db4c53fe-644a-4e70-8f54-9d16fb957ef0]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:19:16 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c41194c-864d-4a5a-a7f2-b7c9367b17c9 tempest-AttachSCSIVolumeTestJSON-1576344526 tempest-AttachSCSIVolumeTestJSON-1576344526-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:19:16 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c532e3b-4f3c-4809-bd49-fd7c2ea7f6cd -p 172.16.0.220:3260 --logout {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:19:16 user nova-compute[75045]: DEBUG nova.network.neutron [req-9b053273-2900-4d05-9d98-998b434e3472 req-930415e3-e349-4aba-a4cc-112d9ba456e0 service nova] [instance: 725866aa-0e2a-4af3-af20-48157e6d2fcb] Updated VIF entry in instance network info cache for port 9a617e54-a69a-4204-b94e-dbe71b1432d2. {{(pid=75045) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 23:19:16 user nova-compute[75045]: DEBUG nova.network.neutron [req-9b053273-2900-4d05-9d98-998b434e3472 req-930415e3-e349-4aba-a4cc-112d9ba456e0 service nova] [instance: 725866aa-0e2a-4af3-af20-48157e6d2fcb] Updating instance_info_cache with network_info: [{"id": "9a617e54-a69a-4204-b94e-dbe71b1432d2", "address": "fa:16:3e:64:ef:b6", "network": {"id": "25b429b3-693b-4e72-9035-71c276706294", "bridge": "br-int", "label": "tempest-TestShelveInstance-437524717-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.40", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec089e7050c542c9860d9fc5f3ae9392", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a617e54-a6", "ovs_interfaceid": "9a617e54-a69a-4204-b94e-dbe71b1432d2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75045) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 23:19:16 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-9b053273-2900-4d05-9d98-998b434e3472 req-930415e3-e349-4aba-a4cc-112d9ba456e0 service nova] Releasing lock "refresh_cache-725866aa-0e2a-4af3-af20-48157e6d2fcb" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 23:19:16 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c532e3b-4f3c-4809-bd49-fd7c2ea7f6cd -p 172.16.0.220:3260 --logout" returned: 0 in 0.077s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:19:16 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[a34b2a5e-e6c2-4cdb-966b-3fce811cf73b]: (4, ('Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:8c532e3b-4f3c-4809-bd49-fd7c2ea7f6cd, portal: 172.16.0.220,3260]\nLogout of [sid: 4, target: iqn.2010-10.org.openstack:8c532e3b-4f3c-4809-bd49-fd7c2ea7f6cd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:19:16 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c41194c-864d-4a5a-a7f2-b7c9367b17c9 tempest-AttachSCSIVolumeTestJSON-1576344526 tempest-AttachSCSIVolumeTestJSON-1576344526-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:8c532e3b-4f3c-4809-bd49-fd7c2ea7f6cd, portal: 172.16.0.220,3260]
Nov 08 23:19:16 user nova-compute[75045]: Logout of [sid: 4, target: iqn.2010-10.org.openstack:8c532e3b-4f3c-4809-bd49-fd7c2ea7f6cd, portal: 172.16.0.220,3260] successful.
Nov 08 23:19:16 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:19:16 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c532e3b-4f3c-4809-bd49-fd7c2ea7f6cd -p 172.16.0.220:3260 --op delete {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:19:16 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c532e3b-4f3c-4809-bd49-fd7c2ea7f6cd -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:19:16 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b532370-f71d-469a-be27-8fa21b8cd24d]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:19:16 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c41194c-864d-4a5a-a7f2-b7c9367b17c9 tempest-AttachSCSIVolumeTestJSON-1576344526 tempest-AttachSCSIVolumeTestJSON-1576344526-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:19:16 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-6c41194c-864d-4a5a-a7f2-b7c9367b17c9 tempest-AttachSCSIVolumeTestJSON-1576344526 tempest-AttachSCSIVolumeTestJSON-1576344526-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.388s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 23:19:16 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c41194c-864d-4a5a-a7f2-b7c9367b17c9 tempest-AttachSCSIVolumeTestJSON-1576344526 tempest-AttachSCSIVolumeTestJSON-1576344526-project-member] <== disconnect_volume: return (391ms) None {{(pid=75045) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 23:19:16 user nova-compute[75045]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6c41194c-864d-4a5a-a7f2-b7c9367b17c9 tempest-AttachSCSIVolumeTestJSON-1576344526 tempest-AttachSCSIVolumeTestJSON-1576344526-project-member] [instance: b9bd3096-92eb-4aae-8619-2725ed9acc2b] Disconnected iSCSI Volume {{(pid=75045) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 23:19:16 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-3bdb0085-b32d-48fe-9776-c6553cadecc5 tempest-TestShelveInstance-1634360024 tempest-TestShelveInstance-1634360024-project-member] Acquiring lock "725866aa-0e2a-4af3-af20-48157e6d2fcb" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:19:16 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-3bdb0085-b32d-48fe-9776-c6553cadecc5 tempest-TestShelveInstance-1634360024 tempest-TestShelveInstance-1634360024-project-member] Lock "725866aa-0e2a-4af3-af20-48157e6d2fcb" acquired by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:19:16 user nova-compute[75045]: INFO nova.compute.manager [None req-3bdb0085-b32d-48fe-9776-c6553cadecc5 tempest-TestShelveInstance-1634360024 tempest-TestShelveInstance-1634360024-project-member] [instance: 725866aa-0e2a-4af3-af20-48157e6d2fcb] Shelve offloading
Nov 08 23:19:16 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:19:16 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:19:16 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:19:16 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:19:16 user nova-compute[75045]: DEBUG nova.compute.manager [req-895c45a3-b807-4b8b-904d-9658fcf2d06c req-34e5a729-9870-474e-b32d-55fb264b3dde service nova] [instance: 725866aa-0e2a-4af3-af20-48157e6d2fcb] Received event network-vif-unplugged-9a617e54-a69a-4204-b94e-dbe71b1432d2 {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:19:16 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-895c45a3-b807-4b8b-904d-9658fcf2d06c req-34e5a729-9870-474e-b32d-55fb264b3dde service nova] Acquiring lock "725866aa-0e2a-4af3-af20-48157e6d2fcb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:19:16 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-895c45a3-b807-4b8b-904d-9658fcf2d06c req-34e5a729-9870-474e-b32d-55fb264b3dde service nova] Lock "725866aa-0e2a-4af3-af20-48157e6d2fcb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:19:16 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-895c45a3-b807-4b8b-904d-9658fcf2d06c req-34e5a729-9870-474e-b32d-55fb264b3dde service nova] Lock "725866aa-0e2a-4af3-af20-48157e6d2fcb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:19:16 user nova-compute[75045]: DEBUG nova.compute.manager [req-895c45a3-b807-4b8b-904d-9658fcf2d06c req-34e5a729-9870-474e-b32d-55fb264b3dde service nova] [instance: 725866aa-0e2a-4af3-af20-48157e6d2fcb] No waiting events found dispatching network-vif-unplugged-9a617e54-a69a-4204-b94e-dbe71b1432d2 {{(pid=75045) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 23:19:16 user nova-compute[75045]: WARNING nova.compute.manager [req-895c45a3-b807-4b8b-904d-9658fcf2d06c req-34e5a729-9870-474e-b32d-55fb264b3dde service nova] [instance: 725866aa-0e2a-4af3-af20-48157e6d2fcb] Received unexpected event network-vif-unplugged-9a617e54-a69a-4204-b94e-dbe71b1432d2 for instance with vm_state active and task_state shelving.
Nov 08 23:19:16 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:19:17 user nova-compute[75045]: INFO nova.virt.libvirt.driver [-] [instance: 725866aa-0e2a-4af3-af20-48157e6d2fcb] Instance destroyed successfully.
Nov 08 23:19:17 user nova-compute[75045]: DEBUG nova.compute.manager [None req-3bdb0085-b32d-48fe-9776-c6553cadecc5 tempest-TestShelveInstance-1634360024 tempest-TestShelveInstance-1634360024-project-member] [instance: 725866aa-0e2a-4af3-af20-48157e6d2fcb] Checking state {{(pid=75045) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 23:19:17 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-3bdb0085-b32d-48fe-9776-c6553cadecc5 tempest-TestShelveInstance-1634360024 tempest-TestShelveInstance-1634360024-project-member] Acquiring lock "refresh_cache-725866aa-0e2a-4af3-af20-48157e6d2fcb" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 23:19:17 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-3bdb0085-b32d-48fe-9776-c6553cadecc5 tempest-TestShelveInstance-1634360024 tempest-TestShelveInstance-1634360024-project-member] Acquired lock "refresh_cache-725866aa-0e2a-4af3-af20-48157e6d2fcb" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 23:19:17 user nova-compute[75045]: DEBUG nova.network.neutron [None req-3bdb0085-b32d-48fe-9776-c6553cadecc5 tempest-TestShelveInstance-1634360024 tempest-TestShelveInstance-1634360024-project-member] [instance: 725866aa-0e2a-4af3-af20-48157e6d2fcb] Building network info cache for instance {{(pid=75045) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 23:19:17 user nova-compute[75045]: DEBUG nova.network.neutron [None req-3bdb0085-b32d-48fe-9776-c6553cadecc5 tempest-TestShelveInstance-1634360024 tempest-TestShelveInstance-1634360024-project-member] [instance: 725866aa-0e2a-4af3-af20-48157e6d2fcb] Updating instance_info_cache with network_info: [{"id": "9a617e54-a69a-4204-b94e-dbe71b1432d2", "address": "fa:16:3e:64:ef:b6", "network": {"id": "25b429b3-693b-4e72-9035-71c276706294", "bridge": "br-int", "label": "tempest-TestShelveInstance-437524717-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.40", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec089e7050c542c9860d9fc5f3ae9392", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a617e54-a6", "ovs_interfaceid": "9a617e54-a69a-4204-b94e-dbe71b1432d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75045) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 23:19:17 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-3bdb0085-b32d-48fe-9776-c6553cadecc5 tempest-TestShelveInstance-1634360024 tempest-TestShelveInstance-1634360024-project-member] Releasing lock "refresh_cache-725866aa-0e2a-4af3-af20-48157e6d2fcb" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 23:19:18 user nova-compute[75045]: INFO nova.compute.manager [None req-0e7deb14-eb81-45e0-9c30-1322b63950a4 tempest-TestVolumeSwap-1091185069 tempest-TestVolumeSwap-1091185069-project-admin] [instance: fde91f7c-31e3-456c-b252-6ce37fa3b600] Swapping volume 4d7a4df0-bfc5-4952-8454-97b703b68f28 for c7f7084f-f0d7-4d4b-9a14-69065a9c3e41
Nov 08 23:19:18 user nova-compute[75045]: INFO nova.virt.libvirt.driver [-] [instance: 725866aa-0e2a-4af3-af20-48157e6d2fcb] Instance destroyed successfully.
Nov 08 23:19:18 user nova-compute[75045]: DEBUG nova.objects.instance [None req-3bdb0085-b32d-48fe-9776-c6553cadecc5 tempest-TestShelveInstance-1634360024 tempest-TestShelveInstance-1634360024-project-member] Lazy-loading 'resources' on Instance uuid 725866aa-0e2a-4af3-af20-48157e6d2fcb {{(pid=75045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 23:19:18 user nova-compute[75045]: DEBUG nova.virt.libvirt.vif [None req-3bdb0085-b32d-48fe-9776-c6553cadecc5 tempest-TestShelveInstance-1634360024 tempest-TestShelveInstance-1634360024-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T23:17:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-961488157',display_name='tempest-TestShelveInstance-server-961488157',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-961488157',id=9,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPdSdRn8WciiiK68fvoPSG0DN5FXQxOXxXUm/XL4qxnEmO5qC4nYOWk8Lgcyp12BuaZBz/IIiTtq1Y4TgPZ8aXxKhhN+gEPxX15QF8o4xT2o0K09li/F7ysXt5rBzWL/Lw==',key_name='tempest-TestShelveInstance-1861694278',keypairs=<?>,launch_index=0,launched_at=2023-11-08T23:17:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ec089e7050c542c9860d9fc5f3ae9392',ramdisk_id='',reservation_id='r-2v3622zl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1634360024',owner_user_name='tempest-TestShelveInstance-1634360024-project-member'},tags=<?>,task_state='shelving',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T23:17:58Z,user_data=None,user_id='e30385ff71444d4f9a799c79e0ab67e9',uuid=725866aa-0e2a-4af3-af20-48157e6d2fcb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9a617e54-a69a-4204-b94e-dbe71b1432d2", "address": "fa:16:3e:64:ef:b6", "network": {"id": "25b429b3-693b-4e72-9035-71c276706294", "bridge": "br-int", "label": "tempest-TestShelveInstance-437524717-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.40", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec089e7050c542c9860d9fc5f3ae9392", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a617e54-a6", "ovs_interfaceid": "9a617e54-a69a-4204-b94e-dbe71b1432d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75045) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 23:19:18 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-3bdb0085-b32d-48fe-9776-c6553cadecc5 tempest-TestShelveInstance-1634360024 tempest-TestShelveInstance-1634360024-project-member] Converting VIF {"id": "9a617e54-a69a-4204-b94e-dbe71b1432d2", "address": "fa:16:3e:64:ef:b6", "network": {"id": "25b429b3-693b-4e72-9035-71c276706294", "bridge": "br-int", "label": "tempest-TestShelveInstance-437524717-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.40", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec089e7050c542c9860d9fc5f3ae9392", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a617e54-a6", "ovs_interfaceid": "9a617e54-a69a-4204-b94e-dbe71b1432d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 23:19:18 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-3bdb0085-b32d-48fe-9776-c6553cadecc5 tempest-TestShelveInstance-1634360024 tempest-TestShelveInstance-1634360024-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:64:ef:b6,bridge_name='br-int',has_traffic_filtering=True,id=9a617e54-a69a-4204-b94e-dbe71b1432d2,network=Network(25b429b3-693b-4e72-9035-71c276706294),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9a617e54-a6') {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 23:19:18 user nova-compute[75045]: DEBUG os_vif [None req-3bdb0085-b32d-48fe-9776-c6553cadecc5 tempest-TestShelveInstance-1634360024 tempest-TestShelveInstance-1634360024-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:64:ef:b6,bridge_name='br-int',has_traffic_filtering=True,id=9a617e54-a69a-4204-b94e-dbe71b1432d2,network=Network(25b429b3-693b-4e72-9035-71c276706294),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9a617e54-a6') {{(pid=75045) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 23:19:18 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:19:18 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9a617e54-a6, bridge=br-int, if_exists=True) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:19:18 user nova-compute[75045]: DEBUG nova.compute.manager [req-7c0c48cb-9439-4b4c-9da3-3eeaed630190 req-7a063180-9ba4-4421-987a-2e89134b60ed service nova] [instance: 725866aa-0e2a-4af3-af20-48157e6d2fcb] Received event network-changed-9a617e54-a69a-4204-b94e-dbe71b1432d2 {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:19:18 user nova-compute[75045]: DEBUG nova.compute.manager [req-7c0c48cb-9439-4b4c-9da3-3eeaed630190 req-7a063180-9ba4-4421-987a-2e89134b60ed service nova] [instance: 725866aa-0e2a-4af3-af20-48157e6d2fcb] Refreshing instance network info cache due to event network-changed-9a617e54-a69a-4204-b94e-dbe71b1432d2. {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 23:19:18 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-7c0c48cb-9439-4b4c-9da3-3eeaed630190 req-7a063180-9ba4-4421-987a-2e89134b60ed service nova] Acquiring lock "refresh_cache-725866aa-0e2a-4af3-af20-48157e6d2fcb" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 23:19:18 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-7c0c48cb-9439-4b4c-9da3-3eeaed630190 req-7a063180-9ba4-4421-987a-2e89134b60ed service nova] Acquired lock "refresh_cache-725866aa-0e2a-4af3-af20-48157e6d2fcb" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 23:19:18 user nova-compute[75045]: DEBUG nova.network.neutron [req-7c0c48cb-9439-4b4c-9da3-3eeaed630190 req-7a063180-9ba4-4421-987a-2e89134b60ed service nova] [instance: 725866aa-0e2a-4af3-af20-48157e6d2fcb] Refreshing network info cache for port 9a617e54-a69a-4204-b94e-dbe71b1432d2 {{(pid=75045) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 23:19:18 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:19:18 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 23:19:18 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:19:18 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b01b735d-3cbc-4987-ba60-1ccfc376b0d2) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:19:18 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:19:18 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 23:19:18 user nova-compute[75045]: INFO os_vif [None req-3bdb0085-b32d-48fe-9776-c6553cadecc5 tempest-TestShelveInstance-1634360024 tempest-TestShelveInstance-1634360024-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:64:ef:b6,bridge_name='br-int',has_traffic_filtering=True,id=9a617e54-a69a-4204-b94e-dbe71b1432d2,network=Network(25b429b3-693b-4e72-9035-71c276706294),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9a617e54-a6')
Nov 08 23:19:18 user nova-compute[75045]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3bdb0085-b32d-48fe-9776-c6553cadecc5 tempest-TestShelveInstance-1634360024 tempest-TestShelveInstance-1634360024-project-member] [instance: 725866aa-0e2a-4af3-af20-48157e6d2fcb] calling os-brick to detach iSCSI Volume {{(pid=75045) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 23:19:18 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bdb0085-b32d-48fe-9776-c6553cadecc5 tempest-TestShelveInstance-1634360024 tempest-TestShelveInstance-1634360024-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1b68210460>, {'target_iqn': 'iqn.2010-10.org.openstack:d2068946-d374-45a4-9850-e3a690b13ef4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eQScvmpf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75045) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 23:19:18 user nova-compute[75045]: WARNING os_brick.initiator.connectors.base [None req-3bdb0085-b32d-48fe-9776-c6553cadecc5 tempest-TestShelveInstance-1634360024 tempest-TestShelveInstance-1634360024-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 23:19:18 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-3bdb0085-b32d-48fe-9776-c6553cadecc5 tempest-TestShelveInstance-1634360024 tempest-TestShelveInstance-1634360024-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 23:19:18 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-3bdb0085-b32d-48fe-9776-c6553cadecc5 tempest-TestShelveInstance-1634360024 tempest-TestShelveInstance-1634360024-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 23:19:18 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:19:18 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.028s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:19:18 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdaf5e0f-a3ff-457a-9768-f5f7305f4dbf]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:528866cb-30dd-40ac-9a81-4c6afc93cdd9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d2068946-d374-45a4-9850-e3a690b13ef4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4d7a4df0-bfc5-4952-8454-97b703b68f28\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f829f03c-8f1a-45f1-a715-b9d769201d1b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:19:18 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bdb0085-b32d-48fe-9776-c6553cadecc5 tempest-TestShelveInstance-1634360024 tempest-TestShelveInstance-1634360024-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 23:19:18 user nova-compute[75045]: No targets found.
Nov 08 23:19:18 user nova-compute[75045]: iSNS:
Nov 08 23:19:18 user nova-compute[75045]: No targets found.
Nov 08 23:19:18 user nova-compute[75045]: STATIC:
Nov 08 23:19:18 user nova-compute[75045]: Target: iqn.2010-10.org.openstack:528866cb-30dd-40ac-9a81-4c6afc93cdd9
Nov 08 23:19:18 user nova-compute[75045]:         Portal: 172.16.0.220:3260,-1
Nov 08 23:19:18 user nova-compute[75045]:                 Iface Name: default
Nov 08 23:19:18 user nova-compute[75045]: Target: iqn.2010-10.org.openstack:d2068946-d374-45a4-9850-e3a690b13ef4
Nov 08 23:19:18 user nova-compute[75045]:         Portal: 172.16.0.220:3260,-1
Nov 08 23:19:18 user nova-compute[75045]:                 Iface Name: default
Nov 08 23:19:18 user nova-compute[75045]: Target: iqn.2010-10.org.openstack:4d7a4df0-bfc5-4952-8454-97b703b68f28
Nov 08 23:19:18 user nova-compute[75045]:         Portal: 172.16.0.220:3260,-1
Nov 08 23:19:18 user nova-compute[75045]:                 Iface Name: default
Nov 08 23:19:18 user nova-compute[75045]: Target: iqn.2010-10.org.openstack:f829f03c-8f1a-45f1-a715-b9d769201d1b
Nov 08 23:19:18 user nova-compute[75045]:         Portal: 172.16.0.220:3260,-1
Nov 08 23:19:18 user nova-compute[75045]:                 Iface Name: default
Nov 08 23:19:18 user nova-compute[75045]: FIRMWARE:
Nov 08 23:19:18 user nova-compute[75045]: No targets found.
Nov 08 23:19:18 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 23:19:18 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bdb0085-b32d-48fe-9776-c6553cadecc5 tempest-TestShelveInstance-1634360024 tempest-TestShelveInstance-1634360024-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 23:19:18 user nova-compute[75045]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 23:19:18 user nova-compute[75045]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75045) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 23:19:18 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bdb0085-b32d-48fe-9776-c6553cadecc5 tempest-TestShelveInstance-1634360024 tempest-TestShelveInstance-1634360024-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d2068946-d374-45a4-9850-e3a690b13ef4', 0)] {{(pid=75045) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 23:19:18 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:19:18 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:19:18 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[15c714e9-5a32-46a1-af7f-14efde978d24]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4d7a4df0-bfc5-4952-8454-97b703b68f28\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:528866cb-30dd-40ac-9a81-4c6afc93cdd9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d2068946-d374-45a4-9850-e3a690b13ef4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f829f03c-8f1a-45f1-a715-b9d769201d1b\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:19:18 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:19:18 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:19:18 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c8d32ab-a7c1-4066-8a9e-dc8ae3ac5cde]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2068946-d374-45a4-9850-e3a690b13ef4 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d7a4df0-bfc5-4952-8454-97b703b68f28 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f829f03c-8f1a-45f1-a715-b9d769201d1b (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:528866cb-30dd-40ac-9a81-4c6afc93cdd9 (non-flash)\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:19:18 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bdb0085-b32d-48fe-9776-c6553cadecc5 tempest-TestShelveInstance-1634360024 tempest-TestShelveInstance-1634360024-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2068946-d374-45a4-9850-e3a690b13ef4 (non-flash)
Nov 08 23:19:18 user nova-compute[75045]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d7a4df0-bfc5-4952-8454-97b703b68f28 (non-flash)
Nov 08 23:19:18 user nova-compute[75045]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f829f03c-8f1a-45f1-a715-b9d769201d1b (non-flash)
Nov 08 23:19:18 user nova-compute[75045]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:528866cb-30dd-40ac-9a81-4c6afc93cdd9 (non-flash)
Nov 08 23:19:18 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 23:19:18 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bdb0085-b32d-48fe-9776-c6553cadecc5 tempest-TestShelveInstance-1634360024 tempest-TestShelveInstance-1634360024-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2068946-d374-45a4-9850-e3a690b13ef4 (non-flash)
Nov 08 23:19:18 user nova-compute[75045]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d7a4df0-bfc5-4952-8454-97b703b68f28 (non-flash)
Nov 08 23:19:18 user nova-compute[75045]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f829f03c-8f1a-45f1-a715-b9d769201d1b (non-flash)
Nov 08 23:19:18 user nova-compute[75045]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:528866cb-30dd-40ac-9a81-4c6afc93cdd9 (non-flash)
Nov 08 23:19:18 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 23:19:18 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bdb0085-b32d-48fe-9776-c6553cadecc5 tempest-TestShelveInstance-1634360024 tempest-TestShelveInstance-1634360024-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1b683ab0a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d2068946-d374-45a4-9850-e3a690b13ef4'): ({'sdb'}, set())}) {{(pid=75045) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 23:19:18 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-3bdb0085-b32d-48fe-9776-c6553cadecc5 tempest-TestShelveInstance-1634360024 tempest-TestShelveInstance-1634360024-project-member] Removing single pathed devices sdb {{(pid=75045) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 23:19:18 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:19:18 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:19:18 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[534612a2-48ee-4968-8bd6-4c7e7fe1e08a]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:19:18 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:19:18 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-f44af977-35eb-44a0-bf36-9092d9d8a0e7 tempest-TaggedAttachmentsTest-1639503389 tempest-TaggedAttachmentsTest-1639503389-project-member] Lock "1cb1b440-0073-4a53-a0a2-e2781e021866" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 71.489s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:19:18 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.034s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:19:18 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e9bebb8-4efe-4b6b-a4f8-679a08e8ce56]: (4, ('ok\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:19:18 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-3bdb0085-b32d-48fe-9776-c6553cadecc5 tempest-TestShelveInstance-1634360024 tempest-TestShelveInstance-1634360024-project-member] Flushing IO for device /dev/sdb {{(pid=75045) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 23:19:18 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:19:18 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.021s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:19:18 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[06ef0240-79f4-43c6-bb50-55e6ad847a72]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:19:18 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-3bdb0085-b32d-48fe-9776-c6553cadecc5 tempest-TestShelveInstance-1634360024 tempest-TestShelveInstance-1634360024-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75045) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 23:19:18 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:19:18 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.039s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:19:18 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[a88bfb4d-d52b-4a02-a9b4-a003032906ce]: (4, ('1', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:19:18 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-3bdb0085-b32d-48fe-9776-c6553cadecc5 tempest-TestShelveInstance-1634360024 tempest-TestShelveInstance-1634360024-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75045) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 23:19:18 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-3bdb0085-b32d-48fe-9776-c6553cadecc5 tempest-TestShelveInstance-1634360024 tempest-TestShelveInstance-1634360024-project-member] SCSI volumes sdb have been removed. {{(pid=75045) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 23:19:18 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bdb0085-b32d-48fe-9776-c6553cadecc5 tempest-TestShelveInstance-1634360024 tempest-TestShelveInstance-1634360024-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d2068946-d374-45a4-9850-e3a690b13ef4')] {{(pid=75045) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 23:19:18 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2068946-d374-45a4-9850-e3a690b13ef4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:19:18 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2068946-d374-45a4-9850-e3a690b13ef4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:19:18 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[051c19c8-7770-412a-b6d5-11b9e07a862e]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:19:18 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bdb0085-b32d-48fe-9776-c6553cadecc5 tempest-TestShelveInstance-1634360024 tempest-TestShelveInstance-1634360024-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:19:18 user nova-compute[75045]: DEBUG nova.compute.manager [req-3f8f06cb-9002-4f30-8080-eb5435ac1ecd req-59c710f2-01db-43a7-9a59-760284f21a54 service nova] [instance: 725866aa-0e2a-4af3-af20-48157e6d2fcb] Received event network-vif-plugged-9a617e54-a69a-4204-b94e-dbe71b1432d2 {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:19:18 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-3f8f06cb-9002-4f30-8080-eb5435ac1ecd req-59c710f2-01db-43a7-9a59-760284f21a54 service nova] Acquiring lock "725866aa-0e2a-4af3-af20-48157e6d2fcb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:19:18 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-3f8f06cb-9002-4f30-8080-eb5435ac1ecd req-59c710f2-01db-43a7-9a59-760284f21a54 service nova] Lock "725866aa-0e2a-4af3-af20-48157e6d2fcb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:19:18 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-3f8f06cb-9002-4f30-8080-eb5435ac1ecd req-59c710f2-01db-43a7-9a59-760284f21a54 service nova] Lock "725866aa-0e2a-4af3-af20-48157e6d2fcb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:19:18 user nova-compute[75045]: DEBUG nova.compute.manager [req-3f8f06cb-9002-4f30-8080-eb5435ac1ecd req-59c710f2-01db-43a7-9a59-760284f21a54 service nova] [instance: 725866aa-0e2a-4af3-af20-48157e6d2fcb] No waiting events found dispatching network-vif-plugged-9a617e54-a69a-4204-b94e-dbe71b1432d2 {{(pid=75045) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 23:19:18 user nova-compute[75045]: WARNING nova.compute.manager [req-3f8f06cb-9002-4f30-8080-eb5435ac1ecd req-59c710f2-01db-43a7-9a59-760284f21a54 service nova] [instance: 725866aa-0e2a-4af3-af20-48157e6d2fcb] Received unexpected event network-vif-plugged-9a617e54-a69a-4204-b94e-dbe71b1432d2 for instance with vm_state active and task_state shelving.
Nov 08 23:19:18 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2068946-d374-45a4-9850-e3a690b13ef4 -p 172.16.0.220:3260 --logout {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:19:18 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2068946-d374-45a4-9850-e3a690b13ef4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:19:18 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[25cb47d5-8952-4d36-9f18-ee1eba66cdb1]: (4, ('Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:d2068946-d374-45a4-9850-e3a690b13ef4, portal: 172.16.0.220,3260]\nLogout of [sid: 2, target: iqn.2010-10.org.openstack:d2068946-d374-45a4-9850-e3a690b13ef4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:19:18 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bdb0085-b32d-48fe-9776-c6553cadecc5 tempest-TestShelveInstance-1634360024 tempest-TestShelveInstance-1634360024-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:d2068946-d374-45a4-9850-e3a690b13ef4, portal: 172.16.0.220,3260]
Nov 08 23:19:18 user nova-compute[75045]: Logout of [sid: 2, target: iqn.2010-10.org.openstack:d2068946-d374-45a4-9850-e3a690b13ef4, portal: 172.16.0.220,3260] successful.
Nov 08 23:19:18 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:19:18 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2068946-d374-45a4-9850-e3a690b13ef4 -p 172.16.0.220:3260 --op delete {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:19:18 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2068946-d374-45a4-9850-e3a690b13ef4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:19:18 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[7110fef4-da38-42c0-a276-162cd6ca13f4]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:19:18 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bdb0085-b32d-48fe-9776-c6553cadecc5 tempest-TestShelveInstance-1634360024 tempest-TestShelveInstance-1634360024-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:19:18 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-3bdb0085-b32d-48fe-9776-c6553cadecc5 tempest-TestShelveInstance-1634360024 tempest-TestShelveInstance-1634360024-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.391s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 23:19:18 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bdb0085-b32d-48fe-9776-c6553cadecc5 tempest-TestShelveInstance-1634360024 tempest-TestShelveInstance-1634360024-project-member] <== disconnect_volume: return (393ms) None {{(pid=75045) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 23:19:18 user nova-compute[75045]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3bdb0085-b32d-48fe-9776-c6553cadecc5 tempest-TestShelveInstance-1634360024 tempest-TestShelveInstance-1634360024-project-member] [instance: 725866aa-0e2a-4af3-af20-48157e6d2fcb] Disconnected iSCSI Volume {{(pid=75045) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 23:19:18 user nova-compute[75045]: INFO nova.virt.libvirt.driver [None req-3bdb0085-b32d-48fe-9776-c6553cadecc5 tempest-TestShelveInstance-1634360024 tempest-TestShelveInstance-1634360024-project-member] [instance: 725866aa-0e2a-4af3-af20-48157e6d2fcb] Deleting instance files /opt/stack/data/nova/instances/725866aa-0e2a-4af3-af20-48157e6d2fcb_del
Nov 08 23:19:18 user nova-compute[75045]: INFO nova.virt.libvirt.driver [None req-3bdb0085-b32d-48fe-9776-c6553cadecc5 tempest-TestShelveInstance-1634360024 tempest-TestShelveInstance-1634360024-project-member] [instance: 725866aa-0e2a-4af3-af20-48157e6d2fcb] Deletion of /opt/stack/data/nova/instances/725866aa-0e2a-4af3-af20-48157e6d2fcb_del complete
Nov 08 23:19:18 user nova-compute[75045]: DEBUG nova.network.neutron [req-7c0c48cb-9439-4b4c-9da3-3eeaed630190 req-7a063180-9ba4-4421-987a-2e89134b60ed service nova] [instance: 725866aa-0e2a-4af3-af20-48157e6d2fcb] Updated VIF entry in instance network info cache for port 9a617e54-a69a-4204-b94e-dbe71b1432d2. {{(pid=75045) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 23:19:18 user nova-compute[75045]: DEBUG nova.network.neutron [req-7c0c48cb-9439-4b4c-9da3-3eeaed630190 req-7a063180-9ba4-4421-987a-2e89134b60ed service nova] [instance: 725866aa-0e2a-4af3-af20-48157e6d2fcb] Updating instance_info_cache with network_info: [{"id": "9a617e54-a69a-4204-b94e-dbe71b1432d2", "address": "fa:16:3e:64:ef:b6", "network": {"id": "25b429b3-693b-4e72-9035-71c276706294", "bridge": null, "label": "tempest-TestShelveInstance-437524717-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.40", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec089e7050c542c9860d9fc5f3ae9392", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap9a617e54-a6", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75045) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 23:19:19 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-7c0c48cb-9439-4b4c-9da3-3eeaed630190 req-7a063180-9ba4-4421-987a-2e89134b60ed service nova] Releasing lock "refresh_cache-725866aa-0e2a-4af3-af20-48157e6d2fcb" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 23:19:19 user nova-compute[75045]: DEBUG nova.objects.instance [None req-6c41194c-864d-4a5a-a7f2-b7c9367b17c9 tempest-AttachSCSIVolumeTestJSON-1576344526 tempest-AttachSCSIVolumeTestJSON-1576344526-project-member] Lazy-loading 'flavor' on Instance uuid b9bd3096-92eb-4aae-8619-2725ed9acc2b {{(pid=75045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 23:19:19 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-6c41194c-864d-4a5a-a7f2-b7c9367b17c9 tempest-AttachSCSIVolumeTestJSON-1576344526 tempest-AttachSCSIVolumeTestJSON-1576344526-project-member] Lock "b9bd3096-92eb-4aae-8619-2725ed9acc2b" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 24.922s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:19:19 user nova-compute[75045]: DEBUG os_brick.utils [None req-cc2764da-d4bb-4f4b-b69a-c9c557549c98 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75045) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 23:19:19 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:19:19 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:19:19 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1c43848-06f5-4372-802a-7ab77ab4bd6c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6217bd6e884\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:19:19 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:19:19 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:19:19 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[f476621a-a3bc-4686-84bb-1e463f513411]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:19:19 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:19:19 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:19:19 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb206ceb-2df5-4ffd-ab22-afd861200e18]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:19:19 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdbe8252-9305-47e0-93f3-5c26f4f0da90]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:19:19 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-cc2764da-d4bb-4f4b-b69a-c9c557549c98 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262-project-member] Running cmd (subprocess): nvme version {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:19:19 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-cc2764da-d4bb-4f4b-b69a-c9c557549c98 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262-project-member] 'nvme version' failed. Not Retrying. {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 23:19:19 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.nvmeof [None req-cc2764da-d4bb-4f4b-b69a-c9c557549c98 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262-project-member] nvme not present on system {{(pid=75045) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 23:19:19 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:19:19 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 23:19:19 user nova-compute[75045]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 23:19:19 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[358ebc72-b0e7-4b76-af01-ede3585be429]: (4, '') {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:19:19 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.lightos [None req-cc2764da-d4bb-4f4b-b69a-c9c557549c98 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75045) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 23:19:19 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.lightos [None req-cc2764da-d4bb-4f4b-b69a-c9c557549c98 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75045) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 23:19:19 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.lightos [None req-cc2764da-d4bb-4f4b-b69a-c9c557549c98 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262-project-member] LIGHTOS: no hostnqn found. {{(pid=75045) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 23:19:19 user nova-compute[75045]: DEBUG os_brick.utils [None req-cc2764da-d4bb-4f4b-b69a-c9c557549c98 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262-project-member] <== get_connector_properties: return (154ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6217bd6e884', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75045) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 23:19:19 user nova-compute[75045]: DEBUG nova.virt.block_device [None req-cc2764da-d4bb-4f4b-b69a-c9c557549c98 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262-project-member] [instance: 82bc5fd0-26c7-4f81-b966-54831393b617] Updating existing volume attachment record: 41b8e83f-0110-434d-8e11-f350552d9383 {{(pid=75045) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 23:19:19 user nova-compute[75045]: DEBUG nova.compute.manager [None req-ac28c4dc-b349-4d76-b20f-521f64e4c39b tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] [instance: 520eac4f-fa48-4e41-924d-840907e701b4] Start spawning the instance on the hypervisor. {{(pid=75045) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 23:19:19 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-ac28c4dc-b349-4d76-b20f-521f64e4c39b tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] [instance: 520eac4f-fa48-4e41-924d-840907e701b4] Creating instance directory {{(pid=75045) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 23:19:19 user nova-compute[75045]: INFO nova.virt.libvirt.driver [None req-ac28c4dc-b349-4d76-b20f-521f64e4c39b tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] [instance: 520eac4f-fa48-4e41-924d-840907e701b4] Creating image(s)
Nov 08 23:19:19 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-ac28c4dc-b349-4d76-b20f-521f64e4c39b tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] [instance: 520eac4f-fa48-4e41-924d-840907e701b4] Did not create local disks {{(pid=75045) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 08 23:19:19 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-ac28c4dc-b349-4d76-b20f-521f64e4c39b tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] [instance: 520eac4f-fa48-4e41-924d-840907e701b4] Ensure instance console log exists: /opt/stack/data/nova/instances/520eac4f-fa48-4e41-924d-840907e701b4/console.log {{(pid=75045) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 23:19:19 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-ac28c4dc-b349-4d76-b20f-521f64e4c39b tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:19:19 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-ac28c4dc-b349-4d76-b20f-521f64e4c39b tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:19:19 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-ac28c4dc-b349-4d76-b20f-521f64e4c39b tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:19:19 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-ac28c4dc-b349-4d76-b20f-521f64e4c39b tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] [instance: 520eac4f-fa48-4e41-924d-840907e701b4] Start _get_guest_xml network_info=[{"id": "25776e3e-60d6-457c-a78a-a59df0e3e7b5", "address": "fa:16:3e:3e:7f:60", "network": {"id": "13af9e02-7f74-4e9c-aea7-2e6f0701b1c2", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1067175210-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74ebbe44152141368b22a9a7989d577a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25776e3e-60", "ovs_interfaceid": "25776e3e-60d6-457c-a78a-a59df0e3e7b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "bcd0d9eb-775a-4e28-b712-148c1fe99521", "address": "fa:16:3e:21:f4:bc", "network": {"id": "0916556c-7a50-48cf-8ad0-56c20de9d89f", "bridge": "br-int", "label": "tempest-device-tagging-net1-573961537", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.137", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "74ebbe44152141368b22a9a7989d577a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbcd0d9eb-77", "ovs_interfaceid": "bcd0d9eb-775a-4e28-b712-148c1fe99521", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "04ae6531-75ef-4043-99f4-bfa5ef2bba59", "address": "fa:16:3e:9f:87:19", "network": {"id": "0916556c-7a50-48cf-8ad0-56c20de9d89f", "bridge": "br-int", "label": "tempest-device-tagging-net1-573961537", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.210", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "74ebbe44152141368b22a9a7989d577a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04ae6531-75", "ovs_interfaceid": "04ae6531-75ef-4043-99f4-bfa5ef2bba59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "b3c645dd-a1ac-4780-a49d-916cb6a121c9", "address": "fa:16:3e:e2:e6:e2", "network": {"id": "0916556c-7a50-48cf-8ad0-56c20de9d89f", "bridge": "br-int", "label": "tempest-device-tagging-net1-573961537", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.154", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "74ebbe44152141368b22a9a7989d577a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3c645dd-a1", "ovs_interfaceid": "b3c645dd-a1ac-4780-a49d-916cb6a121c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3974ed79-74a5-4e9c-aa42-3aab1b234a39", "address": "fa:16:3e:f3:1c:29", "network": {"id": "0916556c-7a50-48cf-8ad0-56c20de9d89f", "bridge": "br-int", "label": "tempest-device-tagging-net1-573961537", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.231", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "74ebbe44152141368b22a9a7989d577a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3974ed79-74", "ovs_interfaceid": "3974ed79-74a5-4e9c-aa42-3aab1b234a39", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c2155ca8-d244-401d-a80f-8c53a68b6799", "address": "fa:16:3e:a2:80:a4", "network": {"id": "5cfed969-3f78-4bc2-8d08-921447c01347", "bridge": "br-int", "label": "tempest-device-tagging-net2-1614620309", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "74ebbe44152141368b22a9a7989d577a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2155ca8-d2", "ovs_interfaceid": "c2155ca8-d244-401d-a80f-8c53a68b6799", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "768830de-7c2e-45ca-959e-398480b6ba29", "address": "fa:16:3e:bc:05:cc", "network": {"id": "5cfed969-3f78-4bc2-8d08-921447c01347", "bridge": "br-int", "label": "tempest-device-tagging-net2-1614620309", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "74ebbe44152141368b22a9a7989d577a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap768830de-7c", "ovs_interfaceid": "768830de-7c2e-45ca-959e-398480b6ba29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T23:11:54Z,direct_url=<?>,disk_format='qcow2',id=a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b1beba2cc4e7465ea249e2225fb494dc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T23:11:56Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'device_type': 'disk', 'attachment_id': 'ea928ac6-518f-4ffa-8d90-41b4c7cb49b8', 'guest_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:175bb2c0-7767-4740-9350-7e3300681a43', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OvWeEoJS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '520eac4f-fa48-4e41-924d-840907e701b4', 'attached_at': '', 'detached_at': '', 'volume_id': '175bb2c0-7767-4740-9350-7e3300681a43', 'serial': '175bb2c0-7767-4740-9350-7e3300681a43'}, 'volume_type': None}, {'delete_on_termination': False, 'device_type': 'disk', 'attachment_id': 'b9856fce-a3e2-484d-9464-f5581a6c5311', 'guest_format': None, 'disk_bus': 'virtio', 'boot_index': 1, 'mount_device': '/dev/vdb', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:6ed77146-5ae0-400d-8116-7f9eb1322808', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kgnpmWxr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '520eac4f-fa48-4e41-924d-840907e701b4', 'attached_at': '', 'detached_at': '', 'volume_id': '6ed77146-5ae0-400d-8116-7f9eb1322808', 'serial': '6ed77146-5ae0-400d-8116-7f9eb1322808'}, 'volume_type': None}, {'delete_on_termination': False, 'device_type': 'disk', 'attachment_id': 'fabc07cf-caf4-4261-b1a7-10f44ceb7174', 'guest_format': None, 'disk_bus': 'virtio', 'boot_index': 2, 'mount_device': '/dev/vdc', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:8d2ff5d0-0b89-42ba-92eb-1e12c9cce205', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SroFPTjC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '520eac4f-fa48-4e41-924d-840907e701b4', 'attached_at': '', 'detached_at': '', 'volume_id': '8d2ff5d0-0b89-42ba-92eb-1e12c9cce205', 'serial': '8d2ff5d0-0b89-42ba-92eb-1e12c9cce205'}, 'volume_type': None} {{(pid=75045) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 23:19:19 user nova-compute[75045]: WARNING nova.virt.libvirt.driver [None req-ac28c4dc-b349-4d76-b20f-521f64e4c39b tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 23:19:19 user nova-compute[75045]: WARNING nova.virt.libvirt.driver [None req-ac28c4dc-b349-4d76-b20f-521f64e4c39b tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 23:19:19 user nova-compute[75045]: DEBUG nova.virt.libvirt.host [None req-ac28c4dc-b349-4d76-b20f-521f64e4c39b tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75045) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 23:19:19 user nova-compute[75045]: DEBUG nova.virt.libvirt.host [None req-ac28c4dc-b349-4d76-b20f-521f64e4c39b tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] CPU controller missing on host. {{(pid=75045) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 23:19:19 user nova-compute[75045]: DEBUG nova.virt.libvirt.host [None req-ac28c4dc-b349-4d76-b20f-521f64e4c39b tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75045) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 23:19:19 user nova-compute[75045]: DEBUG nova.virt.libvirt.host [None req-ac28c4dc-b349-4d76-b20f-521f64e4c39b tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] CPU controller found on host. {{(pid=75045) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 23:19:19 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-ac28c4dc-b349-4d76-b20f-521f64e4c39b tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75045) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 23:19:19 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-ac28c4dc-b349-4d76-b20f-521f64e4c39b tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T23:11:41Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T23:11:54Z,direct_url=<?>,disk_format='qcow2',id=a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b1beba2cc4e7465ea249e2225fb494dc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T23:11:56Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75045) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 23:19:19 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-ac28c4dc-b349-4d76-b20f-521f64e4c39b tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] Flavor limits 0:0:0 {{(pid=75045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 23:19:19 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-ac28c4dc-b349-4d76-b20f-521f64e4c39b tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] Image limits 0:0:0 {{(pid=75045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 23:19:19 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-ac28c4dc-b349-4d76-b20f-521f64e4c39b tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] Flavor pref 0:0:0 {{(pid=75045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 23:19:19 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-ac28c4dc-b349-4d76-b20f-521f64e4c39b tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] Image pref 0:0:0 {{(pid=75045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 23:19:19 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-ac28c4dc-b349-4d76-b20f-521f64e4c39b tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 23:19:19 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-ac28c4dc-b349-4d76-b20f-521f64e4c39b tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75045) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 23:19:19 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-ac28c4dc-b349-4d76-b20f-521f64e4c39b tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75045) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 23:19:19 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-ac28c4dc-b349-4d76-b20f-521f64e4c39b tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] Got 1 possible topologies {{(pid=75045) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 23:19:19 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-ac28c4dc-b349-4d76-b20f-521f64e4c39b tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75045) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 23:19:19 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-ac28c4dc-b349-4d76-b20f-521f64e4c39b tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75045) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 23:19:19 user nova-compute[75045]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ac28c4dc-b349-4d76-b20f-521f64e4c39b tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] [instance: 520eac4f-fa48-4e41-924d-840907e701b4] Calling os-brick to attach iSCSI Volume {{(pid=75045) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 23:19:19 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac28c4dc-b349-4d76-b20f-521f64e4c39b tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1b68210460>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:175bb2c0-7767-4740-9350-7e3300681a43', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OvWeEoJS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75045) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 23:19:19 user nova-compute[75045]: WARNING os_brick.initiator.connectors.base [None req-ac28c4dc-b349-4d76-b20f-521f64e4c39b tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 23:19:19 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-ac28c4dc-b349-4d76-b20f-521f64e4c39b tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 23:19:19 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-ac28c4dc-b349-4d76-b20f-521f64e4c39b tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 23:19:19 user nova-compute[75045]: WARNING os_brick.initiator.connectors.base [None req-ac28c4dc-b349-4d76-b20f-521f64e4c39b tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 23:19:19 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-ac28c4dc-b349-4d76-b20f-521f64e4c39b tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:175bb2c0-7767-4740-9350-7e3300681a43" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 23:19:19 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-ac28c4dc-b349-4d76-b20f-521f64e4c39b tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:175bb2c0-7767-4740-9350-7e3300681a43" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 23:19:19 user nova-compute[75045]: INFO os_brick.initiator.connectors.iscsi [None req-ac28c4dc-b349-4d76-b20f-521f64e4c39b tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 23:19:19 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:175bb2c0-7767-4740-9350-7e3300681a43 -p 172.16.0.220:3260 {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:19:20 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:175bb2c0-7767-4740-9350-7e3300681a43 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:19:20 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[87a60471-4b3c-4e7b-8745-8b8e5806a96c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:19:20 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac28c4dc-b349-4d76-b20f-521f64e4c39b tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 23:19:20 user nova-compute[75045]:  {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:19:20 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:175bb2c0-7767-4740-9350-7e3300681a43 -p 172.16.0.220:3260 --interface default --op new {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:19:20 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:175bb2c0-7767-4740-9350-7e3300681a43 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:19:20 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa9b20e8-a3da-4798-b839-174c0f17fbe5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:175bb2c0-7767-4740-9350-7e3300681a43] added\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:19:20 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac28c4dc-b349-4d76-b20f-521f64e4c39b tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:175bb2c0-7767-4740-9350-7e3300681a43] added
Nov 08 23:19:20 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:19:20 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:175bb2c0-7767-4740-9350-7e3300681a43 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:19:20 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:175bb2c0-7767-4740-9350-7e3300681a43 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:19:20 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[894125d6-70c1-40e1-b301-4b99ee9339d6]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:19:20 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac28c4dc-b349-4d76-b20f-521f64e4c39b tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:19:20 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:175bb2c0-7767-4740-9350-7e3300681a43 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:19:20 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:175bb2c0-7767-4740-9350-7e3300681a43 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.033s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:19:20 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[c55008ec-5c3e-447a-80ae-13d47b5e1d69]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:19:20 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac28c4dc-b349-4d76-b20f-521f64e4c39b tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:19:20 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:175bb2c0-7767-4740-9350-7e3300681a43 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OvWeEoJS {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:19:20 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:175bb2c0-7767-4740-9350-7e3300681a43 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OvWeEoJS" returned: 0 in 0.018s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:19:20 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[343a96bc-528f-4b17-98b7-3e3adbeb338a]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:19:20 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac28c4dc-b349-4d76-b20f-521f64e4c39b tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'OvWeEoJS'): stdout= stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:19:20 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:175bb2c0-7767-4740-9350-7e3300681a43 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:19:20 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:175bb2c0-7767-4740-9350-7e3300681a43 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:19:20 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[922e1635-b4d5-4ea3-a8bc-d791563fa9af]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:19:20 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac28c4dc-b349-4d76-b20f-521f64e4c39b tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:19:20 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:19:20 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:19:20 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6c380d6-2af6-4afb-b819-15ba1103672f]: (4, ('tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d7a4df0-bfc5-4952-8454-97b703b68f28 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f829f03c-8f1a-45f1-a715-b9d769201d1b (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:528866cb-30dd-40ac-9a81-4c6afc93cdd9 (non-flash)\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:19:20 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac28c4dc-b349-4d76-b20f-521f64e4c39b tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d7a4df0-bfc5-4952-8454-97b703b68f28 (non-flash)
Nov 08 23:19:20 user nova-compute[75045]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f829f03c-8f1a-45f1-a715-b9d769201d1b (non-flash)
Nov 08 23:19:20 user nova-compute[75045]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:528866cb-30dd-40ac-9a81-4c6afc93cdd9 (non-flash)
Nov 08 23:19:20 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 23:19:20 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac28c4dc-b349-4d76-b20f-521f64e4c39b tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] iscsi session list stdout=tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d7a4df0-bfc5-4952-8454-97b703b68f28 (non-flash)
Nov 08 23:19:20 user nova-compute[75045]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f829f03c-8f1a-45f1-a715-b9d769201d1b (non-flash)
Nov 08 23:19:20 user nova-compute[75045]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:528866cb-30dd-40ac-9a81-4c6afc93cdd9 (non-flash)
Nov 08 23:19:20 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 23:19:20 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:175bb2c0-7767-4740-9350-7e3300681a43 -p 172.16.0.220:3260 --login {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:19:20 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:175bb2c0-7767-4740-9350-7e3300681a43 -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:19:20 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[f264f020-028a-4dfc-9f43-2a020d6887ca]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:175bb2c0-7767-4740-9350-7e3300681a43, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:175bb2c0-7767-4740-9350-7e3300681a43, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:19:20 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac28c4dc-b349-4d76-b20f-521f64e4c39b tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:175bb2c0-7767-4740-9350-7e3300681a43, portal: 172.16.0.220,3260]
Nov 08 23:19:20 user nova-compute[75045]: Login to [iface: default, target: iqn.2010-10.org.openstack:175bb2c0-7767-4740-9350-7e3300681a43, portal: 172.16.0.220,3260] successful.
Nov 08 23:19:20 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:19:20 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:175bb2c0-7767-4740-9350-7e3300681a43 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:19:20 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:175bb2c0-7767-4740-9350-7e3300681a43 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:19:20 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6c22eae-a9bf-4ae9-a1ef-1c5b93116932]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:19:20 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac28c4dc-b349-4d76-b20f-521f64e4c39b tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:19:20 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:19:20 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:19:20 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac833969-6170-4c71-b97b-39af6804c97c]: (4, ('tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d7a4df0-bfc5-4952-8454-97b703b68f28 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f829f03c-8f1a-45f1-a715-b9d769201d1b (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:528866cb-30dd-40ac-9a81-4c6afc93cdd9 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:175bb2c0-7767-4740-9350-7e3300681a43 (non-flash)\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:19:20 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac28c4dc-b349-4d76-b20f-521f64e4c39b tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d7a4df0-bfc5-4952-8454-97b703b68f28 (non-flash)
Nov 08 23:19:20 user nova-compute[75045]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f829f03c-8f1a-45f1-a715-b9d769201d1b (non-flash)
Nov 08 23:19:20 user nova-compute[75045]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:528866cb-30dd-40ac-9a81-4c6afc93cdd9 (non-flash)
Nov 08 23:19:20 user nova-compute[75045]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:175bb2c0-7767-4740-9350-7e3300681a43 (non-flash)
Nov 08 23:19:20 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 23:19:20 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac28c4dc-b349-4d76-b20f-521f64e4c39b tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] iscsi session list stdout=tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d7a4df0-bfc5-4952-8454-97b703b68f28 (non-flash)
Nov 08 23:19:20 user nova-compute[75045]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f829f03c-8f1a-45f1-a715-b9d769201d1b (non-flash)
Nov 08 23:19:20 user nova-compute[75045]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:528866cb-30dd-40ac-9a81-4c6afc93cdd9 (non-flash)
Nov 08 23:19:20 user nova-compute[75045]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:175bb2c0-7767-4740-9350-7e3300681a43 (non-flash)
Nov 08 23:19:20 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 23:19:20 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-ac28c4dc-b349-4d76-b20f-521f64e4c39b tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:175bb2c0-7767-4740-9350-7e3300681a43" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.315s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 23:19:20 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac28c4dc-b349-4d76-b20f-521f64e4c39b tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] Connected to 172.16.0.220:3260 {{(pid=75045) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 23:19:20 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-ac28c4dc-b349-4d76-b20f-521f64e4c39b tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] HCTL ('33', '-', '-', 0) found on session 8 with lun 0 {{(pid=75045) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 23:19:20 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-ac28c4dc-b349-4d76-b20f-521f64e4c39b tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75045) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 23:19:20 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:19:20 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:19:20 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce146c42-a8d7-40be-b60c-626c029eefdb]: (4, ('- - 0', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:19:20 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-ac28c4dc-b349-4d76-b20f-521f64e4c39b tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] Searching for a device in session 8 and hctl ['33', '*', '*', 0] yield: None {{(pid=75045) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 23:19:20 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:19:21 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-ac28c4dc-b349-4d76-b20f-521f64e4c39b tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] Searching for a device in session 8 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75045) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 23:19:21 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac28c4dc-b349-4d76-b20f-521f64e4c39b tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:175bb2c0-7767-4740-9350-7e3300681a43', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OvWeEoJS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75045) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 23:19:21 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-ac28c4dc-b349-4d76-b20f-521f64e4c39b tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.348s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 23:19:21 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac28c4dc-b349-4d76-b20f-521f64e4c39b tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] <== connect_volume: return (1350ms) {'type': 'block', 'scsi_wwn': '23532613931303164', 'path': '/dev/sdb'} {{(pid=75045) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 23:19:21 user nova-compute[75045]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ac28c4dc-b349-4d76-b20f-521f64e4c39b tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] [instance: 520eac4f-fa48-4e41-924d-840907e701b4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23532613931303164', 'path': '/dev/sdb'} {{(pid=75045) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 23:19:21 user nova-compute[75045]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ac28c4dc-b349-4d76-b20f-521f64e4c39b tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] [instance: 520eac4f-fa48-4e41-924d-840907e701b4] Calling os-brick to attach iSCSI Volume {{(pid=75045) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 23:19:21 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac28c4dc-b349-4d76-b20f-521f64e4c39b tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1b68210460>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:6ed77146-5ae0-400d-8116-7f9eb1322808', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kgnpmWxr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75045) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 23:19:21 user nova-compute[75045]: WARNING os_brick.initiator.connectors.base [None req-ac28c4dc-b349-4d76-b20f-521f64e4c39b tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 23:19:21 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-ac28c4dc-b349-4d76-b20f-521f64e4c39b tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 23:19:21 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-ac28c4dc-b349-4d76-b20f-521f64e4c39b tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 23:19:21 user nova-compute[75045]: WARNING os_brick.initiator.connectors.base [None req-ac28c4dc-b349-4d76-b20f-521f64e4c39b tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 23:19:21 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-ac28c4dc-b349-4d76-b20f-521f64e4c39b tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6ed77146-5ae0-400d-8116-7f9eb1322808" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 23:19:21 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-ac28c4dc-b349-4d76-b20f-521f64e4c39b tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6ed77146-5ae0-400d-8116-7f9eb1322808" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 23:19:21 user nova-compute[75045]: INFO os_brick.initiator.connectors.iscsi [None req-ac28c4dc-b349-4d76-b20f-521f64e4c39b tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 23:19:21 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ed77146-5ae0-400d-8116-7f9eb1322808 -p 172.16.0.220:3260 {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:19:21 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ed77146-5ae0-400d-8116-7f9eb1322808 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:19:21 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[91211eb6-2185-4637-855b-8e5869754580]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:19:21 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac28c4dc-b349-4d76-b20f-521f64e4c39b tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 23:19:21 user nova-compute[75045]:  {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:19:21 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ed77146-5ae0-400d-8116-7f9eb1322808 -p 172.16.0.220:3260 --interface default --op new {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:19:21 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ed77146-5ae0-400d-8116-7f9eb1322808 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.032s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:19:21 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d36ec49-3ae9-47de-ad90-a6ab5512519b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6ed77146-5ae0-400d-8116-7f9eb1322808] added\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:19:21 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac28c4dc-b349-4d76-b20f-521f64e4c39b tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6ed77146-5ae0-400d-8116-7f9eb1322808] added
Nov 08 23:19:21 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:19:21 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ed77146-5ae0-400d-8116-7f9eb1322808 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:19:21 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ed77146-5ae0-400d-8116-7f9eb1322808 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:19:21 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[344d95bb-b751-4c62-85ad-14adda1fa9a8]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:19:21 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac28c4dc-b349-4d76-b20f-521f64e4c39b tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:19:21 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ed77146-5ae0-400d-8116-7f9eb1322808 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:19:21 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ed77146-5ae0-400d-8116-7f9eb1322808 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:19:21 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[64a6a22d-cb3b-4ee5-be64-a216e2683d64]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:19:21 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac28c4dc-b349-4d76-b20f-521f64e4c39b tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:19:21 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ed77146-5ae0-400d-8116-7f9eb1322808 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kgnpmWxr {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:19:21 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ed77146-5ae0-400d-8116-7f9eb1322808 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kgnpmWxr" returned: 0 in 0.018s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:19:21 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd2c9606-1bf6-4385-8bf4-08e090fe9f92]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:19:21 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac28c4dc-b349-4d76-b20f-521f64e4c39b tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'kgnpmWxr'): stdout= stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:19:21 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ed77146-5ae0-400d-8116-7f9eb1322808 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:19:21 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ed77146-5ae0-400d-8116-7f9eb1322808 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:19:21 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[41831ab7-c13e-4cfd-ae46-bc7dea784925]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:19:21 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac28c4dc-b349-4d76-b20f-521f64e4c39b tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:19:21 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:19:21 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:19:21 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[d47c96b9-5a9e-41b8-8a2f-0bf854d00a7c]: (4, ('tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d7a4df0-bfc5-4952-8454-97b703b68f28 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f829f03c-8f1a-45f1-a715-b9d769201d1b (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:528866cb-30dd-40ac-9a81-4c6afc93cdd9 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:175bb2c0-7767-4740-9350-7e3300681a43 (non-flash)\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:19:21 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac28c4dc-b349-4d76-b20f-521f64e4c39b tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d7a4df0-bfc5-4952-8454-97b703b68f28 (non-flash)
Nov 08 23:19:21 user nova-compute[75045]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f829f03c-8f1a-45f1-a715-b9d769201d1b (non-flash)
Nov 08 23:19:21 user nova-compute[75045]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:528866cb-30dd-40ac-9a81-4c6afc93cdd9 (non-flash)
Nov 08 23:19:21 user nova-compute[75045]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:175bb2c0-7767-4740-9350-7e3300681a43 (non-flash)
Nov 08 23:19:21 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 23:19:21 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac28c4dc-b349-4d76-b20f-521f64e4c39b tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] iscsi session list stdout=tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d7a4df0-bfc5-4952-8454-97b703b68f28 (non-flash)
Nov 08 23:19:21 user nova-compute[75045]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f829f03c-8f1a-45f1-a715-b9d769201d1b (non-flash)
Nov 08 23:19:21 user nova-compute[75045]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:528866cb-30dd-40ac-9a81-4c6afc93cdd9 (non-flash)
Nov 08 23:19:21 user nova-compute[75045]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:175bb2c0-7767-4740-9350-7e3300681a43 (non-flash)
Nov 08 23:19:21 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 23:19:21 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ed77146-5ae0-400d-8116-7f9eb1322808 -p 172.16.0.220:3260 --login {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:19:21 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:19:22 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ed77146-5ae0-400d-8116-7f9eb1322808 -p 172.16.0.220:3260 --login" returned: 0 in 1.072s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:19:22 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0e35939-181a-4df7-8e3b-c1be5eb34656]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6ed77146-5ae0-400d-8116-7f9eb1322808, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6ed77146-5ae0-400d-8116-7f9eb1322808, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:19:22 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac28c4dc-b349-4d76-b20f-521f64e4c39b tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6ed77146-5ae0-400d-8116-7f9eb1322808, portal: 172.16.0.220,3260]
Nov 08 23:19:22 user nova-compute[75045]: Login to [iface: default, target: iqn.2010-10.org.openstack:6ed77146-5ae0-400d-8116-7f9eb1322808, portal: 172.16.0.220,3260] successful.
Nov 08 23:19:22 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:19:22 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ed77146-5ae0-400d-8116-7f9eb1322808 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:19:22 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ed77146-5ae0-400d-8116-7f9eb1322808 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:19:22 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cf7c5e5-4de6-4847-b80b-d9a0f349834b]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:19:22 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac28c4dc-b349-4d76-b20f-521f64e4c39b tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:19:22 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:19:22 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:19:22 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdfac368-3e3b-4759-b811-edfff80d16c6]: (4, ('tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d7a4df0-bfc5-4952-8454-97b703b68f28 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f829f03c-8f1a-45f1-a715-b9d769201d1b (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:528866cb-30dd-40ac-9a81-4c6afc93cdd9 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:175bb2c0-7767-4740-9350-7e3300681a43 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ed77146-5ae0-400d-8116-7f9eb1322808 (non-flash)\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:19:22 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac28c4dc-b349-4d76-b20f-521f64e4c39b tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d7a4df0-bfc5-4952-8454-97b703b68f28 (non-flash)
Nov 08 23:19:22 user nova-compute[75045]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f829f03c-8f1a-45f1-a715-b9d769201d1b (non-flash)
Nov 08 23:19:22 user nova-compute[75045]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:528866cb-30dd-40ac-9a81-4c6afc93cdd9 (non-flash)
Nov 08 23:19:22 user nova-compute[75045]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:175bb2c0-7767-4740-9350-7e3300681a43 (non-flash)
Nov 08 23:19:22 user nova-compute[75045]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ed77146-5ae0-400d-8116-7f9eb1322808 (non-flash)
Nov 08 23:19:22 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 23:19:22 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac28c4dc-b349-4d76-b20f-521f64e4c39b tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] iscsi session list stdout=tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d7a4df0-bfc5-4952-8454-97b703b68f28 (non-flash)
Nov 08 23:19:22 user nova-compute[75045]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f829f03c-8f1a-45f1-a715-b9d769201d1b (non-flash)
Nov 08 23:19:22 user nova-compute[75045]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:528866cb-30dd-40ac-9a81-4c6afc93cdd9 (non-flash)
Nov 08 23:19:22 user nova-compute[75045]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:175bb2c0-7767-4740-9350-7e3300681a43 (non-flash)
Nov 08 23:19:22 user nova-compute[75045]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ed77146-5ae0-400d-8116-7f9eb1322808 (non-flash)
Nov 08 23:19:22 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 23:19:22 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-ac28c4dc-b349-4d76-b20f-521f64e4c39b tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6ed77146-5ae0-400d-8116-7f9eb1322808" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.329s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 23:19:22 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac28c4dc-b349-4d76-b20f-521f64e4c39b tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] Connected to 172.16.0.220:3260 {{(pid=75045) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 23:19:22 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-ac28c4dc-b349-4d76-b20f-521f64e4c39b tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] HCTL ('34', '-', '-', 0) found on session 9 with lun 0 {{(pid=75045) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 23:19:22 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-ac28c4dc-b349-4d76-b20f-521f64e4c39b tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75045) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 23:19:22 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:19:22 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.020s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:19:22 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f88ec48-a40e-45a1-905d-d9b094129980]: (4, ('- - 0', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:19:22 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-ac28c4dc-b349-4d76-b20f-521f64e4c39b tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] Searching for a device in session 9 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75045) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 23:19:22 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac28c4dc-b349-4d76-b20f-521f64e4c39b tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:6ed77146-5ae0-400d-8116-7f9eb1322808', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kgnpmWxr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75045) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 23:19:23 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:19:23 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-ac28c4dc-b349-4d76-b20f-521f64e4c39b tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.367s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 23:19:23 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac28c4dc-b349-4d76-b20f-521f64e4c39b tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] <== connect_volume: return (2368ms) {'type': 'block', 'scsi_wwn': '23762346362653333', 'path': '/dev/sdc'} {{(pid=75045) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 23:19:23 user nova-compute[75045]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ac28c4dc-b349-4d76-b20f-521f64e4c39b tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] [instance: 520eac4f-fa48-4e41-924d-840907e701b4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23762346362653333', 'path': '/dev/sdc'} {{(pid=75045) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 23:19:23 user nova-compute[75045]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ac28c4dc-b349-4d76-b20f-521f64e4c39b tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] [instance: 520eac4f-fa48-4e41-924d-840907e701b4] Calling os-brick to attach iSCSI Volume {{(pid=75045) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 23:19:23 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac28c4dc-b349-4d76-b20f-521f64e4c39b tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1b68210460>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:8d2ff5d0-0b89-42ba-92eb-1e12c9cce205', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SroFPTjC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75045) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 23:19:23 user nova-compute[75045]: WARNING os_brick.initiator.connectors.base [None req-ac28c4dc-b349-4d76-b20f-521f64e4c39b tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 23:19:23 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-ac28c4dc-b349-4d76-b20f-521f64e4c39b tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 23:19:23 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-ac28c4dc-b349-4d76-b20f-521f64e4c39b tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 23:19:23 user nova-compute[75045]: WARNING os_brick.initiator.connectors.base [None req-ac28c4dc-b349-4d76-b20f-521f64e4c39b tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 23:19:23 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-ac28c4dc-b349-4d76-b20f-521f64e4c39b tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8d2ff5d0-0b89-42ba-92eb-1e12c9cce205" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 23:19:23 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-ac28c4dc-b349-4d76-b20f-521f64e4c39b tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8d2ff5d0-0b89-42ba-92eb-1e12c9cce205" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 23:19:23 user nova-compute[75045]: INFO os_brick.initiator.connectors.iscsi [None req-ac28c4dc-b349-4d76-b20f-521f64e4c39b tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 23:19:23 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d2ff5d0-0b89-42ba-92eb-1e12c9cce205 -p 172.16.0.220:3260 {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:19:23 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d2ff5d0-0b89-42ba-92eb-1e12c9cce205 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:19:23 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[893948ed-53a5-4de7-8e23-04195579fcb5]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:19:23 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac28c4dc-b349-4d76-b20f-521f64e4c39b tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 23:19:23 user nova-compute[75045]:  {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:19:23 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d2ff5d0-0b89-42ba-92eb-1e12c9cce205 -p 172.16.0.220:3260 --interface default --op new {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:19:23 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d2ff5d0-0b89-42ba-92eb-1e12c9cce205 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:19:23 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffb49123-e8b3-4d01-a0d6-8154577a54fa]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8d2ff5d0-0b89-42ba-92eb-1e12c9cce205] added\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:19:23 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac28c4dc-b349-4d76-b20f-521f64e4c39b tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8d2ff5d0-0b89-42ba-92eb-1e12c9cce205] added
Nov 08 23:19:23 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:19:23 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d2ff5d0-0b89-42ba-92eb-1e12c9cce205 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:19:23 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d2ff5d0-0b89-42ba-92eb-1e12c9cce205 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:19:23 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[889bf00a-f536-48a0-a41a-b76c1aac9d42]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:19:23 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac28c4dc-b349-4d76-b20f-521f64e4c39b tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:19:23 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d2ff5d0-0b89-42ba-92eb-1e12c9cce205 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:19:23 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d2ff5d0-0b89-42ba-92eb-1e12c9cce205 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:19:23 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6b68b67-af1d-4bfb-bce0-a0f41177c3eb]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:19:23 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac28c4dc-b349-4d76-b20f-521f64e4c39b tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:19:23 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d2ff5d0-0b89-42ba-92eb-1e12c9cce205 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SroFPTjC {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:19:24 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-c9cbe7e8-bcf2-4811-9f07-32d1aea04a86 tempest-VolumesAssistedSnapshotsTest-718669656 tempest-VolumesAssistedSnapshotsTest-718669656-project] [instance: 07ec2c05-aaa9-46e8-8439-7aa5b9fca19d] volume_snapshot_create: create_info: {'snapshot_id': 'bbffd11e-e70f-455c-983d-d58b8dac337d', 'type': 'qcow2', 'new_file': 'new_file'} {{(pid=75045) volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3576}}
Nov 08 23:19:24 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-c9cbe7e8-bcf2-4811-9f07-32d1aea04a86 tempest-VolumesAssistedSnapshotsTest-718669656 tempest-VolumesAssistedSnapshotsTest-718669656-project] [instance: 07ec2c05-aaa9-46e8-8439-7aa5b9fca19d] snap xml: <domainsnapshot>
Nov 08 23:19:24 user nova-compute[75045]:   <disks>
Nov 08 23:19:24 user nova-compute[75045]:     <disk name="/dev/sde" snapshot="external" type="file">
Nov 08 23:19:24 user nova-compute[75045]:       <source file="/dev/new_file"/>
Nov 08 23:19:24 user nova-compute[75045]:     </disk>
Nov 08 23:19:24 user nova-compute[75045]:     <disk name="vda" snapshot="no"/>
Nov 08 23:19:24 user nova-compute[75045]:   </disks>
Nov 08 23:19:24 user nova-compute[75045]: </domainsnapshot>
Nov 08 23:19:24 user nova-compute[75045]:  {{(pid=75045) _volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3517}}
Nov 08 23:19:24 user nova-compute[75045]: DEBUG nova.objects.instance [None req-c9cbe7e8-bcf2-4811-9f07-32d1aea04a86 tempest-VolumesAssistedSnapshotsTest-718669656 tempest-VolumesAssistedSnapshotsTest-718669656-project] Lazy-loading 'system_metadata' on Instance uuid 07ec2c05-aaa9-46e8-8439-7aa5b9fca19d {{(pid=75045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 23:19:24 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d2ff5d0-0b89-42ba-92eb-1e12c9cce205 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SroFPTjC" returned: 0 in 0.165s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:19:24 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0280137-3600-4243-8290-4097df0734de]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:19:24 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac28c4dc-b349-4d76-b20f-521f64e4c39b tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'SroFPTjC'): stdout= stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:19:24 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d2ff5d0-0b89-42ba-92eb-1e12c9cce205 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:19:24 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d2ff5d0-0b89-42ba-92eb-1e12c9cce205 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:19:24 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[8999d3ac-5cdb-455e-84d3-69f06c5efba9]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:19:24 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac28c4dc-b349-4d76-b20f-521f64e4c39b tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:19:24 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:19:24 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:19:24 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffd281ff-344e-47f6-b15d-0e628f477427]: (4, ('tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d7a4df0-bfc5-4952-8454-97b703b68f28 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f829f03c-8f1a-45f1-a715-b9d769201d1b (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:528866cb-30dd-40ac-9a81-4c6afc93cdd9 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:175bb2c0-7767-4740-9350-7e3300681a43 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ed77146-5ae0-400d-8116-7f9eb1322808 (non-flash)\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:19:24 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac28c4dc-b349-4d76-b20f-521f64e4c39b tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d7a4df0-bfc5-4952-8454-97b703b68f28 (non-flash)
Nov 08 23:19:24 user nova-compute[75045]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f829f03c-8f1a-45f1-a715-b9d769201d1b (non-flash)
Nov 08 23:19:24 user nova-compute[75045]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:528866cb-30dd-40ac-9a81-4c6afc93cdd9 (non-flash)
Nov 08 23:19:24 user nova-compute[75045]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:175bb2c0-7767-4740-9350-7e3300681a43 (non-flash)
Nov 08 23:19:24 user nova-compute[75045]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ed77146-5ae0-400d-8116-7f9eb1322808 (non-flash)
Nov 08 23:19:24 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 23:19:24 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac28c4dc-b349-4d76-b20f-521f64e4c39b tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] iscsi session list stdout=tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d7a4df0-bfc5-4952-8454-97b703b68f28 (non-flash)
Nov 08 23:19:24 user nova-compute[75045]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f829f03c-8f1a-45f1-a715-b9d769201d1b (non-flash)
Nov 08 23:19:24 user nova-compute[75045]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:528866cb-30dd-40ac-9a81-4c6afc93cdd9 (non-flash)
Nov 08 23:19:24 user nova-compute[75045]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:175bb2c0-7767-4740-9350-7e3300681a43 (non-flash)
Nov 08 23:19:24 user nova-compute[75045]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ed77146-5ae0-400d-8116-7f9eb1322808 (non-flash)
Nov 08 23:19:24 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 23:19:24 user nova-compute[75045]: INFO nova.virt.libvirt.driver [None req-c9cbe7e8-bcf2-4811-9f07-32d1aea04a86 tempest-VolumesAssistedSnapshotsTest-718669656 tempest-VolumesAssistedSnapshotsTest-718669656-project] [instance: 07ec2c05-aaa9-46e8-8439-7aa5b9fca19d] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 08 23:19:24 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d2ff5d0-0b89-42ba-92eb-1e12c9cce205 -p 172.16.0.220:3260 --login {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:19:24 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-79475380-6488-4cf8-9834-9906cfb6abfe tempest-VolumesAssistedSnapshotsTest-718669656 tempest-VolumesAssistedSnapshotsTest-718669656-project] [instance: 07ec2c05-aaa9-46e8-8439-7aa5b9fca19d] volume_snapshot_delete: delete_info: {'volume_id': 'f829f03c-8f1a-45f1-a715-b9d769201d1b'} {{(pid=75045) _volume_snapshot_delete /opt/stack/nova/nova/virt/libvirt/driver.py:3677}}
Nov 08 23:19:24 user nova-compute[75045]: ERROR nova.virt.libvirt.driver [None req-79475380-6488-4cf8-9834-9906cfb6abfe tempest-VolumesAssistedSnapshotsTest-718669656 tempest-VolumesAssistedSnapshotsTest-718669656-project] [instance: 07ec2c05-aaa9-46e8-8439-7aa5b9fca19d] Error occurred during volume_snapshot_delete, sending error status to Cinder.: KeyError: 'type'
Nov 08 23:19:24 user nova-compute[75045]: ERROR nova.virt.libvirt.driver [instance: 07ec2c05-aaa9-46e8-8439-7aa5b9fca19d] Traceback (most recent call last):
Nov 08 23:19:24 user nova-compute[75045]: ERROR nova.virt.libvirt.driver [instance: 07ec2c05-aaa9-46e8-8439-7aa5b9fca19d]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Nov 08 23:19:24 user nova-compute[75045]: ERROR nova.virt.libvirt.driver [instance: 07ec2c05-aaa9-46e8-8439-7aa5b9fca19d]     self._volume_snapshot_delete(context, instance, volume_id,
Nov 08 23:19:24 user nova-compute[75045]: ERROR nova.virt.libvirt.driver [instance: 07ec2c05-aaa9-46e8-8439-7aa5b9fca19d]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Nov 08 23:19:24 user nova-compute[75045]: ERROR nova.virt.libvirt.driver [instance: 07ec2c05-aaa9-46e8-8439-7aa5b9fca19d]     if delete_info['type'] != 'qcow2':
Nov 08 23:19:24 user nova-compute[75045]: ERROR nova.virt.libvirt.driver [instance: 07ec2c05-aaa9-46e8-8439-7aa5b9fca19d] KeyError: 'type'
Nov 08 23:19:24 user nova-compute[75045]: ERROR nova.virt.libvirt.driver [instance: 07ec2c05-aaa9-46e8-8439-7aa5b9fca19d] 
Nov 08 23:19:24 user nova-compute[75045]: ERROR nova.virt.libvirt.driver [None req-c9cbe7e8-bcf2-4811-9f07-32d1aea04a86 tempest-VolumesAssistedSnapshotsTest-718669656 tempest-VolumesAssistedSnapshotsTest-718669656-project] [instance: 07ec2c05-aaa9-46e8-8439-7aa5b9fca19d] Unable to create VM snapshot, failing volume_snapshot operation.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 08 23:19:24 user nova-compute[75045]: ERROR nova.virt.libvirt.driver [instance: 07ec2c05-aaa9-46e8-8439-7aa5b9fca19d] Traceback (most recent call last):
Nov 08 23:19:24 user nova-compute[75045]: ERROR nova.virt.libvirt.driver [instance: 07ec2c05-aaa9-46e8-8439-7aa5b9fca19d]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 08 23:19:24 user nova-compute[75045]: ERROR nova.virt.libvirt.driver [instance: 07ec2c05-aaa9-46e8-8439-7aa5b9fca19d]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 08 23:19:24 user nova-compute[75045]: ERROR nova.virt.libvirt.driver [instance: 07ec2c05-aaa9-46e8-8439-7aa5b9fca19d]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 08 23:19:24 user nova-compute[75045]: ERROR nova.virt.libvirt.driver [instance: 07ec2c05-aaa9-46e8-8439-7aa5b9fca19d]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 08 23:19:24 user nova-compute[75045]: ERROR nova.virt.libvirt.driver [instance: 07ec2c05-aaa9-46e8-8439-7aa5b9fca19d]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 08 23:19:24 user nova-compute[75045]: ERROR nova.virt.libvirt.driver [instance: 07ec2c05-aaa9-46e8-8439-7aa5b9fca19d]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 08 23:19:24 user nova-compute[75045]: ERROR nova.virt.libvirt.driver [instance: 07ec2c05-aaa9-46e8-8439-7aa5b9fca19d]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 08 23:19:24 user nova-compute[75045]: ERROR nova.virt.libvirt.driver [instance: 07ec2c05-aaa9-46e8-8439-7aa5b9fca19d]     rv = execute(f, *args, **kwargs)
Nov 08 23:19:24 user nova-compute[75045]: ERROR nova.virt.libvirt.driver [instance: 07ec2c05-aaa9-46e8-8439-7aa5b9fca19d]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 08 23:19:24 user nova-compute[75045]: ERROR nova.virt.libvirt.driver [instance: 07ec2c05-aaa9-46e8-8439-7aa5b9fca19d]     six.reraise(c, e, tb)
Nov 08 23:19:24 user nova-compute[75045]: ERROR nova.virt.libvirt.driver [instance: 07ec2c05-aaa9-46e8-8439-7aa5b9fca19d]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 08 23:19:24 user nova-compute[75045]: ERROR nova.virt.libvirt.driver [instance: 07ec2c05-aaa9-46e8-8439-7aa5b9fca19d]     raise value
Nov 08 23:19:24 user nova-compute[75045]: ERROR nova.virt.libvirt.driver [instance: 07ec2c05-aaa9-46e8-8439-7aa5b9fca19d]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 08 23:19:24 user nova-compute[75045]: ERROR nova.virt.libvirt.driver [instance: 07ec2c05-aaa9-46e8-8439-7aa5b9fca19d]     rv = meth(*args, **kwargs)
Nov 08 23:19:24 user nova-compute[75045]: ERROR nova.virt.libvirt.driver [instance: 07ec2c05-aaa9-46e8-8439-7aa5b9fca19d]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 08 23:19:24 user nova-compute[75045]: ERROR nova.virt.libvirt.driver [instance: 07ec2c05-aaa9-46e8-8439-7aa5b9fca19d]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 08 23:19:24 user nova-compute[75045]: ERROR nova.virt.libvirt.driver [instance: 07ec2c05-aaa9-46e8-8439-7aa5b9fca19d] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 08 23:19:24 user nova-compute[75045]: ERROR nova.virt.libvirt.driver [instance: 07ec2c05-aaa9-46e8-8439-7aa5b9fca19d] 
Nov 08 23:19:24 user nova-compute[75045]: ERROR nova.virt.libvirt.driver [None req-c9cbe7e8-bcf2-4811-9f07-32d1aea04a86 tempest-VolumesAssistedSnapshotsTest-718669656 tempest-VolumesAssistedSnapshotsTest-718669656-project] [instance: 07ec2c05-aaa9-46e8-8439-7aa5b9fca19d] Error occurred during volume_snapshot_create, sending error status to Cinder.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 08 23:19:24 user nova-compute[75045]: ERROR nova.virt.libvirt.driver [instance: 07ec2c05-aaa9-46e8-8439-7aa5b9fca19d] Traceback (most recent call last):
Nov 08 23:19:24 user nova-compute[75045]: ERROR nova.virt.libvirt.driver [instance: 07ec2c05-aaa9-46e8-8439-7aa5b9fca19d]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Nov 08 23:19:24 user nova-compute[75045]: ERROR nova.virt.libvirt.driver [instance: 07ec2c05-aaa9-46e8-8439-7aa5b9fca19d]     self._volume_snapshot_create(context, instance, guest,
Nov 08 23:19:24 user nova-compute[75045]: ERROR nova.virt.libvirt.driver [instance: 07ec2c05-aaa9-46e8-8439-7aa5b9fca19d]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 08 23:19:24 user nova-compute[75045]: ERROR nova.virt.libvirt.driver [instance: 07ec2c05-aaa9-46e8-8439-7aa5b9fca19d]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 08 23:19:24 user nova-compute[75045]: ERROR nova.virt.libvirt.driver [instance: 07ec2c05-aaa9-46e8-8439-7aa5b9fca19d]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 08 23:19:24 user nova-compute[75045]: ERROR nova.virt.libvirt.driver [instance: 07ec2c05-aaa9-46e8-8439-7aa5b9fca19d]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 08 23:19:24 user nova-compute[75045]: ERROR nova.virt.libvirt.driver [instance: 07ec2c05-aaa9-46e8-8439-7aa5b9fca19d]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 08 23:19:24 user nova-compute[75045]: ERROR nova.virt.libvirt.driver [instance: 07ec2c05-aaa9-46e8-8439-7aa5b9fca19d]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 08 23:19:24 user nova-compute[75045]: ERROR nova.virt.libvirt.driver [instance: 07ec2c05-aaa9-46e8-8439-7aa5b9fca19d]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 08 23:19:24 user nova-compute[75045]: ERROR nova.virt.libvirt.driver [instance: 07ec2c05-aaa9-46e8-8439-7aa5b9fca19d]     rv = execute(f, *args, **kwargs)
Nov 08 23:19:24 user nova-compute[75045]: ERROR nova.virt.libvirt.driver [instance: 07ec2c05-aaa9-46e8-8439-7aa5b9fca19d]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 08 23:19:24 user nova-compute[75045]: ERROR nova.virt.libvirt.driver [instance: 07ec2c05-aaa9-46e8-8439-7aa5b9fca19d]     six.reraise(c, e, tb)
Nov 08 23:19:24 user nova-compute[75045]: ERROR nova.virt.libvirt.driver [instance: 07ec2c05-aaa9-46e8-8439-7aa5b9fca19d]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 08 23:19:24 user nova-compute[75045]: ERROR nova.virt.libvirt.driver [instance: 07ec2c05-aaa9-46e8-8439-7aa5b9fca19d]     raise value
Nov 08 23:19:24 user nova-compute[75045]: ERROR nova.virt.libvirt.driver [instance: 07ec2c05-aaa9-46e8-8439-7aa5b9fca19d]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 08 23:19:24 user nova-compute[75045]: ERROR nova.virt.libvirt.driver [instance: 07ec2c05-aaa9-46e8-8439-7aa5b9fca19d]     rv = meth(*args, **kwargs)
Nov 08 23:19:24 user nova-compute[75045]: ERROR nova.virt.libvirt.driver [instance: 07ec2c05-aaa9-46e8-8439-7aa5b9fca19d]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 08 23:19:24 user nova-compute[75045]: ERROR nova.virt.libvirt.driver [instance: 07ec2c05-aaa9-46e8-8439-7aa5b9fca19d]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 08 23:19:24 user nova-compute[75045]: ERROR nova.virt.libvirt.driver [instance: 07ec2c05-aaa9-46e8-8439-7aa5b9fca19d] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 08 23:19:24 user nova-compute[75045]: ERROR nova.virt.libvirt.driver [instance: 07ec2c05-aaa9-46e8-8439-7aa5b9fca19d] 
Nov 08 23:19:24 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d2ff5d0-0b89-42ba-92eb-1e12c9cce205 -p 172.16.0.220:3260 --login" returned: 0 in 0.178s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:19:24 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee872c6a-3b08-4113-b125-1aef021c1e65]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8d2ff5d0-0b89-42ba-92eb-1e12c9cce205, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8d2ff5d0-0b89-42ba-92eb-1e12c9cce205, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:19:24 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac28c4dc-b349-4d76-b20f-521f64e4c39b tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8d2ff5d0-0b89-42ba-92eb-1e12c9cce205, portal: 172.16.0.220,3260]
Nov 08 23:19:24 user nova-compute[75045]: Login to [iface: default, target: iqn.2010-10.org.openstack:8d2ff5d0-0b89-42ba-92eb-1e12c9cce205, portal: 172.16.0.220,3260] successful.
Nov 08 23:19:24 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:19:24 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d2ff5d0-0b89-42ba-92eb-1e12c9cce205 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:19:24 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d2ff5d0-0b89-42ba-92eb-1e12c9cce205 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:19:24 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c5997ef-b869-42a2-bb15-a47018b1f48a]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:19:24 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac28c4dc-b349-4d76-b20f-521f64e4c39b tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:19:24 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:19:24 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:19:24 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[70187669-52ca-4500-89ed-794019e3abe2]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d2ff5d0-0b89-42ba-92eb-1e12c9cce205 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d7a4df0-bfc5-4952-8454-97b703b68f28 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f829f03c-8f1a-45f1-a715-b9d769201d1b (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:528866cb-30dd-40ac-9a81-4c6afc93cdd9 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:175bb2c0-7767-4740-9350-7e3300681a43 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ed77146-5ae0-400d-8116-7f9eb1322808 (non-flash)\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:19:24 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac28c4dc-b349-4d76-b20f-521f64e4c39b tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d2ff5d0-0b89-42ba-92eb-1e12c9cce205 (non-flash)
Nov 08 23:19:24 user nova-compute[75045]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d7a4df0-bfc5-4952-8454-97b703b68f28 (non-flash)
Nov 08 23:19:24 user nova-compute[75045]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f829f03c-8f1a-45f1-a715-b9d769201d1b (non-flash)
Nov 08 23:19:24 user nova-compute[75045]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:528866cb-30dd-40ac-9a81-4c6afc93cdd9 (non-flash)
Nov 08 23:19:24 user nova-compute[75045]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:175bb2c0-7767-4740-9350-7e3300681a43 (non-flash)
Nov 08 23:19:24 user nova-compute[75045]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ed77146-5ae0-400d-8116-7f9eb1322808 (non-flash)
Nov 08 23:19:24 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 23:19:24 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac28c4dc-b349-4d76-b20f-521f64e4c39b tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d2ff5d0-0b89-42ba-92eb-1e12c9cce205 (non-flash)
Nov 08 23:19:24 user nova-compute[75045]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d7a4df0-bfc5-4952-8454-97b703b68f28 (non-flash)
Nov 08 23:19:24 user nova-compute[75045]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f829f03c-8f1a-45f1-a715-b9d769201d1b (non-flash)
Nov 08 23:19:24 user nova-compute[75045]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:528866cb-30dd-40ac-9a81-4c6afc93cdd9 (non-flash)
Nov 08 23:19:24 user nova-compute[75045]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:175bb2c0-7767-4740-9350-7e3300681a43 (non-flash)
Nov 08 23:19:24 user nova-compute[75045]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ed77146-5ae0-400d-8116-7f9eb1322808 (non-flash)
Nov 08 23:19:24 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 23:19:24 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-ac28c4dc-b349-4d76-b20f-521f64e4c39b tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8d2ff5d0-0b89-42ba-92eb-1e12c9cce205" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.603s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 23:19:24 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac28c4dc-b349-4d76-b20f-521f64e4c39b tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] Connected to 172.16.0.220:3260 {{(pid=75045) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 23:19:24 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-ac28c4dc-b349-4d76-b20f-521f64e4c39b tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] HCTL ('38', '-', '-', 0) found on session 10 with lun 0 {{(pid=75045) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 23:19:24 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-ac28c4dc-b349-4d76-b20f-521f64e4c39b tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=75045) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 23:19:24 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:19:24 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.116s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:19:24 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[27066100-d857-40f5-824f-492695208ad7]: (4, ('- - 0', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:19:24 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-ac28c4dc-b349-4d76-b20f-521f64e4c39b tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] Searching for a device in session 10 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=75045) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 23:19:24 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac28c4dc-b349-4d76-b20f-521f64e4c39b tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:8d2ff5d0-0b89-42ba-92eb-1e12c9cce205', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SroFPTjC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75045) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 23:19:25 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-ac28c4dc-b349-4d76-b20f-521f64e4c39b tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.740s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 23:19:25 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac28c4dc-b349-4d76-b20f-521f64e4c39b tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] <== connect_volume: return (1742ms) {'type': 'block', 'scsi_wwn': '23235376230626231', 'path': '/dev/sdg'} {{(pid=75045) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 23:19:25 user nova-compute[75045]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ac28c4dc-b349-4d76-b20f-521f64e4c39b tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] [instance: 520eac4f-fa48-4e41-924d-840907e701b4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23235376230626231', 'path': '/dev/sdg'} {{(pid=75045) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 23:19:25 user nova-compute[75045]: DEBUG nova.virt.libvirt.vif [None req-ac28c4dc-b349-4d76-b20f-521f64e4c39b tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T23:17:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1412524117',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1412524117',id=10,image_ref='a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIOg6qdtEUL8OwbPxHJ6siVv0HGHJ2I3WU6rXK8ahHqt76KKZ8niNHuCAGdeTPkJyNSdMmrzEWjROFsrOoC1kmaY029eK7Yz3akFrk91+1J9Sq2nrDoAG6jY9mnI91XmoQ==',key_name='tempest-keypair-1736555466',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='74ebbe44152141368b22a9a7989d577a',ramdisk_id='',reservation_id='r-mgh3rv15',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-2022931664',owner_user_name='tempest-TaggedBootDevicesTest-2022931664-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T23:17:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8c4361faf9ee4444be0e061b8c8aee98',uuid=520eac4f-fa48-4e41-924d-840907e701b4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "25776e3e-60d6-457c-a78a-a59df0e3e7b5", "address": "fa:16:3e:3e:7f:60", "network": {"id": "13af9e02-7f74-4e9c-aea7-2e6f0701b1c2", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1067175210-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74ebbe44152141368b22a9a7989d577a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25776e3e-60", "ovs_interfaceid": "25776e3e-60d6-457c-a78a-a59df0e3e7b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75045) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 23:19:25 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-ac28c4dc-b349-4d76-b20f-521f64e4c39b tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] Converting VIF {"id": "25776e3e-60d6-457c-a78a-a59df0e3e7b5", "address": "fa:16:3e:3e:7f:60", "network": {"id": "13af9e02-7f74-4e9c-aea7-2e6f0701b1c2", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1067175210-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74ebbe44152141368b22a9a7989d577a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25776e3e-60", "ovs_interfaceid": "25776e3e-60d6-457c-a78a-a59df0e3e7b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 23:19:25 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-ac28c4dc-b349-4d76-b20f-521f64e4c39b tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3e:7f:60,bridge_name='br-int',has_traffic_filtering=True,id=25776e3e-60d6-457c-a78a-a59df0e3e7b5,network=Network(13af9e02-7f74-4e9c-aea7-2e6f0701b1c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap25776e3e-60') {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 23:19:25 user nova-compute[75045]: DEBUG nova.virt.libvirt.vif [None req-ac28c4dc-b349-4d76-b20f-521f64e4c39b tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T23:17:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1412524117',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1412524117',id=10,image_ref='a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIOg6qdtEUL8OwbPxHJ6siVv0HGHJ2I3WU6rXK8ahHqt76KKZ8niNHuCAGdeTPkJyNSdMmrzEWjROFsrOoC1kmaY029eK7Yz3akFrk91+1J9Sq2nrDoAG6jY9mnI91XmoQ==',key_name='tempest-keypair-1736555466',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='74ebbe44152141368b22a9a7989d577a',ramdisk_id='',reservation_id='r-mgh3rv15',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-2022931664',owner_user_name='tempest-TaggedBootDevicesTest-2022931664-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T23:17:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8c4361faf9ee4444be0e061b8c8aee98',uuid=520eac4f-fa48-4e41-924d-840907e701b4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bcd0d9eb-775a-4e28-b712-148c1fe99521", "address": "fa:16:3e:21:f4:bc", "network": {"id": "0916556c-7a50-48cf-8ad0-56c20de9d89f", "bridge": "br-int", "label": "tempest-device-tagging-net1-573961537", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.137", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "74ebbe44152141368b22a9a7989d577a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbcd0d9eb-77", "ovs_interfaceid": "bcd0d9eb-775a-4e28-b712-148c1fe99521", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75045) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 23:19:25 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-ac28c4dc-b349-4d76-b20f-521f64e4c39b tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] Converting VIF {"id": "bcd0d9eb-775a-4e28-b712-148c1fe99521", "address": "fa:16:3e:21:f4:bc", "network": {"id": "0916556c-7a50-48cf-8ad0-56c20de9d89f", "bridge": "br-int", "label": "tempest-device-tagging-net1-573961537", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.137", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "74ebbe44152141368b22a9a7989d577a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbcd0d9eb-77", "ovs_interfaceid": "bcd0d9eb-775a-4e28-b712-148c1fe99521", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 23:19:25 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-ac28c4dc-b349-4d76-b20f-521f64e4c39b tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:21:f4:bc,bridge_name='br-int',has_traffic_filtering=True,id=bcd0d9eb-775a-4e28-b712-148c1fe99521,network=Network(0916556c-7a50-48cf-8ad0-56c20de9d89f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapbcd0d9eb-77') {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 23:19:25 user nova-compute[75045]: DEBUG nova.virt.libvirt.vif [None req-ac28c4dc-b349-4d76-b20f-521f64e4c39b tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T23:17:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1412524117',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1412524117',id=10,image_ref='a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIOg6qdtEUL8OwbPxHJ6siVv0HGHJ2I3WU6rXK8ahHqt76KKZ8niNHuCAGdeTPkJyNSdMmrzEWjROFsrOoC1kmaY029eK7Yz3akFrk91+1J9Sq2nrDoAG6jY9mnI91XmoQ==',key_name='tempest-keypair-1736555466',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='74ebbe44152141368b22a9a7989d577a',ramdisk_id='',reservation_id='r-mgh3rv15',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-2022931664',owner_user_name='tempest-TaggedBootDevicesTest-2022931664-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T23:17:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8c4361faf9ee4444be0e061b8c8aee98',uuid=520eac4f-fa48-4e41-924d-840907e701b4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "04ae6531-75ef-4043-99f4-bfa5ef2bba59", "address": "fa:16:3e:9f:87:19", "network": {"id": "0916556c-7a50-48cf-8ad0-56c20de9d89f", "bridge": "br-int", "label": "tempest-device-tagging-net1-573961537", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.210", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "74ebbe44152141368b22a9a7989d577a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04ae6531-75", "ovs_interfaceid": "04ae6531-75ef-4043-99f4-bfa5ef2bba59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75045) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 23:19:25 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-ac28c4dc-b349-4d76-b20f-521f64e4c39b tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] Converting VIF {"id": "04ae6531-75ef-4043-99f4-bfa5ef2bba59", "address": "fa:16:3e:9f:87:19", "network": {"id": "0916556c-7a50-48cf-8ad0-56c20de9d89f", "bridge": "br-int", "label": "tempest-device-tagging-net1-573961537", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.210", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "74ebbe44152141368b22a9a7989d577a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04ae6531-75", "ovs_interfaceid": "04ae6531-75ef-4043-99f4-bfa5ef2bba59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 23:19:25 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-ac28c4dc-b349-4d76-b20f-521f64e4c39b tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9f:87:19,bridge_name='br-int',has_traffic_filtering=True,id=04ae6531-75ef-4043-99f4-bfa5ef2bba59,network=Network(0916556c-7a50-48cf-8ad0-56c20de9d89f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap04ae6531-75') {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 23:19:25 user nova-compute[75045]: DEBUG nova.virt.libvirt.vif [None req-ac28c4dc-b349-4d76-b20f-521f64e4c39b tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T23:17:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1412524117',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1412524117',id=10,image_ref='a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIOg6qdtEUL8OwbPxHJ6siVv0HGHJ2I3WU6rXK8ahHqt76KKZ8niNHuCAGdeTPkJyNSdMmrzEWjROFsrOoC1kmaY029eK7Yz3akFrk91+1J9Sq2nrDoAG6jY9mnI91XmoQ==',key_name='tempest-keypair-1736555466',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='74ebbe44152141368b22a9a7989d577a',ramdisk_id='',reservation_id='r-mgh3rv15',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-2022931664',owner_user_name='tempest-TaggedBootDevicesTest-2022931664-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T23:17:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8c4361faf9ee4444be0e061b8c8aee98',uuid=520eac4f-fa48-4e41-924d-840907e701b4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b3c645dd-a1ac-4780-a49d-916cb6a121c9", "address": "fa:16:3e:e2:e6:e2", "network": {"id": "0916556c-7a50-48cf-8ad0-56c20de9d89f", "bridge": "br-int", "label": "tempest-device-tagging-net1-573961537", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.154", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "74ebbe44152141368b22a9a7989d577a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3c645dd-a1", "ovs_interfaceid": "b3c645dd-a1ac-4780-a49d-916cb6a121c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75045) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 23:19:25 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-ac28c4dc-b349-4d76-b20f-521f64e4c39b tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] Converting VIF {"id": "b3c645dd-a1ac-4780-a49d-916cb6a121c9", "address": "fa:16:3e:e2:e6:e2", "network": {"id": "0916556c-7a50-48cf-8ad0-56c20de9d89f", "bridge": "br-int", "label": "tempest-device-tagging-net1-573961537", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.154", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "74ebbe44152141368b22a9a7989d577a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3c645dd-a1", "ovs_interfaceid": "b3c645dd-a1ac-4780-a49d-916cb6a121c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 23:19:25 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-ac28c4dc-b349-4d76-b20f-521f64e4c39b tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e2:e6:e2,bridge_name='br-int',has_traffic_filtering=True,id=b3c645dd-a1ac-4780-a49d-916cb6a121c9,network=Network(0916556c-7a50-48cf-8ad0-56c20de9d89f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3c645dd-a1') {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 23:19:25 user nova-compute[75045]: DEBUG nova.virt.libvirt.vif [None req-ac28c4dc-b349-4d76-b20f-521f64e4c39b tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T23:17:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1412524117',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1412524117',id=10,image_ref='a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIOg6qdtEUL8OwbPxHJ6siVv0HGHJ2I3WU6rXK8ahHqt76KKZ8niNHuCAGdeTPkJyNSdMmrzEWjROFsrOoC1kmaY029eK7Yz3akFrk91+1J9Sq2nrDoAG6jY9mnI91XmoQ==',key_name='tempest-keypair-1736555466',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='74ebbe44152141368b22a9a7989d577a',ramdisk_id='',reservation_id='r-mgh3rv15',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-2022931664',owner_user_name='tempest-TaggedBootDevicesTest-2022931664-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T23:17:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8c4361faf9ee4444be0e061b8c8aee98',uuid=520eac4f-fa48-4e41-924d-840907e701b4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3974ed79-74a5-4e9c-aa42-3aab1b234a39", "address": "fa:16:3e:f3:1c:29", "network": {"id": "0916556c-7a50-48cf-8ad0-56c20de9d89f", "bridge": "br-int", "label": "tempest-device-tagging-net1-573961537", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.231", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "74ebbe44152141368b22a9a7989d577a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3974ed79-74", "ovs_interfaceid": "3974ed79-74a5-4e9c-aa42-3aab1b234a39", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75045) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 23:19:25 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-ac28c4dc-b349-4d76-b20f-521f64e4c39b tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] Converting VIF {"id": "3974ed79-74a5-4e9c-aa42-3aab1b234a39", "address": "fa:16:3e:f3:1c:29", "network": {"id": "0916556c-7a50-48cf-8ad0-56c20de9d89f", "bridge": "br-int", "label": "tempest-device-tagging-net1-573961537", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.231", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "74ebbe44152141368b22a9a7989d577a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3974ed79-74", "ovs_interfaceid": "3974ed79-74a5-4e9c-aa42-3aab1b234a39", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 23:19:25 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-ac28c4dc-b349-4d76-b20f-521f64e4c39b tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f3:1c:29,bridge_name='br-int',has_traffic_filtering=True,id=3974ed79-74a5-4e9c-aa42-3aab1b234a39,network=Network(0916556c-7a50-48cf-8ad0-56c20de9d89f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3974ed79-74') {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 23:19:25 user nova-compute[75045]: DEBUG nova.virt.libvirt.vif [None req-ac28c4dc-b349-4d76-b20f-521f64e4c39b tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T23:17:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1412524117',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1412524117',id=10,image_ref='a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIOg6qdtEUL8OwbPxHJ6siVv0HGHJ2I3WU6rXK8ahHqt76KKZ8niNHuCAGdeTPkJyNSdMmrzEWjROFsrOoC1kmaY029eK7Yz3akFrk91+1J9Sq2nrDoAG6jY9mnI91XmoQ==',key_name='tempest-keypair-1736555466',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='74ebbe44152141368b22a9a7989d577a',ramdisk_id='',reservation_id='r-mgh3rv15',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-2022931664',owner_user_name='tempest-TaggedBootDevicesTest-2022931664-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T23:17:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8c4361faf9ee4444be0e061b8c8aee98',uuid=520eac4f-fa48-4e41-924d-840907e701b4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c2155ca8-d244-401d-a80f-8c53a68b6799", "address": "fa:16:3e:a2:80:a4", "network": {"id": "5cfed969-3f78-4bc2-8d08-921447c01347", "bridge": "br-int", "label": "tempest-device-tagging-net2-1614620309", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "74ebbe44152141368b22a9a7989d577a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2155ca8-d2", "ovs_interfaceid": "c2155ca8-d244-401d-a80f-8c53a68b6799", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75045) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 23:19:25 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-ac28c4dc-b349-4d76-b20f-521f64e4c39b tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] Converting VIF {"id": "c2155ca8-d244-401d-a80f-8c53a68b6799", "address": "fa:16:3e:a2:80:a4", "network": {"id": "5cfed969-3f78-4bc2-8d08-921447c01347", "bridge": "br-int", "label": "tempest-device-tagging-net2-1614620309", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "74ebbe44152141368b22a9a7989d577a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2155ca8-d2", "ovs_interfaceid": "c2155ca8-d244-401d-a80f-8c53a68b6799", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 23:19:25 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-ac28c4dc-b349-4d76-b20f-521f64e4c39b tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a2:80:a4,bridge_name='br-int',has_traffic_filtering=True,id=c2155ca8-d244-401d-a80f-8c53a68b6799,network=Network(5cfed969-3f78-4bc2-8d08-921447c01347),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc2155ca8-d2') {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 23:19:25 user nova-compute[75045]: DEBUG nova.virt.libvirt.vif [None req-ac28c4dc-b349-4d76-b20f-521f64e4c39b tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T23:17:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1412524117',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1412524117',id=10,image_ref='a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIOg6qdtEUL8OwbPxHJ6siVv0HGHJ2I3WU6rXK8ahHqt76KKZ8niNHuCAGdeTPkJyNSdMmrzEWjROFsrOoC1kmaY029eK7Yz3akFrk91+1J9Sq2nrDoAG6jY9mnI91XmoQ==',key_name='tempest-keypair-1736555466',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='74ebbe44152141368b22a9a7989d577a',ramdisk_id='',reservation_id='r-mgh3rv15',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-2022931664',owner_user_name='tempest-TaggedBootDevicesTest-2022931664-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T23:17:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8c4361faf9ee4444be0e061b8c8aee98',uuid=520eac4f-fa48-4e41-924d-840907e701b4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "768830de-7c2e-45ca-959e-398480b6ba29", "address": "fa:16:3e:bc:05:cc", "network": {"id": "5cfed969-3f78-4bc2-8d08-921447c01347", "bridge": "br-int", "label": "tempest-device-tagging-net2-1614620309", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "74ebbe44152141368b22a9a7989d577a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap768830de-7c", "ovs_interfaceid": "768830de-7c2e-45ca-959e-398480b6ba29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75045) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 23:19:25 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-ac28c4dc-b349-4d76-b20f-521f64e4c39b tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] Converting VIF {"id": "768830de-7c2e-45ca-959e-398480b6ba29", "address": "fa:16:3e:bc:05:cc", "network": {"id": "5cfed969-3f78-4bc2-8d08-921447c01347", "bridge": "br-int", "label": "tempest-device-tagging-net2-1614620309", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "74ebbe44152141368b22a9a7989d577a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap768830de-7c", "ovs_interfaceid": "768830de-7c2e-45ca-959e-398480b6ba29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 23:19:25 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-ac28c4dc-b349-4d76-b20f-521f64e4c39b tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bc:05:cc,bridge_name='br-int',has_traffic_filtering=True,id=768830de-7c2e-45ca-959e-398480b6ba29,network=Network(5cfed969-3f78-4bc2-8d08-921447c01347),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap768830de-7c') {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 23:19:25 user nova-compute[75045]: DEBUG nova.objects.instance [None req-ac28c4dc-b349-4d76-b20f-521f64e4c39b tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] Lazy-loading 'pci_devices' on Instance uuid 520eac4f-fa48-4e41-924d-840907e701b4 {{(pid=75045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 23:19:25 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-ac28c4dc-b349-4d76-b20f-521f64e4c39b tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] [instance: 520eac4f-fa48-4e41-924d-840907e701b4] End _get_guest_xml xml=<domain type="kvm">
Nov 08 23:19:25 user nova-compute[75045]:   <uuid>520eac4f-fa48-4e41-924d-840907e701b4</uuid>
Nov 08 23:19:25 user nova-compute[75045]:   <name>instance-0000000a</name>
Nov 08 23:19:25 user nova-compute[75045]:   <memory>524288</memory>
Nov 08 23:19:25 user nova-compute[75045]:   <vcpu>1</vcpu>
Nov 08 23:19:25 user nova-compute[75045]:   <metadata>
Nov 08 23:19:25 user nova-compute[75045]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 23:19:25 user nova-compute[75045]:       <nova:package version="0.0.0"/>
Nov 08 23:19:25 user nova-compute[75045]:       <nova:name>tempest-device-tagging-server-1412524117</nova:name>
Nov 08 23:19:25 user nova-compute[75045]:       <nova:creationTime>2023-11-08 23:19:19</nova:creationTime>
Nov 08 23:19:25 user nova-compute[75045]:       <nova:flavor name="m1.tiny">
Nov 08 23:19:25 user nova-compute[75045]:         <nova:memory>512</nova:memory>
Nov 08 23:19:25 user nova-compute[75045]:         <nova:disk>1</nova:disk>
Nov 08 23:19:25 user nova-compute[75045]:         <nova:swap>0</nova:swap>
Nov 08 23:19:25 user nova-compute[75045]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 23:19:25 user nova-compute[75045]:         <nova:vcpus>1</nova:vcpus>
Nov 08 23:19:25 user nova-compute[75045]:       </nova:flavor>
Nov 08 23:19:25 user nova-compute[75045]:       <nova:owner>
Nov 08 23:19:25 user nova-compute[75045]:         <nova:user uuid="8c4361faf9ee4444be0e061b8c8aee98">tempest-TaggedBootDevicesTest-2022931664-project-member</nova:user>
Nov 08 23:19:25 user nova-compute[75045]:         <nova:project uuid="74ebbe44152141368b22a9a7989d577a">tempest-TaggedBootDevicesTest-2022931664</nova:project>
Nov 08 23:19:25 user nova-compute[75045]:       </nova:owner>
Nov 08 23:19:25 user nova-compute[75045]:       <nova:root type="image" uuid="a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb"/>
Nov 08 23:19:25 user nova-compute[75045]:       <nova:ports>
Nov 08 23:19:25 user nova-compute[75045]:         <nova:port uuid="25776e3e-60d6-457c-a78a-a59df0e3e7b5">
Nov 08 23:19:25 user nova-compute[75045]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 08 23:19:25 user nova-compute[75045]:         </nova:port>
Nov 08 23:19:25 user nova-compute[75045]:         <nova:port uuid="bcd0d9eb-775a-4e28-b712-148c1fe99521">
Nov 08 23:19:25 user nova-compute[75045]:           <nova:ip type="fixed" address="10.1.1.137" ipVersion="4"/>
Nov 08 23:19:25 user nova-compute[75045]:         </nova:port>
Nov 08 23:19:25 user nova-compute[75045]:         <nova:port uuid="04ae6531-75ef-4043-99f4-bfa5ef2bba59">
Nov 08 23:19:25 user nova-compute[75045]:           <nova:ip type="fixed" address="10.1.1.210" ipVersion="4"/>
Nov 08 23:19:25 user nova-compute[75045]:         </nova:port>
Nov 08 23:19:25 user nova-compute[75045]:         <nova:port uuid="b3c645dd-a1ac-4780-a49d-916cb6a121c9">
Nov 08 23:19:25 user nova-compute[75045]:           <nova:ip type="fixed" address="10.1.1.154" ipVersion="4"/>
Nov 08 23:19:25 user nova-compute[75045]:         </nova:port>
Nov 08 23:19:25 user nova-compute[75045]:         <nova:port uuid="3974ed79-74a5-4e9c-aa42-3aab1b234a39">
Nov 08 23:19:25 user nova-compute[75045]:           <nova:ip type="fixed" address="10.1.1.231" ipVersion="4"/>
Nov 08 23:19:25 user nova-compute[75045]:         </nova:port>
Nov 08 23:19:25 user nova-compute[75045]:         <nova:port uuid="c2155ca8-d244-401d-a80f-8c53a68b6799">
Nov 08 23:19:25 user nova-compute[75045]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Nov 08 23:19:25 user nova-compute[75045]:         </nova:port>
Nov 08 23:19:25 user nova-compute[75045]:         <nova:port uuid="768830de-7c2e-45ca-959e-398480b6ba29">
Nov 08 23:19:25 user nova-compute[75045]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Nov 08 23:19:25 user nova-compute[75045]:         </nova:port>
Nov 08 23:19:25 user nova-compute[75045]:       </nova:ports>
Nov 08 23:19:25 user nova-compute[75045]:     </nova:instance>
Nov 08 23:19:25 user nova-compute[75045]:   </metadata>
Nov 08 23:19:25 user nova-compute[75045]:   <sysinfo type="smbios">
Nov 08 23:19:25 user nova-compute[75045]:     <system>
Nov 08 23:19:25 user nova-compute[75045]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 23:19:25 user nova-compute[75045]:       <entry name="product">OpenStack Nova</entry>
Nov 08 23:19:25 user nova-compute[75045]:       <entry name="version">0.0.0</entry>
Nov 08 23:19:25 user nova-compute[75045]:       <entry name="serial">520eac4f-fa48-4e41-924d-840907e701b4</entry>
Nov 08 23:19:25 user nova-compute[75045]:       <entry name="uuid">520eac4f-fa48-4e41-924d-840907e701b4</entry>
Nov 08 23:19:25 user nova-compute[75045]:       <entry name="family">Virtual Machine</entry>
Nov 08 23:19:25 user nova-compute[75045]:     </system>
Nov 08 23:19:25 user nova-compute[75045]:   </sysinfo>
Nov 08 23:19:25 user nova-compute[75045]:   <os>
Nov 08 23:19:25 user nova-compute[75045]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 23:19:25 user nova-compute[75045]:     <boot dev="hd"/>
Nov 08 23:19:25 user nova-compute[75045]:     <smbios mode="sysinfo"/>
Nov 08 23:19:25 user nova-compute[75045]:   </os>
Nov 08 23:19:25 user nova-compute[75045]:   <features>
Nov 08 23:19:25 user nova-compute[75045]:     <acpi/>
Nov 08 23:19:25 user nova-compute[75045]:     <apic/>
Nov 08 23:19:25 user nova-compute[75045]:     <vmcoreinfo/>
Nov 08 23:19:25 user nova-compute[75045]:   </features>
Nov 08 23:19:25 user nova-compute[75045]:   <clock offset="utc">
Nov 08 23:19:25 user nova-compute[75045]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 23:19:25 user nova-compute[75045]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 23:19:25 user nova-compute[75045]:     <timer name="hpet" present="no"/>
Nov 08 23:19:25 user nova-compute[75045]:   </clock>
Nov 08 23:19:25 user nova-compute[75045]:   <cpu mode="custom" match="exact">
Nov 08 23:19:25 user nova-compute[75045]:     <model>Nehalem</model>
Nov 08 23:19:25 user nova-compute[75045]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 23:19:25 user nova-compute[75045]:   </cpu>
Nov 08 23:19:25 user nova-compute[75045]:   <devices>
Nov 08 23:19:25 user nova-compute[75045]:     <disk type="file" device="cdrom">
Nov 08 23:19:25 user nova-compute[75045]:       <driver name="qemu" type="raw" cache="none"/>
Nov 08 23:19:25 user nova-compute[75045]:       <source file="/opt/stack/data/nova/instances/520eac4f-fa48-4e41-924d-840907e701b4/disk.config"/>
Nov 08 23:19:25 user nova-compute[75045]:       <target dev="hda" bus="ide"/>
Nov 08 23:19:25 user nova-compute[75045]:     </disk>
Nov 08 23:19:25 user nova-compute[75045]:     <disk type="block" device="disk">
Nov 08 23:19:25 user nova-compute[75045]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 23:19:25 user nova-compute[75045]:       <source dev="/dev/sdb"/>
Nov 08 23:19:25 user nova-compute[75045]:       <target dev="vda" bus="virtio"/>
Nov 08 23:19:25 user nova-compute[75045]:       <serial>175bb2c0-7767-4740-9350-7e3300681a43</serial>
Nov 08 23:19:25 user nova-compute[75045]:     </disk>
Nov 08 23:19:25 user nova-compute[75045]:     <disk type="block" device="disk">
Nov 08 23:19:25 user nova-compute[75045]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 23:19:25 user nova-compute[75045]:       <source dev="/dev/sdc"/>
Nov 08 23:19:25 user nova-compute[75045]:       <target dev="vdb" bus="virtio"/>
Nov 08 23:19:25 user nova-compute[75045]:       <serial>6ed77146-5ae0-400d-8116-7f9eb1322808</serial>
Nov 08 23:19:25 user nova-compute[75045]:     </disk>
Nov 08 23:19:25 user nova-compute[75045]:     <disk type="block" device="disk">
Nov 08 23:19:25 user nova-compute[75045]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 23:19:25 user nova-compute[75045]:       <source dev="/dev/sdg"/>
Nov 08 23:19:25 user nova-compute[75045]:       <target dev="vdc" bus="virtio"/>
Nov 08 23:19:25 user nova-compute[75045]:       <serial>8d2ff5d0-0b89-42ba-92eb-1e12c9cce205</serial>
Nov 08 23:19:25 user nova-compute[75045]:     </disk>
Nov 08 23:19:25 user nova-compute[75045]:     <interface type="ethernet">
Nov 08 23:19:25 user nova-compute[75045]:       <mac address="fa:16:3e:3e:7f:60"/>
Nov 08 23:19:25 user nova-compute[75045]:       <model type="virtio"/>
Nov 08 23:19:25 user nova-compute[75045]:       <mtu size="1442"/>
Nov 08 23:19:25 user nova-compute[75045]:       <target dev="tap25776e3e-60"/>
Nov 08 23:19:25 user nova-compute[75045]:     </interface>
Nov 08 23:19:25 user nova-compute[75045]:     <interface type="ethernet">
Nov 08 23:19:25 user nova-compute[75045]:       <mac address="fa:16:3e:21:f4:bc"/>
Nov 08 23:19:25 user nova-compute[75045]:       <model type="virtio"/>
Nov 08 23:19:25 user nova-compute[75045]:       <mtu size="1442"/>
Nov 08 23:19:25 user nova-compute[75045]:       <target dev="tapbcd0d9eb-77"/>
Nov 08 23:19:25 user nova-compute[75045]:     </interface>
Nov 08 23:19:25 user nova-compute[75045]:     <interface type="ethernet">
Nov 08 23:19:25 user nova-compute[75045]:       <mac address="fa:16:3e:9f:87:19"/>
Nov 08 23:19:25 user nova-compute[75045]:       <model type="virtio"/>
Nov 08 23:19:25 user nova-compute[75045]:       <mtu size="1442"/>
Nov 08 23:19:25 user nova-compute[75045]:       <target dev="tap04ae6531-75"/>
Nov 08 23:19:25 user nova-compute[75045]:     </interface>
Nov 08 23:19:25 user nova-compute[75045]:     <interface type="ethernet">
Nov 08 23:19:25 user nova-compute[75045]:       <mac address="fa:16:3e:e2:e6:e2"/>
Nov 08 23:19:25 user nova-compute[75045]:       <model type="virtio"/>
Nov 08 23:19:25 user nova-compute[75045]:       <mtu size="1442"/>
Nov 08 23:19:25 user nova-compute[75045]:       <target dev="tapb3c645dd-a1"/>
Nov 08 23:19:25 user nova-compute[75045]:     </interface>
Nov 08 23:19:25 user nova-compute[75045]:     <interface type="ethernet">
Nov 08 23:19:25 user nova-compute[75045]:       <mac address="fa:16:3e:f3:1c:29"/>
Nov 08 23:19:25 user nova-compute[75045]:       <model type="virtio"/>
Nov 08 23:19:25 user nova-compute[75045]:       <mtu size="1442"/>
Nov 08 23:19:25 user nova-compute[75045]:       <target dev="tap3974ed79-74"/>
Nov 08 23:19:25 user nova-compute[75045]:     </interface>
Nov 08 23:19:25 user nova-compute[75045]:     <interface type="ethernet">
Nov 08 23:19:25 user nova-compute[75045]:       <mac address="fa:16:3e:a2:80:a4"/>
Nov 08 23:19:25 user nova-compute[75045]:       <model type="virtio"/>
Nov 08 23:19:25 user nova-compute[75045]:       <mtu size="1442"/>
Nov 08 23:19:25 user nova-compute[75045]:       <target dev="tapc2155ca8-d2"/>
Nov 08 23:19:25 user nova-compute[75045]:     </interface>
Nov 08 23:19:25 user nova-compute[75045]:     <interface type="ethernet">
Nov 08 23:19:25 user nova-compute[75045]:       <mac address="fa:16:3e:bc:05:cc"/>
Nov 08 23:19:25 user nova-compute[75045]:       <model type="virtio"/>
Nov 08 23:19:25 user nova-compute[75045]:       <mtu size="1442"/>
Nov 08 23:19:25 user nova-compute[75045]:       <target dev="tap768830de-7c"/>
Nov 08 23:19:25 user nova-compute[75045]:     </interface>
Nov 08 23:19:25 user nova-compute[75045]:     <serial type="pty">
Nov 08 23:19:25 user nova-compute[75045]:       <log file="/opt/stack/data/nova/instances/520eac4f-fa48-4e41-924d-840907e701b4/console.log" append="off"/>
Nov 08 23:19:25 user nova-compute[75045]:     </serial>
Nov 08 23:19:25 user nova-compute[75045]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 23:19:25 user nova-compute[75045]:     <video>
Nov 08 23:19:25 user nova-compute[75045]:       <model type="virtio"/>
Nov 08 23:19:25 user nova-compute[75045]:     </video>
Nov 08 23:19:25 user nova-compute[75045]:     <rng model="virtio">
Nov 08 23:19:25 user nova-compute[75045]:       <backend model="random">/dev/urandom</backend>
Nov 08 23:19:25 user nova-compute[75045]:     </rng>
Nov 08 23:19:25 user nova-compute[75045]:     <controller type="usb" index="0" model="none"/>
Nov 08 23:19:25 user nova-compute[75045]:     <memballoon model="virtio">
Nov 08 23:19:25 user nova-compute[75045]:       <stats period="10"/>
Nov 08 23:19:25 user nova-compute[75045]:     </memballoon>
Nov 08 23:19:25 user nova-compute[75045]:   </devices>
Nov 08 23:19:25 user nova-compute[75045]: </domain>
Nov 08 23:19:25 user nova-compute[75045]:  {{(pid=75045) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 23:19:25 user nova-compute[75045]: DEBUG nova.virt.libvirt.vif [None req-ac28c4dc-b349-4d76-b20f-521f64e4c39b tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T23:17:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1412524117',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1412524117',id=10,image_ref='a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIOg6qdtEUL8OwbPxHJ6siVv0HGHJ2I3WU6rXK8ahHqt76KKZ8niNHuCAGdeTPkJyNSdMmrzEWjROFsrOoC1kmaY029eK7Yz3akFrk91+1J9Sq2nrDoAG6jY9mnI91XmoQ==',key_name='tempest-keypair-1736555466',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='74ebbe44152141368b22a9a7989d577a',ramdisk_id='',reservation_id='r-mgh3rv15',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-2022931664',owner_user_name='tempest-TaggedBootDevicesTest-2022931664-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T23:17:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8c4361faf9ee4444be0e061b8c8aee98',uuid=520eac4f-fa48-4e41-924d-840907e701b4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "25776e3e-60d6-457c-a78a-a59df0e3e7b5", "address": "fa:16:3e:3e:7f:60", "network": {"id": "13af9e02-7f74-4e9c-aea7-2e6f0701b1c2", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1067175210-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74ebbe44152141368b22a9a7989d577a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25776e3e-60", "ovs_interfaceid": "25776e3e-60d6-457c-a78a-a59df0e3e7b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75045) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 23:19:25 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-ac28c4dc-b349-4d76-b20f-521f64e4c39b tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] Converting VIF {"id": "25776e3e-60d6-457c-a78a-a59df0e3e7b5", "address": "fa:16:3e:3e:7f:60", "network": {"id": "13af9e02-7f74-4e9c-aea7-2e6f0701b1c2", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1067175210-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74ebbe44152141368b22a9a7989d577a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25776e3e-60", "ovs_interfaceid": "25776e3e-60d6-457c-a78a-a59df0e3e7b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 23:19:25 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-ac28c4dc-b349-4d76-b20f-521f64e4c39b tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3e:7f:60,bridge_name='br-int',has_traffic_filtering=True,id=25776e3e-60d6-457c-a78a-a59df0e3e7b5,network=Network(13af9e02-7f74-4e9c-aea7-2e6f0701b1c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap25776e3e-60') {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 23:19:25 user nova-compute[75045]: DEBUG os_vif [None req-ac28c4dc-b349-4d76-b20f-521f64e4c39b tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3e:7f:60,bridge_name='br-int',has_traffic_filtering=True,id=25776e3e-60d6-457c-a78a-a59df0e3e7b5,network=Network(13af9e02-7f74-4e9c-aea7-2e6f0701b1c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap25776e3e-60') {{(pid=75045) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 23:19:25 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:19:25 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:19:25 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 23:19:25 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:19:25 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '723caf80-88e2-57fd-8f3b-6680d2bbbfda', '_type': 'linux-noop'}}, row=False) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:19:25 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:19:25 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 23:19:25 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:19:25 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:19:25 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap25776e3e-60, may_exist=True, interface_attrs={}) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:19:25 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap25776e3e-60, col_values=(('qos', UUID('d1a0eb86-bca2-4e64-aa94-29fd718c1312')),), if_exists=True) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:19:25 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap25776e3e-60, col_values=(('external_ids', {'iface-id': '25776e3e-60d6-457c-a78a-a59df0e3e7b5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3e:7f:60', 'vm-uuid': '520eac4f-fa48-4e41-924d-840907e701b4'}),), if_exists=True) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:19:25 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:19:25 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 23:19:25 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:19:25 user nova-compute[75045]: INFO os_vif [None req-ac28c4dc-b349-4d76-b20f-521f64e4c39b tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3e:7f:60,bridge_name='br-int',has_traffic_filtering=True,id=25776e3e-60d6-457c-a78a-a59df0e3e7b5,network=Network(13af9e02-7f74-4e9c-aea7-2e6f0701b1c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap25776e3e-60')
Nov 08 23:19:25 user nova-compute[75045]: DEBUG nova.virt.libvirt.vif [None req-ac28c4dc-b349-4d76-b20f-521f64e4c39b tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T23:17:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1412524117',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1412524117',id=10,image_ref='a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIOg6qdtEUL8OwbPxHJ6siVv0HGHJ2I3WU6rXK8ahHqt76KKZ8niNHuCAGdeTPkJyNSdMmrzEWjROFsrOoC1kmaY029eK7Yz3akFrk91+1J9Sq2nrDoAG6jY9mnI91XmoQ==',key_name='tempest-keypair-1736555466',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='74ebbe44152141368b22a9a7989d577a',ramdisk_id='',reservation_id='r-mgh3rv15',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-2022931664',owner_user_name='tempest-TaggedBootDevicesTest-2022931664-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T23:17:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8c4361faf9ee4444be0e061b8c8aee98',uuid=520eac4f-fa48-4e41-924d-840907e701b4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bcd0d9eb-775a-4e28-b712-148c1fe99521", "address": "fa:16:3e:21:f4:bc", "network": {"id": "0916556c-7a50-48cf-8ad0-56c20de9d89f", "bridge": "br-int", "label": "tempest-device-tagging-net1-573961537", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.137", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "74ebbe44152141368b22a9a7989d577a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbcd0d9eb-77", "ovs_interfaceid": "bcd0d9eb-775a-4e28-b712-148c1fe99521", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75045) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 23:19:25 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-ac28c4dc-b349-4d76-b20f-521f64e4c39b tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] Converting VIF {"id": "bcd0d9eb-775a-4e28-b712-148c1fe99521", "address": "fa:16:3e:21:f4:bc", "network": {"id": "0916556c-7a50-48cf-8ad0-56c20de9d89f", "bridge": "br-int", "label": "tempest-device-tagging-net1-573961537", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.137", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "74ebbe44152141368b22a9a7989d577a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbcd0d9eb-77", "ovs_interfaceid": "bcd0d9eb-775a-4e28-b712-148c1fe99521", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 23:19:25 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-ac28c4dc-b349-4d76-b20f-521f64e4c39b tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:21:f4:bc,bridge_name='br-int',has_traffic_filtering=True,id=bcd0d9eb-775a-4e28-b712-148c1fe99521,network=Network(0916556c-7a50-48cf-8ad0-56c20de9d89f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapbcd0d9eb-77') {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 23:19:25 user nova-compute[75045]: DEBUG os_vif [None req-ac28c4dc-b349-4d76-b20f-521f64e4c39b tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:21:f4:bc,bridge_name='br-int',has_traffic_filtering=True,id=bcd0d9eb-775a-4e28-b712-148c1fe99521,network=Network(0916556c-7a50-48cf-8ad0-56c20de9d89f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapbcd0d9eb-77') {{(pid=75045) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 23:19:25 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:19:25 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:19:25 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 23:19:25 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:19:25 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '74314e94-1270-5a2b-8c9d-a138a010399d', '_type': 'linux-noop'}}, row=False) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:19:25 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:19:25 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 23:19:25 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:19:25 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:19:25 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbcd0d9eb-77, may_exist=True, interface_attrs={}) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:19:25 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapbcd0d9eb-77, col_values=(('qos', UUID('cf69704d-56db-46f7-bc9e-a8bf45e8357e')),), if_exists=True) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:19:25 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapbcd0d9eb-77, col_values=(('external_ids', {'iface-id': 'bcd0d9eb-775a-4e28-b712-148c1fe99521', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:21:f4:bc', 'vm-uuid': '520eac4f-fa48-4e41-924d-840907e701b4'}),), if_exists=True) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:19:25 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:19:25 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 23:19:25 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:19:25 user nova-compute[75045]: INFO os_vif [None req-ac28c4dc-b349-4d76-b20f-521f64e4c39b tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:21:f4:bc,bridge_name='br-int',has_traffic_filtering=True,id=bcd0d9eb-775a-4e28-b712-148c1fe99521,network=Network(0916556c-7a50-48cf-8ad0-56c20de9d89f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapbcd0d9eb-77')
Nov 08 23:19:25 user nova-compute[75045]: DEBUG nova.virt.libvirt.vif [None req-ac28c4dc-b349-4d76-b20f-521f64e4c39b tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T23:17:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1412524117',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1412524117',id=10,image_ref='a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIOg6qdtEUL8OwbPxHJ6siVv0HGHJ2I3WU6rXK8ahHqt76KKZ8niNHuCAGdeTPkJyNSdMmrzEWjROFsrOoC1kmaY029eK7Yz3akFrk91+1J9Sq2nrDoAG6jY9mnI91XmoQ==',key_name='tempest-keypair-1736555466',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='74ebbe44152141368b22a9a7989d577a',ramdisk_id='',reservation_id='r-mgh3rv15',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-2022931664',owner_user_name='tempest-TaggedBootDevicesTest-2022931664-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T23:17:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8c4361faf9ee4444be0e061b8c8aee98',uuid=520eac4f-fa48-4e41-924d-840907e701b4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "04ae6531-75ef-4043-99f4-bfa5ef2bba59", "address": "fa:16:3e:9f:87:19", "network": {"id": "0916556c-7a50-48cf-8ad0-56c20de9d89f", "bridge": "br-int", "label": "tempest-device-tagging-net1-573961537", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.210", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "74ebbe44152141368b22a9a7989d577a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04ae6531-75", "ovs_interfaceid": "04ae6531-75ef-4043-99f4-bfa5ef2bba59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75045) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 23:19:25 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-ac28c4dc-b349-4d76-b20f-521f64e4c39b tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] Converting VIF {"id": "04ae6531-75ef-4043-99f4-bfa5ef2bba59", "address": "fa:16:3e:9f:87:19", "network": {"id": "0916556c-7a50-48cf-8ad0-56c20de9d89f", "bridge": "br-int", "label": "tempest-device-tagging-net1-573961537", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.210", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "74ebbe44152141368b22a9a7989d577a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04ae6531-75", "ovs_interfaceid": "04ae6531-75ef-4043-99f4-bfa5ef2bba59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 23:19:25 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-ac28c4dc-b349-4d76-b20f-521f64e4c39b tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9f:87:19,bridge_name='br-int',has_traffic_filtering=True,id=04ae6531-75ef-4043-99f4-bfa5ef2bba59,network=Network(0916556c-7a50-48cf-8ad0-56c20de9d89f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap04ae6531-75') {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 23:19:25 user nova-compute[75045]: DEBUG os_vif [None req-ac28c4dc-b349-4d76-b20f-521f64e4c39b tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9f:87:19,bridge_name='br-int',has_traffic_filtering=True,id=04ae6531-75ef-4043-99f4-bfa5ef2bba59,network=Network(0916556c-7a50-48cf-8ad0-56c20de9d89f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap04ae6531-75') {{(pid=75045) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 23:19:25 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:19:25 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:19:25 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 23:19:25 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:19:25 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6f9051a0-f7e5-5274-925a-5a840fff83b1', '_type': 'linux-noop'}}, row=False) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:19:25 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:19:25 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 23:19:25 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:19:25 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:19:25 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap04ae6531-75, may_exist=True, interface_attrs={}) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:19:25 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap04ae6531-75, col_values=(('qos', UUID('4478fd37-16db-4b8c-961b-46c7a3bd4350')),), if_exists=True) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:19:25 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap04ae6531-75, col_values=(('external_ids', {'iface-id': '04ae6531-75ef-4043-99f4-bfa5ef2bba59', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9f:87:19', 'vm-uuid': '520eac4f-fa48-4e41-924d-840907e701b4'}),), if_exists=True) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:19:25 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:19:25 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 23:19:25 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:19:25 user nova-compute[75045]: INFO os_vif [None req-ac28c4dc-b349-4d76-b20f-521f64e4c39b tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9f:87:19,bridge_name='br-int',has_traffic_filtering=True,id=04ae6531-75ef-4043-99f4-bfa5ef2bba59,network=Network(0916556c-7a50-48cf-8ad0-56c20de9d89f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap04ae6531-75')
Nov 08 23:19:25 user nova-compute[75045]: DEBUG nova.virt.libvirt.vif [None req-ac28c4dc-b349-4d76-b20f-521f64e4c39b tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T23:17:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1412524117',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1412524117',id=10,image_ref='a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIOg6qdtEUL8OwbPxHJ6siVv0HGHJ2I3WU6rXK8ahHqt76KKZ8niNHuCAGdeTPkJyNSdMmrzEWjROFsrOoC1kmaY029eK7Yz3akFrk91+1J9Sq2nrDoAG6jY9mnI91XmoQ==',key_name='tempest-keypair-1736555466',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='74ebbe44152141368b22a9a7989d577a',ramdisk_id='',reservation_id='r-mgh3rv15',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-2022931664',owner_user_name='tempest-TaggedBootDevicesTest-2022931664-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T23:17:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8c4361faf9ee4444be0e061b8c8aee98',uuid=520eac4f-fa48-4e41-924d-840907e701b4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b3c645dd-a1ac-4780-a49d-916cb6a121c9", "address": "fa:16:3e:e2:e6:e2", "network": {"id": "0916556c-7a50-48cf-8ad0-56c20de9d89f", "bridge": "br-int", "label": "tempest-device-tagging-net1-573961537", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.154", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "74ebbe44152141368b22a9a7989d577a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3c645dd-a1", "ovs_interfaceid": "b3c645dd-a1ac-4780-a49d-916cb6a121c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75045) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 23:19:25 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-ac28c4dc-b349-4d76-b20f-521f64e4c39b tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] Converting VIF {"id": "b3c645dd-a1ac-4780-a49d-916cb6a121c9", "address": "fa:16:3e:e2:e6:e2", "network": {"id": "0916556c-7a50-48cf-8ad0-56c20de9d89f", "bridge": "br-int", "label": "tempest-device-tagging-net1-573961537", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.154", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "74ebbe44152141368b22a9a7989d577a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3c645dd-a1", "ovs_interfaceid": "b3c645dd-a1ac-4780-a49d-916cb6a121c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 23:19:25 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-ac28c4dc-b349-4d76-b20f-521f64e4c39b tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e2:e6:e2,bridge_name='br-int',has_traffic_filtering=True,id=b3c645dd-a1ac-4780-a49d-916cb6a121c9,network=Network(0916556c-7a50-48cf-8ad0-56c20de9d89f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3c645dd-a1') {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 23:19:25 user nova-compute[75045]: DEBUG os_vif [None req-ac28c4dc-b349-4d76-b20f-521f64e4c39b tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e2:e6:e2,bridge_name='br-int',has_traffic_filtering=True,id=b3c645dd-a1ac-4780-a49d-916cb6a121c9,network=Network(0916556c-7a50-48cf-8ad0-56c20de9d89f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3c645dd-a1') {{(pid=75045) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 23:19:25 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:19:25 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:19:25 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 23:19:25 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:19:25 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ad1194c9-8cac-55e5-8145-a24bca9863ad', '_type': 'linux-noop'}}, row=False) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:19:25 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:19:25 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 23:19:25 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:19:25 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:19:25 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb3c645dd-a1, may_exist=True, interface_attrs={}) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:19:25 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb3c645dd-a1, col_values=(('qos', UUID('2bfb84be-b1f9-4a4b-976e-9209075b4a04')),), if_exists=True) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:19:25 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb3c645dd-a1, col_values=(('external_ids', {'iface-id': 'b3c645dd-a1ac-4780-a49d-916cb6a121c9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e2:e6:e2', 'vm-uuid': '520eac4f-fa48-4e41-924d-840907e701b4'}),), if_exists=True) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:19:25 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:19:25 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 23:19:25 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:19:25 user nova-compute[75045]: INFO os_vif [None req-ac28c4dc-b349-4d76-b20f-521f64e4c39b tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e2:e6:e2,bridge_name='br-int',has_traffic_filtering=True,id=b3c645dd-a1ac-4780-a49d-916cb6a121c9,network=Network(0916556c-7a50-48cf-8ad0-56c20de9d89f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3c645dd-a1')
Nov 08 23:19:25 user nova-compute[75045]: DEBUG nova.virt.libvirt.vif [None req-ac28c4dc-b349-4d76-b20f-521f64e4c39b tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T23:17:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1412524117',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1412524117',id=10,image_ref='a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIOg6qdtEUL8OwbPxHJ6siVv0HGHJ2I3WU6rXK8ahHqt76KKZ8niNHuCAGdeTPkJyNSdMmrzEWjROFsrOoC1kmaY029eK7Yz3akFrk91+1J9Sq2nrDoAG6jY9mnI91XmoQ==',key_name='tempest-keypair-1736555466',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='74ebbe44152141368b22a9a7989d577a',ramdisk_id='',reservation_id='r-mgh3rv15',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-2022931664',owner_user_name='tempest-TaggedBootDevicesTest-2022931664-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T23:17:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8c4361faf9ee4444be0e061b8c8aee98',uuid=520eac4f-fa48-4e41-924d-840907e701b4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3974ed79-74a5-4e9c-aa42-3aab1b234a39", "address": "fa:16:3e:f3:1c:29", "network": {"id": "0916556c-7a50-48cf-8ad0-56c20de9d89f", "bridge": "br-int", "label": "tempest-device-tagging-net1-573961537", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.231", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "74ebbe44152141368b22a9a7989d577a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3974ed79-74", "ovs_interfaceid": "3974ed79-74a5-4e9c-aa42-3aab1b234a39", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75045) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 23:19:25 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-ac28c4dc-b349-4d76-b20f-521f64e4c39b tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] Converting VIF {"id": "3974ed79-74a5-4e9c-aa42-3aab1b234a39", "address": "fa:16:3e:f3:1c:29", "network": {"id": "0916556c-7a50-48cf-8ad0-56c20de9d89f", "bridge": "br-int", "label": "tempest-device-tagging-net1-573961537", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.231", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "74ebbe44152141368b22a9a7989d577a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3974ed79-74", "ovs_interfaceid": "3974ed79-74a5-4e9c-aa42-3aab1b234a39", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 23:19:25 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-ac28c4dc-b349-4d76-b20f-521f64e4c39b tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f3:1c:29,bridge_name='br-int',has_traffic_filtering=True,id=3974ed79-74a5-4e9c-aa42-3aab1b234a39,network=Network(0916556c-7a50-48cf-8ad0-56c20de9d89f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3974ed79-74') {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 23:19:25 user nova-compute[75045]: DEBUG os_vif [None req-ac28c4dc-b349-4d76-b20f-521f64e4c39b tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f3:1c:29,bridge_name='br-int',has_traffic_filtering=True,id=3974ed79-74a5-4e9c-aa42-3aab1b234a39,network=Network(0916556c-7a50-48cf-8ad0-56c20de9d89f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3974ed79-74') {{(pid=75045) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 23:19:25 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:19:25 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:19:25 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 23:19:25 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:19:25 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '95c20c27-dd7f-5524-a92d-fee57c950ffe', '_type': 'linux-noop'}}, row=False) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:19:25 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:19:25 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 23:19:25 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:19:25 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:19:25 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3974ed79-74, may_exist=True, interface_attrs={}) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:19:25 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3974ed79-74, col_values=(('qos', UUID('b0901488-4a7d-4cc7-afb4-ce85d63c70c8')),), if_exists=True) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:19:25 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3974ed79-74, col_values=(('external_ids', {'iface-id': '3974ed79-74a5-4e9c-aa42-3aab1b234a39', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f3:1c:29', 'vm-uuid': '520eac4f-fa48-4e41-924d-840907e701b4'}),), if_exists=True) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:19:25 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:19:25 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 23:19:25 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:19:25 user nova-compute[75045]: INFO os_vif [None req-ac28c4dc-b349-4d76-b20f-521f64e4c39b tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f3:1c:29,bridge_name='br-int',has_traffic_filtering=True,id=3974ed79-74a5-4e9c-aa42-3aab1b234a39,network=Network(0916556c-7a50-48cf-8ad0-56c20de9d89f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3974ed79-74')
Nov 08 23:19:25 user nova-compute[75045]: DEBUG nova.virt.libvirt.vif [None req-ac28c4dc-b349-4d76-b20f-521f64e4c39b tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T23:17:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1412524117',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1412524117',id=10,image_ref='a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIOg6qdtEUL8OwbPxHJ6siVv0HGHJ2I3WU6rXK8ahHqt76KKZ8niNHuCAGdeTPkJyNSdMmrzEWjROFsrOoC1kmaY029eK7Yz3akFrk91+1J9Sq2nrDoAG6jY9mnI91XmoQ==',key_name='tempest-keypair-1736555466',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='74ebbe44152141368b22a9a7989d577a',ramdisk_id='',reservation_id='r-mgh3rv15',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-2022931664',owner_user_name='tempest-TaggedBootDevicesTest-2022931664-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T23:17:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8c4361faf9ee4444be0e061b8c8aee98',uuid=520eac4f-fa48-4e41-924d-840907e701b4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c2155ca8-d244-401d-a80f-8c53a68b6799", "address": "fa:16:3e:a2:80:a4", "network": {"id": "5cfed969-3f78-4bc2-8d08-921447c01347", "bridge": "br-int", "label": "tempest-device-tagging-net2-1614620309", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "74ebbe44152141368b22a9a7989d577a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2155ca8-d2", "ovs_interfaceid": "c2155ca8-d244-401d-a80f-8c53a68b6799", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75045) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 23:19:25 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-ac28c4dc-b349-4d76-b20f-521f64e4c39b tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] Converting VIF {"id": "c2155ca8-d244-401d-a80f-8c53a68b6799", "address": "fa:16:3e:a2:80:a4", "network": {"id": "5cfed969-3f78-4bc2-8d08-921447c01347", "bridge": "br-int", "label": "tempest-device-tagging-net2-1614620309", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "74ebbe44152141368b22a9a7989d577a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2155ca8-d2", "ovs_interfaceid": "c2155ca8-d244-401d-a80f-8c53a68b6799", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 23:19:25 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-ac28c4dc-b349-4d76-b20f-521f64e4c39b tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a2:80:a4,bridge_name='br-int',has_traffic_filtering=True,id=c2155ca8-d244-401d-a80f-8c53a68b6799,network=Network(5cfed969-3f78-4bc2-8d08-921447c01347),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc2155ca8-d2') {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 23:19:25 user nova-compute[75045]: DEBUG os_vif [None req-ac28c4dc-b349-4d76-b20f-521f64e4c39b tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a2:80:a4,bridge_name='br-int',has_traffic_filtering=True,id=c2155ca8-d244-401d-a80f-8c53a68b6799,network=Network(5cfed969-3f78-4bc2-8d08-921447c01347),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc2155ca8-d2') {{(pid=75045) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 23:19:25 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:19:25 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:19:25 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 23:19:25 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:19:25 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4290f05c-f382-5150-9e41-f445581ca075', '_type': 'linux-noop'}}, row=False) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:19:25 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:19:25 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 23:19:25 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:19:26 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:19:26 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc2155ca8-d2, may_exist=True, interface_attrs={}) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:19:26 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc2155ca8-d2, col_values=(('qos', UUID('6c688b42-17ee-497f-828d-7fd165553681')),), if_exists=True) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:19:26 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc2155ca8-d2, col_values=(('external_ids', {'iface-id': 'c2155ca8-d244-401d-a80f-8c53a68b6799', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a2:80:a4', 'vm-uuid': '520eac4f-fa48-4e41-924d-840907e701b4'}),), if_exists=True) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:19:26 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:19:26 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 23:19:26 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:19:26 user nova-compute[75045]: INFO os_vif [None req-ac28c4dc-b349-4d76-b20f-521f64e4c39b tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a2:80:a4,bridge_name='br-int',has_traffic_filtering=True,id=c2155ca8-d244-401d-a80f-8c53a68b6799,network=Network(5cfed969-3f78-4bc2-8d08-921447c01347),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc2155ca8-d2')
Nov 08 23:19:26 user nova-compute[75045]: DEBUG nova.virt.libvirt.vif [None req-ac28c4dc-b349-4d76-b20f-521f64e4c39b tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T23:17:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1412524117',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1412524117',id=10,image_ref='a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIOg6qdtEUL8OwbPxHJ6siVv0HGHJ2I3WU6rXK8ahHqt76KKZ8niNHuCAGdeTPkJyNSdMmrzEWjROFsrOoC1kmaY029eK7Yz3akFrk91+1J9Sq2nrDoAG6jY9mnI91XmoQ==',key_name='tempest-keypair-1736555466',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='74ebbe44152141368b22a9a7989d577a',ramdisk_id='',reservation_id='r-mgh3rv15',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-2022931664',owner_user_name='tempest-TaggedBootDevicesTest-2022931664-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T23:17:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8c4361faf9ee4444be0e061b8c8aee98',uuid=520eac4f-fa48-4e41-924d-840907e701b4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "768830de-7c2e-45ca-959e-398480b6ba29", "address": "fa:16:3e:bc:05:cc", "network": {"id": "5cfed969-3f78-4bc2-8d08-921447c01347", "bridge": "br-int", "label": "tempest-device-tagging-net2-1614620309", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "74ebbe44152141368b22a9a7989d577a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap768830de-7c", "ovs_interfaceid": "768830de-7c2e-45ca-959e-398480b6ba29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75045) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 23:19:26 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-ac28c4dc-b349-4d76-b20f-521f64e4c39b tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] Converting VIF {"id": "768830de-7c2e-45ca-959e-398480b6ba29", "address": "fa:16:3e:bc:05:cc", "network": {"id": "5cfed969-3f78-4bc2-8d08-921447c01347", "bridge": "br-int", "label": "tempest-device-tagging-net2-1614620309", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "74ebbe44152141368b22a9a7989d577a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap768830de-7c", "ovs_interfaceid": "768830de-7c2e-45ca-959e-398480b6ba29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 23:19:26 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-ac28c4dc-b349-4d76-b20f-521f64e4c39b tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bc:05:cc,bridge_name='br-int',has_traffic_filtering=True,id=768830de-7c2e-45ca-959e-398480b6ba29,network=Network(5cfed969-3f78-4bc2-8d08-921447c01347),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap768830de-7c') {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 23:19:26 user nova-compute[75045]: DEBUG os_vif [None req-ac28c4dc-b349-4d76-b20f-521f64e4c39b tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bc:05:cc,bridge_name='br-int',has_traffic_filtering=True,id=768830de-7c2e-45ca-959e-398480b6ba29,network=Network(5cfed969-3f78-4bc2-8d08-921447c01347),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap768830de-7c') {{(pid=75045) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 23:19:26 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:19:26 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:19:26 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 23:19:26 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:19:26 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0eab5b0d-ee83-5581-9dd4-c2626fd8b2bc', '_type': 'linux-noop'}}, row=False) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:19:26 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:19:26 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 23:19:26 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:19:26 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:19:26 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap768830de-7c, may_exist=True, interface_attrs={}) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:19:26 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap768830de-7c, col_values=(('qos', UUID('8ec7bfda-135b-45de-99e2-f7cd348d2f52')),), if_exists=True) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:19:26 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap768830de-7c, col_values=(('external_ids', {'iface-id': '768830de-7c2e-45ca-959e-398480b6ba29', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:bc:05:cc', 'vm-uuid': '520eac4f-fa48-4e41-924d-840907e701b4'}),), if_exists=True) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:19:26 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:19:26 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 23:19:26 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:19:26 user nova-compute[75045]: INFO os_vif [None req-ac28c4dc-b349-4d76-b20f-521f64e4c39b tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bc:05:cc,bridge_name='br-int',has_traffic_filtering=True,id=768830de-7c2e-45ca-959e-398480b6ba29,network=Network(5cfed969-3f78-4bc2-8d08-921447c01347),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap768830de-7c')
Nov 08 23:19:26 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-ac28c4dc-b349-4d76-b20f-521f64e4c39b tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] No BDM found with device name hda, not building metadata. {{(pid=75045) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 23:19:26 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-ac28c4dc-b349-4d76-b20f-521f64e4c39b tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75045) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 23:19:26 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-ac28c4dc-b349-4d76-b20f-521f64e4c39b tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] No VIF found with MAC fa:16:3e:3e:7f:60, not building metadata {{(pid=75045) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 23:19:26 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-ac28c4dc-b349-4d76-b20f-521f64e4c39b tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] No VIF found with MAC fa:16:3e:f3:1c:29, not building metadata {{(pid=75045) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 23:19:26 user nova-compute[75045]: INFO nova.virt.libvirt.driver [None req-ac28c4dc-b349-4d76-b20f-521f64e4c39b tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] [instance: 520eac4f-fa48-4e41-924d-840907e701b4] Using config drive
Nov 08 23:19:26 user nova-compute[75045]: INFO nova.virt.libvirt.driver [None req-ac28c4dc-b349-4d76-b20f-521f64e4c39b tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] [instance: 520eac4f-fa48-4e41-924d-840907e701b4] Creating config drive at /opt/stack/data/nova/instances/520eac4f-fa48-4e41-924d-840907e701b4/disk.config
Nov 08 23:19:26 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-ac28c4dc-b349-4d76-b20f-521f64e4c39b tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/520eac4f-fa48-4e41-924d-840907e701b4/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpnrf6_wzm {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:19:26 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-ac28c4dc-b349-4d76-b20f-521f64e4c39b tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/520eac4f-fa48-4e41-924d-840907e701b4/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpnrf6_wzm" returned: 0 in 0.058s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:19:27 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:19:27 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:19:28 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:19:28 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:19:28 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:19:28 user nova-compute[75045]: DEBUG nova.compute.manager [req-4614cb7e-852e-42a4-ae7d-183372153086 req-ac539149-febe-4d06-aac5-ad68b0d48e74 service nova] [instance: 520eac4f-fa48-4e41-924d-840907e701b4] Received event network-vif-plugged-25776e3e-60d6-457c-a78a-a59df0e3e7b5 {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:19:28 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-4614cb7e-852e-42a4-ae7d-183372153086 req-ac539149-febe-4d06-aac5-ad68b0d48e74 service nova] Acquiring lock "520eac4f-fa48-4e41-924d-840907e701b4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:19:28 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-4614cb7e-852e-42a4-ae7d-183372153086 req-ac539149-febe-4d06-aac5-ad68b0d48e74 service nova] Lock "520eac4f-fa48-4e41-924d-840907e701b4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:19:28 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-4614cb7e-852e-42a4-ae7d-183372153086 req-ac539149-febe-4d06-aac5-ad68b0d48e74 service nova] Lock "520eac4f-fa48-4e41-924d-840907e701b4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:19:28 user nova-compute[75045]: DEBUG nova.compute.manager [req-4614cb7e-852e-42a4-ae7d-183372153086 req-ac539149-febe-4d06-aac5-ad68b0d48e74 service nova] [instance: 520eac4f-fa48-4e41-924d-840907e701b4] No waiting events found dispatching network-vif-plugged-25776e3e-60d6-457c-a78a-a59df0e3e7b5 {{(pid=75045) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 23:19:28 user nova-compute[75045]: WARNING nova.compute.manager [req-4614cb7e-852e-42a4-ae7d-183372153086 req-ac539149-febe-4d06-aac5-ad68b0d48e74 service nova] [instance: 520eac4f-fa48-4e41-924d-840907e701b4] Received unexpected event network-vif-plugged-25776e3e-60d6-457c-a78a-a59df0e3e7b5 for instance with vm_state building and task_state spawning.
Nov 08 23:19:28 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:19:28 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:19:28 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:19:28 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:19:28 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:19:28 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:19:28 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:19:28 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:19:29 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:19:29 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:19:29 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:19:29 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:19:29 user nova-compute[75045]: DEBUG nova.compute.manager [req-f2913d8a-f285-44b0-8a9e-c515b375452a req-c2dbbe65-4e13-478e-b83b-1f9858a69c9f service nova] [instance: 520eac4f-fa48-4e41-924d-840907e701b4] Received event network-vif-plugged-b3c645dd-a1ac-4780-a49d-916cb6a121c9 {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:19:29 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-f2913d8a-f285-44b0-8a9e-c515b375452a req-c2dbbe65-4e13-478e-b83b-1f9858a69c9f service nova] Acquiring lock "520eac4f-fa48-4e41-924d-840907e701b4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:19:29 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-f2913d8a-f285-44b0-8a9e-c515b375452a req-c2dbbe65-4e13-478e-b83b-1f9858a69c9f service nova] Lock "520eac4f-fa48-4e41-924d-840907e701b4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:19:29 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-f2913d8a-f285-44b0-8a9e-c515b375452a req-c2dbbe65-4e13-478e-b83b-1f9858a69c9f service nova] Lock "520eac4f-fa48-4e41-924d-840907e701b4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:19:29 user nova-compute[75045]: DEBUG nova.compute.manager [req-f2913d8a-f285-44b0-8a9e-c515b375452a req-c2dbbe65-4e13-478e-b83b-1f9858a69c9f service nova] [instance: 520eac4f-fa48-4e41-924d-840907e701b4] No waiting events found dispatching network-vif-plugged-b3c645dd-a1ac-4780-a49d-916cb6a121c9 {{(pid=75045) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 23:19:29 user nova-compute[75045]: WARNING nova.compute.manager [req-f2913d8a-f285-44b0-8a9e-c515b375452a req-c2dbbe65-4e13-478e-b83b-1f9858a69c9f service nova] [instance: 520eac4f-fa48-4e41-924d-840907e701b4] Received unexpected event network-vif-plugged-b3c645dd-a1ac-4780-a49d-916cb6a121c9 for instance with vm_state building and task_state spawning.
Nov 08 23:19:29 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:19:29 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:19:29 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:19:29 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:19:29 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:19:29 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:19:29 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:19:29 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:19:29 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:19:29 user nova-compute[75045]: DEBUG nova.compute.manager [req-5b2d2cb5-6c95-4070-9fff-5900c8f7612a req-a4699e63-9142-46f0-94c2-0824c76d33d4 service nova] [instance: 520eac4f-fa48-4e41-924d-840907e701b4] Received event network-vif-plugged-3974ed79-74a5-4e9c-aa42-3aab1b234a39 {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:19:29 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-5b2d2cb5-6c95-4070-9fff-5900c8f7612a req-a4699e63-9142-46f0-94c2-0824c76d33d4 service nova] Acquiring lock "520eac4f-fa48-4e41-924d-840907e701b4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:19:29 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-5b2d2cb5-6c95-4070-9fff-5900c8f7612a req-a4699e63-9142-46f0-94c2-0824c76d33d4 service nova] Lock "520eac4f-fa48-4e41-924d-840907e701b4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:19:29 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-5b2d2cb5-6c95-4070-9fff-5900c8f7612a req-a4699e63-9142-46f0-94c2-0824c76d33d4 service nova] Lock "520eac4f-fa48-4e41-924d-840907e701b4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:19:29 user nova-compute[75045]: DEBUG nova.compute.manager [req-5b2d2cb5-6c95-4070-9fff-5900c8f7612a req-a4699e63-9142-46f0-94c2-0824c76d33d4 service nova] [instance: 520eac4f-fa48-4e41-924d-840907e701b4] No waiting events found dispatching network-vif-plugged-3974ed79-74a5-4e9c-aa42-3aab1b234a39 {{(pid=75045) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 23:19:29 user nova-compute[75045]: WARNING nova.compute.manager [req-5b2d2cb5-6c95-4070-9fff-5900c8f7612a req-a4699e63-9142-46f0-94c2-0824c76d33d4 service nova] [instance: 520eac4f-fa48-4e41-924d-840907e701b4] Received unexpected event network-vif-plugged-3974ed79-74a5-4e9c-aa42-3aab1b234a39 for instance with vm_state building and task_state spawning.
Nov 08 23:19:29 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:19:29 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:19:29 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:19:29 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:19:29 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:19:30 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:19:30 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:19:30 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:19:30 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:19:30 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:19:30 user nova-compute[75045]: DEBUG nova.compute.manager [req-5508ec48-7c5d-40da-9c96-5692b63f0f81 req-611415ff-a9c6-461d-ab1b-b646f81130ba service nova] [instance: 520eac4f-fa48-4e41-924d-840907e701b4] Received event network-vif-plugged-25776e3e-60d6-457c-a78a-a59df0e3e7b5 {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:19:30 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-5508ec48-7c5d-40da-9c96-5692b63f0f81 req-611415ff-a9c6-461d-ab1b-b646f81130ba service nova] Acquiring lock "520eac4f-fa48-4e41-924d-840907e701b4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:19:30 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-5508ec48-7c5d-40da-9c96-5692b63f0f81 req-611415ff-a9c6-461d-ab1b-b646f81130ba service nova] Lock "520eac4f-fa48-4e41-924d-840907e701b4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:19:30 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-5508ec48-7c5d-40da-9c96-5692b63f0f81 req-611415ff-a9c6-461d-ab1b-b646f81130ba service nova] Lock "520eac4f-fa48-4e41-924d-840907e701b4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:19:30 user nova-compute[75045]: DEBUG nova.compute.manager [req-5508ec48-7c5d-40da-9c96-5692b63f0f81 req-611415ff-a9c6-461d-ab1b-b646f81130ba service nova] [instance: 520eac4f-fa48-4e41-924d-840907e701b4] No waiting events found dispatching network-vif-plugged-25776e3e-60d6-457c-a78a-a59df0e3e7b5 {{(pid=75045) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 23:19:30 user nova-compute[75045]: WARNING nova.compute.manager [req-5508ec48-7c5d-40da-9c96-5692b63f0f81 req-611415ff-a9c6-461d-ab1b-b646f81130ba service nova] [instance: 520eac4f-fa48-4e41-924d-840907e701b4] Received unexpected event network-vif-plugged-25776e3e-60d6-457c-a78a-a59df0e3e7b5 for instance with vm_state building and task_state spawning.
Nov 08 23:19:30 user nova-compute[75045]: DEBUG nova.compute.manager [req-5508ec48-7c5d-40da-9c96-5692b63f0f81 req-611415ff-a9c6-461d-ab1b-b646f81130ba service nova] [instance: 520eac4f-fa48-4e41-924d-840907e701b4] Received event network-vif-plugged-bcd0d9eb-775a-4e28-b712-148c1fe99521 {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:19:30 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-5508ec48-7c5d-40da-9c96-5692b63f0f81 req-611415ff-a9c6-461d-ab1b-b646f81130ba service nova] Acquiring lock "520eac4f-fa48-4e41-924d-840907e701b4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:19:30 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-5508ec48-7c5d-40da-9c96-5692b63f0f81 req-611415ff-a9c6-461d-ab1b-b646f81130ba service nova] Lock "520eac4f-fa48-4e41-924d-840907e701b4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:19:30 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-5508ec48-7c5d-40da-9c96-5692b63f0f81 req-611415ff-a9c6-461d-ab1b-b646f81130ba service nova] Lock "520eac4f-fa48-4e41-924d-840907e701b4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:19:30 user nova-compute[75045]: DEBUG nova.compute.manager [req-5508ec48-7c5d-40da-9c96-5692b63f0f81 req-611415ff-a9c6-461d-ab1b-b646f81130ba service nova] [instance: 520eac4f-fa48-4e41-924d-840907e701b4] No waiting events found dispatching network-vif-plugged-bcd0d9eb-775a-4e28-b712-148c1fe99521 {{(pid=75045) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 23:19:30 user nova-compute[75045]: WARNING nova.compute.manager [req-5508ec48-7c5d-40da-9c96-5692b63f0f81 req-611415ff-a9c6-461d-ab1b-b646f81130ba service nova] [instance: 520eac4f-fa48-4e41-924d-840907e701b4] Received unexpected event network-vif-plugged-bcd0d9eb-775a-4e28-b712-148c1fe99521 for instance with vm_state building and task_state spawning.
Nov 08 23:19:30 user nova-compute[75045]: DEBUG nova.compute.manager [req-5508ec48-7c5d-40da-9c96-5692b63f0f81 req-611415ff-a9c6-461d-ab1b-b646f81130ba service nova] [instance: 520eac4f-fa48-4e41-924d-840907e701b4] Received event network-vif-plugged-bcd0d9eb-775a-4e28-b712-148c1fe99521 {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:19:30 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-5508ec48-7c5d-40da-9c96-5692b63f0f81 req-611415ff-a9c6-461d-ab1b-b646f81130ba service nova] Acquiring lock "520eac4f-fa48-4e41-924d-840907e701b4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:19:30 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-5508ec48-7c5d-40da-9c96-5692b63f0f81 req-611415ff-a9c6-461d-ab1b-b646f81130ba service nova] Lock "520eac4f-fa48-4e41-924d-840907e701b4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:19:30 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-5508ec48-7c5d-40da-9c96-5692b63f0f81 req-611415ff-a9c6-461d-ab1b-b646f81130ba service nova] Lock "520eac4f-fa48-4e41-924d-840907e701b4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:19:30 user nova-compute[75045]: DEBUG nova.compute.manager [req-5508ec48-7c5d-40da-9c96-5692b63f0f81 req-611415ff-a9c6-461d-ab1b-b646f81130ba service nova] [instance: 520eac4f-fa48-4e41-924d-840907e701b4] No waiting events found dispatching network-vif-plugged-bcd0d9eb-775a-4e28-b712-148c1fe99521 {{(pid=75045) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 23:19:30 user nova-compute[75045]: WARNING nova.compute.manager [req-5508ec48-7c5d-40da-9c96-5692b63f0f81 req-611415ff-a9c6-461d-ab1b-b646f81130ba service nova] [instance: 520eac4f-fa48-4e41-924d-840907e701b4] Received unexpected event network-vif-plugged-bcd0d9eb-775a-4e28-b712-148c1fe99521 for instance with vm_state building and task_state spawning.
Nov 08 23:19:30 user nova-compute[75045]: DEBUG nova.compute.manager [req-5508ec48-7c5d-40da-9c96-5692b63f0f81 req-611415ff-a9c6-461d-ab1b-b646f81130ba service nova] [instance: 520eac4f-fa48-4e41-924d-840907e701b4] Received event network-vif-plugged-04ae6531-75ef-4043-99f4-bfa5ef2bba59 {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:19:30 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-5508ec48-7c5d-40da-9c96-5692b63f0f81 req-611415ff-a9c6-461d-ab1b-b646f81130ba service nova] Acquiring lock "520eac4f-fa48-4e41-924d-840907e701b4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:19:30 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-5508ec48-7c5d-40da-9c96-5692b63f0f81 req-611415ff-a9c6-461d-ab1b-b646f81130ba service nova] Lock "520eac4f-fa48-4e41-924d-840907e701b4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:19:30 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-5508ec48-7c5d-40da-9c96-5692b63f0f81 req-611415ff-a9c6-461d-ab1b-b646f81130ba service nova] Lock "520eac4f-fa48-4e41-924d-840907e701b4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:19:30 user nova-compute[75045]: DEBUG nova.compute.manager [req-5508ec48-7c5d-40da-9c96-5692b63f0f81 req-611415ff-a9c6-461d-ab1b-b646f81130ba service nova] [instance: 520eac4f-fa48-4e41-924d-840907e701b4] No waiting events found dispatching network-vif-plugged-04ae6531-75ef-4043-99f4-bfa5ef2bba59 {{(pid=75045) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 23:19:30 user nova-compute[75045]: WARNING nova.compute.manager [req-5508ec48-7c5d-40da-9c96-5692b63f0f81 req-611415ff-a9c6-461d-ab1b-b646f81130ba service nova] [instance: 520eac4f-fa48-4e41-924d-840907e701b4] Received unexpected event network-vif-plugged-04ae6531-75ef-4043-99f4-bfa5ef2bba59 for instance with vm_state building and task_state spawning.
Nov 08 23:19:30 user nova-compute[75045]: DEBUG nova.compute.manager [req-5508ec48-7c5d-40da-9c96-5692b63f0f81 req-611415ff-a9c6-461d-ab1b-b646f81130ba service nova] [instance: 520eac4f-fa48-4e41-924d-840907e701b4] Received event network-vif-plugged-04ae6531-75ef-4043-99f4-bfa5ef2bba59 {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:19:30 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-5508ec48-7c5d-40da-9c96-5692b63f0f81 req-611415ff-a9c6-461d-ab1b-b646f81130ba service nova] Acquiring lock "520eac4f-fa48-4e41-924d-840907e701b4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:19:30 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-5508ec48-7c5d-40da-9c96-5692b63f0f81 req-611415ff-a9c6-461d-ab1b-b646f81130ba service nova] Lock "520eac4f-fa48-4e41-924d-840907e701b4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:19:30 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-5508ec48-7c5d-40da-9c96-5692b63f0f81 req-611415ff-a9c6-461d-ab1b-b646f81130ba service nova] Lock "520eac4f-fa48-4e41-924d-840907e701b4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:19:30 user nova-compute[75045]: DEBUG nova.compute.manager [req-5508ec48-7c5d-40da-9c96-5692b63f0f81 req-611415ff-a9c6-461d-ab1b-b646f81130ba service nova] [instance: 520eac4f-fa48-4e41-924d-840907e701b4] No waiting events found dispatching network-vif-plugged-04ae6531-75ef-4043-99f4-bfa5ef2bba59 {{(pid=75045) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 23:19:30 user nova-compute[75045]: WARNING nova.compute.manager [req-5508ec48-7c5d-40da-9c96-5692b63f0f81 req-611415ff-a9c6-461d-ab1b-b646f81130ba service nova] [instance: 520eac4f-fa48-4e41-924d-840907e701b4] Received unexpected event network-vif-plugged-04ae6531-75ef-4043-99f4-bfa5ef2bba59 for instance with vm_state building and task_state spawning.
Nov 08 23:19:30 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:19:30 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:19:31 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:19:31 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:19:31 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:19:31 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:19:31 user nova-compute[75045]: DEBUG nova.compute.manager [req-55271c49-4969-44c1-9919-f6c2310137e4 req-36544b6e-9c8e-4d32-83f5-7e803fe83ee7 service nova] [instance: 520eac4f-fa48-4e41-924d-840907e701b4] Received event network-vif-plugged-b3c645dd-a1ac-4780-a49d-916cb6a121c9 {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:19:31 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-55271c49-4969-44c1-9919-f6c2310137e4 req-36544b6e-9c8e-4d32-83f5-7e803fe83ee7 service nova] Acquiring lock "520eac4f-fa48-4e41-924d-840907e701b4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:19:31 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-55271c49-4969-44c1-9919-f6c2310137e4 req-36544b6e-9c8e-4d32-83f5-7e803fe83ee7 service nova] Lock "520eac4f-fa48-4e41-924d-840907e701b4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:19:31 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-55271c49-4969-44c1-9919-f6c2310137e4 req-36544b6e-9c8e-4d32-83f5-7e803fe83ee7 service nova] Lock "520eac4f-fa48-4e41-924d-840907e701b4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:19:31 user nova-compute[75045]: DEBUG nova.compute.manager [req-55271c49-4969-44c1-9919-f6c2310137e4 req-36544b6e-9c8e-4d32-83f5-7e803fe83ee7 service nova] [instance: 520eac4f-fa48-4e41-924d-840907e701b4] No waiting events found dispatching network-vif-plugged-b3c645dd-a1ac-4780-a49d-916cb6a121c9 {{(pid=75045) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 23:19:31 user nova-compute[75045]: WARNING nova.compute.manager [req-55271c49-4969-44c1-9919-f6c2310137e4 req-36544b6e-9c8e-4d32-83f5-7e803fe83ee7 service nova] [instance: 520eac4f-fa48-4e41-924d-840907e701b4] Received unexpected event network-vif-plugged-b3c645dd-a1ac-4780-a49d-916cb6a121c9 for instance with vm_state building and task_state spawning.
Nov 08 23:19:31 user nova-compute[75045]: DEBUG nova.compute.manager [req-55271c49-4969-44c1-9919-f6c2310137e4 req-36544b6e-9c8e-4d32-83f5-7e803fe83ee7 service nova] [instance: 520eac4f-fa48-4e41-924d-840907e701b4] Received event network-vif-plugged-c2155ca8-d244-401d-a80f-8c53a68b6799 {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:19:31 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-55271c49-4969-44c1-9919-f6c2310137e4 req-36544b6e-9c8e-4d32-83f5-7e803fe83ee7 service nova] Acquiring lock "520eac4f-fa48-4e41-924d-840907e701b4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:19:31 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-55271c49-4969-44c1-9919-f6c2310137e4 req-36544b6e-9c8e-4d32-83f5-7e803fe83ee7 service nova] Lock "520eac4f-fa48-4e41-924d-840907e701b4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:19:31 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-55271c49-4969-44c1-9919-f6c2310137e4 req-36544b6e-9c8e-4d32-83f5-7e803fe83ee7 service nova] Lock "520eac4f-fa48-4e41-924d-840907e701b4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:19:31 user nova-compute[75045]: DEBUG nova.compute.manager [req-55271c49-4969-44c1-9919-f6c2310137e4 req-36544b6e-9c8e-4d32-83f5-7e803fe83ee7 service nova] [instance: 520eac4f-fa48-4e41-924d-840907e701b4] No waiting events found dispatching network-vif-plugged-c2155ca8-d244-401d-a80f-8c53a68b6799 {{(pid=75045) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 23:19:31 user nova-compute[75045]: WARNING nova.compute.manager [req-55271c49-4969-44c1-9919-f6c2310137e4 req-36544b6e-9c8e-4d32-83f5-7e803fe83ee7 service nova] [instance: 520eac4f-fa48-4e41-924d-840907e701b4] Received unexpected event network-vif-plugged-c2155ca8-d244-401d-a80f-8c53a68b6799 for instance with vm_state building and task_state spawning.
Nov 08 23:19:31 user nova-compute[75045]: DEBUG nova.compute.manager [req-55271c49-4969-44c1-9919-f6c2310137e4 req-36544b6e-9c8e-4d32-83f5-7e803fe83ee7 service nova] [instance: 520eac4f-fa48-4e41-924d-840907e701b4] Received event network-vif-plugged-c2155ca8-d244-401d-a80f-8c53a68b6799 {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:19:31 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-55271c49-4969-44c1-9919-f6c2310137e4 req-36544b6e-9c8e-4d32-83f5-7e803fe83ee7 service nova] Acquiring lock "520eac4f-fa48-4e41-924d-840907e701b4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:19:31 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-55271c49-4969-44c1-9919-f6c2310137e4 req-36544b6e-9c8e-4d32-83f5-7e803fe83ee7 service nova] Lock "520eac4f-fa48-4e41-924d-840907e701b4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:19:31 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-55271c49-4969-44c1-9919-f6c2310137e4 req-36544b6e-9c8e-4d32-83f5-7e803fe83ee7 service nova] Lock "520eac4f-fa48-4e41-924d-840907e701b4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:19:31 user nova-compute[75045]: DEBUG nova.compute.manager [req-55271c49-4969-44c1-9919-f6c2310137e4 req-36544b6e-9c8e-4d32-83f5-7e803fe83ee7 service nova] [instance: 520eac4f-fa48-4e41-924d-840907e701b4] No waiting events found dispatching network-vif-plugged-c2155ca8-d244-401d-a80f-8c53a68b6799 {{(pid=75045) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 23:19:31 user nova-compute[75045]: WARNING nova.compute.manager [req-55271c49-4969-44c1-9919-f6c2310137e4 req-36544b6e-9c8e-4d32-83f5-7e803fe83ee7 service nova] [instance: 520eac4f-fa48-4e41-924d-840907e701b4] Received unexpected event network-vif-plugged-c2155ca8-d244-401d-a80f-8c53a68b6799 for instance with vm_state building and task_state spawning.
Nov 08 23:19:31 user nova-compute[75045]: DEBUG nova.compute.manager [req-55271c49-4969-44c1-9919-f6c2310137e4 req-36544b6e-9c8e-4d32-83f5-7e803fe83ee7 service nova] [instance: 520eac4f-fa48-4e41-924d-840907e701b4] Received event network-vif-plugged-768830de-7c2e-45ca-959e-398480b6ba29 {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:19:31 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-55271c49-4969-44c1-9919-f6c2310137e4 req-36544b6e-9c8e-4d32-83f5-7e803fe83ee7 service nova] Acquiring lock "520eac4f-fa48-4e41-924d-840907e701b4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:19:31 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-55271c49-4969-44c1-9919-f6c2310137e4 req-36544b6e-9c8e-4d32-83f5-7e803fe83ee7 service nova] Lock "520eac4f-fa48-4e41-924d-840907e701b4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:19:31 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-55271c49-4969-44c1-9919-f6c2310137e4 req-36544b6e-9c8e-4d32-83f5-7e803fe83ee7 service nova] Lock "520eac4f-fa48-4e41-924d-840907e701b4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:19:31 user nova-compute[75045]: DEBUG nova.compute.manager [req-55271c49-4969-44c1-9919-f6c2310137e4 req-36544b6e-9c8e-4d32-83f5-7e803fe83ee7 service nova] [instance: 520eac4f-fa48-4e41-924d-840907e701b4] No waiting events found dispatching network-vif-plugged-768830de-7c2e-45ca-959e-398480b6ba29 {{(pid=75045) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 23:19:31 user nova-compute[75045]: WARNING nova.compute.manager [req-55271c49-4969-44c1-9919-f6c2310137e4 req-36544b6e-9c8e-4d32-83f5-7e803fe83ee7 service nova] [instance: 520eac4f-fa48-4e41-924d-840907e701b4] Received unexpected event network-vif-plugged-768830de-7c2e-45ca-959e-398480b6ba29 for instance with vm_state building and task_state spawning.
Nov 08 23:19:31 user nova-compute[75045]: DEBUG nova.compute.manager [req-55271c49-4969-44c1-9919-f6c2310137e4 req-36544b6e-9c8e-4d32-83f5-7e803fe83ee7 service nova] [instance: 520eac4f-fa48-4e41-924d-840907e701b4] Received event network-vif-plugged-768830de-7c2e-45ca-959e-398480b6ba29 {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:19:31 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-55271c49-4969-44c1-9919-f6c2310137e4 req-36544b6e-9c8e-4d32-83f5-7e803fe83ee7 service nova] Acquiring lock "520eac4f-fa48-4e41-924d-840907e701b4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:19:31 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-55271c49-4969-44c1-9919-f6c2310137e4 req-36544b6e-9c8e-4d32-83f5-7e803fe83ee7 service nova] Lock "520eac4f-fa48-4e41-924d-840907e701b4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:19:31 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-55271c49-4969-44c1-9919-f6c2310137e4 req-36544b6e-9c8e-4d32-83f5-7e803fe83ee7 service nova] Lock "520eac4f-fa48-4e41-924d-840907e701b4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:19:31 user nova-compute[75045]: DEBUG nova.compute.manager [req-55271c49-4969-44c1-9919-f6c2310137e4 req-36544b6e-9c8e-4d32-83f5-7e803fe83ee7 service nova] [instance: 520eac4f-fa48-4e41-924d-840907e701b4] No waiting events found dispatching network-vif-plugged-768830de-7c2e-45ca-959e-398480b6ba29 {{(pid=75045) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 23:19:31 user nova-compute[75045]: WARNING nova.compute.manager [req-55271c49-4969-44c1-9919-f6c2310137e4 req-36544b6e-9c8e-4d32-83f5-7e803fe83ee7 service nova] [instance: 520eac4f-fa48-4e41-924d-840907e701b4] Received unexpected event network-vif-plugged-768830de-7c2e-45ca-959e-398480b6ba29 for instance with vm_state building and task_state spawning.
Nov 08 23:19:31 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:19:31 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:19:31 user nova-compute[75045]: DEBUG nova.compute.manager [req-4c60bf63-ca07-4f49-8ea2-786c782121be req-7418a2d1-3451-427b-81ba-6d4783844722 service nova] [instance: 520eac4f-fa48-4e41-924d-840907e701b4] Received event network-vif-plugged-3974ed79-74a5-4e9c-aa42-3aab1b234a39 {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:19:31 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-4c60bf63-ca07-4f49-8ea2-786c782121be req-7418a2d1-3451-427b-81ba-6d4783844722 service nova] Acquiring lock "520eac4f-fa48-4e41-924d-840907e701b4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:19:31 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-4c60bf63-ca07-4f49-8ea2-786c782121be req-7418a2d1-3451-427b-81ba-6d4783844722 service nova] Lock "520eac4f-fa48-4e41-924d-840907e701b4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:19:31 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-4c60bf63-ca07-4f49-8ea2-786c782121be req-7418a2d1-3451-427b-81ba-6d4783844722 service nova] Lock "520eac4f-fa48-4e41-924d-840907e701b4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:19:31 user nova-compute[75045]: DEBUG nova.compute.manager [req-4c60bf63-ca07-4f49-8ea2-786c782121be req-7418a2d1-3451-427b-81ba-6d4783844722 service nova] [instance: 520eac4f-fa48-4e41-924d-840907e701b4] No waiting events found dispatching network-vif-plugged-3974ed79-74a5-4e9c-aa42-3aab1b234a39 {{(pid=75045) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 23:19:31 user nova-compute[75045]: WARNING nova.compute.manager [req-4c60bf63-ca07-4f49-8ea2-786c782121be req-7418a2d1-3451-427b-81ba-6d4783844722 service nova] [instance: 520eac4f-fa48-4e41-924d-840907e701b4] Received unexpected event network-vif-plugged-3974ed79-74a5-4e9c-aa42-3aab1b234a39 for instance with vm_state building and task_state spawning.
Nov 08 23:19:31 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:19:31 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:19:32 user nova-compute[75045]: DEBUG nova.compute.manager [None req-ac28c4dc-b349-4d76-b20f-521f64e4c39b tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] [instance: 520eac4f-fa48-4e41-924d-840907e701b4] Instance event wait completed in 0 seconds for  {{(pid=75045) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 23:19:32 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-ac28c4dc-b349-4d76-b20f-521f64e4c39b tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] [instance: 520eac4f-fa48-4e41-924d-840907e701b4] Guest created on hypervisor {{(pid=75045) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 23:19:32 user nova-compute[75045]: INFO nova.virt.libvirt.driver [-] [instance: 520eac4f-fa48-4e41-924d-840907e701b4] Instance spawned successfully.
Nov 08 23:19:32 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-ac28c4dc-b349-4d76-b20f-521f64e4c39b tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] [instance: 520eac4f-fa48-4e41-924d-840907e701b4] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75045) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 23:19:32 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-ac28c4dc-b349-4d76-b20f-521f64e4c39b tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] [instance: 520eac4f-fa48-4e41-924d-840907e701b4] Found default for hw_cdrom_bus of ide {{(pid=75045) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 23:19:32 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-ac28c4dc-b349-4d76-b20f-521f64e4c39b tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] [instance: 520eac4f-fa48-4e41-924d-840907e701b4] Found default for hw_disk_bus of virtio {{(pid=75045) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 23:19:32 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-ac28c4dc-b349-4d76-b20f-521f64e4c39b tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] [instance: 520eac4f-fa48-4e41-924d-840907e701b4] Found default for hw_input_bus of None {{(pid=75045) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 23:19:32 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-ac28c4dc-b349-4d76-b20f-521f64e4c39b tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] [instance: 520eac4f-fa48-4e41-924d-840907e701b4] Found default for hw_pointer_model of None {{(pid=75045) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 23:19:32 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-ac28c4dc-b349-4d76-b20f-521f64e4c39b tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] [instance: 520eac4f-fa48-4e41-924d-840907e701b4] Found default for hw_video_model of virtio {{(pid=75045) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 23:19:32 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-ac28c4dc-b349-4d76-b20f-521f64e4c39b tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] [instance: 520eac4f-fa48-4e41-924d-840907e701b4] Found default for hw_vif_model of virtio {{(pid=75045) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 23:19:32 user nova-compute[75045]: INFO nova.compute.manager [None req-ac28c4dc-b349-4d76-b20f-521f64e4c39b tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] [instance: 520eac4f-fa48-4e41-924d-840907e701b4] Took 12.65 seconds to spawn the instance on the hypervisor.
Nov 08 23:19:32 user nova-compute[75045]: DEBUG nova.compute.manager [None req-ac28c4dc-b349-4d76-b20f-521f64e4c39b tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] [instance: 520eac4f-fa48-4e41-924d-840907e701b4] Checking state {{(pid=75045) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 23:19:32 user nova-compute[75045]: INFO nova.compute.manager [None req-ac28c4dc-b349-4d76-b20f-521f64e4c39b tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] [instance: 520eac4f-fa48-4e41-924d-840907e701b4] Took 126.52 seconds to build instance.
Nov 08 23:19:32 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-ac28c4dc-b349-4d76-b20f-521f64e4c39b tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] Lock "520eac4f-fa48-4e41-924d-840907e701b4" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 126.633s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:19:32 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:19:32 user nova-compute[75045]: DEBUG nova.compute.manager [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Starting heal instance info cache {{(pid=75045) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 23:19:33 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Acquiring lock "refresh_cache-b9bd3096-92eb-4aae-8619-2725ed9acc2b" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 23:19:33 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Acquired lock "refresh_cache-b9bd3096-92eb-4aae-8619-2725ed9acc2b" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 23:19:33 user nova-compute[75045]: DEBUG nova.network.neutron [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] [instance: b9bd3096-92eb-4aae-8619-2725ed9acc2b] Forcefully refreshing network info cache for instance {{(pid=75045) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 23:19:33 user nova-compute[75045]: DEBUG nova.network.neutron [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] [instance: b9bd3096-92eb-4aae-8619-2725ed9acc2b] Updating instance_info_cache with network_info: [{"id": "aea70d63-158f-4f6e-ac36-1c342bd5be4d", "address": "fa:16:3e:1e:64:12", "network": {"id": "c4c4a0db-a673-4145-852d-5ab102a81bf9", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-993346983-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.169", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8623aaa12b0b44928ef7391a460fcfe7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaea70d63-15", "ovs_interfaceid": "aea70d63-158f-4f6e-ac36-1c342bd5be4d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75045) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 23:19:33 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Releasing lock "refresh_cache-b9bd3096-92eb-4aae-8619-2725ed9acc2b" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 23:19:33 user nova-compute[75045]: DEBUG nova.compute.manager [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] [instance: b9bd3096-92eb-4aae-8619-2725ed9acc2b] Updated the network info_cache for instance {{(pid=75045) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 23:19:33 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager.update_available_resource {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:19:33 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:19:33 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:19:33 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:19:33 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Auditing locally available compute resources for user (node: user) {{(pid=75045) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 23:19:34 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82bc5fd0-26c7-4f81-b966-54831393b617/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:19:34 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82bc5fd0-26c7-4f81-b966-54831393b617/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:19:34 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82bc5fd0-26c7-4f81-b966-54831393b617/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:19:34 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82bc5fd0-26c7-4f81-b966-54831393b617/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:19:34 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ae5ff6b-6f2c-4dfd-a4c6-da4809e2cf27/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:19:34 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ae5ff6b-6f2c-4dfd-a4c6-da4809e2cf27/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:19:34 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ae5ff6b-6f2c-4dfd-a4c6-da4809e2cf27/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:19:34 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ae5ff6b-6f2c-4dfd-a4c6-da4809e2cf27/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:19:34 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1cb1b440-0073-4a53-a0a2-e2781e021866/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:19:34 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1cb1b440-0073-4a53-a0a2-e2781e021866/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:19:34 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1cb1b440-0073-4a53-a0a2-e2781e021866/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:19:35 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1cb1b440-0073-4a53-a0a2-e2781e021866/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:19:35 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=75045) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 23:19:35 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f21fcd3-ac5f-499e-9c34-82af806fda1d/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:19:35 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f21fcd3-ac5f-499e-9c34-82af806fda1d/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:19:35 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f21fcd3-ac5f-499e-9c34-82af806fda1d/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:19:35 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f21fcd3-ac5f-499e-9c34-82af806fda1d/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:19:35 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07ec2c05-aaa9-46e8-8439-7aa5b9fca19d/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:19:35 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:19:35 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07ec2c05-aaa9-46e8-8439-7aa5b9fca19d/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:19:35 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07ec2c05-aaa9-46e8-8439-7aa5b9fca19d/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:19:35 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07ec2c05-aaa9-46e8-8439-7aa5b9fca19d/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:19:35 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=75045) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 23:19:35 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fde91f7c-31e3-456c-b252-6ce37fa3b600/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:19:36 user nova-compute[75045]: INFO nova.virt.block_device [None req-3e20b61e-19c4-460d-831a-0137ef420f72 tempest-TaggedBootDevicesTest_v242-1022497165 tempest-TaggedBootDevicesTest_v242-1022497165-project-member] [instance: 84f0b650-5f58-443d-92a2-bbd5240a0b6f] Booting with volume da45fa32-76b9-4f57-8e19-733f235e20b0 at /dev/vdb
Nov 08 23:19:36 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fde91f7c-31e3-456c-b252-6ce37fa3b600/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:19:36 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fde91f7c-31e3-456c-b252-6ce37fa3b600/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:19:36 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:19:36 user nova-compute[75045]: ERROR nova.virt.libvirt.driver [None req-79475380-6488-4cf8-9834-9906cfb6abfe tempest-VolumesAssistedSnapshotsTest-718669656 tempest-VolumesAssistedSnapshotsTest-718669656-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot None could not be found.
Nov 08 23:19:36 user nova-compute[75045]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 08 23:19:36 user nova-compute[75045]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Nov 08 23:19:36 user nova-compute[75045]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_delete(context, instance, volume_id,
Nov 08 23:19:36 user nova-compute[75045]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Nov 08 23:19:36 user nova-compute[75045]: ERROR nova.virt.libvirt.driver     if delete_info['type'] != 'qcow2':
Nov 08 23:19:36 user nova-compute[75045]: ERROR nova.virt.libvirt.driver KeyError: 'type'
Nov 08 23:19:36 user nova-compute[75045]: ERROR nova.virt.libvirt.driver 
Nov 08 23:19:36 user nova-compute[75045]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 08 23:19:36 user nova-compute[75045]: ERROR nova.virt.libvirt.driver 
Nov 08 23:19:36 user nova-compute[75045]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 08 23:19:36 user nova-compute[75045]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 08 23:19:36 user nova-compute[75045]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 08 23:19:36 user nova-compute[75045]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 08 23:19:36 user nova-compute[75045]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 08 23:19:36 user nova-compute[75045]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 08 23:19:36 user nova-compute[75045]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 08 23:19:36 user nova-compute[75045]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 08 23:19:36 user nova-compute[75045]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 08 23:19:36 user nova-compute[75045]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 08 23:19:36 user nova-compute[75045]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 08 23:19:36 user nova-compute[75045]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 08 23:19:36 user nova-compute[75045]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 08 23:19:36 user nova-compute[75045]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 08 23:19:36 user nova-compute[75045]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 08 23:19:36 user nova-compute[75045]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot None could not be found. (HTTP 404) (Request-ID: req-e1792010-c300-4604-815a-930676f628f1)
Nov 08 23:19:36 user nova-compute[75045]: ERROR nova.virt.libvirt.driver 
Nov 08 23:19:36 user nova-compute[75045]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 08 23:19:36 user nova-compute[75045]: ERROR nova.virt.libvirt.driver 
Nov 08 23:19:36 user nova-compute[75045]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 08 23:19:36 user nova-compute[75045]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3416, in _volume_snapshot_update_status
Nov 08 23:19:36 user nova-compute[75045]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Nov 08 23:19:36 user nova-compute[75045]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 08 23:19:36 user nova-compute[75045]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Nov 08 23:19:36 user nova-compute[75045]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Nov 08 23:19:36 user nova-compute[75045]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Nov 08 23:19:36 user nova-compute[75045]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Nov 08 23:19:36 user nova-compute[75045]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Nov 08 23:19:36 user nova-compute[75045]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 08 23:19:36 user nova-compute[75045]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 08 23:19:36 user nova-compute[75045]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 08 23:19:36 user nova-compute[75045]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 08 23:19:36 user nova-compute[75045]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 08 23:19:36 user nova-compute[75045]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 08 23:19:36 user nova-compute[75045]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 08 23:19:36 user nova-compute[75045]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 08 23:19:36 user nova-compute[75045]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 08 23:19:36 user nova-compute[75045]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 08 23:19:36 user nova-compute[75045]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 08 23:19:36 user nova-compute[75045]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 08 23:19:36 user nova-compute[75045]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 08 23:19:36 user nova-compute[75045]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 08 23:19:36 user nova-compute[75045]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot None could not be found.
Nov 08 23:19:36 user nova-compute[75045]: ERROR nova.virt.libvirt.driver 
Nov 08 23:19:36 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fde91f7c-31e3-456c-b252-6ce37fa3b600/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:19:36 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75045) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 23:19:36 user nova-compute[75045]: ERROR nova.virt.libvirt.driver [None req-c9cbe7e8-bcf2-4811-9f07-32d1aea04a86 tempest-VolumesAssistedSnapshotsTest-718669656 tempest-VolumesAssistedSnapshotsTest-718669656-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot bbffd11e-e70f-455c-983d-d58b8dac337d could not be found.
Nov 08 23:19:36 user nova-compute[75045]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 08 23:19:36 user nova-compute[75045]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Nov 08 23:19:36 user nova-compute[75045]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_create(context, instance, guest,
Nov 08 23:19:36 user nova-compute[75045]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 08 23:19:36 user nova-compute[75045]: ERROR nova.virt.libvirt.driver     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 08 23:19:36 user nova-compute[75045]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 08 23:19:36 user nova-compute[75045]: ERROR nova.virt.libvirt.driver     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 08 23:19:36 user nova-compute[75045]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 08 23:19:36 user nova-compute[75045]: ERROR nova.virt.libvirt.driver     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 08 23:19:36 user nova-compute[75045]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 08 23:19:36 user nova-compute[75045]: ERROR nova.virt.libvirt.driver     rv = execute(f, *args, **kwargs)
Nov 08 23:19:36 user nova-compute[75045]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 08 23:19:36 user nova-compute[75045]: ERROR nova.virt.libvirt.driver     six.reraise(c, e, tb)
Nov 08 23:19:36 user nova-compute[75045]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 08 23:19:36 user nova-compute[75045]: ERROR nova.virt.libvirt.driver     raise value
Nov 08 23:19:36 user nova-compute[75045]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 08 23:19:36 user nova-compute[75045]: ERROR nova.virt.libvirt.driver     rv = meth(*args, **kwargs)
Nov 08 23:19:36 user nova-compute[75045]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 08 23:19:36 user nova-compute[75045]: ERROR nova.virt.libvirt.driver     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 08 23:19:36 user nova-compute[75045]: ERROR nova.virt.libvirt.driver libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 08 23:19:36 user nova-compute[75045]: ERROR nova.virt.libvirt.driver 
Nov 08 23:19:36 user nova-compute[75045]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 08 23:19:36 user nova-compute[75045]: ERROR nova.virt.libvirt.driver 
Nov 08 23:19:36 user nova-compute[75045]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 08 23:19:36 user nova-compute[75045]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 08 23:19:36 user nova-compute[75045]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 08 23:19:36 user nova-compute[75045]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 08 23:19:36 user nova-compute[75045]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 08 23:19:36 user nova-compute[75045]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 08 23:19:36 user nova-compute[75045]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 08 23:19:36 user nova-compute[75045]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 08 23:19:36 user nova-compute[75045]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 08 23:19:36 user nova-compute[75045]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 08 23:19:36 user nova-compute[75045]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 08 23:19:36 user nova-compute[75045]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 08 23:19:36 user nova-compute[75045]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 08 23:19:36 user nova-compute[75045]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 08 23:19:36 user nova-compute[75045]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 08 23:19:36 user nova-compute[75045]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot bbffd11e-e70f-455c-983d-d58b8dac337d could not be found. (HTTP 404) (Request-ID: req-76ebda45-a21b-45c3-ac74-21c4af53ee0b)
Nov 08 23:19:36 user nova-compute[75045]: ERROR nova.virt.libvirt.driver 
Nov 08 23:19:36 user nova-compute[75045]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 08 23:19:36 user nova-compute[75045]: ERROR nova.virt.libvirt.driver 
Nov 08 23:19:36 user nova-compute[75045]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 08 23:19:36 user nova-compute[75045]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3416, in _volume_snapshot_update_status
Nov 08 23:19:36 user nova-compute[75045]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Nov 08 23:19:36 user nova-compute[75045]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 08 23:19:36 user nova-compute[75045]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Nov 08 23:19:36 user nova-compute[75045]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Nov 08 23:19:36 user nova-compute[75045]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Nov 08 23:19:36 user nova-compute[75045]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Nov 08 23:19:36 user nova-compute[75045]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Nov 08 23:19:36 user nova-compute[75045]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 08 23:19:36 user nova-compute[75045]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 08 23:19:36 user nova-compute[75045]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 08 23:19:36 user nova-compute[75045]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 08 23:19:36 user nova-compute[75045]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 08 23:19:36 user nova-compute[75045]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 08 23:19:36 user nova-compute[75045]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 08 23:19:36 user nova-compute[75045]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 08 23:19:36 user nova-compute[75045]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 08 23:19:36 user nova-compute[75045]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 08 23:19:36 user nova-compute[75045]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 08 23:19:36 user nova-compute[75045]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 08 23:19:36 user nova-compute[75045]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 08 23:19:36 user nova-compute[75045]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 08 23:19:36 user nova-compute[75045]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot bbffd11e-e70f-455c-983d-d58b8dac337d could not be found.
Nov 08 23:19:36 user nova-compute[75045]: ERROR nova.virt.libvirt.driver 
Nov 08 23:19:36 user nova-compute[75045]: ERROR oslo_messaging.rpc.server [None req-79475380-6488-4cf8-9834-9906cfb6abfe tempest-VolumesAssistedSnapshotsTest-718669656 tempest-VolumesAssistedSnapshotsTest-718669656-project] Exception during message handling: KeyError: 'type'
Nov 08 23:19:36 user nova-compute[75045]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 08 23:19:36 user nova-compute[75045]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Nov 08 23:19:36 user nova-compute[75045]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Nov 08 23:19:36 user nova-compute[75045]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Nov 08 23:19:36 user nova-compute[75045]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Nov 08 23:19:36 user nova-compute[75045]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Nov 08 23:19:36 user nova-compute[75045]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Nov 08 23:19:36 user nova-compute[75045]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Nov 08 23:19:36 user nova-compute[75045]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Nov 08 23:19:36 user nova-compute[75045]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Nov 08 23:19:36 user nova-compute[75045]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 08 23:19:36 user nova-compute[75045]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 08 23:19:36 user nova-compute[75045]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 08 23:19:36 user nova-compute[75045]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 08 23:19:36 user nova-compute[75045]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 08 23:19:36 user nova-compute[75045]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Nov 08 23:19:36 user nova-compute[75045]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Nov 08 23:19:36 user nova-compute[75045]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4517, in volume_snapshot_delete
Nov 08 23:19:36 user nova-compute[75045]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_delete(context, instance, volume_id,
Nov 08 23:19:36 user nova-compute[75045]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3853, in volume_snapshot_delete
Nov 08 23:19:36 user nova-compute[75045]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 08 23:19:36 user nova-compute[75045]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 08 23:19:36 user nova-compute[75045]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 08 23:19:36 user nova-compute[75045]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 08 23:19:36 user nova-compute[75045]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 08 23:19:36 user nova-compute[75045]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Nov 08 23:19:36 user nova-compute[75045]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_delete(context, instance, volume_id,
Nov 08 23:19:36 user nova-compute[75045]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Nov 08 23:19:36 user nova-compute[75045]: ERROR oslo_messaging.rpc.server     if delete_info['type'] != 'qcow2':
Nov 08 23:19:36 user nova-compute[75045]: ERROR oslo_messaging.rpc.server KeyError: 'type'
Nov 08 23:19:36 user nova-compute[75045]: ERROR oslo_messaging.rpc.server 
Nov 08 23:19:36 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9bd3096-92eb-4aae-8619-2725ed9acc2b/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:19:36 user nova-compute[75045]: ERROR oslo_messaging.rpc.server [None req-c9cbe7e8-bcf2-4811-9f07-32d1aea04a86 tempest-VolumesAssistedSnapshotsTest-718669656 tempest-VolumesAssistedSnapshotsTest-718669656-project] Exception during message handling: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 08 23:19:36 user nova-compute[75045]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 08 23:19:36 user nova-compute[75045]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Nov 08 23:19:36 user nova-compute[75045]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Nov 08 23:19:36 user nova-compute[75045]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Nov 08 23:19:36 user nova-compute[75045]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Nov 08 23:19:36 user nova-compute[75045]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Nov 08 23:19:36 user nova-compute[75045]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Nov 08 23:19:36 user nova-compute[75045]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Nov 08 23:19:36 user nova-compute[75045]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Nov 08 23:19:36 user nova-compute[75045]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Nov 08 23:19:36 user nova-compute[75045]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 08 23:19:36 user nova-compute[75045]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 08 23:19:36 user nova-compute[75045]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 08 23:19:36 user nova-compute[75045]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 08 23:19:36 user nova-compute[75045]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 08 23:19:36 user nova-compute[75045]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Nov 08 23:19:36 user nova-compute[75045]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Nov 08 23:19:36 user nova-compute[75045]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4505, in volume_snapshot_create
Nov 08 23:19:36 user nova-compute[75045]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_create(context, instance, volume_id,
Nov 08 23:19:36 user nova-compute[75045]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3597, in volume_snapshot_create
Nov 08 23:19:36 user nova-compute[75045]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 08 23:19:36 user nova-compute[75045]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 08 23:19:36 user nova-compute[75045]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 08 23:19:36 user nova-compute[75045]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 08 23:19:36 user nova-compute[75045]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 08 23:19:36 user nova-compute[75045]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Nov 08 23:19:36 user nova-compute[75045]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_create(context, instance, guest,
Nov 08 23:19:36 user nova-compute[75045]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 08 23:19:36 user nova-compute[75045]: ERROR oslo_messaging.rpc.server     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 08 23:19:36 user nova-compute[75045]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 08 23:19:36 user nova-compute[75045]: ERROR oslo_messaging.rpc.server     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 08 23:19:36 user nova-compute[75045]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 08 23:19:36 user nova-compute[75045]: ERROR oslo_messaging.rpc.server     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 08 23:19:36 user nova-compute[75045]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 08 23:19:36 user nova-compute[75045]: ERROR oslo_messaging.rpc.server     rv = execute(f, *args, **kwargs)
Nov 08 23:19:36 user nova-compute[75045]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 08 23:19:36 user nova-compute[75045]: ERROR oslo_messaging.rpc.server     six.reraise(c, e, tb)
Nov 08 23:19:36 user nova-compute[75045]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 08 23:19:36 user nova-compute[75045]: ERROR oslo_messaging.rpc.server     raise value
Nov 08 23:19:36 user nova-compute[75045]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 08 23:19:36 user nova-compute[75045]: ERROR oslo_messaging.rpc.server     rv = meth(*args, **kwargs)
Nov 08 23:19:36 user nova-compute[75045]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 08 23:19:36 user nova-compute[75045]: ERROR oslo_messaging.rpc.server     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 08 23:19:36 user nova-compute[75045]: ERROR oslo_messaging.rpc.server libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 08 23:19:36 user nova-compute[75045]: ERROR oslo_messaging.rpc.server 
Nov 08 23:19:36 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9bd3096-92eb-4aae-8619-2725ed9acc2b/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:19:36 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9bd3096-92eb-4aae-8619-2725ed9acc2b/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:19:36 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9bd3096-92eb-4aae-8619-2725ed9acc2b/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:19:36 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75045) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 23:19:36 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75045) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 23:19:36 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] skipping disk /dev/sdg (vdc) as it is a volume {{(pid=75045) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 23:19:36 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0de15211-d094-479a-86ce-292389441fa8/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:19:37 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0de15211-d094-479a-86ce-292389441fa8/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:19:37 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0de15211-d094-479a-86ce-292389441fa8/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:19:37 user nova-compute[75045]: DEBUG nova.compute.manager [None req-082394c4-e179-437a-8b30-c03773aae2a3 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] [instance: d2c911cf-d5f4-4c19-8335-8c7834184a7e] Start spawning the instance on the hypervisor. {{(pid=75045) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 23:19:37 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-082394c4-e179-437a-8b30-c03773aae2a3 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] [instance: d2c911cf-d5f4-4c19-8335-8c7834184a7e] Creating instance directory {{(pid=75045) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 23:19:37 user nova-compute[75045]: INFO nova.virt.libvirt.driver [None req-082394c4-e179-437a-8b30-c03773aae2a3 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] [instance: d2c911cf-d5f4-4c19-8335-8c7834184a7e] Creating image(s)
Nov 08 23:19:37 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-082394c4-e179-437a-8b30-c03773aae2a3 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] [instance: d2c911cf-d5f4-4c19-8335-8c7834184a7e] Did not create local disks {{(pid=75045) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 08 23:19:37 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-082394c4-e179-437a-8b30-c03773aae2a3 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] [instance: d2c911cf-d5f4-4c19-8335-8c7834184a7e] Ensure instance console log exists: /opt/stack/data/nova/instances/d2c911cf-d5f4-4c19-8335-8c7834184a7e/console.log {{(pid=75045) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 23:19:37 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-082394c4-e179-437a-8b30-c03773aae2a3 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:19:37 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-082394c4-e179-437a-8b30-c03773aae2a3 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:19:37 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-082394c4-e179-437a-8b30-c03773aae2a3 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:19:37 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-082394c4-e179-437a-8b30-c03773aae2a3 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] [instance: d2c911cf-d5f4-4c19-8335-8c7834184a7e] Start _get_guest_xml network_info=[{"id": "f4321c52-b9d5-434c-820f-25cab4239ef4", "address": "fa:16:3e:49:6b:27", "network": {"id": "d4cd6998-66d1-4389-bc82-dd000c8962de", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-323966879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bfb6963a6c145d4a7b7e47c8fde7e60", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4321c52-b9", "ovs_interfaceid": "f4321c52-b9d5-434c-820f-25cab4239ef4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T23:11:54Z,direct_url=<?>,disk_format='qcow2',id=a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b1beba2cc4e7465ea249e2225fb494dc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T23:11:56Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'device_type': 'disk', 'attachment_id': 'b8b630c0-8906-4d08-b1b6-910bbbf5fca7', 'guest_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nAfSpkVl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'd2c911cf-d5f4-4c19-8335-8c7834184a7e', 'attached_at': '', 'detached_at': '', 'volume_id': 'e7df0819-9ce3-4a97-b0f9-217e351b22ab', 'serial': 'e7df0819-9ce3-4a97-b0f9-217e351b22ab'}, 'volume_type': None} {{(pid=75045) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 23:19:37 user nova-compute[75045]: WARNING nova.virt.libvirt.driver [None req-082394c4-e179-437a-8b30-c03773aae2a3 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 23:19:37 user nova-compute[75045]: WARNING nova.virt.libvirt.driver [None req-082394c4-e179-437a-8b30-c03773aae2a3 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 23:19:37 user nova-compute[75045]: DEBUG nova.virt.libvirt.host [None req-082394c4-e179-437a-8b30-c03773aae2a3 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75045) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 23:19:37 user nova-compute[75045]: DEBUG nova.virt.libvirt.host [None req-082394c4-e179-437a-8b30-c03773aae2a3 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] CPU controller missing on host. {{(pid=75045) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 23:19:37 user nova-compute[75045]: DEBUG nova.virt.libvirt.host [None req-082394c4-e179-437a-8b30-c03773aae2a3 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75045) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 23:19:37 user nova-compute[75045]: DEBUG nova.virt.libvirt.host [None req-082394c4-e179-437a-8b30-c03773aae2a3 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] CPU controller found on host. {{(pid=75045) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 23:19:37 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-082394c4-e179-437a-8b30-c03773aae2a3 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75045) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 23:19:37 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-082394c4-e179-437a-8b30-c03773aae2a3 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T23:11:41Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T23:11:54Z,direct_url=<?>,disk_format='qcow2',id=a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b1beba2cc4e7465ea249e2225fb494dc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T23:11:56Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75045) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 23:19:37 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-082394c4-e179-437a-8b30-c03773aae2a3 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Flavor limits 0:0:0 {{(pid=75045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 23:19:37 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-082394c4-e179-437a-8b30-c03773aae2a3 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Image limits 0:0:0 {{(pid=75045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 23:19:37 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-082394c4-e179-437a-8b30-c03773aae2a3 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Flavor pref 0:0:0 {{(pid=75045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 23:19:37 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-082394c4-e179-437a-8b30-c03773aae2a3 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Image pref 0:0:0 {{(pid=75045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 23:19:37 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-082394c4-e179-437a-8b30-c03773aae2a3 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 23:19:37 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-082394c4-e179-437a-8b30-c03773aae2a3 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75045) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 23:19:37 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-082394c4-e179-437a-8b30-c03773aae2a3 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75045) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 23:19:37 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-082394c4-e179-437a-8b30-c03773aae2a3 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Got 1 possible topologies {{(pid=75045) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 23:19:37 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-082394c4-e179-437a-8b30-c03773aae2a3 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75045) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 23:19:37 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-082394c4-e179-437a-8b30-c03773aae2a3 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75045) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 23:19:37 user nova-compute[75045]: DEBUG nova.virt.libvirt.volume.iscsi [None req-082394c4-e179-437a-8b30-c03773aae2a3 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] [instance: d2c911cf-d5f4-4c19-8335-8c7834184a7e] Calling os-brick to attach iSCSI Volume {{(pid=75045) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 23:19:37 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-082394c4-e179-437a-8b30-c03773aae2a3 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1b68210460>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nAfSpkVl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75045) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 23:19:37 user nova-compute[75045]: WARNING os_brick.initiator.connectors.base [None req-082394c4-e179-437a-8b30-c03773aae2a3 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 23:19:37 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-082394c4-e179-437a-8b30-c03773aae2a3 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 23:19:37 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-082394c4-e179-437a-8b30-c03773aae2a3 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 23:19:37 user nova-compute[75045]: WARNING os_brick.initiator.connectors.base [None req-082394c4-e179-437a-8b30-c03773aae2a3 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 23:19:37 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-082394c4-e179-437a-8b30-c03773aae2a3 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 23:19:37 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-082394c4-e179-437a-8b30-c03773aae2a3 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 23:19:37 user nova-compute[75045]: INFO os_brick.initiator.connectors.iscsi [None req-082394c4-e179-437a-8b30-c03773aae2a3 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 23:19:37 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0de15211-d094-479a-86ce-292389441fa8/disk --force-share --output=json" returned: 0 in 0.286s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:19:37 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab -p 172.16.0.220:3260 {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:19:37 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab -p 172.16.0.220:3260" returned: 21 in 0.025s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:19:37 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebccc61a-f7f8-4942-8065-f35d0a0ddd79]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:19:37 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-082394c4-e179-437a-8b30-c03773aae2a3 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 23:19:37 user nova-compute[75045]:  {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:19:37 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab -p 172.16.0.220:3260 --interface default --op new {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:19:37 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.027s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:19:37 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[152f68c4-f73a-49fb-9dd2-6cba878755d2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab] added\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:19:37 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-082394c4-e179-437a-8b30-c03773aae2a3 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab] added
Nov 08 23:19:37 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:19:37 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:19:37 user nova-compute[75045]: WARNING nova.virt.libvirt.driver [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 23:19:37 user nova-compute[75045]: WARNING nova.virt.libvirt.driver [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 23:19:37 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Hypervisor/Node resource view: name=user free_ram=7823MB free_disk=25.41281509399414GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75045) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 23:19:37 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:19:37 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:19:37 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:19:37 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d350320-c4f2-459e-89f7-41a0eeb2f00a]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:19:37 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-082394c4-e179-437a-8b30-c03773aae2a3 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:19:37 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:19:37 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:19:37 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[93ee2321-3c23-4e46-9369-c7ac795cc5f4]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:19:37 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-082394c4-e179-437a-8b30-c03773aae2a3 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:19:37 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nAfSpkVl {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:19:37 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nAfSpkVl" returned: 0 in 0.026s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:19:37 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e814d0c-5906-4165-bba1-1266757c6164]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:19:37 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-082394c4-e179-437a-8b30-c03773aae2a3 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'nAfSpkVl'): stdout= stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:19:37 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:19:38 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:19:38 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4e940e8-a484-4ecc-ac61-8d9b70822ceb]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:19:38 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-082394c4-e179-437a-8b30-c03773aae2a3 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:19:38 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:19:38 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:19:38 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[13c57843-c043-48c1-bee5-dd283d340dcc]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d2ff5d0-0b89-42ba-92eb-1e12c9cce205 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d7a4df0-bfc5-4952-8454-97b703b68f28 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f829f03c-8f1a-45f1-a715-b9d769201d1b (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:528866cb-30dd-40ac-9a81-4c6afc93cdd9 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:175bb2c0-7767-4740-9350-7e3300681a43 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ed77146-5ae0-400d-8116-7f9eb1322808 (non-flash)\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:19:38 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-082394c4-e179-437a-8b30-c03773aae2a3 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d2ff5d0-0b89-42ba-92eb-1e12c9cce205 (non-flash)
Nov 08 23:19:38 user nova-compute[75045]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d7a4df0-bfc5-4952-8454-97b703b68f28 (non-flash)
Nov 08 23:19:38 user nova-compute[75045]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f829f03c-8f1a-45f1-a715-b9d769201d1b (non-flash)
Nov 08 23:19:38 user nova-compute[75045]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:528866cb-30dd-40ac-9a81-4c6afc93cdd9 (non-flash)
Nov 08 23:19:38 user nova-compute[75045]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:175bb2c0-7767-4740-9350-7e3300681a43 (non-flash)
Nov 08 23:19:38 user nova-compute[75045]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ed77146-5ae0-400d-8116-7f9eb1322808 (non-flash)
Nov 08 23:19:38 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 23:19:38 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-082394c4-e179-437a-8b30-c03773aae2a3 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d2ff5d0-0b89-42ba-92eb-1e12c9cce205 (non-flash)
Nov 08 23:19:38 user nova-compute[75045]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d7a4df0-bfc5-4952-8454-97b703b68f28 (non-flash)
Nov 08 23:19:38 user nova-compute[75045]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f829f03c-8f1a-45f1-a715-b9d769201d1b (non-flash)
Nov 08 23:19:38 user nova-compute[75045]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:528866cb-30dd-40ac-9a81-4c6afc93cdd9 (non-flash)
Nov 08 23:19:38 user nova-compute[75045]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:175bb2c0-7767-4740-9350-7e3300681a43 (non-flash)
Nov 08 23:19:38 user nova-compute[75045]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ed77146-5ae0-400d-8116-7f9eb1322808 (non-flash)
Nov 08 23:19:38 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 23:19:38 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab -p 172.16.0.220:3260 --login {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:19:38 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Instance 4ae5ff6b-6f2c-4dfd-a4c6-da4809e2cf27 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75045) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 23:19:38 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Instance 0f21fcd3-ac5f-499e-9c34-82af806fda1d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75045) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 23:19:38 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Instance b9bd3096-92eb-4aae-8619-2725ed9acc2b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75045) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 23:19:38 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Instance 1cb1b440-0073-4a53-a0a2-e2781e021866 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75045) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 23:19:38 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Instance fde91f7c-31e3-456c-b252-6ce37fa3b600 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75045) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 23:19:38 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Instance 07ec2c05-aaa9-46e8-8439-7aa5b9fca19d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75045) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 23:19:38 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Instance 82bc5fd0-26c7-4f81-b966-54831393b617 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75045) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 23:19:38 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Instance 725866aa-0e2a-4af3-af20-48157e6d2fcb actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75045) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 23:19:38 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Instance 520eac4f-fa48-4e41-924d-840907e701b4 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75045) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 23:19:38 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Instance d2c911cf-d5f4-4c19-8335-8c7834184a7e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75045) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 23:19:38 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Instance 84f0b650-5f58-443d-92a2-bbd5240a0b6f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75045) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 23:19:38 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Instance 0de15211-d094-479a-86ce-292389441fa8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75045) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 23:19:38 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=75045) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 23:19:38 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=75045) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 23:19:38 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab -p 172.16.0.220:3260 --login" returned: 0 in 0.094s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:19:38 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[a05aeeaf-9376-413c-9ad2-d6ae1fb7398b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:19:38 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-082394c4-e179-437a-8b30-c03773aae2a3 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab, portal: 172.16.0.220,3260]
Nov 08 23:19:38 user nova-compute[75045]: Login to [iface: default, target: iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab, portal: 172.16.0.220,3260] successful.
Nov 08 23:19:38 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:19:38 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:19:38 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.027s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:19:38 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[50806066-30f1-474e-ad44-f6eba0cc78c7]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:19:38 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-082394c4-e179-437a-8b30-c03773aae2a3 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:19:38 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:19:38 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.040s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:19:38 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb81f99b-893a-4b2a-9286-8d1254b3efb3]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d2ff5d0-0b89-42ba-92eb-1e12c9cce205 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d7a4df0-bfc5-4952-8454-97b703b68f28 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f829f03c-8f1a-45f1-a715-b9d769201d1b (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:528866cb-30dd-40ac-9a81-4c6afc93cdd9 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:175bb2c0-7767-4740-9350-7e3300681a43 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ed77146-5ae0-400d-8116-7f9eb1322808 (non-flash)\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:19:38 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-082394c4-e179-437a-8b30-c03773aae2a3 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d2ff5d0-0b89-42ba-92eb-1e12c9cce205 (non-flash)
Nov 08 23:19:38 user nova-compute[75045]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab (non-flash)
Nov 08 23:19:38 user nova-compute[75045]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d7a4df0-bfc5-4952-8454-97b703b68f28 (non-flash)
Nov 08 23:19:38 user nova-compute[75045]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f829f03c-8f1a-45f1-a715-b9d769201d1b (non-flash)
Nov 08 23:19:38 user nova-compute[75045]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:528866cb-30dd-40ac-9a81-4c6afc93cdd9 (non-flash)
Nov 08 23:19:38 user nova-compute[75045]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:175bb2c0-7767-4740-9350-7e3300681a43 (non-flash)
Nov 08 23:19:38 user nova-compute[75045]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ed77146-5ae0-400d-8116-7f9eb1322808 (non-flash)
Nov 08 23:19:38 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 23:19:38 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-082394c4-e179-437a-8b30-c03773aae2a3 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d2ff5d0-0b89-42ba-92eb-1e12c9cce205 (non-flash)
Nov 08 23:19:38 user nova-compute[75045]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab (non-flash)
Nov 08 23:19:38 user nova-compute[75045]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d7a4df0-bfc5-4952-8454-97b703b68f28 (non-flash)
Nov 08 23:19:38 user nova-compute[75045]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f829f03c-8f1a-45f1-a715-b9d769201d1b (non-flash)
Nov 08 23:19:38 user nova-compute[75045]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:528866cb-30dd-40ac-9a81-4c6afc93cdd9 (non-flash)
Nov 08 23:19:38 user nova-compute[75045]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:175bb2c0-7767-4740-9350-7e3300681a43 (non-flash)
Nov 08 23:19:38 user nova-compute[75045]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ed77146-5ae0-400d-8116-7f9eb1322808 (non-flash)
Nov 08 23:19:38 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 23:19:38 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-082394c4-e179-437a-8b30-c03773aae2a3 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.933s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 23:19:38 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-082394c4-e179-437a-8b30-c03773aae2a3 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Connected to 172.16.0.220:3260 {{(pid=75045) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 23:19:38 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-082394c4-e179-437a-8b30-c03773aae2a3 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] HCTL ('39', '-', '-', 0) found on session 11 with lun 0 {{(pid=75045) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 23:19:38 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-082394c4-e179-437a-8b30-c03773aae2a3 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=75045) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 23:19:38 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:19:38 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.026s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:19:38 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[beb213fc-8e3b-4d24-90d6-3db7078262e1]: (4, ('- - 0', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:19:38 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-082394c4-e179-437a-8b30-c03773aae2a3 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Searching for a device in session 11 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=75045) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 23:19:38 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-082394c4-e179-437a-8b30-c03773aae2a3 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nAfSpkVl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75045) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 23:19:38 user nova-compute[75045]: DEBUG nova.compute.provider_tree [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Inventory has not changed in ProviderTree for provider: 62ba5f85-c74d-4b58-986e-d4197e813fd7 {{(pid=75045) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 23:19:38 user nova-compute[75045]: INFO nova.scheduler.client.report [None req-3bdb0085-b32d-48fe-9776-c6553cadecc5 tempest-TestShelveInstance-1634360024 tempest-TestShelveInstance-1634360024-project-member] Deleted allocations for instance 725866aa-0e2a-4af3-af20-48157e6d2fcb
Nov 08 23:19:38 user nova-compute[75045]: DEBUG nova.scheduler.client.report [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Inventory has not changed for provider 62ba5f85-c74d-4b58-986e-d4197e813fd7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75045) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 23:19:38 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Compute_service record updated for user:user {{(pid=75045) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 23:19:38 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.713s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:19:38 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-3bdb0085-b32d-48fe-9776-c6553cadecc5 tempest-TestShelveInstance-1634360024 tempest-TestShelveInstance-1634360024-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:19:38 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-3bdb0085-b32d-48fe-9776-c6553cadecc5 tempest-TestShelveInstance-1634360024 tempest-TestShelveInstance-1634360024-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:19:38 user nova-compute[75045]: DEBUG nova.objects.instance [None req-3bdb0085-b32d-48fe-9776-c6553cadecc5 tempest-TestShelveInstance-1634360024 tempest-TestShelveInstance-1634360024-project-member] Lazy-loading 'numa_topology' on Instance uuid 725866aa-0e2a-4af3-af20-48157e6d2fcb {{(pid=75045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 23:19:38 user nova-compute[75045]: DEBUG nova.objects.base [None req-3bdb0085-b32d-48fe-9776-c6553cadecc5 tempest-TestShelveInstance-1634360024 tempest-TestShelveInstance-1634360024-project-member] Object Instance<725866aa-0e2a-4af3-af20-48157e6d2fcb> lazy-loaded attributes: resources,numa_topology {{(pid=75045) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 23:19:38 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-23d5342e-214c-4f05-9f2b-678dc4b21567 tempest-AttachSCSIVolumeTestJSON-1576344526 tempest-AttachSCSIVolumeTestJSON-1576344526-project-member] Acquiring lock "b9bd3096-92eb-4aae-8619-2725ed9acc2b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:19:38 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-23d5342e-214c-4f05-9f2b-678dc4b21567 tempest-AttachSCSIVolumeTestJSON-1576344526 tempest-AttachSCSIVolumeTestJSON-1576344526-project-member] Lock "b9bd3096-92eb-4aae-8619-2725ed9acc2b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:19:38 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-23d5342e-214c-4f05-9f2b-678dc4b21567 tempest-AttachSCSIVolumeTestJSON-1576344526 tempest-AttachSCSIVolumeTestJSON-1576344526-project-member] Acquiring lock "b9bd3096-92eb-4aae-8619-2725ed9acc2b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:19:38 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-23d5342e-214c-4f05-9f2b-678dc4b21567 tempest-AttachSCSIVolumeTestJSON-1576344526 tempest-AttachSCSIVolumeTestJSON-1576344526-project-member] Lock "b9bd3096-92eb-4aae-8619-2725ed9acc2b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:19:38 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-23d5342e-214c-4f05-9f2b-678dc4b21567 tempest-AttachSCSIVolumeTestJSON-1576344526 tempest-AttachSCSIVolumeTestJSON-1576344526-project-member] Lock "b9bd3096-92eb-4aae-8619-2725ed9acc2b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:19:38 user nova-compute[75045]: INFO nova.compute.manager [None req-23d5342e-214c-4f05-9f2b-678dc4b21567 tempest-AttachSCSIVolumeTestJSON-1576344526 tempest-AttachSCSIVolumeTestJSON-1576344526-project-member] [instance: b9bd3096-92eb-4aae-8619-2725ed9acc2b] Terminating instance
Nov 08 23:19:38 user nova-compute[75045]: DEBUG nova.compute.manager [None req-23d5342e-214c-4f05-9f2b-678dc4b21567 tempest-AttachSCSIVolumeTestJSON-1576344526 tempest-AttachSCSIVolumeTestJSON-1576344526-project-member] [instance: b9bd3096-92eb-4aae-8619-2725ed9acc2b] Start destroying the instance on the hypervisor. {{(pid=75045) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 23:19:38 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:19:38 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:19:38 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:19:38 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:19:38 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:19:38 user nova-compute[75045]: DEBUG nova.compute.manager [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75045) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 23:19:38 user nova-compute[75045]: DEBUG os_brick.utils [None req-3e20b61e-19c4-460d-831a-0137ef420f72 tempest-TaggedBootDevicesTest_v242-1022497165 tempest-TaggedBootDevicesTest_v242-1022497165-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75045) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 23:19:38 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:19:38 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:19:38 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.021s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:19:38 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7dbeba3-4891-4e8f-8a3d-e207e249321d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6217bd6e884\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:19:38 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:19:38 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:19:38 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.021s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:19:38 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bb89cf3-22e1-4508-b539-df469af2e0b4]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:19:38 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:19:38 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.024s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:19:38 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[488f00a2-9583-4267-be30-69fc447b2a0a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:19:38 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[47ea8dd0-a916-4018-89c1-48ed50b40a8f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:19:38 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-3e20b61e-19c4-460d-831a-0137ef420f72 tempest-TaggedBootDevicesTest_v242-1022497165 tempest-TaggedBootDevicesTest_v242-1022497165-project-member] Running cmd (subprocess): nvme version {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:19:38 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-3e20b61e-19c4-460d-831a-0137ef420f72 tempest-TaggedBootDevicesTest_v242-1022497165 tempest-TaggedBootDevicesTest_v242-1022497165-project-member] 'nvme version' failed. Not Retrying. {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 23:19:38 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:19:39 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3e20b61e-19c4-460d-831a-0137ef420f72 tempest-TaggedBootDevicesTest_v242-1022497165 tempest-TaggedBootDevicesTest_v242-1022497165-project-member] nvme not present on system {{(pid=75045) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 23:19:39 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:19:39 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 23:19:39 user nova-compute[75045]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 23:19:39 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ff1b347-d938-42ba-a211-665ccb57c714]: (4, '') {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:19:39 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.lightos [None req-3e20b61e-19c4-460d-831a-0137ef420f72 tempest-TaggedBootDevicesTest_v242-1022497165 tempest-TaggedBootDevicesTest_v242-1022497165-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75045) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 23:19:39 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.lightos [None req-3e20b61e-19c4-460d-831a-0137ef420f72 tempest-TaggedBootDevicesTest_v242-1022497165 tempest-TaggedBootDevicesTest_v242-1022497165-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75045) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 23:19:39 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.lightos [None req-3e20b61e-19c4-460d-831a-0137ef420f72 tempest-TaggedBootDevicesTest_v242-1022497165 tempest-TaggedBootDevicesTest_v242-1022497165-project-member] LIGHTOS: no hostnqn found. {{(pid=75045) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 23:19:39 user nova-compute[75045]: DEBUG os_brick.utils [None req-3e20b61e-19c4-460d-831a-0137ef420f72 tempest-TaggedBootDevicesTest_v242-1022497165 tempest-TaggedBootDevicesTest_v242-1022497165-project-member] <== get_connector_properties: return (201ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6217bd6e884', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75045) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 23:19:39 user nova-compute[75045]: DEBUG nova.virt.block_device [None req-3e20b61e-19c4-460d-831a-0137ef420f72 tempest-TaggedBootDevicesTest_v242-1022497165 tempest-TaggedBootDevicesTest_v242-1022497165-project-member] [instance: 84f0b650-5f58-443d-92a2-bbd5240a0b6f] Updating existing volume attachment record: ebd67b2f-f16e-489e-8d51-ed4fd58c2e0b {{(pid=75045) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 23:19:39 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-e0694800-7d06-4e31-a22b-eb1868d5bda7 tempest-VolumesAssistedSnapshotsTest-1482710492 tempest-VolumesAssistedSnapshotsTest-1482710492-project-admin] Acquiring lock "07ec2c05-aaa9-46e8-8439-7aa5b9fca19d" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:19:39 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-e0694800-7d06-4e31-a22b-eb1868d5bda7 tempest-VolumesAssistedSnapshotsTest-1482710492 tempest-VolumesAssistedSnapshotsTest-1482710492-project-admin] Lock "07ec2c05-aaa9-46e8-8439-7aa5b9fca19d" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:19:39 user nova-compute[75045]: INFO nova.compute.manager [None req-e0694800-7d06-4e31-a22b-eb1868d5bda7 tempest-VolumesAssistedSnapshotsTest-1482710492 tempest-VolumesAssistedSnapshotsTest-1482710492-project-admin] [instance: 07ec2c05-aaa9-46e8-8439-7aa5b9fca19d] Detaching volume f829f03c-8f1a-45f1-a715-b9d769201d1b
Nov 08 23:19:39 user nova-compute[75045]: DEBUG nova.compute.provider_tree [None req-3bdb0085-b32d-48fe-9776-c6553cadecc5 tempest-TestShelveInstance-1634360024 tempest-TestShelveInstance-1634360024-project-member] Inventory has not changed in ProviderTree for provider: 62ba5f85-c74d-4b58-986e-d4197e813fd7 {{(pid=75045) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 23:19:39 user nova-compute[75045]: DEBUG nova.scheduler.client.report [None req-3bdb0085-b32d-48fe-9776-c6553cadecc5 tempest-TestShelveInstance-1634360024 tempest-TestShelveInstance-1634360024-project-member] Inventory has not changed for provider 62ba5f85-c74d-4b58-986e-d4197e813fd7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75045) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 23:19:39 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-082394c4-e179-437a-8b30-c03773aae2a3 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.991s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 23:19:39 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-082394c4-e179-437a-8b30-c03773aae2a3 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] <== connect_volume: return (1994ms) {'type': 'block', 'scsi_wwn': '26236653134353633', 'path': '/dev/sdh'} {{(pid=75045) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 23:19:39 user nova-compute[75045]: DEBUG nova.virt.libvirt.volume.iscsi [None req-082394c4-e179-437a-8b30-c03773aae2a3 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] [instance: d2c911cf-d5f4-4c19-8335-8c7834184a7e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26236653134353633', 'path': '/dev/sdh'} {{(pid=75045) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 23:19:39 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-3bdb0085-b32d-48fe-9776-c6553cadecc5 tempest-TestShelveInstance-1634360024 tempest-TestShelveInstance-1634360024-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.699s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:19:39 user nova-compute[75045]: DEBUG nova.virt.libvirt.vif [None req-082394c4-e179-437a-8b30-c03773aae2a3 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T23:18:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-2063862125',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-2063862125',id=11,image_ref='a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6bfb6963a6c145d4a7b7e47c8fde7e60',ramdisk_id='',reservation_id='r-kiu16ror',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-474110917',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T23:18:33Z,user_data=None,user_id='04bb3135250f4465a9947b47f9cde485',uuid=d2c911cf-d5f4-4c19-8335-8c7834184a7e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f4321c52-b9d5-434c-820f-25cab4239ef4", "address": "fa:16:3e:49:6b:27", "network": {"id": "d4cd6998-66d1-4389-bc82-dd000c8962de", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-323966879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bfb6963a6c145d4a7b7e47c8fde7e60", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4321c52-b9", "ovs_interfaceid": "f4321c52-b9d5-434c-820f-25cab4239ef4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75045) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 23:19:39 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-082394c4-e179-437a-8b30-c03773aae2a3 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Converting VIF {"id": "f4321c52-b9d5-434c-820f-25cab4239ef4", "address": "fa:16:3e:49:6b:27", "network": {"id": "d4cd6998-66d1-4389-bc82-dd000c8962de", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-323966879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bfb6963a6c145d4a7b7e47c8fde7e60", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4321c52-b9", "ovs_interfaceid": "f4321c52-b9d5-434c-820f-25cab4239ef4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 23:19:39 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-082394c4-e179-437a-8b30-c03773aae2a3 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:49:6b:27,bridge_name='br-int',has_traffic_filtering=True,id=f4321c52-b9d5-434c-820f-25cab4239ef4,network=Network(d4cd6998-66d1-4389-bc82-dd000c8962de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4321c52-b9') {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 23:19:39 user nova-compute[75045]: DEBUG nova.objects.instance [None req-082394c4-e179-437a-8b30-c03773aae2a3 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Lazy-loading 'pci_devices' on Instance uuid d2c911cf-d5f4-4c19-8335-8c7834184a7e {{(pid=75045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 23:19:39 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-082394c4-e179-437a-8b30-c03773aae2a3 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] [instance: d2c911cf-d5f4-4c19-8335-8c7834184a7e] End _get_guest_xml xml=<domain type="kvm">
Nov 08 23:19:39 user nova-compute[75045]:   <uuid>d2c911cf-d5f4-4c19-8335-8c7834184a7e</uuid>
Nov 08 23:19:39 user nova-compute[75045]:   <name>instance-0000000b</name>
Nov 08 23:19:39 user nova-compute[75045]:   <memory>524288</memory>
Nov 08 23:19:39 user nova-compute[75045]:   <vcpu>1</vcpu>
Nov 08 23:19:39 user nova-compute[75045]:   <metadata>
Nov 08 23:19:39 user nova-compute[75045]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 23:19:39 user nova-compute[75045]:       <nova:package version="0.0.0"/>
Nov 08 23:19:39 user nova-compute[75045]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-2063862125</nova:name>
Nov 08 23:19:39 user nova-compute[75045]:       <nova:creationTime>2023-11-08 23:19:37</nova:creationTime>
Nov 08 23:19:39 user nova-compute[75045]:       <nova:flavor name="m1.tiny">
Nov 08 23:19:39 user nova-compute[75045]:         <nova:memory>512</nova:memory>
Nov 08 23:19:39 user nova-compute[75045]:         <nova:disk>1</nova:disk>
Nov 08 23:19:39 user nova-compute[75045]:         <nova:swap>0</nova:swap>
Nov 08 23:19:39 user nova-compute[75045]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 23:19:39 user nova-compute[75045]:         <nova:vcpus>1</nova:vcpus>
Nov 08 23:19:39 user nova-compute[75045]:       </nova:flavor>
Nov 08 23:19:39 user nova-compute[75045]:       <nova:owner>
Nov 08 23:19:39 user nova-compute[75045]:         <nova:user uuid="04bb3135250f4465a9947b47f9cde485">tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member</nova:user>
Nov 08 23:19:39 user nova-compute[75045]:         <nova:project uuid="6bfb6963a6c145d4a7b7e47c8fde7e60">tempest-ServerBootFromVolumeStableRescueTest-474110917</nova:project>
Nov 08 23:19:39 user nova-compute[75045]:       </nova:owner>
Nov 08 23:19:39 user nova-compute[75045]:       <nova:root type="image" uuid="a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb"/>
Nov 08 23:19:39 user nova-compute[75045]:       <nova:ports>
Nov 08 23:19:39 user nova-compute[75045]:         <nova:port uuid="f4321c52-b9d5-434c-820f-25cab4239ef4">
Nov 08 23:19:39 user nova-compute[75045]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 08 23:19:39 user nova-compute[75045]:         </nova:port>
Nov 08 23:19:39 user nova-compute[75045]:       </nova:ports>
Nov 08 23:19:39 user nova-compute[75045]:     </nova:instance>
Nov 08 23:19:39 user nova-compute[75045]:   </metadata>
Nov 08 23:19:39 user nova-compute[75045]:   <sysinfo type="smbios">
Nov 08 23:19:39 user nova-compute[75045]:     <system>
Nov 08 23:19:39 user nova-compute[75045]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 23:19:39 user nova-compute[75045]:       <entry name="product">OpenStack Nova</entry>
Nov 08 23:19:39 user nova-compute[75045]:       <entry name="version">0.0.0</entry>
Nov 08 23:19:39 user nova-compute[75045]:       <entry name="serial">d2c911cf-d5f4-4c19-8335-8c7834184a7e</entry>
Nov 08 23:19:39 user nova-compute[75045]:       <entry name="uuid">d2c911cf-d5f4-4c19-8335-8c7834184a7e</entry>
Nov 08 23:19:39 user nova-compute[75045]:       <entry name="family">Virtual Machine</entry>
Nov 08 23:19:39 user nova-compute[75045]:     </system>
Nov 08 23:19:39 user nova-compute[75045]:   </sysinfo>
Nov 08 23:19:39 user nova-compute[75045]:   <os>
Nov 08 23:19:39 user nova-compute[75045]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 23:19:39 user nova-compute[75045]:     <boot dev="hd"/>
Nov 08 23:19:39 user nova-compute[75045]:     <smbios mode="sysinfo"/>
Nov 08 23:19:39 user nova-compute[75045]:   </os>
Nov 08 23:19:39 user nova-compute[75045]:   <features>
Nov 08 23:19:39 user nova-compute[75045]:     <acpi/>
Nov 08 23:19:39 user nova-compute[75045]:     <apic/>
Nov 08 23:19:39 user nova-compute[75045]:     <vmcoreinfo/>
Nov 08 23:19:39 user nova-compute[75045]:   </features>
Nov 08 23:19:39 user nova-compute[75045]:   <clock offset="utc">
Nov 08 23:19:39 user nova-compute[75045]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 23:19:39 user nova-compute[75045]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 23:19:39 user nova-compute[75045]:     <timer name="hpet" present="no"/>
Nov 08 23:19:39 user nova-compute[75045]:   </clock>
Nov 08 23:19:39 user nova-compute[75045]:   <cpu mode="custom" match="exact">
Nov 08 23:19:39 user nova-compute[75045]:     <model>Nehalem</model>
Nov 08 23:19:39 user nova-compute[75045]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 23:19:39 user nova-compute[75045]:   </cpu>
Nov 08 23:19:39 user nova-compute[75045]:   <devices>
Nov 08 23:19:39 user nova-compute[75045]:     <disk type="block" device="disk">
Nov 08 23:19:39 user nova-compute[75045]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 23:19:39 user nova-compute[75045]:       <source dev="/dev/sdh"/>
Nov 08 23:19:39 user nova-compute[75045]:       <target dev="vda" bus="virtio"/>
Nov 08 23:19:39 user nova-compute[75045]:       <serial>e7df0819-9ce3-4a97-b0f9-217e351b22ab</serial>
Nov 08 23:19:39 user nova-compute[75045]:     </disk>
Nov 08 23:19:39 user nova-compute[75045]:     <interface type="ethernet">
Nov 08 23:19:39 user nova-compute[75045]:       <mac address="fa:16:3e:49:6b:27"/>
Nov 08 23:19:39 user nova-compute[75045]:       <model type="virtio"/>
Nov 08 23:19:39 user nova-compute[75045]:       <mtu size="1442"/>
Nov 08 23:19:39 user nova-compute[75045]:       <target dev="tapf4321c52-b9"/>
Nov 08 23:19:39 user nova-compute[75045]:     </interface>
Nov 08 23:19:39 user nova-compute[75045]:     <serial type="pty">
Nov 08 23:19:39 user nova-compute[75045]:       <log file="/opt/stack/data/nova/instances/d2c911cf-d5f4-4c19-8335-8c7834184a7e/console.log" append="off"/>
Nov 08 23:19:39 user nova-compute[75045]:     </serial>
Nov 08 23:19:39 user nova-compute[75045]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 23:19:39 user nova-compute[75045]:     <video>
Nov 08 23:19:39 user nova-compute[75045]:       <model type="virtio"/>
Nov 08 23:19:39 user nova-compute[75045]:     </video>
Nov 08 23:19:39 user nova-compute[75045]:     <rng model="virtio">
Nov 08 23:19:39 user nova-compute[75045]:       <backend model="random">/dev/urandom</backend>
Nov 08 23:19:39 user nova-compute[75045]:     </rng>
Nov 08 23:19:39 user nova-compute[75045]:     <controller type="usb" index="0" model="none"/>
Nov 08 23:19:39 user nova-compute[75045]:     <memballoon model="virtio">
Nov 08 23:19:39 user nova-compute[75045]:       <stats period="10"/>
Nov 08 23:19:39 user nova-compute[75045]:     </memballoon>
Nov 08 23:19:39 user nova-compute[75045]:   </devices>
Nov 08 23:19:39 user nova-compute[75045]: </domain>
Nov 08 23:19:39 user nova-compute[75045]:  {{(pid=75045) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 23:19:39 user nova-compute[75045]: DEBUG nova.virt.libvirt.vif [None req-082394c4-e179-437a-8b30-c03773aae2a3 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T23:18:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-2063862125',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-2063862125',id=11,image_ref='a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6bfb6963a6c145d4a7b7e47c8fde7e60',ramdisk_id='',reservation_id='r-kiu16ror',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-474110917',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T23:18:33Z,user_data=None,user_id='04bb3135250f4465a9947b47f9cde485',uuid=d2c911cf-d5f4-4c19-8335-8c7834184a7e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f4321c52-b9d5-434c-820f-25cab4239ef4", "address": "fa:16:3e:49:6b:27", "network": {"id": "d4cd6998-66d1-4389-bc82-dd000c8962de", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-323966879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bfb6963a6c145d4a7b7e47c8fde7e60", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4321c52-b9", "ovs_interfaceid": "f4321c52-b9d5-434c-820f-25cab4239ef4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75045) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 23:19:39 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-082394c4-e179-437a-8b30-c03773aae2a3 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Converting VIF {"id": "f4321c52-b9d5-434c-820f-25cab4239ef4", "address": "fa:16:3e:49:6b:27", "network": {"id": "d4cd6998-66d1-4389-bc82-dd000c8962de", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-323966879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bfb6963a6c145d4a7b7e47c8fde7e60", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4321c52-b9", "ovs_interfaceid": "f4321c52-b9d5-434c-820f-25cab4239ef4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 23:19:39 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-082394c4-e179-437a-8b30-c03773aae2a3 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:49:6b:27,bridge_name='br-int',has_traffic_filtering=True,id=f4321c52-b9d5-434c-820f-25cab4239ef4,network=Network(d4cd6998-66d1-4389-bc82-dd000c8962de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4321c52-b9') {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 23:19:39 user nova-compute[75045]: DEBUG os_vif [None req-082394c4-e179-437a-8b30-c03773aae2a3 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:49:6b:27,bridge_name='br-int',has_traffic_filtering=True,id=f4321c52-b9d5-434c-820f-25cab4239ef4,network=Network(d4cd6998-66d1-4389-bc82-dd000c8962de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4321c52-b9') {{(pid=75045) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 23:19:39 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:19:39 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:19:39 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 23:19:39 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:19:39 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e281d9d2-8ae7-540f-b518-5e4b1ffdc659', '_type': 'linux-noop'}}, row=False) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:19:39 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-3bdb0085-b32d-48fe-9776-c6553cadecc5 tempest-TestShelveInstance-1634360024 tempest-TestShelveInstance-1634360024-project-member] Lock "725866aa-0e2a-4af3-af20-48157e6d2fcb" "released" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: held 23.083s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:19:39 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:19:39 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 23:19:39 user nova-compute[75045]: DEBUG nova.compute.manager [req-72162579-25eb-4c29-9e15-b777513dbb6b req-afa6b6a9-cbe6-42b5-8fd3-437bd75403bb service nova] [instance: b9bd3096-92eb-4aae-8619-2725ed9acc2b] Received event network-vif-unplugged-aea70d63-158f-4f6e-ac36-1c342bd5be4d {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:19:39 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-72162579-25eb-4c29-9e15-b777513dbb6b req-afa6b6a9-cbe6-42b5-8fd3-437bd75403bb service nova] Acquiring lock "b9bd3096-92eb-4aae-8619-2725ed9acc2b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:19:39 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-72162579-25eb-4c29-9e15-b777513dbb6b req-afa6b6a9-cbe6-42b5-8fd3-437bd75403bb service nova] Lock "b9bd3096-92eb-4aae-8619-2725ed9acc2b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:19:39 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-72162579-25eb-4c29-9e15-b777513dbb6b req-afa6b6a9-cbe6-42b5-8fd3-437bd75403bb service nova] Lock "b9bd3096-92eb-4aae-8619-2725ed9acc2b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:19:39 user nova-compute[75045]: DEBUG nova.compute.manager [req-72162579-25eb-4c29-9e15-b777513dbb6b req-afa6b6a9-cbe6-42b5-8fd3-437bd75403bb service nova] [instance: b9bd3096-92eb-4aae-8619-2725ed9acc2b] No waiting events found dispatching network-vif-unplugged-aea70d63-158f-4f6e-ac36-1c342bd5be4d {{(pid=75045) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 23:19:39 user nova-compute[75045]: DEBUG nova.compute.manager [req-72162579-25eb-4c29-9e15-b777513dbb6b req-afa6b6a9-cbe6-42b5-8fd3-437bd75403bb service nova] [instance: b9bd3096-92eb-4aae-8619-2725ed9acc2b] Received event network-vif-unplugged-aea70d63-158f-4f6e-ac36-1c342bd5be4d for instance with task_state deleting. {{(pid=75045) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 23:19:39 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:19:39 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-cd1d6b86-2aa1-4ecb-8c4e-1cf5c01f7fa0 tempest-TaggedAttachmentsTest-1639503389 tempest-TaggedAttachmentsTest-1639503389-project-member] Acquiring lock "1cb1b440-0073-4a53-a0a2-e2781e021866" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:19:39 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-cd1d6b86-2aa1-4ecb-8c4e-1cf5c01f7fa0 tempest-TaggedAttachmentsTest-1639503389 tempest-TaggedAttachmentsTest-1639503389-project-member] Lock "1cb1b440-0073-4a53-a0a2-e2781e021866" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.005s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:19:39 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:19:39 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf4321c52-b9, may_exist=True, interface_attrs={}) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:19:39 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf4321c52-b9, col_values=(('qos', UUID('02c3d59c-a5be-4fff-9c34-1e9136d2c3ee')),), if_exists=True) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:19:39 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf4321c52-b9, col_values=(('external_ids', {'iface-id': 'f4321c52-b9d5-434c-820f-25cab4239ef4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:49:6b:27', 'vm-uuid': 'd2c911cf-d5f4-4c19-8335-8c7834184a7e'}),), if_exists=True) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:19:39 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:19:39 user nova-compute[75045]: INFO nova.compute.manager [None req-cd1d6b86-2aa1-4ecb-8c4e-1cf5c01f7fa0 tempest-TaggedAttachmentsTest-1639503389 tempest-TaggedAttachmentsTest-1639503389-project-member] [instance: 1cb1b440-0073-4a53-a0a2-e2781e021866] Detaching volume 528866cb-30dd-40ac-9a81-4c6afc93cdd9
Nov 08 23:19:39 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:19:39 user nova-compute[75045]: INFO os_vif [None req-082394c4-e179-437a-8b30-c03773aae2a3 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:49:6b:27,bridge_name='br-int',has_traffic_filtering=True,id=f4321c52-b9d5-434c-820f-25cab4239ef4,network=Network(d4cd6998-66d1-4389-bc82-dd000c8962de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4321c52-b9')
Nov 08 23:19:39 user nova-compute[75045]: INFO nova.virt.libvirt.driver [-] [instance: b9bd3096-92eb-4aae-8619-2725ed9acc2b] Instance destroyed successfully.
Nov 08 23:19:39 user nova-compute[75045]: DEBUG nova.objects.instance [None req-23d5342e-214c-4f05-9f2b-678dc4b21567 tempest-AttachSCSIVolumeTestJSON-1576344526 tempest-AttachSCSIVolumeTestJSON-1576344526-project-member] Lazy-loading 'resources' on Instance uuid b9bd3096-92eb-4aae-8619-2725ed9acc2b {{(pid=75045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 23:19:39 user nova-compute[75045]: DEBUG nova.virt.libvirt.vif [None req-23d5342e-214c-4f05-9f2b-678dc4b21567 tempest-AttachSCSIVolumeTestJSON-1576344526 tempest-AttachSCSIVolumeTestJSON-1576344526-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T23:16:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-408021707',display_name='tempest-AttachSCSIVolumeTestJSON-server-408021707',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-408021707',id=4,image_ref='7360a3b4-3739-4e8b-98be-8e9d960334e0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMkusxQ2AIWt+q8cMtgxBO33WctNFiDwXbEZNqu4BBPA8YD6480ZXWebvyQxcoDq94VlU5EYWyi/TSp/ddm5krz+nTT/5O7uRcdrcOj3m+dMT9AVi9e6K7uWY/zixU3OiQ==',key_name='tempest-keypair-1133253416',keypairs=<?>,launch_index=0,launched_at=2023-11-08T23:16:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8623aaa12b0b44928ef7391a460fcfe7',ramdisk_id='',reservation_id='r-m1etkbx4',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7360a3b4-3739-4e8b-98be-8e9d960334e0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_scsi_model='virtio-scsi',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1576344526',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1576344526-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T23:16:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3579fcc0ca4d46dbb6f04ed8f3962ff9',uuid=b9bd3096-92eb-4aae-8619-2725ed9acc2b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "aea70d63-158f-4f6e-ac36-1c342bd5be4d", "address": "fa:16:3e:1e:64:12", "network": {"id": "c4c4a0db-a673-4145-852d-5ab102a81bf9", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-993346983-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.169", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8623aaa12b0b44928ef7391a460fcfe7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaea70d63-15", "ovs_interfaceid": "aea70d63-158f-4f6e-ac36-1c342bd5be4d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75045) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 23:19:39 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-23d5342e-214c-4f05-9f2b-678dc4b21567 tempest-AttachSCSIVolumeTestJSON-1576344526 tempest-AttachSCSIVolumeTestJSON-1576344526-project-member] Converting VIF {"id": "aea70d63-158f-4f6e-ac36-1c342bd5be4d", "address": "fa:16:3e:1e:64:12", "network": {"id": "c4c4a0db-a673-4145-852d-5ab102a81bf9", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-993346983-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.169", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8623aaa12b0b44928ef7391a460fcfe7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaea70d63-15", "ovs_interfaceid": "aea70d63-158f-4f6e-ac36-1c342bd5be4d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 23:19:39 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-23d5342e-214c-4f05-9f2b-678dc4b21567 tempest-AttachSCSIVolumeTestJSON-1576344526 tempest-AttachSCSIVolumeTestJSON-1576344526-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1e:64:12,bridge_name='br-int',has_traffic_filtering=True,id=aea70d63-158f-4f6e-ac36-1c342bd5be4d,network=Network(c4c4a0db-a673-4145-852d-5ab102a81bf9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaea70d63-15') {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 23:19:39 user nova-compute[75045]: DEBUG os_vif [None req-23d5342e-214c-4f05-9f2b-678dc4b21567 tempest-AttachSCSIVolumeTestJSON-1576344526 tempest-AttachSCSIVolumeTestJSON-1576344526-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:1e:64:12,bridge_name='br-int',has_traffic_filtering=True,id=aea70d63-158f-4f6e-ac36-1c342bd5be4d,network=Network(c4c4a0db-a673-4145-852d-5ab102a81bf9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaea70d63-15') {{(pid=75045) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 23:19:39 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:19:39 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapaea70d63-15, bridge=br-int, if_exists=True) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:19:39 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:19:39 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 23:19:39 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:19:39 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:19:39 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=02117c51-7f71-4096-841a-d479d78d2169) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:19:39 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:19:39 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-082394c4-e179-437a-8b30-c03773aae2a3 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] No BDM found with device name vda, not building metadata. {{(pid=75045) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 23:19:39 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-082394c4-e179-437a-8b30-c03773aae2a3 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] No VIF found with MAC fa:16:3e:49:6b:27, not building metadata {{(pid=75045) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 23:19:39 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 23:19:39 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:19:39 user nova-compute[75045]: INFO os_vif [None req-23d5342e-214c-4f05-9f2b-678dc4b21567 tempest-AttachSCSIVolumeTestJSON-1576344526 tempest-AttachSCSIVolumeTestJSON-1576344526-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:1e:64:12,bridge_name='br-int',has_traffic_filtering=True,id=aea70d63-158f-4f6e-ac36-1c342bd5be4d,network=Network(c4c4a0db-a673-4145-852d-5ab102a81bf9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaea70d63-15')
Nov 08 23:19:39 user nova-compute[75045]: INFO nova.virt.libvirt.driver [None req-23d5342e-214c-4f05-9f2b-678dc4b21567 tempest-AttachSCSIVolumeTestJSON-1576344526 tempest-AttachSCSIVolumeTestJSON-1576344526-project-member] [instance: b9bd3096-92eb-4aae-8619-2725ed9acc2b] Deleting instance files /opt/stack/data/nova/instances/b9bd3096-92eb-4aae-8619-2725ed9acc2b_del
Nov 08 23:19:39 user nova-compute[75045]: INFO nova.virt.libvirt.driver [None req-23d5342e-214c-4f05-9f2b-678dc4b21567 tempest-AttachSCSIVolumeTestJSON-1576344526 tempest-AttachSCSIVolumeTestJSON-1576344526-project-member] [instance: b9bd3096-92eb-4aae-8619-2725ed9acc2b] Deletion of /opt/stack/data/nova/instances/b9bd3096-92eb-4aae-8619-2725ed9acc2b_del complete
Nov 08 23:19:40 user nova-compute[75045]: INFO nova.compute.manager [None req-23d5342e-214c-4f05-9f2b-678dc4b21567 tempest-AttachSCSIVolumeTestJSON-1576344526 tempest-AttachSCSIVolumeTestJSON-1576344526-project-member] [instance: b9bd3096-92eb-4aae-8619-2725ed9acc2b] Took 1.50 seconds to destroy the instance on the hypervisor.
Nov 08 23:19:40 user nova-compute[75045]: DEBUG oslo.service.loopingcall [None req-23d5342e-214c-4f05-9f2b-678dc4b21567 tempest-AttachSCSIVolumeTestJSON-1576344526 tempest-AttachSCSIVolumeTestJSON-1576344526-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75045) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 23:19:40 user nova-compute[75045]: DEBUG nova.compute.manager [-] [instance: b9bd3096-92eb-4aae-8619-2725ed9acc2b] Deallocating network for instance {{(pid=75045) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 23:19:40 user nova-compute[75045]: DEBUG nova.network.neutron [-] [instance: b9bd3096-92eb-4aae-8619-2725ed9acc2b] deallocate_for_instance() {{(pid=75045) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 23:19:40 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:19:40 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-c2951d46-db33-418e-8d19-8bedafa6b90b tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Acquiring lock "032e20aa-8887-4215-808e-68299a0d8d0b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:19:40 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-c2951d46-db33-418e-8d19-8bedafa6b90b tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Lock "032e20aa-8887-4215-808e-68299a0d8d0b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:19:40 user nova-compute[75045]: DEBUG nova.compute.manager [None req-c2951d46-db33-418e-8d19-8bedafa6b90b tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] [instance: 032e20aa-8887-4215-808e-68299a0d8d0b] Starting instance... {{(pid=75045) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 23:19:41 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-c2951d46-db33-418e-8d19-8bedafa6b90b tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:19:41 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-c2951d46-db33-418e-8d19-8bedafa6b90b tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:19:41 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-c2951d46-db33-418e-8d19-8bedafa6b90b tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75045) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 23:19:41 user nova-compute[75045]: INFO nova.compute.claims [None req-c2951d46-db33-418e-8d19-8bedafa6b90b tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] [instance: 032e20aa-8887-4215-808e-68299a0d8d0b] Claim successful on node user
Nov 08 23:19:41 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:19:41 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:19:41 user nova-compute[75045]: DEBUG nova.network.neutron [-] [instance: b9bd3096-92eb-4aae-8619-2725ed9acc2b] Updating instance_info_cache with network_info: [] {{(pid=75045) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 23:19:41 user nova-compute[75045]: DEBUG nova.compute.manager [req-2161c9cf-8174-4080-9eb3-42b6b4835a29 req-4f52db85-e349-4618-84d5-ef8fed0a0319 service nova] [instance: b9bd3096-92eb-4aae-8619-2725ed9acc2b] Received event network-vif-deleted-aea70d63-158f-4f6e-ac36-1c342bd5be4d {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:19:41 user nova-compute[75045]: INFO nova.compute.manager [req-2161c9cf-8174-4080-9eb3-42b6b4835a29 req-4f52db85-e349-4618-84d5-ef8fed0a0319 service nova] [instance: b9bd3096-92eb-4aae-8619-2725ed9acc2b] Neutron deleted interface aea70d63-158f-4f6e-ac36-1c342bd5be4d; detaching it from the instance and deleting it from the info cache
Nov 08 23:19:41 user nova-compute[75045]: DEBUG nova.network.neutron [req-2161c9cf-8174-4080-9eb3-42b6b4835a29 req-4f52db85-e349-4618-84d5-ef8fed0a0319 service nova] [instance: b9bd3096-92eb-4aae-8619-2725ed9acc2b] Updating instance_info_cache with network_info: [] {{(pid=75045) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 23:19:41 user nova-compute[75045]: INFO nova.compute.manager [-] [instance: b9bd3096-92eb-4aae-8619-2725ed9acc2b] Took 1.21 seconds to deallocate network for instance.
Nov 08 23:19:41 user nova-compute[75045]: DEBUG nova.compute.manager [req-2161c9cf-8174-4080-9eb3-42b6b4835a29 req-4f52db85-e349-4618-84d5-ef8fed0a0319 service nova] [instance: b9bd3096-92eb-4aae-8619-2725ed9acc2b] Detach interface failed, port_id=aea70d63-158f-4f6e-ac36-1c342bd5be4d, reason: Instance b9bd3096-92eb-4aae-8619-2725ed9acc2b could not be found. {{(pid=75045) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 08 23:19:41 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-23d5342e-214c-4f05-9f2b-678dc4b21567 tempest-AttachSCSIVolumeTestJSON-1576344526 tempest-AttachSCSIVolumeTestJSON-1576344526-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:19:41 user nova-compute[75045]: DEBUG nova.compute.manager [req-acd95181-9b12-450d-a24f-3c984b72c206 req-4298fa25-8a34-4627-9e11-20896b63d129 service nova] [instance: b9bd3096-92eb-4aae-8619-2725ed9acc2b] Received event network-vif-plugged-aea70d63-158f-4f6e-ac36-1c342bd5be4d {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:19:41 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-acd95181-9b12-450d-a24f-3c984b72c206 req-4298fa25-8a34-4627-9e11-20896b63d129 service nova] Acquiring lock "b9bd3096-92eb-4aae-8619-2725ed9acc2b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:19:41 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-acd95181-9b12-450d-a24f-3c984b72c206 req-4298fa25-8a34-4627-9e11-20896b63d129 service nova] Lock "b9bd3096-92eb-4aae-8619-2725ed9acc2b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:19:41 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-acd95181-9b12-450d-a24f-3c984b72c206 req-4298fa25-8a34-4627-9e11-20896b63d129 service nova] Lock "b9bd3096-92eb-4aae-8619-2725ed9acc2b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:19:41 user nova-compute[75045]: DEBUG nova.compute.manager [req-acd95181-9b12-450d-a24f-3c984b72c206 req-4298fa25-8a34-4627-9e11-20896b63d129 service nova] [instance: b9bd3096-92eb-4aae-8619-2725ed9acc2b] No waiting events found dispatching network-vif-plugged-aea70d63-158f-4f6e-ac36-1c342bd5be4d {{(pid=75045) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 23:19:41 user nova-compute[75045]: WARNING nova.compute.manager [req-acd95181-9b12-450d-a24f-3c984b72c206 req-4298fa25-8a34-4627-9e11-20896b63d129 service nova] [instance: b9bd3096-92eb-4aae-8619-2725ed9acc2b] Received unexpected event network-vif-plugged-aea70d63-158f-4f6e-ac36-1c342bd5be4d for instance with vm_state deleted and task_state None.
Nov 08 23:19:41 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:19:41 user nova-compute[75045]: DEBUG nova.compute.provider_tree [None req-c2951d46-db33-418e-8d19-8bedafa6b90b tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Inventory has not changed in ProviderTree for provider: 62ba5f85-c74d-4b58-986e-d4197e813fd7 {{(pid=75045) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 23:19:41 user nova-compute[75045]: DEBUG nova.scheduler.client.report [None req-c2951d46-db33-418e-8d19-8bedafa6b90b tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Inventory has not changed for provider 62ba5f85-c74d-4b58-986e-d4197e813fd7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75045) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 23:19:41 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-c2951d46-db33-418e-8d19-8bedafa6b90b tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.653s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:19:41 user nova-compute[75045]: DEBUG nova.compute.manager [None req-c2951d46-db33-418e-8d19-8bedafa6b90b tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] [instance: 032e20aa-8887-4215-808e-68299a0d8d0b] Start building networks asynchronously for instance. {{(pid=75045) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 23:19:41 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-23d5342e-214c-4f05-9f2b-678dc4b21567 tempest-AttachSCSIVolumeTestJSON-1576344526 tempest-AttachSCSIVolumeTestJSON-1576344526-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.260s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:19:41 user nova-compute[75045]: DEBUG nova.compute.manager [None req-c2951d46-db33-418e-8d19-8bedafa6b90b tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] [instance: 032e20aa-8887-4215-808e-68299a0d8d0b] Allocating IP information in the background. {{(pid=75045) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 23:19:41 user nova-compute[75045]: DEBUG nova.network.neutron [None req-c2951d46-db33-418e-8d19-8bedafa6b90b tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] [instance: 032e20aa-8887-4215-808e-68299a0d8d0b] allocate_for_instance() {{(pid=75045) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 23:19:41 user nova-compute[75045]: INFO nova.virt.libvirt.driver [None req-c2951d46-db33-418e-8d19-8bedafa6b90b tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] [instance: 032e20aa-8887-4215-808e-68299a0d8d0b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 23:19:41 user nova-compute[75045]: DEBUG nova.compute.manager [None req-c2951d46-db33-418e-8d19-8bedafa6b90b tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] [instance: 032e20aa-8887-4215-808e-68299a0d8d0b] Start building block device mappings for instance. {{(pid=75045) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 23:19:42 user nova-compute[75045]: DEBUG nova.policy [None req-c2951d46-db33-418e-8d19-8bedafa6b90b tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '75fc508f268d4a569ad78598ff019c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e63623113f11463d9035bb990de43510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75045) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 23:19:42 user nova-compute[75045]: DEBUG nova.compute.manager [None req-c2951d46-db33-418e-8d19-8bedafa6b90b tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] [instance: 032e20aa-8887-4215-808e-68299a0d8d0b] Start spawning the instance on the hypervisor. {{(pid=75045) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 23:19:42 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-c2951d46-db33-418e-8d19-8bedafa6b90b tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] [instance: 032e20aa-8887-4215-808e-68299a0d8d0b] Creating instance directory {{(pid=75045) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 23:19:42 user nova-compute[75045]: INFO nova.virt.libvirt.driver [None req-c2951d46-db33-418e-8d19-8bedafa6b90b tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] [instance: 032e20aa-8887-4215-808e-68299a0d8d0b] Creating image(s)
Nov 08 23:19:42 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-c2951d46-db33-418e-8d19-8bedafa6b90b tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Acquiring lock "/opt/stack/data/nova/instances/032e20aa-8887-4215-808e-68299a0d8d0b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:19:42 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-c2951d46-db33-418e-8d19-8bedafa6b90b tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Lock "/opt/stack/data/nova/instances/032e20aa-8887-4215-808e-68299a0d8d0b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:19:42 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-c2951d46-db33-418e-8d19-8bedafa6b90b tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Lock "/opt/stack/data/nova/instances/032e20aa-8887-4215-808e-68299a0d8d0b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:19:42 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-c2951d46-db33-418e-8d19-8bedafa6b90b tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b59f52a99fff51c56dd1edfb83892fb8f647f2f3 --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:19:42 user nova-compute[75045]: DEBUG nova.compute.provider_tree [None req-23d5342e-214c-4f05-9f2b-678dc4b21567 tempest-AttachSCSIVolumeTestJSON-1576344526 tempest-AttachSCSIVolumeTestJSON-1576344526-project-member] Inventory has not changed in ProviderTree for provider: 62ba5f85-c74d-4b58-986e-d4197e813fd7 {{(pid=75045) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 23:19:42 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-c2951d46-db33-418e-8d19-8bedafa6b90b tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b59f52a99fff51c56dd1edfb83892fb8f647f2f3 --force-share --output=json" returned: 0 in 0.203s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:19:42 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-c2951d46-db33-418e-8d19-8bedafa6b90b tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Acquiring lock "b59f52a99fff51c56dd1edfb83892fb8f647f2f3" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:19:42 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-c2951d46-db33-418e-8d19-8bedafa6b90b tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Lock "b59f52a99fff51c56dd1edfb83892fb8f647f2f3" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:19:42 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-c2951d46-db33-418e-8d19-8bedafa6b90b tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b59f52a99fff51c56dd1edfb83892fb8f647f2f3 --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:19:42 user nova-compute[75045]: DEBUG nova.scheduler.client.report [None req-23d5342e-214c-4f05-9f2b-678dc4b21567 tempest-AttachSCSIVolumeTestJSON-1576344526 tempest-AttachSCSIVolumeTestJSON-1576344526-project-member] Inventory has not changed for provider 62ba5f85-c74d-4b58-986e-d4197e813fd7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75045) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 23:19:42 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-23d5342e-214c-4f05-9f2b-678dc4b21567 tempest-AttachSCSIVolumeTestJSON-1576344526 tempest-AttachSCSIVolumeTestJSON-1576344526-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.570s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:19:42 user nova-compute[75045]: INFO nova.scheduler.client.report [None req-23d5342e-214c-4f05-9f2b-678dc4b21567 tempest-AttachSCSIVolumeTestJSON-1576344526 tempest-AttachSCSIVolumeTestJSON-1576344526-project-member] Deleted allocations for instance b9bd3096-92eb-4aae-8619-2725ed9acc2b
Nov 08 23:19:42 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-c2951d46-db33-418e-8d19-8bedafa6b90b tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b59f52a99fff51c56dd1edfb83892fb8f647f2f3 --force-share --output=json" returned: 0 in 0.203s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:19:42 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-c2951d46-db33-418e-8d19-8bedafa6b90b tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b59f52a99fff51c56dd1edfb83892fb8f647f2f3,backing_fmt=raw /opt/stack/data/nova/instances/032e20aa-8887-4215-808e-68299a0d8d0b/disk 1073741824 {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:19:42 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-c2951d46-db33-418e-8d19-8bedafa6b90b tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b59f52a99fff51c56dd1edfb83892fb8f647f2f3,backing_fmt=raw /opt/stack/data/nova/instances/032e20aa-8887-4215-808e-68299a0d8d0b/disk 1073741824" returned: 0 in 0.079s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:19:42 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-c2951d46-db33-418e-8d19-8bedafa6b90b tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Lock "b59f52a99fff51c56dd1edfb83892fb8f647f2f3" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.293s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:19:42 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-c2951d46-db33-418e-8d19-8bedafa6b90b tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b59f52a99fff51c56dd1edfb83892fb8f647f2f3 --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:19:42 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-23d5342e-214c-4f05-9f2b-678dc4b21567 tempest-AttachSCSIVolumeTestJSON-1576344526 tempest-AttachSCSIVolumeTestJSON-1576344526-project-member] Lock "b9bd3096-92eb-4aae-8619-2725ed9acc2b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.891s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:19:42 user nova-compute[75045]: DEBUG nova.network.neutron [None req-c2951d46-db33-418e-8d19-8bedafa6b90b tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] [instance: 032e20aa-8887-4215-808e-68299a0d8d0b] Successfully created port: 9cd2b9ae-f99a-4f33-8b8b-e2013d3c05e6 {{(pid=75045) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 23:19:42 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-c2951d46-db33-418e-8d19-8bedafa6b90b tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b59f52a99fff51c56dd1edfb83892fb8f647f2f3 --force-share --output=json" returned: 0 in 0.234s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:19:42 user nova-compute[75045]: DEBUG nova.virt.disk.api [None req-c2951d46-db33-418e-8d19-8bedafa6b90b tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Checking if we can resize image /opt/stack/data/nova/instances/032e20aa-8887-4215-808e-68299a0d8d0b/disk. size=1073741824 {{(pid=75045) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 23:19:42 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-c2951d46-db33-418e-8d19-8bedafa6b90b tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/032e20aa-8887-4215-808e-68299a0d8d0b/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:19:43 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-c2951d46-db33-418e-8d19-8bedafa6b90b tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/032e20aa-8887-4215-808e-68299a0d8d0b/disk --force-share --output=json" returned: 0 in 0.240s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:19:43 user nova-compute[75045]: DEBUG nova.virt.disk.api [None req-c2951d46-db33-418e-8d19-8bedafa6b90b tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Cannot resize image /opt/stack/data/nova/instances/032e20aa-8887-4215-808e-68299a0d8d0b/disk to a smaller size. {{(pid=75045) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 08 23:19:43 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-c2951d46-db33-418e-8d19-8bedafa6b90b tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] [instance: 032e20aa-8887-4215-808e-68299a0d8d0b] Created local disks {{(pid=75045) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 23:19:43 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-c2951d46-db33-418e-8d19-8bedafa6b90b tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] [instance: 032e20aa-8887-4215-808e-68299a0d8d0b] Ensure instance console log exists: /opt/stack/data/nova/instances/032e20aa-8887-4215-808e-68299a0d8d0b/console.log {{(pid=75045) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 23:19:43 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-c2951d46-db33-418e-8d19-8bedafa6b90b tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:19:43 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-c2951d46-db33-418e-8d19-8bedafa6b90b tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:19:43 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-c2951d46-db33-418e-8d19-8bedafa6b90b tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:19:43 user nova-compute[75045]: DEBUG nova.network.neutron [None req-c2951d46-db33-418e-8d19-8bedafa6b90b tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] [instance: 032e20aa-8887-4215-808e-68299a0d8d0b] Successfully updated port: 9cd2b9ae-f99a-4f33-8b8b-e2013d3c05e6 {{(pid=75045) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 23:19:43 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-c2951d46-db33-418e-8d19-8bedafa6b90b tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Acquiring lock "refresh_cache-032e20aa-8887-4215-808e-68299a0d8d0b" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 23:19:43 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-c2951d46-db33-418e-8d19-8bedafa6b90b tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Acquired lock "refresh_cache-032e20aa-8887-4215-808e-68299a0d8d0b" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 23:19:43 user nova-compute[75045]: DEBUG nova.network.neutron [None req-c2951d46-db33-418e-8d19-8bedafa6b90b tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] [instance: 032e20aa-8887-4215-808e-68299a0d8d0b] Building network info cache for instance {{(pid=75045) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 23:19:43 user nova-compute[75045]: DEBUG nova.network.neutron [None req-c2951d46-db33-418e-8d19-8bedafa6b90b tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] [instance: 032e20aa-8887-4215-808e-68299a0d8d0b] Instance cache missing network info. {{(pid=75045) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 23:19:43 user nova-compute[75045]: DEBUG nova.compute.manager [req-63472e00-01a2-4f0c-a101-28f8544a7bf7 req-39260d2a-4b34-42e2-ae57-2a387099b64e service nova] [instance: d2c911cf-d5f4-4c19-8335-8c7834184a7e] Received event network-vif-plugged-f4321c52-b9d5-434c-820f-25cab4239ef4 {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:19:43 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-63472e00-01a2-4f0c-a101-28f8544a7bf7 req-39260d2a-4b34-42e2-ae57-2a387099b64e service nova] Acquiring lock "d2c911cf-d5f4-4c19-8335-8c7834184a7e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:19:43 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-63472e00-01a2-4f0c-a101-28f8544a7bf7 req-39260d2a-4b34-42e2-ae57-2a387099b64e service nova] Lock "d2c911cf-d5f4-4c19-8335-8c7834184a7e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:19:43 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-63472e00-01a2-4f0c-a101-28f8544a7bf7 req-39260d2a-4b34-42e2-ae57-2a387099b64e service nova] Lock "d2c911cf-d5f4-4c19-8335-8c7834184a7e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:19:43 user nova-compute[75045]: DEBUG nova.compute.manager [req-63472e00-01a2-4f0c-a101-28f8544a7bf7 req-39260d2a-4b34-42e2-ae57-2a387099b64e service nova] [instance: d2c911cf-d5f4-4c19-8335-8c7834184a7e] No waiting events found dispatching network-vif-plugged-f4321c52-b9d5-434c-820f-25cab4239ef4 {{(pid=75045) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 23:19:43 user nova-compute[75045]: WARNING nova.compute.manager [req-63472e00-01a2-4f0c-a101-28f8544a7bf7 req-39260d2a-4b34-42e2-ae57-2a387099b64e service nova] [instance: d2c911cf-d5f4-4c19-8335-8c7834184a7e] Received unexpected event network-vif-plugged-f4321c52-b9d5-434c-820f-25cab4239ef4 for instance with vm_state building and task_state spawning.
Nov 08 23:19:43 user nova-compute[75045]: DEBUG nova.compute.manager [req-63472e00-01a2-4f0c-a101-28f8544a7bf7 req-39260d2a-4b34-42e2-ae57-2a387099b64e service nova] [instance: d2c911cf-d5f4-4c19-8335-8c7834184a7e] Received event network-vif-plugged-f4321c52-b9d5-434c-820f-25cab4239ef4 {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:19:43 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-63472e00-01a2-4f0c-a101-28f8544a7bf7 req-39260d2a-4b34-42e2-ae57-2a387099b64e service nova] Acquiring lock "d2c911cf-d5f4-4c19-8335-8c7834184a7e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:19:43 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-63472e00-01a2-4f0c-a101-28f8544a7bf7 req-39260d2a-4b34-42e2-ae57-2a387099b64e service nova] Lock "d2c911cf-d5f4-4c19-8335-8c7834184a7e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:19:43 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-63472e00-01a2-4f0c-a101-28f8544a7bf7 req-39260d2a-4b34-42e2-ae57-2a387099b64e service nova] Lock "d2c911cf-d5f4-4c19-8335-8c7834184a7e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:19:43 user nova-compute[75045]: DEBUG nova.compute.manager [req-63472e00-01a2-4f0c-a101-28f8544a7bf7 req-39260d2a-4b34-42e2-ae57-2a387099b64e service nova] [instance: d2c911cf-d5f4-4c19-8335-8c7834184a7e] No waiting events found dispatching network-vif-plugged-f4321c52-b9d5-434c-820f-25cab4239ef4 {{(pid=75045) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 23:19:43 user nova-compute[75045]: WARNING nova.compute.manager [req-63472e00-01a2-4f0c-a101-28f8544a7bf7 req-39260d2a-4b34-42e2-ae57-2a387099b64e service nova] [instance: d2c911cf-d5f4-4c19-8335-8c7834184a7e] Received unexpected event network-vif-plugged-f4321c52-b9d5-434c-820f-25cab4239ef4 for instance with vm_state building and task_state spawning.
Nov 08 23:19:43 user nova-compute[75045]: DEBUG nova.compute.manager [req-63472e00-01a2-4f0c-a101-28f8544a7bf7 req-39260d2a-4b34-42e2-ae57-2a387099b64e service nova] [instance: 032e20aa-8887-4215-808e-68299a0d8d0b] Received event network-changed-9cd2b9ae-f99a-4f33-8b8b-e2013d3c05e6 {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:19:43 user nova-compute[75045]: DEBUG nova.compute.manager [req-63472e00-01a2-4f0c-a101-28f8544a7bf7 req-39260d2a-4b34-42e2-ae57-2a387099b64e service nova] [instance: 032e20aa-8887-4215-808e-68299a0d8d0b] Refreshing instance network info cache due to event network-changed-9cd2b9ae-f99a-4f33-8b8b-e2013d3c05e6. {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 23:19:43 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-63472e00-01a2-4f0c-a101-28f8544a7bf7 req-39260d2a-4b34-42e2-ae57-2a387099b64e service nova] Acquiring lock "refresh_cache-032e20aa-8887-4215-808e-68299a0d8d0b" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 23:19:43 user nova-compute[75045]: DEBUG nova.compute.manager [None req-082394c4-e179-437a-8b30-c03773aae2a3 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] [instance: d2c911cf-d5f4-4c19-8335-8c7834184a7e] Instance event wait completed in 0 seconds for  {{(pid=75045) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 23:19:43 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-082394c4-e179-437a-8b30-c03773aae2a3 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] [instance: d2c911cf-d5f4-4c19-8335-8c7834184a7e] Guest created on hypervisor {{(pid=75045) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 23:19:43 user nova-compute[75045]: INFO nova.virt.libvirt.driver [-] [instance: d2c911cf-d5f4-4c19-8335-8c7834184a7e] Instance spawned successfully.
Nov 08 23:19:43 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-082394c4-e179-437a-8b30-c03773aae2a3 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] [instance: d2c911cf-d5f4-4c19-8335-8c7834184a7e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75045) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 23:19:43 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-082394c4-e179-437a-8b30-c03773aae2a3 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] [instance: d2c911cf-d5f4-4c19-8335-8c7834184a7e] Found default for hw_cdrom_bus of ide {{(pid=75045) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 23:19:43 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-082394c4-e179-437a-8b30-c03773aae2a3 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] [instance: d2c911cf-d5f4-4c19-8335-8c7834184a7e] Found default for hw_disk_bus of virtio {{(pid=75045) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 23:19:43 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-082394c4-e179-437a-8b30-c03773aae2a3 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] [instance: d2c911cf-d5f4-4c19-8335-8c7834184a7e] Found default for hw_input_bus of None {{(pid=75045) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 23:19:43 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-082394c4-e179-437a-8b30-c03773aae2a3 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] [instance: d2c911cf-d5f4-4c19-8335-8c7834184a7e] Found default for hw_pointer_model of None {{(pid=75045) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 23:19:43 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-082394c4-e179-437a-8b30-c03773aae2a3 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] [instance: d2c911cf-d5f4-4c19-8335-8c7834184a7e] Found default for hw_video_model of virtio {{(pid=75045) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 23:19:43 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-082394c4-e179-437a-8b30-c03773aae2a3 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] [instance: d2c911cf-d5f4-4c19-8335-8c7834184a7e] Found default for hw_vif_model of virtio {{(pid=75045) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 23:19:43 user nova-compute[75045]: DEBUG nova.network.neutron [None req-c2951d46-db33-418e-8d19-8bedafa6b90b tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] [instance: 032e20aa-8887-4215-808e-68299a0d8d0b] Updating instance_info_cache with network_info: [{"id": "9cd2b9ae-f99a-4f33-8b8b-e2013d3c05e6", "address": "fa:16:3e:df:66:51", "network": {"id": "700b5784-d35b-45c0-a4d3-1ab8aa4c48aa", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-194469807-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e63623113f11463d9035bb990de43510", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9cd2b9ae-f9", "ovs_interfaceid": "9cd2b9ae-f99a-4f33-8b8b-e2013d3c05e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75045) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 23:19:43 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-c2951d46-db33-418e-8d19-8bedafa6b90b tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Releasing lock "refresh_cache-032e20aa-8887-4215-808e-68299a0d8d0b" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 23:19:43 user nova-compute[75045]: DEBUG nova.compute.manager [None req-c2951d46-db33-418e-8d19-8bedafa6b90b tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] [instance: 032e20aa-8887-4215-808e-68299a0d8d0b] Instance network_info: |[{"id": "9cd2b9ae-f99a-4f33-8b8b-e2013d3c05e6", "address": "fa:16:3e:df:66:51", "network": {"id": "700b5784-d35b-45c0-a4d3-1ab8aa4c48aa", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-194469807-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e63623113f11463d9035bb990de43510", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9cd2b9ae-f9", "ovs_interfaceid": "9cd2b9ae-f99a-4f33-8b8b-e2013d3c05e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75045) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 23:19:43 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-63472e00-01a2-4f0c-a101-28f8544a7bf7 req-39260d2a-4b34-42e2-ae57-2a387099b64e service nova] Acquired lock "refresh_cache-032e20aa-8887-4215-808e-68299a0d8d0b" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 23:19:43 user nova-compute[75045]: DEBUG nova.network.neutron [req-63472e00-01a2-4f0c-a101-28f8544a7bf7 req-39260d2a-4b34-42e2-ae57-2a387099b64e service nova] [instance: 032e20aa-8887-4215-808e-68299a0d8d0b] Refreshing network info cache for port 9cd2b9ae-f99a-4f33-8b8b-e2013d3c05e6 {{(pid=75045) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 23:19:43 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-c2951d46-db33-418e-8d19-8bedafa6b90b tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] [instance: 032e20aa-8887-4215-808e-68299a0d8d0b] Start _get_guest_xml network_info=[{"id": "9cd2b9ae-f99a-4f33-8b8b-e2013d3c05e6", "address": "fa:16:3e:df:66:51", "network": {"id": "700b5784-d35b-45c0-a4d3-1ab8aa4c48aa", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-194469807-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e63623113f11463d9035bb990de43510", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9cd2b9ae-f9", "ovs_interfaceid": "9cd2b9ae-f99a-4f33-8b8b-e2013d3c05e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T23:11:54Z,direct_url=<?>,disk_format='qcow2',id=a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b1beba2cc4e7465ea249e2225fb494dc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T23:11:56Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'disk_bus': 'virtio', 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': 'a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75045) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 23:19:43 user nova-compute[75045]: WARNING nova.virt.libvirt.driver [None req-c2951d46-db33-418e-8d19-8bedafa6b90b tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 23:19:43 user nova-compute[75045]: WARNING nova.virt.libvirt.driver [None req-c2951d46-db33-418e-8d19-8bedafa6b90b tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 23:19:43 user nova-compute[75045]: DEBUG nova.virt.libvirt.host [None req-c2951d46-db33-418e-8d19-8bedafa6b90b tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75045) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 23:19:43 user nova-compute[75045]: DEBUG nova.virt.libvirt.host [None req-c2951d46-db33-418e-8d19-8bedafa6b90b tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] CPU controller missing on host. {{(pid=75045) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 23:19:43 user nova-compute[75045]: DEBUG nova.virt.libvirt.host [None req-c2951d46-db33-418e-8d19-8bedafa6b90b tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75045) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 23:19:43 user nova-compute[75045]: DEBUG nova.virt.libvirt.host [None req-c2951d46-db33-418e-8d19-8bedafa6b90b tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] CPU controller found on host. {{(pid=75045) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 23:19:43 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-c2951d46-db33-418e-8d19-8bedafa6b90b tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75045) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 23:19:43 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-c2951d46-db33-418e-8d19-8bedafa6b90b tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T23:11:41Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T23:11:54Z,direct_url=<?>,disk_format='qcow2',id=a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b1beba2cc4e7465ea249e2225fb494dc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T23:11:56Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75045) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 23:19:43 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-c2951d46-db33-418e-8d19-8bedafa6b90b tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Flavor limits 0:0:0 {{(pid=75045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 23:19:43 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-c2951d46-db33-418e-8d19-8bedafa6b90b tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Image limits 0:0:0 {{(pid=75045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 23:19:43 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-c2951d46-db33-418e-8d19-8bedafa6b90b tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Flavor pref 0:0:0 {{(pid=75045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 23:19:43 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-c2951d46-db33-418e-8d19-8bedafa6b90b tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Image pref 0:0:0 {{(pid=75045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 23:19:43 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-c2951d46-db33-418e-8d19-8bedafa6b90b tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 23:19:43 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-c2951d46-db33-418e-8d19-8bedafa6b90b tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75045) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 23:19:43 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-c2951d46-db33-418e-8d19-8bedafa6b90b tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75045) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 23:19:43 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-c2951d46-db33-418e-8d19-8bedafa6b90b tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Got 1 possible topologies {{(pid=75045) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 23:19:43 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-c2951d46-db33-418e-8d19-8bedafa6b90b tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75045) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 23:19:43 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-c2951d46-db33-418e-8d19-8bedafa6b90b tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75045) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 23:19:43 user nova-compute[75045]: DEBUG nova.virt.libvirt.vif [None req-c2951d46-db33-418e-8d19-8bedafa6b90b tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T23:19:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1752899834',display_name='tempest-tempest.common.compute-instance-1752899834',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1752899834',id=14,image_ref='a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM+q2m9WsZpZxsu7IWDJqTSDAyt9zen9gZBXmCH3tBzXyeyKdTBcMPy8pYQxPGeGnPRc+jFEID8sOJopOMmrv8cAChFAOof4/DA6j4PlbpQ3YcCnU4/0PdUKZbkLWBt7Jg==',key_name='tempest-keypair-1151386852',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e63623113f11463d9035bb990de43510',ramdisk_id='',reservation_id='r-vxqzthcz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-2056815713',owner_user_name='tempest-ServerActionsTestOtherA-2056815713-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T23:19:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='75fc508f268d4a569ad78598ff019c14',uuid=032e20aa-8887-4215-808e-68299a0d8d0b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9cd2b9ae-f99a-4f33-8b8b-e2013d3c05e6", "address": "fa:16:3e:df:66:51", "network": {"id": "700b5784-d35b-45c0-a4d3-1ab8aa4c48aa", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-194469807-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e63623113f11463d9035bb990de43510", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9cd2b9ae-f9", "ovs_interfaceid": "9cd2b9ae-f99a-4f33-8b8b-e2013d3c05e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75045) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 23:19:43 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-c2951d46-db33-418e-8d19-8bedafa6b90b tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Converting VIF {"id": "9cd2b9ae-f99a-4f33-8b8b-e2013d3c05e6", "address": "fa:16:3e:df:66:51", "network": {"id": "700b5784-d35b-45c0-a4d3-1ab8aa4c48aa", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-194469807-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e63623113f11463d9035bb990de43510", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9cd2b9ae-f9", "ovs_interfaceid": "9cd2b9ae-f99a-4f33-8b8b-e2013d3c05e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 23:19:43 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-c2951d46-db33-418e-8d19-8bedafa6b90b tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:df:66:51,bridge_name='br-int',has_traffic_filtering=True,id=9cd2b9ae-f99a-4f33-8b8b-e2013d3c05e6,network=Network(700b5784-d35b-45c0-a4d3-1ab8aa4c48aa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9cd2b9ae-f9') {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 23:19:43 user nova-compute[75045]: DEBUG nova.objects.instance [None req-c2951d46-db33-418e-8d19-8bedafa6b90b tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Lazy-loading 'pci_devices' on Instance uuid 032e20aa-8887-4215-808e-68299a0d8d0b {{(pid=75045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 23:19:43 user nova-compute[75045]: INFO nova.compute.manager [None req-082394c4-e179-437a-8b30-c03773aae2a3 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] [instance: d2c911cf-d5f4-4c19-8335-8c7834184a7e] Took 6.74 seconds to spawn the instance on the hypervisor.
Nov 08 23:19:43 user nova-compute[75045]: DEBUG nova.compute.manager [None req-082394c4-e179-437a-8b30-c03773aae2a3 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] [instance: d2c911cf-d5f4-4c19-8335-8c7834184a7e] Checking state {{(pid=75045) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 23:19:43 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-c2951d46-db33-418e-8d19-8bedafa6b90b tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] [instance: 032e20aa-8887-4215-808e-68299a0d8d0b] End _get_guest_xml xml=<domain type="kvm">
Nov 08 23:19:43 user nova-compute[75045]:   <uuid>032e20aa-8887-4215-808e-68299a0d8d0b</uuid>
Nov 08 23:19:43 user nova-compute[75045]:   <name>instance-0000000e</name>
Nov 08 23:19:43 user nova-compute[75045]:   <memory>524288</memory>
Nov 08 23:19:43 user nova-compute[75045]:   <vcpu>1</vcpu>
Nov 08 23:19:43 user nova-compute[75045]:   <metadata>
Nov 08 23:19:43 user nova-compute[75045]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 23:19:43 user nova-compute[75045]:       <nova:package version="0.0.0"/>
Nov 08 23:19:43 user nova-compute[75045]:       <nova:name>tempest-tempest.common.compute-instance-1752899834</nova:name>
Nov 08 23:19:43 user nova-compute[75045]:       <nova:creationTime>2023-11-08 23:19:43</nova:creationTime>
Nov 08 23:19:43 user nova-compute[75045]:       <nova:flavor name="m1.tiny">
Nov 08 23:19:43 user nova-compute[75045]:         <nova:memory>512</nova:memory>
Nov 08 23:19:43 user nova-compute[75045]:         <nova:disk>1</nova:disk>
Nov 08 23:19:43 user nova-compute[75045]:         <nova:swap>0</nova:swap>
Nov 08 23:19:43 user nova-compute[75045]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 23:19:43 user nova-compute[75045]:         <nova:vcpus>1</nova:vcpus>
Nov 08 23:19:43 user nova-compute[75045]:       </nova:flavor>
Nov 08 23:19:43 user nova-compute[75045]:       <nova:owner>
Nov 08 23:19:43 user nova-compute[75045]:         <nova:user uuid="75fc508f268d4a569ad78598ff019c14">tempest-ServerActionsTestOtherA-2056815713-project-member</nova:user>
Nov 08 23:19:43 user nova-compute[75045]:         <nova:project uuid="e63623113f11463d9035bb990de43510">tempest-ServerActionsTestOtherA-2056815713</nova:project>
Nov 08 23:19:43 user nova-compute[75045]:       </nova:owner>
Nov 08 23:19:43 user nova-compute[75045]:       <nova:root type="image" uuid="a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb"/>
Nov 08 23:19:43 user nova-compute[75045]:       <nova:ports>
Nov 08 23:19:43 user nova-compute[75045]:         <nova:port uuid="9cd2b9ae-f99a-4f33-8b8b-e2013d3c05e6">
Nov 08 23:19:43 user nova-compute[75045]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 08 23:19:43 user nova-compute[75045]:         </nova:port>
Nov 08 23:19:43 user nova-compute[75045]:       </nova:ports>
Nov 08 23:19:43 user nova-compute[75045]:     </nova:instance>
Nov 08 23:19:43 user nova-compute[75045]:   </metadata>
Nov 08 23:19:43 user nova-compute[75045]:   <sysinfo type="smbios">
Nov 08 23:19:43 user nova-compute[75045]:     <system>
Nov 08 23:19:43 user nova-compute[75045]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 23:19:43 user nova-compute[75045]:       <entry name="product">OpenStack Nova</entry>
Nov 08 23:19:43 user nova-compute[75045]:       <entry name="version">0.0.0</entry>
Nov 08 23:19:43 user nova-compute[75045]:       <entry name="serial">032e20aa-8887-4215-808e-68299a0d8d0b</entry>
Nov 08 23:19:43 user nova-compute[75045]:       <entry name="uuid">032e20aa-8887-4215-808e-68299a0d8d0b</entry>
Nov 08 23:19:43 user nova-compute[75045]:       <entry name="family">Virtual Machine</entry>
Nov 08 23:19:43 user nova-compute[75045]:     </system>
Nov 08 23:19:43 user nova-compute[75045]:   </sysinfo>
Nov 08 23:19:43 user nova-compute[75045]:   <os>
Nov 08 23:19:43 user nova-compute[75045]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 23:19:43 user nova-compute[75045]:     <boot dev="hd"/>
Nov 08 23:19:43 user nova-compute[75045]:     <smbios mode="sysinfo"/>
Nov 08 23:19:43 user nova-compute[75045]:   </os>
Nov 08 23:19:43 user nova-compute[75045]:   <features>
Nov 08 23:19:43 user nova-compute[75045]:     <acpi/>
Nov 08 23:19:43 user nova-compute[75045]:     <apic/>
Nov 08 23:19:43 user nova-compute[75045]:     <vmcoreinfo/>
Nov 08 23:19:43 user nova-compute[75045]:   </features>
Nov 08 23:19:43 user nova-compute[75045]:   <clock offset="utc">
Nov 08 23:19:43 user nova-compute[75045]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 23:19:43 user nova-compute[75045]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 23:19:43 user nova-compute[75045]:     <timer name="hpet" present="no"/>
Nov 08 23:19:43 user nova-compute[75045]:   </clock>
Nov 08 23:19:43 user nova-compute[75045]:   <cpu mode="custom" match="exact">
Nov 08 23:19:43 user nova-compute[75045]:     <model>Nehalem</model>
Nov 08 23:19:43 user nova-compute[75045]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 23:19:43 user nova-compute[75045]:   </cpu>
Nov 08 23:19:43 user nova-compute[75045]:   <devices>
Nov 08 23:19:43 user nova-compute[75045]:     <disk type="file" device="disk">
Nov 08 23:19:43 user nova-compute[75045]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 23:19:43 user nova-compute[75045]:       <source file="/opt/stack/data/nova/instances/032e20aa-8887-4215-808e-68299a0d8d0b/disk"/>
Nov 08 23:19:43 user nova-compute[75045]:       <target dev="vda" bus="virtio"/>
Nov 08 23:19:43 user nova-compute[75045]:     </disk>
Nov 08 23:19:43 user nova-compute[75045]:     <interface type="ethernet">
Nov 08 23:19:43 user nova-compute[75045]:       <mac address="fa:16:3e:df:66:51"/>
Nov 08 23:19:43 user nova-compute[75045]:       <model type="virtio"/>
Nov 08 23:19:43 user nova-compute[75045]:       <mtu size="1442"/>
Nov 08 23:19:43 user nova-compute[75045]:       <target dev="tap9cd2b9ae-f9"/>
Nov 08 23:19:43 user nova-compute[75045]:     </interface>
Nov 08 23:19:43 user nova-compute[75045]:     <serial type="pty">
Nov 08 23:19:43 user nova-compute[75045]:       <log file="/opt/stack/data/nova/instances/032e20aa-8887-4215-808e-68299a0d8d0b/console.log" append="off"/>
Nov 08 23:19:43 user nova-compute[75045]:     </serial>
Nov 08 23:19:43 user nova-compute[75045]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 23:19:43 user nova-compute[75045]:     <video>
Nov 08 23:19:43 user nova-compute[75045]:       <model type="virtio"/>
Nov 08 23:19:43 user nova-compute[75045]:     </video>
Nov 08 23:19:43 user nova-compute[75045]:     <rng model="virtio">
Nov 08 23:19:43 user nova-compute[75045]:       <backend model="random">/dev/urandom</backend>
Nov 08 23:19:43 user nova-compute[75045]:     </rng>
Nov 08 23:19:43 user nova-compute[75045]:     <controller type="usb" index="0" model="none"/>
Nov 08 23:19:43 user nova-compute[75045]:     <memballoon model="virtio">
Nov 08 23:19:43 user nova-compute[75045]:       <stats period="10"/>
Nov 08 23:19:43 user nova-compute[75045]:     </memballoon>
Nov 08 23:19:43 user nova-compute[75045]:   </devices>
Nov 08 23:19:43 user nova-compute[75045]: </domain>
Nov 08 23:19:43 user nova-compute[75045]:  {{(pid=75045) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 23:19:43 user nova-compute[75045]: DEBUG nova.virt.libvirt.vif [None req-c2951d46-db33-418e-8d19-8bedafa6b90b tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T23:19:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1752899834',display_name='tempest-tempest.common.compute-instance-1752899834',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1752899834',id=14,image_ref='a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM+q2m9WsZpZxsu7IWDJqTSDAyt9zen9gZBXmCH3tBzXyeyKdTBcMPy8pYQxPGeGnPRc+jFEID8sOJopOMmrv8cAChFAOof4/DA6j4PlbpQ3YcCnU4/0PdUKZbkLWBt7Jg==',key_name='tempest-keypair-1151386852',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e63623113f11463d9035bb990de43510',ramdisk_id='',reservation_id='r-vxqzthcz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-2056815713',owner_user_name='tempest-ServerActionsTestOtherA-2056815713-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T23:19:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='75fc508f268d4a569ad78598ff019c14',uuid=032e20aa-8887-4215-808e-68299a0d8d0b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9cd2b9ae-f99a-4f33-8b8b-e2013d3c05e6", "address": "fa:16:3e:df:66:51", "network": {"id": "700b5784-d35b-45c0-a4d3-1ab8aa4c48aa", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-194469807-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e63623113f11463d9035bb990de43510", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9cd2b9ae-f9", "ovs_interfaceid": "9cd2b9ae-f99a-4f33-8b8b-e2013d3c05e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75045) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 23:19:43 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-c2951d46-db33-418e-8d19-8bedafa6b90b tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Converting VIF {"id": "9cd2b9ae-f99a-4f33-8b8b-e2013d3c05e6", "address": "fa:16:3e:df:66:51", "network": {"id": "700b5784-d35b-45c0-a4d3-1ab8aa4c48aa", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-194469807-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e63623113f11463d9035bb990de43510", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9cd2b9ae-f9", "ovs_interfaceid": "9cd2b9ae-f99a-4f33-8b8b-e2013d3c05e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 23:19:43 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-c2951d46-db33-418e-8d19-8bedafa6b90b tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:df:66:51,bridge_name='br-int',has_traffic_filtering=True,id=9cd2b9ae-f99a-4f33-8b8b-e2013d3c05e6,network=Network(700b5784-d35b-45c0-a4d3-1ab8aa4c48aa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9cd2b9ae-f9') {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 23:19:43 user nova-compute[75045]: DEBUG os_vif [None req-c2951d46-db33-418e-8d19-8bedafa6b90b tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:df:66:51,bridge_name='br-int',has_traffic_filtering=True,id=9cd2b9ae-f99a-4f33-8b8b-e2013d3c05e6,network=Network(700b5784-d35b-45c0-a4d3-1ab8aa4c48aa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9cd2b9ae-f9') {{(pid=75045) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 23:19:43 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:19:43 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:19:43 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 23:19:43 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:19:43 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd5aa8d43-4bad-5e40-84b6-e61495b4fa74', '_type': 'linux-noop'}}, row=False) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:19:43 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 23:19:43 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:19:43 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9cd2b9ae-f9, may_exist=True, interface_attrs={}) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:19:43 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9cd2b9ae-f9, col_values=(('qos', UUID('bb55dbcd-bee4-4825-b793-de14cf5c4f3e')),), if_exists=True) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:19:43 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9cd2b9ae-f9, col_values=(('external_ids', {'iface-id': '9cd2b9ae-f99a-4f33-8b8b-e2013d3c05e6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:df:66:51', 'vm-uuid': '032e20aa-8887-4215-808e-68299a0d8d0b'}),), if_exists=True) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:19:44 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 23:19:44 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:19:44 user nova-compute[75045]: INFO os_vif [None req-c2951d46-db33-418e-8d19-8bedafa6b90b tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:df:66:51,bridge_name='br-int',has_traffic_filtering=True,id=9cd2b9ae-f99a-4f33-8b8b-e2013d3c05e6,network=Network(700b5784-d35b-45c0-a4d3-1ab8aa4c48aa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9cd2b9ae-f9')
Nov 08 23:19:44 user nova-compute[75045]: INFO nova.compute.manager [None req-082394c4-e179-437a-8b30-c03773aae2a3 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] [instance: d2c911cf-d5f4-4c19-8335-8c7834184a7e] Took 72.05 seconds to build instance.
Nov 08 23:19:44 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-c2951d46-db33-418e-8d19-8bedafa6b90b tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] No BDM found with device name vda, not building metadata. {{(pid=75045) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 23:19:44 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-c2951d46-db33-418e-8d19-8bedafa6b90b tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] No VIF found with MAC fa:16:3e:df:66:51, not building metadata {{(pid=75045) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 23:19:44 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-082394c4-e179-437a-8b30-c03773aae2a3 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Lock "d2c911cf-d5f4-4c19-8335-8c7834184a7e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 72.151s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:19:44 user nova-compute[75045]: DEBUG nova.network.neutron [req-63472e00-01a2-4f0c-a101-28f8544a7bf7 req-39260d2a-4b34-42e2-ae57-2a387099b64e service nova] [instance: 032e20aa-8887-4215-808e-68299a0d8d0b] Updated VIF entry in instance network info cache for port 9cd2b9ae-f99a-4f33-8b8b-e2013d3c05e6. {{(pid=75045) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 23:19:44 user nova-compute[75045]: DEBUG nova.network.neutron [req-63472e00-01a2-4f0c-a101-28f8544a7bf7 req-39260d2a-4b34-42e2-ae57-2a387099b64e service nova] [instance: 032e20aa-8887-4215-808e-68299a0d8d0b] Updating instance_info_cache with network_info: [{"id": "9cd2b9ae-f99a-4f33-8b8b-e2013d3c05e6", "address": "fa:16:3e:df:66:51", "network": {"id": "700b5784-d35b-45c0-a4d3-1ab8aa4c48aa", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-194469807-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e63623113f11463d9035bb990de43510", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9cd2b9ae-f9", "ovs_interfaceid": "9cd2b9ae-f99a-4f33-8b8b-e2013d3c05e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75045) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 23:19:44 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-63472e00-01a2-4f0c-a101-28f8544a7bf7 req-39260d2a-4b34-42e2-ae57-2a387099b64e service nova] Releasing lock "refresh_cache-032e20aa-8887-4215-808e-68299a0d8d0b" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 23:19:45 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:19:45 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:19:45 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:19:45 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:19:45 user nova-compute[75045]: DEBUG nova.compute.manager [req-0307521c-6a1a-44f7-b3cb-1210a5748e68 req-0acb4ed1-6e2b-4ea7-aeaa-2c303ec5eb30 service nova] [instance: 032e20aa-8887-4215-808e-68299a0d8d0b] Received event network-vif-plugged-9cd2b9ae-f99a-4f33-8b8b-e2013d3c05e6 {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:19:45 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-0307521c-6a1a-44f7-b3cb-1210a5748e68 req-0acb4ed1-6e2b-4ea7-aeaa-2c303ec5eb30 service nova] Acquiring lock "032e20aa-8887-4215-808e-68299a0d8d0b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:19:45 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-0307521c-6a1a-44f7-b3cb-1210a5748e68 req-0acb4ed1-6e2b-4ea7-aeaa-2c303ec5eb30 service nova] Lock "032e20aa-8887-4215-808e-68299a0d8d0b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:19:45 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-0307521c-6a1a-44f7-b3cb-1210a5748e68 req-0acb4ed1-6e2b-4ea7-aeaa-2c303ec5eb30 service nova] Lock "032e20aa-8887-4215-808e-68299a0d8d0b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:19:45 user nova-compute[75045]: DEBUG nova.compute.manager [req-0307521c-6a1a-44f7-b3cb-1210a5748e68 req-0acb4ed1-6e2b-4ea7-aeaa-2c303ec5eb30 service nova] [instance: 032e20aa-8887-4215-808e-68299a0d8d0b] No waiting events found dispatching network-vif-plugged-9cd2b9ae-f99a-4f33-8b8b-e2013d3c05e6 {{(pid=75045) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 23:19:45 user nova-compute[75045]: WARNING nova.compute.manager [req-0307521c-6a1a-44f7-b3cb-1210a5748e68 req-0acb4ed1-6e2b-4ea7-aeaa-2c303ec5eb30 service nova] [instance: 032e20aa-8887-4215-808e-68299a0d8d0b] Received unexpected event network-vif-plugged-9cd2b9ae-f99a-4f33-8b8b-e2013d3c05e6 for instance with vm_state building and task_state spawning.
Nov 08 23:19:45 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:19:45 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:19:47 user nova-compute[75045]: DEBUG nova.compute.manager [None req-c2951d46-db33-418e-8d19-8bedafa6b90b tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] [instance: 032e20aa-8887-4215-808e-68299a0d8d0b] Instance event wait completed in 0 seconds for  {{(pid=75045) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 23:19:47 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-c2951d46-db33-418e-8d19-8bedafa6b90b tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] [instance: 032e20aa-8887-4215-808e-68299a0d8d0b] Guest created on hypervisor {{(pid=75045) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 23:19:47 user nova-compute[75045]: INFO nova.virt.libvirt.driver [-] [instance: 032e20aa-8887-4215-808e-68299a0d8d0b] Instance spawned successfully.
Nov 08 23:19:47 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-c2951d46-db33-418e-8d19-8bedafa6b90b tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] [instance: 032e20aa-8887-4215-808e-68299a0d8d0b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75045) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 23:19:47 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-c2951d46-db33-418e-8d19-8bedafa6b90b tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] [instance: 032e20aa-8887-4215-808e-68299a0d8d0b] Found default for hw_cdrom_bus of ide {{(pid=75045) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 23:19:47 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-c2951d46-db33-418e-8d19-8bedafa6b90b tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] [instance: 032e20aa-8887-4215-808e-68299a0d8d0b] Found default for hw_disk_bus of virtio {{(pid=75045) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 23:19:47 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-c2951d46-db33-418e-8d19-8bedafa6b90b tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] [instance: 032e20aa-8887-4215-808e-68299a0d8d0b] Found default for hw_input_bus of None {{(pid=75045) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 23:19:47 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-c2951d46-db33-418e-8d19-8bedafa6b90b tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] [instance: 032e20aa-8887-4215-808e-68299a0d8d0b] Found default for hw_pointer_model of None {{(pid=75045) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 23:19:47 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-c2951d46-db33-418e-8d19-8bedafa6b90b tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] [instance: 032e20aa-8887-4215-808e-68299a0d8d0b] Found default for hw_video_model of virtio {{(pid=75045) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 23:19:47 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-c2951d46-db33-418e-8d19-8bedafa6b90b tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] [instance: 032e20aa-8887-4215-808e-68299a0d8d0b] Found default for hw_vif_model of virtio {{(pid=75045) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 23:19:47 user nova-compute[75045]: INFO nova.compute.manager [None req-c2951d46-db33-418e-8d19-8bedafa6b90b tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] [instance: 032e20aa-8887-4215-808e-68299a0d8d0b] Took 5.75 seconds to spawn the instance on the hypervisor.
Nov 08 23:19:47 user nova-compute[75045]: DEBUG nova.compute.manager [None req-c2951d46-db33-418e-8d19-8bedafa6b90b tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] [instance: 032e20aa-8887-4215-808e-68299a0d8d0b] Checking state {{(pid=75045) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 23:19:47 user nova-compute[75045]: DEBUG nova.compute.manager [req-aaf2c1e8-f739-4dd3-a197-250fa6a2ae2d req-558230c7-e560-4fe3-8576-f5f215eb6e01 service nova] [instance: 032e20aa-8887-4215-808e-68299a0d8d0b] Received event network-vif-plugged-9cd2b9ae-f99a-4f33-8b8b-e2013d3c05e6 {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:19:47 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-aaf2c1e8-f739-4dd3-a197-250fa6a2ae2d req-558230c7-e560-4fe3-8576-f5f215eb6e01 service nova] Acquiring lock "032e20aa-8887-4215-808e-68299a0d8d0b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:19:47 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-aaf2c1e8-f739-4dd3-a197-250fa6a2ae2d req-558230c7-e560-4fe3-8576-f5f215eb6e01 service nova] Lock "032e20aa-8887-4215-808e-68299a0d8d0b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:19:47 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-aaf2c1e8-f739-4dd3-a197-250fa6a2ae2d req-558230c7-e560-4fe3-8576-f5f215eb6e01 service nova] Lock "032e20aa-8887-4215-808e-68299a0d8d0b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:19:47 user nova-compute[75045]: DEBUG nova.compute.manager [req-aaf2c1e8-f739-4dd3-a197-250fa6a2ae2d req-558230c7-e560-4fe3-8576-f5f215eb6e01 service nova] [instance: 032e20aa-8887-4215-808e-68299a0d8d0b] No waiting events found dispatching network-vif-plugged-9cd2b9ae-f99a-4f33-8b8b-e2013d3c05e6 {{(pid=75045) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 23:19:47 user nova-compute[75045]: WARNING nova.compute.manager [req-aaf2c1e8-f739-4dd3-a197-250fa6a2ae2d req-558230c7-e560-4fe3-8576-f5f215eb6e01 service nova] [instance: 032e20aa-8887-4215-808e-68299a0d8d0b] Received unexpected event network-vif-plugged-9cd2b9ae-f99a-4f33-8b8b-e2013d3c05e6 for instance with vm_state building and task_state spawning.
Nov 08 23:19:47 user nova-compute[75045]: INFO nova.compute.manager [None req-c2951d46-db33-418e-8d19-8bedafa6b90b tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] [instance: 032e20aa-8887-4215-808e-68299a0d8d0b] Took 6.79 seconds to build instance.
Nov 08 23:19:47 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-c2951d46-db33-418e-8d19-8bedafa6b90b tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Lock "032e20aa-8887-4215-808e-68299a0d8d0b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.944s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:19:49 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:19:49 user nova-compute[75045]: DEBUG nova.compute.manager [None req-0e7deb14-eb81-45e0-9c30-1322b63950a4 tempest-TestVolumeSwap-1091185069 tempest-TestVolumeSwap-1091185069-project-admin] [instance: fde91f7c-31e3-456c-b252-6ce37fa3b600] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:c7f7084f-f0d7-4d4b-9a14-69065a9c3e41', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mCxrFhHs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'fde91f7c-31e3-456c-b252-6ce37fa3b600', 'attached_at': '', 'detached_at': '', 'volume_id': 'c7f7084f-f0d7-4d4b-9a14-69065a9c3e41', 'serial': 'c7f7084f-f0d7-4d4b-9a14-69065a9c3e41'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:4d7a4df0-bfc5-4952-8454-97b703b68f28', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MzmZAnHp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, 'status': 'reserved', 'instance': 'fde91f7c-31e3-456c-b252-6ce37fa3b600', 'attached_at': '', 'detached_at': '', 'volume_id': '4d7a4df0-bfc5-4952-8454-97b703b68f28', 'serial'} {{(pid=75045) _swap_volume /opt/stack/nova/nova/compute/manager.py:7782}}
Nov 08 23:19:49 user nova-compute[75045]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0e7deb14-eb81-45e0-9c30-1322b63950a4 tempest-TestVolumeSwap-1091185069 tempest-TestVolumeSwap-1091185069-project-admin] [instance: fde91f7c-31e3-456c-b252-6ce37fa3b600] Calling os-brick to attach iSCSI Volume {{(pid=75045) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 23:19:49 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e7deb14-eb81-45e0-9c30-1322b63950a4 tempest-TestVolumeSwap-1091185069 tempest-TestVolumeSwap-1091185069-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1b68210460>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c7f7084f-f0d7-4d4b-9a14-69065a9c3e41', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mCxrFhHs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75045) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 23:19:49 user nova-compute[75045]: WARNING os_brick.initiator.connectors.base [None req-0e7deb14-eb81-45e0-9c30-1322b63950a4 tempest-TestVolumeSwap-1091185069 tempest-TestVolumeSwap-1091185069-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 23:19:49 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-0e7deb14-eb81-45e0-9c30-1322b63950a4 tempest-TestVolumeSwap-1091185069 tempest-TestVolumeSwap-1091185069-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 23:19:49 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-0e7deb14-eb81-45e0-9c30-1322b63950a4 tempest-TestVolumeSwap-1091185069 tempest-TestVolumeSwap-1091185069-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 23:19:49 user nova-compute[75045]: WARNING os_brick.initiator.connectors.base [None req-0e7deb14-eb81-45e0-9c30-1322b63950a4 tempest-TestVolumeSwap-1091185069 tempest-TestVolumeSwap-1091185069-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 23:19:49 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-0e7deb14-eb81-45e0-9c30-1322b63950a4 tempest-TestVolumeSwap-1091185069 tempest-TestVolumeSwap-1091185069-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c7f7084f-f0d7-4d4b-9a14-69065a9c3e41" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 23:19:49 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-0e7deb14-eb81-45e0-9c30-1322b63950a4 tempest-TestVolumeSwap-1091185069 tempest-TestVolumeSwap-1091185069-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c7f7084f-f0d7-4d4b-9a14-69065a9c3e41" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 23:19:49 user nova-compute[75045]: INFO os_brick.initiator.connectors.iscsi [None req-0e7deb14-eb81-45e0-9c30-1322b63950a4 tempest-TestVolumeSwap-1091185069 tempest-TestVolumeSwap-1091185069-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 23:19:49 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7f7084f-f0d7-4d4b-9a14-69065a9c3e41 -p 172.16.0.220:3260 {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:19:49 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7f7084f-f0d7-4d4b-9a14-69065a9c3e41 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:19:49 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d2bc311-092d-4b93-a5bb-f7f2871ecfd9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:19:49 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e7deb14-eb81-45e0-9c30-1322b63950a4 tempest-TestVolumeSwap-1091185069 tempest-TestVolumeSwap-1091185069-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 23:19:49 user nova-compute[75045]:  {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:19:49 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7f7084f-f0d7-4d4b-9a14-69065a9c3e41 -p 172.16.0.220:3260 --interface default --op new {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:19:49 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7f7084f-f0d7-4d4b-9a14-69065a9c3e41 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:19:49 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[624d07ae-668d-4880-8157-32ee7713f328]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c7f7084f-f0d7-4d4b-9a14-69065a9c3e41] added\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:19:49 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e7deb14-eb81-45e0-9c30-1322b63950a4 tempest-TestVolumeSwap-1091185069 tempest-TestVolumeSwap-1091185069-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c7f7084f-f0d7-4d4b-9a14-69065a9c3e41] added
Nov 08 23:19:49 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:19:49 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7f7084f-f0d7-4d4b-9a14-69065a9c3e41 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:19:49 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7f7084f-f0d7-4d4b-9a14-69065a9c3e41 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:19:49 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[32c0acf5-16e9-43cc-9eb7-db0985359420]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:19:49 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e7deb14-eb81-45e0-9c30-1322b63950a4 tempest-TestVolumeSwap-1091185069 tempest-TestVolumeSwap-1091185069-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:19:49 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7f7084f-f0d7-4d4b-9a14-69065a9c3e41 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:19:49 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7f7084f-f0d7-4d4b-9a14-69065a9c3e41 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:19:49 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[33db21f0-0288-443f-9cd6-c9b6470a6576]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:19:49 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e7deb14-eb81-45e0-9c30-1322b63950a4 tempest-TestVolumeSwap-1091185069 tempest-TestVolumeSwap-1091185069-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:19:49 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7f7084f-f0d7-4d4b-9a14-69065a9c3e41 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mCxrFhHs {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:19:49 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7f7084f-f0d7-4d4b-9a14-69065a9c3e41 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mCxrFhHs" returned: 0 in 0.018s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:19:49 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[df5e4c89-ac1e-4732-b62f-31c737305e2f]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:19:49 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e7deb14-eb81-45e0-9c30-1322b63950a4 tempest-TestVolumeSwap-1091185069 tempest-TestVolumeSwap-1091185069-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'mCxrFhHs'): stdout= stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:19:49 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7f7084f-f0d7-4d4b-9a14-69065a9c3e41 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:19:49 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7f7084f-f0d7-4d4b-9a14-69065a9c3e41 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:19:49 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[0db95ce2-e771-420e-9e32-82479847e2a2]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:19:49 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e7deb14-eb81-45e0-9c30-1322b63950a4 tempest-TestVolumeSwap-1091185069 tempest-TestVolumeSwap-1091185069-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:19:49 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:19:49 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:19:49 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a2123b7-0d3e-4052-bf81-921ef5383f12]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d2ff5d0-0b89-42ba-92eb-1e12c9cce205 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d7a4df0-bfc5-4952-8454-97b703b68f28 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f829f03c-8f1a-45f1-a715-b9d769201d1b (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:528866cb-30dd-40ac-9a81-4c6afc93cdd9 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:175bb2c0-7767-4740-9350-7e3300681a43 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ed77146-5ae0-400d-8116-7f9eb1322808 (non-flash)\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:19:49 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e7deb14-eb81-45e0-9c30-1322b63950a4 tempest-TestVolumeSwap-1091185069 tempest-TestVolumeSwap-1091185069-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d2ff5d0-0b89-42ba-92eb-1e12c9cce205 (non-flash)
Nov 08 23:19:49 user nova-compute[75045]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab (non-flash)
Nov 08 23:19:49 user nova-compute[75045]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d7a4df0-bfc5-4952-8454-97b703b68f28 (non-flash)
Nov 08 23:19:49 user nova-compute[75045]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f829f03c-8f1a-45f1-a715-b9d769201d1b (non-flash)
Nov 08 23:19:49 user nova-compute[75045]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:528866cb-30dd-40ac-9a81-4c6afc93cdd9 (non-flash)
Nov 08 23:19:49 user nova-compute[75045]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:175bb2c0-7767-4740-9350-7e3300681a43 (non-flash)
Nov 08 23:19:49 user nova-compute[75045]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ed77146-5ae0-400d-8116-7f9eb1322808 (non-flash)
Nov 08 23:19:49 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 23:19:49 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e7deb14-eb81-45e0-9c30-1322b63950a4 tempest-TestVolumeSwap-1091185069 tempest-TestVolumeSwap-1091185069-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d2ff5d0-0b89-42ba-92eb-1e12c9cce205 (non-flash)
Nov 08 23:19:49 user nova-compute[75045]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab (non-flash)
Nov 08 23:19:49 user nova-compute[75045]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d7a4df0-bfc5-4952-8454-97b703b68f28 (non-flash)
Nov 08 23:19:49 user nova-compute[75045]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f829f03c-8f1a-45f1-a715-b9d769201d1b (non-flash)
Nov 08 23:19:49 user nova-compute[75045]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:528866cb-30dd-40ac-9a81-4c6afc93cdd9 (non-flash)
Nov 08 23:19:49 user nova-compute[75045]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:175bb2c0-7767-4740-9350-7e3300681a43 (non-flash)
Nov 08 23:19:49 user nova-compute[75045]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ed77146-5ae0-400d-8116-7f9eb1322808 (non-flash)
Nov 08 23:19:49 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 23:19:49 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7f7084f-f0d7-4d4b-9a14-69065a9c3e41 -p 172.16.0.220:3260 --login {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:19:49 user nova-compute[75045]: INFO nova.virt.block_device [None req-e0694800-7d06-4e31-a22b-eb1868d5bda7 tempest-VolumesAssistedSnapshotsTest-1482710492 tempest-VolumesAssistedSnapshotsTest-1482710492-project-admin] [instance: 07ec2c05-aaa9-46e8-8439-7aa5b9fca19d] Attempting to driver detach volume f829f03c-8f1a-45f1-a715-b9d769201d1b from mountpoint /dev/vdb
Nov 08 23:19:49 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7f7084f-f0d7-4d4b-9a14-69065a9c3e41 -p 172.16.0.220:3260 --login" returned: 0 in 0.087s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:19:49 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[bde7b814-73bd-442e-b206-4ccc1f5b3bbb]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c7f7084f-f0d7-4d4b-9a14-69065a9c3e41, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c7f7084f-f0d7-4d4b-9a14-69065a9c3e41, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:19:49 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e7deb14-eb81-45e0-9c30-1322b63950a4 tempest-TestVolumeSwap-1091185069 tempest-TestVolumeSwap-1091185069-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c7f7084f-f0d7-4d4b-9a14-69065a9c3e41, portal: 172.16.0.220,3260]
Nov 08 23:19:49 user nova-compute[75045]: Login to [iface: default, target: iqn.2010-10.org.openstack:c7f7084f-f0d7-4d4b-9a14-69065a9c3e41, portal: 172.16.0.220,3260] successful.
Nov 08 23:19:49 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:19:49 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7f7084f-f0d7-4d4b-9a14-69065a9c3e41 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:19:49 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-e0694800-7d06-4e31-a22b-eb1868d5bda7 tempest-VolumesAssistedSnapshotsTest-1482710492 tempest-VolumesAssistedSnapshotsTest-1482710492-project-admin] Attempting to detach device vdb from instance 07ec2c05-aaa9-46e8-8439-7aa5b9fca19d from the persistent domain config. {{(pid=75045) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 08 23:19:49 user nova-compute[75045]: DEBUG nova.virt.libvirt.guest [None req-e0694800-7d06-4e31-a22b-eb1868d5bda7 tempest-VolumesAssistedSnapshotsTest-1482710492 tempest-VolumesAssistedSnapshotsTest-1482710492-project-admin] detach device xml: <disk type="block" device="disk">
Nov 08 23:19:49 user nova-compute[75045]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 23:19:49 user nova-compute[75045]:   <source dev="/dev/sde"/>
Nov 08 23:19:49 user nova-compute[75045]:   <target dev="vdb" bus="virtio"/>
Nov 08 23:19:49 user nova-compute[75045]:   <serial>f829f03c-8f1a-45f1-a715-b9d769201d1b</serial>
Nov 08 23:19:49 user nova-compute[75045]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 08 23:19:49 user nova-compute[75045]: </disk>
Nov 08 23:19:49 user nova-compute[75045]:  {{(pid=75045) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 23:19:49 user nova-compute[75045]: INFO nova.virt.libvirt.driver [None req-e0694800-7d06-4e31-a22b-eb1868d5bda7 tempest-VolumesAssistedSnapshotsTest-1482710492 tempest-VolumesAssistedSnapshotsTest-1482710492-project-admin] Successfully detached device vdb from instance 07ec2c05-aaa9-46e8-8439-7aa5b9fca19d from the persistent domain config.
Nov 08 23:19:49 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-e0694800-7d06-4e31-a22b-eb1868d5bda7 tempest-VolumesAssistedSnapshotsTest-1482710492 tempest-VolumesAssistedSnapshotsTest-1482710492-project-admin] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 07ec2c05-aaa9-46e8-8439-7aa5b9fca19d from the live domain config. {{(pid=75045) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 08 23:19:49 user nova-compute[75045]: DEBUG nova.virt.libvirt.guest [None req-e0694800-7d06-4e31-a22b-eb1868d5bda7 tempest-VolumesAssistedSnapshotsTest-1482710492 tempest-VolumesAssistedSnapshotsTest-1482710492-project-admin] detach device xml: <disk type="block" device="disk">
Nov 08 23:19:49 user nova-compute[75045]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 23:19:49 user nova-compute[75045]:   <source dev="/dev/sde"/>
Nov 08 23:19:49 user nova-compute[75045]:   <target dev="vdb" bus="virtio"/>
Nov 08 23:19:49 user nova-compute[75045]:   <serial>f829f03c-8f1a-45f1-a715-b9d769201d1b</serial>
Nov 08 23:19:49 user nova-compute[75045]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 08 23:19:49 user nova-compute[75045]: </disk>
Nov 08 23:19:49 user nova-compute[75045]:  {{(pid=75045) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 23:19:49 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7f7084f-f0d7-4d4b-9a14-69065a9c3e41 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:19:49 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[6912f9d9-65cd-47fa-90c9-f786848daf6d]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:19:49 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e7deb14-eb81-45e0-9c30-1322b63950a4 tempest-TestVolumeSwap-1091185069 tempest-TestVolumeSwap-1091185069-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:19:49 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:19:49 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.043s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:19:49 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc5dac5e-91cc-4c15-9496-b058992508ef]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d2ff5d0-0b89-42ba-92eb-1e12c9cce205 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7f7084f-f0d7-4d4b-9a14-69065a9c3e41 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d7a4df0-bfc5-4952-8454-97b703b68f28 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f829f03c-8f1a-45f1-a715-b9d769201d1b (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:528866cb-30dd-40ac-9a81-4c6afc93cdd9 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:175bb2c0-7767-4740-9350-7e3300681a43 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ed77146-5ae0-400d-8116-7f9eb1322808 (non-flash)\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:19:49 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e7deb14-eb81-45e0-9c30-1322b63950a4 tempest-TestVolumeSwap-1091185069 tempest-TestVolumeSwap-1091185069-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d2ff5d0-0b89-42ba-92eb-1e12c9cce205 (non-flash)
Nov 08 23:19:49 user nova-compute[75045]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab (non-flash)
Nov 08 23:19:49 user nova-compute[75045]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7f7084f-f0d7-4d4b-9a14-69065a9c3e41 (non-flash)
Nov 08 23:19:49 user nova-compute[75045]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d7a4df0-bfc5-4952-8454-97b703b68f28 (non-flash)
Nov 08 23:19:49 user nova-compute[75045]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f829f03c-8f1a-45f1-a715-b9d769201d1b (non-flash)
Nov 08 23:19:49 user nova-compute[75045]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:528866cb-30dd-40ac-9a81-4c6afc93cdd9 (non-flash)
Nov 08 23:19:49 user nova-compute[75045]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:175bb2c0-7767-4740-9350-7e3300681a43 (non-flash)
Nov 08 23:19:49 user nova-compute[75045]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ed77146-5ae0-400d-8116-7f9eb1322808 (non-flash)
Nov 08 23:19:49 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 23:19:49 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e7deb14-eb81-45e0-9c30-1322b63950a4 tempest-TestVolumeSwap-1091185069 tempest-TestVolumeSwap-1091185069-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d2ff5d0-0b89-42ba-92eb-1e12c9cce205 (non-flash)
Nov 08 23:19:49 user nova-compute[75045]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab (non-flash)
Nov 08 23:19:49 user nova-compute[75045]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7f7084f-f0d7-4d4b-9a14-69065a9c3e41 (non-flash)
Nov 08 23:19:49 user nova-compute[75045]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d7a4df0-bfc5-4952-8454-97b703b68f28 (non-flash)
Nov 08 23:19:49 user nova-compute[75045]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f829f03c-8f1a-45f1-a715-b9d769201d1b (non-flash)
Nov 08 23:19:49 user nova-compute[75045]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:528866cb-30dd-40ac-9a81-4c6afc93cdd9 (non-flash)
Nov 08 23:19:49 user nova-compute[75045]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:175bb2c0-7767-4740-9350-7e3300681a43 (non-flash)
Nov 08 23:19:49 user nova-compute[75045]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ed77146-5ae0-400d-8116-7f9eb1322808 (non-flash)
Nov 08 23:19:49 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 23:19:49 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-0e7deb14-eb81-45e0-9c30-1322b63950a4 tempest-TestVolumeSwap-1091185069 tempest-TestVolumeSwap-1091185069-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c7f7084f-f0d7-4d4b-9a14-69065a9c3e41" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.361s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 23:19:49 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e7deb14-eb81-45e0-9c30-1322b63950a4 tempest-TestVolumeSwap-1091185069 tempest-TestVolumeSwap-1091185069-project-admin] Connected to 172.16.0.220:3260 {{(pid=75045) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 23:19:49 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-0e7deb14-eb81-45e0-9c30-1322b63950a4 tempest-TestVolumeSwap-1091185069 tempest-TestVolumeSwap-1091185069-project-admin] HCTL ('40', '-', '-', 0) found on session 12 with lun 0 {{(pid=75045) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 23:19:49 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-0e7deb14-eb81-45e0-9c30-1322b63950a4 tempest-TestVolumeSwap-1091185069 tempest-TestVolumeSwap-1091185069-project-admin] Scanning host 40 c: -, t: -, l: 0) {{(pid=75045) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 23:19:49 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host40/scan {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:19:49 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host40/scan" returned: 0 in 0.017s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:19:49 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[96965c6e-9e27-4e98-9603-5004cfa36cdc]: (4, ('- - 0', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:19:49 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-0e7deb14-eb81-45e0-9c30-1322b63950a4 tempest-TestVolumeSwap-1091185069 tempest-TestVolumeSwap-1091185069-project-admin] Searching for a device in session 12 and hctl ['40', '*', '*', 0] yield: sdi {{(pid=75045) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 23:19:49 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e7deb14-eb81-45e0-9c30-1322b63950a4 tempest-TestVolumeSwap-1091185069 tempest-TestVolumeSwap-1091185069-project-admin] Connected to sdi using {'target_iqn': 'iqn.2010-10.org.openstack:c7f7084f-f0d7-4d4b-9a14-69065a9c3e41', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mCxrFhHs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75045) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 23:19:49 user nova-compute[75045]: INFO nova.virt.block_device [None req-cd1d6b86-2aa1-4ecb-8c4e-1cf5c01f7fa0 tempest-TaggedAttachmentsTest-1639503389 tempest-TaggedAttachmentsTest-1639503389-project-member] [instance: 1cb1b440-0073-4a53-a0a2-e2781e021866] Attempting to driver detach volume 528866cb-30dd-40ac-9a81-4c6afc93cdd9 from mountpoint /dev/vdb
Nov 08 23:19:49 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-cd1d6b86-2aa1-4ecb-8c4e-1cf5c01f7fa0 tempest-TaggedAttachmentsTest-1639503389 tempest-TaggedAttachmentsTest-1639503389-project-member] Attempting to detach device vdb from instance 1cb1b440-0073-4a53-a0a2-e2781e021866 from the persistent domain config. {{(pid=75045) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 08 23:19:49 user nova-compute[75045]: DEBUG nova.virt.libvirt.guest [None req-cd1d6b86-2aa1-4ecb-8c4e-1cf5c01f7fa0 tempest-TaggedAttachmentsTest-1639503389 tempest-TaggedAttachmentsTest-1639503389-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 23:19:49 user nova-compute[75045]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 23:19:49 user nova-compute[75045]:   <source dev="/dev/sdf"/>
Nov 08 23:19:49 user nova-compute[75045]:   <target dev="vdb" bus="virtio"/>
Nov 08 23:19:49 user nova-compute[75045]:   <serial>528866cb-30dd-40ac-9a81-4c6afc93cdd9</serial>
Nov 08 23:19:49 user nova-compute[75045]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 08 23:19:49 user nova-compute[75045]: </disk>
Nov 08 23:19:49 user nova-compute[75045]:  {{(pid=75045) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 23:19:49 user nova-compute[75045]: INFO nova.virt.libvirt.driver [None req-cd1d6b86-2aa1-4ecb-8c4e-1cf5c01f7fa0 tempest-TaggedAttachmentsTest-1639503389 tempest-TaggedAttachmentsTest-1639503389-project-member] Successfully detached device vdb from instance 1cb1b440-0073-4a53-a0a2-e2781e021866 from the persistent domain config.
Nov 08 23:19:49 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-cd1d6b86-2aa1-4ecb-8c4e-1cf5c01f7fa0 tempest-TaggedAttachmentsTest-1639503389 tempest-TaggedAttachmentsTest-1639503389-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 1cb1b440-0073-4a53-a0a2-e2781e021866 from the live domain config. {{(pid=75045) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 08 23:19:49 user nova-compute[75045]: DEBUG nova.virt.libvirt.guest [None req-cd1d6b86-2aa1-4ecb-8c4e-1cf5c01f7fa0 tempest-TaggedAttachmentsTest-1639503389 tempest-TaggedAttachmentsTest-1639503389-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 23:19:49 user nova-compute[75045]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 23:19:49 user nova-compute[75045]:   <source dev="/dev/sdf"/>
Nov 08 23:19:49 user nova-compute[75045]:   <target dev="vdb" bus="virtio"/>
Nov 08 23:19:49 user nova-compute[75045]:   <serial>528866cb-30dd-40ac-9a81-4c6afc93cdd9</serial>
Nov 08 23:19:49 user nova-compute[75045]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 08 23:19:49 user nova-compute[75045]: </disk>
Nov 08 23:19:49 user nova-compute[75045]:  {{(pid=75045) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 23:19:49 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-e0694800-7d06-4e31-a22b-eb1868d5bda7 tempest-VolumesAssistedSnapshotsTest-1482710492 tempest-VolumesAssistedSnapshotsTest-1482710492-project-admin] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 07ec2c05-aaa9-46e8-8439-7aa5b9fca19d {{(pid=75045) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 08 23:19:50 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-cd1d6b86-2aa1-4ecb-8c4e-1cf5c01f7fa0 tempest-TaggedAttachmentsTest-1639503389 tempest-TaggedAttachmentsTest-1639503389-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 1cb1b440-0073-4a53-a0a2-e2781e021866 {{(pid=75045) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 08 23:19:50 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-0e7deb14-eb81-45e0-9c30-1322b63950a4 tempest-TestVolumeSwap-1091185069 tempest-TestVolumeSwap-1091185069-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.416s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 23:19:50 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e7deb14-eb81-45e0-9c30-1322b63950a4 tempest-TestVolumeSwap-1091185069 tempest-TestVolumeSwap-1091185069-project-admin] <== connect_volume: return (1418ms) {'type': 'block', 'scsi_wwn': '26361656562346263', 'path': '/dev/sdi'} {{(pid=75045) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 23:19:50 user nova-compute[75045]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0e7deb14-eb81-45e0-9c30-1322b63950a4 tempest-TestVolumeSwap-1091185069 tempest-TestVolumeSwap-1091185069-project-admin] [instance: fde91f7c-31e3-456c-b252-6ce37fa3b600] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26361656562346263', 'path': '/dev/sdi'} {{(pid=75045) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 23:19:50 user nova-compute[75045]: DEBUG nova.objects.instance [None req-0e7deb14-eb81-45e0-9c30-1322b63950a4 tempest-TestVolumeSwap-1091185069 tempest-TestVolumeSwap-1091185069-project-admin] Lazy-loading 'flavor' on Instance uuid fde91f7c-31e3-456c-b252-6ce37fa3b600 {{(pid=75045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 23:19:50 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:19:51 user nova-compute[75045]: DEBUG nova.virt.libvirt.guest [None req-0e7deb14-eb81-45e0-9c30-1322b63950a4 tempest-TestVolumeSwap-1091185069 tempest-TestVolumeSwap-1091185069-project-admin] COPY block job progress, current cursor: 0 final cursor: 1073741824 {{(pid=75045) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 08 23:19:51 user nova-compute[75045]: DEBUG nova.virt.libvirt.guest [None req-0e7deb14-eb81-45e0-9c30-1322b63950a4 tempest-TestVolumeSwap-1091185069 tempest-TestVolumeSwap-1091185069-project-admin] COPY block job progress, current cursor: 124780544 final cursor: 1073741824 {{(pid=75045) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 08 23:19:52 user nova-compute[75045]: DEBUG nova.virt.libvirt.guest [None req-0e7deb14-eb81-45e0-9c30-1322b63950a4 tempest-TestVolumeSwap-1091185069 tempest-TestVolumeSwap-1091185069-project-admin] COPY block job progress, current cursor: 284164096 final cursor: 1073741824 {{(pid=75045) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 08 23:19:52 user nova-compute[75045]: DEBUG nova.virt.libvirt.guest [None req-0e7deb14-eb81-45e0-9c30-1322b63950a4 tempest-TestVolumeSwap-1091185069 tempest-TestVolumeSwap-1091185069-project-admin] COPY block job progress, current cursor: 411041792 final cursor: 1073741824 {{(pid=75045) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 08 23:19:53 user nova-compute[75045]: DEBUG nova.virt.libvirt.guest [None req-0e7deb14-eb81-45e0-9c30-1322b63950a4 tempest-TestVolumeSwap-1091185069 tempest-TestVolumeSwap-1091185069-project-admin] COPY block job progress, current cursor: 574619648 final cursor: 1073741824 {{(pid=75045) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 08 23:19:53 user nova-compute[75045]: DEBUG nova.virt.libvirt.guest [None req-0e7deb14-eb81-45e0-9c30-1322b63950a4 tempest-TestVolumeSwap-1091185069 tempest-TestVolumeSwap-1091185069-project-admin] COPY block job progress, current cursor: 675282944 final cursor: 1073741824 {{(pid=75045) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 08 23:19:54 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:19:54 user nova-compute[75045]: DEBUG nova.virt.libvirt.guest [None req-0e7deb14-eb81-45e0-9c30-1322b63950a4 tempest-TestVolumeSwap-1091185069 tempest-TestVolumeSwap-1091185069-project-admin] COPY block job progress, current cursor: 781189120 final cursor: 1073741824 {{(pid=75045) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 08 23:19:54 user nova-compute[75045]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cc2764da-d4bb-4f4b-b69a-c9c557549c98 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262-project-member] [instance: 82bc5fd0-26c7-4f81-b966-54831393b617] Calling os-brick to attach iSCSI Volume {{(pid=75045) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 23:19:54 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc2764da-d4bb-4f4b-b69a-c9c557549c98 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1b68210460>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:1bec3976-0b2c-436e-9c4a-eeb6b8badbae', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dPxsmzhw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75045) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 23:19:54 user nova-compute[75045]: WARNING os_brick.initiator.connectors.base [None req-cc2764da-d4bb-4f4b-b69a-c9c557549c98 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 23:19:54 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-cc2764da-d4bb-4f4b-b69a-c9c557549c98 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 23:19:54 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-cc2764da-d4bb-4f4b-b69a-c9c557549c98 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 23:19:54 user nova-compute[75045]: WARNING os_brick.initiator.connectors.base [None req-cc2764da-d4bb-4f4b-b69a-c9c557549c98 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 23:19:54 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-cc2764da-d4bb-4f4b-b69a-c9c557549c98 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1bec3976-0b2c-436e-9c4a-eeb6b8badbae" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 23:19:54 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-cc2764da-d4bb-4f4b-b69a-c9c557549c98 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1bec3976-0b2c-436e-9c4a-eeb6b8badbae" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 23:19:54 user nova-compute[75045]: INFO os_brick.initiator.connectors.iscsi [None req-cc2764da-d4bb-4f4b-b69a-c9c557549c98 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 23:19:54 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1bec3976-0b2c-436e-9c4a-eeb6b8badbae -p 172.16.0.220:3260 {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:19:54 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1bec3976-0b2c-436e-9c4a-eeb6b8badbae -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:19:54 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5d30d8a-8ba9-4144-97fa-b4ab6e5050b0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:19:54 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc2764da-d4bb-4f4b-b69a-c9c557549c98 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 23:19:54 user nova-compute[75045]:  {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:19:54 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1bec3976-0b2c-436e-9c4a-eeb6b8badbae -p 172.16.0.220:3260 --interface default --op new {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:19:54 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1bec3976-0b2c-436e-9c4a-eeb6b8badbae -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.030s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:19:54 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[03189b36-60df-415b-9094-31bcb7bd1734]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1bec3976-0b2c-436e-9c4a-eeb6b8badbae] added\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:19:54 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc2764da-d4bb-4f4b-b69a-c9c557549c98 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1bec3976-0b2c-436e-9c4a-eeb6b8badbae] added
Nov 08 23:19:54 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:19:54 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1bec3976-0b2c-436e-9c4a-eeb6b8badbae -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:19:54 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1bec3976-0b2c-436e-9c4a-eeb6b8badbae -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.029s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:19:54 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf8c5ffe-8c96-4311-819b-4e18888ef6af]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:19:54 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc2764da-d4bb-4f4b-b69a-c9c557549c98 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:19:54 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1bec3976-0b2c-436e-9c4a-eeb6b8badbae -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:19:54 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1bec3976-0b2c-436e-9c4a-eeb6b8badbae -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:19:54 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[ede7287b-904b-45c0-b884-0e522b0b7afb]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:19:54 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc2764da-d4bb-4f4b-b69a-c9c557549c98 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:19:54 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1bec3976-0b2c-436e-9c4a-eeb6b8badbae -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dPxsmzhw {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:19:54 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1bec3976-0b2c-436e-9c4a-eeb6b8badbae -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dPxsmzhw" returned: 0 in 0.033s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:19:54 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[00436160-fb11-4fd3-bb86-8d7de90aac07]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:19:54 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc2764da-d4bb-4f4b-b69a-c9c557549c98 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'dPxsmzhw'): stdout= stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:19:54 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1bec3976-0b2c-436e-9c4a-eeb6b8badbae -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:19:54 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1bec3976-0b2c-436e-9c4a-eeb6b8badbae -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.029s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:19:54 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[106bc773-683f-4598-bc29-f56878c78f9b]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:19:54 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc2764da-d4bb-4f4b-b69a-c9c557549c98 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:19:54 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:19:54 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:19:54 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[48eb6f5e-3d95-41fd-8fe9-104d3692dc66]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d2ff5d0-0b89-42ba-92eb-1e12c9cce205 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7f7084f-f0d7-4d4b-9a14-69065a9c3e41 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d7a4df0-bfc5-4952-8454-97b703b68f28 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f829f03c-8f1a-45f1-a715-b9d769201d1b (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:528866cb-30dd-40ac-9a81-4c6afc93cdd9 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:175bb2c0-7767-4740-9350-7e3300681a43 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ed77146-5ae0-400d-8116-7f9eb1322808 (non-flash)\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:19:54 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc2764da-d4bb-4f4b-b69a-c9c557549c98 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d2ff5d0-0b89-42ba-92eb-1e12c9cce205 (non-flash)
Nov 08 23:19:54 user nova-compute[75045]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab (non-flash)
Nov 08 23:19:54 user nova-compute[75045]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7f7084f-f0d7-4d4b-9a14-69065a9c3e41 (non-flash)
Nov 08 23:19:54 user nova-compute[75045]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d7a4df0-bfc5-4952-8454-97b703b68f28 (non-flash)
Nov 08 23:19:54 user nova-compute[75045]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f829f03c-8f1a-45f1-a715-b9d769201d1b (non-flash)
Nov 08 23:19:54 user nova-compute[75045]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:528866cb-30dd-40ac-9a81-4c6afc93cdd9 (non-flash)
Nov 08 23:19:54 user nova-compute[75045]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:175bb2c0-7767-4740-9350-7e3300681a43 (non-flash)
Nov 08 23:19:54 user nova-compute[75045]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ed77146-5ae0-400d-8116-7f9eb1322808 (non-flash)
Nov 08 23:19:54 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 23:19:54 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc2764da-d4bb-4f4b-b69a-c9c557549c98 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d2ff5d0-0b89-42ba-92eb-1e12c9cce205 (non-flash)
Nov 08 23:19:54 user nova-compute[75045]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab (non-flash)
Nov 08 23:19:54 user nova-compute[75045]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7f7084f-f0d7-4d4b-9a14-69065a9c3e41 (non-flash)
Nov 08 23:19:54 user nova-compute[75045]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d7a4df0-bfc5-4952-8454-97b703b68f28 (non-flash)
Nov 08 23:19:54 user nova-compute[75045]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f829f03c-8f1a-45f1-a715-b9d769201d1b (non-flash)
Nov 08 23:19:54 user nova-compute[75045]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:528866cb-30dd-40ac-9a81-4c6afc93cdd9 (non-flash)
Nov 08 23:19:54 user nova-compute[75045]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:175bb2c0-7767-4740-9350-7e3300681a43 (non-flash)
Nov 08 23:19:54 user nova-compute[75045]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ed77146-5ae0-400d-8116-7f9eb1322808 (non-flash)
Nov 08 23:19:54 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 23:19:54 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1bec3976-0b2c-436e-9c4a-eeb6b8badbae -p 172.16.0.220:3260 --login {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:19:54 user nova-compute[75045]: DEBUG nova.virt.libvirt.guest [None req-0e7deb14-eb81-45e0-9c30-1322b63950a4 tempest-TestVolumeSwap-1091185069 tempest-TestVolumeSwap-1091185069-project-admin] COPY block job progress, current cursor: 910163968 final cursor: 1073741824 {{(pid=75045) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 08 23:19:55 user nova-compute[75045]: DEBUG nova.virt.libvirt.guest [None req-0e7deb14-eb81-45e0-9c30-1322b63950a4 tempest-TestVolumeSwap-1091185069 tempest-TestVolumeSwap-1091185069-project-admin] COPY block job progress, current cursor: 1015021568 final cursor: 1073741824 {{(pid=75045) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 08 23:19:55 user nova-compute[75045]: DEBUG nova.virt.libvirt.guest [None req-0e7deb14-eb81-45e0-9c30-1322b63950a4 tempest-TestVolumeSwap-1091185069 tempest-TestVolumeSwap-1091185069-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=75045) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 08 23:19:55 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:19:55 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1bec3976-0b2c-436e-9c4a-eeb6b8badbae -p 172.16.0.220:3260 --login" returned: 0 in 1.112s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:19:55 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c96870d-2792-48bc-971c-5d1f206a2536]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1bec3976-0b2c-436e-9c4a-eeb6b8badbae, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1bec3976-0b2c-436e-9c4a-eeb6b8badbae, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:19:55 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc2764da-d4bb-4f4b-b69a-c9c557549c98 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1bec3976-0b2c-436e-9c4a-eeb6b8badbae, portal: 172.16.0.220,3260]
Nov 08 23:19:55 user nova-compute[75045]: Login to [iface: default, target: iqn.2010-10.org.openstack:1bec3976-0b2c-436e-9c4a-eeb6b8badbae, portal: 172.16.0.220,3260] successful.
Nov 08 23:19:55 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:19:55 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1bec3976-0b2c-436e-9c4a-eeb6b8badbae -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:19:55 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1bec3976-0b2c-436e-9c4a-eeb6b8badbae -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.029s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:19:55 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[eedf7233-bca4-418d-bd8b-4202ede07393]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:19:55 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc2764da-d4bb-4f4b-b69a-c9c557549c98 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:19:55 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:19:55 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.045s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:19:55 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[63835bda-79bc-40d1-a99e-bb5b7e76abff]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d2ff5d0-0b89-42ba-92eb-1e12c9cce205 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7f7084f-f0d7-4d4b-9a14-69065a9c3e41 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1bec3976-0b2c-436e-9c4a-eeb6b8badbae (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d7a4df0-bfc5-4952-8454-97b703b68f28 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f829f03c-8f1a-45f1-a715-b9d769201d1b (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:528866cb-30dd-40ac-9a81-4c6afc93cdd9 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:175bb2c0-7767-4740-9350-7e3300681a43 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ed77146-5ae0-400d-8116-7f9eb1322808 (non-flash)\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:19:55 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc2764da-d4bb-4f4b-b69a-c9c557549c98 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d2ff5d0-0b89-42ba-92eb-1e12c9cce205 (non-flash)
Nov 08 23:19:55 user nova-compute[75045]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab (non-flash)
Nov 08 23:19:55 user nova-compute[75045]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7f7084f-f0d7-4d4b-9a14-69065a9c3e41 (non-flash)
Nov 08 23:19:55 user nova-compute[75045]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1bec3976-0b2c-436e-9c4a-eeb6b8badbae (non-flash)
Nov 08 23:19:55 user nova-compute[75045]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d7a4df0-bfc5-4952-8454-97b703b68f28 (non-flash)
Nov 08 23:19:55 user nova-compute[75045]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f829f03c-8f1a-45f1-a715-b9d769201d1b (non-flash)
Nov 08 23:19:55 user nova-compute[75045]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:528866cb-30dd-40ac-9a81-4c6afc93cdd9 (non-flash)
Nov 08 23:19:55 user nova-compute[75045]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:175bb2c0-7767-4740-9350-7e3300681a43 (non-flash)
Nov 08 23:19:55 user nova-compute[75045]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ed77146-5ae0-400d-8116-7f9eb1322808 (non-flash)
Nov 08 23:19:55 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 23:19:55 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc2764da-d4bb-4f4b-b69a-c9c557549c98 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d2ff5d0-0b89-42ba-92eb-1e12c9cce205 (non-flash)
Nov 08 23:19:55 user nova-compute[75045]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab (non-flash)
Nov 08 23:19:55 user nova-compute[75045]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7f7084f-f0d7-4d4b-9a14-69065a9c3e41 (non-flash)
Nov 08 23:19:55 user nova-compute[75045]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1bec3976-0b2c-436e-9c4a-eeb6b8badbae (non-flash)
Nov 08 23:19:55 user nova-compute[75045]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d7a4df0-bfc5-4952-8454-97b703b68f28 (non-flash)
Nov 08 23:19:55 user nova-compute[75045]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f829f03c-8f1a-45f1-a715-b9d769201d1b (non-flash)
Nov 08 23:19:55 user nova-compute[75045]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:528866cb-30dd-40ac-9a81-4c6afc93cdd9 (non-flash)
Nov 08 23:19:55 user nova-compute[75045]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:175bb2c0-7767-4740-9350-7e3300681a43 (non-flash)
Nov 08 23:19:55 user nova-compute[75045]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ed77146-5ae0-400d-8116-7f9eb1322808 (non-flash)
Nov 08 23:19:55 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 23:19:55 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-cc2764da-d4bb-4f4b-b69a-c9c557549c98 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1bec3976-0b2c-436e-9c4a-eeb6b8badbae" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.446s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 23:19:55 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc2764da-d4bb-4f4b-b69a-c9c557549c98 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262-project-member] Connected to 172.16.0.220:3260 {{(pid=75045) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 23:19:55 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-cc2764da-d4bb-4f4b-b69a-c9c557549c98 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262-project-member] HCTL ('41', '-', '-', 0) found on session 13 with lun 0 {{(pid=75045) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 23:19:55 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-cc2764da-d4bb-4f4b-b69a-c9c557549c98 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262-project-member] Scanning host 41 c: -, t: -, l: 0) {{(pid=75045) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 23:19:55 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host41/scan {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:19:55 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host41/scan" returned: 0 in 0.028s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:19:55 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[6acb82cc-d619-4f2f-b8b2-f17054b624fd]: (4, ('- - 0', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:19:55 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-cc2764da-d4bb-4f4b-b69a-c9c557549c98 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262-project-member] Searching for a device in session 13 and hctl ['41', '*', '*', 0] yield: None {{(pid=75045) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 23:19:55 user nova-compute[75045]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0e7deb14-eb81-45e0-9c30-1322b63950a4 tempest-TestVolumeSwap-1091185069 tempest-TestVolumeSwap-1091185069-project-admin] [instance: fde91f7c-31e3-456c-b252-6ce37fa3b600] calling os-brick to detach iSCSI Volume {{(pid=75045) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 23:19:55 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e7deb14-eb81-45e0-9c30-1322b63950a4 tempest-TestVolumeSwap-1091185069 tempest-TestVolumeSwap-1091185069-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1b68210460>, {'target_iqn': 'iqn.2010-10.org.openstack:4d7a4df0-bfc5-4952-8454-97b703b68f28', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MzmZAnHp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=75045) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 23:19:55 user nova-compute[75045]: WARNING os_brick.initiator.connectors.base [None req-0e7deb14-eb81-45e0-9c30-1322b63950a4 tempest-TestVolumeSwap-1091185069 tempest-TestVolumeSwap-1091185069-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 23:19:55 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-0e7deb14-eb81-45e0-9c30-1322b63950a4 tempest-TestVolumeSwap-1091185069 tempest-TestVolumeSwap-1091185069-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 23:19:56 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-cc2764da-d4bb-4f4b-b69a-c9c557549c98 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262-project-member] Searching for a device in session 13 and hctl ['41', '*', '*', 0] yield: sdj {{(pid=75045) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 23:19:56 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc2764da-d4bb-4f4b-b69a-c9c557549c98 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262-project-member] Connected to sdj using {'target_iqn': 'iqn.2010-10.org.openstack:1bec3976-0b2c-436e-9c4a-eeb6b8badbae', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dPxsmzhw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75045) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 23:19:56 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-cc2764da-d4bb-4f4b-b69a-c9c557549c98 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.497s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 23:19:56 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc2764da-d4bb-4f4b-b69a-c9c557549c98 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262-project-member] <== connect_volume: return (2499ms) {'type': 'block', 'scsi_wwn': '26262393330356437', 'path': '/dev/sdj'} {{(pid=75045) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 23:19:56 user nova-compute[75045]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cc2764da-d4bb-4f4b-b69a-c9c557549c98 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262-project-member] [instance: 82bc5fd0-26c7-4f81-b966-54831393b617] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26262393330356437', 'path': '/dev/sdj'} {{(pid=75045) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 23:19:56 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-0e7deb14-eb81-45e0-9c30-1322b63950a4 tempest-TestVolumeSwap-1091185069 tempest-TestVolumeSwap-1091185069-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.981s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 23:19:56 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:19:56 user nova-compute[75045]: DEBUG nova.objects.instance [None req-cc2764da-d4bb-4f4b-b69a-c9c557549c98 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262-project-member] Lazy-loading 'flavor' on Instance uuid 82bc5fd0-26c7-4f81-b966-54831393b617 {{(pid=75045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 23:19:56 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:19:56 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe82b425-dfc6-485f-bd4f-ca74f62edd22]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8d2ff5d0-0b89-42ba-92eb-1e12c9cce205\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1bec3976-0b2c-436e-9c4a-eeb6b8badbae\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6ed77146-5ae0-400d-8116-7f9eb1322808\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:528866cb-30dd-40ac-9a81-4c6afc93cdd9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:175bb2c0-7767-4740-9350-7e3300681a43\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c7f7084f-f0d7-4d4b-9a14-69065a9c3e41\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4d7a4df0-bfc5-4952-8454-97b703b68f28\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f829f03c-8f1a-45f1-a715-b9d769201d1b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:19:56 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e7deb14-eb81-45e0-9c30-1322b63950a4 tempest-TestVolumeSwap-1091185069 tempest-TestVolumeSwap-1091185069-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 23:19:56 user nova-compute[75045]: No targets found.
Nov 08 23:19:56 user nova-compute[75045]: iSNS:
Nov 08 23:19:56 user nova-compute[75045]: No targets found.
Nov 08 23:19:56 user nova-compute[75045]: STATIC:
Nov 08 23:19:56 user nova-compute[75045]: Target: iqn.2010-10.org.openstack:8d2ff5d0-0b89-42ba-92eb-1e12c9cce205
Nov 08 23:19:56 user nova-compute[75045]:         Portal: 172.16.0.220:3260,-1
Nov 08 23:19:56 user nova-compute[75045]:                 Iface Name: default
Nov 08 23:19:56 user nova-compute[75045]: Target: iqn.2010-10.org.openstack:1bec3976-0b2c-436e-9c4a-eeb6b8badbae
Nov 08 23:19:56 user nova-compute[75045]:         Portal: 172.16.0.220:3260,-1
Nov 08 23:19:56 user nova-compute[75045]:                 Iface Name: default
Nov 08 23:19:56 user nova-compute[75045]: Target: iqn.2010-10.org.openstack:6ed77146-5ae0-400d-8116-7f9eb1322808
Nov 08 23:19:56 user nova-compute[75045]:         Portal: 172.16.0.220:3260,-1
Nov 08 23:19:56 user nova-compute[75045]:                 Iface Name: default
Nov 08 23:19:56 user nova-compute[75045]: Target: iqn.2010-10.org.openstack:528866cb-30dd-40ac-9a81-4c6afc93cdd9
Nov 08 23:19:56 user nova-compute[75045]:         Portal: 172.16.0.220:3260,-1
Nov 08 23:19:56 user nova-compute[75045]:                 Iface Name: default
Nov 08 23:19:56 user nova-compute[75045]: Target: iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab
Nov 08 23:19:56 user nova-compute[75045]:         Portal: 172.16.0.220:3260,-1
Nov 08 23:19:56 user nova-compute[75045]:                 Iface Name: default
Nov 08 23:19:56 user nova-compute[75045]: Target: iqn.2010-10.org.openstack:175bb2c0-7767-4740-9350-7e3300681a43
Nov 08 23:19:56 user nova-compute[75045]:         Portal: 172.16.0.220:3260,-1
Nov 08 23:19:56 user nova-compute[75045]:                 Iface Name: default
Nov 08 23:19:56 user nova-compute[75045]: Target: iqn.2010-10.org.openstack:c7f7084f-f0d7-4d4b-9a14-69065a9c3e41
Nov 08 23:19:56 user nova-compute[75045]:         Portal: 172.16.0.220:3260,-1
Nov 08 23:19:56 user nova-compute[75045]:                 Iface Name: default
Nov 08 23:19:56 user nova-compute[75045]: Target: iqn.2010-10.org.openstack:4d7a4df0-bfc5-4952-8454-97b703b68f28
Nov 08 23:19:56 user nova-compute[75045]:         Portal: 172.16.0.220:3260,-1
Nov 08 23:19:56 user nova-compute[75045]:                 Iface Name: default
Nov 08 23:19:56 user nova-compute[75045]: Target: iqn.2010-10.org.openstack:f829f03c-8f1a-45f1-a715-b9d769201d1b
Nov 08 23:19:56 user nova-compute[75045]:         Portal: 172.16.0.220:3260,-1
Nov 08 23:19:56 user nova-compute[75045]:                 Iface Name: default
Nov 08 23:19:56 user nova-compute[75045]: FIRMWARE:
Nov 08 23:19:56 user nova-compute[75045]: No targets found.
Nov 08 23:19:56 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 23:19:56 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e7deb14-eb81-45e0-9c30-1322b63950a4 tempest-TestVolumeSwap-1091185069 tempest-TestVolumeSwap-1091185069-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 23:19:56 user nova-compute[75045]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 23:19:56 user nova-compute[75045]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75045) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 23:19:56 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e7deb14-eb81-45e0-9c30-1322b63950a4 tempest-TestVolumeSwap-1091185069 tempest-TestVolumeSwap-1091185069-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4d7a4df0-bfc5-4952-8454-97b703b68f28', 0)] {{(pid=75045) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 23:19:56 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:19:56 user nova-compute[75045]: DEBUG nova.virt.libvirt.guest [None req-cc2764da-d4bb-4f4b-b69a-c9c557549c98 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262-project-member] attach device xml: <disk type="block" device="disk">
Nov 08 23:19:56 user nova-compute[75045]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 23:19:56 user nova-compute[75045]:   <source dev="/dev/sdj"/>
Nov 08 23:19:56 user nova-compute[75045]:   <target dev="vdb" bus="virtio"/>
Nov 08 23:19:56 user nova-compute[75045]:   <serial>1bec3976-0b2c-436e-9c4a-eeb6b8badbae</serial>
Nov 08 23:19:56 user nova-compute[75045]: </disk>
Nov 08 23:19:56 user nova-compute[75045]:  {{(pid=75045) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 08 23:19:56 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:19:56 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab85a405-2015-46dd-84ff-5a3b7f5769e2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:175bb2c0-7767-4740-9350-7e3300681a43\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1bec3976-0b2c-436e-9c4a-eeb6b8badbae\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4d7a4df0-bfc5-4952-8454-97b703b68f28\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:528866cb-30dd-40ac-9a81-4c6afc93cdd9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6ed77146-5ae0-400d-8116-7f9eb1322808\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8d2ff5d0-0b89-42ba-92eb-1e12c9cce205\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c7f7084f-f0d7-4d4b-9a14-69065a9c3e41\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f829f03c-8f1a-45f1-a715-b9d769201d1b\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:19:56 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:19:56 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:19:56 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcbd6140-f5e5-41d6-823f-94f782ea3bc1]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d2ff5d0-0b89-42ba-92eb-1e12c9cce205 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7f7084f-f0d7-4d4b-9a14-69065a9c3e41 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1bec3976-0b2c-436e-9c4a-eeb6b8badbae (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d7a4df0-bfc5-4952-8454-97b703b68f28 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f829f03c-8f1a-45f1-a715-b9d769201d1b (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:528866cb-30dd-40ac-9a81-4c6afc93cdd9 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:175bb2c0-7767-4740-9350-7e3300681a43 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ed77146-5ae0-400d-8116-7f9eb1322808 (non-flash)\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:19:56 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e7deb14-eb81-45e0-9c30-1322b63950a4 tempest-TestVolumeSwap-1091185069 tempest-TestVolumeSwap-1091185069-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d2ff5d0-0b89-42ba-92eb-1e12c9cce205 (non-flash)
Nov 08 23:19:56 user nova-compute[75045]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab (non-flash)
Nov 08 23:19:56 user nova-compute[75045]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7f7084f-f0d7-4d4b-9a14-69065a9c3e41 (non-flash)
Nov 08 23:19:56 user nova-compute[75045]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1bec3976-0b2c-436e-9c4a-eeb6b8badbae (non-flash)
Nov 08 23:19:56 user nova-compute[75045]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d7a4df0-bfc5-4952-8454-97b703b68f28 (non-flash)
Nov 08 23:19:56 user nova-compute[75045]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f829f03c-8f1a-45f1-a715-b9d769201d1b (non-flash)
Nov 08 23:19:56 user nova-compute[75045]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:528866cb-30dd-40ac-9a81-4c6afc93cdd9 (non-flash)
Nov 08 23:19:56 user nova-compute[75045]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:175bb2c0-7767-4740-9350-7e3300681a43 (non-flash)
Nov 08 23:19:56 user nova-compute[75045]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ed77146-5ae0-400d-8116-7f9eb1322808 (non-flash)
Nov 08 23:19:56 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 23:19:56 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e7deb14-eb81-45e0-9c30-1322b63950a4 tempest-TestVolumeSwap-1091185069 tempest-TestVolumeSwap-1091185069-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d2ff5d0-0b89-42ba-92eb-1e12c9cce205 (non-flash)
Nov 08 23:19:56 user nova-compute[75045]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab (non-flash)
Nov 08 23:19:56 user nova-compute[75045]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7f7084f-f0d7-4d4b-9a14-69065a9c3e41 (non-flash)
Nov 08 23:19:56 user nova-compute[75045]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1bec3976-0b2c-436e-9c4a-eeb6b8badbae (non-flash)
Nov 08 23:19:56 user nova-compute[75045]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d7a4df0-bfc5-4952-8454-97b703b68f28 (non-flash)
Nov 08 23:19:56 user nova-compute[75045]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f829f03c-8f1a-45f1-a715-b9d769201d1b (non-flash)
Nov 08 23:19:56 user nova-compute[75045]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:528866cb-30dd-40ac-9a81-4c6afc93cdd9 (non-flash)
Nov 08 23:19:56 user nova-compute[75045]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:175bb2c0-7767-4740-9350-7e3300681a43 (non-flash)
Nov 08 23:19:56 user nova-compute[75045]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ed77146-5ae0-400d-8116-7f9eb1322808 (non-flash)
Nov 08 23:19:56 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 23:19:56 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e7deb14-eb81-45e0-9c30-1322b63950a4 tempest-TestVolumeSwap-1091185069 tempest-TestVolumeSwap-1091185069-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1b68269f30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4d7a4df0-bfc5-4952-8454-97b703b68f28'): ({'sdd'}, set())}) {{(pid=75045) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 23:19:56 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-0e7deb14-eb81-45e0-9c30-1322b63950a4 tempest-TestVolumeSwap-1091185069 tempest-TestVolumeSwap-1091185069-project-admin] Removing single pathed devices sdd {{(pid=75045) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 23:19:56 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:19:56 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:19:56 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[bccf57c5-c969-4048-b6b0-8897d36d1a46]: (4, ('path checker states:\nup                  9\n\npaths: 0\nbusy: False\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:19:56 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:19:56 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.023s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:19:56 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a94a6e2-fe95-4f67-b335-66c5fca526dd]: (4, ('ok\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:19:56 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-0e7deb14-eb81-45e0-9c30-1322b63950a4 tempest-TestVolumeSwap-1091185069 tempest-TestVolumeSwap-1091185069-project-admin] Flushing IO for device /dev/sdd {{(pid=75045) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 23:19:56 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:19:56 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:19:56 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[89550534-ac9b-4fe9-9113-be6f4f36ed2d]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:19:56 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-0e7deb14-eb81-45e0-9c30-1322b63950a4 tempest-TestVolumeSwap-1091185069 tempest-TestVolumeSwap-1091185069-project-admin] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75045) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 23:19:56 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:19:57 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.057s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:19:57 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a1829b4-6c55-490c-842b-b9c055fbd256]: (4, ('1', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:19:57 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-0e7deb14-eb81-45e0-9c30-1322b63950a4 tempest-TestVolumeSwap-1091185069 tempest-TestVolumeSwap-1091185069-project-admin] Checking to see if SCSI volumes sdd have been removed. {{(pid=75045) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 23:19:57 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-0e7deb14-eb81-45e0-9c30-1322b63950a4 tempest-TestVolumeSwap-1091185069 tempest-TestVolumeSwap-1091185069-project-admin] SCSI volumes sdd have been removed. {{(pid=75045) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 23:19:57 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e7deb14-eb81-45e0-9c30-1322b63950a4 tempest-TestVolumeSwap-1091185069 tempest-TestVolumeSwap-1091185069-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4d7a4df0-bfc5-4952-8454-97b703b68f28')] {{(pid=75045) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 23:19:57 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d7a4df0-bfc5-4952-8454-97b703b68f28 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:19:57 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d7a4df0-bfc5-4952-8454-97b703b68f28 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:19:57 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[84b037e7-ac48-401b-9535-e9bad5dd36ff]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:19:57 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e7deb14-eb81-45e0-9c30-1322b63950a4 tempest-TestVolumeSwap-1091185069 tempest-TestVolumeSwap-1091185069-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:19:57 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d7a4df0-bfc5-4952-8454-97b703b68f28 -p 172.16.0.220:3260 --logout {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:19:57 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d7a4df0-bfc5-4952-8454-97b703b68f28 -p 172.16.0.220:3260 --logout" returned: 0 in 0.100s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:19:57 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[1607f646-29cd-4448-8c0d-385702d8a17f]: (4, ('Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:4d7a4df0-bfc5-4952-8454-97b703b68f28, portal: 172.16.0.220,3260]\nLogout of [sid: 5, target: iqn.2010-10.org.openstack:4d7a4df0-bfc5-4952-8454-97b703b68f28, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:19:57 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e7deb14-eb81-45e0-9c30-1322b63950a4 tempest-TestVolumeSwap-1091185069 tempest-TestVolumeSwap-1091185069-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:4d7a4df0-bfc5-4952-8454-97b703b68f28, portal: 172.16.0.220,3260]
Nov 08 23:19:57 user nova-compute[75045]: Logout of [sid: 5, target: iqn.2010-10.org.openstack:4d7a4df0-bfc5-4952-8454-97b703b68f28, portal: 172.16.0.220,3260] successful.
Nov 08 23:19:57 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:19:57 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d7a4df0-bfc5-4952-8454-97b703b68f28 -p 172.16.0.220:3260 --op delete {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:19:57 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d7a4df0-bfc5-4952-8454-97b703b68f28 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.037s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:19:57 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cc279f6-0484-479f-83d6-4ae003fa6977]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:19:57 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e7deb14-eb81-45e0-9c30-1322b63950a4 tempest-TestVolumeSwap-1091185069 tempest-TestVolumeSwap-1091185069-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:19:57 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-0e7deb14-eb81-45e0-9c30-1322b63950a4 tempest-TestVolumeSwap-1091185069 tempest-TestVolumeSwap-1091185069-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.423s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 23:19:57 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e7deb14-eb81-45e0-9c30-1322b63950a4 tempest-TestVolumeSwap-1091185069 tempest-TestVolumeSwap-1091185069-project-admin] <== disconnect_volume: return (1404ms) None {{(pid=75045) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 23:19:57 user nova-compute[75045]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0e7deb14-eb81-45e0-9c30-1322b63950a4 tempest-TestVolumeSwap-1091185069 tempest-TestVolumeSwap-1091185069-project-admin] [instance: fde91f7c-31e3-456c-b252-6ce37fa3b600] Disconnected iSCSI Volume {{(pid=75045) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 23:19:57 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-cc2764da-d4bb-4f4b-b69a-c9c557549c98 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262-project-member] No BDM found with device name vda, not building metadata. {{(pid=75045) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 23:19:57 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-cc2764da-d4bb-4f4b-b69a-c9c557549c98 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75045) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 23:19:57 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-cc2764da-d4bb-4f4b-b69a-c9c557549c98 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262-project-member] No VIF found with MAC fa:16:3e:4a:29:50, not building metadata {{(pid=75045) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 23:19:57 user nova-compute[75045]: DEBUG nova.compute.manager [None req-0e7deb14-eb81-45e0-9c30-1322b63950a4 tempest-TestVolumeSwap-1091185069 tempest-TestVolumeSwap-1091185069-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:c7f7084f-f0d7-4d4b-9a14-69065a9c3e41', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mCxrFhHs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, 'status': 'reserved', 'instance': 'fde91f7c-31e3-456c-b252-6ce37fa3b600', 'attached_at': '', 'detached_at': '', 'volume_id': 'c7f7084f-f0d7-4d4b-9a14-69065a9c3e41', 'serial'} {{(pid=75045) _swap_volume /opt/stack/nova/nova/compute/manager.py:7791}}
Nov 08 23:19:57 user nova-compute[75045]: DEBUG nova.compute.manager [None req-0e7deb14-eb81-45e0-9c30-1322b63950a4 tempest-TestVolumeSwap-1091185069 tempest-TestVolumeSwap-1091185069-project-admin] [instance: fde91f7c-31e3-456c-b252-6ce37fa3b600] swap_volume: removing Cinder connection for volume 4d7a4df0-bfc5-4952-8454-97b703b68f28 {{(pid=75045) _swap_volume /opt/stack/nova/nova/compute/manager.py:7836}}
Nov 08 23:19:57 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-cc2764da-d4bb-4f4b-b69a-c9c557549c98 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262-project-member] Lock "82bc5fd0-26c7-4f81-b966-54831393b617" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 60.107s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:19:58 user nova-compute[75045]: DEBUG nova.compute.manager [None req-0e7deb14-eb81-45e0-9c30-1322b63950a4 tempest-TestVolumeSwap-1091185069 tempest-TestVolumeSwap-1091185069-project-admin] [instance: fde91f7c-31e3-456c-b252-6ce37fa3b600] swap_volume: Updating volume 4d7a4df0-bfc5-4952-8454-97b703b68f28 BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqn": "iqn.2010-10.org.openstack:c7f7084f-f0d7-4d4b-9a14-69065a9c3e41", "target_portal": "172.16.0.220:3260", "target_discovered": false, "auth_method": "CHAP", "auth_username": "mCxrFhHs", "auth_password": "hUyCY8ERQ5mgfu", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdi", "volume_id": "c7f7084f-f0d7-4d4b-9a14-69065a9c3e41"}, "status": "reserved", "instance": "fde91f7c-31e3-456c-b252-6ce37fa3b600", "attached_at": "", "detached_at": "", "volume_id": "c7f7084f-f0d7-4d4b-9a14-69065a9c3e41", "serial": "c7f7084f-f0d7-4d4b-9a14-69065a9c3e41"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': 'c7f7084f-f0d7-4d4b-9a14-69065a9c3e41', 'no_device': None, 'attachment_id': '1f2998ee-ffbf-476b-9f32-a19fcd00aca9'} {{(pid=75045) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7984}}
Nov 08 23:19:58 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-0e7deb14-eb81-45e0-9c30-1322b63950a4 tempest-TestVolumeSwap-1091185069 tempest-TestVolumeSwap-1091185069-project-admin] Lock "fde91f7c-31e3-456c-b252-6ce37fa3b600" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 61.520s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:19:58 user nova-compute[75045]: ERROR nova.volume.cinder [None req-3e20b61e-19c4-460d-831a-0137ef420f72 tempest-TaggedBootDevicesTest_v242-1022497165 tempest-TaggedBootDevicesTest_v242-1022497165-project-member] Update attachment failed for attachment ebd67b2f-f16e-489e-8d51-ed4fd58c2e0b. Error: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-9ebcb963-5e78-4e9c-b13e-c5b72109ad0e) Code: 500: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-9ebcb963-5e78-4e9c-b13e-c5b72109ad0e)
Nov 08 23:19:58 user nova-compute[75045]: ERROR nova.compute.manager [None req-3e20b61e-19c4-460d-831a-0137ef420f72 tempest-TaggedBootDevicesTest_v242-1022497165 tempest-TaggedBootDevicesTest_v242-1022497165-project-member] [instance: 84f0b650-5f58-443d-92a2-bbd5240a0b6f] Instance failed block device setup: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-9ebcb963-5e78-4e9c-b13e-c5b72109ad0e)
Nov 08 23:19:58 user nova-compute[75045]: ERROR nova.compute.manager [instance: 84f0b650-5f58-443d-92a2-bbd5240a0b6f] Traceback (most recent call last):
Nov 08 23:19:58 user nova-compute[75045]: ERROR nova.compute.manager [instance: 84f0b650-5f58-443d-92a2-bbd5240a0b6f]   File "/opt/stack/nova/nova/compute/manager.py", line 2190, in _prep_block_device
Nov 08 23:19:58 user nova-compute[75045]: ERROR nova.compute.manager [instance: 84f0b650-5f58-443d-92a2-bbd5240a0b6f]     driver_block_device.attach_block_devices(
Nov 08 23:19:58 user nova-compute[75045]: ERROR nova.compute.manager [instance: 84f0b650-5f58-443d-92a2-bbd5240a0b6f]   File "/opt/stack/nova/nova/virt/block_device.py", line 936, in attach_block_devices
Nov 08 23:19:58 user nova-compute[75045]: ERROR nova.compute.manager [instance: 84f0b650-5f58-443d-92a2-bbd5240a0b6f]     _log_and_attach(device)
Nov 08 23:19:58 user nova-compute[75045]: ERROR nova.compute.manager [instance: 84f0b650-5f58-443d-92a2-bbd5240a0b6f]   File "/opt/stack/nova/nova/virt/block_device.py", line 933, in _log_and_attach
Nov 08 23:19:58 user nova-compute[75045]: ERROR nova.compute.manager [instance: 84f0b650-5f58-443d-92a2-bbd5240a0b6f]     bdm.attach(*attach_args, **attach_kwargs)
Nov 08 23:19:58 user nova-compute[75045]: ERROR nova.compute.manager [instance: 84f0b650-5f58-443d-92a2-bbd5240a0b6f]   File "/opt/stack/nova/nova/virt/block_device.py", line 46, in wrapped
Nov 08 23:19:58 user nova-compute[75045]: ERROR nova.compute.manager [instance: 84f0b650-5f58-443d-92a2-bbd5240a0b6f]     ret_val = method(obj, context, *args, **kwargs)
Nov 08 23:19:58 user nova-compute[75045]: ERROR nova.compute.manager [instance: 84f0b650-5f58-443d-92a2-bbd5240a0b6f]   File "/opt/stack/nova/nova/virt/block_device.py", line 734, in attach
Nov 08 23:19:58 user nova-compute[75045]: ERROR nova.compute.manager [instance: 84f0b650-5f58-443d-92a2-bbd5240a0b6f]     self._do_attach(context, instance, volume, volume_api,
Nov 08 23:19:58 user nova-compute[75045]: ERROR nova.compute.manager [instance: 84f0b650-5f58-443d-92a2-bbd5240a0b6f]   File "/opt/stack/nova/nova/virt/block_device.py", line 719, in _do_attach
Nov 08 23:19:58 user nova-compute[75045]: ERROR nova.compute.manager [instance: 84f0b650-5f58-443d-92a2-bbd5240a0b6f]     self._volume_attach(context, volume, connector, instance,
Nov 08 23:19:58 user nova-compute[75045]: ERROR nova.compute.manager [instance: 84f0b650-5f58-443d-92a2-bbd5240a0b6f]   File "/opt/stack/nova/nova/virt/block_device.py", line 633, in _volume_attach
Nov 08 23:19:58 user nova-compute[75045]: ERROR nova.compute.manager [instance: 84f0b650-5f58-443d-92a2-bbd5240a0b6f]     connection_info = volume_api.attachment_update(
Nov 08 23:19:58 user nova-compute[75045]: ERROR nova.compute.manager [instance: 84f0b650-5f58-443d-92a2-bbd5240a0b6f]   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 08 23:19:58 user nova-compute[75045]: ERROR nova.compute.manager [instance: 84f0b650-5f58-443d-92a2-bbd5240a0b6f]     res = method(self, ctx, *args, **kwargs)
Nov 08 23:19:58 user nova-compute[75045]: ERROR nova.compute.manager [instance: 84f0b650-5f58-443d-92a2-bbd5240a0b6f]   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Nov 08 23:19:58 user nova-compute[75045]: ERROR nova.compute.manager [instance: 84f0b650-5f58-443d-92a2-bbd5240a0b6f]     res = method(self, ctx, attachment_id, *args, **kwargs)
Nov 08 23:19:58 user nova-compute[75045]: ERROR nova.compute.manager [instance: 84f0b650-5f58-443d-92a2-bbd5240a0b6f]   File "/opt/stack/nova/nova/volume/cinder.py", line 915, in attachment_update
Nov 08 23:19:58 user nova-compute[75045]: ERROR nova.compute.manager [instance: 84f0b650-5f58-443d-92a2-bbd5240a0b6f]     with excutils.save_and_reraise_exception():
Nov 08 23:19:58 user nova-compute[75045]: ERROR nova.compute.manager [instance: 84f0b650-5f58-443d-92a2-bbd5240a0b6f]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 08 23:19:58 user nova-compute[75045]: ERROR nova.compute.manager [instance: 84f0b650-5f58-443d-92a2-bbd5240a0b6f]     self.force_reraise()
Nov 08 23:19:58 user nova-compute[75045]: ERROR nova.compute.manager [instance: 84f0b650-5f58-443d-92a2-bbd5240a0b6f]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 08 23:19:58 user nova-compute[75045]: ERROR nova.compute.manager [instance: 84f0b650-5f58-443d-92a2-bbd5240a0b6f]     raise self.value
Nov 08 23:19:58 user nova-compute[75045]: ERROR nova.compute.manager [instance: 84f0b650-5f58-443d-92a2-bbd5240a0b6f]   File "/opt/stack/nova/nova/volume/cinder.py", line 909, in attachment_update
Nov 08 23:19:58 user nova-compute[75045]: ERROR nova.compute.manager [instance: 84f0b650-5f58-443d-92a2-bbd5240a0b6f]     context, '3.44', skip_version_check=True).attachments.update(
Nov 08 23:19:58 user nova-compute[75045]: ERROR nova.compute.manager [instance: 84f0b650-5f58-443d-92a2-bbd5240a0b6f]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Nov 08 23:19:58 user nova-compute[75045]: ERROR nova.compute.manager [instance: 84f0b650-5f58-443d-92a2-bbd5240a0b6f]     return method.func(obj, *args, **kwargs)
Nov 08 23:19:58 user nova-compute[75045]: ERROR nova.compute.manager [instance: 84f0b650-5f58-443d-92a2-bbd5240a0b6f]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Nov 08 23:19:58 user nova-compute[75045]: ERROR nova.compute.manager [instance: 84f0b650-5f58-443d-92a2-bbd5240a0b6f]     resp = self._update('/attachments/%s' % id, body)
Nov 08 23:19:58 user nova-compute[75045]: ERROR nova.compute.manager [instance: 84f0b650-5f58-443d-92a2-bbd5240a0b6f]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Nov 08 23:19:58 user nova-compute[75045]: ERROR nova.compute.manager [instance: 84f0b650-5f58-443d-92a2-bbd5240a0b6f]     resp, body = self.api.client.put(url, body=body, **kwargs)
Nov 08 23:19:58 user nova-compute[75045]: ERROR nova.compute.manager [instance: 84f0b650-5f58-443d-92a2-bbd5240a0b6f]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Nov 08 23:19:58 user nova-compute[75045]: ERROR nova.compute.manager [instance: 84f0b650-5f58-443d-92a2-bbd5240a0b6f]     return self._cs_request(url, 'PUT', **kwargs)
Nov 08 23:19:58 user nova-compute[75045]: ERROR nova.compute.manager [instance: 84f0b650-5f58-443d-92a2-bbd5240a0b6f]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 08 23:19:58 user nova-compute[75045]: ERROR nova.compute.manager [instance: 84f0b650-5f58-443d-92a2-bbd5240a0b6f]     return self.request(url, method, **kwargs)
Nov 08 23:19:58 user nova-compute[75045]: ERROR nova.compute.manager [instance: 84f0b650-5f58-443d-92a2-bbd5240a0b6f]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 08 23:19:58 user nova-compute[75045]: ERROR nova.compute.manager [instance: 84f0b650-5f58-443d-92a2-bbd5240a0b6f]     raise exceptions.from_response(resp, body)
Nov 08 23:19:58 user nova-compute[75045]: ERROR nova.compute.manager [instance: 84f0b650-5f58-443d-92a2-bbd5240a0b6f] cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-9ebcb963-5e78-4e9c-b13e-c5b72109ad0e)
Nov 08 23:19:58 user nova-compute[75045]: ERROR nova.compute.manager [instance: 84f0b650-5f58-443d-92a2-bbd5240a0b6f] 
Nov 08 23:19:58 user nova-compute[75045]: DEBUG nova.compute.claims [None req-3e20b61e-19c4-460d-831a-0137ef420f72 tempest-TaggedBootDevicesTest_v242-1022497165 tempest-TaggedBootDevicesTest_v242-1022497165-project-member] [instance: 84f0b650-5f58-443d-92a2-bbd5240a0b6f] Aborting claim: <nova.compute.claims.Claim object at 0x7f1b6816b370> {{(pid=75045) abort /opt/stack/nova/nova/compute/claims.py:84}}
Nov 08 23:19:58 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-3e20b61e-19c4-460d-831a-0137ef420f72 tempest-TaggedBootDevicesTest_v242-1022497165 tempest-TaggedBootDevicesTest_v242-1022497165-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:19:58 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-3e20b61e-19c4-460d-831a-0137ef420f72 tempest-TaggedBootDevicesTest_v242-1022497165 tempest-TaggedBootDevicesTest_v242-1022497165-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:19:59 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:19:59 user nova-compute[75045]: DEBUG nova.compute.provider_tree [None req-3e20b61e-19c4-460d-831a-0137ef420f72 tempest-TaggedBootDevicesTest_v242-1022497165 tempest-TaggedBootDevicesTest_v242-1022497165-project-member] Inventory has not changed in ProviderTree for provider: 62ba5f85-c74d-4b58-986e-d4197e813fd7 {{(pid=75045) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 23:19:59 user nova-compute[75045]: DEBUG nova.scheduler.client.report [None req-3e20b61e-19c4-460d-831a-0137ef420f72 tempest-TaggedBootDevicesTest_v242-1022497165 tempest-TaggedBootDevicesTest_v242-1022497165-project-member] Inventory has not changed for provider 62ba5f85-c74d-4b58-986e-d4197e813fd7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75045) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 23:19:59 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-3e20b61e-19c4-460d-831a-0137ef420f72 tempest-TaggedBootDevicesTest_v242-1022497165 tempest-TaggedBootDevicesTest_v242-1022497165-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" :: held 0.511s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:19:59 user nova-compute[75045]: DEBUG nova.compute.manager [None req-3e20b61e-19c4-460d-831a-0137ef420f72 tempest-TaggedBootDevicesTest_v242-1022497165 tempest-TaggedBootDevicesTest_v242-1022497165-project-member] [instance: 84f0b650-5f58-443d-92a2-bbd5240a0b6f] Build of instance 84f0b650-5f58-443d-92a2-bbd5240a0b6f aborted: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-9ebcb963-5e78-4e9c-b13e-c5b72109ad0e) {{(pid=75045) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2660}}
Nov 08 23:19:59 user nova-compute[75045]: DEBUG nova.compute.utils [None req-3e20b61e-19c4-460d-831a-0137ef420f72 tempest-TaggedBootDevicesTest_v242-1022497165 tempest-TaggedBootDevicesTest_v242-1022497165-project-member] [instance: 84f0b650-5f58-443d-92a2-bbd5240a0b6f] Build of instance 84f0b650-5f58-443d-92a2-bbd5240a0b6f aborted: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: {{(pid=75045) notify_about_instance_usage /opt/stack/nova/nova/compute/utils.py:430}}
Nov 08 23:19:59 user nova-compute[75045]: ERROR nova.compute.manager [None req-3e20b61e-19c4-460d-831a-0137ef420f72 tempest-TaggedBootDevicesTest_v242-1022497165 tempest-TaggedBootDevicesTest_v242-1022497165-project-member] [instance: 84f0b650-5f58-443d-92a2-bbd5240a0b6f] Build of instance 84f0b650-5f58-443d-92a2-bbd5240a0b6f aborted: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-9ebcb963-5e78-4e9c-b13e-c5b72109ad0e): nova.exception.BuildAbortException: Build of instance 84f0b650-5f58-443d-92a2-bbd5240a0b6f aborted: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-9ebcb963-5e78-4e9c-b13e-c5b72109ad0e)
Nov 08 23:19:59 user nova-compute[75045]: DEBUG nova.compute.manager [None req-3e20b61e-19c4-460d-831a-0137ef420f72 tempest-TaggedBootDevicesTest_v242-1022497165 tempest-TaggedBootDevicesTest_v242-1022497165-project-member] [instance: 84f0b650-5f58-443d-92a2-bbd5240a0b6f] Unplugging VIFs for instance {{(pid=75045) _cleanup_allocated_networks /opt/stack/nova/nova/compute/manager.py:2996}}
Nov 08 23:19:59 user nova-compute[75045]: DEBUG nova.virt.libvirt.vif [None req-3e20b61e-19c4-460d-831a-0137ef420f72 tempest-TaggedBootDevicesTest_v242-1022497165 tempest-TaggedBootDevicesTest_v242-1022497165-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T23:18:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-918872471',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-918872471',id=12,image_ref='a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLWzUPBl7zoK5psQ6b+zfY3nZD1vA/wWXZYVYAERV3mtmPAGS/Ucb9+9J79qx6zmClZ3Q8w73hC8GHuQzCukyP5lElXvkXPTiM7z5ABunzck60/h2W50CnOqdK5KIIbbkQ==',key_name='tempest-keypair-178084195',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2adf8b4b78eb494d8fa806e9d7c592a7',ramdisk_id='',reservation_id='r-38dwyk1x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1022497165',owner_user_name='tempest-TaggedBootDevicesTest_v242-1022497165-project-member'},tags=TagList,task_state='block_device_mapping',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T23:18:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='138a510eaf5a489790a3ebc21fde5481',uuid=84f0b650-5f58-443d-92a2-bbd5240a0b6f,vcpu_model=None,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fc4db695-a5ec-4a17-ae30-8d21e4f4824e", "address": "fa:16:3e:a4:55:a2", "network": {"id": "b2e474ab-b3aa-48a0-ba26-dc0b42cf38ab", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-265119296-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2adf8b4b78eb494d8fa806e9d7c592a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc4db695-a5", "ovs_interfaceid": "fc4db695-a5ec-4a17-ae30-8d21e4f4824e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75045) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 23:19:59 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-3e20b61e-19c4-460d-831a-0137ef420f72 tempest-TaggedBootDevicesTest_v242-1022497165 tempest-TaggedBootDevicesTest_v242-1022497165-project-member] Converting VIF {"id": "fc4db695-a5ec-4a17-ae30-8d21e4f4824e", "address": "fa:16:3e:a4:55:a2", "network": {"id": "b2e474ab-b3aa-48a0-ba26-dc0b42cf38ab", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-265119296-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2adf8b4b78eb494d8fa806e9d7c592a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc4db695-a5", "ovs_interfaceid": "fc4db695-a5ec-4a17-ae30-8d21e4f4824e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 23:19:59 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-3e20b61e-19c4-460d-831a-0137ef420f72 tempest-TaggedBootDevicesTest_v242-1022497165 tempest-TaggedBootDevicesTest_v242-1022497165-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a4:55:a2,bridge_name='br-int',has_traffic_filtering=True,id=fc4db695-a5ec-4a17-ae30-8d21e4f4824e,network=Network(b2e474ab-b3aa-48a0-ba26-dc0b42cf38ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc4db695-a5') {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 23:19:59 user nova-compute[75045]: DEBUG os_vif [None req-3e20b61e-19c4-460d-831a-0137ef420f72 tempest-TaggedBootDevicesTest_v242-1022497165 tempest-TaggedBootDevicesTest_v242-1022497165-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a4:55:a2,bridge_name='br-int',has_traffic_filtering=True,id=fc4db695-a5ec-4a17-ae30-8d21e4f4824e,network=Network(b2e474ab-b3aa-48a0-ba26-dc0b42cf38ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc4db695-a5') {{(pid=75045) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 23:19:59 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:19:59 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfc4db695-a5, bridge=br-int, if_exists=True) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:19:59 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 23:19:59 user nova-compute[75045]: INFO os_vif [None req-3e20b61e-19c4-460d-831a-0137ef420f72 tempest-TaggedBootDevicesTest_v242-1022497165 tempest-TaggedBootDevicesTest_v242-1022497165-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a4:55:a2,bridge_name='br-int',has_traffic_filtering=True,id=fc4db695-a5ec-4a17-ae30-8d21e4f4824e,network=Network(b2e474ab-b3aa-48a0-ba26-dc0b42cf38ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc4db695-a5')
Nov 08 23:19:59 user nova-compute[75045]: DEBUG nova.virt.libvirt.vif [None req-3e20b61e-19c4-460d-831a-0137ef420f72 tempest-TaggedBootDevicesTest_v242-1022497165 tempest-TaggedBootDevicesTest_v242-1022497165-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T23:18:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-918872471',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-918872471',id=12,image_ref='a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLWzUPBl7zoK5psQ6b+zfY3nZD1vA/wWXZYVYAERV3mtmPAGS/Ucb9+9J79qx6zmClZ3Q8w73hC8GHuQzCukyP5lElXvkXPTiM7z5ABunzck60/h2W50CnOqdK5KIIbbkQ==',key_name='tempest-keypair-178084195',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2adf8b4b78eb494d8fa806e9d7c592a7',ramdisk_id='',reservation_id='r-38dwyk1x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1022497165',owner_user_name='tempest-TaggedBootDevicesTest_v242-1022497165-project-member'},tags=TagList,task_state='block_device_mapping',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T23:18:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='138a510eaf5a489790a3ebc21fde5481',uuid=84f0b650-5f58-443d-92a2-bbd5240a0b6f,vcpu_model=None,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3bf6df35-9e21-4f9b-8d1f-1d0bea146bd4", "address": "fa:16:3e:ac:8e:d8", "network": {"id": "ae6d1517-a734-498b-bb06-554fe0816868", "bridge": "br-int", "label": "tempest-device-tagging-net1-228754202", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.51", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2adf8b4b78eb494d8fa806e9d7c592a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3bf6df35-9e", "ovs_interfaceid": "3bf6df35-9e21-4f9b-8d1f-1d0bea146bd4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75045) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 23:19:59 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-3e20b61e-19c4-460d-831a-0137ef420f72 tempest-TaggedBootDevicesTest_v242-1022497165 tempest-TaggedBootDevicesTest_v242-1022497165-project-member] Converting VIF {"id": "3bf6df35-9e21-4f9b-8d1f-1d0bea146bd4", "address": "fa:16:3e:ac:8e:d8", "network": {"id": "ae6d1517-a734-498b-bb06-554fe0816868", "bridge": "br-int", "label": "tempest-device-tagging-net1-228754202", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.51", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2adf8b4b78eb494d8fa806e9d7c592a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3bf6df35-9e", "ovs_interfaceid": "3bf6df35-9e21-4f9b-8d1f-1d0bea146bd4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 23:19:59 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-3e20b61e-19c4-460d-831a-0137ef420f72 tempest-TaggedBootDevicesTest_v242-1022497165 tempest-TaggedBootDevicesTest_v242-1022497165-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ac:8e:d8,bridge_name='br-int',has_traffic_filtering=True,id=3bf6df35-9e21-4f9b-8d1f-1d0bea146bd4,network=Network(ae6d1517-a734-498b-bb06-554fe0816868),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap3bf6df35-9e') {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 23:19:59 user nova-compute[75045]: DEBUG os_vif [None req-3e20b61e-19c4-460d-831a-0137ef420f72 tempest-TaggedBootDevicesTest_v242-1022497165 tempest-TaggedBootDevicesTest_v242-1022497165-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ac:8e:d8,bridge_name='br-int',has_traffic_filtering=True,id=3bf6df35-9e21-4f9b-8d1f-1d0bea146bd4,network=Network(ae6d1517-a734-498b-bb06-554fe0816868),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap3bf6df35-9e') {{(pid=75045) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 23:19:59 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:19:59 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3bf6df35-9e, bridge=br-int, if_exists=True) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:19:59 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 23:19:59 user nova-compute[75045]: INFO os_vif [None req-3e20b61e-19c4-460d-831a-0137ef420f72 tempest-TaggedBootDevicesTest_v242-1022497165 tempest-TaggedBootDevicesTest_v242-1022497165-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ac:8e:d8,bridge_name='br-int',has_traffic_filtering=True,id=3bf6df35-9e21-4f9b-8d1f-1d0bea146bd4,network=Network(ae6d1517-a734-498b-bb06-554fe0816868),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap3bf6df35-9e')
Nov 08 23:19:59 user nova-compute[75045]: DEBUG nova.virt.libvirt.vif [None req-3e20b61e-19c4-460d-831a-0137ef420f72 tempest-TaggedBootDevicesTest_v242-1022497165 tempest-TaggedBootDevicesTest_v242-1022497165-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T23:18:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-918872471',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-918872471',id=12,image_ref='a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLWzUPBl7zoK5psQ6b+zfY3nZD1vA/wWXZYVYAERV3mtmPAGS/Ucb9+9J79qx6zmClZ3Q8w73hC8GHuQzCukyP5lElXvkXPTiM7z5ABunzck60/h2W50CnOqdK5KIIbbkQ==',key_name='tempest-keypair-178084195',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2adf8b4b78eb494d8fa806e9d7c592a7',ramdisk_id='',reservation_id='r-38dwyk1x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1022497165',owner_user_name='tempest-TaggedBootDevicesTest_v242-1022497165-project-member'},tags=TagList,task_state='block_device_mapping',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T23:18:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='138a510eaf5a489790a3ebc21fde5481',uuid=84f0b650-5f58-443d-92a2-bbd5240a0b6f,vcpu_model=None,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "61b1ec8c-48bc-413b-b19f-48909a05358d", "address": "fa:16:3e:70:d1:5b", "network": {"id": "ae6d1517-a734-498b-bb06-554fe0816868", "bridge": "br-int", "label": "tempest-device-tagging-net1-228754202", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.18", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2adf8b4b78eb494d8fa806e9d7c592a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61b1ec8c-48", "ovs_interfaceid": "61b1ec8c-48bc-413b-b19f-48909a05358d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75045) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 23:19:59 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-3e20b61e-19c4-460d-831a-0137ef420f72 tempest-TaggedBootDevicesTest_v242-1022497165 tempest-TaggedBootDevicesTest_v242-1022497165-project-member] Converting VIF {"id": "61b1ec8c-48bc-413b-b19f-48909a05358d", "address": "fa:16:3e:70:d1:5b", "network": {"id": "ae6d1517-a734-498b-bb06-554fe0816868", "bridge": "br-int", "label": "tempest-device-tagging-net1-228754202", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.18", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2adf8b4b78eb494d8fa806e9d7c592a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61b1ec8c-48", "ovs_interfaceid": "61b1ec8c-48bc-413b-b19f-48909a05358d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 23:19:59 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-3e20b61e-19c4-460d-831a-0137ef420f72 tempest-TaggedBootDevicesTest_v242-1022497165 tempest-TaggedBootDevicesTest_v242-1022497165-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:70:d1:5b,bridge_name='br-int',has_traffic_filtering=True,id=61b1ec8c-48bc-413b-b19f-48909a05358d,network=Network(ae6d1517-a734-498b-bb06-554fe0816868),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap61b1ec8c-48') {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 23:19:59 user nova-compute[75045]: DEBUG os_vif [None req-3e20b61e-19c4-460d-831a-0137ef420f72 tempest-TaggedBootDevicesTest_v242-1022497165 tempest-TaggedBootDevicesTest_v242-1022497165-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:70:d1:5b,bridge_name='br-int',has_traffic_filtering=True,id=61b1ec8c-48bc-413b-b19f-48909a05358d,network=Network(ae6d1517-a734-498b-bb06-554fe0816868),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap61b1ec8c-48') {{(pid=75045) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 23:19:59 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:19:59 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap61b1ec8c-48, bridge=br-int, if_exists=True) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:19:59 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 23:19:59 user nova-compute[75045]: INFO os_vif [None req-3e20b61e-19c4-460d-831a-0137ef420f72 tempest-TaggedBootDevicesTest_v242-1022497165 tempest-TaggedBootDevicesTest_v242-1022497165-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:70:d1:5b,bridge_name='br-int',has_traffic_filtering=True,id=61b1ec8c-48bc-413b-b19f-48909a05358d,network=Network(ae6d1517-a734-498b-bb06-554fe0816868),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap61b1ec8c-48')
Nov 08 23:19:59 user nova-compute[75045]: DEBUG nova.virt.libvirt.vif [None req-3e20b61e-19c4-460d-831a-0137ef420f72 tempest-TaggedBootDevicesTest_v242-1022497165 tempest-TaggedBootDevicesTest_v242-1022497165-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T23:18:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-918872471',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-918872471',id=12,image_ref='a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLWzUPBl7zoK5psQ6b+zfY3nZD1vA/wWXZYVYAERV3mtmPAGS/Ucb9+9J79qx6zmClZ3Q8w73hC8GHuQzCukyP5lElXvkXPTiM7z5ABunzck60/h2W50CnOqdK5KIIbbkQ==',key_name='tempest-keypair-178084195',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2adf8b4b78eb494d8fa806e9d7c592a7',ramdisk_id='',reservation_id='r-38dwyk1x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1022497165',owner_user_name='tempest-TaggedBootDevicesTest_v242-1022497165-project-member'},tags=TagList,task_state='block_device_mapping',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T23:18:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='138a510eaf5a489790a3ebc21fde5481',uuid=84f0b650-5f58-443d-92a2-bbd5240a0b6f,vcpu_model=None,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b9c4728f-f4cc-49c9-aca5-288b818b9c34", "address": "fa:16:3e:d0:f0:01", "network": {"id": "ae6d1517-a734-498b-bb06-554fe0816868", "bridge": "br-int", "label": "tempest-device-tagging-net1-228754202", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.205", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2adf8b4b78eb494d8fa806e9d7c592a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9c4728f-f4", "ovs_interfaceid": "b9c4728f-f4cc-49c9-aca5-288b818b9c34", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75045) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 23:19:59 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-3e20b61e-19c4-460d-831a-0137ef420f72 tempest-TaggedBootDevicesTest_v242-1022497165 tempest-TaggedBootDevicesTest_v242-1022497165-project-member] Converting VIF {"id": "b9c4728f-f4cc-49c9-aca5-288b818b9c34", "address": "fa:16:3e:d0:f0:01", "network": {"id": "ae6d1517-a734-498b-bb06-554fe0816868", "bridge": "br-int", "label": "tempest-device-tagging-net1-228754202", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.205", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2adf8b4b78eb494d8fa806e9d7c592a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9c4728f-f4", "ovs_interfaceid": "b9c4728f-f4cc-49c9-aca5-288b818b9c34", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 23:19:59 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-3e20b61e-19c4-460d-831a-0137ef420f72 tempest-TaggedBootDevicesTest_v242-1022497165 tempest-TaggedBootDevicesTest_v242-1022497165-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d0:f0:01,bridge_name='br-int',has_traffic_filtering=True,id=b9c4728f-f4cc-49c9-aca5-288b818b9c34,network=Network(ae6d1517-a734-498b-bb06-554fe0816868),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb9c4728f-f4') {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 23:19:59 user nova-compute[75045]: DEBUG os_vif [None req-3e20b61e-19c4-460d-831a-0137ef420f72 tempest-TaggedBootDevicesTest_v242-1022497165 tempest-TaggedBootDevicesTest_v242-1022497165-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d0:f0:01,bridge_name='br-int',has_traffic_filtering=True,id=b9c4728f-f4cc-49c9-aca5-288b818b9c34,network=Network(ae6d1517-a734-498b-bb06-554fe0816868),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb9c4728f-f4') {{(pid=75045) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 23:19:59 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:19:59 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb9c4728f-f4, bridge=br-int, if_exists=True) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:19:59 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 23:19:59 user nova-compute[75045]: INFO os_vif [None req-3e20b61e-19c4-460d-831a-0137ef420f72 tempest-TaggedBootDevicesTest_v242-1022497165 tempest-TaggedBootDevicesTest_v242-1022497165-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d0:f0:01,bridge_name='br-int',has_traffic_filtering=True,id=b9c4728f-f4cc-49c9-aca5-288b818b9c34,network=Network(ae6d1517-a734-498b-bb06-554fe0816868),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb9c4728f-f4')
Nov 08 23:19:59 user nova-compute[75045]: DEBUG nova.virt.libvirt.vif [None req-3e20b61e-19c4-460d-831a-0137ef420f72 tempest-TaggedBootDevicesTest_v242-1022497165 tempest-TaggedBootDevicesTest_v242-1022497165-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T23:18:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-918872471',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-918872471',id=12,image_ref='a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLWzUPBl7zoK5psQ6b+zfY3nZD1vA/wWXZYVYAERV3mtmPAGS/Ucb9+9J79qx6zmClZ3Q8w73hC8GHuQzCukyP5lElXvkXPTiM7z5ABunzck60/h2W50CnOqdK5KIIbbkQ==',key_name='tempest-keypair-178084195',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2adf8b4b78eb494d8fa806e9d7c592a7',ramdisk_id='',reservation_id='r-38dwyk1x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1022497165',owner_user_name='tempest-TaggedBootDevicesTest_v242-1022497165-project-member'},tags=TagList,task_state='block_device_mapping',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T23:18:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='138a510eaf5a489790a3ebc21fde5481',uuid=84f0b650-5f58-443d-92a2-bbd5240a0b6f,vcpu_model=None,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ddf04b42-4dcd-4981-a301-5b51c3a5a86e", "address": "fa:16:3e:e8:be:34", "network": {"id": "ae6d1517-a734-498b-bb06-554fe0816868", "bridge": "br-int", "label": "tempest-device-tagging-net1-228754202", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.125", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2adf8b4b78eb494d8fa806e9d7c592a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapddf04b42-4d", "ovs_interfaceid": "ddf04b42-4dcd-4981-a301-5b51c3a5a86e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75045) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 23:19:59 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-3e20b61e-19c4-460d-831a-0137ef420f72 tempest-TaggedBootDevicesTest_v242-1022497165 tempest-TaggedBootDevicesTest_v242-1022497165-project-member] Converting VIF {"id": "ddf04b42-4dcd-4981-a301-5b51c3a5a86e", "address": "fa:16:3e:e8:be:34", "network": {"id": "ae6d1517-a734-498b-bb06-554fe0816868", "bridge": "br-int", "label": "tempest-device-tagging-net1-228754202", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.125", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2adf8b4b78eb494d8fa806e9d7c592a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapddf04b42-4d", "ovs_interfaceid": "ddf04b42-4dcd-4981-a301-5b51c3a5a86e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 23:19:59 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-3e20b61e-19c4-460d-831a-0137ef420f72 tempest-TaggedBootDevicesTest_v242-1022497165 tempest-TaggedBootDevicesTest_v242-1022497165-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e8:be:34,bridge_name='br-int',has_traffic_filtering=True,id=ddf04b42-4dcd-4981-a301-5b51c3a5a86e,network=Network(ae6d1517-a734-498b-bb06-554fe0816868),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapddf04b42-4d') {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 23:19:59 user nova-compute[75045]: DEBUG os_vif [None req-3e20b61e-19c4-460d-831a-0137ef420f72 tempest-TaggedBootDevicesTest_v242-1022497165 tempest-TaggedBootDevicesTest_v242-1022497165-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e8:be:34,bridge_name='br-int',has_traffic_filtering=True,id=ddf04b42-4dcd-4981-a301-5b51c3a5a86e,network=Network(ae6d1517-a734-498b-bb06-554fe0816868),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapddf04b42-4d') {{(pid=75045) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 23:19:59 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:19:59 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapddf04b42-4d, bridge=br-int, if_exists=True) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:19:59 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 23:19:59 user nova-compute[75045]: INFO os_vif [None req-3e20b61e-19c4-460d-831a-0137ef420f72 tempest-TaggedBootDevicesTest_v242-1022497165 tempest-TaggedBootDevicesTest_v242-1022497165-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e8:be:34,bridge_name='br-int',has_traffic_filtering=True,id=ddf04b42-4dcd-4981-a301-5b51c3a5a86e,network=Network(ae6d1517-a734-498b-bb06-554fe0816868),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapddf04b42-4d')
Nov 08 23:19:59 user nova-compute[75045]: DEBUG nova.virt.libvirt.vif [None req-3e20b61e-19c4-460d-831a-0137ef420f72 tempest-TaggedBootDevicesTest_v242-1022497165 tempest-TaggedBootDevicesTest_v242-1022497165-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T23:18:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-918872471',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-918872471',id=12,image_ref='a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLWzUPBl7zoK5psQ6b+zfY3nZD1vA/wWXZYVYAERV3mtmPAGS/Ucb9+9J79qx6zmClZ3Q8w73hC8GHuQzCukyP5lElXvkXPTiM7z5ABunzck60/h2W50CnOqdK5KIIbbkQ==',key_name='tempest-keypair-178084195',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2adf8b4b78eb494d8fa806e9d7c592a7',ramdisk_id='',reservation_id='r-38dwyk1x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1022497165',owner_user_name='tempest-TaggedBootDevicesTest_v242-1022497165-project-member'},tags=TagList,task_state='block_device_mapping',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T23:18:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='138a510eaf5a489790a3ebc21fde5481',uuid=84f0b650-5f58-443d-92a2-bbd5240a0b6f,vcpu_model=None,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5ba5ecd6-5bf3-4be1-b79b-d00e7d98d9f8", "address": "fa:16:3e:54:ad:a7", "network": {"id": "926152b1-a3c8-4610-8378-5f00a5878df1", "bridge": "br-int", "label": "tempest-device-tagging-net2-614981566", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2adf8b4b78eb494d8fa806e9d7c592a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ba5ecd6-5b", "ovs_interfaceid": "5ba5ecd6-5bf3-4be1-b79b-d00e7d98d9f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75045) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 23:19:59 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-3e20b61e-19c4-460d-831a-0137ef420f72 tempest-TaggedBootDevicesTest_v242-1022497165 tempest-TaggedBootDevicesTest_v242-1022497165-project-member] Converting VIF {"id": "5ba5ecd6-5bf3-4be1-b79b-d00e7d98d9f8", "address": "fa:16:3e:54:ad:a7", "network": {"id": "926152b1-a3c8-4610-8378-5f00a5878df1", "bridge": "br-int", "label": "tempest-device-tagging-net2-614981566", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2adf8b4b78eb494d8fa806e9d7c592a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ba5ecd6-5b", "ovs_interfaceid": "5ba5ecd6-5bf3-4be1-b79b-d00e7d98d9f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 23:19:59 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-3e20b61e-19c4-460d-831a-0137ef420f72 tempest-TaggedBootDevicesTest_v242-1022497165 tempest-TaggedBootDevicesTest_v242-1022497165-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:54:ad:a7,bridge_name='br-int',has_traffic_filtering=True,id=5ba5ecd6-5bf3-4be1-b79b-d00e7d98d9f8,network=Network(926152b1-a3c8-4610-8378-5f00a5878df1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ba5ecd6-5b') {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 23:19:59 user nova-compute[75045]: DEBUG os_vif [None req-3e20b61e-19c4-460d-831a-0137ef420f72 tempest-TaggedBootDevicesTest_v242-1022497165 tempest-TaggedBootDevicesTest_v242-1022497165-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:54:ad:a7,bridge_name='br-int',has_traffic_filtering=True,id=5ba5ecd6-5bf3-4be1-b79b-d00e7d98d9f8,network=Network(926152b1-a3c8-4610-8378-5f00a5878df1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ba5ecd6-5b') {{(pid=75045) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 23:19:59 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:19:59 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5ba5ecd6-5b, bridge=br-int, if_exists=True) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:19:59 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 23:19:59 user nova-compute[75045]: INFO os_vif [None req-3e20b61e-19c4-460d-831a-0137ef420f72 tempest-TaggedBootDevicesTest_v242-1022497165 tempest-TaggedBootDevicesTest_v242-1022497165-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:54:ad:a7,bridge_name='br-int',has_traffic_filtering=True,id=5ba5ecd6-5bf3-4be1-b79b-d00e7d98d9f8,network=Network(926152b1-a3c8-4610-8378-5f00a5878df1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ba5ecd6-5b')
Nov 08 23:19:59 user nova-compute[75045]: DEBUG nova.virt.libvirt.vif [None req-3e20b61e-19c4-460d-831a-0137ef420f72 tempest-TaggedBootDevicesTest_v242-1022497165 tempest-TaggedBootDevicesTest_v242-1022497165-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T23:18:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-918872471',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-918872471',id=12,image_ref='a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLWzUPBl7zoK5psQ6b+zfY3nZD1vA/wWXZYVYAERV3mtmPAGS/Ucb9+9J79qx6zmClZ3Q8w73hC8GHuQzCukyP5lElXvkXPTiM7z5ABunzck60/h2W50CnOqdK5KIIbbkQ==',key_name='tempest-keypair-178084195',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2adf8b4b78eb494d8fa806e9d7c592a7',ramdisk_id='',reservation_id='r-38dwyk1x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1022497165',owner_user_name='tempest-TaggedBootDevicesTest_v242-1022497165-project-member'},tags=TagList,task_state='block_device_mapping',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T23:18:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='138a510eaf5a489790a3ebc21fde5481',uuid=84f0b650-5f58-443d-92a2-bbd5240a0b6f,vcpu_model=None,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1e76bdd5-2edb-4f5e-baa8-8d82ace77cf3", "address": "fa:16:3e:79:d3:78", "network": {"id": "926152b1-a3c8-4610-8378-5f00a5878df1", "bridge": "br-int", "label": "tempest-device-tagging-net2-614981566", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2adf8b4b78eb494d8fa806e9d7c592a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e76bdd5-2e", "ovs_interfaceid": "1e76bdd5-2edb-4f5e-baa8-8d82ace77cf3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75045) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 23:19:59 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-3e20b61e-19c4-460d-831a-0137ef420f72 tempest-TaggedBootDevicesTest_v242-1022497165 tempest-TaggedBootDevicesTest_v242-1022497165-project-member] Converting VIF {"id": "1e76bdd5-2edb-4f5e-baa8-8d82ace77cf3", "address": "fa:16:3e:79:d3:78", "network": {"id": "926152b1-a3c8-4610-8378-5f00a5878df1", "bridge": "br-int", "label": "tempest-device-tagging-net2-614981566", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2adf8b4b78eb494d8fa806e9d7c592a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e76bdd5-2e", "ovs_interfaceid": "1e76bdd5-2edb-4f5e-baa8-8d82ace77cf3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 23:19:59 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-3e20b61e-19c4-460d-831a-0137ef420f72 tempest-TaggedBootDevicesTest_v242-1022497165 tempest-TaggedBootDevicesTest_v242-1022497165-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:79:d3:78,bridge_name='br-int',has_traffic_filtering=True,id=1e76bdd5-2edb-4f5e-baa8-8d82ace77cf3,network=Network(926152b1-a3c8-4610-8378-5f00a5878df1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1e76bdd5-2e') {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 23:19:59 user nova-compute[75045]: DEBUG os_vif [None req-3e20b61e-19c4-460d-831a-0137ef420f72 tempest-TaggedBootDevicesTest_v242-1022497165 tempest-TaggedBootDevicesTest_v242-1022497165-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:79:d3:78,bridge_name='br-int',has_traffic_filtering=True,id=1e76bdd5-2edb-4f5e-baa8-8d82ace77cf3,network=Network(926152b1-a3c8-4610-8378-5f00a5878df1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1e76bdd5-2e') {{(pid=75045) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 23:19:59 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:19:59 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1e76bdd5-2e, bridge=br-int, if_exists=True) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:19:59 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 23:19:59 user nova-compute[75045]: INFO os_vif [None req-3e20b61e-19c4-460d-831a-0137ef420f72 tempest-TaggedBootDevicesTest_v242-1022497165 tempest-TaggedBootDevicesTest_v242-1022497165-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:79:d3:78,bridge_name='br-int',has_traffic_filtering=True,id=1e76bdd5-2edb-4f5e-baa8-8d82ace77cf3,network=Network(926152b1-a3c8-4610-8378-5f00a5878df1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1e76bdd5-2e')
Nov 08 23:19:59 user nova-compute[75045]: DEBUG nova.compute.manager [None req-3e20b61e-19c4-460d-831a-0137ef420f72 tempest-TaggedBootDevicesTest_v242-1022497165 tempest-TaggedBootDevicesTest_v242-1022497165-project-member] [instance: 84f0b650-5f58-443d-92a2-bbd5240a0b6f] Unplugged VIFs for instance {{(pid=75045) _cleanup_allocated_networks /opt/stack/nova/nova/compute/manager.py:3032}}
Nov 08 23:19:59 user nova-compute[75045]: DEBUG nova.compute.manager [None req-3e20b61e-19c4-460d-831a-0137ef420f72 tempest-TaggedBootDevicesTest_v242-1022497165 tempest-TaggedBootDevicesTest_v242-1022497165-project-member] [instance: 84f0b650-5f58-443d-92a2-bbd5240a0b6f] Deallocating network for instance {{(pid=75045) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 23:19:59 user nova-compute[75045]: DEBUG nova.network.neutron [None req-3e20b61e-19c4-460d-831a-0137ef420f72 tempest-TaggedBootDevicesTest_v242-1022497165 tempest-TaggedBootDevicesTest_v242-1022497165-project-member] [instance: 84f0b650-5f58-443d-92a2-bbd5240a0b6f] deallocate_for_instance() {{(pid=75045) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 23:19:59 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-0c9c7288-cef6-40c5-be76-5d17c13493d1 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262-project-member] Acquiring lock "82bc5fd0-26c7-4f81-b966-54831393b617" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:19:59 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-0c9c7288-cef6-40c5-be76-5d17c13493d1 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262-project-member] Lock "82bc5fd0-26c7-4f81-b966-54831393b617" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:19:59 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-8b435292-6609-4c27-a9fd-1daf316eca29 tempest-TestVolumeSwap-1091185069 tempest-TestVolumeSwap-1091185069-project-admin] Acquiring lock "fde91f7c-31e3-456c-b252-6ce37fa3b600" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:19:59 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-8b435292-6609-4c27-a9fd-1daf316eca29 tempest-TestVolumeSwap-1091185069 tempest-TestVolumeSwap-1091185069-project-admin] Lock "fde91f7c-31e3-456c-b252-6ce37fa3b600" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:19:59 user nova-compute[75045]: INFO nova.compute.manager [None req-0c9c7288-cef6-40c5-be76-5d17c13493d1 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262-project-member] [instance: 82bc5fd0-26c7-4f81-b966-54831393b617] Detaching volume 1bec3976-0b2c-436e-9c4a-eeb6b8badbae
Nov 08 23:19:59 user nova-compute[75045]: DEBUG os_brick.utils [None req-8b435292-6609-4c27-a9fd-1daf316eca29 tempest-TestVolumeSwap-1091185069 tempest-TestVolumeSwap-1091185069-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75045) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 23:19:59 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:19:59 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:19:59 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[c785cfe7-a222-4759-8861-4f795bff8be1]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6217bd6e884\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:19:59 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:19:59 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:19:59 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bd51a33-8afc-4152-a17f-527ad445a6d5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:20:00 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:20:00 user nova-compute[75045]: INFO nova.virt.block_device [None req-0c9c7288-cef6-40c5-be76-5d17c13493d1 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262-project-member] [instance: 82bc5fd0-26c7-4f81-b966-54831393b617] Attempting to driver detach volume 1bec3976-0b2c-436e-9c4a-eeb6b8badbae from mountpoint /dev/vdb
Nov 08 23:20:00 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.029s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:20:00 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[cef33bde-dfe7-4d9c-bc0f-21daa00b87d5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:20:00 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[46ba1edb-424e-449f-8667-9b6fc7b216b2]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:20:00 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-8b435292-6609-4c27-a9fd-1daf316eca29 tempest-TestVolumeSwap-1091185069 tempest-TestVolumeSwap-1091185069-project-admin] Running cmd (subprocess): nvme version {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:20:00 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-8b435292-6609-4c27-a9fd-1daf316eca29 tempest-TestVolumeSwap-1091185069 tempest-TestVolumeSwap-1091185069-project-admin] 'nvme version' failed. Not Retrying. {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 23:20:00 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8b435292-6609-4c27-a9fd-1daf316eca29 tempest-TestVolumeSwap-1091185069 tempest-TestVolumeSwap-1091185069-project-admin] nvme not present on system {{(pid=75045) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 23:20:00 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:20:00 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 23:20:00 user nova-compute[75045]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 23:20:00 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e9ccb36-ee70-48a5-97ce-4380871412c2]: (4, '') {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:20:00 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.lightos [None req-8b435292-6609-4c27-a9fd-1daf316eca29 tempest-TestVolumeSwap-1091185069 tempest-TestVolumeSwap-1091185069-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75045) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 23:20:00 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.lightos [None req-8b435292-6609-4c27-a9fd-1daf316eca29 tempest-TestVolumeSwap-1091185069 tempest-TestVolumeSwap-1091185069-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75045) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 23:20:00 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.lightos [None req-8b435292-6609-4c27-a9fd-1daf316eca29 tempest-TestVolumeSwap-1091185069 tempest-TestVolumeSwap-1091185069-project-admin] LIGHTOS: no hostnqn found. {{(pid=75045) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 23:20:00 user nova-compute[75045]: DEBUG os_brick.utils [None req-8b435292-6609-4c27-a9fd-1daf316eca29 tempest-TestVolumeSwap-1091185069 tempest-TestVolumeSwap-1091185069-project-admin] <== get_connector_properties: return (161ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6217bd6e884', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75045) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 23:20:00 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-0c9c7288-cef6-40c5-be76-5d17c13493d1 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262-project-member] Attempting to detach device vdb from instance 82bc5fd0-26c7-4f81-b966-54831393b617 from the persistent domain config. {{(pid=75045) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 08 23:20:00 user nova-compute[75045]: DEBUG nova.virt.libvirt.guest [None req-0c9c7288-cef6-40c5-be76-5d17c13493d1 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 23:20:00 user nova-compute[75045]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 23:20:00 user nova-compute[75045]:   <source dev="/dev/sdj"/>
Nov 08 23:20:00 user nova-compute[75045]:   <target dev="vdb" bus="virtio"/>
Nov 08 23:20:00 user nova-compute[75045]:   <serial>1bec3976-0b2c-436e-9c4a-eeb6b8badbae</serial>
Nov 08 23:20:00 user nova-compute[75045]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 08 23:20:00 user nova-compute[75045]: </disk>
Nov 08 23:20:00 user nova-compute[75045]:  {{(pid=75045) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 23:20:00 user nova-compute[75045]: INFO nova.virt.libvirt.driver [None req-0c9c7288-cef6-40c5-be76-5d17c13493d1 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262-project-member] Successfully detached device vdb from instance 82bc5fd0-26c7-4f81-b966-54831393b617 from the persistent domain config.
Nov 08 23:20:00 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-0c9c7288-cef6-40c5-be76-5d17c13493d1 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 82bc5fd0-26c7-4f81-b966-54831393b617 from the live domain config. {{(pid=75045) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 08 23:20:00 user nova-compute[75045]: DEBUG nova.virt.libvirt.guest [None req-0c9c7288-cef6-40c5-be76-5d17c13493d1 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 23:20:00 user nova-compute[75045]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 23:20:00 user nova-compute[75045]:   <source dev="/dev/sdj"/>
Nov 08 23:20:00 user nova-compute[75045]:   <target dev="vdb" bus="virtio"/>
Nov 08 23:20:00 user nova-compute[75045]:   <serial>1bec3976-0b2c-436e-9c4a-eeb6b8badbae</serial>
Nov 08 23:20:00 user nova-compute[75045]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 08 23:20:00 user nova-compute[75045]: </disk>
Nov 08 23:20:00 user nova-compute[75045]:  {{(pid=75045) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 23:20:00 user nova-compute[75045]: INFO nova.compute.manager [None req-8b435292-6609-4c27-a9fd-1daf316eca29 tempest-TestVolumeSwap-1091185069 tempest-TestVolumeSwap-1091185069-project-admin] [instance: fde91f7c-31e3-456c-b252-6ce37fa3b600] Swapping volume c7f7084f-f0d7-4d4b-9a14-69065a9c3e41 for 4d7a4df0-bfc5-4952-8454-97b703b68f28
Nov 08 23:20:00 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-0c9c7288-cef6-40c5-be76-5d17c13493d1 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 82bc5fd0-26c7-4f81-b966-54831393b617 {{(pid=75045) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 08 23:20:00 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:20:03 user nova-compute[75045]: DEBUG nova.network.neutron [None req-3e20b61e-19c4-460d-831a-0137ef420f72 tempest-TaggedBootDevicesTest_v242-1022497165 tempest-TaggedBootDevicesTest_v242-1022497165-project-member] [instance: 84f0b650-5f58-443d-92a2-bbd5240a0b6f] Updating instance_info_cache with network_info: [] {{(pid=75045) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 23:20:03 user nova-compute[75045]: INFO nova.compute.manager [None req-3e20b61e-19c4-460d-831a-0137ef420f72 tempest-TaggedBootDevicesTest_v242-1022497165 tempest-TaggedBootDevicesTest_v242-1022497165-project-member] [instance: 84f0b650-5f58-443d-92a2-bbd5240a0b6f] Took 3.67 seconds to deallocate network for instance.
Nov 08 23:20:03 user nova-compute[75045]: DEBUG nova.compute.manager [None req-3e20b61e-19c4-460d-831a-0137ef420f72 tempest-TaggedBootDevicesTest_v242-1022497165 tempest-TaggedBootDevicesTest_v242-1022497165-project-member] [instance: 84f0b650-5f58-443d-92a2-bbd5240a0b6f] Detaching volume: 48ebf6bb-f8ec-45f7-aa58-04e071193771 {{(pid=75045) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3224}}
Nov 08 23:20:03 user nova-compute[75045]: INFO nova.compute.manager [None req-3e20b61e-19c4-460d-831a-0137ef420f72 tempest-TaggedBootDevicesTest_v242-1022497165 tempest-TaggedBootDevicesTest_v242-1022497165-project-member] [instance: 84f0b650-5f58-443d-92a2-bbd5240a0b6f] Detaching volume 48ebf6bb-f8ec-45f7-aa58-04e071193771
Nov 08 23:20:03 user nova-compute[75045]: DEBUG nova.virt.block_device [None req-3e20b61e-19c4-460d-831a-0137ef420f72 tempest-TaggedBootDevicesTest_v242-1022497165 tempest-TaggedBootDevicesTest_v242-1022497165-project-member] [instance: 84f0b650-5f58-443d-92a2-bbd5240a0b6f] Skipping driver_detach during remote rebuild. {{(pid=75045) _do_detach /opt/stack/nova/nova/virt/block_device.py:461}}
Nov 08 23:20:04 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:20:04 user nova-compute[75045]: WARNING nova.compute.manager [None req-3e20b61e-19c4-460d-831a-0137ef420f72 tempest-TaggedBootDevicesTest_v242-1022497165 tempest-TaggedBootDevicesTest_v242-1022497165-project-member] Failed to detach volume: 48ebf6bb-f8ec-45f7-aa58-04e071193771 due to 'NoneType' object has no attribute 'devices'
Nov 08 23:20:04 user nova-compute[75045]: DEBUG nova.compute.manager [None req-3e20b61e-19c4-460d-831a-0137ef420f72 tempest-TaggedBootDevicesTest_v242-1022497165 tempest-TaggedBootDevicesTest_v242-1022497165-project-member] [instance: 84f0b650-5f58-443d-92a2-bbd5240a0b6f] Detaching volume: da45fa32-76b9-4f57-8e19-733f235e20b0 {{(pid=75045) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3224}}
Nov 08 23:20:04 user nova-compute[75045]: INFO nova.compute.manager [None req-3e20b61e-19c4-460d-831a-0137ef420f72 tempest-TaggedBootDevicesTest_v242-1022497165 tempest-TaggedBootDevicesTest_v242-1022497165-project-member] [instance: 84f0b650-5f58-443d-92a2-bbd5240a0b6f] Detaching volume da45fa32-76b9-4f57-8e19-733f235e20b0
Nov 08 23:20:04 user nova-compute[75045]: DEBUG nova.virt.block_device [None req-3e20b61e-19c4-460d-831a-0137ef420f72 tempest-TaggedBootDevicesTest_v242-1022497165 tempest-TaggedBootDevicesTest_v242-1022497165-project-member] [instance: 84f0b650-5f58-443d-92a2-bbd5240a0b6f] Skipping driver_detach during remote rebuild. {{(pid=75045) _do_detach /opt/stack/nova/nova/virt/block_device.py:461}}
Nov 08 23:20:04 user nova-compute[75045]: WARNING nova.compute.manager [None req-3e20b61e-19c4-460d-831a-0137ef420f72 tempest-TaggedBootDevicesTest_v242-1022497165 tempest-TaggedBootDevicesTest_v242-1022497165-project-member] Failed to detach volume: da45fa32-76b9-4f57-8e19-733f235e20b0 due to 'NoneType' object has no attribute 'devices'
Nov 08 23:20:04 user nova-compute[75045]: DEBUG nova.compute.manager [None req-3e20b61e-19c4-460d-831a-0137ef420f72 tempest-TaggedBootDevicesTest_v242-1022497165 tempest-TaggedBootDevicesTest_v242-1022497165-project-member] [instance: 84f0b650-5f58-443d-92a2-bbd5240a0b6f] Detaching volume: cc40063c-698a-4259-addf-5136d4e2c1f6 {{(pid=75045) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3224}}
Nov 08 23:20:04 user nova-compute[75045]: INFO nova.compute.manager [None req-3e20b61e-19c4-460d-831a-0137ef420f72 tempest-TaggedBootDevicesTest_v242-1022497165 tempest-TaggedBootDevicesTest_v242-1022497165-project-member] [instance: 84f0b650-5f58-443d-92a2-bbd5240a0b6f] Detaching volume cc40063c-698a-4259-addf-5136d4e2c1f6
Nov 08 23:20:04 user nova-compute[75045]: DEBUG nova.virt.block_device [None req-3e20b61e-19c4-460d-831a-0137ef420f72 tempest-TaggedBootDevicesTest_v242-1022497165 tempest-TaggedBootDevicesTest_v242-1022497165-project-member] [instance: 84f0b650-5f58-443d-92a2-bbd5240a0b6f] Skipping driver_detach during remote rebuild. {{(pid=75045) _do_detach /opt/stack/nova/nova/virt/block_device.py:461}}
Nov 08 23:20:04 user nova-compute[75045]: INFO nova.scheduler.client.report [None req-3e20b61e-19c4-460d-831a-0137ef420f72 tempest-TaggedBootDevicesTest_v242-1022497165 tempest-TaggedBootDevicesTest_v242-1022497165-project-member] Deleted allocations for instance 84f0b650-5f58-443d-92a2-bbd5240a0b6f
Nov 08 23:20:04 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-3e20b61e-19c4-460d-831a-0137ef420f72 tempest-TaggedBootDevicesTest_v242-1022497165 tempest-TaggedBootDevicesTest_v242-1022497165-project-member] Lock "84f0b650-5f58-443d-92a2-bbd5240a0b6f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 78.880s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:20:05 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:20:09 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:20:09 user nova-compute[75045]: WARNING nova.virt.libvirt.driver [None req-e0694800-7d06-4e31-a22b-eb1868d5bda7 tempest-VolumesAssistedSnapshotsTest-1482710492 tempest-VolumesAssistedSnapshotsTest-1482710492-project-admin] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 07ec2c05-aaa9-46e8-8439-7aa5b9fca19d is timed out.
Nov 08 23:20:09 user nova-compute[75045]: INFO nova.virt.libvirt.driver [None req-e0694800-7d06-4e31-a22b-eb1868d5bda7 tempest-VolumesAssistedSnapshotsTest-1482710492 tempest-VolumesAssistedSnapshotsTest-1482710492-project-admin] Successfully detached device vdb from instance 07ec2c05-aaa9-46e8-8439-7aa5b9fca19d from the live domain config.
Nov 08 23:20:09 user nova-compute[75045]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e0694800-7d06-4e31-a22b-eb1868d5bda7 tempest-VolumesAssistedSnapshotsTest-1482710492 tempest-VolumesAssistedSnapshotsTest-1482710492-project-admin] [instance: 07ec2c05-aaa9-46e8-8439-7aa5b9fca19d] calling os-brick to detach iSCSI Volume {{(pid=75045) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 23:20:09 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0694800-7d06-4e31-a22b-eb1868d5bda7 tempest-VolumesAssistedSnapshotsTest-1482710492 tempest-VolumesAssistedSnapshotsTest-1482710492-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1b68210460>, {'target_iqn': 'iqn.2010-10.org.openstack:f829f03c-8f1a-45f1-a715-b9d769201d1b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PmvVbZrA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=75045) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 23:20:09 user nova-compute[75045]: WARNING os_brick.initiator.connectors.base [None req-e0694800-7d06-4e31-a22b-eb1868d5bda7 tempest-VolumesAssistedSnapshotsTest-1482710492 tempest-VolumesAssistedSnapshotsTest-1482710492-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 23:20:09 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-e0694800-7d06-4e31-a22b-eb1868d5bda7 tempest-VolumesAssistedSnapshotsTest-1482710492 tempest-VolumesAssistedSnapshotsTest-1482710492-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 23:20:09 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-e0694800-7d06-4e31-a22b-eb1868d5bda7 tempest-VolumesAssistedSnapshotsTest-1482710492 tempest-VolumesAssistedSnapshotsTest-1482710492-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 23:20:09 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:20:09 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:20:09 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[24a92696-c4e7-440d-a109-cd42ebfa922d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8d2ff5d0-0b89-42ba-92eb-1e12c9cce205\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1bec3976-0b2c-436e-9c4a-eeb6b8badbae\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6ed77146-5ae0-400d-8116-7f9eb1322808\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:528866cb-30dd-40ac-9a81-4c6afc93cdd9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:175bb2c0-7767-4740-9350-7e3300681a43\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c7f7084f-f0d7-4d4b-9a14-69065a9c3e41\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f829f03c-8f1a-45f1-a715-b9d769201d1b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:20:09 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0694800-7d06-4e31-a22b-eb1868d5bda7 tempest-VolumesAssistedSnapshotsTest-1482710492 tempest-VolumesAssistedSnapshotsTest-1482710492-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 23:20:09 user nova-compute[75045]: No targets found.
Nov 08 23:20:09 user nova-compute[75045]: iSNS:
Nov 08 23:20:09 user nova-compute[75045]: No targets found.
Nov 08 23:20:09 user nova-compute[75045]: STATIC:
Nov 08 23:20:09 user nova-compute[75045]: Target: iqn.2010-10.org.openstack:8d2ff5d0-0b89-42ba-92eb-1e12c9cce205
Nov 08 23:20:09 user nova-compute[75045]:         Portal: 172.16.0.220:3260,-1
Nov 08 23:20:09 user nova-compute[75045]:                 Iface Name: default
Nov 08 23:20:09 user nova-compute[75045]: Target: iqn.2010-10.org.openstack:1bec3976-0b2c-436e-9c4a-eeb6b8badbae
Nov 08 23:20:09 user nova-compute[75045]:         Portal: 172.16.0.220:3260,-1
Nov 08 23:20:09 user nova-compute[75045]:                 Iface Name: default
Nov 08 23:20:09 user nova-compute[75045]: Target: iqn.2010-10.org.openstack:6ed77146-5ae0-400d-8116-7f9eb1322808
Nov 08 23:20:09 user nova-compute[75045]:         Portal: 172.16.0.220:3260,-1
Nov 08 23:20:09 user nova-compute[75045]:                 Iface Name: default
Nov 08 23:20:09 user nova-compute[75045]: Target: iqn.2010-10.org.openstack:528866cb-30dd-40ac-9a81-4c6afc93cdd9
Nov 08 23:20:09 user nova-compute[75045]:         Portal: 172.16.0.220:3260,-1
Nov 08 23:20:09 user nova-compute[75045]:                 Iface Name: default
Nov 08 23:20:09 user nova-compute[75045]: Target: iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab
Nov 08 23:20:09 user nova-compute[75045]:         Portal: 172.16.0.220:3260,-1
Nov 08 23:20:09 user nova-compute[75045]:                 Iface Name: default
Nov 08 23:20:09 user nova-compute[75045]: Target: iqn.2010-10.org.openstack:175bb2c0-7767-4740-9350-7e3300681a43
Nov 08 23:20:09 user nova-compute[75045]:         Portal: 172.16.0.220:3260,-1
Nov 08 23:20:09 user nova-compute[75045]:                 Iface Name: default
Nov 08 23:20:09 user nova-compute[75045]: Target: iqn.2010-10.org.openstack:c7f7084f-f0d7-4d4b-9a14-69065a9c3e41
Nov 08 23:20:09 user nova-compute[75045]:         Portal: 172.16.0.220:3260,-1
Nov 08 23:20:09 user nova-compute[75045]:                 Iface Name: default
Nov 08 23:20:09 user nova-compute[75045]: Target: iqn.2010-10.org.openstack:f829f03c-8f1a-45f1-a715-b9d769201d1b
Nov 08 23:20:09 user nova-compute[75045]:         Portal: 172.16.0.220:3260,-1
Nov 08 23:20:09 user nova-compute[75045]:                 Iface Name: default
Nov 08 23:20:09 user nova-compute[75045]: FIRMWARE:
Nov 08 23:20:09 user nova-compute[75045]: No targets found.
Nov 08 23:20:09 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 23:20:09 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0694800-7d06-4e31-a22b-eb1868d5bda7 tempest-VolumesAssistedSnapshotsTest-1482710492 tempest-VolumesAssistedSnapshotsTest-1482710492-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 23:20:09 user nova-compute[75045]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 23:20:09 user nova-compute[75045]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75045) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 23:20:09 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0694800-7d06-4e31-a22b-eb1868d5bda7 tempest-VolumesAssistedSnapshotsTest-1482710492 tempest-VolumesAssistedSnapshotsTest-1482710492-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f829f03c-8f1a-45f1-a715-b9d769201d1b', 0)] {{(pid=75045) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 23:20:09 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:20:10 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.028s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:20:10 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3708451-96e9-4359-95b7-ff6d6493c07f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:175bb2c0-7767-4740-9350-7e3300681a43\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1bec3976-0b2c-436e-9c4a-eeb6b8badbae\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:528866cb-30dd-40ac-9a81-4c6afc93cdd9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6ed77146-5ae0-400d-8116-7f9eb1322808\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8d2ff5d0-0b89-42ba-92eb-1e12c9cce205\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c7f7084f-f0d7-4d4b-9a14-69065a9c3e41\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f829f03c-8f1a-45f1-a715-b9d769201d1b\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:20:10 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:20:10 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.040s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:20:10 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[7feae511-c91a-41a9-9513-dd727a0de2cf]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d2ff5d0-0b89-42ba-92eb-1e12c9cce205 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7f7084f-f0d7-4d4b-9a14-69065a9c3e41 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1bec3976-0b2c-436e-9c4a-eeb6b8badbae (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f829f03c-8f1a-45f1-a715-b9d769201d1b (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:528866cb-30dd-40ac-9a81-4c6afc93cdd9 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:175bb2c0-7767-4740-9350-7e3300681a43 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ed77146-5ae0-400d-8116-7f9eb1322808 (non-flash)\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:20:10 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0694800-7d06-4e31-a22b-eb1868d5bda7 tempest-VolumesAssistedSnapshotsTest-1482710492 tempest-VolumesAssistedSnapshotsTest-1482710492-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d2ff5d0-0b89-42ba-92eb-1e12c9cce205 (non-flash)
Nov 08 23:20:10 user nova-compute[75045]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab (non-flash)
Nov 08 23:20:10 user nova-compute[75045]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7f7084f-f0d7-4d4b-9a14-69065a9c3e41 (non-flash)
Nov 08 23:20:10 user nova-compute[75045]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1bec3976-0b2c-436e-9c4a-eeb6b8badbae (non-flash)
Nov 08 23:20:10 user nova-compute[75045]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f829f03c-8f1a-45f1-a715-b9d769201d1b (non-flash)
Nov 08 23:20:10 user nova-compute[75045]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:528866cb-30dd-40ac-9a81-4c6afc93cdd9 (non-flash)
Nov 08 23:20:10 user nova-compute[75045]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:175bb2c0-7767-4740-9350-7e3300681a43 (non-flash)
Nov 08 23:20:10 user nova-compute[75045]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ed77146-5ae0-400d-8116-7f9eb1322808 (non-flash)
Nov 08 23:20:10 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 23:20:10 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0694800-7d06-4e31-a22b-eb1868d5bda7 tempest-VolumesAssistedSnapshotsTest-1482710492 tempest-VolumesAssistedSnapshotsTest-1482710492-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d2ff5d0-0b89-42ba-92eb-1e12c9cce205 (non-flash)
Nov 08 23:20:10 user nova-compute[75045]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab (non-flash)
Nov 08 23:20:10 user nova-compute[75045]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7f7084f-f0d7-4d4b-9a14-69065a9c3e41 (non-flash)
Nov 08 23:20:10 user nova-compute[75045]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1bec3976-0b2c-436e-9c4a-eeb6b8badbae (non-flash)
Nov 08 23:20:10 user nova-compute[75045]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f829f03c-8f1a-45f1-a715-b9d769201d1b (non-flash)
Nov 08 23:20:10 user nova-compute[75045]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:528866cb-30dd-40ac-9a81-4c6afc93cdd9 (non-flash)
Nov 08 23:20:10 user nova-compute[75045]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:175bb2c0-7767-4740-9350-7e3300681a43 (non-flash)
Nov 08 23:20:10 user nova-compute[75045]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ed77146-5ae0-400d-8116-7f9eb1322808 (non-flash)
Nov 08 23:20:10 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 23:20:10 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0694800-7d06-4e31-a22b-eb1868d5bda7 tempest-VolumesAssistedSnapshotsTest-1482710492 tempest-VolumesAssistedSnapshotsTest-1482710492-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1b485b2b90>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f829f03c-8f1a-45f1-a715-b9d769201d1b'): ({'sde'}, set())}) {{(pid=75045) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 23:20:10 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-e0694800-7d06-4e31-a22b-eb1868d5bda7 tempest-VolumesAssistedSnapshotsTest-1482710492 tempest-VolumesAssistedSnapshotsTest-1482710492-project-admin] Removing single pathed devices sde {{(pid=75045) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 23:20:10 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:20:10 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:20:10 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c71984f-dd9e-46b8-a955-b9a68431869e]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:20:10 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:20:10 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.022s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:20:10 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[57732060-efd7-4a52-a84f-a1a850eb28f3]: (4, ('ok\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:20:10 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-e0694800-7d06-4e31-a22b-eb1868d5bda7 tempest-VolumesAssistedSnapshotsTest-1482710492 tempest-VolumesAssistedSnapshotsTest-1482710492-project-admin] Flushing IO for device /dev/sde {{(pid=75045) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 23:20:10 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:20:10 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.015s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:20:10 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce500bb6-eada-4d0a-83c4-2755d3a46d8b]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:20:10 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-e0694800-7d06-4e31-a22b-eb1868d5bda7 tempest-VolumesAssistedSnapshotsTest-1482710492 tempest-VolumesAssistedSnapshotsTest-1482710492-project-admin] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75045) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 23:20:10 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:20:10 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.045s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:20:10 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[e284e9df-d11e-4aa1-9f4c-b5c61aa21cef]: (4, ('1', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:20:10 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-e0694800-7d06-4e31-a22b-eb1868d5bda7 tempest-VolumesAssistedSnapshotsTest-1482710492 tempest-VolumesAssistedSnapshotsTest-1482710492-project-admin] Checking to see if SCSI volumes sde have been removed. {{(pid=75045) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 23:20:10 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-e0694800-7d06-4e31-a22b-eb1868d5bda7 tempest-VolumesAssistedSnapshotsTest-1482710492 tempest-VolumesAssistedSnapshotsTest-1482710492-project-admin] SCSI volumes sde have been removed. {{(pid=75045) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 23:20:10 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0694800-7d06-4e31-a22b-eb1868d5bda7 tempest-VolumesAssistedSnapshotsTest-1482710492 tempest-VolumesAssistedSnapshotsTest-1482710492-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f829f03c-8f1a-45f1-a715-b9d769201d1b')] {{(pid=75045) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 23:20:10 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f829f03c-8f1a-45f1-a715-b9d769201d1b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:20:10 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f829f03c-8f1a-45f1-a715-b9d769201d1b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:20:10 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f2e3dec-ce7e-4e15-ae75-745285d30873]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:20:10 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0694800-7d06-4e31-a22b-eb1868d5bda7 tempest-VolumesAssistedSnapshotsTest-1482710492 tempest-VolumesAssistedSnapshotsTest-1482710492-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:20:10 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f829f03c-8f1a-45f1-a715-b9d769201d1b -p 172.16.0.220:3260 --logout {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:20:10 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f829f03c-8f1a-45f1-a715-b9d769201d1b -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:20:10 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[75b0c488-a90f-4df1-84fe-cbc3f6854afe]: (4, ('Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:f829f03c-8f1a-45f1-a715-b9d769201d1b, portal: 172.16.0.220,3260]\nLogout of [sid: 6, target: iqn.2010-10.org.openstack:f829f03c-8f1a-45f1-a715-b9d769201d1b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:20:10 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0694800-7d06-4e31-a22b-eb1868d5bda7 tempest-VolumesAssistedSnapshotsTest-1482710492 tempest-VolumesAssistedSnapshotsTest-1482710492-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:f829f03c-8f1a-45f1-a715-b9d769201d1b, portal: 172.16.0.220,3260]
Nov 08 23:20:10 user nova-compute[75045]: Logout of [sid: 6, target: iqn.2010-10.org.openstack:f829f03c-8f1a-45f1-a715-b9d769201d1b, portal: 172.16.0.220,3260] successful.
Nov 08 23:20:10 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:20:10 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f829f03c-8f1a-45f1-a715-b9d769201d1b -p 172.16.0.220:3260 --op delete {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:20:10 user nova-compute[75045]: WARNING nova.virt.libvirt.driver [None req-cd1d6b86-2aa1-4ecb-8c4e-1cf5c01f7fa0 tempest-TaggedAttachmentsTest-1639503389 tempest-TaggedAttachmentsTest-1639503389-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 1cb1b440-0073-4a53-a0a2-e2781e021866 is timed out.
Nov 08 23:20:10 user nova-compute[75045]: INFO nova.virt.libvirt.driver [None req-cd1d6b86-2aa1-4ecb-8c4e-1cf5c01f7fa0 tempest-TaggedAttachmentsTest-1639503389 tempest-TaggedAttachmentsTest-1639503389-project-member] Successfully detached device vdb from instance 1cb1b440-0073-4a53-a0a2-e2781e021866 from the live domain config.
Nov 08 23:20:10 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f829f03c-8f1a-45f1-a715-b9d769201d1b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:20:10 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[01b16563-8393-4105-b457-6736c0900b23]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:20:10 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0694800-7d06-4e31-a22b-eb1868d5bda7 tempest-VolumesAssistedSnapshotsTest-1482710492 tempest-VolumesAssistedSnapshotsTest-1482710492-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:20:10 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-e0694800-7d06-4e31-a22b-eb1868d5bda7 tempest-VolumesAssistedSnapshotsTest-1482710492 tempest-VolumesAssistedSnapshotsTest-1482710492-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.361s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 23:20:10 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0694800-7d06-4e31-a22b-eb1868d5bda7 tempest-VolumesAssistedSnapshotsTest-1482710492 tempest-VolumesAssistedSnapshotsTest-1482710492-project-admin] <== disconnect_volume: return (363ms) None {{(pid=75045) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 23:20:10 user nova-compute[75045]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e0694800-7d06-4e31-a22b-eb1868d5bda7 tempest-VolumesAssistedSnapshotsTest-1482710492 tempest-VolumesAssistedSnapshotsTest-1482710492-project-admin] [instance: 07ec2c05-aaa9-46e8-8439-7aa5b9fca19d] Disconnected iSCSI Volume {{(pid=75045) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 23:20:10 user nova-compute[75045]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cd1d6b86-2aa1-4ecb-8c4e-1cf5c01f7fa0 tempest-TaggedAttachmentsTest-1639503389 tempest-TaggedAttachmentsTest-1639503389-project-member] [instance: 1cb1b440-0073-4a53-a0a2-e2781e021866] calling os-brick to detach iSCSI Volume {{(pid=75045) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 23:20:10 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd1d6b86-2aa1-4ecb-8c4e-1cf5c01f7fa0 tempest-TaggedAttachmentsTest-1639503389 tempest-TaggedAttachmentsTest-1639503389-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1b68210460>, {'target_iqn': 'iqn.2010-10.org.openstack:528866cb-30dd-40ac-9a81-4c6afc93cdd9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mpVfHWuQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=75045) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 23:20:10 user nova-compute[75045]: WARNING os_brick.initiator.connectors.base [None req-cd1d6b86-2aa1-4ecb-8c4e-1cf5c01f7fa0 tempest-TaggedAttachmentsTest-1639503389 tempest-TaggedAttachmentsTest-1639503389-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 23:20:10 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-cd1d6b86-2aa1-4ecb-8c4e-1cf5c01f7fa0 tempest-TaggedAttachmentsTest-1639503389 tempest-TaggedAttachmentsTest-1639503389-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 23:20:10 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-cd1d6b86-2aa1-4ecb-8c4e-1cf5c01f7fa0 tempest-TaggedAttachmentsTest-1639503389 tempest-TaggedAttachmentsTest-1639503389-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 23:20:10 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:20:10 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.028s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:20:10 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[149db5a2-662f-42f6-baca-8e25630a74c9]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8d2ff5d0-0b89-42ba-92eb-1e12c9cce205\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1bec3976-0b2c-436e-9c4a-eeb6b8badbae\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6ed77146-5ae0-400d-8116-7f9eb1322808\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:528866cb-30dd-40ac-9a81-4c6afc93cdd9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:175bb2c0-7767-4740-9350-7e3300681a43\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c7f7084f-f0d7-4d4b-9a14-69065a9c3e41\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:20:10 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd1d6b86-2aa1-4ecb-8c4e-1cf5c01f7fa0 tempest-TaggedAttachmentsTest-1639503389 tempest-TaggedAttachmentsTest-1639503389-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 23:20:10 user nova-compute[75045]: No targets found.
Nov 08 23:20:10 user nova-compute[75045]: iSNS:
Nov 08 23:20:10 user nova-compute[75045]: No targets found.
Nov 08 23:20:10 user nova-compute[75045]: STATIC:
Nov 08 23:20:10 user nova-compute[75045]: Target: iqn.2010-10.org.openstack:8d2ff5d0-0b89-42ba-92eb-1e12c9cce205
Nov 08 23:20:10 user nova-compute[75045]:         Portal: 172.16.0.220:3260,-1
Nov 08 23:20:10 user nova-compute[75045]:                 Iface Name: default
Nov 08 23:20:10 user nova-compute[75045]: Target: iqn.2010-10.org.openstack:1bec3976-0b2c-436e-9c4a-eeb6b8badbae
Nov 08 23:20:10 user nova-compute[75045]:         Portal: 172.16.0.220:3260,-1
Nov 08 23:20:10 user nova-compute[75045]:                 Iface Name: default
Nov 08 23:20:10 user nova-compute[75045]: Target: iqn.2010-10.org.openstack:6ed77146-5ae0-400d-8116-7f9eb1322808
Nov 08 23:20:10 user nova-compute[75045]:         Portal: 172.16.0.220:3260,-1
Nov 08 23:20:10 user nova-compute[75045]:                 Iface Name: default
Nov 08 23:20:10 user nova-compute[75045]: Target: iqn.2010-10.org.openstack:528866cb-30dd-40ac-9a81-4c6afc93cdd9
Nov 08 23:20:10 user nova-compute[75045]:         Portal: 172.16.0.220:3260,-1
Nov 08 23:20:10 user nova-compute[75045]:                 Iface Name: default
Nov 08 23:20:10 user nova-compute[75045]: Target: iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab
Nov 08 23:20:10 user nova-compute[75045]:         Portal: 172.16.0.220:3260,-1
Nov 08 23:20:10 user nova-compute[75045]:                 Iface Name: default
Nov 08 23:20:10 user nova-compute[75045]: Target: iqn.2010-10.org.openstack:175bb2c0-7767-4740-9350-7e3300681a43
Nov 08 23:20:10 user nova-compute[75045]:         Portal: 172.16.0.220:3260,-1
Nov 08 23:20:10 user nova-compute[75045]:                 Iface Name: default
Nov 08 23:20:10 user nova-compute[75045]: Target: iqn.2010-10.org.openstack:c7f7084f-f0d7-4d4b-9a14-69065a9c3e41
Nov 08 23:20:10 user nova-compute[75045]:         Portal: 172.16.0.220:3260,-1
Nov 08 23:20:10 user nova-compute[75045]:                 Iface Name: default
Nov 08 23:20:10 user nova-compute[75045]: FIRMWARE:
Nov 08 23:20:10 user nova-compute[75045]: No targets found.
Nov 08 23:20:10 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 23:20:10 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd1d6b86-2aa1-4ecb-8c4e-1cf5c01f7fa0 tempest-TaggedAttachmentsTest-1639503389 tempest-TaggedAttachmentsTest-1639503389-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 23:20:10 user nova-compute[75045]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 23:20:10 user nova-compute[75045]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75045) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 23:20:10 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd1d6b86-2aa1-4ecb-8c4e-1cf5c01f7fa0 tempest-TaggedAttachmentsTest-1639503389 tempest-TaggedAttachmentsTest-1639503389-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:528866cb-30dd-40ac-9a81-4c6afc93cdd9', 0)] {{(pid=75045) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 23:20:10 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:20:10 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:20:10 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b0f139e-de04-40e9-a3a2-2332fcb83bb0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:175bb2c0-7767-4740-9350-7e3300681a43\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1bec3976-0b2c-436e-9c4a-eeb6b8badbae\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:528866cb-30dd-40ac-9a81-4c6afc93cdd9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6ed77146-5ae0-400d-8116-7f9eb1322808\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8d2ff5d0-0b89-42ba-92eb-1e12c9cce205\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c7f7084f-f0d7-4d4b-9a14-69065a9c3e41\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:20:10 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:20:10 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:20:10 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d264cc8-51c1-4fc1-b973-2a75148d66fa]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d2ff5d0-0b89-42ba-92eb-1e12c9cce205 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7f7084f-f0d7-4d4b-9a14-69065a9c3e41 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1bec3976-0b2c-436e-9c4a-eeb6b8badbae (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:528866cb-30dd-40ac-9a81-4c6afc93cdd9 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:175bb2c0-7767-4740-9350-7e3300681a43 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ed77146-5ae0-400d-8116-7f9eb1322808 (non-flash)\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:20:10 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd1d6b86-2aa1-4ecb-8c4e-1cf5c01f7fa0 tempest-TaggedAttachmentsTest-1639503389 tempest-TaggedAttachmentsTest-1639503389-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d2ff5d0-0b89-42ba-92eb-1e12c9cce205 (non-flash)
Nov 08 23:20:10 user nova-compute[75045]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab (non-flash)
Nov 08 23:20:10 user nova-compute[75045]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7f7084f-f0d7-4d4b-9a14-69065a9c3e41 (non-flash)
Nov 08 23:20:10 user nova-compute[75045]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1bec3976-0b2c-436e-9c4a-eeb6b8badbae (non-flash)
Nov 08 23:20:10 user nova-compute[75045]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:528866cb-30dd-40ac-9a81-4c6afc93cdd9 (non-flash)
Nov 08 23:20:10 user nova-compute[75045]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:175bb2c0-7767-4740-9350-7e3300681a43 (non-flash)
Nov 08 23:20:10 user nova-compute[75045]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ed77146-5ae0-400d-8116-7f9eb1322808 (non-flash)
Nov 08 23:20:10 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 23:20:10 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd1d6b86-2aa1-4ecb-8c4e-1cf5c01f7fa0 tempest-TaggedAttachmentsTest-1639503389 tempest-TaggedAttachmentsTest-1639503389-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d2ff5d0-0b89-42ba-92eb-1e12c9cce205 (non-flash)
Nov 08 23:20:10 user nova-compute[75045]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab (non-flash)
Nov 08 23:20:10 user nova-compute[75045]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7f7084f-f0d7-4d4b-9a14-69065a9c3e41 (non-flash)
Nov 08 23:20:10 user nova-compute[75045]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1bec3976-0b2c-436e-9c4a-eeb6b8badbae (non-flash)
Nov 08 23:20:10 user nova-compute[75045]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:528866cb-30dd-40ac-9a81-4c6afc93cdd9 (non-flash)
Nov 08 23:20:10 user nova-compute[75045]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:175bb2c0-7767-4740-9350-7e3300681a43 (non-flash)
Nov 08 23:20:10 user nova-compute[75045]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ed77146-5ae0-400d-8116-7f9eb1322808 (non-flash)
Nov 08 23:20:10 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 23:20:10 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd1d6b86-2aa1-4ecb-8c4e-1cf5c01f7fa0 tempest-TaggedAttachmentsTest-1639503389 tempest-TaggedAttachmentsTest-1639503389-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1b683f3130>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:528866cb-30dd-40ac-9a81-4c6afc93cdd9'): ({'sdf'}, set())}) {{(pid=75045) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 23:20:10 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-cd1d6b86-2aa1-4ecb-8c4e-1cf5c01f7fa0 tempest-TaggedAttachmentsTest-1639503389 tempest-TaggedAttachmentsTest-1639503389-project-member] Removing single pathed devices sdf {{(pid=75045) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 23:20:10 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:20:10 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:20:10 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[14617693-5ab8-47dd-9e80-603a07f305f0]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:20:10 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:20:10 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.022s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:20:10 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b3d3aab-c69f-4b69-8105-bac9f475b33f]: (4, ('ok\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:20:10 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-cd1d6b86-2aa1-4ecb-8c4e-1cf5c01f7fa0 tempest-TaggedAttachmentsTest-1639503389 tempest-TaggedAttachmentsTest-1639503389-project-member] Flushing IO for device /dev/sdf {{(pid=75045) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 23:20:10 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:20:10 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.015s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:20:10 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[e02b9c6f-2add-40de-8c0a-216993b4d662]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:20:10 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-cd1d6b86-2aa1-4ecb-8c4e-1cf5c01f7fa0 tempest-TaggedAttachmentsTest-1639503389 tempest-TaggedAttachmentsTest-1639503389-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=75045) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 23:20:10 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:20:10 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.038s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:20:10 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c37b017-ac97-4c20-a2df-1beb85cbe472]: (4, ('1', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:20:10 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-cd1d6b86-2aa1-4ecb-8c4e-1cf5c01f7fa0 tempest-TaggedAttachmentsTest-1639503389 tempest-TaggedAttachmentsTest-1639503389-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=75045) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 23:20:10 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-cd1d6b86-2aa1-4ecb-8c4e-1cf5c01f7fa0 tempest-TaggedAttachmentsTest-1639503389 tempest-TaggedAttachmentsTest-1639503389-project-member] SCSI volumes sdf have been removed. {{(pid=75045) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 23:20:10 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd1d6b86-2aa1-4ecb-8c4e-1cf5c01f7fa0 tempest-TaggedAttachmentsTest-1639503389 tempest-TaggedAttachmentsTest-1639503389-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:528866cb-30dd-40ac-9a81-4c6afc93cdd9')] {{(pid=75045) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 23:20:10 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:528866cb-30dd-40ac-9a81-4c6afc93cdd9 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:20:10 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:528866cb-30dd-40ac-9a81-4c6afc93cdd9 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:20:10 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1c711b9-12d3-485d-8040-f15aaa76d128]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:20:10 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd1d6b86-2aa1-4ecb-8c4e-1cf5c01f7fa0 tempest-TaggedAttachmentsTest-1639503389 tempest-TaggedAttachmentsTest-1639503389-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:20:10 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:528866cb-30dd-40ac-9a81-4c6afc93cdd9 -p 172.16.0.220:3260 --logout {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:20:10 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:528866cb-30dd-40ac-9a81-4c6afc93cdd9 -p 172.16.0.220:3260 --logout" returned: 0 in 0.071s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:20:10 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea91aff9-28e7-4e82-87ac-60f8bda58472]: (4, ('Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:528866cb-30dd-40ac-9a81-4c6afc93cdd9, portal: 172.16.0.220,3260]\nLogout of [sid: 7, target: iqn.2010-10.org.openstack:528866cb-30dd-40ac-9a81-4c6afc93cdd9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:20:10 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd1d6b86-2aa1-4ecb-8c4e-1cf5c01f7fa0 tempest-TaggedAttachmentsTest-1639503389 tempest-TaggedAttachmentsTest-1639503389-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:528866cb-30dd-40ac-9a81-4c6afc93cdd9, portal: 172.16.0.220,3260]
Nov 08 23:20:10 user nova-compute[75045]: Logout of [sid: 7, target: iqn.2010-10.org.openstack:528866cb-30dd-40ac-9a81-4c6afc93cdd9, portal: 172.16.0.220,3260] successful.
Nov 08 23:20:10 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:20:10 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:528866cb-30dd-40ac-9a81-4c6afc93cdd9 -p 172.16.0.220:3260 --op delete {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:20:10 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:20:10 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:528866cb-30dd-40ac-9a81-4c6afc93cdd9 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.036s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:20:10 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[e534968b-e780-4049-80a5-8303012b9856]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:20:10 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd1d6b86-2aa1-4ecb-8c4e-1cf5c01f7fa0 tempest-TaggedAttachmentsTest-1639503389 tempest-TaggedAttachmentsTest-1639503389-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:20:10 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-cd1d6b86-2aa1-4ecb-8c4e-1cf5c01f7fa0 tempest-TaggedAttachmentsTest-1639503389 tempest-TaggedAttachmentsTest-1639503389-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.363s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 23:20:10 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd1d6b86-2aa1-4ecb-8c4e-1cf5c01f7fa0 tempest-TaggedAttachmentsTest-1639503389 tempest-TaggedAttachmentsTest-1639503389-project-member] <== disconnect_volume: return (364ms) None {{(pid=75045) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 23:20:10 user nova-compute[75045]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cd1d6b86-2aa1-4ecb-8c4e-1cf5c01f7fa0 tempest-TaggedAttachmentsTest-1639503389 tempest-TaggedAttachmentsTest-1639503389-project-member] [instance: 1cb1b440-0073-4a53-a0a2-e2781e021866] Disconnected iSCSI Volume {{(pid=75045) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 23:20:11 user nova-compute[75045]: DEBUG nova.objects.instance [None req-e0694800-7d06-4e31-a22b-eb1868d5bda7 tempest-VolumesAssistedSnapshotsTest-1482710492 tempest-VolumesAssistedSnapshotsTest-1482710492-project-admin] Lazy-loading 'flavor' on Instance uuid 07ec2c05-aaa9-46e8-8439-7aa5b9fca19d {{(pid=75045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 23:20:11 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-e0694800-7d06-4e31-a22b-eb1868d5bda7 tempest-VolumesAssistedSnapshotsTest-1482710492 tempest-VolumesAssistedSnapshotsTest-1482710492-project-admin] Lock "07ec2c05-aaa9-46e8-8439-7aa5b9fca19d" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 32.377s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:20:11 user nova-compute[75045]: DEBUG nova.objects.instance [None req-cd1d6b86-2aa1-4ecb-8c4e-1cf5c01f7fa0 tempest-TaggedAttachmentsTest-1639503389 tempest-TaggedAttachmentsTest-1639503389-project-member] Lazy-loading 'flavor' on Instance uuid 1cb1b440-0073-4a53-a0a2-e2781e021866 {{(pid=75045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 23:20:11 user nova-compute[75045]: ERROR nova.volume.cinder [None req-8b435292-6609-4c27-a9fd-1daf316eca29 tempest-TestVolumeSwap-1091185069 tempest-TestVolumeSwap-1091185069-project-admin] Update attachment failed for attachment c745edaa-84a6-4c36-a366-3535a7acc153. Error: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-2a97d005-dff9-42b1-be2a-3d88a5667315) Code: 500: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-2a97d005-dff9-42b1-be2a-3d88a5667315)
Nov 08 23:20:11 user nova-compute[75045]: ERROR nova.compute.manager [None req-8b435292-6609-4c27-a9fd-1daf316eca29 tempest-TestVolumeSwap-1091185069 tempest-TestVolumeSwap-1091185069-project-admin] [instance: fde91f7c-31e3-456c-b252-6ce37fa3b600] Failed to connect to volume 4d7a4df0-bfc5-4952-8454-97b703b68f28 with volume at /dev/vdb: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-2a97d005-dff9-42b1-be2a-3d88a5667315)
Nov 08 23:20:11 user nova-compute[75045]: ERROR nova.compute.manager [instance: fde91f7c-31e3-456c-b252-6ce37fa3b600] Traceback (most recent call last):
Nov 08 23:20:11 user nova-compute[75045]: ERROR nova.compute.manager [instance: fde91f7c-31e3-456c-b252-6ce37fa3b600]   File "/opt/stack/nova/nova/compute/manager.py", line 7770, in _swap_volume
Nov 08 23:20:11 user nova-compute[75045]: ERROR nova.compute.manager [instance: fde91f7c-31e3-456c-b252-6ce37fa3b600]     old_cinfo, new_cinfo = self._init_volume_connection(
Nov 08 23:20:11 user nova-compute[75045]: ERROR nova.compute.manager [instance: fde91f7c-31e3-456c-b252-6ce37fa3b600]   File "/opt/stack/nova/nova/compute/manager.py", line 7743, in _init_volume_connection
Nov 08 23:20:11 user nova-compute[75045]: ERROR nova.compute.manager [instance: fde91f7c-31e3-456c-b252-6ce37fa3b600]     new_cinfo = self.volume_api.attachment_update(
Nov 08 23:20:11 user nova-compute[75045]: ERROR nova.compute.manager [instance: fde91f7c-31e3-456c-b252-6ce37fa3b600]   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 08 23:20:11 user nova-compute[75045]: ERROR nova.compute.manager [instance: fde91f7c-31e3-456c-b252-6ce37fa3b600]     res = method(self, ctx, *args, **kwargs)
Nov 08 23:20:11 user nova-compute[75045]: ERROR nova.compute.manager [instance: fde91f7c-31e3-456c-b252-6ce37fa3b600]   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Nov 08 23:20:11 user nova-compute[75045]: ERROR nova.compute.manager [instance: fde91f7c-31e3-456c-b252-6ce37fa3b600]     res = method(self, ctx, attachment_id, *args, **kwargs)
Nov 08 23:20:11 user nova-compute[75045]: ERROR nova.compute.manager [instance: fde91f7c-31e3-456c-b252-6ce37fa3b600]   File "/opt/stack/nova/nova/volume/cinder.py", line 915, in attachment_update
Nov 08 23:20:11 user nova-compute[75045]: ERROR nova.compute.manager [instance: fde91f7c-31e3-456c-b252-6ce37fa3b600]     with excutils.save_and_reraise_exception():
Nov 08 23:20:11 user nova-compute[75045]: ERROR nova.compute.manager [instance: fde91f7c-31e3-456c-b252-6ce37fa3b600]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 08 23:20:11 user nova-compute[75045]: ERROR nova.compute.manager [instance: fde91f7c-31e3-456c-b252-6ce37fa3b600]     self.force_reraise()
Nov 08 23:20:11 user nova-compute[75045]: ERROR nova.compute.manager [instance: fde91f7c-31e3-456c-b252-6ce37fa3b600]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 08 23:20:11 user nova-compute[75045]: ERROR nova.compute.manager [instance: fde91f7c-31e3-456c-b252-6ce37fa3b600]     raise self.value
Nov 08 23:20:11 user nova-compute[75045]: ERROR nova.compute.manager [instance: fde91f7c-31e3-456c-b252-6ce37fa3b600]   File "/opt/stack/nova/nova/volume/cinder.py", line 909, in attachment_update
Nov 08 23:20:11 user nova-compute[75045]: ERROR nova.compute.manager [instance: fde91f7c-31e3-456c-b252-6ce37fa3b600]     context, '3.44', skip_version_check=True).attachments.update(
Nov 08 23:20:11 user nova-compute[75045]: ERROR nova.compute.manager [instance: fde91f7c-31e3-456c-b252-6ce37fa3b600]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Nov 08 23:20:11 user nova-compute[75045]: ERROR nova.compute.manager [instance: fde91f7c-31e3-456c-b252-6ce37fa3b600]     return method.func(obj, *args, **kwargs)
Nov 08 23:20:11 user nova-compute[75045]: ERROR nova.compute.manager [instance: fde91f7c-31e3-456c-b252-6ce37fa3b600]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Nov 08 23:20:11 user nova-compute[75045]: ERROR nova.compute.manager [instance: fde91f7c-31e3-456c-b252-6ce37fa3b600]     resp = self._update('/attachments/%s' % id, body)
Nov 08 23:20:11 user nova-compute[75045]: ERROR nova.compute.manager [instance: fde91f7c-31e3-456c-b252-6ce37fa3b600]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Nov 08 23:20:11 user nova-compute[75045]: ERROR nova.compute.manager [instance: fde91f7c-31e3-456c-b252-6ce37fa3b600]     resp, body = self.api.client.put(url, body=body, **kwargs)
Nov 08 23:20:11 user nova-compute[75045]: ERROR nova.compute.manager [instance: fde91f7c-31e3-456c-b252-6ce37fa3b600]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Nov 08 23:20:11 user nova-compute[75045]: ERROR nova.compute.manager [instance: fde91f7c-31e3-456c-b252-6ce37fa3b600]     return self._cs_request(url, 'PUT', **kwargs)
Nov 08 23:20:11 user nova-compute[75045]: ERROR nova.compute.manager [instance: fde91f7c-31e3-456c-b252-6ce37fa3b600]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 08 23:20:11 user nova-compute[75045]: ERROR nova.compute.manager [instance: fde91f7c-31e3-456c-b252-6ce37fa3b600]     return self.request(url, method, **kwargs)
Nov 08 23:20:11 user nova-compute[75045]: ERROR nova.compute.manager [instance: fde91f7c-31e3-456c-b252-6ce37fa3b600]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 08 23:20:11 user nova-compute[75045]: ERROR nova.compute.manager [instance: fde91f7c-31e3-456c-b252-6ce37fa3b600]     raise exceptions.from_response(resp, body)
Nov 08 23:20:11 user nova-compute[75045]: ERROR nova.compute.manager [instance: fde91f7c-31e3-456c-b252-6ce37fa3b600] cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-2a97d005-dff9-42b1-be2a-3d88a5667315)
Nov 08 23:20:11 user nova-compute[75045]: ERROR nova.compute.manager [instance: fde91f7c-31e3-456c-b252-6ce37fa3b600] 
Nov 08 23:20:11 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-cd1d6b86-2aa1-4ecb-8c4e-1cf5c01f7fa0 tempest-TaggedAttachmentsTest-1639503389 tempest-TaggedAttachmentsTest-1639503389-project-member] Lock "1cb1b440-0073-4a53-a0a2-e2781e021866" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 32.353s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:20:12 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-8b435292-6609-4c27-a9fd-1daf316eca29 tempest-TestVolumeSwap-1091185069 tempest-TestVolumeSwap-1091185069-project-admin] Lock "fde91f7c-31e3-456c-b252-6ce37fa3b600" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 12.129s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:20:12 user nova-compute[75045]: ERROR oslo_messaging.rpc.server [None req-8b435292-6609-4c27-a9fd-1daf316eca29 tempest-TestVolumeSwap-1091185069 tempest-TestVolumeSwap-1091185069-project-admin] Exception during message handling: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-2a97d005-dff9-42b1-be2a-3d88a5667315)
Nov 08 23:20:12 user nova-compute[75045]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 08 23:20:12 user nova-compute[75045]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Nov 08 23:20:12 user nova-compute[75045]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Nov 08 23:20:12 user nova-compute[75045]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Nov 08 23:20:12 user nova-compute[75045]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Nov 08 23:20:12 user nova-compute[75045]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Nov 08 23:20:12 user nova-compute[75045]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Nov 08 23:20:12 user nova-compute[75045]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Nov 08 23:20:12 user nova-compute[75045]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 08 23:20:12 user nova-compute[75045]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 08 23:20:12 user nova-compute[75045]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 08 23:20:12 user nova-compute[75045]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 08 23:20:12 user nova-compute[75045]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 08 23:20:12 user nova-compute[75045]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Nov 08 23:20:12 user nova-compute[75045]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Nov 08 23:20:12 user nova-compute[75045]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/utils.py", line 1439, in decorated_function
Nov 08 23:20:12 user nova-compute[75045]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Nov 08 23:20:12 user nova-compute[75045]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 213, in decorated_function
Nov 08 23:20:12 user nova-compute[75045]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 08 23:20:12 user nova-compute[75045]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 08 23:20:12 user nova-compute[75045]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 08 23:20:12 user nova-compute[75045]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 08 23:20:12 user nova-compute[75045]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 08 23:20:12 user nova-compute[75045]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 203, in decorated_function
Nov 08 23:20:12 user nova-compute[75045]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Nov 08 23:20:12 user nova-compute[75045]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7903, in swap_volume
Nov 08 23:20:12 user nova-compute[75045]: ERROR oslo_messaging.rpc.server     _do_locked_swap_volume(context, old_volume_id, new_volume_id, instance,
Nov 08 23:20:12 user nova-compute[75045]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py", line 414, in inner
Nov 08 23:20:12 user nova-compute[75045]: ERROR oslo_messaging.rpc.server     return f(*args, **kwargs)
Nov 08 23:20:12 user nova-compute[75045]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7901, in _do_locked_swap_volume
Nov 08 23:20:12 user nova-compute[75045]: ERROR oslo_messaging.rpc.server     self._do_swap_volume(context, old_volume_id, new_volume_id,
Nov 08 23:20:12 user nova-compute[75045]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7945, in _do_swap_volume
Nov 08 23:20:12 user nova-compute[75045]: ERROR oslo_messaging.rpc.server     comp_ret, new_cinfo = self._swap_volume(context,
Nov 08 23:20:12 user nova-compute[75045]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7794, in _swap_volume
Nov 08 23:20:12 user nova-compute[75045]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 08 23:20:12 user nova-compute[75045]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 08 23:20:12 user nova-compute[75045]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 08 23:20:12 user nova-compute[75045]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 08 23:20:12 user nova-compute[75045]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 08 23:20:12 user nova-compute[75045]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7770, in _swap_volume
Nov 08 23:20:12 user nova-compute[75045]: ERROR oslo_messaging.rpc.server     old_cinfo, new_cinfo = self._init_volume_connection(
Nov 08 23:20:12 user nova-compute[75045]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7743, in _init_volume_connection
Nov 08 23:20:12 user nova-compute[75045]: ERROR oslo_messaging.rpc.server     new_cinfo = self.volume_api.attachment_update(
Nov 08 23:20:12 user nova-compute[75045]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 08 23:20:12 user nova-compute[75045]: ERROR oslo_messaging.rpc.server     res = method(self, ctx, *args, **kwargs)
Nov 08 23:20:12 user nova-compute[75045]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Nov 08 23:20:12 user nova-compute[75045]: ERROR oslo_messaging.rpc.server     res = method(self, ctx, attachment_id, *args, **kwargs)
Nov 08 23:20:12 user nova-compute[75045]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 915, in attachment_update
Nov 08 23:20:12 user nova-compute[75045]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 08 23:20:12 user nova-compute[75045]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 08 23:20:12 user nova-compute[75045]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 08 23:20:12 user nova-compute[75045]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 08 23:20:12 user nova-compute[75045]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 08 23:20:12 user nova-compute[75045]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 909, in attachment_update
Nov 08 23:20:12 user nova-compute[75045]: ERROR oslo_messaging.rpc.server     context, '3.44', skip_version_check=True).attachments.update(
Nov 08 23:20:12 user nova-compute[75045]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Nov 08 23:20:12 user nova-compute[75045]: ERROR oslo_messaging.rpc.server     return method.func(obj, *args, **kwargs)
Nov 08 23:20:12 user nova-compute[75045]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Nov 08 23:20:12 user nova-compute[75045]: ERROR oslo_messaging.rpc.server     resp = self._update('/attachments/%s' % id, body)
Nov 08 23:20:12 user nova-compute[75045]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Nov 08 23:20:12 user nova-compute[75045]: ERROR oslo_messaging.rpc.server     resp, body = self.api.client.put(url, body=body, **kwargs)
Nov 08 23:20:12 user nova-compute[75045]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Nov 08 23:20:12 user nova-compute[75045]: ERROR oslo_messaging.rpc.server     return self._cs_request(url, 'PUT', **kwargs)
Nov 08 23:20:12 user nova-compute[75045]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 08 23:20:12 user nova-compute[75045]: ERROR oslo_messaging.rpc.server     return self.request(url, method, **kwargs)
Nov 08 23:20:12 user nova-compute[75045]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 08 23:20:12 user nova-compute[75045]: ERROR oslo_messaging.rpc.server     raise exceptions.from_response(resp, body)
Nov 08 23:20:12 user nova-compute[75045]: ERROR oslo_messaging.rpc.server cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-2a97d005-dff9-42b1-be2a-3d88a5667315)
Nov 08 23:20:12 user nova-compute[75045]: ERROR oslo_messaging.rpc.server 
Nov 08 23:20:12 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-9d241a0b-bc72-4ed6-b08b-000d3a80e474 tempest-TaggedAttachmentsTest-1639503389 tempest-TaggedAttachmentsTest-1639503389-project-member] Acquiring lock "interface-1cb1b440-0073-4a53-a0a2-e2781e021866-2baf0a88-fd3e-45ae-95f8-9d568be4211b" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:20:12 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-9d241a0b-bc72-4ed6-b08b-000d3a80e474 tempest-TaggedAttachmentsTest-1639503389 tempest-TaggedAttachmentsTest-1639503389-project-member] Lock "interface-1cb1b440-0073-4a53-a0a2-e2781e021866-2baf0a88-fd3e-45ae-95f8-9d568be4211b" acquired by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:20:12 user nova-compute[75045]: DEBUG nova.objects.instance [None req-9d241a0b-bc72-4ed6-b08b-000d3a80e474 tempest-TaggedAttachmentsTest-1639503389 tempest-TaggedAttachmentsTest-1639503389-project-member] Lazy-loading 'flavor' on Instance uuid 1cb1b440-0073-4a53-a0a2-e2781e021866 {{(pid=75045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 23:20:12 user nova-compute[75045]: DEBUG nova.virt.libvirt.vif [None req-9d241a0b-bc72-4ed6-b08b-000d3a80e474 tempest-TaggedAttachmentsTest-1639503389 tempest-TaggedAttachmentsTest-1639503389-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T23:16:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1008670319',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1008670319',id=5,image_ref='a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJHwrx1BGWhjjUX4+Byh1wjqwerHxYEs1Bi9i8sP+n0orNMkrqYiTdsqsEt8sTDzFkc1LBM09NOYtbQKa/c7KjqeCNDDUOdBi8LqOWMDeLuYXRRZIoptz+6bpxuTCZMmXg==',key_name='tempest-keypair-1418515873',keypairs=<?>,launch_index=0,launched_at=2023-11-08T23:16:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bb18f0af92ec4de6a1fddb6c77ea030d',ramdisk_id='',reservation_id='r-15oytm0c',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1639503389',owner_user_name='tempest-TaggedAttachmentsTest-1639503389-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T23:16:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0c8d9cc387dc45d18ad1550ef6d3cfa9',uuid=1cb1b440-0073-4a53-a0a2-e2781e021866,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2baf0a88-fd3e-45ae-95f8-9d568be4211b", "address": "fa:16:3e:9e:7d:b7", "network": {"id": "3ffe4edb-8137-442f-9c3e-231775c7527c", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1585434856", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.184", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "bb18f0af92ec4de6a1fddb6c77ea030d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2baf0a88-fd", "ovs_interfaceid": "2baf0a88-fd3e-45ae-95f8-9d568be4211b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75045) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 23:20:12 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-9d241a0b-bc72-4ed6-b08b-000d3a80e474 tempest-TaggedAttachmentsTest-1639503389 tempest-TaggedAttachmentsTest-1639503389-project-member] Converting VIF {"id": "2baf0a88-fd3e-45ae-95f8-9d568be4211b", "address": "fa:16:3e:9e:7d:b7", "network": {"id": "3ffe4edb-8137-442f-9c3e-231775c7527c", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1585434856", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.184", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "bb18f0af92ec4de6a1fddb6c77ea030d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2baf0a88-fd", "ovs_interfaceid": "2baf0a88-fd3e-45ae-95f8-9d568be4211b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 23:20:12 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-9d241a0b-bc72-4ed6-b08b-000d3a80e474 tempest-TaggedAttachmentsTest-1639503389 tempest-TaggedAttachmentsTest-1639503389-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9e:7d:b7,bridge_name='br-int',has_traffic_filtering=True,id=2baf0a88-fd3e-45ae-95f8-9d568be4211b,network=Network(3ffe4edb-8137-442f-9c3e-231775c7527c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2baf0a88-fd') {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 23:20:12 user nova-compute[75045]: DEBUG nova.virt.libvirt.guest [None req-9d241a0b-bc72-4ed6-b08b-000d3a80e474 tempest-TaggedAttachmentsTest-1639503389 tempest-TaggedAttachmentsTest-1639503389-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:9e:7d:b7"/><model type="virtio"/><mtu size="1442"/><target dev="tap2baf0a88-fd"/></interface> {{(pid=75045) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 08 23:20:12 user nova-compute[75045]: DEBUG nova.virt.libvirt.guest [None req-9d241a0b-bc72-4ed6-b08b-000d3a80e474 tempest-TaggedAttachmentsTest-1639503389 tempest-TaggedAttachmentsTest-1639503389-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:9e:7d:b7"/><model type="virtio"/><mtu size="1442"/><target dev="tap2baf0a88-fd"/></interface> {{(pid=75045) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 08 23:20:12 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-9d241a0b-bc72-4ed6-b08b-000d3a80e474 tempest-TaggedAttachmentsTest-1639503389 tempest-TaggedAttachmentsTest-1639503389-project-member] Attempting to detach device tap2baf0a88-fd from instance 1cb1b440-0073-4a53-a0a2-e2781e021866 from the persistent domain config. {{(pid=75045) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 08 23:20:12 user nova-compute[75045]: DEBUG nova.virt.libvirt.guest [None req-9d241a0b-bc72-4ed6-b08b-000d3a80e474 tempest-TaggedAttachmentsTest-1639503389 tempest-TaggedAttachmentsTest-1639503389-project-member] detach device xml: <interface type="ethernet">
Nov 08 23:20:12 user nova-compute[75045]:   <mac address="fa:16:3e:9e:7d:b7"/>
Nov 08 23:20:12 user nova-compute[75045]:   <model type="virtio"/>
Nov 08 23:20:12 user nova-compute[75045]:   <mtu size="1442"/>
Nov 08 23:20:12 user nova-compute[75045]:   <target dev="tap2baf0a88-fd"/>
Nov 08 23:20:12 user nova-compute[75045]: </interface>
Nov 08 23:20:12 user nova-compute[75045]:  {{(pid=75045) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 23:20:12 user nova-compute[75045]: DEBUG nova.virt.libvirt.guest [None req-9d241a0b-bc72-4ed6-b08b-000d3a80e474 tempest-TaggedAttachmentsTest-1639503389 tempest-TaggedAttachmentsTest-1639503389-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:9e:7d:b7"/><model type="virtio"/><mtu size="1442"/><target dev="tap2baf0a88-fd"/></interface> {{(pid=75045) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 08 23:20:12 user nova-compute[75045]: DEBUG nova.virt.libvirt.guest [None req-9d241a0b-bc72-4ed6-b08b-000d3a80e474 tempest-TaggedAttachmentsTest-1639503389 tempest-TaggedAttachmentsTest-1639503389-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:9e:7d:b7"/><model type="virtio"/><mtu size="1442"/><target dev="tap2baf0a88-fd"/></interface>not found in domain: <domain type='kvm' id='5'>
Nov 08 23:20:12 user nova-compute[75045]:   <name>instance-00000005</name>
Nov 08 23:20:12 user nova-compute[75045]:   <uuid>1cb1b440-0073-4a53-a0a2-e2781e021866</uuid>
Nov 08 23:20:12 user nova-compute[75045]:   <metadata>
Nov 08 23:20:12 user nova-compute[75045]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 23:20:12 user nova-compute[75045]:   <nova:package version="0.0.0"/>
Nov 08 23:20:12 user nova-compute[75045]:   <nova:name>tempest-device-tagging-server-1008670319</nova:name>
Nov 08 23:20:12 user nova-compute[75045]:   <nova:creationTime>2023-11-08 23:18:03</nova:creationTime>
Nov 08 23:20:12 user nova-compute[75045]:   <nova:flavor name="m1.tiny">
Nov 08 23:20:12 user nova-compute[75045]:     <nova:memory>512</nova:memory>
Nov 08 23:20:12 user nova-compute[75045]:     <nova:disk>1</nova:disk>
Nov 08 23:20:12 user nova-compute[75045]:     <nova:swap>0</nova:swap>
Nov 08 23:20:12 user nova-compute[75045]:     <nova:ephemeral>0</nova:ephemeral>
Nov 08 23:20:12 user nova-compute[75045]:     <nova:vcpus>1</nova:vcpus>
Nov 08 23:20:12 user nova-compute[75045]:   </nova:flavor>
Nov 08 23:20:12 user nova-compute[75045]:   <nova:owner>
Nov 08 23:20:12 user nova-compute[75045]:     <nova:user uuid="0c8d9cc387dc45d18ad1550ef6d3cfa9">tempest-TaggedAttachmentsTest-1639503389-project-member</nova:user>
Nov 08 23:20:12 user nova-compute[75045]:     <nova:project uuid="bb18f0af92ec4de6a1fddb6c77ea030d">tempest-TaggedAttachmentsTest-1639503389</nova:project>
Nov 08 23:20:12 user nova-compute[75045]:   </nova:owner>
Nov 08 23:20:12 user nova-compute[75045]:   <nova:root type="image" uuid="a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb"/>
Nov 08 23:20:12 user nova-compute[75045]:   <nova:ports>
Nov 08 23:20:12 user nova-compute[75045]:     <nova:port uuid="892284f7-b4b9-4b5b-82c7-62300cd8afb7">
Nov 08 23:20:12 user nova-compute[75045]:       <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 08 23:20:12 user nova-compute[75045]:     </nova:port>
Nov 08 23:20:12 user nova-compute[75045]:     <nova:port uuid="2baf0a88-fd3e-45ae-95f8-9d568be4211b">
Nov 08 23:20:12 user nova-compute[75045]:       <nova:ip type="fixed" address="10.10.10.184" ipVersion="4"/>
Nov 08 23:20:12 user nova-compute[75045]:     </nova:port>
Nov 08 23:20:12 user nova-compute[75045]:   </nova:ports>
Nov 08 23:20:12 user nova-compute[75045]: </nova:instance>
Nov 08 23:20:12 user nova-compute[75045]:   </metadata>
Nov 08 23:20:12 user nova-compute[75045]:   <memory unit='KiB'>524288</memory>
Nov 08 23:20:12 user nova-compute[75045]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 08 23:20:12 user nova-compute[75045]:   <vcpu placement='static'>1</vcpu>
Nov 08 23:20:12 user nova-compute[75045]:   <resource>
Nov 08 23:20:12 user nova-compute[75045]:     <partition>/machine</partition>
Nov 08 23:20:12 user nova-compute[75045]:   </resource>
Nov 08 23:20:12 user nova-compute[75045]:   <sysinfo type='smbios'>
Nov 08 23:20:12 user nova-compute[75045]:     <system>
Nov 08 23:20:12 user nova-compute[75045]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 08 23:20:12 user nova-compute[75045]:       <entry name='product'>OpenStack Nova</entry>
Nov 08 23:20:12 user nova-compute[75045]:       <entry name='version'>0.0.0</entry>
Nov 08 23:20:12 user nova-compute[75045]:       <entry name='serial'>1cb1b440-0073-4a53-a0a2-e2781e021866</entry>
Nov 08 23:20:12 user nova-compute[75045]:       <entry name='uuid'>1cb1b440-0073-4a53-a0a2-e2781e021866</entry>
Nov 08 23:20:12 user nova-compute[75045]:       <entry name='family'>Virtual Machine</entry>
Nov 08 23:20:12 user nova-compute[75045]:     </system>
Nov 08 23:20:12 user nova-compute[75045]:   </sysinfo>
Nov 08 23:20:12 user nova-compute[75045]:   <os>
Nov 08 23:20:12 user nova-compute[75045]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 08 23:20:12 user nova-compute[75045]:     <boot dev='hd'/>
Nov 08 23:20:12 user nova-compute[75045]:     <smbios mode='sysinfo'/>
Nov 08 23:20:12 user nova-compute[75045]:   </os>
Nov 08 23:20:12 user nova-compute[75045]:   <features>
Nov 08 23:20:12 user nova-compute[75045]:     <acpi/>
Nov 08 23:20:12 user nova-compute[75045]:     <apic/>
Nov 08 23:20:12 user nova-compute[75045]:     <vmcoreinfo state='on'/>
Nov 08 23:20:12 user nova-compute[75045]:   </features>
Nov 08 23:20:12 user nova-compute[75045]:   <cpu mode='custom' match='exact' check='full'>
Nov 08 23:20:12 user nova-compute[75045]:     <model fallback='forbid'>Nehalem</model>
Nov 08 23:20:12 user nova-compute[75045]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 08 23:20:12 user nova-compute[75045]:     <feature policy='require' name='vme'/>
Nov 08 23:20:12 user nova-compute[75045]:     <feature policy='require' name='x2apic'/>
Nov 08 23:20:12 user nova-compute[75045]:     <feature policy='require' name='hypervisor'/>
Nov 08 23:20:12 user nova-compute[75045]:   </cpu>
Nov 08 23:20:12 user nova-compute[75045]:   <clock offset='utc'>
Nov 08 23:20:12 user nova-compute[75045]:     <timer name='pit' tickpolicy='delay'/>
Nov 08 23:20:12 user nova-compute[75045]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 08 23:20:12 user nova-compute[75045]:     <timer name='hpet' present='no'/>
Nov 08 23:20:12 user nova-compute[75045]:   </clock>
Nov 08 23:20:12 user nova-compute[75045]:   <on_poweroff>destroy</on_poweroff>
Nov 08 23:20:12 user nova-compute[75045]:   <on_reboot>restart</on_reboot>
Nov 08 23:20:12 user nova-compute[75045]:   <on_crash>destroy</on_crash>
Nov 08 23:20:12 user nova-compute[75045]:   <devices>
Nov 08 23:20:12 user nova-compute[75045]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 08 23:20:12 user nova-compute[75045]:     <disk type='file' device='disk'>
Nov 08 23:20:12 user nova-compute[75045]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 08 23:20:12 user nova-compute[75045]:       <source file='/opt/stack/data/nova/instances/1cb1b440-0073-4a53-a0a2-e2781e021866/disk' index='2'/>
Nov 08 23:20:12 user nova-compute[75045]:       <backingStore type='file' index='3'>
Nov 08 23:20:12 user nova-compute[75045]:         <format type='raw'/>
Nov 08 23:20:12 user nova-compute[75045]:         <source file='/opt/stack/data/nova/instances/_base/b59f52a99fff51c56dd1edfb83892fb8f647f2f3'/>
Nov 08 23:20:12 user nova-compute[75045]:         <backingStore/>
Nov 08 23:20:12 user nova-compute[75045]:       </backingStore>
Nov 08 23:20:12 user nova-compute[75045]:       <target dev='vda' bus='virtio'/>
Nov 08 23:20:12 user nova-compute[75045]:       <alias name='virtio-disk0'/>
Nov 08 23:20:12 user nova-compute[75045]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 08 23:20:12 user nova-compute[75045]:     </disk>
Nov 08 23:20:12 user nova-compute[75045]:     <disk type='file' device='cdrom'>
Nov 08 23:20:12 user nova-compute[75045]:       <driver name='qemu' type='raw' cache='none'/>
Nov 08 23:20:12 user nova-compute[75045]:       <source file='/opt/stack/data/nova/instances/1cb1b440-0073-4a53-a0a2-e2781e021866/disk.config' index='1'/>
Nov 08 23:20:12 user nova-compute[75045]:       <backingStore/>
Nov 08 23:20:12 user nova-compute[75045]:       <target dev='hda' bus='ide'/>
Nov 08 23:20:12 user nova-compute[75045]:       <readonly/>
Nov 08 23:20:12 user nova-compute[75045]:       <alias name='ide0-0-0'/>
Nov 08 23:20:12 user nova-compute[75045]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 08 23:20:12 user nova-compute[75045]:     </disk>
Nov 08 23:20:12 user nova-compute[75045]:     <controller type='usb' index='0' model='none'>
Nov 08 23:20:12 user nova-compute[75045]:       <alias name='usb'/>
Nov 08 23:20:12 user nova-compute[75045]:     </controller>
Nov 08 23:20:12 user nova-compute[75045]:     <controller type='pci' index='0' model='pci-root'>
Nov 08 23:20:12 user nova-compute[75045]:       <alias name='pci.0'/>
Nov 08 23:20:12 user nova-compute[75045]:     </controller>
Nov 08 23:20:12 user nova-compute[75045]:     <controller type='ide' index='0'>
Nov 08 23:20:12 user nova-compute[75045]:       <alias name='ide'/>
Nov 08 23:20:12 user nova-compute[75045]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 08 23:20:12 user nova-compute[75045]:     </controller>
Nov 08 23:20:12 user nova-compute[75045]:     <interface type='ethernet'>
Nov 08 23:20:12 user nova-compute[75045]:       <mac address='fa:16:3e:e4:4d:f8'/>
Nov 08 23:20:12 user nova-compute[75045]:       <target dev='tap892284f7-b4'/>
Nov 08 23:20:12 user nova-compute[75045]:       <model type='virtio'/>
Nov 08 23:20:12 user nova-compute[75045]:       <mtu size='1442'/>
Nov 08 23:20:12 user nova-compute[75045]:       <alias name='net0'/>
Nov 08 23:20:12 user nova-compute[75045]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 08 23:20:12 user nova-compute[75045]:     </interface>
Nov 08 23:20:12 user nova-compute[75045]:     <interface type='ethernet'>
Nov 08 23:20:12 user nova-compute[75045]:       <mac address='fa:16:3e:9e:7d:b7'/>
Nov 08 23:20:12 user nova-compute[75045]:       <target dev='tap2baf0a88-fd'/>
Nov 08 23:20:12 user nova-compute[75045]:       <model type='virtio'/>
Nov 08 23:20:12 user nova-compute[75045]:       <mtu size='1442'/>
Nov 08 23:20:12 user nova-compute[75045]:       <alias name='net1'/>
Nov 08 23:20:12 user nova-compute[75045]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x0'/>
Nov 08 23:20:12 user nova-compute[75045]:     </interface>
Nov 08 23:20:12 user nova-compute[75045]:     <serial type='pty'>
Nov 08 23:20:12 user nova-compute[75045]:       <source path='/dev/pts/4'/>
Nov 08 23:20:12 user nova-compute[75045]:       <log file='/opt/stack/data/nova/instances/1cb1b440-0073-4a53-a0a2-e2781e021866/console.log' append='off'/>
Nov 08 23:20:12 user nova-compute[75045]:       <target type='isa-serial' port='0'>
Nov 08 23:20:12 user nova-compute[75045]:         <model name='isa-serial'/>
Nov 08 23:20:12 user nova-compute[75045]:       </target>
Nov 08 23:20:12 user nova-compute[75045]:       <alias name='serial0'/>
Nov 08 23:20:12 user nova-compute[75045]:     </serial>
Nov 08 23:20:12 user nova-compute[75045]:     <console type='pty' tty='/dev/pts/4'>
Nov 08 23:20:12 user nova-compute[75045]:       <source path='/dev/pts/4'/>
Nov 08 23:20:12 user nova-compute[75045]:       <log file='/opt/stack/data/nova/instances/1cb1b440-0073-4a53-a0a2-e2781e021866/console.log' append='off'/>
Nov 08 23:20:12 user nova-compute[75045]:       <target type='serial' port='0'/>
Nov 08 23:20:12 user nova-compute[75045]:       <alias name='serial0'/>
Nov 08 23:20:12 user nova-compute[75045]:     </console>
Nov 08 23:20:12 user nova-compute[75045]:     <input type='mouse' bus='ps2'>
Nov 08 23:20:12 user nova-compute[75045]:       <alias name='input0'/>
Nov 08 23:20:12 user nova-compute[75045]:     </input>
Nov 08 23:20:12 user nova-compute[75045]:     <input type='keyboard' bus='ps2'>
Nov 08 23:20:12 user nova-compute[75045]:       <alias name='input1'/>
Nov 08 23:20:12 user nova-compute[75045]:     </input>
Nov 08 23:20:12 user nova-compute[75045]:     <graphics type='vnc' port='5904' autoport='yes' listen='0.0.0.0'>
Nov 08 23:20:12 user nova-compute[75045]:       <listen type='address' address='0.0.0.0'/>
Nov 08 23:20:12 user nova-compute[75045]:     </graphics>
Nov 08 23:20:12 user nova-compute[75045]:     <audio id='1' type='none'/>
Nov 08 23:20:12 user nova-compute[75045]:     <video>
Nov 08 23:20:12 user nova-compute[75045]:       <model type='virtio' heads='1' primary='yes'/>
Nov 08 23:20:12 user nova-compute[75045]:       <alias name='video0'/>
Nov 08 23:20:12 user nova-compute[75045]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 08 23:20:12 user nova-compute[75045]:     </video>
Nov 08 23:20:12 user nova-compute[75045]:     <memballoon model='virtio'>
Nov 08 23:20:12 user nova-compute[75045]:       <stats period='10'/>
Nov 08 23:20:12 user nova-compute[75045]:       <alias name='balloon0'/>
Nov 08 23:20:12 user nova-compute[75045]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 08 23:20:12 user nova-compute[75045]:     </memballoon>
Nov 08 23:20:12 user nova-compute[75045]:     <rng model='virtio'>
Nov 08 23:20:12 user nova-compute[75045]:       <backend model='random'>/dev/urandom</backend>
Nov 08 23:20:12 user nova-compute[75045]:       <alias name='rng0'/>
Nov 08 23:20:12 user nova-compute[75045]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 08 23:20:12 user nova-compute[75045]:     </rng>
Nov 08 23:20:12 user nova-compute[75045]:   </devices>
Nov 08 23:20:12 user nova-compute[75045]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 08 23:20:12 user nova-compute[75045]:     <label>libvirt-1cb1b440-0073-4a53-a0a2-e2781e021866</label>
Nov 08 23:20:12 user nova-compute[75045]:     <imagelabel>libvirt-1cb1b440-0073-4a53-a0a2-e2781e021866</imagelabel>
Nov 08 23:20:12 user nova-compute[75045]:   </seclabel>
Nov 08 23:20:12 user nova-compute[75045]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 08 23:20:12 user nova-compute[75045]:     <label>+64055:+108</label>
Nov 08 23:20:12 user nova-compute[75045]:     <imagelabel>+64055:+108</imagelabel>
Nov 08 23:20:12 user nova-compute[75045]:   </seclabel>
Nov 08 23:20:12 user nova-compute[75045]: </domain>
Nov 08 23:20:12 user nova-compute[75045]:  {{(pid=75045) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 08 23:20:12 user nova-compute[75045]: INFO nova.virt.libvirt.driver [None req-9d241a0b-bc72-4ed6-b08b-000d3a80e474 tempest-TaggedAttachmentsTest-1639503389 tempest-TaggedAttachmentsTest-1639503389-project-member] Successfully detached device tap2baf0a88-fd from instance 1cb1b440-0073-4a53-a0a2-e2781e021866 from the persistent domain config.
Nov 08 23:20:12 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-9d241a0b-bc72-4ed6-b08b-000d3a80e474 tempest-TaggedAttachmentsTest-1639503389 tempest-TaggedAttachmentsTest-1639503389-project-member] (1/8): Attempting to detach device tap2baf0a88-fd with device alias net1 from instance 1cb1b440-0073-4a53-a0a2-e2781e021866 from the live domain config. {{(pid=75045) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 08 23:20:12 user nova-compute[75045]: DEBUG nova.virt.libvirt.guest [None req-9d241a0b-bc72-4ed6-b08b-000d3a80e474 tempest-TaggedAttachmentsTest-1639503389 tempest-TaggedAttachmentsTest-1639503389-project-member] detach device xml: <interface type="ethernet">
Nov 08 23:20:12 user nova-compute[75045]:   <mac address="fa:16:3e:9e:7d:b7"/>
Nov 08 23:20:12 user nova-compute[75045]:   <model type="virtio"/>
Nov 08 23:20:12 user nova-compute[75045]:   <mtu size="1442"/>
Nov 08 23:20:12 user nova-compute[75045]:   <target dev="tap2baf0a88-fd"/>
Nov 08 23:20:12 user nova-compute[75045]: </interface>
Nov 08 23:20:12 user nova-compute[75045]:  {{(pid=75045) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 23:20:13 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:20:13 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:20:13 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:20:13 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-9d241a0b-bc72-4ed6-b08b-000d3a80e474 tempest-TaggedAttachmentsTest-1639503389 tempest-TaggedAttachmentsTest-1639503389-project-member] Start waiting for the detach event from libvirt for device tap2baf0a88-fd with device alias net1 for instance 1cb1b440-0073-4a53-a0a2-e2781e021866 {{(pid=75045) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 08 23:20:13 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:20:13 user nova-compute[75045]: DEBUG nova.compute.manager [req-6dbf63fb-d1a2-4aae-8bc4-cbfed66780ca req-479c62d9-cb45-4926-8847-01c66f1ad40c service nova] [instance: 1cb1b440-0073-4a53-a0a2-e2781e021866] Received event network-vif-unplugged-2baf0a88-fd3e-45ae-95f8-9d568be4211b {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:20:13 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-6dbf63fb-d1a2-4aae-8bc4-cbfed66780ca req-479c62d9-cb45-4926-8847-01c66f1ad40c service nova] Acquiring lock "1cb1b440-0073-4a53-a0a2-e2781e021866-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:20:13 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-6dbf63fb-d1a2-4aae-8bc4-cbfed66780ca req-479c62d9-cb45-4926-8847-01c66f1ad40c service nova] Lock "1cb1b440-0073-4a53-a0a2-e2781e021866-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:20:13 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-6dbf63fb-d1a2-4aae-8bc4-cbfed66780ca req-479c62d9-cb45-4926-8847-01c66f1ad40c service nova] Lock "1cb1b440-0073-4a53-a0a2-e2781e021866-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:20:13 user nova-compute[75045]: DEBUG nova.compute.manager [req-6dbf63fb-d1a2-4aae-8bc4-cbfed66780ca req-479c62d9-cb45-4926-8847-01c66f1ad40c service nova] [instance: 1cb1b440-0073-4a53-a0a2-e2781e021866] No waiting events found dispatching network-vif-unplugged-2baf0a88-fd3e-45ae-95f8-9d568be4211b {{(pid=75045) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 23:20:13 user nova-compute[75045]: WARNING nova.compute.manager [req-6dbf63fb-d1a2-4aae-8bc4-cbfed66780ca req-479c62d9-cb45-4926-8847-01c66f1ad40c service nova] [instance: 1cb1b440-0073-4a53-a0a2-e2781e021866] Received unexpected event network-vif-unplugged-2baf0a88-fd3e-45ae-95f8-9d568be4211b for instance with vm_state active and task_state None.
Nov 08 23:20:14 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:20:15 user nova-compute[75045]: DEBUG nova.compute.manager [req-65ba388d-0edb-4058-8228-b86eb6db42b1 req-6351dffb-e29a-440c-98ca-37754495ab66 service nova] [instance: 1cb1b440-0073-4a53-a0a2-e2781e021866] Received event network-vif-plugged-2baf0a88-fd3e-45ae-95f8-9d568be4211b {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:20:15 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-65ba388d-0edb-4058-8228-b86eb6db42b1 req-6351dffb-e29a-440c-98ca-37754495ab66 service nova] Acquiring lock "1cb1b440-0073-4a53-a0a2-e2781e021866-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:20:15 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-65ba388d-0edb-4058-8228-b86eb6db42b1 req-6351dffb-e29a-440c-98ca-37754495ab66 service nova] Lock "1cb1b440-0073-4a53-a0a2-e2781e021866-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:20:15 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-65ba388d-0edb-4058-8228-b86eb6db42b1 req-6351dffb-e29a-440c-98ca-37754495ab66 service nova] Lock "1cb1b440-0073-4a53-a0a2-e2781e021866-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:20:15 user nova-compute[75045]: DEBUG nova.compute.manager [req-65ba388d-0edb-4058-8228-b86eb6db42b1 req-6351dffb-e29a-440c-98ca-37754495ab66 service nova] [instance: 1cb1b440-0073-4a53-a0a2-e2781e021866] No waiting events found dispatching network-vif-plugged-2baf0a88-fd3e-45ae-95f8-9d568be4211b {{(pid=75045) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 23:20:15 user nova-compute[75045]: WARNING nova.compute.manager [req-65ba388d-0edb-4058-8228-b86eb6db42b1 req-6351dffb-e29a-440c-98ca-37754495ab66 service nova] [instance: 1cb1b440-0073-4a53-a0a2-e2781e021866] Received unexpected event network-vif-plugged-2baf0a88-fd3e-45ae-95f8-9d568be4211b for instance with vm_state active and task_state None.
Nov 08 23:20:15 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:20:19 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:20:20 user nova-compute[75045]: WARNING nova.virt.libvirt.driver [None req-0c9c7288-cef6-40c5-be76-5d17c13493d1 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 82bc5fd0-26c7-4f81-b966-54831393b617 is timed out.
Nov 08 23:20:20 user nova-compute[75045]: INFO nova.virt.libvirt.driver [None req-0c9c7288-cef6-40c5-be76-5d17c13493d1 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262-project-member] Successfully detached device vdb from instance 82bc5fd0-26c7-4f81-b966-54831393b617 from the live domain config.
Nov 08 23:20:20 user nova-compute[75045]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0c9c7288-cef6-40c5-be76-5d17c13493d1 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262-project-member] [instance: 82bc5fd0-26c7-4f81-b966-54831393b617] calling os-brick to detach iSCSI Volume {{(pid=75045) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 23:20:20 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c9c7288-cef6-40c5-be76-5d17c13493d1 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1b68210460>, {'target_iqn': 'iqn.2010-10.org.openstack:1bec3976-0b2c-436e-9c4a-eeb6b8badbae', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dPxsmzhw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdj'}, None), 'kwargs': False}}" {{(pid=75045) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 23:20:20 user nova-compute[75045]: WARNING os_brick.initiator.connectors.base [None req-0c9c7288-cef6-40c5-be76-5d17c13493d1 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 23:20:20 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-0c9c7288-cef6-40c5-be76-5d17c13493d1 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 23:20:20 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-0c9c7288-cef6-40c5-be76-5d17c13493d1 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 23:20:20 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:20:20 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:20:20 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:20:20 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[55c633ee-1b53-479d-817d-8811a036132d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8d2ff5d0-0b89-42ba-92eb-1e12c9cce205\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1bec3976-0b2c-436e-9c4a-eeb6b8badbae\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6ed77146-5ae0-400d-8116-7f9eb1322808\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:175bb2c0-7767-4740-9350-7e3300681a43\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c7f7084f-f0d7-4d4b-9a14-69065a9c3e41\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:20:20 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c9c7288-cef6-40c5-be76-5d17c13493d1 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 23:20:20 user nova-compute[75045]: No targets found.
Nov 08 23:20:20 user nova-compute[75045]: iSNS:
Nov 08 23:20:20 user nova-compute[75045]: No targets found.
Nov 08 23:20:20 user nova-compute[75045]: STATIC:
Nov 08 23:20:20 user nova-compute[75045]: Target: iqn.2010-10.org.openstack:8d2ff5d0-0b89-42ba-92eb-1e12c9cce205
Nov 08 23:20:20 user nova-compute[75045]:         Portal: 172.16.0.220:3260,-1
Nov 08 23:20:20 user nova-compute[75045]:                 Iface Name: default
Nov 08 23:20:20 user nova-compute[75045]: Target: iqn.2010-10.org.openstack:1bec3976-0b2c-436e-9c4a-eeb6b8badbae
Nov 08 23:20:20 user nova-compute[75045]:         Portal: 172.16.0.220:3260,-1
Nov 08 23:20:20 user nova-compute[75045]:                 Iface Name: default
Nov 08 23:20:20 user nova-compute[75045]: Target: iqn.2010-10.org.openstack:6ed77146-5ae0-400d-8116-7f9eb1322808
Nov 08 23:20:20 user nova-compute[75045]:         Portal: 172.16.0.220:3260,-1
Nov 08 23:20:20 user nova-compute[75045]:                 Iface Name: default
Nov 08 23:20:20 user nova-compute[75045]: Target: iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab
Nov 08 23:20:20 user nova-compute[75045]:         Portal: 172.16.0.220:3260,-1
Nov 08 23:20:20 user nova-compute[75045]:                 Iface Name: default
Nov 08 23:20:20 user nova-compute[75045]: Target: iqn.2010-10.org.openstack:175bb2c0-7767-4740-9350-7e3300681a43
Nov 08 23:20:20 user nova-compute[75045]:         Portal: 172.16.0.220:3260,-1
Nov 08 23:20:20 user nova-compute[75045]:                 Iface Name: default
Nov 08 23:20:20 user nova-compute[75045]: Target: iqn.2010-10.org.openstack:c7f7084f-f0d7-4d4b-9a14-69065a9c3e41
Nov 08 23:20:20 user nova-compute[75045]:         Portal: 172.16.0.220:3260,-1
Nov 08 23:20:20 user nova-compute[75045]:                 Iface Name: default
Nov 08 23:20:20 user nova-compute[75045]: FIRMWARE:
Nov 08 23:20:20 user nova-compute[75045]: No targets found.
Nov 08 23:20:20 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 23:20:20 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c9c7288-cef6-40c5-be76-5d17c13493d1 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 23:20:20 user nova-compute[75045]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 23:20:20 user nova-compute[75045]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75045) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 23:20:20 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c9c7288-cef6-40c5-be76-5d17c13493d1 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1bec3976-0b2c-436e-9c4a-eeb6b8badbae', 0)] {{(pid=75045) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 23:20:20 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:20:20 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:20:20 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[89763c89-0e89-44c2-ba5e-5c8d638f105b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:175bb2c0-7767-4740-9350-7e3300681a43\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1bec3976-0b2c-436e-9c4a-eeb6b8badbae\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6ed77146-5ae0-400d-8116-7f9eb1322808\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8d2ff5d0-0b89-42ba-92eb-1e12c9cce205\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c7f7084f-f0d7-4d4b-9a14-69065a9c3e41\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:20:20 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:20:20 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:20:20 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[c14c68f9-6e98-4fd0-9a53-02c5bf58eb12]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d2ff5d0-0b89-42ba-92eb-1e12c9cce205 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7f7084f-f0d7-4d4b-9a14-69065a9c3e41 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1bec3976-0b2c-436e-9c4a-eeb6b8badbae (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:175bb2c0-7767-4740-9350-7e3300681a43 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ed77146-5ae0-400d-8116-7f9eb1322808 (non-flash)\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:20:20 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c9c7288-cef6-40c5-be76-5d17c13493d1 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d2ff5d0-0b89-42ba-92eb-1e12c9cce205 (non-flash)
Nov 08 23:20:20 user nova-compute[75045]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab (non-flash)
Nov 08 23:20:20 user nova-compute[75045]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7f7084f-f0d7-4d4b-9a14-69065a9c3e41 (non-flash)
Nov 08 23:20:20 user nova-compute[75045]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1bec3976-0b2c-436e-9c4a-eeb6b8badbae (non-flash)
Nov 08 23:20:20 user nova-compute[75045]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:175bb2c0-7767-4740-9350-7e3300681a43 (non-flash)
Nov 08 23:20:20 user nova-compute[75045]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ed77146-5ae0-400d-8116-7f9eb1322808 (non-flash)
Nov 08 23:20:20 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 23:20:20 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c9c7288-cef6-40c5-be76-5d17c13493d1 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d2ff5d0-0b89-42ba-92eb-1e12c9cce205 (non-flash)
Nov 08 23:20:20 user nova-compute[75045]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab (non-flash)
Nov 08 23:20:20 user nova-compute[75045]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7f7084f-f0d7-4d4b-9a14-69065a9c3e41 (non-flash)
Nov 08 23:20:20 user nova-compute[75045]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1bec3976-0b2c-436e-9c4a-eeb6b8badbae (non-flash)
Nov 08 23:20:20 user nova-compute[75045]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:175bb2c0-7767-4740-9350-7e3300681a43 (non-flash)
Nov 08 23:20:20 user nova-compute[75045]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ed77146-5ae0-400d-8116-7f9eb1322808 (non-flash)
Nov 08 23:20:20 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 23:20:20 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c9c7288-cef6-40c5-be76-5d17c13493d1 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1b709569e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1bec3976-0b2c-436e-9c4a-eeb6b8badbae'): ({'sdj'}, set())}) {{(pid=75045) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 23:20:20 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-0c9c7288-cef6-40c5-be76-5d17c13493d1 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262-project-member] Removing single pathed devices sdj {{(pid=75045) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 23:20:20 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:20:20 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:20:20 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5f6da2d-1170-421a-ba26-8deb81c6e3f4]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:20:20 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdj {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:20:20 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdj" returned: 0 in 0.021s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:20:20 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[74606f93-0280-48d6-811f-8ea42a5d4ad8]: (4, ('ok\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:20:20 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-0c9c7288-cef6-40c5-be76-5d17c13493d1 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262-project-member] Flushing IO for device /dev/sdj {{(pid=75045) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 23:20:20 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdj {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:20:20 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdj" returned: 0 in 0.013s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:20:20 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c83b492-1156-4925-9e16-15e880e49b5b]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:20:20 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-0c9c7288-cef6-40c5-be76-5d17c13493d1 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262-project-member] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=75045) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 23:20:20 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdj/device/delete {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:20:20 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdj/device/delete" returned: 0 in 0.038s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:20:20 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[c726d61e-d51f-4a7f-8288-418c016d2844]: (4, ('1', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:20:20 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-0c9c7288-cef6-40c5-be76-5d17c13493d1 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262-project-member] Checking to see if SCSI volumes sdj have been removed. {{(pid=75045) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 23:20:20 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-0c9c7288-cef6-40c5-be76-5d17c13493d1 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262-project-member] SCSI volumes sdj have been removed. {{(pid=75045) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 23:20:20 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c9c7288-cef6-40c5-be76-5d17c13493d1 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1bec3976-0b2c-436e-9c4a-eeb6b8badbae')] {{(pid=75045) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 23:20:20 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1bec3976-0b2c-436e-9c4a-eeb6b8badbae -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:20:20 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1bec3976-0b2c-436e-9c4a-eeb6b8badbae -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:20:20 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[27530122-34d6-423c-a9a8-ca3e1b012247]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:20:20 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c9c7288-cef6-40c5-be76-5d17c13493d1 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:20:20 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1bec3976-0b2c-436e-9c4a-eeb6b8badbae -p 172.16.0.220:3260 --logout {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:20:20 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1bec3976-0b2c-436e-9c4a-eeb6b8badbae -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:20:20 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[587d0a0e-f5c1-4e24-946b-54894cac9f27]: (4, ('Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:1bec3976-0b2c-436e-9c4a-eeb6b8badbae, portal: 172.16.0.220,3260]\nLogout of [sid: 13, target: iqn.2010-10.org.openstack:1bec3976-0b2c-436e-9c4a-eeb6b8badbae, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:20:20 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c9c7288-cef6-40c5-be76-5d17c13493d1 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:1bec3976-0b2c-436e-9c4a-eeb6b8badbae, portal: 172.16.0.220,3260]
Nov 08 23:20:20 user nova-compute[75045]: Logout of [sid: 13, target: iqn.2010-10.org.openstack:1bec3976-0b2c-436e-9c4a-eeb6b8badbae, portal: 172.16.0.220,3260] successful.
Nov 08 23:20:20 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:20:20 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1bec3976-0b2c-436e-9c4a-eeb6b8badbae -p 172.16.0.220:3260 --op delete {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:20:20 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1bec3976-0b2c-436e-9c4a-eeb6b8badbae -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:20:20 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb868e34-f268-4946-bced-f7ed0e3b731d]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:20:20 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c9c7288-cef6-40c5-be76-5d17c13493d1 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:20:20 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-0c9c7288-cef6-40c5-be76-5d17c13493d1 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.318s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 23:20:20 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c9c7288-cef6-40c5-be76-5d17c13493d1 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262-project-member] <== disconnect_volume: return (319ms) None {{(pid=75045) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 23:20:20 user nova-compute[75045]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0c9c7288-cef6-40c5-be76-5d17c13493d1 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262-project-member] [instance: 82bc5fd0-26c7-4f81-b966-54831393b617] Disconnected iSCSI Volume {{(pid=75045) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 23:20:22 user nova-compute[75045]: DEBUG nova.objects.instance [None req-0c9c7288-cef6-40c5-be76-5d17c13493d1 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262-project-member] Lazy-loading 'flavor' on Instance uuid 82bc5fd0-26c7-4f81-b966-54831393b617 {{(pid=75045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 23:20:22 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-0c9c7288-cef6-40c5-be76-5d17c13493d1 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262-project-member] Lock "82bc5fd0-26c7-4f81-b966-54831393b617" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.129s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:20:24 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:20:26 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:20:29 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:20:29 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:20:31 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:20:33 user nova-compute[75045]: WARNING nova.virt.libvirt.driver [None req-9d241a0b-bc72-4ed6-b08b-000d3a80e474 tempest-TaggedAttachmentsTest-1639503389 tempest-TaggedAttachmentsTest-1639503389-project-member] Waiting for libvirt event about the detach of device tap2baf0a88-fd with device alias net1 from instance 1cb1b440-0073-4a53-a0a2-e2781e021866 is timed out.
Nov 08 23:20:33 user nova-compute[75045]: DEBUG nova.virt.libvirt.guest [None req-9d241a0b-bc72-4ed6-b08b-000d3a80e474 tempest-TaggedAttachmentsTest-1639503389 tempest-TaggedAttachmentsTest-1639503389-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:9e:7d:b7"/><model type="virtio"/><mtu size="1442"/><target dev="tap2baf0a88-fd"/></interface> {{(pid=75045) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 08 23:20:33 user nova-compute[75045]: DEBUG nova.virt.libvirt.guest [None req-9d241a0b-bc72-4ed6-b08b-000d3a80e474 tempest-TaggedAttachmentsTest-1639503389 tempest-TaggedAttachmentsTest-1639503389-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:9e:7d:b7"/><model type="virtio"/><mtu size="1442"/><target dev="tap2baf0a88-fd"/></interface>not found in domain: <domain type='kvm' id='5'>
Nov 08 23:20:33 user nova-compute[75045]:   <name>instance-00000005</name>
Nov 08 23:20:33 user nova-compute[75045]:   <uuid>1cb1b440-0073-4a53-a0a2-e2781e021866</uuid>
Nov 08 23:20:33 user nova-compute[75045]:   <metadata>
Nov 08 23:20:33 user nova-compute[75045]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 23:20:33 user nova-compute[75045]:   <nova:package version="0.0.0"/>
Nov 08 23:20:33 user nova-compute[75045]:   <nova:name>tempest-device-tagging-server-1008670319</nova:name>
Nov 08 23:20:33 user nova-compute[75045]:   <nova:creationTime>2023-11-08 23:18:03</nova:creationTime>
Nov 08 23:20:33 user nova-compute[75045]:   <nova:flavor name="m1.tiny">
Nov 08 23:20:33 user nova-compute[75045]:     <nova:memory>512</nova:memory>
Nov 08 23:20:33 user nova-compute[75045]:     <nova:disk>1</nova:disk>
Nov 08 23:20:33 user nova-compute[75045]:     <nova:swap>0</nova:swap>
Nov 08 23:20:33 user nova-compute[75045]:     <nova:ephemeral>0</nova:ephemeral>
Nov 08 23:20:33 user nova-compute[75045]:     <nova:vcpus>1</nova:vcpus>
Nov 08 23:20:33 user nova-compute[75045]:   </nova:flavor>
Nov 08 23:20:33 user nova-compute[75045]:   <nova:owner>
Nov 08 23:20:33 user nova-compute[75045]:     <nova:user uuid="0c8d9cc387dc45d18ad1550ef6d3cfa9">tempest-TaggedAttachmentsTest-1639503389-project-member</nova:user>
Nov 08 23:20:33 user nova-compute[75045]:     <nova:project uuid="bb18f0af92ec4de6a1fddb6c77ea030d">tempest-TaggedAttachmentsTest-1639503389</nova:project>
Nov 08 23:20:33 user nova-compute[75045]:   </nova:owner>
Nov 08 23:20:33 user nova-compute[75045]:   <nova:root type="image" uuid="a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb"/>
Nov 08 23:20:33 user nova-compute[75045]:   <nova:ports>
Nov 08 23:20:33 user nova-compute[75045]:     <nova:port uuid="892284f7-b4b9-4b5b-82c7-62300cd8afb7">
Nov 08 23:20:33 user nova-compute[75045]:       <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 08 23:20:33 user nova-compute[75045]:     </nova:port>
Nov 08 23:20:33 user nova-compute[75045]:     <nova:port uuid="2baf0a88-fd3e-45ae-95f8-9d568be4211b">
Nov 08 23:20:33 user nova-compute[75045]:       <nova:ip type="fixed" address="10.10.10.184" ipVersion="4"/>
Nov 08 23:20:33 user nova-compute[75045]:     </nova:port>
Nov 08 23:20:33 user nova-compute[75045]:   </nova:ports>
Nov 08 23:20:33 user nova-compute[75045]: </nova:instance>
Nov 08 23:20:33 user nova-compute[75045]:   </metadata>
Nov 08 23:20:33 user nova-compute[75045]:   <memory unit='KiB'>524288</memory>
Nov 08 23:20:33 user nova-compute[75045]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 08 23:20:33 user nova-compute[75045]:   <vcpu placement='static'>1</vcpu>
Nov 08 23:20:33 user nova-compute[75045]:   <resource>
Nov 08 23:20:33 user nova-compute[75045]:     <partition>/machine</partition>
Nov 08 23:20:33 user nova-compute[75045]:   </resource>
Nov 08 23:20:33 user nova-compute[75045]:   <sysinfo type='smbios'>
Nov 08 23:20:33 user nova-compute[75045]:     <system>
Nov 08 23:20:33 user nova-compute[75045]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 08 23:20:33 user nova-compute[75045]:       <entry name='product'>OpenStack Nova</entry>
Nov 08 23:20:33 user nova-compute[75045]:       <entry name='version'>0.0.0</entry>
Nov 08 23:20:33 user nova-compute[75045]:       <entry name='serial'>1cb1b440-0073-4a53-a0a2-e2781e021866</entry>
Nov 08 23:20:33 user nova-compute[75045]:       <entry name='uuid'>1cb1b440-0073-4a53-a0a2-e2781e021866</entry>
Nov 08 23:20:33 user nova-compute[75045]:       <entry name='family'>Virtual Machine</entry>
Nov 08 23:20:33 user nova-compute[75045]:     </system>
Nov 08 23:20:33 user nova-compute[75045]:   </sysinfo>
Nov 08 23:20:33 user nova-compute[75045]:   <os>
Nov 08 23:20:33 user nova-compute[75045]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 08 23:20:33 user nova-compute[75045]:     <boot dev='hd'/>
Nov 08 23:20:33 user nova-compute[75045]:     <smbios mode='sysinfo'/>
Nov 08 23:20:33 user nova-compute[75045]:   </os>
Nov 08 23:20:33 user nova-compute[75045]:   <features>
Nov 08 23:20:33 user nova-compute[75045]:     <acpi/>
Nov 08 23:20:33 user nova-compute[75045]:     <apic/>
Nov 08 23:20:33 user nova-compute[75045]:     <vmcoreinfo state='on'/>
Nov 08 23:20:33 user nova-compute[75045]:   </features>
Nov 08 23:20:33 user nova-compute[75045]:   <cpu mode='custom' match='exact' check='full'>
Nov 08 23:20:33 user nova-compute[75045]:     <model fallback='forbid'>Nehalem</model>
Nov 08 23:20:33 user nova-compute[75045]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 08 23:20:33 user nova-compute[75045]:     <feature policy='require' name='vme'/>
Nov 08 23:20:33 user nova-compute[75045]:     <feature policy='require' name='x2apic'/>
Nov 08 23:20:33 user nova-compute[75045]:     <feature policy='require' name='hypervisor'/>
Nov 08 23:20:33 user nova-compute[75045]:   </cpu>
Nov 08 23:20:33 user nova-compute[75045]:   <clock offset='utc'>
Nov 08 23:20:33 user nova-compute[75045]:     <timer name='pit' tickpolicy='delay'/>
Nov 08 23:20:33 user nova-compute[75045]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 08 23:20:33 user nova-compute[75045]:     <timer name='hpet' present='no'/>
Nov 08 23:20:33 user nova-compute[75045]:   </clock>
Nov 08 23:20:33 user nova-compute[75045]:   <on_poweroff>destroy</on_poweroff>
Nov 08 23:20:33 user nova-compute[75045]:   <on_reboot>restart</on_reboot>
Nov 08 23:20:33 user nova-compute[75045]:   <on_crash>destroy</on_crash>
Nov 08 23:20:33 user nova-compute[75045]:   <devices>
Nov 08 23:20:33 user nova-compute[75045]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 08 23:20:33 user nova-compute[75045]:     <disk type='file' device='disk'>
Nov 08 23:20:33 user nova-compute[75045]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 08 23:20:33 user nova-compute[75045]:       <source file='/opt/stack/data/nova/instances/1cb1b440-0073-4a53-a0a2-e2781e021866/disk' index='2'/>
Nov 08 23:20:33 user nova-compute[75045]:       <backingStore type='file' index='3'>
Nov 08 23:20:33 user nova-compute[75045]:         <format type='raw'/>
Nov 08 23:20:33 user nova-compute[75045]:         <source file='/opt/stack/data/nova/instances/_base/b59f52a99fff51c56dd1edfb83892fb8f647f2f3'/>
Nov 08 23:20:33 user nova-compute[75045]:         <backingStore/>
Nov 08 23:20:33 user nova-compute[75045]:       </backingStore>
Nov 08 23:20:33 user nova-compute[75045]:       <target dev='vda' bus='virtio'/>
Nov 08 23:20:33 user nova-compute[75045]:       <alias name='virtio-disk0'/>
Nov 08 23:20:33 user nova-compute[75045]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 08 23:20:33 user nova-compute[75045]:     </disk>
Nov 08 23:20:33 user nova-compute[75045]:     <disk type='file' device='cdrom'>
Nov 08 23:20:33 user nova-compute[75045]:       <driver name='qemu' type='raw' cache='none'/>
Nov 08 23:20:33 user nova-compute[75045]:       <source file='/opt/stack/data/nova/instances/1cb1b440-0073-4a53-a0a2-e2781e021866/disk.config' index='1'/>
Nov 08 23:20:33 user nova-compute[75045]:       <backingStore/>
Nov 08 23:20:33 user nova-compute[75045]:       <target dev='hda' bus='ide'/>
Nov 08 23:20:33 user nova-compute[75045]:       <readonly/>
Nov 08 23:20:33 user nova-compute[75045]:       <alias name='ide0-0-0'/>
Nov 08 23:20:33 user nova-compute[75045]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 08 23:20:33 user nova-compute[75045]:     </disk>
Nov 08 23:20:33 user nova-compute[75045]:     <controller type='usb' index='0' model='none'>
Nov 08 23:20:33 user nova-compute[75045]:       <alias name='usb'/>
Nov 08 23:20:33 user nova-compute[75045]:     </controller>
Nov 08 23:20:33 user nova-compute[75045]:     <controller type='pci' index='0' model='pci-root'>
Nov 08 23:20:33 user nova-compute[75045]:       <alias name='pci.0'/>
Nov 08 23:20:33 user nova-compute[75045]:     </controller>
Nov 08 23:20:33 user nova-compute[75045]:     <controller type='ide' index='0'>
Nov 08 23:20:33 user nova-compute[75045]:       <alias name='ide'/>
Nov 08 23:20:33 user nova-compute[75045]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 08 23:20:33 user nova-compute[75045]:     </controller>
Nov 08 23:20:33 user nova-compute[75045]:     <interface type='ethernet'>
Nov 08 23:20:33 user nova-compute[75045]:       <mac address='fa:16:3e:e4:4d:f8'/>
Nov 08 23:20:33 user nova-compute[75045]:       <target dev='tap892284f7-b4'/>
Nov 08 23:20:33 user nova-compute[75045]:       <model type='virtio'/>
Nov 08 23:20:33 user nova-compute[75045]:       <mtu size='1442'/>
Nov 08 23:20:33 user nova-compute[75045]:       <alias name='net0'/>
Nov 08 23:20:33 user nova-compute[75045]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 08 23:20:33 user nova-compute[75045]:     </interface>
Nov 08 23:20:33 user nova-compute[75045]:     <serial type='pty'>
Nov 08 23:20:33 user nova-compute[75045]:       <source path='/dev/pts/4'/>
Nov 08 23:20:33 user nova-compute[75045]:       <log file='/opt/stack/data/nova/instances/1cb1b440-0073-4a53-a0a2-e2781e021866/console.log' append='off'/>
Nov 08 23:20:33 user nova-compute[75045]:       <target type='isa-serial' port='0'>
Nov 08 23:20:33 user nova-compute[75045]:         <model name='isa-serial'/>
Nov 08 23:20:33 user nova-compute[75045]:       </target>
Nov 08 23:20:33 user nova-compute[75045]:       <alias name='serial0'/>
Nov 08 23:20:33 user nova-compute[75045]:     </serial>
Nov 08 23:20:33 user nova-compute[75045]:     <console type='pty' tty='/dev/pts/4'>
Nov 08 23:20:33 user nova-compute[75045]:       <source path='/dev/pts/4'/>
Nov 08 23:20:33 user nova-compute[75045]:       <log file='/opt/stack/data/nova/instances/1cb1b440-0073-4a53-a0a2-e2781e021866/console.log' append='off'/>
Nov 08 23:20:33 user nova-compute[75045]:       <target type='serial' port='0'/>
Nov 08 23:20:33 user nova-compute[75045]:       <alias name='serial0'/>
Nov 08 23:20:33 user nova-compute[75045]:     </console>
Nov 08 23:20:33 user nova-compute[75045]:     <input type='mouse' bus='ps2'>
Nov 08 23:20:33 user nova-compute[75045]:       <alias name='input0'/>
Nov 08 23:20:33 user nova-compute[75045]:     </input>
Nov 08 23:20:33 user nova-compute[75045]:     <input type='keyboard' bus='ps2'>
Nov 08 23:20:33 user nova-compute[75045]:       <alias name='input1'/>
Nov 08 23:20:33 user nova-compute[75045]:     </input>
Nov 08 23:20:33 user nova-compute[75045]:     <graphics type='vnc' port='5904' autoport='yes' listen='0.0.0.0'>
Nov 08 23:20:33 user nova-compute[75045]:       <listen type='address' address='0.0.0.0'/>
Nov 08 23:20:33 user nova-compute[75045]:     </graphics>
Nov 08 23:20:33 user nova-compute[75045]:     <audio id='1' type='none'/>
Nov 08 23:20:33 user nova-compute[75045]:     <video>
Nov 08 23:20:33 user nova-compute[75045]:       <model type='virtio' heads='1' primary='yes'/>
Nov 08 23:20:33 user nova-compute[75045]:       <alias name='video0'/>
Nov 08 23:20:33 user nova-compute[75045]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 08 23:20:33 user nova-compute[75045]:     </video>
Nov 08 23:20:33 user nova-compute[75045]:     <memballoon model='virtio'>
Nov 08 23:20:33 user nova-compute[75045]:       <stats period='10'/>
Nov 08 23:20:33 user nova-compute[75045]:       <alias name='balloon0'/>
Nov 08 23:20:33 user nova-compute[75045]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 08 23:20:33 user nova-compute[75045]:     </memballoon>
Nov 08 23:20:33 user nova-compute[75045]:     <rng model='virtio'>
Nov 08 23:20:33 user nova-compute[75045]:       <backend model='random'>/dev/urandom</backend>
Nov 08 23:20:33 user nova-compute[75045]:       <alias name='rng0'/>
Nov 08 23:20:33 user nova-compute[75045]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 08 23:20:33 user nova-compute[75045]:     </rng>
Nov 08 23:20:33 user nova-compute[75045]:   </devices>
Nov 08 23:20:33 user nova-compute[75045]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 08 23:20:33 user nova-compute[75045]:     <label>libvirt-1cb1b440-0073-4a53-a0a2-e2781e021866</label>
Nov 08 23:20:33 user nova-compute[75045]:     <imagelabel>libvirt-1cb1b440-0073-4a53-a0a2-e2781e021866</imagelabel>
Nov 08 23:20:33 user nova-compute[75045]:   </seclabel>
Nov 08 23:20:33 user nova-compute[75045]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 08 23:20:33 user nova-compute[75045]:     <label>+64055:+108</label>
Nov 08 23:20:33 user nova-compute[75045]:     <imagelabel>+64055:+108</imagelabel>
Nov 08 23:20:33 user nova-compute[75045]:   </seclabel>
Nov 08 23:20:33 user nova-compute[75045]: </domain>
Nov 08 23:20:33 user nova-compute[75045]:  {{(pid=75045) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 08 23:20:33 user nova-compute[75045]: INFO nova.virt.libvirt.driver [None req-9d241a0b-bc72-4ed6-b08b-000d3a80e474 tempest-TaggedAttachmentsTest-1639503389 tempest-TaggedAttachmentsTest-1639503389-project-member] Successfully detached device tap2baf0a88-fd from instance 1cb1b440-0073-4a53-a0a2-e2781e021866 from the live domain config.
Nov 08 23:20:33 user nova-compute[75045]: DEBUG nova.virt.libvirt.vif [None req-9d241a0b-bc72-4ed6-b08b-000d3a80e474 tempest-TaggedAttachmentsTest-1639503389 tempest-TaggedAttachmentsTest-1639503389-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T23:16:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1008670319',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1008670319',id=5,image_ref='a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJHwrx1BGWhjjUX4+Byh1wjqwerHxYEs1Bi9i8sP+n0orNMkrqYiTdsqsEt8sTDzFkc1LBM09NOYtbQKa/c7KjqeCNDDUOdBi8LqOWMDeLuYXRRZIoptz+6bpxuTCZMmXg==',key_name='tempest-keypair-1418515873',keypairs=<?>,launch_index=0,launched_at=2023-11-08T23:16:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bb18f0af92ec4de6a1fddb6c77ea030d',ramdisk_id='',reservation_id='r-15oytm0c',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1639503389',owner_user_name='tempest-TaggedAttachmentsTest-1639503389-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T23:16:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0c8d9cc387dc45d18ad1550ef6d3cfa9',uuid=1cb1b440-0073-4a53-a0a2-e2781e021866,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2baf0a88-fd3e-45ae-95f8-9d568be4211b", "address": "fa:16:3e:9e:7d:b7", "network": {"id": "3ffe4edb-8137-442f-9c3e-231775c7527c", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1585434856", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.184", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "bb18f0af92ec4de6a1fddb6c77ea030d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2baf0a88-fd", "ovs_interfaceid": "2baf0a88-fd3e-45ae-95f8-9d568be4211b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75045) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 23:20:33 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-9d241a0b-bc72-4ed6-b08b-000d3a80e474 tempest-TaggedAttachmentsTest-1639503389 tempest-TaggedAttachmentsTest-1639503389-project-member] Converting VIF {"id": "2baf0a88-fd3e-45ae-95f8-9d568be4211b", "address": "fa:16:3e:9e:7d:b7", "network": {"id": "3ffe4edb-8137-442f-9c3e-231775c7527c", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1585434856", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.184", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "bb18f0af92ec4de6a1fddb6c77ea030d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2baf0a88-fd", "ovs_interfaceid": "2baf0a88-fd3e-45ae-95f8-9d568be4211b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 23:20:33 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-9d241a0b-bc72-4ed6-b08b-000d3a80e474 tempest-TaggedAttachmentsTest-1639503389 tempest-TaggedAttachmentsTest-1639503389-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9e:7d:b7,bridge_name='br-int',has_traffic_filtering=True,id=2baf0a88-fd3e-45ae-95f8-9d568be4211b,network=Network(3ffe4edb-8137-442f-9c3e-231775c7527c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2baf0a88-fd') {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 23:20:33 user nova-compute[75045]: DEBUG os_vif [None req-9d241a0b-bc72-4ed6-b08b-000d3a80e474 tempest-TaggedAttachmentsTest-1639503389 tempest-TaggedAttachmentsTest-1639503389-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9e:7d:b7,bridge_name='br-int',has_traffic_filtering=True,id=2baf0a88-fd3e-45ae-95f8-9d568be4211b,network=Network(3ffe4edb-8137-442f-9c3e-231775c7527c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2baf0a88-fd') {{(pid=75045) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 23:20:33 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:20:33 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2baf0a88-fd, bridge=br-int, if_exists=True) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:20:33 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:20:33 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:20:33 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:20:33 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9e236a60-cba6-4c7d-b36b-f1a8c6eeea95) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:20:33 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:20:33 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:20:33 user nova-compute[75045]: INFO os_vif [None req-9d241a0b-bc72-4ed6-b08b-000d3a80e474 tempest-TaggedAttachmentsTest-1639503389 tempest-TaggedAttachmentsTest-1639503389-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9e:7d:b7,bridge_name='br-int',has_traffic_filtering=True,id=2baf0a88-fd3e-45ae-95f8-9d568be4211b,network=Network(3ffe4edb-8137-442f-9c3e-231775c7527c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2baf0a88-fd')
Nov 08 23:20:33 user nova-compute[75045]: DEBUG nova.virt.libvirt.guest [None req-9d241a0b-bc72-4ed6-b08b-000d3a80e474 tempest-TaggedAttachmentsTest-1639503389 tempest-TaggedAttachmentsTest-1639503389-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 23:20:33 user nova-compute[75045]:   <nova:package version="0.0.0"/>
Nov 08 23:20:33 user nova-compute[75045]:   <nova:name>tempest-device-tagging-server-1008670319</nova:name>
Nov 08 23:20:33 user nova-compute[75045]:   <nova:creationTime>2023-11-08 23:20:33</nova:creationTime>
Nov 08 23:20:33 user nova-compute[75045]:   <nova:flavor name="m1.tiny">
Nov 08 23:20:33 user nova-compute[75045]:     <nova:memory>512</nova:memory>
Nov 08 23:20:33 user nova-compute[75045]:     <nova:disk>1</nova:disk>
Nov 08 23:20:33 user nova-compute[75045]:     <nova:swap>0</nova:swap>
Nov 08 23:20:33 user nova-compute[75045]:     <nova:ephemeral>0</nova:ephemeral>
Nov 08 23:20:33 user nova-compute[75045]:     <nova:vcpus>1</nova:vcpus>
Nov 08 23:20:33 user nova-compute[75045]:   </nova:flavor>
Nov 08 23:20:33 user nova-compute[75045]:   <nova:owner>
Nov 08 23:20:33 user nova-compute[75045]:     <nova:user uuid="0c8d9cc387dc45d18ad1550ef6d3cfa9">tempest-TaggedAttachmentsTest-1639503389-project-member</nova:user>
Nov 08 23:20:33 user nova-compute[75045]:     <nova:project uuid="bb18f0af92ec4de6a1fddb6c77ea030d">tempest-TaggedAttachmentsTest-1639503389</nova:project>
Nov 08 23:20:33 user nova-compute[75045]:   </nova:owner>
Nov 08 23:20:33 user nova-compute[75045]:   <nova:root type="image" uuid="a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb"/>
Nov 08 23:20:33 user nova-compute[75045]:   <nova:ports>
Nov 08 23:20:33 user nova-compute[75045]:     <nova:port uuid="892284f7-b4b9-4b5b-82c7-62300cd8afb7">
Nov 08 23:20:33 user nova-compute[75045]:       <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 08 23:20:33 user nova-compute[75045]:     </nova:port>
Nov 08 23:20:33 user nova-compute[75045]:   </nova:ports>
Nov 08 23:20:33 user nova-compute[75045]: </nova:instance>
Nov 08 23:20:33 user nova-compute[75045]:  {{(pid=75045) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Nov 08 23:20:33 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:20:33 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:20:34 user nova-compute[75045]: DEBUG nova.compute.manager [req-1f32e34f-094f-47b8-b714-ed86e6c2877e req-6c0c7758-2418-4628-b480-c215fd421a62 service nova] [instance: 1cb1b440-0073-4a53-a0a2-e2781e021866] Received event network-vif-deleted-2baf0a88-fd3e-45ae-95f8-9d568be4211b {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:20:34 user nova-compute[75045]: INFO nova.compute.manager [req-1f32e34f-094f-47b8-b714-ed86e6c2877e req-6c0c7758-2418-4628-b480-c215fd421a62 service nova] [instance: 1cb1b440-0073-4a53-a0a2-e2781e021866] Neutron deleted interface 2baf0a88-fd3e-45ae-95f8-9d568be4211b; detaching it from the instance and deleting it from the info cache
Nov 08 23:20:34 user nova-compute[75045]: DEBUG nova.network.neutron [req-1f32e34f-094f-47b8-b714-ed86e6c2877e req-6c0c7758-2418-4628-b480-c215fd421a62 service nova] [instance: 1cb1b440-0073-4a53-a0a2-e2781e021866] Updating instance_info_cache with network_info: [{"id": "892284f7-b4b9-4b5b-82c7-62300cd8afb7", "address": "fa:16:3e:e4:4d:f8", "network": {"id": "fa6f2c92-825d-46c6-a0ea-51f96da244cb", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-193868289-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.235", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb18f0af92ec4de6a1fddb6c77ea030d", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap892284f7-b4", "ovs_interfaceid": "892284f7-b4b9-4b5b-82c7-62300cd8afb7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75045) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 23:20:34 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-9d241a0b-bc72-4ed6-b08b-000d3a80e474 tempest-TaggedAttachmentsTest-1639503389 tempest-TaggedAttachmentsTest-1639503389-project-member] Acquiring lock "refresh_cache-1cb1b440-0073-4a53-a0a2-e2781e021866" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 23:20:34 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-9d241a0b-bc72-4ed6-b08b-000d3a80e474 tempest-TaggedAttachmentsTest-1639503389 tempest-TaggedAttachmentsTest-1639503389-project-member] Acquired lock "refresh_cache-1cb1b440-0073-4a53-a0a2-e2781e021866" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 23:20:34 user nova-compute[75045]: DEBUG nova.network.neutron [None req-9d241a0b-bc72-4ed6-b08b-000d3a80e474 tempest-TaggedAttachmentsTest-1639503389 tempest-TaggedAttachmentsTest-1639503389-project-member] [instance: 1cb1b440-0073-4a53-a0a2-e2781e021866] Building network info cache for instance {{(pid=75045) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 23:20:34 user nova-compute[75045]: DEBUG nova.objects.instance [req-1f32e34f-094f-47b8-b714-ed86e6c2877e req-6c0c7758-2418-4628-b480-c215fd421a62 service nova] Lazy-loading 'system_metadata' on Instance uuid 1cb1b440-0073-4a53-a0a2-e2781e021866 {{(pid=75045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 23:20:34 user nova-compute[75045]: DEBUG nova.objects.instance [req-1f32e34f-094f-47b8-b714-ed86e6c2877e req-6c0c7758-2418-4628-b480-c215fd421a62 service nova] Lazy-loading 'flavor' on Instance uuid 1cb1b440-0073-4a53-a0a2-e2781e021866 {{(pid=75045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 23:20:34 user nova-compute[75045]: DEBUG nova.objects.base [req-1f32e34f-094f-47b8-b714-ed86e6c2877e req-6c0c7758-2418-4628-b480-c215fd421a62 service nova] Object Instance<1cb1b440-0073-4a53-a0a2-e2781e021866> lazy-loaded attributes: system_metadata,flavor {{(pid=75045) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 23:20:34 user nova-compute[75045]: DEBUG nova.virt.libvirt.vif [req-1f32e34f-094f-47b8-b714-ed86e6c2877e req-6c0c7758-2418-4628-b480-c215fd421a62 service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T23:16:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1008670319',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1008670319',id=5,image_ref='a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJHwrx1BGWhjjUX4+Byh1wjqwerHxYEs1Bi9i8sP+n0orNMkrqYiTdsqsEt8sTDzFkc1LBM09NOYtbQKa/c7KjqeCNDDUOdBi8LqOWMDeLuYXRRZIoptz+6bpxuTCZMmXg==',key_name='tempest-keypair-1418515873',keypairs=<?>,launch_index=0,launched_at=2023-11-08T23:16:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bb18f0af92ec4de6a1fddb6c77ea030d',ramdisk_id='',reservation_id='r-15oytm0c',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1639503389',owner_user_name='tempest-TaggedAttachmentsTest-1639503389-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T23:16:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0c8d9cc387dc45d18ad1550ef6d3cfa9',uuid=1cb1b440-0073-4a53-a0a2-e2781e021866,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2baf0a88-fd3e-45ae-95f8-9d568be4211b", "address": "fa:16:3e:9e:7d:b7", "network": {"id": "3ffe4edb-8137-442f-9c3e-231775c7527c", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1585434856", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.184", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "bb18f0af92ec4de6a1fddb6c77ea030d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2baf0a88-fd", "ovs_interfaceid": "2baf0a88-fd3e-45ae-95f8-9d568be4211b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75045) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 23:20:34 user nova-compute[75045]: DEBUG nova.network.os_vif_util [req-1f32e34f-094f-47b8-b714-ed86e6c2877e req-6c0c7758-2418-4628-b480-c215fd421a62 service nova] Converting VIF {"id": "2baf0a88-fd3e-45ae-95f8-9d568be4211b", "address": "fa:16:3e:9e:7d:b7", "network": {"id": "3ffe4edb-8137-442f-9c3e-231775c7527c", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1585434856", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.184", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "bb18f0af92ec4de6a1fddb6c77ea030d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2baf0a88-fd", "ovs_interfaceid": "2baf0a88-fd3e-45ae-95f8-9d568be4211b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 23:20:34 user nova-compute[75045]: DEBUG nova.network.os_vif_util [req-1f32e34f-094f-47b8-b714-ed86e6c2877e req-6c0c7758-2418-4628-b480-c215fd421a62 service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9e:7d:b7,bridge_name='br-int',has_traffic_filtering=True,id=2baf0a88-fd3e-45ae-95f8-9d568be4211b,network=Network(3ffe4edb-8137-442f-9c3e-231775c7527c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2baf0a88-fd') {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 23:20:34 user nova-compute[75045]: DEBUG nova.virt.libvirt.guest [req-1f32e34f-094f-47b8-b714-ed86e6c2877e req-6c0c7758-2418-4628-b480-c215fd421a62 service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:9e:7d:b7"/><model type="virtio"/><mtu size="1442"/><target dev="tap2baf0a88-fd"/></interface> {{(pid=75045) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 08 23:20:34 user nova-compute[75045]: DEBUG nova.virt.libvirt.guest [req-1f32e34f-094f-47b8-b714-ed86e6c2877e req-6c0c7758-2418-4628-b480-c215fd421a62 service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:9e:7d:b7"/><model type="virtio"/><mtu size="1442"/><target dev="tap2baf0a88-fd"/></interface>not found in domain: <domain type='kvm' id='5'>
Nov 08 23:20:34 user nova-compute[75045]:   <name>instance-00000005</name>
Nov 08 23:20:34 user nova-compute[75045]:   <uuid>1cb1b440-0073-4a53-a0a2-e2781e021866</uuid>
Nov 08 23:20:34 user nova-compute[75045]:   <metadata>
Nov 08 23:20:34 user nova-compute[75045]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 23:20:34 user nova-compute[75045]:   <nova:package version="0.0.0"/>
Nov 08 23:20:34 user nova-compute[75045]:   <nova:name>tempest-device-tagging-server-1008670319</nova:name>
Nov 08 23:20:34 user nova-compute[75045]:   <nova:creationTime>2023-11-08 23:20:33</nova:creationTime>
Nov 08 23:20:34 user nova-compute[75045]:   <nova:flavor name="m1.tiny">
Nov 08 23:20:34 user nova-compute[75045]:     <nova:memory>512</nova:memory>
Nov 08 23:20:34 user nova-compute[75045]:     <nova:disk>1</nova:disk>
Nov 08 23:20:34 user nova-compute[75045]:     <nova:swap>0</nova:swap>
Nov 08 23:20:34 user nova-compute[75045]:     <nova:ephemeral>0</nova:ephemeral>
Nov 08 23:20:34 user nova-compute[75045]:     <nova:vcpus>1</nova:vcpus>
Nov 08 23:20:34 user nova-compute[75045]:   </nova:flavor>
Nov 08 23:20:34 user nova-compute[75045]:   <nova:owner>
Nov 08 23:20:34 user nova-compute[75045]:     <nova:user uuid="0c8d9cc387dc45d18ad1550ef6d3cfa9">tempest-TaggedAttachmentsTest-1639503389-project-member</nova:user>
Nov 08 23:20:34 user nova-compute[75045]:     <nova:project uuid="bb18f0af92ec4de6a1fddb6c77ea030d">tempest-TaggedAttachmentsTest-1639503389</nova:project>
Nov 08 23:20:34 user nova-compute[75045]:   </nova:owner>
Nov 08 23:20:34 user nova-compute[75045]:   <nova:root type="image" uuid="a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb"/>
Nov 08 23:20:34 user nova-compute[75045]:   <nova:ports>
Nov 08 23:20:34 user nova-compute[75045]:     <nova:port uuid="892284f7-b4b9-4b5b-82c7-62300cd8afb7">
Nov 08 23:20:34 user nova-compute[75045]:       <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 08 23:20:34 user nova-compute[75045]:     </nova:port>
Nov 08 23:20:34 user nova-compute[75045]:   </nova:ports>
Nov 08 23:20:34 user nova-compute[75045]: </nova:instance>
Nov 08 23:20:34 user nova-compute[75045]:   </metadata>
Nov 08 23:20:34 user nova-compute[75045]:   <memory unit='KiB'>524288</memory>
Nov 08 23:20:34 user nova-compute[75045]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 08 23:20:34 user nova-compute[75045]:   <vcpu placement='static'>1</vcpu>
Nov 08 23:20:34 user nova-compute[75045]:   <resource>
Nov 08 23:20:34 user nova-compute[75045]:     <partition>/machine</partition>
Nov 08 23:20:34 user nova-compute[75045]:   </resource>
Nov 08 23:20:34 user nova-compute[75045]:   <sysinfo type='smbios'>
Nov 08 23:20:34 user nova-compute[75045]:     <system>
Nov 08 23:20:34 user nova-compute[75045]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 08 23:20:34 user nova-compute[75045]:       <entry name='product'>OpenStack Nova</entry>
Nov 08 23:20:34 user nova-compute[75045]:       <entry name='version'>0.0.0</entry>
Nov 08 23:20:34 user nova-compute[75045]:       <entry name='serial'>1cb1b440-0073-4a53-a0a2-e2781e021866</entry>
Nov 08 23:20:34 user nova-compute[75045]:       <entry name='uuid'>1cb1b440-0073-4a53-a0a2-e2781e021866</entry>
Nov 08 23:20:34 user nova-compute[75045]:       <entry name='family'>Virtual Machine</entry>
Nov 08 23:20:34 user nova-compute[75045]:     </system>
Nov 08 23:20:34 user nova-compute[75045]:   </sysinfo>
Nov 08 23:20:34 user nova-compute[75045]:   <os>
Nov 08 23:20:34 user nova-compute[75045]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 08 23:20:34 user nova-compute[75045]:     <boot dev='hd'/>
Nov 08 23:20:34 user nova-compute[75045]:     <smbios mode='sysinfo'/>
Nov 08 23:20:34 user nova-compute[75045]:   </os>
Nov 08 23:20:34 user nova-compute[75045]:   <features>
Nov 08 23:20:34 user nova-compute[75045]:     <acpi/>
Nov 08 23:20:34 user nova-compute[75045]:     <apic/>
Nov 08 23:20:34 user nova-compute[75045]:     <vmcoreinfo state='on'/>
Nov 08 23:20:34 user nova-compute[75045]:   </features>
Nov 08 23:20:34 user nova-compute[75045]:   <cpu mode='custom' match='exact' check='full'>
Nov 08 23:20:34 user nova-compute[75045]:     <model fallback='forbid'>Nehalem</model>
Nov 08 23:20:34 user nova-compute[75045]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 08 23:20:34 user nova-compute[75045]:     <feature policy='require' name='vme'/>
Nov 08 23:20:34 user nova-compute[75045]:     <feature policy='require' name='x2apic'/>
Nov 08 23:20:34 user nova-compute[75045]:     <feature policy='require' name='hypervisor'/>
Nov 08 23:20:34 user nova-compute[75045]:   </cpu>
Nov 08 23:20:34 user nova-compute[75045]:   <clock offset='utc'>
Nov 08 23:20:34 user nova-compute[75045]:     <timer name='pit' tickpolicy='delay'/>
Nov 08 23:20:34 user nova-compute[75045]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 08 23:20:34 user nova-compute[75045]:     <timer name='hpet' present='no'/>
Nov 08 23:20:34 user nova-compute[75045]:   </clock>
Nov 08 23:20:34 user nova-compute[75045]:   <on_poweroff>destroy</on_poweroff>
Nov 08 23:20:34 user nova-compute[75045]:   <on_reboot>restart</on_reboot>
Nov 08 23:20:34 user nova-compute[75045]:   <on_crash>destroy</on_crash>
Nov 08 23:20:34 user nova-compute[75045]:   <devices>
Nov 08 23:20:34 user nova-compute[75045]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 08 23:20:34 user nova-compute[75045]:     <disk type='file' device='disk'>
Nov 08 23:20:34 user nova-compute[75045]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 08 23:20:34 user nova-compute[75045]:       <source file='/opt/stack/data/nova/instances/1cb1b440-0073-4a53-a0a2-e2781e021866/disk' index='2'/>
Nov 08 23:20:34 user nova-compute[75045]:       <backingStore type='file' index='3'>
Nov 08 23:20:34 user nova-compute[75045]:         <format type='raw'/>
Nov 08 23:20:34 user nova-compute[75045]:         <source file='/opt/stack/data/nova/instances/_base/b59f52a99fff51c56dd1edfb83892fb8f647f2f3'/>
Nov 08 23:20:34 user nova-compute[75045]:         <backingStore/>
Nov 08 23:20:34 user nova-compute[75045]:       </backingStore>
Nov 08 23:20:34 user nova-compute[75045]:       <target dev='vda' bus='virtio'/>
Nov 08 23:20:34 user nova-compute[75045]:       <alias name='virtio-disk0'/>
Nov 08 23:20:34 user nova-compute[75045]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 08 23:20:34 user nova-compute[75045]:     </disk>
Nov 08 23:20:34 user nova-compute[75045]:     <disk type='file' device='cdrom'>
Nov 08 23:20:34 user nova-compute[75045]:       <driver name='qemu' type='raw' cache='none'/>
Nov 08 23:20:34 user nova-compute[75045]:       <source file='/opt/stack/data/nova/instances/1cb1b440-0073-4a53-a0a2-e2781e021866/disk.config' index='1'/>
Nov 08 23:20:34 user nova-compute[75045]:       <backingStore/>
Nov 08 23:20:34 user nova-compute[75045]:       <target dev='hda' bus='ide'/>
Nov 08 23:20:34 user nova-compute[75045]:       <readonly/>
Nov 08 23:20:34 user nova-compute[75045]:       <alias name='ide0-0-0'/>
Nov 08 23:20:34 user nova-compute[75045]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 08 23:20:34 user nova-compute[75045]:     </disk>
Nov 08 23:20:34 user nova-compute[75045]:     <controller type='usb' index='0' model='none'>
Nov 08 23:20:34 user nova-compute[75045]:       <alias name='usb'/>
Nov 08 23:20:34 user nova-compute[75045]:     </controller>
Nov 08 23:20:34 user nova-compute[75045]:     <controller type='pci' index='0' model='pci-root'>
Nov 08 23:20:34 user nova-compute[75045]:       <alias name='pci.0'/>
Nov 08 23:20:34 user nova-compute[75045]:     </controller>
Nov 08 23:20:34 user nova-compute[75045]:     <controller type='ide' index='0'>
Nov 08 23:20:34 user nova-compute[75045]:       <alias name='ide'/>
Nov 08 23:20:34 user nova-compute[75045]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 08 23:20:34 user nova-compute[75045]:     </controller>
Nov 08 23:20:34 user nova-compute[75045]:     <interface type='ethernet'>
Nov 08 23:20:34 user nova-compute[75045]:       <mac address='fa:16:3e:e4:4d:f8'/>
Nov 08 23:20:34 user nova-compute[75045]:       <target dev='tap892284f7-b4'/>
Nov 08 23:20:34 user nova-compute[75045]:       <model type='virtio'/>
Nov 08 23:20:34 user nova-compute[75045]:       <mtu size='1442'/>
Nov 08 23:20:34 user nova-compute[75045]:       <alias name='net0'/>
Nov 08 23:20:34 user nova-compute[75045]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 08 23:20:34 user nova-compute[75045]:     </interface>
Nov 08 23:20:34 user nova-compute[75045]:     <serial type='pty'>
Nov 08 23:20:34 user nova-compute[75045]:       <source path='/dev/pts/4'/>
Nov 08 23:20:34 user nova-compute[75045]:       <log file='/opt/stack/data/nova/instances/1cb1b440-0073-4a53-a0a2-e2781e021866/console.log' append='off'/>
Nov 08 23:20:34 user nova-compute[75045]:       <target type='isa-serial' port='0'>
Nov 08 23:20:34 user nova-compute[75045]:         <model name='isa-serial'/>
Nov 08 23:20:34 user nova-compute[75045]:       </target>
Nov 08 23:20:34 user nova-compute[75045]:       <alias name='serial0'/>
Nov 08 23:20:34 user nova-compute[75045]:     </serial>
Nov 08 23:20:34 user nova-compute[75045]:     <console type='pty' tty='/dev/pts/4'>
Nov 08 23:20:34 user nova-compute[75045]:       <source path='/dev/pts/4'/>
Nov 08 23:20:34 user nova-compute[75045]:       <log file='/opt/stack/data/nova/instances/1cb1b440-0073-4a53-a0a2-e2781e021866/console.log' append='off'/>
Nov 08 23:20:34 user nova-compute[75045]:       <target type='serial' port='0'/>
Nov 08 23:20:34 user nova-compute[75045]:       <alias name='serial0'/>
Nov 08 23:20:34 user nova-compute[75045]:     </console>
Nov 08 23:20:34 user nova-compute[75045]:     <input type='mouse' bus='ps2'>
Nov 08 23:20:34 user nova-compute[75045]:       <alias name='input0'/>
Nov 08 23:20:34 user nova-compute[75045]:     </input>
Nov 08 23:20:34 user nova-compute[75045]:     <input type='keyboard' bus='ps2'>
Nov 08 23:20:34 user nova-compute[75045]:       <alias name='input1'/>
Nov 08 23:20:34 user nova-compute[75045]:     </input>
Nov 08 23:20:34 user nova-compute[75045]:     <graphics type='vnc' port='5904' autoport='yes' listen='0.0.0.0'>
Nov 08 23:20:34 user nova-compute[75045]:       <listen type='address' address='0.0.0.0'/>
Nov 08 23:20:34 user nova-compute[75045]:     </graphics>
Nov 08 23:20:34 user nova-compute[75045]:     <audio id='1' type='none'/>
Nov 08 23:20:34 user nova-compute[75045]:     <video>
Nov 08 23:20:34 user nova-compute[75045]:       <model type='virtio' heads='1' primary='yes'/>
Nov 08 23:20:34 user nova-compute[75045]:       <alias name='video0'/>
Nov 08 23:20:34 user nova-compute[75045]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 08 23:20:34 user nova-compute[75045]:     </video>
Nov 08 23:20:34 user nova-compute[75045]:     <memballoon model='virtio'>
Nov 08 23:20:34 user nova-compute[75045]:       <stats period='10'/>
Nov 08 23:20:34 user nova-compute[75045]:       <alias name='balloon0'/>
Nov 08 23:20:34 user nova-compute[75045]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 08 23:20:34 user nova-compute[75045]:     </memballoon>
Nov 08 23:20:34 user nova-compute[75045]:     <rng model='virtio'>
Nov 08 23:20:34 user nova-compute[75045]:       <backend model='random'>/dev/urandom</backend>
Nov 08 23:20:34 user nova-compute[75045]:       <alias name='rng0'/>
Nov 08 23:20:34 user nova-compute[75045]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 08 23:20:34 user nova-compute[75045]:     </rng>
Nov 08 23:20:34 user nova-compute[75045]:   </devices>
Nov 08 23:20:34 user nova-compute[75045]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 08 23:20:34 user nova-compute[75045]:     <label>libvirt-1cb1b440-0073-4a53-a0a2-e2781e021866</label>
Nov 08 23:20:34 user nova-compute[75045]:     <imagelabel>libvirt-1cb1b440-0073-4a53-a0a2-e2781e021866</imagelabel>
Nov 08 23:20:34 user nova-compute[75045]:   </seclabel>
Nov 08 23:20:34 user nova-compute[75045]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 08 23:20:34 user nova-compute[75045]:     <label>+64055:+108</label>
Nov 08 23:20:34 user nova-compute[75045]:     <imagelabel>+64055:+108</imagelabel>
Nov 08 23:20:34 user nova-compute[75045]:   </seclabel>
Nov 08 23:20:34 user nova-compute[75045]: </domain>
Nov 08 23:20:34 user nova-compute[75045]:  {{(pid=75045) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 08 23:20:34 user nova-compute[75045]: DEBUG nova.virt.libvirt.guest [req-1f32e34f-094f-47b8-b714-ed86e6c2877e req-6c0c7758-2418-4628-b480-c215fd421a62 service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:9e:7d:b7"/><model type="virtio"/><mtu size="1442"/><target dev="tap2baf0a88-fd"/></interface> {{(pid=75045) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 08 23:20:34 user nova-compute[75045]: DEBUG nova.virt.libvirt.guest [req-1f32e34f-094f-47b8-b714-ed86e6c2877e req-6c0c7758-2418-4628-b480-c215fd421a62 service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:9e:7d:b7"/><model type="virtio"/><mtu size="1442"/><target dev="tap2baf0a88-fd"/></interface>not found in domain: <domain type='kvm' id='5'>
Nov 08 23:20:34 user nova-compute[75045]:   <name>instance-00000005</name>
Nov 08 23:20:34 user nova-compute[75045]:   <uuid>1cb1b440-0073-4a53-a0a2-e2781e021866</uuid>
Nov 08 23:20:34 user nova-compute[75045]:   <metadata>
Nov 08 23:20:34 user nova-compute[75045]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 23:20:34 user nova-compute[75045]:   <nova:package version="0.0.0"/>
Nov 08 23:20:34 user nova-compute[75045]:   <nova:name>tempest-device-tagging-server-1008670319</nova:name>
Nov 08 23:20:34 user nova-compute[75045]:   <nova:creationTime>2023-11-08 23:20:33</nova:creationTime>
Nov 08 23:20:34 user nova-compute[75045]:   <nova:flavor name="m1.tiny">
Nov 08 23:20:34 user nova-compute[75045]:     <nova:memory>512</nova:memory>
Nov 08 23:20:34 user nova-compute[75045]:     <nova:disk>1</nova:disk>
Nov 08 23:20:34 user nova-compute[75045]:     <nova:swap>0</nova:swap>
Nov 08 23:20:34 user nova-compute[75045]:     <nova:ephemeral>0</nova:ephemeral>
Nov 08 23:20:34 user nova-compute[75045]:     <nova:vcpus>1</nova:vcpus>
Nov 08 23:20:34 user nova-compute[75045]:   </nova:flavor>
Nov 08 23:20:34 user nova-compute[75045]:   <nova:owner>
Nov 08 23:20:34 user nova-compute[75045]:     <nova:user uuid="0c8d9cc387dc45d18ad1550ef6d3cfa9">tempest-TaggedAttachmentsTest-1639503389-project-member</nova:user>
Nov 08 23:20:34 user nova-compute[75045]:     <nova:project uuid="bb18f0af92ec4de6a1fddb6c77ea030d">tempest-TaggedAttachmentsTest-1639503389</nova:project>
Nov 08 23:20:34 user nova-compute[75045]:   </nova:owner>
Nov 08 23:20:34 user nova-compute[75045]:   <nova:root type="image" uuid="a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb"/>
Nov 08 23:20:34 user nova-compute[75045]:   <nova:ports>
Nov 08 23:20:34 user nova-compute[75045]:     <nova:port uuid="892284f7-b4b9-4b5b-82c7-62300cd8afb7">
Nov 08 23:20:34 user nova-compute[75045]:       <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 08 23:20:34 user nova-compute[75045]:     </nova:port>
Nov 08 23:20:34 user nova-compute[75045]:   </nova:ports>
Nov 08 23:20:34 user nova-compute[75045]: </nova:instance>
Nov 08 23:20:34 user nova-compute[75045]:   </metadata>
Nov 08 23:20:34 user nova-compute[75045]:   <memory unit='KiB'>524288</memory>
Nov 08 23:20:34 user nova-compute[75045]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 08 23:20:34 user nova-compute[75045]:   <vcpu placement='static'>1</vcpu>
Nov 08 23:20:34 user nova-compute[75045]:   <resource>
Nov 08 23:20:34 user nova-compute[75045]:     <partition>/machine</partition>
Nov 08 23:20:34 user nova-compute[75045]:   </resource>
Nov 08 23:20:34 user nova-compute[75045]:   <sysinfo type='smbios'>
Nov 08 23:20:34 user nova-compute[75045]:     <system>
Nov 08 23:20:34 user nova-compute[75045]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 08 23:20:34 user nova-compute[75045]:       <entry name='product'>OpenStack Nova</entry>
Nov 08 23:20:34 user nova-compute[75045]:       <entry name='version'>0.0.0</entry>
Nov 08 23:20:34 user nova-compute[75045]:       <entry name='serial'>1cb1b440-0073-4a53-a0a2-e2781e021866</entry>
Nov 08 23:20:34 user nova-compute[75045]:       <entry name='uuid'>1cb1b440-0073-4a53-a0a2-e2781e021866</entry>
Nov 08 23:20:34 user nova-compute[75045]:       <entry name='family'>Virtual Machine</entry>
Nov 08 23:20:34 user nova-compute[75045]:     </system>
Nov 08 23:20:34 user nova-compute[75045]:   </sysinfo>
Nov 08 23:20:34 user nova-compute[75045]:   <os>
Nov 08 23:20:34 user nova-compute[75045]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 08 23:20:34 user nova-compute[75045]:     <boot dev='hd'/>
Nov 08 23:20:34 user nova-compute[75045]:     <smbios mode='sysinfo'/>
Nov 08 23:20:34 user nova-compute[75045]:   </os>
Nov 08 23:20:34 user nova-compute[75045]:   <features>
Nov 08 23:20:34 user nova-compute[75045]:     <acpi/>
Nov 08 23:20:34 user nova-compute[75045]:     <apic/>
Nov 08 23:20:34 user nova-compute[75045]:     <vmcoreinfo state='on'/>
Nov 08 23:20:34 user nova-compute[75045]:   </features>
Nov 08 23:20:34 user nova-compute[75045]:   <cpu mode='custom' match='exact' check='full'>
Nov 08 23:20:34 user nova-compute[75045]:     <model fallback='forbid'>Nehalem</model>
Nov 08 23:20:34 user nova-compute[75045]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 08 23:20:34 user nova-compute[75045]:     <feature policy='require' name='vme'/>
Nov 08 23:20:34 user nova-compute[75045]:     <feature policy='require' name='x2apic'/>
Nov 08 23:20:34 user nova-compute[75045]:     <feature policy='require' name='hypervisor'/>
Nov 08 23:20:34 user nova-compute[75045]:   </cpu>
Nov 08 23:20:34 user nova-compute[75045]:   <clock offset='utc'>
Nov 08 23:20:34 user nova-compute[75045]:     <timer name='pit' tickpolicy='delay'/>
Nov 08 23:20:34 user nova-compute[75045]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 08 23:20:34 user nova-compute[75045]:     <timer name='hpet' present='no'/>
Nov 08 23:20:34 user nova-compute[75045]:   </clock>
Nov 08 23:20:34 user nova-compute[75045]:   <on_poweroff>destroy</on_poweroff>
Nov 08 23:20:34 user nova-compute[75045]:   <on_reboot>restart</on_reboot>
Nov 08 23:20:34 user nova-compute[75045]:   <on_crash>destroy</on_crash>
Nov 08 23:20:34 user nova-compute[75045]:   <devices>
Nov 08 23:20:34 user nova-compute[75045]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 08 23:20:34 user nova-compute[75045]:     <disk type='file' device='disk'>
Nov 08 23:20:34 user nova-compute[75045]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 08 23:20:34 user nova-compute[75045]:       <source file='/opt/stack/data/nova/instances/1cb1b440-0073-4a53-a0a2-e2781e021866/disk' index='2'/>
Nov 08 23:20:34 user nova-compute[75045]:       <backingStore type='file' index='3'>
Nov 08 23:20:34 user nova-compute[75045]:         <format type='raw'/>
Nov 08 23:20:34 user nova-compute[75045]:         <source file='/opt/stack/data/nova/instances/_base/b59f52a99fff51c56dd1edfb83892fb8f647f2f3'/>
Nov 08 23:20:34 user nova-compute[75045]:         <backingStore/>
Nov 08 23:20:34 user nova-compute[75045]:       </backingStore>
Nov 08 23:20:34 user nova-compute[75045]:       <target dev='vda' bus='virtio'/>
Nov 08 23:20:34 user nova-compute[75045]:       <alias name='virtio-disk0'/>
Nov 08 23:20:34 user nova-compute[75045]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 08 23:20:34 user nova-compute[75045]:     </disk>
Nov 08 23:20:34 user nova-compute[75045]:     <disk type='file' device='cdrom'>
Nov 08 23:20:34 user nova-compute[75045]:       <driver name='qemu' type='raw' cache='none'/>
Nov 08 23:20:34 user nova-compute[75045]:       <source file='/opt/stack/data/nova/instances/1cb1b440-0073-4a53-a0a2-e2781e021866/disk.config' index='1'/>
Nov 08 23:20:34 user nova-compute[75045]:       <backingStore/>
Nov 08 23:20:34 user nova-compute[75045]:       <target dev='hda' bus='ide'/>
Nov 08 23:20:34 user nova-compute[75045]:       <readonly/>
Nov 08 23:20:34 user nova-compute[75045]:       <alias name='ide0-0-0'/>
Nov 08 23:20:34 user nova-compute[75045]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 08 23:20:34 user nova-compute[75045]:     </disk>
Nov 08 23:20:34 user nova-compute[75045]:     <controller type='usb' index='0' model='none'>
Nov 08 23:20:34 user nova-compute[75045]:       <alias name='usb'/>
Nov 08 23:20:34 user nova-compute[75045]:     </controller>
Nov 08 23:20:34 user nova-compute[75045]:     <controller type='pci' index='0' model='pci-root'>
Nov 08 23:20:34 user nova-compute[75045]:       <alias name='pci.0'/>
Nov 08 23:20:34 user nova-compute[75045]:     </controller>
Nov 08 23:20:34 user nova-compute[75045]:     <controller type='ide' index='0'>
Nov 08 23:20:34 user nova-compute[75045]:       <alias name='ide'/>
Nov 08 23:20:34 user nova-compute[75045]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 08 23:20:34 user nova-compute[75045]:     </controller>
Nov 08 23:20:34 user nova-compute[75045]:     <interface type='ethernet'>
Nov 08 23:20:34 user nova-compute[75045]:       <mac address='fa:16:3e:e4:4d:f8'/>
Nov 08 23:20:34 user nova-compute[75045]:       <target dev='tap892284f7-b4'/>
Nov 08 23:20:34 user nova-compute[75045]:       <model type='virtio'/>
Nov 08 23:20:34 user nova-compute[75045]:       <mtu size='1442'/>
Nov 08 23:20:34 user nova-compute[75045]:       <alias name='net0'/>
Nov 08 23:20:34 user nova-compute[75045]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 08 23:20:34 user nova-compute[75045]:     </interface>
Nov 08 23:20:34 user nova-compute[75045]:     <serial type='pty'>
Nov 08 23:20:34 user nova-compute[75045]:       <source path='/dev/pts/4'/>
Nov 08 23:20:34 user nova-compute[75045]:       <log file='/opt/stack/data/nova/instances/1cb1b440-0073-4a53-a0a2-e2781e021866/console.log' append='off'/>
Nov 08 23:20:34 user nova-compute[75045]:       <target type='isa-serial' port='0'>
Nov 08 23:20:34 user nova-compute[75045]:         <model name='isa-serial'/>
Nov 08 23:20:34 user nova-compute[75045]:       </target>
Nov 08 23:20:34 user nova-compute[75045]:       <alias name='serial0'/>
Nov 08 23:20:34 user nova-compute[75045]:     </serial>
Nov 08 23:20:34 user nova-compute[75045]:     <console type='pty' tty='/dev/pts/4'>
Nov 08 23:20:34 user nova-compute[75045]:       <source path='/dev/pts/4'/>
Nov 08 23:20:34 user nova-compute[75045]:       <log file='/opt/stack/data/nova/instances/1cb1b440-0073-4a53-a0a2-e2781e021866/console.log' append='off'/>
Nov 08 23:20:34 user nova-compute[75045]:       <target type='serial' port='0'/>
Nov 08 23:20:34 user nova-compute[75045]:       <alias name='serial0'/>
Nov 08 23:20:34 user nova-compute[75045]:     </console>
Nov 08 23:20:34 user nova-compute[75045]:     <input type='mouse' bus='ps2'>
Nov 08 23:20:34 user nova-compute[75045]:       <alias name='input0'/>
Nov 08 23:20:34 user nova-compute[75045]:     </input>
Nov 08 23:20:34 user nova-compute[75045]:     <input type='keyboard' bus='ps2'>
Nov 08 23:20:34 user nova-compute[75045]:       <alias name='input1'/>
Nov 08 23:20:34 user nova-compute[75045]:     </input>
Nov 08 23:20:34 user nova-compute[75045]:     <graphics type='vnc' port='5904' autoport='yes' listen='0.0.0.0'>
Nov 08 23:20:34 user nova-compute[75045]:       <listen type='address' address='0.0.0.0'/>
Nov 08 23:20:34 user nova-compute[75045]:     </graphics>
Nov 08 23:20:34 user nova-compute[75045]:     <audio id='1' type='none'/>
Nov 08 23:20:34 user nova-compute[75045]:     <video>
Nov 08 23:20:34 user nova-compute[75045]:       <model type='virtio' heads='1' primary='yes'/>
Nov 08 23:20:34 user nova-compute[75045]:       <alias name='video0'/>
Nov 08 23:20:34 user nova-compute[75045]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 08 23:20:34 user nova-compute[75045]:     </video>
Nov 08 23:20:34 user nova-compute[75045]:     <memballoon model='virtio'>
Nov 08 23:20:34 user nova-compute[75045]:       <stats period='10'/>
Nov 08 23:20:34 user nova-compute[75045]:       <alias name='balloon0'/>
Nov 08 23:20:34 user nova-compute[75045]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 08 23:20:34 user nova-compute[75045]:     </memballoon>
Nov 08 23:20:34 user nova-compute[75045]:     <rng model='virtio'>
Nov 08 23:20:34 user nova-compute[75045]:       <backend model='random'>/dev/urandom</backend>
Nov 08 23:20:34 user nova-compute[75045]:       <alias name='rng0'/>
Nov 08 23:20:34 user nova-compute[75045]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 08 23:20:34 user nova-compute[75045]:     </rng>
Nov 08 23:20:34 user nova-compute[75045]:   </devices>
Nov 08 23:20:34 user nova-compute[75045]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 08 23:20:34 user nova-compute[75045]:     <label>libvirt-1cb1b440-0073-4a53-a0a2-e2781e021866</label>
Nov 08 23:20:34 user nova-compute[75045]:     <imagelabel>libvirt-1cb1b440-0073-4a53-a0a2-e2781e021866</imagelabel>
Nov 08 23:20:34 user nova-compute[75045]:   </seclabel>
Nov 08 23:20:34 user nova-compute[75045]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 08 23:20:34 user nova-compute[75045]:     <label>+64055:+108</label>
Nov 08 23:20:34 user nova-compute[75045]:     <imagelabel>+64055:+108</imagelabel>
Nov 08 23:20:34 user nova-compute[75045]:   </seclabel>
Nov 08 23:20:34 user nova-compute[75045]: </domain>
Nov 08 23:20:34 user nova-compute[75045]:  {{(pid=75045) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 08 23:20:34 user nova-compute[75045]: WARNING nova.virt.libvirt.driver [req-1f32e34f-094f-47b8-b714-ed86e6c2877e req-6c0c7758-2418-4628-b480-c215fd421a62 service nova] [instance: 1cb1b440-0073-4a53-a0a2-e2781e021866] Detaching interface fa:16:3e:9e:7d:b7 failed because the device is no longer found on the guest.: nova.exception.DeviceNotFound: Device 'tap2baf0a88-fd' not found.
Nov 08 23:20:34 user nova-compute[75045]: DEBUG nova.virt.libvirt.vif [req-1f32e34f-094f-47b8-b714-ed86e6c2877e req-6c0c7758-2418-4628-b480-c215fd421a62 service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T23:16:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1008670319',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1008670319',id=5,image_ref='a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJHwrx1BGWhjjUX4+Byh1wjqwerHxYEs1Bi9i8sP+n0orNMkrqYiTdsqsEt8sTDzFkc1LBM09NOYtbQKa/c7KjqeCNDDUOdBi8LqOWMDeLuYXRRZIoptz+6bpxuTCZMmXg==',key_name='tempest-keypair-1418515873',keypairs=<?>,launch_index=0,launched_at=2023-11-08T23:16:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bb18f0af92ec4de6a1fddb6c77ea030d',ramdisk_id='',reservation_id='r-15oytm0c',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1639503389',owner_user_name='tempest-TaggedAttachmentsTest-1639503389-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T23:16:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0c8d9cc387dc45d18ad1550ef6d3cfa9',uuid=1cb1b440-0073-4a53-a0a2-e2781e021866,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2baf0a88-fd3e-45ae-95f8-9d568be4211b", "address": "fa:16:3e:9e:7d:b7", "network": {"id": "3ffe4edb-8137-442f-9c3e-231775c7527c", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1585434856", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.184", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "bb18f0af92ec4de6a1fddb6c77ea030d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2baf0a88-fd", "ovs_interfaceid": "2baf0a88-fd3e-45ae-95f8-9d568be4211b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75045) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 23:20:34 user nova-compute[75045]: DEBUG nova.network.os_vif_util [req-1f32e34f-094f-47b8-b714-ed86e6c2877e req-6c0c7758-2418-4628-b480-c215fd421a62 service nova] Converting VIF {"id": "2baf0a88-fd3e-45ae-95f8-9d568be4211b", "address": "fa:16:3e:9e:7d:b7", "network": {"id": "3ffe4edb-8137-442f-9c3e-231775c7527c", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1585434856", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.184", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "bb18f0af92ec4de6a1fddb6c77ea030d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2baf0a88-fd", "ovs_interfaceid": "2baf0a88-fd3e-45ae-95f8-9d568be4211b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 23:20:34 user nova-compute[75045]: DEBUG nova.network.os_vif_util [req-1f32e34f-094f-47b8-b714-ed86e6c2877e req-6c0c7758-2418-4628-b480-c215fd421a62 service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9e:7d:b7,bridge_name='br-int',has_traffic_filtering=True,id=2baf0a88-fd3e-45ae-95f8-9d568be4211b,network=Network(3ffe4edb-8137-442f-9c3e-231775c7527c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2baf0a88-fd') {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 23:20:34 user nova-compute[75045]: DEBUG os_vif [req-1f32e34f-094f-47b8-b714-ed86e6c2877e req-6c0c7758-2418-4628-b480-c215fd421a62 service nova] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9e:7d:b7,bridge_name='br-int',has_traffic_filtering=True,id=2baf0a88-fd3e-45ae-95f8-9d568be4211b,network=Network(3ffe4edb-8137-442f-9c3e-231775c7527c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2baf0a88-fd') {{(pid=75045) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 23:20:34 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:20:34 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2baf0a88-fd, bridge=br-int, if_exists=True) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:20:34 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 23:20:34 user nova-compute[75045]: INFO os_vif [req-1f32e34f-094f-47b8-b714-ed86e6c2877e req-6c0c7758-2418-4628-b480-c215fd421a62 service nova] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9e:7d:b7,bridge_name='br-int',has_traffic_filtering=True,id=2baf0a88-fd3e-45ae-95f8-9d568be4211b,network=Network(3ffe4edb-8137-442f-9c3e-231775c7527c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2baf0a88-fd')
Nov 08 23:20:34 user nova-compute[75045]: DEBUG nova.virt.libvirt.guest [req-1f32e34f-094f-47b8-b714-ed86e6c2877e req-6c0c7758-2418-4628-b480-c215fd421a62 service nova] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 23:20:34 user nova-compute[75045]:   <nova:package version="0.0.0"/>
Nov 08 23:20:34 user nova-compute[75045]:   <nova:name>tempest-device-tagging-server-1008670319</nova:name>
Nov 08 23:20:34 user nova-compute[75045]:   <nova:creationTime>2023-11-08 23:20:34</nova:creationTime>
Nov 08 23:20:34 user nova-compute[75045]:   <nova:flavor name="m1.tiny">
Nov 08 23:20:34 user nova-compute[75045]:     <nova:memory>512</nova:memory>
Nov 08 23:20:34 user nova-compute[75045]:     <nova:disk>1</nova:disk>
Nov 08 23:20:34 user nova-compute[75045]:     <nova:swap>0</nova:swap>
Nov 08 23:20:34 user nova-compute[75045]:     <nova:ephemeral>0</nova:ephemeral>
Nov 08 23:20:34 user nova-compute[75045]:     <nova:vcpus>1</nova:vcpus>
Nov 08 23:20:34 user nova-compute[75045]:   </nova:flavor>
Nov 08 23:20:34 user nova-compute[75045]:   <nova:owner>
Nov 08 23:20:34 user nova-compute[75045]:     <nova:user uuid="0c8d9cc387dc45d18ad1550ef6d3cfa9">tempest-TaggedAttachmentsTest-1639503389-project-member</nova:user>
Nov 08 23:20:34 user nova-compute[75045]:     <nova:project uuid="bb18f0af92ec4de6a1fddb6c77ea030d">tempest-TaggedAttachmentsTest-1639503389</nova:project>
Nov 08 23:20:34 user nova-compute[75045]:   </nova:owner>
Nov 08 23:20:34 user nova-compute[75045]:   <nova:root type="image" uuid="a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb"/>
Nov 08 23:20:34 user nova-compute[75045]:   <nova:ports>
Nov 08 23:20:34 user nova-compute[75045]:     <nova:port uuid="892284f7-b4b9-4b5b-82c7-62300cd8afb7">
Nov 08 23:20:34 user nova-compute[75045]:       <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 08 23:20:34 user nova-compute[75045]:     </nova:port>
Nov 08 23:20:34 user nova-compute[75045]:   </nova:ports>
Nov 08 23:20:34 user nova-compute[75045]: </nova:instance>
Nov 08 23:20:34 user nova-compute[75045]:  {{(pid=75045) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Nov 08 23:20:34 user nova-compute[75045]: DEBUG nova.network.neutron [None req-9d241a0b-bc72-4ed6-b08b-000d3a80e474 tempest-TaggedAttachmentsTest-1639503389 tempest-TaggedAttachmentsTest-1639503389-project-member] [instance: 1cb1b440-0073-4a53-a0a2-e2781e021866] Updating instance_info_cache with network_info: [{"id": "892284f7-b4b9-4b5b-82c7-62300cd8afb7", "address": "fa:16:3e:e4:4d:f8", "network": {"id": "fa6f2c92-825d-46c6-a0ea-51f96da244cb", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-193868289-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.235", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb18f0af92ec4de6a1fddb6c77ea030d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap892284f7-b4", "ovs_interfaceid": "892284f7-b4b9-4b5b-82c7-62300cd8afb7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75045) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 23:20:34 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-9d241a0b-bc72-4ed6-b08b-000d3a80e474 tempest-TaggedAttachmentsTest-1639503389 tempest-TaggedAttachmentsTest-1639503389-project-member] Releasing lock "refresh_cache-1cb1b440-0073-4a53-a0a2-e2781e021866" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 23:20:34 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-9d241a0b-bc72-4ed6-b08b-000d3a80e474 tempest-TaggedAttachmentsTest-1639503389 tempest-TaggedAttachmentsTest-1639503389-project-member] Lock "interface-1cb1b440-0073-4a53-a0a2-e2781e021866-2baf0a88-fd3e-45ae-95f8-9d568be4211b" "released" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: held 21.875s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:20:34 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:20:34 user nova-compute[75045]: DEBUG nova.compute.manager [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Starting heal instance info cache {{(pid=75045) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 23:20:35 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Acquiring lock "refresh_cache-1cb1b440-0073-4a53-a0a2-e2781e021866" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 23:20:35 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Acquired lock "refresh_cache-1cb1b440-0073-4a53-a0a2-e2781e021866" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 23:20:35 user nova-compute[75045]: DEBUG nova.network.neutron [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] [instance: 1cb1b440-0073-4a53-a0a2-e2781e021866] Forcefully refreshing network info cache for instance {{(pid=75045) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 23:20:35 user nova-compute[75045]: DEBUG nova.network.neutron [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] [instance: 1cb1b440-0073-4a53-a0a2-e2781e021866] Updating instance_info_cache with network_info: [{"id": "892284f7-b4b9-4b5b-82c7-62300cd8afb7", "address": "fa:16:3e:e4:4d:f8", "network": {"id": "fa6f2c92-825d-46c6-a0ea-51f96da244cb", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-193868289-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.235", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb18f0af92ec4de6a1fddb6c77ea030d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap892284f7-b4", "ovs_interfaceid": "892284f7-b4b9-4b5b-82c7-62300cd8afb7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75045) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 23:20:35 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Releasing lock "refresh_cache-1cb1b440-0073-4a53-a0a2-e2781e021866" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 23:20:35 user nova-compute[75045]: DEBUG nova.compute.manager [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] [instance: 1cb1b440-0073-4a53-a0a2-e2781e021866] Updated the network info_cache for instance {{(pid=75045) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 23:20:35 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager.update_available_resource {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:20:35 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:20:35 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.002s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:20:35 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:20:35 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Auditing locally available compute resources for user (node: user) {{(pid=75045) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 23:20:35 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82bc5fd0-26c7-4f81-b966-54831393b617/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:20:36 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82bc5fd0-26c7-4f81-b966-54831393b617/disk --force-share --output=json" returned: 0 in 0.355s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:20:36 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82bc5fd0-26c7-4f81-b966-54831393b617/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:20:36 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82bc5fd0-26c7-4f81-b966-54831393b617/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:20:36 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ae5ff6b-6f2c-4dfd-a4c6-da4809e2cf27/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:20:36 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ae5ff6b-6f2c-4dfd-a4c6-da4809e2cf27/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:20:36 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ae5ff6b-6f2c-4dfd-a4c6-da4809e2cf27/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:20:36 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ae5ff6b-6f2c-4dfd-a4c6-da4809e2cf27/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:20:36 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] skipping disk /dev/sdh (vda) as it is a volume {{(pid=75045) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 23:20:36 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1cb1b440-0073-4a53-a0a2-e2781e021866/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:20:36 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1cb1b440-0073-4a53-a0a2-e2781e021866/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:20:36 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1cb1b440-0073-4a53-a0a2-e2781e021866/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:20:37 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1cb1b440-0073-4a53-a0a2-e2781e021866/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:20:37 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f21fcd3-ac5f-499e-9c34-82af806fda1d/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:20:37 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f21fcd3-ac5f-499e-9c34-82af806fda1d/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:20:37 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f21fcd3-ac5f-499e-9c34-82af806fda1d/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:20:37 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f21fcd3-ac5f-499e-9c34-82af806fda1d/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:20:37 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07ec2c05-aaa9-46e8-8439-7aa5b9fca19d/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:20:37 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07ec2c05-aaa9-46e8-8439-7aa5b9fca19d/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:20:37 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07ec2c05-aaa9-46e8-8439-7aa5b9fca19d/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:20:37 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07ec2c05-aaa9-46e8-8439-7aa5b9fca19d/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:20:37 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fde91f7c-31e3-456c-b252-6ce37fa3b600/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:20:38 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fde91f7c-31e3-456c-b252-6ce37fa3b600/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:20:38 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fde91f7c-31e3-456c-b252-6ce37fa3b600/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:20:38 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fde91f7c-31e3-456c-b252-6ce37fa3b600/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:20:38 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] skipping disk /dev/sdi (vdb) as it is a volume {{(pid=75045) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 23:20:38 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/032e20aa-8887-4215-808e-68299a0d8d0b/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:20:38 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:20:38 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/032e20aa-8887-4215-808e-68299a0d8d0b/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:20:38 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/032e20aa-8887-4215-808e-68299a0d8d0b/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:20:38 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/032e20aa-8887-4215-808e-68299a0d8d0b/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:20:38 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75045) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 23:20:38 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75045) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 23:20:38 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] skipping disk /dev/sdg (vdc) as it is a volume {{(pid=75045) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 23:20:38 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0de15211-d094-479a-86ce-292389441fa8/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:20:38 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0de15211-d094-479a-86ce-292389441fa8/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:20:38 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0de15211-d094-479a-86ce-292389441fa8/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:20:39 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0de15211-d094-479a-86ce-292389441fa8/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:20:39 user nova-compute[75045]: WARNING nova.virt.libvirt.driver [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 23:20:39 user nova-compute[75045]: WARNING nova.virt.libvirt.driver [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 23:20:39 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Hypervisor/Node resource view: name=user free_ram=7571MB free_disk=25.430160522460938GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75045) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 23:20:39 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:20:39 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:20:39 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Instance 4ae5ff6b-6f2c-4dfd-a4c6-da4809e2cf27 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75045) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 23:20:39 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Instance 0f21fcd3-ac5f-499e-9c34-82af806fda1d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75045) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 23:20:39 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Instance 1cb1b440-0073-4a53-a0a2-e2781e021866 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75045) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 23:20:39 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Instance fde91f7c-31e3-456c-b252-6ce37fa3b600 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75045) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 23:20:39 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Instance 07ec2c05-aaa9-46e8-8439-7aa5b9fca19d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75045) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 23:20:39 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Instance 82bc5fd0-26c7-4f81-b966-54831393b617 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75045) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 23:20:39 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Instance 520eac4f-fa48-4e41-924d-840907e701b4 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75045) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 23:20:39 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Instance d2c911cf-d5f4-4c19-8335-8c7834184a7e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75045) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 23:20:39 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Instance 0de15211-d094-479a-86ce-292389441fa8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75045) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 23:20:39 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Instance 032e20aa-8887-4215-808e-68299a0d8d0b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75045) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 23:20:39 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=75045) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 23:20:39 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=75045) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 23:20:39 user nova-compute[75045]: DEBUG nova.compute.provider_tree [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Inventory has not changed in ProviderTree for provider: 62ba5f85-c74d-4b58-986e-d4197e813fd7 {{(pid=75045) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 23:20:39 user nova-compute[75045]: DEBUG nova.scheduler.client.report [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Inventory has not changed for provider 62ba5f85-c74d-4b58-986e-d4197e813fd7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75045) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 23:20:40 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Compute_service record updated for user:user {{(pid=75045) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 23:20:40 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.548s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:20:40 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:20:40 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:20:40 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:20:40 user nova-compute[75045]: DEBUG nova.compute.manager [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75045) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 23:20:42 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-c7c3a7c8-f6fd-4d2d-8de6-84c5d136f20b tempest-VolumesAssistedSnapshotsTest-1158723798 tempest-VolumesAssistedSnapshotsTest-1158723798-project-member] Acquiring lock "07ec2c05-aaa9-46e8-8439-7aa5b9fca19d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:20:42 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-c7c3a7c8-f6fd-4d2d-8de6-84c5d136f20b tempest-VolumesAssistedSnapshotsTest-1158723798 tempest-VolumesAssistedSnapshotsTest-1158723798-project-member] Lock "07ec2c05-aaa9-46e8-8439-7aa5b9fca19d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:20:42 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-c7c3a7c8-f6fd-4d2d-8de6-84c5d136f20b tempest-VolumesAssistedSnapshotsTest-1158723798 tempest-VolumesAssistedSnapshotsTest-1158723798-project-member] Acquiring lock "07ec2c05-aaa9-46e8-8439-7aa5b9fca19d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:20:42 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-c7c3a7c8-f6fd-4d2d-8de6-84c5d136f20b tempest-VolumesAssistedSnapshotsTest-1158723798 tempest-VolumesAssistedSnapshotsTest-1158723798-project-member] Lock "07ec2c05-aaa9-46e8-8439-7aa5b9fca19d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:20:42 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-c7c3a7c8-f6fd-4d2d-8de6-84c5d136f20b tempest-VolumesAssistedSnapshotsTest-1158723798 tempest-VolumesAssistedSnapshotsTest-1158723798-project-member] Lock "07ec2c05-aaa9-46e8-8439-7aa5b9fca19d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:20:42 user nova-compute[75045]: INFO nova.compute.manager [None req-c7c3a7c8-f6fd-4d2d-8de6-84c5d136f20b tempest-VolumesAssistedSnapshotsTest-1158723798 tempest-VolumesAssistedSnapshotsTest-1158723798-project-member] [instance: 07ec2c05-aaa9-46e8-8439-7aa5b9fca19d] Terminating instance
Nov 08 23:20:42 user nova-compute[75045]: DEBUG nova.compute.manager [None req-c7c3a7c8-f6fd-4d2d-8de6-84c5d136f20b tempest-VolumesAssistedSnapshotsTest-1158723798 tempest-VolumesAssistedSnapshotsTest-1158723798-project-member] [instance: 07ec2c05-aaa9-46e8-8439-7aa5b9fca19d] Start destroying the instance on the hypervisor. {{(pid=75045) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 23:20:42 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:20:42 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:20:42 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:20:42 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:20:42 user nova-compute[75045]: DEBUG nova.compute.manager [req-efa1f1de-c340-4bfe-9805-0d2187c2d91e req-d23d4959-4e8d-41f9-ad33-a511bcc1f96a service nova] [instance: 07ec2c05-aaa9-46e8-8439-7aa5b9fca19d] Received event network-vif-unplugged-11c9f384-694c-41fc-b8b3-2db1d15ea84c {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:20:42 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-efa1f1de-c340-4bfe-9805-0d2187c2d91e req-d23d4959-4e8d-41f9-ad33-a511bcc1f96a service nova] Acquiring lock "07ec2c05-aaa9-46e8-8439-7aa5b9fca19d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:20:42 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-efa1f1de-c340-4bfe-9805-0d2187c2d91e req-d23d4959-4e8d-41f9-ad33-a511bcc1f96a service nova] Lock "07ec2c05-aaa9-46e8-8439-7aa5b9fca19d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:20:42 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-efa1f1de-c340-4bfe-9805-0d2187c2d91e req-d23d4959-4e8d-41f9-ad33-a511bcc1f96a service nova] Lock "07ec2c05-aaa9-46e8-8439-7aa5b9fca19d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:20:42 user nova-compute[75045]: DEBUG nova.compute.manager [req-efa1f1de-c340-4bfe-9805-0d2187c2d91e req-d23d4959-4e8d-41f9-ad33-a511bcc1f96a service nova] [instance: 07ec2c05-aaa9-46e8-8439-7aa5b9fca19d] No waiting events found dispatching network-vif-unplugged-11c9f384-694c-41fc-b8b3-2db1d15ea84c {{(pid=75045) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 23:20:42 user nova-compute[75045]: DEBUG nova.compute.manager [req-efa1f1de-c340-4bfe-9805-0d2187c2d91e req-d23d4959-4e8d-41f9-ad33-a511bcc1f96a service nova] [instance: 07ec2c05-aaa9-46e8-8439-7aa5b9fca19d] Received event network-vif-unplugged-11c9f384-694c-41fc-b8b3-2db1d15ea84c for instance with task_state deleting. {{(pid=75045) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 23:20:43 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:20:43 user nova-compute[75045]: INFO nova.virt.libvirt.driver [-] [instance: 07ec2c05-aaa9-46e8-8439-7aa5b9fca19d] Instance destroyed successfully.
Nov 08 23:20:43 user nova-compute[75045]: DEBUG nova.objects.instance [None req-c7c3a7c8-f6fd-4d2d-8de6-84c5d136f20b tempest-VolumesAssistedSnapshotsTest-1158723798 tempest-VolumesAssistedSnapshotsTest-1158723798-project-member] Lazy-loading 'resources' on Instance uuid 07ec2c05-aaa9-46e8-8439-7aa5b9fca19d {{(pid=75045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 23:20:43 user nova-compute[75045]: DEBUG nova.virt.libvirt.vif [None req-c7c3a7c8-f6fd-4d2d-8de6-84c5d136f20b tempest-VolumesAssistedSnapshotsTest-1158723798 tempest-VolumesAssistedSnapshotsTest-1158723798-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T23:16:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-1746570331',display_name='tempest-VolumesAssistedSnapshotsTest-server-1746570331',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-1746570331',id=7,image_ref='a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMO+3rq+jd4dmTq/9fmMHTiEHe/EZDy55SNQ64pIFNsX69QCGFUEeJ0O+ELkMFRNoagvq20aUr1XhXUmotm4AMikPZwkMYAH+2+ja0MMjrIMlvdpd4dYwJ56c1cHeiFNhw==',key_name='tempest-keypair-1517163596',keypairs=<?>,launch_index=0,launched_at=2023-11-08T23:16:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='07fac94bac644b72801b207a378f34ac',ramdisk_id='',reservation_id='r-f2hec4rt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAssistedSnapshotsTest-1158723798',owner_user_name='tempest-VolumesAssistedSnapshotsTest-1158723798-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T23:16:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c45f30733b674d33ba6d18f50ac2ad0a',uuid=07ec2c05-aaa9-46e8-8439-7aa5b9fca19d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "11c9f384-694c-41fc-b8b3-2db1d15ea84c", "address": "fa:16:3e:22:d3:3d", "network": {"id": "c7d78679-f4e4-4060-86d0-ec146a216818", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-315788385-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.207", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07fac94bac644b72801b207a378f34ac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11c9f384-69", "ovs_interfaceid": "11c9f384-694c-41fc-b8b3-2db1d15ea84c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75045) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 23:20:43 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-c7c3a7c8-f6fd-4d2d-8de6-84c5d136f20b tempest-VolumesAssistedSnapshotsTest-1158723798 tempest-VolumesAssistedSnapshotsTest-1158723798-project-member] Converting VIF {"id": "11c9f384-694c-41fc-b8b3-2db1d15ea84c", "address": "fa:16:3e:22:d3:3d", "network": {"id": "c7d78679-f4e4-4060-86d0-ec146a216818", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-315788385-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.207", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07fac94bac644b72801b207a378f34ac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11c9f384-69", "ovs_interfaceid": "11c9f384-694c-41fc-b8b3-2db1d15ea84c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 23:20:43 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-c7c3a7c8-f6fd-4d2d-8de6-84c5d136f20b tempest-VolumesAssistedSnapshotsTest-1158723798 tempest-VolumesAssistedSnapshotsTest-1158723798-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:22:d3:3d,bridge_name='br-int',has_traffic_filtering=True,id=11c9f384-694c-41fc-b8b3-2db1d15ea84c,network=Network(c7d78679-f4e4-4060-86d0-ec146a216818),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap11c9f384-69') {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 23:20:43 user nova-compute[75045]: DEBUG os_vif [None req-c7c3a7c8-f6fd-4d2d-8de6-84c5d136f20b tempest-VolumesAssistedSnapshotsTest-1158723798 tempest-VolumesAssistedSnapshotsTest-1158723798-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:22:d3:3d,bridge_name='br-int',has_traffic_filtering=True,id=11c9f384-694c-41fc-b8b3-2db1d15ea84c,network=Network(c7d78679-f4e4-4060-86d0-ec146a216818),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap11c9f384-69') {{(pid=75045) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 23:20:43 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:20:43 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap11c9f384-69, bridge=br-int, if_exists=True) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:20:43 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:20:43 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:20:43 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:20:43 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=28c0ff58-5bcb-4c55-80dc-13400db9be3c) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:20:43 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:20:43 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 23:20:43 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:20:43 user nova-compute[75045]: INFO os_vif [None req-c7c3a7c8-f6fd-4d2d-8de6-84c5d136f20b tempest-VolumesAssistedSnapshotsTest-1158723798 tempest-VolumesAssistedSnapshotsTest-1158723798-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:22:d3:3d,bridge_name='br-int',has_traffic_filtering=True,id=11c9f384-694c-41fc-b8b3-2db1d15ea84c,network=Network(c7d78679-f4e4-4060-86d0-ec146a216818),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap11c9f384-69')
Nov 08 23:20:43 user nova-compute[75045]: INFO nova.virt.libvirt.driver [None req-c7c3a7c8-f6fd-4d2d-8de6-84c5d136f20b tempest-VolumesAssistedSnapshotsTest-1158723798 tempest-VolumesAssistedSnapshotsTest-1158723798-project-member] [instance: 07ec2c05-aaa9-46e8-8439-7aa5b9fca19d] Deleting instance files /opt/stack/data/nova/instances/07ec2c05-aaa9-46e8-8439-7aa5b9fca19d_del
Nov 08 23:20:43 user nova-compute[75045]: INFO nova.virt.libvirt.driver [None req-c7c3a7c8-f6fd-4d2d-8de6-84c5d136f20b tempest-VolumesAssistedSnapshotsTest-1158723798 tempest-VolumesAssistedSnapshotsTest-1158723798-project-member] [instance: 07ec2c05-aaa9-46e8-8439-7aa5b9fca19d] Deletion of /opt/stack/data/nova/instances/07ec2c05-aaa9-46e8-8439-7aa5b9fca19d_del complete
Nov 08 23:20:43 user nova-compute[75045]: INFO nova.compute.manager [None req-c7c3a7c8-f6fd-4d2d-8de6-84c5d136f20b tempest-VolumesAssistedSnapshotsTest-1158723798 tempest-VolumesAssistedSnapshotsTest-1158723798-project-member] [instance: 07ec2c05-aaa9-46e8-8439-7aa5b9fca19d] Took 0.97 seconds to destroy the instance on the hypervisor.
Nov 08 23:20:43 user nova-compute[75045]: DEBUG oslo.service.loopingcall [None req-c7c3a7c8-f6fd-4d2d-8de6-84c5d136f20b tempest-VolumesAssistedSnapshotsTest-1158723798 tempest-VolumesAssistedSnapshotsTest-1158723798-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75045) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 23:20:43 user nova-compute[75045]: DEBUG nova.compute.manager [-] [instance: 07ec2c05-aaa9-46e8-8439-7aa5b9fca19d] Deallocating network for instance {{(pid=75045) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 23:20:43 user nova-compute[75045]: DEBUG nova.network.neutron [-] [instance: 07ec2c05-aaa9-46e8-8439-7aa5b9fca19d] deallocate_for_instance() {{(pid=75045) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 23:20:44 user nova-compute[75045]: DEBUG nova.network.neutron [-] [instance: 07ec2c05-aaa9-46e8-8439-7aa5b9fca19d] Updating instance_info_cache with network_info: [] {{(pid=75045) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 23:20:44 user nova-compute[75045]: INFO nova.compute.manager [-] [instance: 07ec2c05-aaa9-46e8-8439-7aa5b9fca19d] Took 1.02 seconds to deallocate network for instance.
Nov 08 23:20:44 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-c7c3a7c8-f6fd-4d2d-8de6-84c5d136f20b tempest-VolumesAssistedSnapshotsTest-1158723798 tempest-VolumesAssistedSnapshotsTest-1158723798-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:20:44 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-c7c3a7c8-f6fd-4d2d-8de6-84c5d136f20b tempest-VolumesAssistedSnapshotsTest-1158723798 tempest-VolumesAssistedSnapshotsTest-1158723798-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:20:44 user nova-compute[75045]: DEBUG nova.compute.provider_tree [None req-c7c3a7c8-f6fd-4d2d-8de6-84c5d136f20b tempest-VolumesAssistedSnapshotsTest-1158723798 tempest-VolumesAssistedSnapshotsTest-1158723798-project-member] Inventory has not changed in ProviderTree for provider: 62ba5f85-c74d-4b58-986e-d4197e813fd7 {{(pid=75045) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 23:20:44 user nova-compute[75045]: DEBUG nova.scheduler.client.report [None req-c7c3a7c8-f6fd-4d2d-8de6-84c5d136f20b tempest-VolumesAssistedSnapshotsTest-1158723798 tempest-VolumesAssistedSnapshotsTest-1158723798-project-member] Inventory has not changed for provider 62ba5f85-c74d-4b58-986e-d4197e813fd7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75045) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 23:20:44 user nova-compute[75045]: DEBUG nova.compute.manager [req-c91084fe-fb74-4d85-bb7a-b022cf390870 req-bf4d66ae-9dcd-4f8d-88fe-11ae07eed01d service nova] [instance: 07ec2c05-aaa9-46e8-8439-7aa5b9fca19d] Received event network-vif-plugged-11c9f384-694c-41fc-b8b3-2db1d15ea84c {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:20:44 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-c91084fe-fb74-4d85-bb7a-b022cf390870 req-bf4d66ae-9dcd-4f8d-88fe-11ae07eed01d service nova] Acquiring lock "07ec2c05-aaa9-46e8-8439-7aa5b9fca19d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:20:44 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-c91084fe-fb74-4d85-bb7a-b022cf390870 req-bf4d66ae-9dcd-4f8d-88fe-11ae07eed01d service nova] Lock "07ec2c05-aaa9-46e8-8439-7aa5b9fca19d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:20:44 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-c91084fe-fb74-4d85-bb7a-b022cf390870 req-bf4d66ae-9dcd-4f8d-88fe-11ae07eed01d service nova] Lock "07ec2c05-aaa9-46e8-8439-7aa5b9fca19d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:20:44 user nova-compute[75045]: DEBUG nova.compute.manager [req-c91084fe-fb74-4d85-bb7a-b022cf390870 req-bf4d66ae-9dcd-4f8d-88fe-11ae07eed01d service nova] [instance: 07ec2c05-aaa9-46e8-8439-7aa5b9fca19d] No waiting events found dispatching network-vif-plugged-11c9f384-694c-41fc-b8b3-2db1d15ea84c {{(pid=75045) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 23:20:44 user nova-compute[75045]: WARNING nova.compute.manager [req-c91084fe-fb74-4d85-bb7a-b022cf390870 req-bf4d66ae-9dcd-4f8d-88fe-11ae07eed01d service nova] [instance: 07ec2c05-aaa9-46e8-8439-7aa5b9fca19d] Received unexpected event network-vif-plugged-11c9f384-694c-41fc-b8b3-2db1d15ea84c for instance with vm_state deleted and task_state None.
Nov 08 23:20:44 user nova-compute[75045]: DEBUG nova.compute.manager [req-c91084fe-fb74-4d85-bb7a-b022cf390870 req-bf4d66ae-9dcd-4f8d-88fe-11ae07eed01d service nova] [instance: 07ec2c05-aaa9-46e8-8439-7aa5b9fca19d] Received event network-vif-deleted-11c9f384-694c-41fc-b8b3-2db1d15ea84c {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:20:44 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-c7c3a7c8-f6fd-4d2d-8de6-84c5d136f20b tempest-VolumesAssistedSnapshotsTest-1158723798 tempest-VolumesAssistedSnapshotsTest-1158723798-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.347s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:20:45 user nova-compute[75045]: INFO nova.scheduler.client.report [None req-c7c3a7c8-f6fd-4d2d-8de6-84c5d136f20b tempest-VolumesAssistedSnapshotsTest-1158723798 tempest-VolumesAssistedSnapshotsTest-1158723798-project-member] Deleted allocations for instance 07ec2c05-aaa9-46e8-8439-7aa5b9fca19d
Nov 08 23:20:45 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-c7c3a7c8-f6fd-4d2d-8de6-84c5d136f20b tempest-VolumesAssistedSnapshotsTest-1158723798 tempest-VolumesAssistedSnapshotsTest-1158723798-project-member] Lock "07ec2c05-aaa9-46e8-8439-7aa5b9fca19d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.575s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:20:48 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:20:48 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-7b81baed-26d9-4dbd-9368-924c19b62d45 tempest-VolumesActionsTest-1040491269 tempest-VolumesActionsTest-1040491269-project-member] Acquiring lock "0de15211-d094-479a-86ce-292389441fa8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:20:48 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-7b81baed-26d9-4dbd-9368-924c19b62d45 tempest-VolumesActionsTest-1040491269 tempest-VolumesActionsTest-1040491269-project-member] Lock "0de15211-d094-479a-86ce-292389441fa8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:20:48 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-7b81baed-26d9-4dbd-9368-924c19b62d45 tempest-VolumesActionsTest-1040491269 tempest-VolumesActionsTest-1040491269-project-member] Acquiring lock "0de15211-d094-479a-86ce-292389441fa8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:20:48 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-7b81baed-26d9-4dbd-9368-924c19b62d45 tempest-VolumesActionsTest-1040491269 tempest-VolumesActionsTest-1040491269-project-member] Lock "0de15211-d094-479a-86ce-292389441fa8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:20:48 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-7b81baed-26d9-4dbd-9368-924c19b62d45 tempest-VolumesActionsTest-1040491269 tempest-VolumesActionsTest-1040491269-project-member] Lock "0de15211-d094-479a-86ce-292389441fa8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:20:48 user nova-compute[75045]: INFO nova.compute.manager [None req-7b81baed-26d9-4dbd-9368-924c19b62d45 tempest-VolumesActionsTest-1040491269 tempest-VolumesActionsTest-1040491269-project-member] [instance: 0de15211-d094-479a-86ce-292389441fa8] Terminating instance
Nov 08 23:20:48 user nova-compute[75045]: DEBUG nova.compute.manager [None req-7b81baed-26d9-4dbd-9368-924c19b62d45 tempest-VolumesActionsTest-1040491269 tempest-VolumesActionsTest-1040491269-project-member] [instance: 0de15211-d094-479a-86ce-292389441fa8] Start destroying the instance on the hypervisor. {{(pid=75045) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 23:20:49 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:20:49 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:20:49 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:20:49 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:20:49 user nova-compute[75045]: DEBUG nova.compute.manager [req-1c464b08-ffd1-4d1d-ab59-60af811cb7dc req-77468651-1e9f-4942-8bb1-b10d529fde38 service nova] [instance: 0de15211-d094-479a-86ce-292389441fa8] Received event network-vif-unplugged-ddc3ddff-13ab-48d7-b4fc-8196ec7d2485 {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:20:49 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-1c464b08-ffd1-4d1d-ab59-60af811cb7dc req-77468651-1e9f-4942-8bb1-b10d529fde38 service nova] Acquiring lock "0de15211-d094-479a-86ce-292389441fa8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:20:49 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-1c464b08-ffd1-4d1d-ab59-60af811cb7dc req-77468651-1e9f-4942-8bb1-b10d529fde38 service nova] Lock "0de15211-d094-479a-86ce-292389441fa8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:20:49 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-1c464b08-ffd1-4d1d-ab59-60af811cb7dc req-77468651-1e9f-4942-8bb1-b10d529fde38 service nova] Lock "0de15211-d094-479a-86ce-292389441fa8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:20:49 user nova-compute[75045]: DEBUG nova.compute.manager [req-1c464b08-ffd1-4d1d-ab59-60af811cb7dc req-77468651-1e9f-4942-8bb1-b10d529fde38 service nova] [instance: 0de15211-d094-479a-86ce-292389441fa8] No waiting events found dispatching network-vif-unplugged-ddc3ddff-13ab-48d7-b4fc-8196ec7d2485 {{(pid=75045) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 23:20:49 user nova-compute[75045]: DEBUG nova.compute.manager [req-1c464b08-ffd1-4d1d-ab59-60af811cb7dc req-77468651-1e9f-4942-8bb1-b10d529fde38 service nova] [instance: 0de15211-d094-479a-86ce-292389441fa8] Received event network-vif-unplugged-ddc3ddff-13ab-48d7-b4fc-8196ec7d2485 for instance with task_state deleting. {{(pid=75045) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 23:20:49 user nova-compute[75045]: INFO nova.virt.libvirt.driver [-] [instance: 0de15211-d094-479a-86ce-292389441fa8] Instance destroyed successfully.
Nov 08 23:20:49 user nova-compute[75045]: DEBUG nova.objects.instance [None req-7b81baed-26d9-4dbd-9368-924c19b62d45 tempest-VolumesActionsTest-1040491269 tempest-VolumesActionsTest-1040491269-project-member] Lazy-loading 'resources' on Instance uuid 0de15211-d094-479a-86ce-292389441fa8 {{(pid=75045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 23:20:50 user nova-compute[75045]: DEBUG nova.virt.libvirt.vif [None req-7b81baed-26d9-4dbd-9368-924c19b62d45 tempest-VolumesActionsTest-1040491269 tempest-VolumesActionsTest-1040491269-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T23:18:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1418708991',display_name='tempest-VolumesActionsTest-instance-1418708991',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1418708991',id=13,image_ref='a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-08T23:19:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d400c9e6a57b4b8b830b7fd7a83bc8c5',ramdisk_id='',reservation_id='r-quukbsfo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1040491269',owner_user_name='tempest-VolumesActionsTest-1040491269-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T23:19:05Z,user_data=None,user_id='47fd89109eff4cf9a4a5d8b5f53b8980',uuid=0de15211-d094-479a-86ce-292389441fa8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ddc3ddff-13ab-48d7-b4fc-8196ec7d2485", "address": "fa:16:3e:ba:cb:fb", "network": {"id": "8f7dd756-4715-4085-bfab-8432f99f2e77", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1836278743-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d400c9e6a57b4b8b830b7fd7a83bc8c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapddc3ddff-13", "ovs_interfaceid": "ddc3ddff-13ab-48d7-b4fc-8196ec7d2485", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75045) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 23:20:50 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-7b81baed-26d9-4dbd-9368-924c19b62d45 tempest-VolumesActionsTest-1040491269 tempest-VolumesActionsTest-1040491269-project-member] Converting VIF {"id": "ddc3ddff-13ab-48d7-b4fc-8196ec7d2485", "address": "fa:16:3e:ba:cb:fb", "network": {"id": "8f7dd756-4715-4085-bfab-8432f99f2e77", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1836278743-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d400c9e6a57b4b8b830b7fd7a83bc8c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapddc3ddff-13", "ovs_interfaceid": "ddc3ddff-13ab-48d7-b4fc-8196ec7d2485", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 23:20:50 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-7b81baed-26d9-4dbd-9368-924c19b62d45 tempest-VolumesActionsTest-1040491269 tempest-VolumesActionsTest-1040491269-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ba:cb:fb,bridge_name='br-int',has_traffic_filtering=True,id=ddc3ddff-13ab-48d7-b4fc-8196ec7d2485,network=Network(8f7dd756-4715-4085-bfab-8432f99f2e77),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapddc3ddff-13') {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 23:20:50 user nova-compute[75045]: DEBUG os_vif [None req-7b81baed-26d9-4dbd-9368-924c19b62d45 tempest-VolumesActionsTest-1040491269 tempest-VolumesActionsTest-1040491269-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ba:cb:fb,bridge_name='br-int',has_traffic_filtering=True,id=ddc3ddff-13ab-48d7-b4fc-8196ec7d2485,network=Network(8f7dd756-4715-4085-bfab-8432f99f2e77),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapddc3ddff-13') {{(pid=75045) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 23:20:50 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:20:50 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapddc3ddff-13, bridge=br-int, if_exists=True) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:20:50 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:20:50 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 23:20:50 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:20:50 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4a2fbdd8-042e-44c3-b026-f3821a840873) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:20:50 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:20:50 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 23:20:50 user nova-compute[75045]: INFO os_vif [None req-7b81baed-26d9-4dbd-9368-924c19b62d45 tempest-VolumesActionsTest-1040491269 tempest-VolumesActionsTest-1040491269-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ba:cb:fb,bridge_name='br-int',has_traffic_filtering=True,id=ddc3ddff-13ab-48d7-b4fc-8196ec7d2485,network=Network(8f7dd756-4715-4085-bfab-8432f99f2e77),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapddc3ddff-13')
Nov 08 23:20:50 user nova-compute[75045]: INFO nova.virt.libvirt.driver [None req-7b81baed-26d9-4dbd-9368-924c19b62d45 tempest-VolumesActionsTest-1040491269 tempest-VolumesActionsTest-1040491269-project-member] [instance: 0de15211-d094-479a-86ce-292389441fa8] Deleting instance files /opt/stack/data/nova/instances/0de15211-d094-479a-86ce-292389441fa8_del
Nov 08 23:20:50 user nova-compute[75045]: INFO nova.virt.libvirt.driver [None req-7b81baed-26d9-4dbd-9368-924c19b62d45 tempest-VolumesActionsTest-1040491269 tempest-VolumesActionsTest-1040491269-project-member] [instance: 0de15211-d094-479a-86ce-292389441fa8] Deletion of /opt/stack/data/nova/instances/0de15211-d094-479a-86ce-292389441fa8_del complete
Nov 08 23:20:50 user nova-compute[75045]: INFO nova.compute.manager [None req-7b81baed-26d9-4dbd-9368-924c19b62d45 tempest-VolumesActionsTest-1040491269 tempest-VolumesActionsTest-1040491269-project-member] [instance: 0de15211-d094-479a-86ce-292389441fa8] Took 1.16 seconds to destroy the instance on the hypervisor.
Nov 08 23:20:50 user nova-compute[75045]: DEBUG oslo.service.loopingcall [None req-7b81baed-26d9-4dbd-9368-924c19b62d45 tempest-VolumesActionsTest-1040491269 tempest-VolumesActionsTest-1040491269-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75045) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 23:20:50 user nova-compute[75045]: DEBUG nova.compute.manager [-] [instance: 0de15211-d094-479a-86ce-292389441fa8] Deallocating network for instance {{(pid=75045) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 23:20:50 user nova-compute[75045]: DEBUG nova.network.neutron [-] [instance: 0de15211-d094-479a-86ce-292389441fa8] deallocate_for_instance() {{(pid=75045) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 23:20:50 user nova-compute[75045]: DEBUG nova.network.neutron [-] [instance: 0de15211-d094-479a-86ce-292389441fa8] Updating instance_info_cache with network_info: [] {{(pid=75045) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 23:20:50 user nova-compute[75045]: INFO nova.compute.manager [-] [instance: 0de15211-d094-479a-86ce-292389441fa8] Took 0.50 seconds to deallocate network for instance.
Nov 08 23:20:50 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-7b81baed-26d9-4dbd-9368-924c19b62d45 tempest-VolumesActionsTest-1040491269 tempest-VolumesActionsTest-1040491269-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:20:50 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-7b81baed-26d9-4dbd-9368-924c19b62d45 tempest-VolumesActionsTest-1040491269 tempest-VolumesActionsTest-1040491269-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:20:50 user nova-compute[75045]: DEBUG nova.compute.manager [req-b6cded03-2623-4cc0-9d60-0a770b67ea3e req-67e805aa-6926-40be-9eba-f6c98b717682 service nova] [instance: 0de15211-d094-479a-86ce-292389441fa8] Received event network-vif-deleted-ddc3ddff-13ab-48d7-b4fc-8196ec7d2485 {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:20:50 user nova-compute[75045]: DEBUG nova.compute.provider_tree [None req-7b81baed-26d9-4dbd-9368-924c19b62d45 tempest-VolumesActionsTest-1040491269 tempest-VolumesActionsTest-1040491269-project-member] Inventory has not changed in ProviderTree for provider: 62ba5f85-c74d-4b58-986e-d4197e813fd7 {{(pid=75045) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 23:20:50 user nova-compute[75045]: DEBUG nova.scheduler.client.report [None req-7b81baed-26d9-4dbd-9368-924c19b62d45 tempest-VolumesActionsTest-1040491269 tempest-VolumesActionsTest-1040491269-project-member] Inventory has not changed for provider 62ba5f85-c74d-4b58-986e-d4197e813fd7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75045) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 23:20:51 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-7b81baed-26d9-4dbd-9368-924c19b62d45 tempest-VolumesActionsTest-1040491269 tempest-VolumesActionsTest-1040491269-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.323s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:20:51 user nova-compute[75045]: INFO nova.scheduler.client.report [None req-7b81baed-26d9-4dbd-9368-924c19b62d45 tempest-VolumesActionsTest-1040491269 tempest-VolumesActionsTest-1040491269-project-member] Deleted allocations for instance 0de15211-d094-479a-86ce-292389441fa8
Nov 08 23:20:51 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-7b81baed-26d9-4dbd-9368-924c19b62d45 tempest-VolumesActionsTest-1040491269 tempest-VolumesActionsTest-1040491269-project-member] Lock "0de15211-d094-479a-86ce-292389441fa8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.207s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:20:51 user nova-compute[75045]: DEBUG nova.compute.manager [req-11d1feee-54ee-459a-82d3-2b940a9483c9 req-5554a545-f9a2-4997-938c-755f7a39d33c service nova] [instance: 0de15211-d094-479a-86ce-292389441fa8] Received event network-vif-plugged-ddc3ddff-13ab-48d7-b4fc-8196ec7d2485 {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:20:51 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-11d1feee-54ee-459a-82d3-2b940a9483c9 req-5554a545-f9a2-4997-938c-755f7a39d33c service nova] Acquiring lock "0de15211-d094-479a-86ce-292389441fa8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:20:51 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-11d1feee-54ee-459a-82d3-2b940a9483c9 req-5554a545-f9a2-4997-938c-755f7a39d33c service nova] Lock "0de15211-d094-479a-86ce-292389441fa8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:20:51 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-11d1feee-54ee-459a-82d3-2b940a9483c9 req-5554a545-f9a2-4997-938c-755f7a39d33c service nova] Lock "0de15211-d094-479a-86ce-292389441fa8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:20:51 user nova-compute[75045]: DEBUG nova.compute.manager [req-11d1feee-54ee-459a-82d3-2b940a9483c9 req-5554a545-f9a2-4997-938c-755f7a39d33c service nova] [instance: 0de15211-d094-479a-86ce-292389441fa8] No waiting events found dispatching network-vif-plugged-ddc3ddff-13ab-48d7-b4fc-8196ec7d2485 {{(pid=75045) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 23:20:51 user nova-compute[75045]: WARNING nova.compute.manager [req-11d1feee-54ee-459a-82d3-2b940a9483c9 req-5554a545-f9a2-4997-938c-755f7a39d33c service nova] [instance: 0de15211-d094-479a-86ce-292389441fa8] Received unexpected event network-vif-plugged-ddc3ddff-13ab-48d7-b4fc-8196ec7d2485 for instance with vm_state deleted and task_state None.
Nov 08 23:20:55 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:20:55 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:21:00 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:21:00 user nova-compute[75045]: DEBUG nova.compute.manager [req-41f57fb5-7708-414d-8135-31ce3c5f9500 req-b27b3fc2-10b2-41e3-a7e5-c56f843de1d8 service nova] [instance: 520eac4f-fa48-4e41-924d-840907e701b4] Received event network-changed-25776e3e-60d6-457c-a78a-a59df0e3e7b5 {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:21:00 user nova-compute[75045]: DEBUG nova.compute.manager [req-41f57fb5-7708-414d-8135-31ce3c5f9500 req-b27b3fc2-10b2-41e3-a7e5-c56f843de1d8 service nova] [instance: 520eac4f-fa48-4e41-924d-840907e701b4] Refreshing instance network info cache due to event network-changed-25776e3e-60d6-457c-a78a-a59df0e3e7b5. {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 23:21:00 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-41f57fb5-7708-414d-8135-31ce3c5f9500 req-b27b3fc2-10b2-41e3-a7e5-c56f843de1d8 service nova] Acquiring lock "refresh_cache-520eac4f-fa48-4e41-924d-840907e701b4" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 23:21:00 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-41f57fb5-7708-414d-8135-31ce3c5f9500 req-b27b3fc2-10b2-41e3-a7e5-c56f843de1d8 service nova] Acquired lock "refresh_cache-520eac4f-fa48-4e41-924d-840907e701b4" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 23:21:00 user nova-compute[75045]: DEBUG nova.network.neutron [req-41f57fb5-7708-414d-8135-31ce3c5f9500 req-b27b3fc2-10b2-41e3-a7e5-c56f843de1d8 service nova] [instance: 520eac4f-fa48-4e41-924d-840907e701b4] Refreshing network info cache for port 25776e3e-60d6-457c-a78a-a59df0e3e7b5 {{(pid=75045) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 23:21:00 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:21:00 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:21:01 user nova-compute[75045]: DEBUG nova.network.neutron [req-41f57fb5-7708-414d-8135-31ce3c5f9500 req-b27b3fc2-10b2-41e3-a7e5-c56f843de1d8 service nova] [instance: 520eac4f-fa48-4e41-924d-840907e701b4] Updated VIF entry in instance network info cache for port 25776e3e-60d6-457c-a78a-a59df0e3e7b5. {{(pid=75045) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 23:21:01 user nova-compute[75045]: DEBUG nova.network.neutron [req-41f57fb5-7708-414d-8135-31ce3c5f9500 req-b27b3fc2-10b2-41e3-a7e5-c56f843de1d8 service nova] [instance: 520eac4f-fa48-4e41-924d-840907e701b4] Updating instance_info_cache with network_info: [{"id": "25776e3e-60d6-457c-a78a-a59df0e3e7b5", "address": "fa:16:3e:3e:7f:60", "network": {"id": "13af9e02-7f74-4e9c-aea7-2e6f0701b1c2", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1067175210-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.230", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74ebbe44152141368b22a9a7989d577a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25776e3e-60", "ovs_interfaceid": "25776e3e-60d6-457c-a78a-a59df0e3e7b5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "bcd0d9eb-775a-4e28-b712-148c1fe99521", "address": "fa:16:3e:21:f4:bc", "network": {"id": "0916556c-7a50-48cf-8ad0-56c20de9d89f", "bridge": "br-int", "label": "tempest-device-tagging-net1-573961537", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.137", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "74ebbe44152141368b22a9a7989d577a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbcd0d9eb-77", "ovs_interfaceid": "bcd0d9eb-775a-4e28-b712-148c1fe99521", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "04ae6531-75ef-4043-99f4-bfa5ef2bba59", "address": "fa:16:3e:9f:87:19", "network": {"id": "0916556c-7a50-48cf-8ad0-56c20de9d89f", "bridge": "br-int", "label": "tempest-device-tagging-net1-573961537", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.210", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "74ebbe44152141368b22a9a7989d577a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04ae6531-75", "ovs_interfaceid": "04ae6531-75ef-4043-99f4-bfa5ef2bba59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "b3c645dd-a1ac-4780-a49d-916cb6a121c9", "address": "fa:16:3e:e2:e6:e2", "network": {"id": "0916556c-7a50-48cf-8ad0-56c20de9d89f", "bridge": "br-int", "label": "tempest-device-tagging-net1-573961537", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.154", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "74ebbe44152141368b22a9a7989d577a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3c645dd-a1", "ovs_interfaceid": "b3c645dd-a1ac-4780-a49d-916cb6a121c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3974ed79-74a5-4e9c-aa42-3aab1b234a39", "address": "fa:16:3e:f3:1c:29", "network": {"id": "0916556c-7a50-48cf-8ad0-56c20de9d89f", "bridge": "br-int", "label": "tempest-device-tagging-net1-573961537", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.231", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "74ebbe44152141368b22a9a7989d577a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3974ed79-74", "ovs_interfaceid": "3974ed79-74a5-4e9c-aa42-3aab1b234a39", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c2155ca8-d244-401d-a80f-8c53a68b6799", "address": "fa:16:3e:a2:80:a4", "network": {"id": "5cfed969-3f78-4bc2-8d08-921447c01347", "bridge": "br-int", "label": "tempest-device-tagging-net2-1614620309", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "74ebbe44152141368b22a9a7989d577a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2155ca8-d2", "ovs_interfaceid": "c2155ca8-d244-401d-a80f-8c53a68b6799", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "768830de-7c2e-45ca-959e-398480b6ba29", "address": "fa:16:3e:bc:05:cc", "network": {"id": "5cfed969-3f78-4bc2-8d08-921447c01347", "bridge": "br-int", "label": "tempest-device-tagging-net2-1614620309", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "74ebbe44152141368b22a9a7989d577a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap768830de-7c", "ovs_interfaceid": "768830de-7c2e-45ca-959e-398480b6ba29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75045) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 23:21:01 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-41f57fb5-7708-414d-8135-31ce3c5f9500 req-b27b3fc2-10b2-41e3-a7e5-c56f843de1d8 service nova] Releasing lock "refresh_cache-520eac4f-fa48-4e41-924d-840907e701b4" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 23:21:02 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-1d1f8477-7295-4e7a-8ef1-db1bb1469775 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262-project-member] Acquiring lock "82bc5fd0-26c7-4f81-b966-54831393b617" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:21:02 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-1d1f8477-7295-4e7a-8ef1-db1bb1469775 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262-project-member] Lock "82bc5fd0-26c7-4f81-b966-54831393b617" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:21:02 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-1d1f8477-7295-4e7a-8ef1-db1bb1469775 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262-project-member] Acquiring lock "82bc5fd0-26c7-4f81-b966-54831393b617-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:21:02 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-1d1f8477-7295-4e7a-8ef1-db1bb1469775 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262-project-member] Lock "82bc5fd0-26c7-4f81-b966-54831393b617-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:21:02 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-1d1f8477-7295-4e7a-8ef1-db1bb1469775 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262-project-member] Lock "82bc5fd0-26c7-4f81-b966-54831393b617-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:21:02 user nova-compute[75045]: INFO nova.compute.manager [None req-1d1f8477-7295-4e7a-8ef1-db1bb1469775 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262-project-member] [instance: 82bc5fd0-26c7-4f81-b966-54831393b617] Terminating instance
Nov 08 23:21:02 user nova-compute[75045]: DEBUG nova.compute.manager [None req-1d1f8477-7295-4e7a-8ef1-db1bb1469775 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262-project-member] [instance: 82bc5fd0-26c7-4f81-b966-54831393b617] Start destroying the instance on the hypervisor. {{(pid=75045) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 23:21:02 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:21:02 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:21:02 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:21:02 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:21:02 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:21:03 user nova-compute[75045]: DEBUG nova.compute.manager [req-a016f5ae-2f25-4f6b-8b8b-485ce922f779 req-fe3ddc5a-4563-43b0-8d07-e1370c2324f1 service nova] [instance: 82bc5fd0-26c7-4f81-b966-54831393b617] Received event network-vif-unplugged-5d77f7bf-dc8f-4aa2-9c4a-48d0e81d7451 {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:21:03 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-a016f5ae-2f25-4f6b-8b8b-485ce922f779 req-fe3ddc5a-4563-43b0-8d07-e1370c2324f1 service nova] Acquiring lock "82bc5fd0-26c7-4f81-b966-54831393b617-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:21:03 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-a016f5ae-2f25-4f6b-8b8b-485ce922f779 req-fe3ddc5a-4563-43b0-8d07-e1370c2324f1 service nova] Lock "82bc5fd0-26c7-4f81-b966-54831393b617-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:21:03 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-a016f5ae-2f25-4f6b-8b8b-485ce922f779 req-fe3ddc5a-4563-43b0-8d07-e1370c2324f1 service nova] Lock "82bc5fd0-26c7-4f81-b966-54831393b617-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:21:03 user nova-compute[75045]: DEBUG nova.compute.manager [req-a016f5ae-2f25-4f6b-8b8b-485ce922f779 req-fe3ddc5a-4563-43b0-8d07-e1370c2324f1 service nova] [instance: 82bc5fd0-26c7-4f81-b966-54831393b617] No waiting events found dispatching network-vif-unplugged-5d77f7bf-dc8f-4aa2-9c4a-48d0e81d7451 {{(pid=75045) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 23:21:03 user nova-compute[75045]: DEBUG nova.compute.manager [req-a016f5ae-2f25-4f6b-8b8b-485ce922f779 req-fe3ddc5a-4563-43b0-8d07-e1370c2324f1 service nova] [instance: 82bc5fd0-26c7-4f81-b966-54831393b617] Received event network-vif-unplugged-5d77f7bf-dc8f-4aa2-9c4a-48d0e81d7451 for instance with task_state deleting. {{(pid=75045) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 23:21:03 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:21:03 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:21:03 user nova-compute[75045]: INFO nova.virt.libvirt.driver [-] [instance: 82bc5fd0-26c7-4f81-b966-54831393b617] Instance destroyed successfully.
Nov 08 23:21:03 user nova-compute[75045]: DEBUG nova.objects.instance [None req-1d1f8477-7295-4e7a-8ef1-db1bb1469775 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262-project-member] Lazy-loading 'resources' on Instance uuid 82bc5fd0-26c7-4f81-b966-54831393b617 {{(pid=75045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 23:21:03 user nova-compute[75045]: DEBUG nova.virt.libvirt.vif [None req-1d1f8477-7295-4e7a-8ef1-db1bb1469775 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T23:16:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-2125080824',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-2125080824',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-2125080',id=8,image_ref='a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJB+N4c4RW1Mj/ZBcpZxNZKh8oAQlNrZ55bDfrddDIM0PKfYdL9vlhxn2vwFGUfAQ+5RB5nJAcQ4bYCYha3SZiJLy5/J8QONmDnSWa1k3TgGI2X5Sv/018bHDNHf9u3HcQ==',key_name='tempest-keypair-2084566665',keypairs=<?>,launch_index=0,launched_at=2023-11-08T23:16:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f8880c89fe3a444eb5e87aa0c0f82a19',ramdisk_id='',reservation_id='r-se9k226s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1679099262',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1679099262-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T23:16:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='61e83a029ebf498ca938bd1d248e5f03',uuid=82bc5fd0-26c7-4f81-b966-54831393b617,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5d77f7bf-dc8f-4aa2-9c4a-48d0e81d7451", "address": "fa:16:3e:4a:29:50", "network": {"id": "3f41081c-be28-40e3-bf5d-dd18368a2c49", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-102171439-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.170", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f8880c89fe3a444eb5e87aa0c0f82a19", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d77f7bf-dc", "ovs_interfaceid": "5d77f7bf-dc8f-4aa2-9c4a-48d0e81d7451", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75045) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 23:21:03 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-1d1f8477-7295-4e7a-8ef1-db1bb1469775 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262-project-member] Converting VIF {"id": "5d77f7bf-dc8f-4aa2-9c4a-48d0e81d7451", "address": "fa:16:3e:4a:29:50", "network": {"id": "3f41081c-be28-40e3-bf5d-dd18368a2c49", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-102171439-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.170", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f8880c89fe3a444eb5e87aa0c0f82a19", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d77f7bf-dc", "ovs_interfaceid": "5d77f7bf-dc8f-4aa2-9c4a-48d0e81d7451", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 23:21:03 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-1d1f8477-7295-4e7a-8ef1-db1bb1469775 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4a:29:50,bridge_name='br-int',has_traffic_filtering=True,id=5d77f7bf-dc8f-4aa2-9c4a-48d0e81d7451,network=Network(3f41081c-be28-40e3-bf5d-dd18368a2c49),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5d77f7bf-dc') {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 23:21:03 user nova-compute[75045]: DEBUG os_vif [None req-1d1f8477-7295-4e7a-8ef1-db1bb1469775 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:4a:29:50,bridge_name='br-int',has_traffic_filtering=True,id=5d77f7bf-dc8f-4aa2-9c4a-48d0e81d7451,network=Network(3f41081c-be28-40e3-bf5d-dd18368a2c49),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5d77f7bf-dc') {{(pid=75045) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 23:21:03 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:21:03 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5d77f7bf-dc, bridge=br-int, if_exists=True) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:21:03 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:21:03 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 23:21:03 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:21:03 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:21:03 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=487c8305-54bf-40b8-b5e6-aedc541a4807) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:21:03 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:21:03 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 23:21:03 user nova-compute[75045]: INFO os_vif [None req-1d1f8477-7295-4e7a-8ef1-db1bb1469775 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:4a:29:50,bridge_name='br-int',has_traffic_filtering=True,id=5d77f7bf-dc8f-4aa2-9c4a-48d0e81d7451,network=Network(3f41081c-be28-40e3-bf5d-dd18368a2c49),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5d77f7bf-dc')
Nov 08 23:21:03 user nova-compute[75045]: INFO nova.virt.libvirt.driver [None req-1d1f8477-7295-4e7a-8ef1-db1bb1469775 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262-project-member] [instance: 82bc5fd0-26c7-4f81-b966-54831393b617] Deleting instance files /opt/stack/data/nova/instances/82bc5fd0-26c7-4f81-b966-54831393b617_del
Nov 08 23:21:03 user nova-compute[75045]: INFO nova.virt.libvirt.driver [None req-1d1f8477-7295-4e7a-8ef1-db1bb1469775 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262-project-member] [instance: 82bc5fd0-26c7-4f81-b966-54831393b617] Deletion of /opt/stack/data/nova/instances/82bc5fd0-26c7-4f81-b966-54831393b617_del complete
Nov 08 23:21:04 user nova-compute[75045]: INFO nova.compute.manager [None req-1d1f8477-7295-4e7a-8ef1-db1bb1469775 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262-project-member] [instance: 82bc5fd0-26c7-4f81-b966-54831393b617] Took 1.34 seconds to destroy the instance on the hypervisor.
Nov 08 23:21:04 user nova-compute[75045]: DEBUG oslo.service.loopingcall [None req-1d1f8477-7295-4e7a-8ef1-db1bb1469775 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75045) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 23:21:04 user nova-compute[75045]: DEBUG nova.compute.manager [-] [instance: 82bc5fd0-26c7-4f81-b966-54831393b617] Deallocating network for instance {{(pid=75045) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 23:21:04 user nova-compute[75045]: DEBUG nova.network.neutron [-] [instance: 82bc5fd0-26c7-4f81-b966-54831393b617] deallocate_for_instance() {{(pid=75045) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 23:21:04 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-b17001c7-4eef-4c12-8560-bbc28897aeb0 tempest-TaggedAttachmentsTest-1639503389 tempest-TaggedAttachmentsTest-1639503389-project-member] Acquiring lock "1cb1b440-0073-4a53-a0a2-e2781e021866" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:21:04 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-b17001c7-4eef-4c12-8560-bbc28897aeb0 tempest-TaggedAttachmentsTest-1639503389 tempest-TaggedAttachmentsTest-1639503389-project-member] Lock "1cb1b440-0073-4a53-a0a2-e2781e021866" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:21:04 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-b17001c7-4eef-4c12-8560-bbc28897aeb0 tempest-TaggedAttachmentsTest-1639503389 tempest-TaggedAttachmentsTest-1639503389-project-member] Acquiring lock "1cb1b440-0073-4a53-a0a2-e2781e021866-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:21:04 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-b17001c7-4eef-4c12-8560-bbc28897aeb0 tempest-TaggedAttachmentsTest-1639503389 tempest-TaggedAttachmentsTest-1639503389-project-member] Lock "1cb1b440-0073-4a53-a0a2-e2781e021866-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.002s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:21:04 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-b17001c7-4eef-4c12-8560-bbc28897aeb0 tempest-TaggedAttachmentsTest-1639503389 tempest-TaggedAttachmentsTest-1639503389-project-member] Lock "1cb1b440-0073-4a53-a0a2-e2781e021866-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:21:04 user nova-compute[75045]: INFO nova.compute.manager [None req-b17001c7-4eef-4c12-8560-bbc28897aeb0 tempest-TaggedAttachmentsTest-1639503389 tempest-TaggedAttachmentsTest-1639503389-project-member] [instance: 1cb1b440-0073-4a53-a0a2-e2781e021866] Terminating instance
Nov 08 23:21:04 user nova-compute[75045]: DEBUG nova.compute.manager [None req-b17001c7-4eef-4c12-8560-bbc28897aeb0 tempest-TaggedAttachmentsTest-1639503389 tempest-TaggedAttachmentsTest-1639503389-project-member] [instance: 1cb1b440-0073-4a53-a0a2-e2781e021866] Start destroying the instance on the hypervisor. {{(pid=75045) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 23:21:04 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:21:04 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-d5805710-9670-4f75-8e44-f7d92ad2b113 tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] Acquiring lock "520eac4f-fa48-4e41-924d-840907e701b4" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:21:04 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-d5805710-9670-4f75-8e44-f7d92ad2b113 tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] Lock "520eac4f-fa48-4e41-924d-840907e701b4" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:21:04 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-d5805710-9670-4f75-8e44-f7d92ad2b113 tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] Acquiring lock "520eac4f-fa48-4e41-924d-840907e701b4-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:21:04 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-d5805710-9670-4f75-8e44-f7d92ad2b113 tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] Lock "520eac4f-fa48-4e41-924d-840907e701b4-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:21:04 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-d5805710-9670-4f75-8e44-f7d92ad2b113 tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] Lock "520eac4f-fa48-4e41-924d-840907e701b4-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:21:04 user nova-compute[75045]: INFO nova.compute.manager [None req-d5805710-9670-4f75-8e44-f7d92ad2b113 tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] [instance: 520eac4f-fa48-4e41-924d-840907e701b4] Terminating instance
Nov 08 23:21:04 user nova-compute[75045]: DEBUG nova.compute.manager [None req-d5805710-9670-4f75-8e44-f7d92ad2b113 tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] [instance: 520eac4f-fa48-4e41-924d-840907e701b4] Start destroying the instance on the hypervisor. {{(pid=75045) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 23:21:04 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:21:04 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:21:04 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:21:04 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:21:04 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:21:04 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:21:04 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:21:04 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:21:04 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:21:04 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:21:04 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:21:04 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:21:04 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:21:04 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:21:05 user nova-compute[75045]: DEBUG nova.compute.manager [req-5006a99d-eec6-4b39-bc9c-babde67a91a4 req-543f2de1-087f-4a3d-b0fb-9553e65e81df service nova] [instance: 520eac4f-fa48-4e41-924d-840907e701b4] Received event network-vif-unplugged-25776e3e-60d6-457c-a78a-a59df0e3e7b5 {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:21:05 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-5006a99d-eec6-4b39-bc9c-babde67a91a4 req-543f2de1-087f-4a3d-b0fb-9553e65e81df service nova] Acquiring lock "520eac4f-fa48-4e41-924d-840907e701b4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:21:05 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-5006a99d-eec6-4b39-bc9c-babde67a91a4 req-543f2de1-087f-4a3d-b0fb-9553e65e81df service nova] Lock "520eac4f-fa48-4e41-924d-840907e701b4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:21:05 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-5006a99d-eec6-4b39-bc9c-babde67a91a4 req-543f2de1-087f-4a3d-b0fb-9553e65e81df service nova] Lock "520eac4f-fa48-4e41-924d-840907e701b4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:21:05 user nova-compute[75045]: DEBUG nova.compute.manager [req-5006a99d-eec6-4b39-bc9c-babde67a91a4 req-543f2de1-087f-4a3d-b0fb-9553e65e81df service nova] [instance: 520eac4f-fa48-4e41-924d-840907e701b4] No waiting events found dispatching network-vif-unplugged-25776e3e-60d6-457c-a78a-a59df0e3e7b5 {{(pid=75045) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 23:21:05 user nova-compute[75045]: DEBUG nova.compute.manager [req-5006a99d-eec6-4b39-bc9c-babde67a91a4 req-543f2de1-087f-4a3d-b0fb-9553e65e81df service nova] [instance: 520eac4f-fa48-4e41-924d-840907e701b4] Received event network-vif-unplugged-25776e3e-60d6-457c-a78a-a59df0e3e7b5 for instance with task_state deleting. {{(pid=75045) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 23:21:05 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:21:05 user nova-compute[75045]: INFO nova.virt.libvirt.driver [-] [instance: 1cb1b440-0073-4a53-a0a2-e2781e021866] Instance destroyed successfully.
Nov 08 23:21:05 user nova-compute[75045]: DEBUG nova.objects.instance [None req-b17001c7-4eef-4c12-8560-bbc28897aeb0 tempest-TaggedAttachmentsTest-1639503389 tempest-TaggedAttachmentsTest-1639503389-project-member] Lazy-loading 'resources' on Instance uuid 1cb1b440-0073-4a53-a0a2-e2781e021866 {{(pid=75045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 23:21:05 user nova-compute[75045]: DEBUG nova.compute.manager [req-52b44edc-49e9-40a7-aae9-99e210feea24 req-8edb9b71-8f33-404a-920f-57e7e4819f39 service nova] [instance: 82bc5fd0-26c7-4f81-b966-54831393b617] Received event network-vif-plugged-5d77f7bf-dc8f-4aa2-9c4a-48d0e81d7451 {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:21:05 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-52b44edc-49e9-40a7-aae9-99e210feea24 req-8edb9b71-8f33-404a-920f-57e7e4819f39 service nova] Acquiring lock "82bc5fd0-26c7-4f81-b966-54831393b617-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:21:05 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-52b44edc-49e9-40a7-aae9-99e210feea24 req-8edb9b71-8f33-404a-920f-57e7e4819f39 service nova] Lock "82bc5fd0-26c7-4f81-b966-54831393b617-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:21:05 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-52b44edc-49e9-40a7-aae9-99e210feea24 req-8edb9b71-8f33-404a-920f-57e7e4819f39 service nova] Lock "82bc5fd0-26c7-4f81-b966-54831393b617-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:21:05 user nova-compute[75045]: DEBUG nova.compute.manager [req-52b44edc-49e9-40a7-aae9-99e210feea24 req-8edb9b71-8f33-404a-920f-57e7e4819f39 service nova] [instance: 82bc5fd0-26c7-4f81-b966-54831393b617] No waiting events found dispatching network-vif-plugged-5d77f7bf-dc8f-4aa2-9c4a-48d0e81d7451 {{(pid=75045) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 23:21:05 user nova-compute[75045]: WARNING nova.compute.manager [req-52b44edc-49e9-40a7-aae9-99e210feea24 req-8edb9b71-8f33-404a-920f-57e7e4819f39 service nova] [instance: 82bc5fd0-26c7-4f81-b966-54831393b617] Received unexpected event network-vif-plugged-5d77f7bf-dc8f-4aa2-9c4a-48d0e81d7451 for instance with vm_state active and task_state deleting.
Nov 08 23:21:05 user nova-compute[75045]: DEBUG nova.compute.manager [req-52b44edc-49e9-40a7-aae9-99e210feea24 req-8edb9b71-8f33-404a-920f-57e7e4819f39 service nova] [instance: 1cb1b440-0073-4a53-a0a2-e2781e021866] Received event network-vif-unplugged-892284f7-b4b9-4b5b-82c7-62300cd8afb7 {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:21:05 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-52b44edc-49e9-40a7-aae9-99e210feea24 req-8edb9b71-8f33-404a-920f-57e7e4819f39 service nova] Acquiring lock "1cb1b440-0073-4a53-a0a2-e2781e021866-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:21:05 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-52b44edc-49e9-40a7-aae9-99e210feea24 req-8edb9b71-8f33-404a-920f-57e7e4819f39 service nova] Lock "1cb1b440-0073-4a53-a0a2-e2781e021866-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:21:05 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-52b44edc-49e9-40a7-aae9-99e210feea24 req-8edb9b71-8f33-404a-920f-57e7e4819f39 service nova] Lock "1cb1b440-0073-4a53-a0a2-e2781e021866-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:21:05 user nova-compute[75045]: DEBUG nova.compute.manager [req-52b44edc-49e9-40a7-aae9-99e210feea24 req-8edb9b71-8f33-404a-920f-57e7e4819f39 service nova] [instance: 1cb1b440-0073-4a53-a0a2-e2781e021866] No waiting events found dispatching network-vif-unplugged-892284f7-b4b9-4b5b-82c7-62300cd8afb7 {{(pid=75045) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 23:21:05 user nova-compute[75045]: DEBUG nova.compute.manager [req-52b44edc-49e9-40a7-aae9-99e210feea24 req-8edb9b71-8f33-404a-920f-57e7e4819f39 service nova] [instance: 1cb1b440-0073-4a53-a0a2-e2781e021866] Received event network-vif-unplugged-892284f7-b4b9-4b5b-82c7-62300cd8afb7 for instance with task_state deleting. {{(pid=75045) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 23:21:05 user nova-compute[75045]: DEBUG nova.compute.manager [req-52b44edc-49e9-40a7-aae9-99e210feea24 req-8edb9b71-8f33-404a-920f-57e7e4819f39 service nova] [instance: 1cb1b440-0073-4a53-a0a2-e2781e021866] Received event network-vif-plugged-892284f7-b4b9-4b5b-82c7-62300cd8afb7 {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:21:05 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-52b44edc-49e9-40a7-aae9-99e210feea24 req-8edb9b71-8f33-404a-920f-57e7e4819f39 service nova] Acquiring lock "1cb1b440-0073-4a53-a0a2-e2781e021866-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:21:05 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-52b44edc-49e9-40a7-aae9-99e210feea24 req-8edb9b71-8f33-404a-920f-57e7e4819f39 service nova] Lock "1cb1b440-0073-4a53-a0a2-e2781e021866-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:21:05 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-52b44edc-49e9-40a7-aae9-99e210feea24 req-8edb9b71-8f33-404a-920f-57e7e4819f39 service nova] Lock "1cb1b440-0073-4a53-a0a2-e2781e021866-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:21:05 user nova-compute[75045]: DEBUG nova.compute.manager [req-52b44edc-49e9-40a7-aae9-99e210feea24 req-8edb9b71-8f33-404a-920f-57e7e4819f39 service nova] [instance: 1cb1b440-0073-4a53-a0a2-e2781e021866] No waiting events found dispatching network-vif-plugged-892284f7-b4b9-4b5b-82c7-62300cd8afb7 {{(pid=75045) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 23:21:05 user nova-compute[75045]: WARNING nova.compute.manager [req-52b44edc-49e9-40a7-aae9-99e210feea24 req-8edb9b71-8f33-404a-920f-57e7e4819f39 service nova] [instance: 1cb1b440-0073-4a53-a0a2-e2781e021866] Received unexpected event network-vif-plugged-892284f7-b4b9-4b5b-82c7-62300cd8afb7 for instance with vm_state active and task_state deleting.
Nov 08 23:21:05 user nova-compute[75045]: DEBUG nova.virt.libvirt.vif [None req-b17001c7-4eef-4c12-8560-bbc28897aeb0 tempest-TaggedAttachmentsTest-1639503389 tempest-TaggedAttachmentsTest-1639503389-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T23:16:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1008670319',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1008670319',id=5,image_ref='a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJHwrx1BGWhjjUX4+Byh1wjqwerHxYEs1Bi9i8sP+n0orNMkrqYiTdsqsEt8sTDzFkc1LBM09NOYtbQKa/c7KjqeCNDDUOdBi8LqOWMDeLuYXRRZIoptz+6bpxuTCZMmXg==',key_name='tempest-keypair-1418515873',keypairs=<?>,launch_index=0,launched_at=2023-11-08T23:16:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bb18f0af92ec4de6a1fddb6c77ea030d',ramdisk_id='',reservation_id='r-15oytm0c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1639503389',owner_user_name='tempest-TaggedAttachmentsTest-1639503389-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T23:16:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0c8d9cc387dc45d18ad1550ef6d3cfa9',uuid=1cb1b440-0073-4a53-a0a2-e2781e021866,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "892284f7-b4b9-4b5b-82c7-62300cd8afb7", "address": "fa:16:3e:e4:4d:f8", "network": {"id": "fa6f2c92-825d-46c6-a0ea-51f96da244cb", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-193868289-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.235", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb18f0af92ec4de6a1fddb6c77ea030d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap892284f7-b4", "ovs_interfaceid": "892284f7-b4b9-4b5b-82c7-62300cd8afb7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75045) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 23:21:05 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-b17001c7-4eef-4c12-8560-bbc28897aeb0 tempest-TaggedAttachmentsTest-1639503389 tempest-TaggedAttachmentsTest-1639503389-project-member] Converting VIF {"id": "892284f7-b4b9-4b5b-82c7-62300cd8afb7", "address": "fa:16:3e:e4:4d:f8", "network": {"id": "fa6f2c92-825d-46c6-a0ea-51f96da244cb", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-193868289-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.235", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb18f0af92ec4de6a1fddb6c77ea030d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap892284f7-b4", "ovs_interfaceid": "892284f7-b4b9-4b5b-82c7-62300cd8afb7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 23:21:05 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-b17001c7-4eef-4c12-8560-bbc28897aeb0 tempest-TaggedAttachmentsTest-1639503389 tempest-TaggedAttachmentsTest-1639503389-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e4:4d:f8,bridge_name='br-int',has_traffic_filtering=True,id=892284f7-b4b9-4b5b-82c7-62300cd8afb7,network=Network(fa6f2c92-825d-46c6-a0ea-51f96da244cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap892284f7-b4') {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 23:21:05 user nova-compute[75045]: DEBUG os_vif [None req-b17001c7-4eef-4c12-8560-bbc28897aeb0 tempest-TaggedAttachmentsTest-1639503389 tempest-TaggedAttachmentsTest-1639503389-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e4:4d:f8,bridge_name='br-int',has_traffic_filtering=True,id=892284f7-b4b9-4b5b-82c7-62300cd8afb7,network=Network(fa6f2c92-825d-46c6-a0ea-51f96da244cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap892284f7-b4') {{(pid=75045) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 23:21:05 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:21:05 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap892284f7-b4, bridge=br-int, if_exists=True) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:21:05 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:21:05 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 23:21:05 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:21:05 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:21:05 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:21:05 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:21:05 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:21:05 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=bd9fa511-5bf7-41f7-9851-187b7003d946) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:21:05 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:21:05 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 23:21:05 user nova-compute[75045]: DEBUG nova.compute.manager [req-fa7fb664-d8a3-4500-8a27-20989ef50205 req-529a477a-5261-40f5-a784-ff7d7840f352 service nova] [instance: 520eac4f-fa48-4e41-924d-840907e701b4] Received event network-vif-unplugged-b3c645dd-a1ac-4780-a49d-916cb6a121c9 {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:21:05 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-fa7fb664-d8a3-4500-8a27-20989ef50205 req-529a477a-5261-40f5-a784-ff7d7840f352 service nova] Acquiring lock "520eac4f-fa48-4e41-924d-840907e701b4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:21:05 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-fa7fb664-d8a3-4500-8a27-20989ef50205 req-529a477a-5261-40f5-a784-ff7d7840f352 service nova] Lock "520eac4f-fa48-4e41-924d-840907e701b4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:21:05 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-fa7fb664-d8a3-4500-8a27-20989ef50205 req-529a477a-5261-40f5-a784-ff7d7840f352 service nova] Lock "520eac4f-fa48-4e41-924d-840907e701b4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:21:05 user nova-compute[75045]: DEBUG nova.compute.manager [req-fa7fb664-d8a3-4500-8a27-20989ef50205 req-529a477a-5261-40f5-a784-ff7d7840f352 service nova] [instance: 520eac4f-fa48-4e41-924d-840907e701b4] No waiting events found dispatching network-vif-unplugged-b3c645dd-a1ac-4780-a49d-916cb6a121c9 {{(pid=75045) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 23:21:05 user nova-compute[75045]: DEBUG nova.compute.manager [req-fa7fb664-d8a3-4500-8a27-20989ef50205 req-529a477a-5261-40f5-a784-ff7d7840f352 service nova] [instance: 520eac4f-fa48-4e41-924d-840907e701b4] Received event network-vif-unplugged-b3c645dd-a1ac-4780-a49d-916cb6a121c9 for instance with task_state deleting. {{(pid=75045) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 23:21:05 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:21:05 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:21:05 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:21:05 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:21:05 user nova-compute[75045]: INFO os_vif [None req-b17001c7-4eef-4c12-8560-bbc28897aeb0 tempest-TaggedAttachmentsTest-1639503389 tempest-TaggedAttachmentsTest-1639503389-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e4:4d:f8,bridge_name='br-int',has_traffic_filtering=True,id=892284f7-b4b9-4b5b-82c7-62300cd8afb7,network=Network(fa6f2c92-825d-46c6-a0ea-51f96da244cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap892284f7-b4')
Nov 08 23:21:05 user nova-compute[75045]: INFO nova.virt.libvirt.driver [None req-b17001c7-4eef-4c12-8560-bbc28897aeb0 tempest-TaggedAttachmentsTest-1639503389 tempest-TaggedAttachmentsTest-1639503389-project-member] [instance: 1cb1b440-0073-4a53-a0a2-e2781e021866] Deleting instance files /opt/stack/data/nova/instances/1cb1b440-0073-4a53-a0a2-e2781e021866_del
Nov 08 23:21:05 user nova-compute[75045]: INFO nova.virt.libvirt.driver [None req-b17001c7-4eef-4c12-8560-bbc28897aeb0 tempest-TaggedAttachmentsTest-1639503389 tempest-TaggedAttachmentsTest-1639503389-project-member] [instance: 1cb1b440-0073-4a53-a0a2-e2781e021866] Deletion of /opt/stack/data/nova/instances/1cb1b440-0073-4a53-a0a2-e2781e021866_del complete
Nov 08 23:21:05 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:21:05 user nova-compute[75045]: INFO nova.compute.manager [None req-b17001c7-4eef-4c12-8560-bbc28897aeb0 tempest-TaggedAttachmentsTest-1639503389 tempest-TaggedAttachmentsTest-1639503389-project-member] [instance: 1cb1b440-0073-4a53-a0a2-e2781e021866] Took 1.49 seconds to destroy the instance on the hypervisor.
Nov 08 23:21:05 user nova-compute[75045]: DEBUG oslo.service.loopingcall [None req-b17001c7-4eef-4c12-8560-bbc28897aeb0 tempest-TaggedAttachmentsTest-1639503389 tempest-TaggedAttachmentsTest-1639503389-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75045) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 23:21:05 user nova-compute[75045]: DEBUG nova.compute.manager [-] [instance: 1cb1b440-0073-4a53-a0a2-e2781e021866] Deallocating network for instance {{(pid=75045) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 23:21:05 user nova-compute[75045]: DEBUG nova.network.neutron [-] [instance: 1cb1b440-0073-4a53-a0a2-e2781e021866] deallocate_for_instance() {{(pid=75045) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 23:21:05 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:21:05 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:21:05 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:21:05 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:21:05 user nova-compute[75045]: DEBUG nova.network.neutron [-] [instance: 82bc5fd0-26c7-4f81-b966-54831393b617] Updating instance_info_cache with network_info: [] {{(pid=75045) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 23:21:05 user nova-compute[75045]: INFO nova.compute.manager [-] [instance: 82bc5fd0-26c7-4f81-b966-54831393b617] Took 1.92 seconds to deallocate network for instance.
Nov 08 23:21:06 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-1d1f8477-7295-4e7a-8ef1-db1bb1469775 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:21:06 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-1d1f8477-7295-4e7a-8ef1-db1bb1469775 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:21:06 user nova-compute[75045]: INFO nova.virt.libvirt.driver [-] [instance: 520eac4f-fa48-4e41-924d-840907e701b4] Instance destroyed successfully.
Nov 08 23:21:06 user nova-compute[75045]: DEBUG nova.objects.instance [None req-d5805710-9670-4f75-8e44-f7d92ad2b113 tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] Lazy-loading 'resources' on Instance uuid 520eac4f-fa48-4e41-924d-840907e701b4 {{(pid=75045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 23:21:06 user nova-compute[75045]: DEBUG nova.virt.libvirt.vif [None req-d5805710-9670-4f75-8e44-f7d92ad2b113 tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T23:17:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1412524117',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1412524117',id=10,image_ref='a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIOg6qdtEUL8OwbPxHJ6siVv0HGHJ2I3WU6rXK8ahHqt76KKZ8niNHuCAGdeTPkJyNSdMmrzEWjROFsrOoC1kmaY029eK7Yz3akFrk91+1J9Sq2nrDoAG6jY9mnI91XmoQ==',key_name='tempest-keypair-1736555466',keypairs=<?>,launch_index=0,launched_at=2023-11-08T23:19:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='74ebbe44152141368b22a9a7989d577a',ramdisk_id='',reservation_id='r-mgh3rv15',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-2022931664',owner_user_name='tempest-TaggedBootDevicesTest-2022931664-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T23:19:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8c4361faf9ee4444be0e061b8c8aee98',uuid=520eac4f-fa48-4e41-924d-840907e701b4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "25776e3e-60d6-457c-a78a-a59df0e3e7b5", "address": "fa:16:3e:3e:7f:60", "network": {"id": "13af9e02-7f74-4e9c-aea7-2e6f0701b1c2", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1067175210-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.230", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74ebbe44152141368b22a9a7989d577a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25776e3e-60", "ovs_interfaceid": "25776e3e-60d6-457c-a78a-a59df0e3e7b5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75045) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 23:21:06 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-d5805710-9670-4f75-8e44-f7d92ad2b113 tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] Converting VIF {"id": "25776e3e-60d6-457c-a78a-a59df0e3e7b5", "address": "fa:16:3e:3e:7f:60", "network": {"id": "13af9e02-7f74-4e9c-aea7-2e6f0701b1c2", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1067175210-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.230", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74ebbe44152141368b22a9a7989d577a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25776e3e-60", "ovs_interfaceid": "25776e3e-60d6-457c-a78a-a59df0e3e7b5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 23:21:06 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-d5805710-9670-4f75-8e44-f7d92ad2b113 tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3e:7f:60,bridge_name='br-int',has_traffic_filtering=True,id=25776e3e-60d6-457c-a78a-a59df0e3e7b5,network=Network(13af9e02-7f74-4e9c-aea7-2e6f0701b1c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap25776e3e-60') {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 23:21:06 user nova-compute[75045]: DEBUG os_vif [None req-d5805710-9670-4f75-8e44-f7d92ad2b113 tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:3e:7f:60,bridge_name='br-int',has_traffic_filtering=True,id=25776e3e-60d6-457c-a78a-a59df0e3e7b5,network=Network(13af9e02-7f74-4e9c-aea7-2e6f0701b1c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap25776e3e-60') {{(pid=75045) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 23:21:06 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:21:06 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap25776e3e-60, bridge=br-int, if_exists=True) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:21:06 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:21:06 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 23:21:06 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:21:06 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:21:06 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d1a0eb86-bca2-4e64-aa94-29fd718c1312) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:21:06 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:21:06 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 23:21:06 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:21:06 user nova-compute[75045]: INFO os_vif [None req-d5805710-9670-4f75-8e44-f7d92ad2b113 tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:3e:7f:60,bridge_name='br-int',has_traffic_filtering=True,id=25776e3e-60d6-457c-a78a-a59df0e3e7b5,network=Network(13af9e02-7f74-4e9c-aea7-2e6f0701b1c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap25776e3e-60')
Nov 08 23:21:06 user nova-compute[75045]: DEBUG nova.virt.libvirt.vif [None req-d5805710-9670-4f75-8e44-f7d92ad2b113 tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T23:17:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1412524117',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1412524117',id=10,image_ref='a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIOg6qdtEUL8OwbPxHJ6siVv0HGHJ2I3WU6rXK8ahHqt76KKZ8niNHuCAGdeTPkJyNSdMmrzEWjROFsrOoC1kmaY029eK7Yz3akFrk91+1J9Sq2nrDoAG6jY9mnI91XmoQ==',key_name='tempest-keypair-1736555466',keypairs=<?>,launch_index=0,launched_at=2023-11-08T23:19:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='74ebbe44152141368b22a9a7989d577a',ramdisk_id='',reservation_id='r-mgh3rv15',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-2022931664',owner_user_name='tempest-TaggedBootDevicesTest-2022931664-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T23:19:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8c4361faf9ee4444be0e061b8c8aee98',uuid=520eac4f-fa48-4e41-924d-840907e701b4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bcd0d9eb-775a-4e28-b712-148c1fe99521", "address": "fa:16:3e:21:f4:bc", "network": {"id": "0916556c-7a50-48cf-8ad0-56c20de9d89f", "bridge": "br-int", "label": "tempest-device-tagging-net1-573961537", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.137", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "74ebbe44152141368b22a9a7989d577a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbcd0d9eb-77", "ovs_interfaceid": "bcd0d9eb-775a-4e28-b712-148c1fe99521", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75045) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 23:21:06 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-d5805710-9670-4f75-8e44-f7d92ad2b113 tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] Converting VIF {"id": "bcd0d9eb-775a-4e28-b712-148c1fe99521", "address": "fa:16:3e:21:f4:bc", "network": {"id": "0916556c-7a50-48cf-8ad0-56c20de9d89f", "bridge": "br-int", "label": "tempest-device-tagging-net1-573961537", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.137", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "74ebbe44152141368b22a9a7989d577a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbcd0d9eb-77", "ovs_interfaceid": "bcd0d9eb-775a-4e28-b712-148c1fe99521", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 23:21:06 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-d5805710-9670-4f75-8e44-f7d92ad2b113 tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:21:f4:bc,bridge_name='br-int',has_traffic_filtering=True,id=bcd0d9eb-775a-4e28-b712-148c1fe99521,network=Network(0916556c-7a50-48cf-8ad0-56c20de9d89f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapbcd0d9eb-77') {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 23:21:06 user nova-compute[75045]: DEBUG os_vif [None req-d5805710-9670-4f75-8e44-f7d92ad2b113 tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:21:f4:bc,bridge_name='br-int',has_traffic_filtering=True,id=bcd0d9eb-775a-4e28-b712-148c1fe99521,network=Network(0916556c-7a50-48cf-8ad0-56c20de9d89f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapbcd0d9eb-77') {{(pid=75045) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 23:21:06 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:21:06 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbcd0d9eb-77, bridge=br-int, if_exists=True) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:21:06 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:21:06 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 23:21:06 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:21:06 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:21:06 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=cf69704d-56db-46f7-bc9e-a8bf45e8357e) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:21:06 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:21:06 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 23:21:06 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:21:06 user nova-compute[75045]: INFO os_vif [None req-d5805710-9670-4f75-8e44-f7d92ad2b113 tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:21:f4:bc,bridge_name='br-int',has_traffic_filtering=True,id=bcd0d9eb-775a-4e28-b712-148c1fe99521,network=Network(0916556c-7a50-48cf-8ad0-56c20de9d89f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapbcd0d9eb-77')
Nov 08 23:21:06 user nova-compute[75045]: DEBUG nova.virt.libvirt.vif [None req-d5805710-9670-4f75-8e44-f7d92ad2b113 tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T23:17:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1412524117',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1412524117',id=10,image_ref='a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIOg6qdtEUL8OwbPxHJ6siVv0HGHJ2I3WU6rXK8ahHqt76KKZ8niNHuCAGdeTPkJyNSdMmrzEWjROFsrOoC1kmaY029eK7Yz3akFrk91+1J9Sq2nrDoAG6jY9mnI91XmoQ==',key_name='tempest-keypair-1736555466',keypairs=<?>,launch_index=0,launched_at=2023-11-08T23:19:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='74ebbe44152141368b22a9a7989d577a',ramdisk_id='',reservation_id='r-mgh3rv15',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-2022931664',owner_user_name='tempest-TaggedBootDevicesTest-2022931664-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T23:19:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8c4361faf9ee4444be0e061b8c8aee98',uuid=520eac4f-fa48-4e41-924d-840907e701b4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "04ae6531-75ef-4043-99f4-bfa5ef2bba59", "address": "fa:16:3e:9f:87:19", "network": {"id": "0916556c-7a50-48cf-8ad0-56c20de9d89f", "bridge": "br-int", "label": "tempest-device-tagging-net1-573961537", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.210", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "74ebbe44152141368b22a9a7989d577a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04ae6531-75", "ovs_interfaceid": "04ae6531-75ef-4043-99f4-bfa5ef2bba59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75045) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 23:21:06 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-d5805710-9670-4f75-8e44-f7d92ad2b113 tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] Converting VIF {"id": "04ae6531-75ef-4043-99f4-bfa5ef2bba59", "address": "fa:16:3e:9f:87:19", "network": {"id": "0916556c-7a50-48cf-8ad0-56c20de9d89f", "bridge": "br-int", "label": "tempest-device-tagging-net1-573961537", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.210", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "74ebbe44152141368b22a9a7989d577a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04ae6531-75", "ovs_interfaceid": "04ae6531-75ef-4043-99f4-bfa5ef2bba59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 23:21:06 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-d5805710-9670-4f75-8e44-f7d92ad2b113 tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9f:87:19,bridge_name='br-int',has_traffic_filtering=True,id=04ae6531-75ef-4043-99f4-bfa5ef2bba59,network=Network(0916556c-7a50-48cf-8ad0-56c20de9d89f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap04ae6531-75') {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 23:21:06 user nova-compute[75045]: DEBUG os_vif [None req-d5805710-9670-4f75-8e44-f7d92ad2b113 tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9f:87:19,bridge_name='br-int',has_traffic_filtering=True,id=04ae6531-75ef-4043-99f4-bfa5ef2bba59,network=Network(0916556c-7a50-48cf-8ad0-56c20de9d89f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap04ae6531-75') {{(pid=75045) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 23:21:06 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:21:06 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap04ae6531-75, bridge=br-int, if_exists=True) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:21:06 user nova-compute[75045]: DEBUG nova.compute.provider_tree [None req-1d1f8477-7295-4e7a-8ef1-db1bb1469775 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262-project-member] Inventory has not changed in ProviderTree for provider: 62ba5f85-c74d-4b58-986e-d4197e813fd7 {{(pid=75045) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 23:21:06 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:21:06 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 23:21:06 user nova-compute[75045]: DEBUG nova.scheduler.client.report [None req-1d1f8477-7295-4e7a-8ef1-db1bb1469775 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262-project-member] Inventory has not changed for provider 62ba5f85-c74d-4b58-986e-d4197e813fd7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75045) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 23:21:06 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:21:06 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:21:06 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4478fd37-16db-4b8c-961b-46c7a3bd4350) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:21:06 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:21:06 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 23:21:06 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-1d1f8477-7295-4e7a-8ef1-db1bb1469775 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.460s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:21:06 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:21:06 user nova-compute[75045]: INFO os_vif [None req-d5805710-9670-4f75-8e44-f7d92ad2b113 tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9f:87:19,bridge_name='br-int',has_traffic_filtering=True,id=04ae6531-75ef-4043-99f4-bfa5ef2bba59,network=Network(0916556c-7a50-48cf-8ad0-56c20de9d89f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap04ae6531-75')
Nov 08 23:21:06 user nova-compute[75045]: DEBUG nova.virt.libvirt.vif [None req-d5805710-9670-4f75-8e44-f7d92ad2b113 tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T23:17:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1412524117',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1412524117',id=10,image_ref='a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIOg6qdtEUL8OwbPxHJ6siVv0HGHJ2I3WU6rXK8ahHqt76KKZ8niNHuCAGdeTPkJyNSdMmrzEWjROFsrOoC1kmaY029eK7Yz3akFrk91+1J9Sq2nrDoAG6jY9mnI91XmoQ==',key_name='tempest-keypair-1736555466',keypairs=<?>,launch_index=0,launched_at=2023-11-08T23:19:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='74ebbe44152141368b22a9a7989d577a',ramdisk_id='',reservation_id='r-mgh3rv15',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-2022931664',owner_user_name='tempest-TaggedBootDevicesTest-2022931664-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T23:19:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8c4361faf9ee4444be0e061b8c8aee98',uuid=520eac4f-fa48-4e41-924d-840907e701b4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b3c645dd-a1ac-4780-a49d-916cb6a121c9", "address": "fa:16:3e:e2:e6:e2", "network": {"id": "0916556c-7a50-48cf-8ad0-56c20de9d89f", "bridge": "br-int", "label": "tempest-device-tagging-net1-573961537", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.154", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "74ebbe44152141368b22a9a7989d577a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3c645dd-a1", "ovs_interfaceid": "b3c645dd-a1ac-4780-a49d-916cb6a121c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75045) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 23:21:06 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-d5805710-9670-4f75-8e44-f7d92ad2b113 tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] Converting VIF {"id": "b3c645dd-a1ac-4780-a49d-916cb6a121c9", "address": "fa:16:3e:e2:e6:e2", "network": {"id": "0916556c-7a50-48cf-8ad0-56c20de9d89f", "bridge": "br-int", "label": "tempest-device-tagging-net1-573961537", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.154", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "74ebbe44152141368b22a9a7989d577a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3c645dd-a1", "ovs_interfaceid": "b3c645dd-a1ac-4780-a49d-916cb6a121c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 23:21:06 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-d5805710-9670-4f75-8e44-f7d92ad2b113 tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e2:e6:e2,bridge_name='br-int',has_traffic_filtering=True,id=b3c645dd-a1ac-4780-a49d-916cb6a121c9,network=Network(0916556c-7a50-48cf-8ad0-56c20de9d89f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3c645dd-a1') {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 23:21:06 user nova-compute[75045]: DEBUG os_vif [None req-d5805710-9670-4f75-8e44-f7d92ad2b113 tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e2:e6:e2,bridge_name='br-int',has_traffic_filtering=True,id=b3c645dd-a1ac-4780-a49d-916cb6a121c9,network=Network(0916556c-7a50-48cf-8ad0-56c20de9d89f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3c645dd-a1') {{(pid=75045) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 23:21:06 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:21:06 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb3c645dd-a1, bridge=br-int, if_exists=True) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:21:06 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:21:06 user nova-compute[75045]: INFO nova.scheduler.client.report [None req-1d1f8477-7295-4e7a-8ef1-db1bb1469775 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262-project-member] Deleted allocations for instance 82bc5fd0-26c7-4f81-b966-54831393b617
Nov 08 23:21:06 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 23:21:06 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:21:06 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:21:06 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2bfb84be-b1f9-4a4b-976e-9209075b4a04) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:21:06 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:21:06 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 23:21:06 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:21:06 user nova-compute[75045]: INFO os_vif [None req-d5805710-9670-4f75-8e44-f7d92ad2b113 tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e2:e6:e2,bridge_name='br-int',has_traffic_filtering=True,id=b3c645dd-a1ac-4780-a49d-916cb6a121c9,network=Network(0916556c-7a50-48cf-8ad0-56c20de9d89f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3c645dd-a1')
Nov 08 23:21:06 user nova-compute[75045]: DEBUG nova.virt.libvirt.vif [None req-d5805710-9670-4f75-8e44-f7d92ad2b113 tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T23:17:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1412524117',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1412524117',id=10,image_ref='a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIOg6qdtEUL8OwbPxHJ6siVv0HGHJ2I3WU6rXK8ahHqt76KKZ8niNHuCAGdeTPkJyNSdMmrzEWjROFsrOoC1kmaY029eK7Yz3akFrk91+1J9Sq2nrDoAG6jY9mnI91XmoQ==',key_name='tempest-keypair-1736555466',keypairs=<?>,launch_index=0,launched_at=2023-11-08T23:19:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='74ebbe44152141368b22a9a7989d577a',ramdisk_id='',reservation_id='r-mgh3rv15',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-2022931664',owner_user_name='tempest-TaggedBootDevicesTest-2022931664-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T23:19:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8c4361faf9ee4444be0e061b8c8aee98',uuid=520eac4f-fa48-4e41-924d-840907e701b4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3974ed79-74a5-4e9c-aa42-3aab1b234a39", "address": "fa:16:3e:f3:1c:29", "network": {"id": "0916556c-7a50-48cf-8ad0-56c20de9d89f", "bridge": "br-int", "label": "tempest-device-tagging-net1-573961537", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.231", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "74ebbe44152141368b22a9a7989d577a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3974ed79-74", "ovs_interfaceid": "3974ed79-74a5-4e9c-aa42-3aab1b234a39", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75045) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 23:21:06 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-d5805710-9670-4f75-8e44-f7d92ad2b113 tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] Converting VIF {"id": "3974ed79-74a5-4e9c-aa42-3aab1b234a39", "address": "fa:16:3e:f3:1c:29", "network": {"id": "0916556c-7a50-48cf-8ad0-56c20de9d89f", "bridge": "br-int", "label": "tempest-device-tagging-net1-573961537", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.231", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "74ebbe44152141368b22a9a7989d577a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3974ed79-74", "ovs_interfaceid": "3974ed79-74a5-4e9c-aa42-3aab1b234a39", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 23:21:06 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-d5805710-9670-4f75-8e44-f7d92ad2b113 tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f3:1c:29,bridge_name='br-int',has_traffic_filtering=True,id=3974ed79-74a5-4e9c-aa42-3aab1b234a39,network=Network(0916556c-7a50-48cf-8ad0-56c20de9d89f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3974ed79-74') {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 23:21:06 user nova-compute[75045]: DEBUG os_vif [None req-d5805710-9670-4f75-8e44-f7d92ad2b113 tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f3:1c:29,bridge_name='br-int',has_traffic_filtering=True,id=3974ed79-74a5-4e9c-aa42-3aab1b234a39,network=Network(0916556c-7a50-48cf-8ad0-56c20de9d89f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3974ed79-74') {{(pid=75045) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 23:21:06 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:21:06 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3974ed79-74, bridge=br-int, if_exists=True) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:21:06 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 23:21:06 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-1d1f8477-7295-4e7a-8ef1-db1bb1469775 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262 tempest-TestServerVolumeAttachScenarioOldVersion-1679099262-project-member] Lock "82bc5fd0-26c7-4f81-b966-54831393b617" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.099s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:21:06 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:21:06 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:21:06 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b0901488-4a7d-4cc7-afb4-ce85d63c70c8) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:21:06 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 23:21:06 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:21:06 user nova-compute[75045]: INFO os_vif [None req-d5805710-9670-4f75-8e44-f7d92ad2b113 tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f3:1c:29,bridge_name='br-int',has_traffic_filtering=True,id=3974ed79-74a5-4e9c-aa42-3aab1b234a39,network=Network(0916556c-7a50-48cf-8ad0-56c20de9d89f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3974ed79-74')
Nov 08 23:21:06 user nova-compute[75045]: DEBUG nova.virt.libvirt.vif [None req-d5805710-9670-4f75-8e44-f7d92ad2b113 tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T23:17:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1412524117',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1412524117',id=10,image_ref='a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIOg6qdtEUL8OwbPxHJ6siVv0HGHJ2I3WU6rXK8ahHqt76KKZ8niNHuCAGdeTPkJyNSdMmrzEWjROFsrOoC1kmaY029eK7Yz3akFrk91+1J9Sq2nrDoAG6jY9mnI91XmoQ==',key_name='tempest-keypair-1736555466',keypairs=<?>,launch_index=0,launched_at=2023-11-08T23:19:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='74ebbe44152141368b22a9a7989d577a',ramdisk_id='',reservation_id='r-mgh3rv15',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-2022931664',owner_user_name='tempest-TaggedBootDevicesTest-2022931664-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T23:19:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8c4361faf9ee4444be0e061b8c8aee98',uuid=520eac4f-fa48-4e41-924d-840907e701b4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c2155ca8-d244-401d-a80f-8c53a68b6799", "address": "fa:16:3e:a2:80:a4", "network": {"id": "5cfed969-3f78-4bc2-8d08-921447c01347", "bridge": "br-int", "label": "tempest-device-tagging-net2-1614620309", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "74ebbe44152141368b22a9a7989d577a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2155ca8-d2", "ovs_interfaceid": "c2155ca8-d244-401d-a80f-8c53a68b6799", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75045) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 23:21:06 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-d5805710-9670-4f75-8e44-f7d92ad2b113 tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] Converting VIF {"id": "c2155ca8-d244-401d-a80f-8c53a68b6799", "address": "fa:16:3e:a2:80:a4", "network": {"id": "5cfed969-3f78-4bc2-8d08-921447c01347", "bridge": "br-int", "label": "tempest-device-tagging-net2-1614620309", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "74ebbe44152141368b22a9a7989d577a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2155ca8-d2", "ovs_interfaceid": "c2155ca8-d244-401d-a80f-8c53a68b6799", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 23:21:06 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-d5805710-9670-4f75-8e44-f7d92ad2b113 tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a2:80:a4,bridge_name='br-int',has_traffic_filtering=True,id=c2155ca8-d244-401d-a80f-8c53a68b6799,network=Network(5cfed969-3f78-4bc2-8d08-921447c01347),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc2155ca8-d2') {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 23:21:06 user nova-compute[75045]: DEBUG os_vif [None req-d5805710-9670-4f75-8e44-f7d92ad2b113 tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a2:80:a4,bridge_name='br-int',has_traffic_filtering=True,id=c2155ca8-d244-401d-a80f-8c53a68b6799,network=Network(5cfed969-3f78-4bc2-8d08-921447c01347),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc2155ca8-d2') {{(pid=75045) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 23:21:06 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:21:06 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc2155ca8-d2, bridge=br-int, if_exists=True) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:21:06 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:21:06 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 23:21:06 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:21:06 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:21:06 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6c688b42-17ee-497f-828d-7fd165553681) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:21:06 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:21:06 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 23:21:06 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:21:06 user nova-compute[75045]: INFO os_vif [None req-d5805710-9670-4f75-8e44-f7d92ad2b113 tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a2:80:a4,bridge_name='br-int',has_traffic_filtering=True,id=c2155ca8-d244-401d-a80f-8c53a68b6799,network=Network(5cfed969-3f78-4bc2-8d08-921447c01347),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc2155ca8-d2')
Nov 08 23:21:06 user nova-compute[75045]: DEBUG nova.virt.libvirt.vif [None req-d5805710-9670-4f75-8e44-f7d92ad2b113 tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T23:17:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1412524117',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1412524117',id=10,image_ref='a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIOg6qdtEUL8OwbPxHJ6siVv0HGHJ2I3WU6rXK8ahHqt76KKZ8niNHuCAGdeTPkJyNSdMmrzEWjROFsrOoC1kmaY029eK7Yz3akFrk91+1J9Sq2nrDoAG6jY9mnI91XmoQ==',key_name='tempest-keypair-1736555466',keypairs=<?>,launch_index=0,launched_at=2023-11-08T23:19:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='74ebbe44152141368b22a9a7989d577a',ramdisk_id='',reservation_id='r-mgh3rv15',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-2022931664',owner_user_name='tempest-TaggedBootDevicesTest-2022931664-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T23:19:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8c4361faf9ee4444be0e061b8c8aee98',uuid=520eac4f-fa48-4e41-924d-840907e701b4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "768830de-7c2e-45ca-959e-398480b6ba29", "address": "fa:16:3e:bc:05:cc", "network": {"id": "5cfed969-3f78-4bc2-8d08-921447c01347", "bridge": "br-int", "label": "tempest-device-tagging-net2-1614620309", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "74ebbe44152141368b22a9a7989d577a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap768830de-7c", "ovs_interfaceid": "768830de-7c2e-45ca-959e-398480b6ba29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75045) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 23:21:06 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-d5805710-9670-4f75-8e44-f7d92ad2b113 tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] Converting VIF {"id": "768830de-7c2e-45ca-959e-398480b6ba29", "address": "fa:16:3e:bc:05:cc", "network": {"id": "5cfed969-3f78-4bc2-8d08-921447c01347", "bridge": "br-int", "label": "tempest-device-tagging-net2-1614620309", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "74ebbe44152141368b22a9a7989d577a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap768830de-7c", "ovs_interfaceid": "768830de-7c2e-45ca-959e-398480b6ba29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 23:21:06 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-d5805710-9670-4f75-8e44-f7d92ad2b113 tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bc:05:cc,bridge_name='br-int',has_traffic_filtering=True,id=768830de-7c2e-45ca-959e-398480b6ba29,network=Network(5cfed969-3f78-4bc2-8d08-921447c01347),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap768830de-7c') {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 23:21:06 user nova-compute[75045]: DEBUG os_vif [None req-d5805710-9670-4f75-8e44-f7d92ad2b113 tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bc:05:cc,bridge_name='br-int',has_traffic_filtering=True,id=768830de-7c2e-45ca-959e-398480b6ba29,network=Network(5cfed969-3f78-4bc2-8d08-921447c01347),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap768830de-7c') {{(pid=75045) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 23:21:06 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:21:06 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap768830de-7c, bridge=br-int, if_exists=True) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:21:06 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:21:06 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 23:21:06 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:21:06 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8ec7bfda-135b-45de-99e2-f7cd348d2f52) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:21:06 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:21:06 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:21:06 user nova-compute[75045]: INFO os_vif [None req-d5805710-9670-4f75-8e44-f7d92ad2b113 tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bc:05:cc,bridge_name='br-int',has_traffic_filtering=True,id=768830de-7c2e-45ca-959e-398480b6ba29,network=Network(5cfed969-3f78-4bc2-8d08-921447c01347),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap768830de-7c')
Nov 08 23:21:06 user nova-compute[75045]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d5805710-9670-4f75-8e44-f7d92ad2b113 tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] [instance: 520eac4f-fa48-4e41-924d-840907e701b4] calling os-brick to detach iSCSI Volume {{(pid=75045) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 23:21:06 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5805710-9670-4f75-8e44-f7d92ad2b113 tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1b68210460>, {'target_iqn': 'iqn.2010-10.org.openstack:175bb2c0-7767-4740-9350-7e3300681a43', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OvWeEoJS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75045) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 23:21:06 user nova-compute[75045]: WARNING os_brick.initiator.connectors.base [None req-d5805710-9670-4f75-8e44-f7d92ad2b113 tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 23:21:06 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-d5805710-9670-4f75-8e44-f7d92ad2b113 tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 23:21:06 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-d5805710-9670-4f75-8e44-f7d92ad2b113 tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 23:21:06 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:21:06 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:21:06 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0e932c4-f25b-4361-946b-2ccdcad5e9d2]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8d2ff5d0-0b89-42ba-92eb-1e12c9cce205\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6ed77146-5ae0-400d-8116-7f9eb1322808\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:175bb2c0-7767-4740-9350-7e3300681a43\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c7f7084f-f0d7-4d4b-9a14-69065a9c3e41\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:21:06 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5805710-9670-4f75-8e44-f7d92ad2b113 tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 23:21:06 user nova-compute[75045]: No targets found.
Nov 08 23:21:06 user nova-compute[75045]: iSNS:
Nov 08 23:21:06 user nova-compute[75045]: No targets found.
Nov 08 23:21:06 user nova-compute[75045]: STATIC:
Nov 08 23:21:06 user nova-compute[75045]: Target: iqn.2010-10.org.openstack:8d2ff5d0-0b89-42ba-92eb-1e12c9cce205
Nov 08 23:21:06 user nova-compute[75045]:         Portal: 172.16.0.220:3260,-1
Nov 08 23:21:06 user nova-compute[75045]:                 Iface Name: default
Nov 08 23:21:06 user nova-compute[75045]: Target: iqn.2010-10.org.openstack:6ed77146-5ae0-400d-8116-7f9eb1322808
Nov 08 23:21:06 user nova-compute[75045]:         Portal: 172.16.0.220:3260,-1
Nov 08 23:21:06 user nova-compute[75045]:                 Iface Name: default
Nov 08 23:21:06 user nova-compute[75045]: Target: iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab
Nov 08 23:21:06 user nova-compute[75045]:         Portal: 172.16.0.220:3260,-1
Nov 08 23:21:06 user nova-compute[75045]:                 Iface Name: default
Nov 08 23:21:06 user nova-compute[75045]: Target: iqn.2010-10.org.openstack:175bb2c0-7767-4740-9350-7e3300681a43
Nov 08 23:21:06 user nova-compute[75045]:         Portal: 172.16.0.220:3260,-1
Nov 08 23:21:06 user nova-compute[75045]:                 Iface Name: default
Nov 08 23:21:06 user nova-compute[75045]: Target: iqn.2010-10.org.openstack:c7f7084f-f0d7-4d4b-9a14-69065a9c3e41
Nov 08 23:21:06 user nova-compute[75045]:         Portal: 172.16.0.220:3260,-1
Nov 08 23:21:06 user nova-compute[75045]:                 Iface Name: default
Nov 08 23:21:06 user nova-compute[75045]: FIRMWARE:
Nov 08 23:21:06 user nova-compute[75045]: No targets found.
Nov 08 23:21:06 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 23:21:06 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5805710-9670-4f75-8e44-f7d92ad2b113 tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 23:21:06 user nova-compute[75045]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 23:21:06 user nova-compute[75045]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75045) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 23:21:06 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5805710-9670-4f75-8e44-f7d92ad2b113 tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:175bb2c0-7767-4740-9350-7e3300681a43', 0)] {{(pid=75045) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 23:21:06 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:21:06 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:21:06 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2b16a73-ddca-4a99-83aa-eeafa68fa4fd]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:175bb2c0-7767-4740-9350-7e3300681a43\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6ed77146-5ae0-400d-8116-7f9eb1322808\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8d2ff5d0-0b89-42ba-92eb-1e12c9cce205\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c7f7084f-f0d7-4d4b-9a14-69065a9c3e41\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:21:06 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:21:07 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:21:07 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[af272e3f-b7f4-4203-9517-e7e89ed016d5]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d2ff5d0-0b89-42ba-92eb-1e12c9cce205 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7f7084f-f0d7-4d4b-9a14-69065a9c3e41 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:175bb2c0-7767-4740-9350-7e3300681a43 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ed77146-5ae0-400d-8116-7f9eb1322808 (non-flash)\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:21:07 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5805710-9670-4f75-8e44-f7d92ad2b113 tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d2ff5d0-0b89-42ba-92eb-1e12c9cce205 (non-flash)
Nov 08 23:21:07 user nova-compute[75045]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab (non-flash)
Nov 08 23:21:07 user nova-compute[75045]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7f7084f-f0d7-4d4b-9a14-69065a9c3e41 (non-flash)
Nov 08 23:21:07 user nova-compute[75045]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:175bb2c0-7767-4740-9350-7e3300681a43 (non-flash)
Nov 08 23:21:07 user nova-compute[75045]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ed77146-5ae0-400d-8116-7f9eb1322808 (non-flash)
Nov 08 23:21:07 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 23:21:07 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5805710-9670-4f75-8e44-f7d92ad2b113 tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d2ff5d0-0b89-42ba-92eb-1e12c9cce205 (non-flash)
Nov 08 23:21:07 user nova-compute[75045]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab (non-flash)
Nov 08 23:21:07 user nova-compute[75045]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7f7084f-f0d7-4d4b-9a14-69065a9c3e41 (non-flash)
Nov 08 23:21:07 user nova-compute[75045]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:175bb2c0-7767-4740-9350-7e3300681a43 (non-flash)
Nov 08 23:21:07 user nova-compute[75045]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ed77146-5ae0-400d-8116-7f9eb1322808 (non-flash)
Nov 08 23:21:07 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 23:21:07 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5805710-9670-4f75-8e44-f7d92ad2b113 tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1b68269ab0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:175bb2c0-7767-4740-9350-7e3300681a43'): ({'sdb'}, set())}) {{(pid=75045) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 23:21:07 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-d5805710-9670-4f75-8e44-f7d92ad2b113 tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] Removing single pathed devices sdb {{(pid=75045) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 23:21:07 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:21:07 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:21:07 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[102fb35e-0176-45af-bee7-b0e1509d141b]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:21:07 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:21:07 user nova-compute[75045]: DEBUG nova.compute.manager [req-58e5bd4b-0d69-4c65-bc13-6a63e1e72769 req-cb7ae98d-7146-42c5-9dea-58bddb1646c6 service nova] [instance: 520eac4f-fa48-4e41-924d-840907e701b4] Received event network-vif-plugged-25776e3e-60d6-457c-a78a-a59df0e3e7b5 {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:21:07 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-58e5bd4b-0d69-4c65-bc13-6a63e1e72769 req-cb7ae98d-7146-42c5-9dea-58bddb1646c6 service nova] Acquiring lock "520eac4f-fa48-4e41-924d-840907e701b4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:21:07 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-58e5bd4b-0d69-4c65-bc13-6a63e1e72769 req-cb7ae98d-7146-42c5-9dea-58bddb1646c6 service nova] Lock "520eac4f-fa48-4e41-924d-840907e701b4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:21:07 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-58e5bd4b-0d69-4c65-bc13-6a63e1e72769 req-cb7ae98d-7146-42c5-9dea-58bddb1646c6 service nova] Lock "520eac4f-fa48-4e41-924d-840907e701b4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:21:07 user nova-compute[75045]: DEBUG nova.compute.manager [req-58e5bd4b-0d69-4c65-bc13-6a63e1e72769 req-cb7ae98d-7146-42c5-9dea-58bddb1646c6 service nova] [instance: 520eac4f-fa48-4e41-924d-840907e701b4] No waiting events found dispatching network-vif-plugged-25776e3e-60d6-457c-a78a-a59df0e3e7b5 {{(pid=75045) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 23:21:07 user nova-compute[75045]: WARNING nova.compute.manager [req-58e5bd4b-0d69-4c65-bc13-6a63e1e72769 req-cb7ae98d-7146-42c5-9dea-58bddb1646c6 service nova] [instance: 520eac4f-fa48-4e41-924d-840907e701b4] Received unexpected event network-vif-plugged-25776e3e-60d6-457c-a78a-a59df0e3e7b5 for instance with vm_state active and task_state deleting.
Nov 08 23:21:07 user nova-compute[75045]: DEBUG nova.compute.manager [req-58e5bd4b-0d69-4c65-bc13-6a63e1e72769 req-cb7ae98d-7146-42c5-9dea-58bddb1646c6 service nova] [instance: 520eac4f-fa48-4e41-924d-840907e701b4] Received event network-vif-unplugged-bcd0d9eb-775a-4e28-b712-148c1fe99521 {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:21:07 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-58e5bd4b-0d69-4c65-bc13-6a63e1e72769 req-cb7ae98d-7146-42c5-9dea-58bddb1646c6 service nova] Acquiring lock "520eac4f-fa48-4e41-924d-840907e701b4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:21:07 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-58e5bd4b-0d69-4c65-bc13-6a63e1e72769 req-cb7ae98d-7146-42c5-9dea-58bddb1646c6 service nova] Lock "520eac4f-fa48-4e41-924d-840907e701b4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:21:07 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-58e5bd4b-0d69-4c65-bc13-6a63e1e72769 req-cb7ae98d-7146-42c5-9dea-58bddb1646c6 service nova] Lock "520eac4f-fa48-4e41-924d-840907e701b4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:21:07 user nova-compute[75045]: DEBUG nova.compute.manager [req-58e5bd4b-0d69-4c65-bc13-6a63e1e72769 req-cb7ae98d-7146-42c5-9dea-58bddb1646c6 service nova] [instance: 520eac4f-fa48-4e41-924d-840907e701b4] No waiting events found dispatching network-vif-unplugged-bcd0d9eb-775a-4e28-b712-148c1fe99521 {{(pid=75045) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 23:21:07 user nova-compute[75045]: DEBUG nova.compute.manager [req-58e5bd4b-0d69-4c65-bc13-6a63e1e72769 req-cb7ae98d-7146-42c5-9dea-58bddb1646c6 service nova] [instance: 520eac4f-fa48-4e41-924d-840907e701b4] Received event network-vif-unplugged-bcd0d9eb-775a-4e28-b712-148c1fe99521 for instance with task_state deleting. {{(pid=75045) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 23:21:07 user nova-compute[75045]: DEBUG nova.compute.manager [req-58e5bd4b-0d69-4c65-bc13-6a63e1e72769 req-cb7ae98d-7146-42c5-9dea-58bddb1646c6 service nova] [instance: 82bc5fd0-26c7-4f81-b966-54831393b617] Received event network-vif-deleted-5d77f7bf-dc8f-4aa2-9c4a-48d0e81d7451 {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:21:07 user nova-compute[75045]: DEBUG nova.compute.manager [req-58e5bd4b-0d69-4c65-bc13-6a63e1e72769 req-cb7ae98d-7146-42c5-9dea-58bddb1646c6 service nova] [instance: 520eac4f-fa48-4e41-924d-840907e701b4] Received event network-vif-plugged-bcd0d9eb-775a-4e28-b712-148c1fe99521 {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:21:07 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-58e5bd4b-0d69-4c65-bc13-6a63e1e72769 req-cb7ae98d-7146-42c5-9dea-58bddb1646c6 service nova] Acquiring lock "520eac4f-fa48-4e41-924d-840907e701b4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:21:07 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-58e5bd4b-0d69-4c65-bc13-6a63e1e72769 req-cb7ae98d-7146-42c5-9dea-58bddb1646c6 service nova] Lock "520eac4f-fa48-4e41-924d-840907e701b4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:21:07 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-58e5bd4b-0d69-4c65-bc13-6a63e1e72769 req-cb7ae98d-7146-42c5-9dea-58bddb1646c6 service nova] Lock "520eac4f-fa48-4e41-924d-840907e701b4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:21:07 user nova-compute[75045]: DEBUG nova.compute.manager [req-58e5bd4b-0d69-4c65-bc13-6a63e1e72769 req-cb7ae98d-7146-42c5-9dea-58bddb1646c6 service nova] [instance: 520eac4f-fa48-4e41-924d-840907e701b4] No waiting events found dispatching network-vif-plugged-bcd0d9eb-775a-4e28-b712-148c1fe99521 {{(pid=75045) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 23:21:07 user nova-compute[75045]: WARNING nova.compute.manager [req-58e5bd4b-0d69-4c65-bc13-6a63e1e72769 req-cb7ae98d-7146-42c5-9dea-58bddb1646c6 service nova] [instance: 520eac4f-fa48-4e41-924d-840907e701b4] Received unexpected event network-vif-plugged-bcd0d9eb-775a-4e28-b712-148c1fe99521 for instance with vm_state active and task_state deleting.
Nov 08 23:21:07 user nova-compute[75045]: DEBUG nova.compute.manager [req-58e5bd4b-0d69-4c65-bc13-6a63e1e72769 req-cb7ae98d-7146-42c5-9dea-58bddb1646c6 service nova] [instance: 520eac4f-fa48-4e41-924d-840907e701b4] Received event network-vif-unplugged-04ae6531-75ef-4043-99f4-bfa5ef2bba59 {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:21:07 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-58e5bd4b-0d69-4c65-bc13-6a63e1e72769 req-cb7ae98d-7146-42c5-9dea-58bddb1646c6 service nova] Acquiring lock "520eac4f-fa48-4e41-924d-840907e701b4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:21:07 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-58e5bd4b-0d69-4c65-bc13-6a63e1e72769 req-cb7ae98d-7146-42c5-9dea-58bddb1646c6 service nova] Lock "520eac4f-fa48-4e41-924d-840907e701b4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:21:07 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-58e5bd4b-0d69-4c65-bc13-6a63e1e72769 req-cb7ae98d-7146-42c5-9dea-58bddb1646c6 service nova] Lock "520eac4f-fa48-4e41-924d-840907e701b4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:21:07 user nova-compute[75045]: DEBUG nova.compute.manager [req-58e5bd4b-0d69-4c65-bc13-6a63e1e72769 req-cb7ae98d-7146-42c5-9dea-58bddb1646c6 service nova] [instance: 520eac4f-fa48-4e41-924d-840907e701b4] No waiting events found dispatching network-vif-unplugged-04ae6531-75ef-4043-99f4-bfa5ef2bba59 {{(pid=75045) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 23:21:07 user nova-compute[75045]: DEBUG nova.compute.manager [req-58e5bd4b-0d69-4c65-bc13-6a63e1e72769 req-cb7ae98d-7146-42c5-9dea-58bddb1646c6 service nova] [instance: 520eac4f-fa48-4e41-924d-840907e701b4] Received event network-vif-unplugged-04ae6531-75ef-4043-99f4-bfa5ef2bba59 for instance with task_state deleting. {{(pid=75045) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 23:21:07 user nova-compute[75045]: DEBUG nova.compute.manager [req-58e5bd4b-0d69-4c65-bc13-6a63e1e72769 req-cb7ae98d-7146-42c5-9dea-58bddb1646c6 service nova] [instance: 520eac4f-fa48-4e41-924d-840907e701b4] Received event network-vif-plugged-04ae6531-75ef-4043-99f4-bfa5ef2bba59 {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:21:07 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-58e5bd4b-0d69-4c65-bc13-6a63e1e72769 req-cb7ae98d-7146-42c5-9dea-58bddb1646c6 service nova] Acquiring lock "520eac4f-fa48-4e41-924d-840907e701b4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:21:07 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-58e5bd4b-0d69-4c65-bc13-6a63e1e72769 req-cb7ae98d-7146-42c5-9dea-58bddb1646c6 service nova] Lock "520eac4f-fa48-4e41-924d-840907e701b4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:21:07 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-58e5bd4b-0d69-4c65-bc13-6a63e1e72769 req-cb7ae98d-7146-42c5-9dea-58bddb1646c6 service nova] Lock "520eac4f-fa48-4e41-924d-840907e701b4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:21:07 user nova-compute[75045]: DEBUG nova.compute.manager [req-58e5bd4b-0d69-4c65-bc13-6a63e1e72769 req-cb7ae98d-7146-42c5-9dea-58bddb1646c6 service nova] [instance: 520eac4f-fa48-4e41-924d-840907e701b4] No waiting events found dispatching network-vif-plugged-04ae6531-75ef-4043-99f4-bfa5ef2bba59 {{(pid=75045) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 23:21:07 user nova-compute[75045]: WARNING nova.compute.manager [req-58e5bd4b-0d69-4c65-bc13-6a63e1e72769 req-cb7ae98d-7146-42c5-9dea-58bddb1646c6 service nova] [instance: 520eac4f-fa48-4e41-924d-840907e701b4] Received unexpected event network-vif-plugged-04ae6531-75ef-4043-99f4-bfa5ef2bba59 for instance with vm_state active and task_state deleting.
Nov 08 23:21:07 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.022s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:21:07 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[221135c7-4897-4efb-9de0-2ce15a558b70]: (4, ('ok\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:21:07 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-d5805710-9670-4f75-8e44-f7d92ad2b113 tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] Flushing IO for device /dev/sdb {{(pid=75045) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 23:21:07 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:21:07 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:21:07 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c76ee93-30eb-40b6-af91-db408a594ee0]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:21:07 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-d5805710-9670-4f75-8e44-f7d92ad2b113 tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75045) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 23:21:07 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:21:07 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.038s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:21:07 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7a9de09-7c1f-4bf3-88d6-5056bb96a9a0]: (4, ('1', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:21:07 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-d5805710-9670-4f75-8e44-f7d92ad2b113 tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75045) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 23:21:07 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-d5805710-9670-4f75-8e44-f7d92ad2b113 tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] SCSI volumes sdb have been removed. {{(pid=75045) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 23:21:07 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5805710-9670-4f75-8e44-f7d92ad2b113 tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:175bb2c0-7767-4740-9350-7e3300681a43')] {{(pid=75045) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 23:21:07 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:175bb2c0-7767-4740-9350-7e3300681a43 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:21:07 user nova-compute[75045]: DEBUG nova.compute.manager [req-bad71c81-1d0f-4a41-bd62-454fe25e0171 req-f481f11c-6ad0-41fc-a746-59586c3cdf29 service nova] [instance: 520eac4f-fa48-4e41-924d-840907e701b4] Received event network-vif-unplugged-3974ed79-74a5-4e9c-aa42-3aab1b234a39 {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:21:07 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-bad71c81-1d0f-4a41-bd62-454fe25e0171 req-f481f11c-6ad0-41fc-a746-59586c3cdf29 service nova] Acquiring lock "520eac4f-fa48-4e41-924d-840907e701b4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:21:07 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-bad71c81-1d0f-4a41-bd62-454fe25e0171 req-f481f11c-6ad0-41fc-a746-59586c3cdf29 service nova] Lock "520eac4f-fa48-4e41-924d-840907e701b4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:21:07 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-bad71c81-1d0f-4a41-bd62-454fe25e0171 req-f481f11c-6ad0-41fc-a746-59586c3cdf29 service nova] Lock "520eac4f-fa48-4e41-924d-840907e701b4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:21:07 user nova-compute[75045]: DEBUG nova.compute.manager [req-bad71c81-1d0f-4a41-bd62-454fe25e0171 req-f481f11c-6ad0-41fc-a746-59586c3cdf29 service nova] [instance: 520eac4f-fa48-4e41-924d-840907e701b4] No waiting events found dispatching network-vif-unplugged-3974ed79-74a5-4e9c-aa42-3aab1b234a39 {{(pid=75045) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 23:21:07 user nova-compute[75045]: DEBUG nova.compute.manager [req-bad71c81-1d0f-4a41-bd62-454fe25e0171 req-f481f11c-6ad0-41fc-a746-59586c3cdf29 service nova] [instance: 520eac4f-fa48-4e41-924d-840907e701b4] Received event network-vif-unplugged-3974ed79-74a5-4e9c-aa42-3aab1b234a39 for instance with task_state deleting. {{(pid=75045) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 23:21:07 user nova-compute[75045]: DEBUG nova.compute.manager [req-bad71c81-1d0f-4a41-bd62-454fe25e0171 req-f481f11c-6ad0-41fc-a746-59586c3cdf29 service nova] [instance: 520eac4f-fa48-4e41-924d-840907e701b4] Received event network-vif-plugged-3974ed79-74a5-4e9c-aa42-3aab1b234a39 {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:21:07 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-bad71c81-1d0f-4a41-bd62-454fe25e0171 req-f481f11c-6ad0-41fc-a746-59586c3cdf29 service nova] Acquiring lock "520eac4f-fa48-4e41-924d-840907e701b4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:21:07 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-bad71c81-1d0f-4a41-bd62-454fe25e0171 req-f481f11c-6ad0-41fc-a746-59586c3cdf29 service nova] Lock "520eac4f-fa48-4e41-924d-840907e701b4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:21:07 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-bad71c81-1d0f-4a41-bd62-454fe25e0171 req-f481f11c-6ad0-41fc-a746-59586c3cdf29 service nova] Lock "520eac4f-fa48-4e41-924d-840907e701b4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:21:07 user nova-compute[75045]: DEBUG nova.compute.manager [req-bad71c81-1d0f-4a41-bd62-454fe25e0171 req-f481f11c-6ad0-41fc-a746-59586c3cdf29 service nova] [instance: 520eac4f-fa48-4e41-924d-840907e701b4] No waiting events found dispatching network-vif-plugged-3974ed79-74a5-4e9c-aa42-3aab1b234a39 {{(pid=75045) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 23:21:07 user nova-compute[75045]: WARNING nova.compute.manager [req-bad71c81-1d0f-4a41-bd62-454fe25e0171 req-f481f11c-6ad0-41fc-a746-59586c3cdf29 service nova] [instance: 520eac4f-fa48-4e41-924d-840907e701b4] Received unexpected event network-vif-plugged-3974ed79-74a5-4e9c-aa42-3aab1b234a39 for instance with vm_state active and task_state deleting.
Nov 08 23:21:07 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:175bb2c0-7767-4740-9350-7e3300681a43 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:21:07 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2f209ac-8a1a-4c73-8645-751bbbf13e30]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:21:07 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5805710-9670-4f75-8e44-f7d92ad2b113 tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:21:07 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:175bb2c0-7767-4740-9350-7e3300681a43 -p 172.16.0.220:3260 --logout {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:21:07 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:175bb2c0-7767-4740-9350-7e3300681a43 -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:21:07 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[47dc2bf7-993f-4c08-8ef2-8aa494bb5803]: (4, ('Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:175bb2c0-7767-4740-9350-7e3300681a43, portal: 172.16.0.220,3260]\nLogout of [sid: 8, target: iqn.2010-10.org.openstack:175bb2c0-7767-4740-9350-7e3300681a43, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:21:07 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5805710-9670-4f75-8e44-f7d92ad2b113 tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:175bb2c0-7767-4740-9350-7e3300681a43, portal: 172.16.0.220,3260]
Nov 08 23:21:07 user nova-compute[75045]: Logout of [sid: 8, target: iqn.2010-10.org.openstack:175bb2c0-7767-4740-9350-7e3300681a43, portal: 172.16.0.220,3260] successful.
Nov 08 23:21:07 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:21:07 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:175bb2c0-7767-4740-9350-7e3300681a43 -p 172.16.0.220:3260 --op delete {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:21:07 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:175bb2c0-7767-4740-9350-7e3300681a43 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:21:07 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[df16a22f-0bc1-45f8-b58a-3fda4cd638a9]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:21:07 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5805710-9670-4f75-8e44-f7d92ad2b113 tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:21:07 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-d5805710-9670-4f75-8e44-f7d92ad2b113 tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.372s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 23:21:07 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5805710-9670-4f75-8e44-f7d92ad2b113 tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] <== disconnect_volume: return (375ms) None {{(pid=75045) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 23:21:07 user nova-compute[75045]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d5805710-9670-4f75-8e44-f7d92ad2b113 tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] [instance: 520eac4f-fa48-4e41-924d-840907e701b4] Disconnected iSCSI Volume {{(pid=75045) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 23:21:07 user nova-compute[75045]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d5805710-9670-4f75-8e44-f7d92ad2b113 tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] [instance: 520eac4f-fa48-4e41-924d-840907e701b4] calling os-brick to detach iSCSI Volume {{(pid=75045) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 23:21:07 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5805710-9670-4f75-8e44-f7d92ad2b113 tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1b68210460>, {'target_iqn': 'iqn.2010-10.org.openstack:6ed77146-5ae0-400d-8116-7f9eb1322808', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kgnpmWxr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75045) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 23:21:07 user nova-compute[75045]: WARNING os_brick.initiator.connectors.base [None req-d5805710-9670-4f75-8e44-f7d92ad2b113 tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 23:21:07 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-d5805710-9670-4f75-8e44-f7d92ad2b113 tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 23:21:07 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-d5805710-9670-4f75-8e44-f7d92ad2b113 tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 23:21:07 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:21:07 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:21:07 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd2132e2-fbc3-4bc9-bf4f-bc6bd67f831d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8d2ff5d0-0b89-42ba-92eb-1e12c9cce205\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6ed77146-5ae0-400d-8116-7f9eb1322808\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c7f7084f-f0d7-4d4b-9a14-69065a9c3e41\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:21:07 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5805710-9670-4f75-8e44-f7d92ad2b113 tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 23:21:07 user nova-compute[75045]: No targets found.
Nov 08 23:21:07 user nova-compute[75045]: iSNS:
Nov 08 23:21:07 user nova-compute[75045]: No targets found.
Nov 08 23:21:07 user nova-compute[75045]: STATIC:
Nov 08 23:21:07 user nova-compute[75045]: Target: iqn.2010-10.org.openstack:8d2ff5d0-0b89-42ba-92eb-1e12c9cce205
Nov 08 23:21:07 user nova-compute[75045]:         Portal: 172.16.0.220:3260,-1
Nov 08 23:21:07 user nova-compute[75045]:                 Iface Name: default
Nov 08 23:21:07 user nova-compute[75045]: Target: iqn.2010-10.org.openstack:6ed77146-5ae0-400d-8116-7f9eb1322808
Nov 08 23:21:07 user nova-compute[75045]:         Portal: 172.16.0.220:3260,-1
Nov 08 23:21:07 user nova-compute[75045]:                 Iface Name: default
Nov 08 23:21:07 user nova-compute[75045]: Target: iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab
Nov 08 23:21:07 user nova-compute[75045]:         Portal: 172.16.0.220:3260,-1
Nov 08 23:21:07 user nova-compute[75045]:                 Iface Name: default
Nov 08 23:21:07 user nova-compute[75045]: Target: iqn.2010-10.org.openstack:c7f7084f-f0d7-4d4b-9a14-69065a9c3e41
Nov 08 23:21:07 user nova-compute[75045]:         Portal: 172.16.0.220:3260,-1
Nov 08 23:21:07 user nova-compute[75045]:                 Iface Name: default
Nov 08 23:21:07 user nova-compute[75045]: FIRMWARE:
Nov 08 23:21:07 user nova-compute[75045]: No targets found.
Nov 08 23:21:07 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 23:21:07 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5805710-9670-4f75-8e44-f7d92ad2b113 tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 23:21:07 user nova-compute[75045]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 23:21:07 user nova-compute[75045]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75045) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 23:21:07 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5805710-9670-4f75-8e44-f7d92ad2b113 tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6ed77146-5ae0-400d-8116-7f9eb1322808', 0)] {{(pid=75045) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 23:21:07 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:21:07 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:21:07 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b542f2d-0096-4e41-a9a5-0cbffcd453f8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6ed77146-5ae0-400d-8116-7f9eb1322808\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8d2ff5d0-0b89-42ba-92eb-1e12c9cce205\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c7f7084f-f0d7-4d4b-9a14-69065a9c3e41\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:21:07 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:21:07 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:21:07 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc61e761-c908-4307-9770-b6ba5d9dd348]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d2ff5d0-0b89-42ba-92eb-1e12c9cce205 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7f7084f-f0d7-4d4b-9a14-69065a9c3e41 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ed77146-5ae0-400d-8116-7f9eb1322808 (non-flash)\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:21:07 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5805710-9670-4f75-8e44-f7d92ad2b113 tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d2ff5d0-0b89-42ba-92eb-1e12c9cce205 (non-flash)
Nov 08 23:21:07 user nova-compute[75045]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab (non-flash)
Nov 08 23:21:07 user nova-compute[75045]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7f7084f-f0d7-4d4b-9a14-69065a9c3e41 (non-flash)
Nov 08 23:21:07 user nova-compute[75045]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ed77146-5ae0-400d-8116-7f9eb1322808 (non-flash)
Nov 08 23:21:07 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 23:21:07 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5805710-9670-4f75-8e44-f7d92ad2b113 tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d2ff5d0-0b89-42ba-92eb-1e12c9cce205 (non-flash)
Nov 08 23:21:07 user nova-compute[75045]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab (non-flash)
Nov 08 23:21:07 user nova-compute[75045]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7f7084f-f0d7-4d4b-9a14-69065a9c3e41 (non-flash)
Nov 08 23:21:07 user nova-compute[75045]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ed77146-5ae0-400d-8116-7f9eb1322808 (non-flash)
Nov 08 23:21:07 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 23:21:07 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5805710-9670-4f75-8e44-f7d92ad2b113 tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1b485ea9e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6ed77146-5ae0-400d-8116-7f9eb1322808'): ({'sdc'}, set())}) {{(pid=75045) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 23:21:07 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-d5805710-9670-4f75-8e44-f7d92ad2b113 tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] Removing single pathed devices sdc {{(pid=75045) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 23:21:07 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:21:07 user nova-compute[75045]: DEBUG nova.compute.manager [req-52d03aa7-7e53-4053-a715-80edf11c69de req-ae5fc0bf-2305-487e-8e1c-e5420f6d7a92 service nova] [instance: 520eac4f-fa48-4e41-924d-840907e701b4] Received event network-vif-plugged-b3c645dd-a1ac-4780-a49d-916cb6a121c9 {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:21:07 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-52d03aa7-7e53-4053-a715-80edf11c69de req-ae5fc0bf-2305-487e-8e1c-e5420f6d7a92 service nova] Acquiring lock "520eac4f-fa48-4e41-924d-840907e701b4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:21:07 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-52d03aa7-7e53-4053-a715-80edf11c69de req-ae5fc0bf-2305-487e-8e1c-e5420f6d7a92 service nova] Lock "520eac4f-fa48-4e41-924d-840907e701b4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:21:07 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-52d03aa7-7e53-4053-a715-80edf11c69de req-ae5fc0bf-2305-487e-8e1c-e5420f6d7a92 service nova] Lock "520eac4f-fa48-4e41-924d-840907e701b4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:21:07 user nova-compute[75045]: DEBUG nova.compute.manager [req-52d03aa7-7e53-4053-a715-80edf11c69de req-ae5fc0bf-2305-487e-8e1c-e5420f6d7a92 service nova] [instance: 520eac4f-fa48-4e41-924d-840907e701b4] No waiting events found dispatching network-vif-plugged-b3c645dd-a1ac-4780-a49d-916cb6a121c9 {{(pid=75045) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 23:21:07 user nova-compute[75045]: WARNING nova.compute.manager [req-52d03aa7-7e53-4053-a715-80edf11c69de req-ae5fc0bf-2305-487e-8e1c-e5420f6d7a92 service nova] [instance: 520eac4f-fa48-4e41-924d-840907e701b4] Received unexpected event network-vif-plugged-b3c645dd-a1ac-4780-a49d-916cb6a121c9 for instance with vm_state active and task_state deleting.
Nov 08 23:21:07 user nova-compute[75045]: DEBUG nova.compute.manager [req-52d03aa7-7e53-4053-a715-80edf11c69de req-ae5fc0bf-2305-487e-8e1c-e5420f6d7a92 service nova] [instance: 520eac4f-fa48-4e41-924d-840907e701b4] Received event network-vif-unplugged-c2155ca8-d244-401d-a80f-8c53a68b6799 {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:21:07 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-52d03aa7-7e53-4053-a715-80edf11c69de req-ae5fc0bf-2305-487e-8e1c-e5420f6d7a92 service nova] Acquiring lock "520eac4f-fa48-4e41-924d-840907e701b4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:21:07 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-52d03aa7-7e53-4053-a715-80edf11c69de req-ae5fc0bf-2305-487e-8e1c-e5420f6d7a92 service nova] Lock "520eac4f-fa48-4e41-924d-840907e701b4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:21:07 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-52d03aa7-7e53-4053-a715-80edf11c69de req-ae5fc0bf-2305-487e-8e1c-e5420f6d7a92 service nova] Lock "520eac4f-fa48-4e41-924d-840907e701b4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:21:07 user nova-compute[75045]: DEBUG nova.compute.manager [req-52d03aa7-7e53-4053-a715-80edf11c69de req-ae5fc0bf-2305-487e-8e1c-e5420f6d7a92 service nova] [instance: 520eac4f-fa48-4e41-924d-840907e701b4] No waiting events found dispatching network-vif-unplugged-c2155ca8-d244-401d-a80f-8c53a68b6799 {{(pid=75045) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 23:21:07 user nova-compute[75045]: DEBUG nova.compute.manager [req-52d03aa7-7e53-4053-a715-80edf11c69de req-ae5fc0bf-2305-487e-8e1c-e5420f6d7a92 service nova] [instance: 520eac4f-fa48-4e41-924d-840907e701b4] Received event network-vif-unplugged-c2155ca8-d244-401d-a80f-8c53a68b6799 for instance with task_state deleting. {{(pid=75045) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 23:21:07 user nova-compute[75045]: DEBUG nova.compute.manager [req-52d03aa7-7e53-4053-a715-80edf11c69de req-ae5fc0bf-2305-487e-8e1c-e5420f6d7a92 service nova] [instance: 520eac4f-fa48-4e41-924d-840907e701b4] Received event network-vif-plugged-c2155ca8-d244-401d-a80f-8c53a68b6799 {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:21:07 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-52d03aa7-7e53-4053-a715-80edf11c69de req-ae5fc0bf-2305-487e-8e1c-e5420f6d7a92 service nova] Acquiring lock "520eac4f-fa48-4e41-924d-840907e701b4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:21:07 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-52d03aa7-7e53-4053-a715-80edf11c69de req-ae5fc0bf-2305-487e-8e1c-e5420f6d7a92 service nova] Lock "520eac4f-fa48-4e41-924d-840907e701b4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:21:07 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-52d03aa7-7e53-4053-a715-80edf11c69de req-ae5fc0bf-2305-487e-8e1c-e5420f6d7a92 service nova] Lock "520eac4f-fa48-4e41-924d-840907e701b4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:21:07 user nova-compute[75045]: DEBUG nova.compute.manager [req-52d03aa7-7e53-4053-a715-80edf11c69de req-ae5fc0bf-2305-487e-8e1c-e5420f6d7a92 service nova] [instance: 520eac4f-fa48-4e41-924d-840907e701b4] No waiting events found dispatching network-vif-plugged-c2155ca8-d244-401d-a80f-8c53a68b6799 {{(pid=75045) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 23:21:07 user nova-compute[75045]: WARNING nova.compute.manager [req-52d03aa7-7e53-4053-a715-80edf11c69de req-ae5fc0bf-2305-487e-8e1c-e5420f6d7a92 service nova] [instance: 520eac4f-fa48-4e41-924d-840907e701b4] Received unexpected event network-vif-plugged-c2155ca8-d244-401d-a80f-8c53a68b6799 for instance with vm_state active and task_state deleting.
Nov 08 23:21:07 user nova-compute[75045]: DEBUG nova.compute.manager [req-52d03aa7-7e53-4053-a715-80edf11c69de req-ae5fc0bf-2305-487e-8e1c-e5420f6d7a92 service nova] [instance: 520eac4f-fa48-4e41-924d-840907e701b4] Received event network-vif-unplugged-768830de-7c2e-45ca-959e-398480b6ba29 {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:21:07 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-52d03aa7-7e53-4053-a715-80edf11c69de req-ae5fc0bf-2305-487e-8e1c-e5420f6d7a92 service nova] Acquiring lock "520eac4f-fa48-4e41-924d-840907e701b4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:21:07 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-52d03aa7-7e53-4053-a715-80edf11c69de req-ae5fc0bf-2305-487e-8e1c-e5420f6d7a92 service nova] Lock "520eac4f-fa48-4e41-924d-840907e701b4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:21:07 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-52d03aa7-7e53-4053-a715-80edf11c69de req-ae5fc0bf-2305-487e-8e1c-e5420f6d7a92 service nova] Lock "520eac4f-fa48-4e41-924d-840907e701b4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:21:07 user nova-compute[75045]: DEBUG nova.compute.manager [req-52d03aa7-7e53-4053-a715-80edf11c69de req-ae5fc0bf-2305-487e-8e1c-e5420f6d7a92 service nova] [instance: 520eac4f-fa48-4e41-924d-840907e701b4] No waiting events found dispatching network-vif-unplugged-768830de-7c2e-45ca-959e-398480b6ba29 {{(pid=75045) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 23:21:07 user nova-compute[75045]: DEBUG nova.compute.manager [req-52d03aa7-7e53-4053-a715-80edf11c69de req-ae5fc0bf-2305-487e-8e1c-e5420f6d7a92 service nova] [instance: 520eac4f-fa48-4e41-924d-840907e701b4] Received event network-vif-unplugged-768830de-7c2e-45ca-959e-398480b6ba29 for instance with task_state deleting. {{(pid=75045) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 23:21:07 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:21:07 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[739e9796-b234-43bb-9e84-b886e489cde1]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:21:07 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:21:07 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.022s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:21:07 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1f6124c-a9ba-431d-b59f-06e8aabec15f]: (4, ('ok\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:21:07 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-d5805710-9670-4f75-8e44-f7d92ad2b113 tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] Flushing IO for device /dev/sdc {{(pid=75045) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 23:21:07 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:21:07 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:21:07 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[038458f9-7e7c-4ce7-934c-1fe0d6c45f36]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:21:07 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-d5805710-9670-4f75-8e44-f7d92ad2b113 tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75045) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 23:21:07 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:21:07 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.084s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:21:07 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[207ab8c7-1ccb-48b2-a3d5-f42352e13d09]: (4, ('1', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:21:07 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-d5805710-9670-4f75-8e44-f7d92ad2b113 tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75045) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 23:21:07 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-d5805710-9670-4f75-8e44-f7d92ad2b113 tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] SCSI volumes sdc have been removed. {{(pid=75045) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 23:21:07 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5805710-9670-4f75-8e44-f7d92ad2b113 tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6ed77146-5ae0-400d-8116-7f9eb1322808')] {{(pid=75045) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 23:21:07 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ed77146-5ae0-400d-8116-7f9eb1322808 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:21:07 user nova-compute[75045]: DEBUG nova.network.neutron [-] [instance: 1cb1b440-0073-4a53-a0a2-e2781e021866] Updating instance_info_cache with network_info: [] {{(pid=75045) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 23:21:07 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ed77146-5ae0-400d-8116-7f9eb1322808 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:21:07 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4d1abab-c397-4d24-bdd6-fb600a2135dd]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:21:07 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5805710-9670-4f75-8e44-f7d92ad2b113 tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:21:07 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ed77146-5ae0-400d-8116-7f9eb1322808 -p 172.16.0.220:3260 --logout {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:21:07 user nova-compute[75045]: INFO nova.compute.manager [-] [instance: 1cb1b440-0073-4a53-a0a2-e2781e021866] Took 1.97 seconds to deallocate network for instance.
Nov 08 23:21:07 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ed77146-5ae0-400d-8116-7f9eb1322808 -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:21:07 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[363983a3-78bb-4cec-a143-bf03b9fee094]: (4, ('Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:6ed77146-5ae0-400d-8116-7f9eb1322808, portal: 172.16.0.220,3260]\nLogout of [sid: 9, target: iqn.2010-10.org.openstack:6ed77146-5ae0-400d-8116-7f9eb1322808, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:21:07 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5805710-9670-4f75-8e44-f7d92ad2b113 tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:6ed77146-5ae0-400d-8116-7f9eb1322808, portal: 172.16.0.220,3260]
Nov 08 23:21:07 user nova-compute[75045]: Logout of [sid: 9, target: iqn.2010-10.org.openstack:6ed77146-5ae0-400d-8116-7f9eb1322808, portal: 172.16.0.220,3260] successful.
Nov 08 23:21:07 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:21:07 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ed77146-5ae0-400d-8116-7f9eb1322808 -p 172.16.0.220:3260 --op delete {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:21:07 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ed77146-5ae0-400d-8116-7f9eb1322808 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:21:07 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f055cdf-7d54-41be-ba6f-8f28c9de6b5c]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:21:07 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5805710-9670-4f75-8e44-f7d92ad2b113 tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:21:07 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-d5805710-9670-4f75-8e44-f7d92ad2b113 tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.386s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 23:21:07 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5805710-9670-4f75-8e44-f7d92ad2b113 tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] <== disconnect_volume: return (388ms) None {{(pid=75045) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 23:21:07 user nova-compute[75045]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d5805710-9670-4f75-8e44-f7d92ad2b113 tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] [instance: 520eac4f-fa48-4e41-924d-840907e701b4] Disconnected iSCSI Volume {{(pid=75045) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 23:21:07 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-b17001c7-4eef-4c12-8560-bbc28897aeb0 tempest-TaggedAttachmentsTest-1639503389 tempest-TaggedAttachmentsTest-1639503389-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:21:07 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-b17001c7-4eef-4c12-8560-bbc28897aeb0 tempest-TaggedAttachmentsTest-1639503389 tempest-TaggedAttachmentsTest-1639503389-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:21:07 user nova-compute[75045]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d5805710-9670-4f75-8e44-f7d92ad2b113 tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] [instance: 520eac4f-fa48-4e41-924d-840907e701b4] calling os-brick to detach iSCSI Volume {{(pid=75045) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 23:21:07 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5805710-9670-4f75-8e44-f7d92ad2b113 tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1b68210460>, {'target_iqn': 'iqn.2010-10.org.openstack:8d2ff5d0-0b89-42ba-92eb-1e12c9cce205', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SroFPTjC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': True}}" {{(pid=75045) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 23:21:07 user nova-compute[75045]: WARNING os_brick.initiator.connectors.base [None req-d5805710-9670-4f75-8e44-f7d92ad2b113 tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 23:21:07 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-d5805710-9670-4f75-8e44-f7d92ad2b113 tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 23:21:07 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-d5805710-9670-4f75-8e44-f7d92ad2b113 tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 23:21:07 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:21:07 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:21:07 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe969cf3-68c8-493b-ad95-0ef84f795257]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8d2ff5d0-0b89-42ba-92eb-1e12c9cce205\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c7f7084f-f0d7-4d4b-9a14-69065a9c3e41\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:21:07 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5805710-9670-4f75-8e44-f7d92ad2b113 tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 23:21:07 user nova-compute[75045]: No targets found.
Nov 08 23:21:07 user nova-compute[75045]: iSNS:
Nov 08 23:21:07 user nova-compute[75045]: No targets found.
Nov 08 23:21:07 user nova-compute[75045]: STATIC:
Nov 08 23:21:07 user nova-compute[75045]: Target: iqn.2010-10.org.openstack:8d2ff5d0-0b89-42ba-92eb-1e12c9cce205
Nov 08 23:21:07 user nova-compute[75045]:         Portal: 172.16.0.220:3260,-1
Nov 08 23:21:07 user nova-compute[75045]:                 Iface Name: default
Nov 08 23:21:07 user nova-compute[75045]: Target: iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab
Nov 08 23:21:07 user nova-compute[75045]:         Portal: 172.16.0.220:3260,-1
Nov 08 23:21:07 user nova-compute[75045]:                 Iface Name: default
Nov 08 23:21:07 user nova-compute[75045]: Target: iqn.2010-10.org.openstack:c7f7084f-f0d7-4d4b-9a14-69065a9c3e41
Nov 08 23:21:07 user nova-compute[75045]:         Portal: 172.16.0.220:3260,-1
Nov 08 23:21:07 user nova-compute[75045]:                 Iface Name: default
Nov 08 23:21:07 user nova-compute[75045]: FIRMWARE:
Nov 08 23:21:07 user nova-compute[75045]: No targets found.
Nov 08 23:21:07 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 23:21:07 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5805710-9670-4f75-8e44-f7d92ad2b113 tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 23:21:07 user nova-compute[75045]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 23:21:07 user nova-compute[75045]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75045) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 23:21:07 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5805710-9670-4f75-8e44-f7d92ad2b113 tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8d2ff5d0-0b89-42ba-92eb-1e12c9cce205', 0)] {{(pid=75045) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 23:21:07 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:21:07 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:21:07 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[55f6311f-141b-422b-840a-99611714207b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8d2ff5d0-0b89-42ba-92eb-1e12c9cce205\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c7f7084f-f0d7-4d4b-9a14-69065a9c3e41\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:21:07 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:21:07 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:21:07 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ad9d46a-1196-43e8-8903-a31ba34c4742]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d2ff5d0-0b89-42ba-92eb-1e12c9cce205 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7f7084f-f0d7-4d4b-9a14-69065a9c3e41 (non-flash)\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:21:07 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5805710-9670-4f75-8e44-f7d92ad2b113 tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d2ff5d0-0b89-42ba-92eb-1e12c9cce205 (non-flash)
Nov 08 23:21:07 user nova-compute[75045]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab (non-flash)
Nov 08 23:21:07 user nova-compute[75045]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7f7084f-f0d7-4d4b-9a14-69065a9c3e41 (non-flash)
Nov 08 23:21:07 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 23:21:07 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5805710-9670-4f75-8e44-f7d92ad2b113 tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d2ff5d0-0b89-42ba-92eb-1e12c9cce205 (non-flash)
Nov 08 23:21:07 user nova-compute[75045]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab (non-flash)
Nov 08 23:21:07 user nova-compute[75045]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7f7084f-f0d7-4d4b-9a14-69065a9c3e41 (non-flash)
Nov 08 23:21:07 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 23:21:07 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5805710-9670-4f75-8e44-f7d92ad2b113 tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1b485d01f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8d2ff5d0-0b89-42ba-92eb-1e12c9cce205'): ({'sdg'}, set())}) {{(pid=75045) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 23:21:07 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-d5805710-9670-4f75-8e44-f7d92ad2b113 tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] Removing single pathed devices sdg {{(pid=75045) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 23:21:07 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:21:07 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:21:07 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[acdb3188-3570-45ae-b1cd-f059f005df3b]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:21:07 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:21:07 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.026s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:21:07 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6fb42f9-ea93-452d-aebd-aa6dad858aef]: (4, ('ok\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:21:07 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-d5805710-9670-4f75-8e44-f7d92ad2b113 tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] Flushing IO for device /dev/sdg {{(pid=75045) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 23:21:07 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:21:07 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.013s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:21:07 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b9eeefc-8d19-4f4b-8475-015b9c4dd83f]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:21:07 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-d5805710-9670-4f75-8e44-f7d92ad2b113 tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=75045) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 23:21:07 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:21:07 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.053s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:21:07 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd22bdef-7aca-4582-bfc1-07bad42c21e4]: (4, ('1', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:21:07 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-d5805710-9670-4f75-8e44-f7d92ad2b113 tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=75045) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 23:21:07 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-d5805710-9670-4f75-8e44-f7d92ad2b113 tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] SCSI volumes sdg have been removed. {{(pid=75045) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 23:21:07 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5805710-9670-4f75-8e44-f7d92ad2b113 tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8d2ff5d0-0b89-42ba-92eb-1e12c9cce205')] {{(pid=75045) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 23:21:07 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d2ff5d0-0b89-42ba-92eb-1e12c9cce205 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:21:07 user nova-compute[75045]: DEBUG nova.compute.provider_tree [None req-b17001c7-4eef-4c12-8560-bbc28897aeb0 tempest-TaggedAttachmentsTest-1639503389 tempest-TaggedAttachmentsTest-1639503389-project-member] Inventory has not changed in ProviderTree for provider: 62ba5f85-c74d-4b58-986e-d4197e813fd7 {{(pid=75045) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 23:21:07 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d2ff5d0-0b89-42ba-92eb-1e12c9cce205 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:21:07 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[d39bbaca-f657-4f7b-ac95-407e0e2f6079]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:21:07 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5805710-9670-4f75-8e44-f7d92ad2b113 tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:21:07 user nova-compute[75045]: DEBUG nova.scheduler.client.report [None req-b17001c7-4eef-4c12-8560-bbc28897aeb0 tempest-TaggedAttachmentsTest-1639503389 tempest-TaggedAttachmentsTest-1639503389-project-member] Inventory has not changed for provider 62ba5f85-c74d-4b58-986e-d4197e813fd7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75045) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 23:21:07 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d2ff5d0-0b89-42ba-92eb-1e12c9cce205 -p 172.16.0.220:3260 --logout {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:21:08 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-b17001c7-4eef-4c12-8560-bbc28897aeb0 tempest-TaggedAttachmentsTest-1639503389 tempest-TaggedAttachmentsTest-1639503389-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.301s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:21:08 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d2ff5d0-0b89-42ba-92eb-1e12c9cce205 -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:21:08 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[15d726c0-295b-40cf-9a92-f1a3e24456de]: (4, ('Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:8d2ff5d0-0b89-42ba-92eb-1e12c9cce205, portal: 172.16.0.220,3260]\nLogout of [sid: 10, target: iqn.2010-10.org.openstack:8d2ff5d0-0b89-42ba-92eb-1e12c9cce205, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:21:08 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5805710-9670-4f75-8e44-f7d92ad2b113 tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:8d2ff5d0-0b89-42ba-92eb-1e12c9cce205, portal: 172.16.0.220,3260]
Nov 08 23:21:08 user nova-compute[75045]: Logout of [sid: 10, target: iqn.2010-10.org.openstack:8d2ff5d0-0b89-42ba-92eb-1e12c9cce205, portal: 172.16.0.220,3260] successful.
Nov 08 23:21:08 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:21:08 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d2ff5d0-0b89-42ba-92eb-1e12c9cce205 -p 172.16.0.220:3260 --op delete {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:21:08 user nova-compute[75045]: INFO nova.scheduler.client.report [None req-b17001c7-4eef-4c12-8560-bbc28897aeb0 tempest-TaggedAttachmentsTest-1639503389 tempest-TaggedAttachmentsTest-1639503389-project-member] Deleted allocations for instance 1cb1b440-0073-4a53-a0a2-e2781e021866
Nov 08 23:21:08 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d2ff5d0-0b89-42ba-92eb-1e12c9cce205 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:21:08 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d8184d0-acbb-4b78-a008-5ac098fbf9b9]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:21:08 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5805710-9670-4f75-8e44-f7d92ad2b113 tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:21:08 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-d5805710-9670-4f75-8e44-f7d92ad2b113 tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.347s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 23:21:08 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5805710-9670-4f75-8e44-f7d92ad2b113 tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] <== disconnect_volume: return (350ms) None {{(pid=75045) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 23:21:08 user nova-compute[75045]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d5805710-9670-4f75-8e44-f7d92ad2b113 tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] [instance: 520eac4f-fa48-4e41-924d-840907e701b4] Disconnected iSCSI Volume {{(pid=75045) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 23:21:08 user nova-compute[75045]: INFO nova.virt.libvirt.driver [None req-d5805710-9670-4f75-8e44-f7d92ad2b113 tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] [instance: 520eac4f-fa48-4e41-924d-840907e701b4] Deleting instance files /opt/stack/data/nova/instances/520eac4f-fa48-4e41-924d-840907e701b4_del
Nov 08 23:21:08 user nova-compute[75045]: INFO nova.virt.libvirt.driver [None req-d5805710-9670-4f75-8e44-f7d92ad2b113 tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] [instance: 520eac4f-fa48-4e41-924d-840907e701b4] Deletion of /opt/stack/data/nova/instances/520eac4f-fa48-4e41-924d-840907e701b4_del complete
Nov 08 23:21:08 user nova-compute[75045]: INFO nova.compute.manager [None req-d5805710-9670-4f75-8e44-f7d92ad2b113 tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] [instance: 520eac4f-fa48-4e41-924d-840907e701b4] Took 3.88 seconds to destroy the instance on the hypervisor.
Nov 08 23:21:08 user nova-compute[75045]: DEBUG oslo.service.loopingcall [None req-d5805710-9670-4f75-8e44-f7d92ad2b113 tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75045) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 23:21:08 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-b17001c7-4eef-4c12-8560-bbc28897aeb0 tempest-TaggedAttachmentsTest-1639503389 tempest-TaggedAttachmentsTest-1639503389-project-member] Lock "1cb1b440-0073-4a53-a0a2-e2781e021866" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.994s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:21:08 user nova-compute[75045]: DEBUG nova.compute.manager [-] [instance: 520eac4f-fa48-4e41-924d-840907e701b4] Deallocating network for instance {{(pid=75045) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 23:21:08 user nova-compute[75045]: DEBUG nova.network.neutron [-] [instance: 520eac4f-fa48-4e41-924d-840907e701b4] deallocate_for_instance() {{(pid=75045) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 23:21:08 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-c1adc332-a2d8-4fbd-88d0-288020b56c91 tempest-TestShelveInstance-1634360024 tempest-TestShelveInstance-1634360024-project-member] Acquiring lock "725866aa-0e2a-4af3-af20-48157e6d2fcb" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:21:08 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-c1adc332-a2d8-4fbd-88d0-288020b56c91 tempest-TestShelveInstance-1634360024 tempest-TestShelveInstance-1634360024-project-member] Lock "725866aa-0e2a-4af3-af20-48157e6d2fcb" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:21:08 user nova-compute[75045]: INFO nova.compute.manager [None req-c1adc332-a2d8-4fbd-88d0-288020b56c91 tempest-TestShelveInstance-1634360024 tempest-TestShelveInstance-1634360024-project-member] [instance: 725866aa-0e2a-4af3-af20-48157e6d2fcb] Unshelving
Nov 08 23:21:08 user nova-compute[75045]: INFO nova.virt.block_device [None req-c1adc332-a2d8-4fbd-88d0-288020b56c91 tempest-TestShelveInstance-1634360024 tempest-TestShelveInstance-1634360024-project-member] [instance: 725866aa-0e2a-4af3-af20-48157e6d2fcb] Booting with volume d2068946-d374-45a4-9850-e3a690b13ef4 at /dev/vda
Nov 08 23:21:08 user nova-compute[75045]: DEBUG os_brick.utils [None req-c1adc332-a2d8-4fbd-88d0-288020b56c91 tempest-TestShelveInstance-1634360024 tempest-TestShelveInstance-1634360024-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75045) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 23:21:08 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:21:08 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:21:08 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c9dd2f6-5393-4acb-96c5-178374d999fd]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6217bd6e884\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:21:08 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:21:08 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.021s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:21:08 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bc6de7c-9698-489b-902b-c3497d1940c9]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:21:08 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:21:08 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:21:08 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc9b0db2-7743-465c-bba0-22e2239d7c74]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:21:08 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c91cb21-812e-41e7-8181-e984a01f747c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:21:08 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-c1adc332-a2d8-4fbd-88d0-288020b56c91 tempest-TestShelveInstance-1634360024 tempest-TestShelveInstance-1634360024-project-member] Running cmd (subprocess): nvme version {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:21:08 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-c1adc332-a2d8-4fbd-88d0-288020b56c91 tempest-TestShelveInstance-1634360024 tempest-TestShelveInstance-1634360024-project-member] 'nvme version' failed. Not Retrying. {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 23:21:08 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c1adc332-a2d8-4fbd-88d0-288020b56c91 tempest-TestShelveInstance-1634360024 tempest-TestShelveInstance-1634360024-project-member] nvme not present on system {{(pid=75045) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 23:21:08 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:21:08 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 23:21:08 user nova-compute[75045]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 23:21:08 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[918d7f74-6968-453b-b5bd-8eb2d5d766bc]: (4, '') {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:21:08 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.lightos [None req-c1adc332-a2d8-4fbd-88d0-288020b56c91 tempest-TestShelveInstance-1634360024 tempest-TestShelveInstance-1634360024-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75045) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 23:21:08 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.lightos [None req-c1adc332-a2d8-4fbd-88d0-288020b56c91 tempest-TestShelveInstance-1634360024 tempest-TestShelveInstance-1634360024-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75045) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 23:21:08 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.lightos [None req-c1adc332-a2d8-4fbd-88d0-288020b56c91 tempest-TestShelveInstance-1634360024 tempest-TestShelveInstance-1634360024-project-member] LIGHTOS: no hostnqn found. {{(pid=75045) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 23:21:08 user nova-compute[75045]: DEBUG os_brick.utils [None req-c1adc332-a2d8-4fbd-88d0-288020b56c91 tempest-TestShelveInstance-1634360024 tempest-TestShelveInstance-1634360024-project-member] <== get_connector_properties: return (150ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6217bd6e884', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75045) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 23:21:08 user nova-compute[75045]: DEBUG nova.virt.block_device [None req-c1adc332-a2d8-4fbd-88d0-288020b56c91 tempest-TestShelveInstance-1634360024 tempest-TestShelveInstance-1634360024-project-member] [instance: 725866aa-0e2a-4af3-af20-48157e6d2fcb] Updating existing volume attachment record: 9076c585-292c-4f08-8bb5-405e46473cbd {{(pid=75045) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 23:21:09 user nova-compute[75045]: DEBUG nova.compute.manager [req-cb2efc20-c358-4e18-9fcf-7f14316d9e28 req-26043793-d8ec-4575-bb91-3baa5cf8d89e service nova] [instance: 520eac4f-fa48-4e41-924d-840907e701b4] Received event network-vif-plugged-768830de-7c2e-45ca-959e-398480b6ba29 {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:21:09 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-cb2efc20-c358-4e18-9fcf-7f14316d9e28 req-26043793-d8ec-4575-bb91-3baa5cf8d89e service nova] Acquiring lock "520eac4f-fa48-4e41-924d-840907e701b4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:21:09 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-cb2efc20-c358-4e18-9fcf-7f14316d9e28 req-26043793-d8ec-4575-bb91-3baa5cf8d89e service nova] Lock "520eac4f-fa48-4e41-924d-840907e701b4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:21:09 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-cb2efc20-c358-4e18-9fcf-7f14316d9e28 req-26043793-d8ec-4575-bb91-3baa5cf8d89e service nova] Lock "520eac4f-fa48-4e41-924d-840907e701b4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:21:09 user nova-compute[75045]: DEBUG nova.compute.manager [req-cb2efc20-c358-4e18-9fcf-7f14316d9e28 req-26043793-d8ec-4575-bb91-3baa5cf8d89e service nova] [instance: 520eac4f-fa48-4e41-924d-840907e701b4] No waiting events found dispatching network-vif-plugged-768830de-7c2e-45ca-959e-398480b6ba29 {{(pid=75045) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 23:21:09 user nova-compute[75045]: WARNING nova.compute.manager [req-cb2efc20-c358-4e18-9fcf-7f14316d9e28 req-26043793-d8ec-4575-bb91-3baa5cf8d89e service nova] [instance: 520eac4f-fa48-4e41-924d-840907e701b4] Received unexpected event network-vif-plugged-768830de-7c2e-45ca-959e-398480b6ba29 for instance with vm_state active and task_state deleting.
Nov 08 23:21:09 user nova-compute[75045]: DEBUG nova.compute.manager [req-cb2efc20-c358-4e18-9fcf-7f14316d9e28 req-26043793-d8ec-4575-bb91-3baa5cf8d89e service nova] [instance: 1cb1b440-0073-4a53-a0a2-e2781e021866] Received event network-vif-deleted-892284f7-b4b9-4b5b-82c7-62300cd8afb7 {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:21:10 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:21:10 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:21:11 user nova-compute[75045]: DEBUG nova.compute.manager [req-9bb026eb-6179-43d7-8e89-685e87060632 req-937eb180-1bcf-4949-b2b5-fd0a954103d1 service nova] [instance: 520eac4f-fa48-4e41-924d-840907e701b4] Received event network-vif-deleted-768830de-7c2e-45ca-959e-398480b6ba29 {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:21:11 user nova-compute[75045]: INFO nova.compute.manager [req-9bb026eb-6179-43d7-8e89-685e87060632 req-937eb180-1bcf-4949-b2b5-fd0a954103d1 service nova] [instance: 520eac4f-fa48-4e41-924d-840907e701b4] Neutron deleted interface 768830de-7c2e-45ca-959e-398480b6ba29; detaching it from the instance and deleting it from the info cache
Nov 08 23:21:11 user nova-compute[75045]: DEBUG nova.network.neutron [req-9bb026eb-6179-43d7-8e89-685e87060632 req-937eb180-1bcf-4949-b2b5-fd0a954103d1 service nova] [instance: 520eac4f-fa48-4e41-924d-840907e701b4] Updating instance_info_cache with network_info: [{"id": "25776e3e-60d6-457c-a78a-a59df0e3e7b5", "address": "fa:16:3e:3e:7f:60", "network": {"id": "13af9e02-7f74-4e9c-aea7-2e6f0701b1c2", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1067175210-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.230", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74ebbe44152141368b22a9a7989d577a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25776e3e-60", "ovs_interfaceid": "25776e3e-60d6-457c-a78a-a59df0e3e7b5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "bcd0d9eb-775a-4e28-b712-148c1fe99521", "address": "fa:16:3e:21:f4:bc", "network": {"id": "0916556c-7a50-48cf-8ad0-56c20de9d89f", "bridge": "br-int", "label": "tempest-device-tagging-net1-573961537", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.137", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "74ebbe44152141368b22a9a7989d577a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbcd0d9eb-77", "ovs_interfaceid": "bcd0d9eb-775a-4e28-b712-148c1fe99521", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "04ae6531-75ef-4043-99f4-bfa5ef2bba59", "address": "fa:16:3e:9f:87:19", "network": {"id": "0916556c-7a50-48cf-8ad0-56c20de9d89f", "bridge": "br-int", "label": "tempest-device-tagging-net1-573961537", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.210", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "74ebbe44152141368b22a9a7989d577a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04ae6531-75", "ovs_interfaceid": "04ae6531-75ef-4043-99f4-bfa5ef2bba59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "b3c645dd-a1ac-4780-a49d-916cb6a121c9", "address": "fa:16:3e:e2:e6:e2", "network": {"id": "0916556c-7a50-48cf-8ad0-56c20de9d89f", "bridge": "br-int", "label": "tempest-device-tagging-net1-573961537", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.154", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "74ebbe44152141368b22a9a7989d577a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3c645dd-a1", "ovs_interfaceid": "b3c645dd-a1ac-4780-a49d-916cb6a121c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3974ed79-74a5-4e9c-aa42-3aab1b234a39", "address": "fa:16:3e:f3:1c:29", "network": {"id": "0916556c-7a50-48cf-8ad0-56c20de9d89f", "bridge": "br-int", "label": "tempest-device-tagging-net1-573961537", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.231", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "74ebbe44152141368b22a9a7989d577a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3974ed79-74", "ovs_interfaceid": "3974ed79-74a5-4e9c-aa42-3aab1b234a39", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c2155ca8-d244-401d-a80f-8c53a68b6799", "address": "fa:16:3e:a2:80:a4", "network": {"id": "5cfed969-3f78-4bc2-8d08-921447c01347", "bridge": "br-int", "label": "tempest-device-tagging-net2-1614620309", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "74ebbe44152141368b22a9a7989d577a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2155ca8-d2", "ovs_interfaceid": "c2155ca8-d244-401d-a80f-8c53a68b6799", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75045) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 23:21:11 user nova-compute[75045]: DEBUG nova.compute.manager [req-9bb026eb-6179-43d7-8e89-685e87060632 req-937eb180-1bcf-4949-b2b5-fd0a954103d1 service nova] [instance: 520eac4f-fa48-4e41-924d-840907e701b4] Detach interface failed, port_id=768830de-7c2e-45ca-959e-398480b6ba29, reason: Instance 520eac4f-fa48-4e41-924d-840907e701b4 could not be found. {{(pid=75045) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 08 23:21:11 user nova-compute[75045]: DEBUG nova.compute.manager [req-9bb026eb-6179-43d7-8e89-685e87060632 req-937eb180-1bcf-4949-b2b5-fd0a954103d1 service nova] [instance: 520eac4f-fa48-4e41-924d-840907e701b4] Received event network-vif-deleted-b3c645dd-a1ac-4780-a49d-916cb6a121c9 {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:21:11 user nova-compute[75045]: INFO nova.compute.manager [req-9bb026eb-6179-43d7-8e89-685e87060632 req-937eb180-1bcf-4949-b2b5-fd0a954103d1 service nova] [instance: 520eac4f-fa48-4e41-924d-840907e701b4] Neutron deleted interface b3c645dd-a1ac-4780-a49d-916cb6a121c9; detaching it from the instance and deleting it from the info cache
Nov 08 23:21:11 user nova-compute[75045]: DEBUG nova.network.neutron [req-9bb026eb-6179-43d7-8e89-685e87060632 req-937eb180-1bcf-4949-b2b5-fd0a954103d1 service nova] [instance: 520eac4f-fa48-4e41-924d-840907e701b4] Updating instance_info_cache with network_info: [{"id": "25776e3e-60d6-457c-a78a-a59df0e3e7b5", "address": "fa:16:3e:3e:7f:60", "network": {"id": "13af9e02-7f74-4e9c-aea7-2e6f0701b1c2", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1067175210-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.230", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74ebbe44152141368b22a9a7989d577a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25776e3e-60", "ovs_interfaceid": "25776e3e-60d6-457c-a78a-a59df0e3e7b5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "bcd0d9eb-775a-4e28-b712-148c1fe99521", "address": "fa:16:3e:21:f4:bc", "network": {"id": "0916556c-7a50-48cf-8ad0-56c20de9d89f", "bridge": "br-int", "label": "tempest-device-tagging-net1-573961537", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.137", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "74ebbe44152141368b22a9a7989d577a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbcd0d9eb-77", "ovs_interfaceid": "bcd0d9eb-775a-4e28-b712-148c1fe99521", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "04ae6531-75ef-4043-99f4-bfa5ef2bba59", "address": "fa:16:3e:9f:87:19", "network": {"id": "0916556c-7a50-48cf-8ad0-56c20de9d89f", "bridge": "br-int", "label": "tempest-device-tagging-net1-573961537", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.210", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "74ebbe44152141368b22a9a7989d577a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04ae6531-75", "ovs_interfaceid": "04ae6531-75ef-4043-99f4-bfa5ef2bba59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "3974ed79-74a5-4e9c-aa42-3aab1b234a39", "address": "fa:16:3e:f3:1c:29", "network": {"id": "0916556c-7a50-48cf-8ad0-56c20de9d89f", "bridge": "br-int", "label": "tempest-device-tagging-net1-573961537", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.231", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "74ebbe44152141368b22a9a7989d577a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3974ed79-74", "ovs_interfaceid": "3974ed79-74a5-4e9c-aa42-3aab1b234a39", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c2155ca8-d244-401d-a80f-8c53a68b6799", "address": "fa:16:3e:a2:80:a4", "network": {"id": "5cfed969-3f78-4bc2-8d08-921447c01347", "bridge": "br-int", "label": "tempest-device-tagging-net2-1614620309", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "74ebbe44152141368b22a9a7989d577a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2155ca8-d2", "ovs_interfaceid": "c2155ca8-d244-401d-a80f-8c53a68b6799", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75045) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 23:21:11 user nova-compute[75045]: DEBUG nova.compute.manager [req-9bb026eb-6179-43d7-8e89-685e87060632 req-937eb180-1bcf-4949-b2b5-fd0a954103d1 service nova] [instance: 520eac4f-fa48-4e41-924d-840907e701b4] Detach interface failed, port_id=b3c645dd-a1ac-4780-a49d-916cb6a121c9, reason: Instance 520eac4f-fa48-4e41-924d-840907e701b4 could not be found. {{(pid=75045) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 08 23:21:11 user nova-compute[75045]: DEBUG nova.compute.manager [req-9bb026eb-6179-43d7-8e89-685e87060632 req-937eb180-1bcf-4949-b2b5-fd0a954103d1 service nova] [instance: 520eac4f-fa48-4e41-924d-840907e701b4] Received event network-vif-deleted-25776e3e-60d6-457c-a78a-a59df0e3e7b5 {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:21:11 user nova-compute[75045]: INFO nova.compute.manager [req-9bb026eb-6179-43d7-8e89-685e87060632 req-937eb180-1bcf-4949-b2b5-fd0a954103d1 service nova] [instance: 520eac4f-fa48-4e41-924d-840907e701b4] Neutron deleted interface 25776e3e-60d6-457c-a78a-a59df0e3e7b5; detaching it from the instance and deleting it from the info cache
Nov 08 23:21:11 user nova-compute[75045]: DEBUG nova.network.neutron [req-9bb026eb-6179-43d7-8e89-685e87060632 req-937eb180-1bcf-4949-b2b5-fd0a954103d1 service nova] [instance: 520eac4f-fa48-4e41-924d-840907e701b4] Updating instance_info_cache with network_info: [{"id": "bcd0d9eb-775a-4e28-b712-148c1fe99521", "address": "fa:16:3e:21:f4:bc", "network": {"id": "0916556c-7a50-48cf-8ad0-56c20de9d89f", "bridge": "br-int", "label": "tempest-device-tagging-net1-573961537", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.137", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "74ebbe44152141368b22a9a7989d577a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbcd0d9eb-77", "ovs_interfaceid": "bcd0d9eb-775a-4e28-b712-148c1fe99521", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "04ae6531-75ef-4043-99f4-bfa5ef2bba59", "address": "fa:16:3e:9f:87:19", "network": {"id": "0916556c-7a50-48cf-8ad0-56c20de9d89f", "bridge": "br-int", "label": "tempest-device-tagging-net1-573961537", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.210", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "74ebbe44152141368b22a9a7989d577a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04ae6531-75", "ovs_interfaceid": "04ae6531-75ef-4043-99f4-bfa5ef2bba59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "3974ed79-74a5-4e9c-aa42-3aab1b234a39", "address": "fa:16:3e:f3:1c:29", "network": {"id": "0916556c-7a50-48cf-8ad0-56c20de9d89f", "bridge": "br-int", "label": "tempest-device-tagging-net1-573961537", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.231", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "74ebbe44152141368b22a9a7989d577a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3974ed79-74", "ovs_interfaceid": "3974ed79-74a5-4e9c-aa42-3aab1b234a39", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c2155ca8-d244-401d-a80f-8c53a68b6799", "address": "fa:16:3e:a2:80:a4", "network": {"id": "5cfed969-3f78-4bc2-8d08-921447c01347", "bridge": "br-int", "label": "tempest-device-tagging-net2-1614620309", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "74ebbe44152141368b22a9a7989d577a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2155ca8-d2", "ovs_interfaceid": "c2155ca8-d244-401d-a80f-8c53a68b6799", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75045) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 23:21:11 user nova-compute[75045]: DEBUG nova.compute.manager [req-9bb026eb-6179-43d7-8e89-685e87060632 req-937eb180-1bcf-4949-b2b5-fd0a954103d1 service nova] [instance: 520eac4f-fa48-4e41-924d-840907e701b4] Detach interface failed, port_id=25776e3e-60d6-457c-a78a-a59df0e3e7b5, reason: Instance 520eac4f-fa48-4e41-924d-840907e701b4 could not be found. {{(pid=75045) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 08 23:21:11 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:21:12 user nova-compute[75045]: DEBUG nova.network.neutron [-] [instance: 520eac4f-fa48-4e41-924d-840907e701b4] Updating instance_info_cache with network_info: [] {{(pid=75045) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 23:21:12 user nova-compute[75045]: INFO nova.compute.manager [-] [instance: 520eac4f-fa48-4e41-924d-840907e701b4] Took 4.20 seconds to deallocate network for instance.
Nov 08 23:21:13 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:21:13 user nova-compute[75045]: INFO nova.compute.manager [None req-67eeb900-b53a-46c6-ad9f-de31511f3fa4 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] [instance: d2c911cf-d5f4-4c19-8335-8c7834184a7e] Rescuing
Nov 08 23:21:13 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-67eeb900-b53a-46c6-ad9f-de31511f3fa4 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Acquiring lock "refresh_cache-d2c911cf-d5f4-4c19-8335-8c7834184a7e" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 23:21:13 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-67eeb900-b53a-46c6-ad9f-de31511f3fa4 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Acquired lock "refresh_cache-d2c911cf-d5f4-4c19-8335-8c7834184a7e" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 23:21:13 user nova-compute[75045]: DEBUG nova.network.neutron [None req-67eeb900-b53a-46c6-ad9f-de31511f3fa4 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] [instance: d2c911cf-d5f4-4c19-8335-8c7834184a7e] Building network info cache for instance {{(pid=75045) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 23:21:13 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:21:13 user nova-compute[75045]: DEBUG nova.compute.manager [req-7ada8311-57eb-447d-9596-3dca5d08a362 req-8b6de7b4-d592-48cd-be16-355bb57f114b service nova] [instance: 520eac4f-fa48-4e41-924d-840907e701b4] Received event network-vif-deleted-3974ed79-74a5-4e9c-aa42-3aab1b234a39 {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:21:13 user nova-compute[75045]: DEBUG nova.compute.manager [req-7ada8311-57eb-447d-9596-3dca5d08a362 req-8b6de7b4-d592-48cd-be16-355bb57f114b service nova] [instance: 520eac4f-fa48-4e41-924d-840907e701b4] Received event network-vif-deleted-c2155ca8-d244-401d-a80f-8c53a68b6799 {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:21:14 user nova-compute[75045]: DEBUG nova.network.neutron [None req-67eeb900-b53a-46c6-ad9f-de31511f3fa4 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] [instance: d2c911cf-d5f4-4c19-8335-8c7834184a7e] Updating instance_info_cache with network_info: [{"id": "f4321c52-b9d5-434c-820f-25cab4239ef4", "address": "fa:16:3e:49:6b:27", "network": {"id": "d4cd6998-66d1-4389-bc82-dd000c8962de", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-323966879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bfb6963a6c145d4a7b7e47c8fde7e60", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4321c52-b9", "ovs_interfaceid": "f4321c52-b9d5-434c-820f-25cab4239ef4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75045) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 23:21:14 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-67eeb900-b53a-46c6-ad9f-de31511f3fa4 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Releasing lock "refresh_cache-d2c911cf-d5f4-4c19-8335-8c7834184a7e" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 23:21:14 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:21:14 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:21:14 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:21:14 user nova-compute[75045]: DEBUG nova.compute.manager [req-4cbff978-8335-4621-9aff-1a6d49f70979 req-368e716b-4754-41dc-8809-1f47dbd6a664 service nova] [instance: d2c911cf-d5f4-4c19-8335-8c7834184a7e] Received event network-vif-unplugged-f4321c52-b9d5-434c-820f-25cab4239ef4 {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:21:14 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-4cbff978-8335-4621-9aff-1a6d49f70979 req-368e716b-4754-41dc-8809-1f47dbd6a664 service nova] Acquiring lock "d2c911cf-d5f4-4c19-8335-8c7834184a7e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:21:14 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-4cbff978-8335-4621-9aff-1a6d49f70979 req-368e716b-4754-41dc-8809-1f47dbd6a664 service nova] Lock "d2c911cf-d5f4-4c19-8335-8c7834184a7e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:21:14 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-4cbff978-8335-4621-9aff-1a6d49f70979 req-368e716b-4754-41dc-8809-1f47dbd6a664 service nova] Lock "d2c911cf-d5f4-4c19-8335-8c7834184a7e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:21:14 user nova-compute[75045]: DEBUG nova.compute.manager [req-4cbff978-8335-4621-9aff-1a6d49f70979 req-368e716b-4754-41dc-8809-1f47dbd6a664 service nova] [instance: d2c911cf-d5f4-4c19-8335-8c7834184a7e] No waiting events found dispatching network-vif-unplugged-f4321c52-b9d5-434c-820f-25cab4239ef4 {{(pid=75045) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 23:21:14 user nova-compute[75045]: WARNING nova.compute.manager [req-4cbff978-8335-4621-9aff-1a6d49f70979 req-368e716b-4754-41dc-8809-1f47dbd6a664 service nova] [instance: d2c911cf-d5f4-4c19-8335-8c7834184a7e] Received unexpected event network-vif-unplugged-f4321c52-b9d5-434c-820f-25cab4239ef4 for instance with vm_state active and task_state rescuing.
Nov 08 23:21:14 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:21:14 user nova-compute[75045]: INFO nova.virt.libvirt.driver [-] [instance: d2c911cf-d5f4-4c19-8335-8c7834184a7e] Instance destroyed successfully.
Nov 08 23:21:15 user nova-compute[75045]: INFO nova.virt.libvirt.driver [None req-67eeb900-b53a-46c6-ad9f-de31511f3fa4 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] [instance: d2c911cf-d5f4-4c19-8335-8c7834184a7e] Attempting a stable device rescue
Nov 08 23:21:15 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-67eeb900-b53a-46c6-ad9f-de31511f3fa4 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75045) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 08 23:21:15 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-67eeb900-b53a-46c6-ad9f-de31511f3fa4 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] [instance: d2c911cf-d5f4-4c19-8335-8c7834184a7e] Instance directory exists: not creating {{(pid=75045) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 08 23:21:15 user nova-compute[75045]: INFO nova.virt.libvirt.driver [None req-67eeb900-b53a-46c6-ad9f-de31511f3fa4 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] [instance: d2c911cf-d5f4-4c19-8335-8c7834184a7e] Creating image(s)
Nov 08 23:21:15 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-67eeb900-b53a-46c6-ad9f-de31511f3fa4 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Acquiring lock "/opt/stack/data/nova/instances/d2c911cf-d5f4-4c19-8335-8c7834184a7e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:21:15 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-67eeb900-b53a-46c6-ad9f-de31511f3fa4 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Lock "/opt/stack/data/nova/instances/d2c911cf-d5f4-4c19-8335-8c7834184a7e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:21:15 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-67eeb900-b53a-46c6-ad9f-de31511f3fa4 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Lock "/opt/stack/data/nova/instances/d2c911cf-d5f4-4c19-8335-8c7834184a7e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:21:15 user nova-compute[75045]: DEBUG nova.objects.instance [None req-67eeb900-b53a-46c6-ad9f-de31511f3fa4 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Lazy-loading 'trusted_certs' on Instance uuid d2c911cf-d5f4-4c19-8335-8c7834184a7e {{(pid=75045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 23:21:15 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-67eeb900-b53a-46c6-ad9f-de31511f3fa4 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Acquiring lock "4b10dc438b97ddb95edd42624e0fcf6950db25c8" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:21:15 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-67eeb900-b53a-46c6-ad9f-de31511f3fa4 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Lock "4b10dc438b97ddb95edd42624e0fcf6950db25c8" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.002s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:21:16 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-67eeb900-b53a-46c6-ad9f-de31511f3fa4 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4b10dc438b97ddb95edd42624e0fcf6950db25c8.part --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:21:16 user nova-compute[75045]: INFO nova.compute.manager [None req-d5805710-9670-4f75-8e44-f7d92ad2b113 tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] [instance: 520eac4f-fa48-4e41-924d-840907e701b4] Took 3.83 seconds to detach 3 volumes for instance.
Nov 08 23:21:16 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:21:16 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-d5805710-9670-4f75-8e44-f7d92ad2b113 tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:21:16 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-d5805710-9670-4f75-8e44-f7d92ad2b113 tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:21:16 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-67eeb900-b53a-46c6-ad9f-de31511f3fa4 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4b10dc438b97ddb95edd42624e0fcf6950db25c8.part --force-share --output=json" returned: 0 in 0.201s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:21:16 user nova-compute[75045]: DEBUG nova.virt.images [None req-67eeb900-b53a-46c6-ad9f-de31511f3fa4 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] 69cfb30c-571c-4e0a-8be4-58585c73e233 was qcow2, converting to raw {{(pid=75045) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 08 23:21:16 user nova-compute[75045]: DEBUG nova.privsep.utils [None req-67eeb900-b53a-46c6-ad9f-de31511f3fa4 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75045) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 08 23:21:16 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-67eeb900-b53a-46c6-ad9f-de31511f3fa4 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/4b10dc438b97ddb95edd42624e0fcf6950db25c8.part /opt/stack/data/nova/instances/_base/4b10dc438b97ddb95edd42624e0fcf6950db25c8.converted {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:21:16 user nova-compute[75045]: DEBUG nova.compute.provider_tree [None req-d5805710-9670-4f75-8e44-f7d92ad2b113 tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] Inventory has not changed in ProviderTree for provider: 62ba5f85-c74d-4b58-986e-d4197e813fd7 {{(pid=75045) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 23:21:16 user nova-compute[75045]: DEBUG nova.scheduler.client.report [None req-d5805710-9670-4f75-8e44-f7d92ad2b113 tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] Inventory has not changed for provider 62ba5f85-c74d-4b58-986e-d4197e813fd7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75045) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 23:21:16 user nova-compute[75045]: DEBUG nova.compute.manager [req-6ec203d5-bff8-447b-863e-22cdf3398575 req-91642ac5-c2d6-47d4-96d7-8d382d8b1e1b service nova] [instance: d2c911cf-d5f4-4c19-8335-8c7834184a7e] Received event network-vif-plugged-f4321c52-b9d5-434c-820f-25cab4239ef4 {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:21:16 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-6ec203d5-bff8-447b-863e-22cdf3398575 req-91642ac5-c2d6-47d4-96d7-8d382d8b1e1b service nova] Acquiring lock "d2c911cf-d5f4-4c19-8335-8c7834184a7e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:21:16 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-6ec203d5-bff8-447b-863e-22cdf3398575 req-91642ac5-c2d6-47d4-96d7-8d382d8b1e1b service nova] Lock "d2c911cf-d5f4-4c19-8335-8c7834184a7e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:21:16 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-6ec203d5-bff8-447b-863e-22cdf3398575 req-91642ac5-c2d6-47d4-96d7-8d382d8b1e1b service nova] Lock "d2c911cf-d5f4-4c19-8335-8c7834184a7e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:21:16 user nova-compute[75045]: DEBUG nova.compute.manager [req-6ec203d5-bff8-447b-863e-22cdf3398575 req-91642ac5-c2d6-47d4-96d7-8d382d8b1e1b service nova] [instance: d2c911cf-d5f4-4c19-8335-8c7834184a7e] No waiting events found dispatching network-vif-plugged-f4321c52-b9d5-434c-820f-25cab4239ef4 {{(pid=75045) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 23:21:16 user nova-compute[75045]: WARNING nova.compute.manager [req-6ec203d5-bff8-447b-863e-22cdf3398575 req-91642ac5-c2d6-47d4-96d7-8d382d8b1e1b service nova] [instance: d2c911cf-d5f4-4c19-8335-8c7834184a7e] Received unexpected event network-vif-plugged-f4321c52-b9d5-434c-820f-25cab4239ef4 for instance with vm_state active and task_state rescuing.
Nov 08 23:21:16 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-d5805710-9670-4f75-8e44-f7d92ad2b113 tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.579s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:21:16 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-67eeb900-b53a-46c6-ad9f-de31511f3fa4 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/4b10dc438b97ddb95edd42624e0fcf6950db25c8.part /opt/stack/data/nova/instances/_base/4b10dc438b97ddb95edd42624e0fcf6950db25c8.converted" returned: 0 in 0.492s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:21:16 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-67eeb900-b53a-46c6-ad9f-de31511f3fa4 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4b10dc438b97ddb95edd42624e0fcf6950db25c8.converted --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:21:16 user nova-compute[75045]: INFO nova.scheduler.client.report [None req-d5805710-9670-4f75-8e44-f7d92ad2b113 tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] Deleted allocations for instance 520eac4f-fa48-4e41-924d-840907e701b4
Nov 08 23:21:16 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:21:17 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-d5805710-9670-4f75-8e44-f7d92ad2b113 tempest-TaggedBootDevicesTest-2022931664 tempest-TaggedBootDevicesTest-2022931664-project-member] Lock "520eac4f-fa48-4e41-924d-840907e701b4" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 12.759s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:21:17 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-94fec9d7-9ae4-4304-b898-f34905377c4d tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Acquiring lock "43f31110-89ec-4b20-9842-7c9dd7df0e14" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:21:17 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-94fec9d7-9ae4-4304-b898-f34905377c4d tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Lock "43f31110-89ec-4b20-9842-7c9dd7df0e14" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:21:17 user nova-compute[75045]: DEBUG nova.compute.manager [None req-94fec9d7-9ae4-4304-b898-f34905377c4d tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] [instance: 43f31110-89ec-4b20-9842-7c9dd7df0e14] Starting instance... {{(pid=75045) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 23:21:17 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-67eeb900-b53a-46c6-ad9f-de31511f3fa4 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4b10dc438b97ddb95edd42624e0fcf6950db25c8.converted --force-share --output=json" returned: 0 in 0.191s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:21:17 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-67eeb900-b53a-46c6-ad9f-de31511f3fa4 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Lock "4b10dc438b97ddb95edd42624e0fcf6950db25c8" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.974s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:21:17 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-67eeb900-b53a-46c6-ad9f-de31511f3fa4 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Acquiring lock "4b10dc438b97ddb95edd42624e0fcf6950db25c8" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:21:17 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-67eeb900-b53a-46c6-ad9f-de31511f3fa4 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Lock "4b10dc438b97ddb95edd42624e0fcf6950db25c8" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:21:17 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-67eeb900-b53a-46c6-ad9f-de31511f3fa4 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4b10dc438b97ddb95edd42624e0fcf6950db25c8 --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:21:17 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-94fec9d7-9ae4-4304-b898-f34905377c4d tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:21:17 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-94fec9d7-9ae4-4304-b898-f34905377c4d tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:21:17 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-94fec9d7-9ae4-4304-b898-f34905377c4d tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75045) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 23:21:17 user nova-compute[75045]: INFO nova.compute.claims [None req-94fec9d7-9ae4-4304-b898-f34905377c4d tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] [instance: 43f31110-89ec-4b20-9842-7c9dd7df0e14] Claim successful on node user
Nov 08 23:21:17 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-67eeb900-b53a-46c6-ad9f-de31511f3fa4 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4b10dc438b97ddb95edd42624e0fcf6950db25c8 --force-share --output=json" returned: 0 in 0.191s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:21:17 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-67eeb900-b53a-46c6-ad9f-de31511f3fa4 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4b10dc438b97ddb95edd42624e0fcf6950db25c8,backing_fmt=raw /opt/stack/data/nova/instances/d2c911cf-d5f4-4c19-8335-8c7834184a7e/disk.rescue {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:21:17 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-67eeb900-b53a-46c6-ad9f-de31511f3fa4 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4b10dc438b97ddb95edd42624e0fcf6950db25c8,backing_fmt=raw /opt/stack/data/nova/instances/d2c911cf-d5f4-4c19-8335-8c7834184a7e/disk.rescue" returned: 0 in 0.049s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:21:17 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-67eeb900-b53a-46c6-ad9f-de31511f3fa4 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Lock "4b10dc438b97ddb95edd42624e0fcf6950db25c8" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.247s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:21:17 user nova-compute[75045]: DEBUG nova.objects.instance [None req-67eeb900-b53a-46c6-ad9f-de31511f3fa4 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Lazy-loading 'migration_context' on Instance uuid d2c911cf-d5f4-4c19-8335-8c7834184a7e {{(pid=75045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 23:21:17 user nova-compute[75045]: DEBUG nova.objects.base [None req-67eeb900-b53a-46c6-ad9f-de31511f3fa4 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Object Instance<d2c911cf-d5f4-4c19-8335-8c7834184a7e> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75045) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 23:21:17 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-67eeb900-b53a-46c6-ad9f-de31511f3fa4 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] [instance: d2c911cf-d5f4-4c19-8335-8c7834184a7e] Created local disks {{(pid=75045) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 23:21:17 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-67eeb900-b53a-46c6-ad9f-de31511f3fa4 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] [instance: d2c911cf-d5f4-4c19-8335-8c7834184a7e] Start _get_guest_xml network_info=[{"id": "f4321c52-b9d5-434c-820f-25cab4239ef4", "address": "fa:16:3e:49:6b:27", "network": {"id": "d4cd6998-66d1-4389-bc82-dd000c8962de", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-323966879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-323966879-network", "vif_mac": "fa:16:3e:49:6b:27"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bfb6963a6c145d4a7b7e47c8fde7e60", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4321c52-b9", "ovs_interfaceid": "f4321c52-b9d5-434c-820f-25cab4239ef4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T23:11:54Z,direct_url=<?>,disk_format='qcow2',id=a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b1beba2cc4e7465ea249e2225fb494dc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T23:11:56Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '69cfb30c-571c-4e0a-8be4-58585c73e233', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'device_type': 'disk', 'attachment_id': 'b8b630c0-8906-4d08-b1b6-910bbbf5fca7', 'guest_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nAfSpkVl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, 'status': 'reserved', 'instance': 'd2c911cf-d5f4-4c19-8335-8c7834184a7e', 'attached_at': '', 'detached_at': '', 'volume_id': 'e7df0819-9ce3-4a97-b0f9-217e351b22ab', 'serial': 'e7df0819-9ce3-4a97-b0f9-217e351b22ab'}, 'volume_type': None} {{(pid=75045) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 23:21:17 user nova-compute[75045]: DEBUG nova.objects.instance [None req-67eeb900-b53a-46c6-ad9f-de31511f3fa4 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Lazy-loading 'resources' on Instance uuid d2c911cf-d5f4-4c19-8335-8c7834184a7e {{(pid=75045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 23:21:17 user nova-compute[75045]: DEBUG nova.objects.base [None req-67eeb900-b53a-46c6-ad9f-de31511f3fa4 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Object Instance<d2c911cf-d5f4-4c19-8335-8c7834184a7e> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75045) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 23:21:17 user nova-compute[75045]: DEBUG nova.objects.instance [None req-67eeb900-b53a-46c6-ad9f-de31511f3fa4 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Lazy-loading 'numa_topology' on Instance uuid d2c911cf-d5f4-4c19-8335-8c7834184a7e {{(pid=75045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 23:21:17 user nova-compute[75045]: DEBUG nova.objects.base [None req-67eeb900-b53a-46c6-ad9f-de31511f3fa4 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Object Instance<d2c911cf-d5f4-4c19-8335-8c7834184a7e> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75045) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 23:21:17 user nova-compute[75045]: WARNING nova.virt.libvirt.driver [None req-67eeb900-b53a-46c6-ad9f-de31511f3fa4 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 23:21:17 user nova-compute[75045]: WARNING nova.virt.libvirt.driver [None req-67eeb900-b53a-46c6-ad9f-de31511f3fa4 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 23:21:17 user nova-compute[75045]: DEBUG nova.virt.libvirt.host [None req-67eeb900-b53a-46c6-ad9f-de31511f3fa4 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75045) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 23:21:17 user nova-compute[75045]: DEBUG nova.virt.libvirt.host [None req-67eeb900-b53a-46c6-ad9f-de31511f3fa4 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] CPU controller missing on host. {{(pid=75045) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 23:21:17 user nova-compute[75045]: DEBUG nova.virt.libvirt.host [None req-67eeb900-b53a-46c6-ad9f-de31511f3fa4 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75045) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 23:21:17 user nova-compute[75045]: DEBUG nova.virt.libvirt.host [None req-67eeb900-b53a-46c6-ad9f-de31511f3fa4 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] CPU controller found on host. {{(pid=75045) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 23:21:17 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-67eeb900-b53a-46c6-ad9f-de31511f3fa4 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75045) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 23:21:17 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-67eeb900-b53a-46c6-ad9f-de31511f3fa4 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T23:11:41Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T23:11:54Z,direct_url=<?>,disk_format='qcow2',id=a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b1beba2cc4e7465ea249e2225fb494dc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T23:11:56Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75045) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 23:21:17 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-67eeb900-b53a-46c6-ad9f-de31511f3fa4 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Flavor limits 0:0:0 {{(pid=75045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 23:21:17 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-67eeb900-b53a-46c6-ad9f-de31511f3fa4 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Image limits 0:0:0 {{(pid=75045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 23:21:17 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-67eeb900-b53a-46c6-ad9f-de31511f3fa4 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Flavor pref 0:0:0 {{(pid=75045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 23:21:17 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-67eeb900-b53a-46c6-ad9f-de31511f3fa4 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Image pref 0:0:0 {{(pid=75045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 23:21:17 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-67eeb900-b53a-46c6-ad9f-de31511f3fa4 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 23:21:17 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-67eeb900-b53a-46c6-ad9f-de31511f3fa4 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75045) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 23:21:17 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-67eeb900-b53a-46c6-ad9f-de31511f3fa4 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75045) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 23:21:17 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-67eeb900-b53a-46c6-ad9f-de31511f3fa4 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Got 1 possible topologies {{(pid=75045) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 23:21:17 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-67eeb900-b53a-46c6-ad9f-de31511f3fa4 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75045) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 23:21:17 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-67eeb900-b53a-46c6-ad9f-de31511f3fa4 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75045) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 23:21:17 user nova-compute[75045]: DEBUG nova.objects.instance [None req-67eeb900-b53a-46c6-ad9f-de31511f3fa4 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Lazy-loading 'vcpu_model' on Instance uuid d2c911cf-d5f4-4c19-8335-8c7834184a7e {{(pid=75045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 23:21:17 user nova-compute[75045]: DEBUG nova.objects.base [None req-67eeb900-b53a-46c6-ad9f-de31511f3fa4 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Object Instance<d2c911cf-d5f4-4c19-8335-8c7834184a7e> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75045) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 23:21:17 user nova-compute[75045]: DEBUG nova.virt.libvirt.volume.iscsi [None req-67eeb900-b53a-46c6-ad9f-de31511f3fa4 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] [instance: d2c911cf-d5f4-4c19-8335-8c7834184a7e] Calling os-brick to attach iSCSI Volume {{(pid=75045) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 23:21:17 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-67eeb900-b53a-46c6-ad9f-de31511f3fa4 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1b68210460>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nAfSpkVl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75045) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 23:21:17 user nova-compute[75045]: WARNING os_brick.initiator.connectors.base [None req-67eeb900-b53a-46c6-ad9f-de31511f3fa4 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 23:21:17 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-67eeb900-b53a-46c6-ad9f-de31511f3fa4 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 23:21:17 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-67eeb900-b53a-46c6-ad9f-de31511f3fa4 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 23:21:17 user nova-compute[75045]: WARNING os_brick.initiator.connectors.base [None req-67eeb900-b53a-46c6-ad9f-de31511f3fa4 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 23:21:17 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-67eeb900-b53a-46c6-ad9f-de31511f3fa4 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 23:21:17 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-67eeb900-b53a-46c6-ad9f-de31511f3fa4 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 23:21:17 user nova-compute[75045]: INFO os_brick.initiator.connectors.iscsi [None req-67eeb900-b53a-46c6-ad9f-de31511f3fa4 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 23:21:17 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab -p 172.16.0.220:3260 {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:21:17 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab -p 172.16.0.220:3260" returned: 0 in 0.019s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:21:17 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[6439cd19-1e04-4545-ba7a-eee07b5660e4]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = nAfSpkVl\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:21:17 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-67eeb900-b53a-46c6-ad9f-de31511f3fa4 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Nov 08 23:21:17 user nova-compute[75045]: node.name = iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab
Nov 08 23:21:17 user nova-compute[75045]: node.tpgt = -1
Nov 08 23:21:17 user nova-compute[75045]: node.startup = automatic
Nov 08 23:21:17 user nova-compute[75045]: node.leading_login = No
Nov 08 23:21:17 user nova-compute[75045]: iface.iscsi_ifacename = default
Nov 08 23:21:17 user nova-compute[75045]: iface.net_ifacename = <empty>
Nov 08 23:21:17 user nova-compute[75045]: iface.ipaddress = <empty>
Nov 08 23:21:17 user nova-compute[75045]: iface.prefix_len = 0
Nov 08 23:21:17 user nova-compute[75045]: iface.hwaddress = <empty>
Nov 08 23:21:17 user nova-compute[75045]: iface.transport_name = tcp
Nov 08 23:21:17 user nova-compute[75045]: iface.initiatorname = <empty>
Nov 08 23:21:17 user nova-compute[75045]: iface.state = <empty>
Nov 08 23:21:17 user nova-compute[75045]: iface.vlan_id = 0
Nov 08 23:21:17 user nova-compute[75045]: iface.vlan_priority = 0
Nov 08 23:21:17 user nova-compute[75045]: iface.vlan_state = <empty>
Nov 08 23:21:17 user nova-compute[75045]: iface.iface_num = 0
Nov 08 23:21:17 user nova-compute[75045]: iface.mtu = 0
Nov 08 23:21:17 user nova-compute[75045]: iface.port = 0
Nov 08 23:21:17 user nova-compute[75045]: iface.bootproto = <empty>
Nov 08 23:21:17 user nova-compute[75045]: iface.subnet_mask = <empty>
Nov 08 23:21:17 user nova-compute[75045]: iface.gateway = <empty>
Nov 08 23:21:17 user nova-compute[75045]: iface.dhcp_alt_client_id_state = <empty>
Nov 08 23:21:17 user nova-compute[75045]: iface.dhcp_alt_client_id = <empty>
Nov 08 23:21:17 user nova-compute[75045]: iface.dhcp_dns = <empty>
Nov 08 23:21:17 user nova-compute[75045]: iface.dhcp_learn_iqn = <empty>
Nov 08 23:21:17 user nova-compute[75045]: iface.dhcp_req_vendor_id_state = <empty>
Nov 08 23:21:17 user nova-compute[75045]: iface.dhcp_vendor_id_state = <empty>
Nov 08 23:21:17 user nova-compute[75045]: iface.dhcp_vendor_id = <empty>
Nov 08 23:21:17 user nova-compute[75045]: iface.dhcp_slp_da = <empty>
Nov 08 23:21:17 user nova-compute[75045]: iface.fragmentation = <empty>
Nov 08 23:21:17 user nova-compute[75045]: iface.gratuitous_arp = <empty>
Nov 08 23:21:17 user nova-compute[75045]: iface.incoming_forwarding = <empty>
Nov 08 23:21:17 user nova-compute[75045]: iface.tos_state = <empty>
Nov 08 23:21:17 user nova-compute[75045]: iface.tos = 0
Nov 08 23:21:17 user nova-compute[75045]: iface.ttl = 0
Nov 08 23:21:17 user nova-compute[75045]: iface.delayed_ack = <empty>
Nov 08 23:21:17 user nova-compute[75045]: iface.tcp_nagle = <empty>
Nov 08 23:21:17 user nova-compute[75045]: iface.tcp_wsf_state = <empty>
Nov 08 23:21:17 user nova-compute[75045]: iface.tcp_wsf = 0
Nov 08 23:21:17 user nova-compute[75045]: iface.tcp_timer_scale = 0
Nov 08 23:21:17 user nova-compute[75045]: iface.tcp_timestamp = <empty>
Nov 08 23:21:17 user nova-compute[75045]: iface.redirect = <empty>
Nov 08 23:21:17 user nova-compute[75045]: iface.def_task_mgmt_timeout = 0
Nov 08 23:21:17 user nova-compute[75045]: iface.header_digest = <empty>
Nov 08 23:21:17 user nova-compute[75045]: iface.data_digest = <empty>
Nov 08 23:21:17 user nova-compute[75045]: iface.immediate_data = <empty>
Nov 08 23:21:17 user nova-compute[75045]: iface.initial_r2t = <empty>
Nov 08 23:21:17 user nova-compute[75045]: iface.data_seq_inorder = <empty>
Nov 08 23:21:17 user nova-compute[75045]: iface.data_pdu_inorder = <empty>
Nov 08 23:21:17 user nova-compute[75045]: iface.erl = 0
Nov 08 23:21:17 user nova-compute[75045]: iface.max_receive_data_len = 0
Nov 08 23:21:17 user nova-compute[75045]: iface.first_burst_len = 0
Nov 08 23:21:17 user nova-compute[75045]: iface.max_outstanding_r2t = 0
Nov 08 23:21:17 user nova-compute[75045]: iface.max_burst_len = 0
Nov 08 23:21:17 user nova-compute[75045]: iface.chap_auth = <empty>
Nov 08 23:21:17 user nova-compute[75045]: iface.bidi_chap = <empty>
Nov 08 23:21:17 user nova-compute[75045]: iface.strict_login_compliance = <empty>
Nov 08 23:21:17 user nova-compute[75045]: iface.discovery_auth = <empty>
Nov 08 23:21:17 user nova-compute[75045]: iface.discovery_logout = <empty>
Nov 08 23:21:17 user nova-compute[75045]: node.discovery_address = <empty>
Nov 08 23:21:17 user nova-compute[75045]: node.discovery_port = 0
Nov 08 23:21:17 user nova-compute[75045]: node.discovery_type = static
Nov 08 23:21:17 user nova-compute[75045]: node.session.initial_cmdsn = 0
Nov 08 23:21:17 user nova-compute[75045]: node.session.initial_login_retry_max = 8
Nov 08 23:21:17 user nova-compute[75045]: node.session.xmit_thread_priority = -20
Nov 08 23:21:17 user nova-compute[75045]: node.session.cmds_max = 128
Nov 08 23:21:17 user nova-compute[75045]: node.session.queue_depth = 32
Nov 08 23:21:17 user nova-compute[75045]: node.session.nr_sessions = 1
Nov 08 23:21:17 user nova-compute[75045]: node.session.auth.authmethod = CHAP
Nov 08 23:21:17 user nova-compute[75045]: node.session.auth.username = nAfSpkVl
Nov 08 23:21:17 user nova-compute[75045]: node.session.auth.password = ***
Nov 08 23:21:17 user nova-compute[75045]: node.session.auth.username_in = <empty>
Nov 08 23:21:17 user nova-compute[75045]: node.session.auth.password_in = <empty>
Nov 08 23:21:17 user nova-compute[75045]: node.session.auth.chap_algs = MD5
Nov 08 23:21:17 user nova-compute[75045]: node.session.timeo.replacement_timeout = 120
Nov 08 23:21:17 user nova-compute[75045]: node.session.err_timeo.abort_timeout = 15
Nov 08 23:21:17 user nova-compute[75045]: node.session.err_timeo.lu_reset_timeout = 30
Nov 08 23:21:17 user nova-compute[75045]: node.session.err_timeo.tgt_reset_timeout = 30
Nov 08 23:21:17 user nova-compute[75045]: node.session.err_timeo.host_reset_timeout = 60
Nov 08 23:21:17 user nova-compute[75045]: node.session.iscsi.FastAbort = Yes
Nov 08 23:21:17 user nova-compute[75045]: node.session.iscsi.InitialR2T = No
Nov 08 23:21:17 user nova-compute[75045]: node.session.iscsi.ImmediateData = Yes
Nov 08 23:21:17 user nova-compute[75045]: node.session.iscsi.FirstBurstLength = 262144
Nov 08 23:21:17 user nova-compute[75045]: node.session.iscsi.MaxBurstLength = 16776192
Nov 08 23:21:17 user nova-compute[75045]: node.session.iscsi.DefaultTime2Retain = 0
Nov 08 23:21:17 user nova-compute[75045]: node.session.iscsi.DefaultTime2Wait = 2
Nov 08 23:21:17 user nova-compute[75045]: node.session.iscsi.MaxConnections = 1
Nov 08 23:21:17 user nova-compute[75045]: node.session.iscsi.MaxOutstandingR2T = 1
Nov 08 23:21:17 user nova-compute[75045]: node.session.iscsi.ERL = 0
Nov 08 23:21:17 user nova-compute[75045]: node.session.scan = manual
Nov 08 23:21:17 user nova-compute[75045]: node.session.reopen_max = 0
Nov 08 23:21:17 user nova-compute[75045]: node.conn[0].address = 172.16.0.220
Nov 08 23:21:17 user nova-compute[75045]: node.conn[0].port = 3260
Nov 08 23:21:17 user nova-compute[75045]: node.conn[0].startup = manual
Nov 08 23:21:17 user nova-compute[75045]: node.conn[0].tcp.window_size = 524288
Nov 08 23:21:17 user nova-compute[75045]: node.conn[0].tcp.type_of_service = 0
Nov 08 23:21:17 user nova-compute[75045]: node.conn[0].timeo.logout_timeout = 15
Nov 08 23:21:17 user nova-compute[75045]: node.conn[0].timeo.login_timeout = 15
Nov 08 23:21:17 user nova-compute[75045]: node.conn[0].timeo.auth_timeout = 45
Nov 08 23:21:17 user nova-compute[75045]: node.conn[0].timeo.noop_out_interval = 5
Nov 08 23:21:17 user nova-compute[75045]: node.conn[0].timeo.noop_out_timeout = 5
Nov 08 23:21:17 user nova-compute[75045]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Nov 08 23:21:17 user nova-compute[75045]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Nov 08 23:21:17 user nova-compute[75045]: node.conn[0].iscsi.HeaderDigest = None
Nov 08 23:21:17 user nova-compute[75045]: node.conn[0].iscsi.DataDigest = None
Nov 08 23:21:17 user nova-compute[75045]: node.conn[0].iscsi.IFMarker = No
Nov 08 23:21:17 user nova-compute[75045]: node.conn[0].iscsi.OFMarker = No
Nov 08 23:21:17 user nova-compute[75045]: # END RECORD
Nov 08 23:21:17 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:21:17 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:21:17 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:21:17 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[be83f28a-829c-4983-b7a0-0caecc1e3b9d]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:21:17 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-67eeb900-b53a-46c6-ad9f-de31511f3fa4 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:21:17 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:21:17 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:21:17 user nova-compute[75045]: DEBUG nova.compute.provider_tree [None req-94fec9d7-9ae4-4304-b898-f34905377c4d tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Inventory has not changed in ProviderTree for provider: 62ba5f85-c74d-4b58-986e-d4197e813fd7 {{(pid=75045) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 23:21:17 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:21:17 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8723bb4-10e0-4d06-861c-7a24439a30b7]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:21:17 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-67eeb900-b53a-46c6-ad9f-de31511f3fa4 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:21:17 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nAfSpkVl {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:21:17 user nova-compute[75045]: DEBUG nova.scheduler.client.report [None req-94fec9d7-9ae4-4304-b898-f34905377c4d tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Inventory has not changed for provider 62ba5f85-c74d-4b58-986e-d4197e813fd7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75045) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 23:21:17 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nAfSpkVl" returned: 0 in 0.021s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:21:17 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[35def48c-66e1-4838-89a1-60d7fb066080]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:21:17 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-67eeb900-b53a-46c6-ad9f-de31511f3fa4 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'nAfSpkVl'): stdout= stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:21:17 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:21:17 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:21:17 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[39e3657d-9357-44fc-97bc-3784b0ca41d2]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:21:17 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-67eeb900-b53a-46c6-ad9f-de31511f3fa4 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:21:17 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:21:17 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-94fec9d7-9ae4-4304-b898-f34905377c4d tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.451s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:21:17 user nova-compute[75045]: DEBUG nova.compute.manager [None req-94fec9d7-9ae4-4304-b898-f34905377c4d tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] [instance: 43f31110-89ec-4b20-9842-7c9dd7df0e14] Start building networks asynchronously for instance. {{(pid=75045) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 23:21:17 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:21:17 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6ba80b3-6a3b-4ea7-9220-1d01d58a0955]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7f7084f-f0d7-4d4b-9a14-69065a9c3e41 (non-flash)\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:21:17 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-67eeb900-b53a-46c6-ad9f-de31511f3fa4 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab (non-flash)
Nov 08 23:21:17 user nova-compute[75045]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7f7084f-f0d7-4d4b-9a14-69065a9c3e41 (non-flash)
Nov 08 23:21:17 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 23:21:17 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-67eeb900-b53a-46c6-ad9f-de31511f3fa4 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab (non-flash)
Nov 08 23:21:17 user nova-compute[75045]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7f7084f-f0d7-4d4b-9a14-69065a9c3e41 (non-flash)
Nov 08 23:21:17 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 23:21:17 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-67eeb900-b53a-46c6-ad9f-de31511f3fa4 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.158s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 23:21:17 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-67eeb900-b53a-46c6-ad9f-de31511f3fa4 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Connected to 172.16.0.220:3260 {{(pid=75045) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 23:21:17 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-67eeb900-b53a-46c6-ad9f-de31511f3fa4 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] HCTL ('39', '0', '0', 0) found on session 11 with lun 0 {{(pid=75045) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 23:21:17 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-67eeb900-b53a-46c6-ad9f-de31511f3fa4 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Scanning host 39 c: 0, t: 0, l: 0) {{(pid=75045) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 23:21:17 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:21:17 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.017s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:21:17 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f13b08e-ae2f-4101-ac0e-c0232a090955]: (4, ('0 0 0', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:21:17 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-67eeb900-b53a-46c6-ad9f-de31511f3fa4 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Searching for a device in session 11 and hctl ('39', '0', '0', 0) yield: sdh {{(pid=75045) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 23:21:17 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-67eeb900-b53a-46c6-ad9f-de31511f3fa4 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nAfSpkVl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75045) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 23:21:17 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-67eeb900-b53a-46c6-ad9f-de31511f3fa4 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.184s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 23:21:17 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-67eeb900-b53a-46c6-ad9f-de31511f3fa4 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] <== connect_volume: return (186ms) {'type': 'block', 'scsi_wwn': '26236653134353633', 'path': '/dev/sdh'} {{(pid=75045) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 23:21:17 user nova-compute[75045]: DEBUG nova.virt.libvirt.volume.iscsi [None req-67eeb900-b53a-46c6-ad9f-de31511f3fa4 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] [instance: d2c911cf-d5f4-4c19-8335-8c7834184a7e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26236653134353633', 'path': '/dev/sdh'} {{(pid=75045) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 23:21:17 user nova-compute[75045]: DEBUG nova.compute.manager [None req-94fec9d7-9ae4-4304-b898-f34905377c4d tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] [instance: 43f31110-89ec-4b20-9842-7c9dd7df0e14] Allocating IP information in the background. {{(pid=75045) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 23:21:17 user nova-compute[75045]: DEBUG nova.network.neutron [None req-94fec9d7-9ae4-4304-b898-f34905377c4d tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] [instance: 43f31110-89ec-4b20-9842-7c9dd7df0e14] allocate_for_instance() {{(pid=75045) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 23:21:17 user nova-compute[75045]: DEBUG nova.virt.libvirt.vif [None req-67eeb900-b53a-46c6-ad9f-de31511f3fa4 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T23:18:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-2063862125',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-2063862125',id=11,image_ref='a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-08T23:19:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6bfb6963a6c145d4a7b7e47c8fde7e60',ramdisk_id='',reservation_id='r-kiu16ror',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-474110917',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T23:19:44Z,user_data=None,user_id='04bb3135250f4465a9947b47f9cde485',uuid=d2c911cf-d5f4-4c19-8335-8c7834184a7e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f4321c52-b9d5-434c-820f-25cab4239ef4", "address": "fa:16:3e:49:6b:27", "network": {"id": "d4cd6998-66d1-4389-bc82-dd000c8962de", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-323966879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-323966879-network", "vif_mac": "fa:16:3e:49:6b:27"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bfb6963a6c145d4a7b7e47c8fde7e60", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4321c52-b9", "ovs_interfaceid": "f4321c52-b9d5-434c-820f-25cab4239ef4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75045) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 23:21:17 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-67eeb900-b53a-46c6-ad9f-de31511f3fa4 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Converting VIF {"id": "f4321c52-b9d5-434c-820f-25cab4239ef4", "address": "fa:16:3e:49:6b:27", "network": {"id": "d4cd6998-66d1-4389-bc82-dd000c8962de", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-323966879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-323966879-network", "vif_mac": "fa:16:3e:49:6b:27"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bfb6963a6c145d4a7b7e47c8fde7e60", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4321c52-b9", "ovs_interfaceid": "f4321c52-b9d5-434c-820f-25cab4239ef4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 23:21:17 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-67eeb900-b53a-46c6-ad9f-de31511f3fa4 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:49:6b:27,bridge_name='br-int',has_traffic_filtering=True,id=f4321c52-b9d5-434c-820f-25cab4239ef4,network=Network(d4cd6998-66d1-4389-bc82-dd000c8962de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4321c52-b9') {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 23:21:17 user nova-compute[75045]: DEBUG nova.objects.instance [None req-67eeb900-b53a-46c6-ad9f-de31511f3fa4 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Lazy-loading 'pci_devices' on Instance uuid d2c911cf-d5f4-4c19-8335-8c7834184a7e {{(pid=75045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 23:21:17 user nova-compute[75045]: INFO nova.virt.libvirt.driver [None req-94fec9d7-9ae4-4304-b898-f34905377c4d tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] [instance: 43f31110-89ec-4b20-9842-7c9dd7df0e14] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 23:21:17 user nova-compute[75045]: DEBUG nova.objects.base [None req-67eeb900-b53a-46c6-ad9f-de31511f3fa4 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Object Instance<d2c911cf-d5f4-4c19-8335-8c7834184a7e> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75045) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 23:21:17 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-67eeb900-b53a-46c6-ad9f-de31511f3fa4 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] [instance: d2c911cf-d5f4-4c19-8335-8c7834184a7e] End _get_guest_xml xml=<domain type="kvm">
Nov 08 23:21:17 user nova-compute[75045]:   <uuid>d2c911cf-d5f4-4c19-8335-8c7834184a7e</uuid>
Nov 08 23:21:17 user nova-compute[75045]:   <name>instance-0000000b</name>
Nov 08 23:21:17 user nova-compute[75045]:   <memory>524288</memory>
Nov 08 23:21:17 user nova-compute[75045]:   <vcpu>1</vcpu>
Nov 08 23:21:17 user nova-compute[75045]:   <metadata>
Nov 08 23:21:17 user nova-compute[75045]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 23:21:17 user nova-compute[75045]:       <nova:package version="0.0.0"/>
Nov 08 23:21:17 user nova-compute[75045]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-2063862125</nova:name>
Nov 08 23:21:17 user nova-compute[75045]:       <nova:creationTime>2023-11-08 23:21:17</nova:creationTime>
Nov 08 23:21:17 user nova-compute[75045]:       <nova:flavor name="m1.tiny">
Nov 08 23:21:17 user nova-compute[75045]:         <nova:memory>512</nova:memory>
Nov 08 23:21:17 user nova-compute[75045]:         <nova:disk>1</nova:disk>
Nov 08 23:21:17 user nova-compute[75045]:         <nova:swap>0</nova:swap>
Nov 08 23:21:17 user nova-compute[75045]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 23:21:17 user nova-compute[75045]:         <nova:vcpus>1</nova:vcpus>
Nov 08 23:21:17 user nova-compute[75045]:       </nova:flavor>
Nov 08 23:21:17 user nova-compute[75045]:       <nova:owner>
Nov 08 23:21:17 user nova-compute[75045]:         <nova:user uuid="04bb3135250f4465a9947b47f9cde485">tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member</nova:user>
Nov 08 23:21:17 user nova-compute[75045]:         <nova:project uuid="6bfb6963a6c145d4a7b7e47c8fde7e60">tempest-ServerBootFromVolumeStableRescueTest-474110917</nova:project>
Nov 08 23:21:17 user nova-compute[75045]:       </nova:owner>
Nov 08 23:21:17 user nova-compute[75045]:       <nova:root type="image" uuid="a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb"/>
Nov 08 23:21:17 user nova-compute[75045]:       <nova:ports>
Nov 08 23:21:17 user nova-compute[75045]:         <nova:port uuid="f4321c52-b9d5-434c-820f-25cab4239ef4">
Nov 08 23:21:17 user nova-compute[75045]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 08 23:21:17 user nova-compute[75045]:         </nova:port>
Nov 08 23:21:17 user nova-compute[75045]:       </nova:ports>
Nov 08 23:21:17 user nova-compute[75045]:     </nova:instance>
Nov 08 23:21:17 user nova-compute[75045]:   </metadata>
Nov 08 23:21:17 user nova-compute[75045]:   <sysinfo type="smbios">
Nov 08 23:21:17 user nova-compute[75045]:     <system>
Nov 08 23:21:17 user nova-compute[75045]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 23:21:17 user nova-compute[75045]:       <entry name="product">OpenStack Nova</entry>
Nov 08 23:21:17 user nova-compute[75045]:       <entry name="version">0.0.0</entry>
Nov 08 23:21:17 user nova-compute[75045]:       <entry name="serial">d2c911cf-d5f4-4c19-8335-8c7834184a7e</entry>
Nov 08 23:21:17 user nova-compute[75045]:       <entry name="uuid">d2c911cf-d5f4-4c19-8335-8c7834184a7e</entry>
Nov 08 23:21:17 user nova-compute[75045]:       <entry name="family">Virtual Machine</entry>
Nov 08 23:21:17 user nova-compute[75045]:     </system>
Nov 08 23:21:17 user nova-compute[75045]:   </sysinfo>
Nov 08 23:21:17 user nova-compute[75045]:   <os>
Nov 08 23:21:17 user nova-compute[75045]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 23:21:17 user nova-compute[75045]:     <smbios mode="sysinfo"/>
Nov 08 23:21:17 user nova-compute[75045]:   </os>
Nov 08 23:21:17 user nova-compute[75045]:   <features>
Nov 08 23:21:17 user nova-compute[75045]:     <acpi/>
Nov 08 23:21:17 user nova-compute[75045]:     <apic/>
Nov 08 23:21:17 user nova-compute[75045]:     <vmcoreinfo/>
Nov 08 23:21:17 user nova-compute[75045]:   </features>
Nov 08 23:21:17 user nova-compute[75045]:   <clock offset="utc">
Nov 08 23:21:17 user nova-compute[75045]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 23:21:17 user nova-compute[75045]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 23:21:17 user nova-compute[75045]:     <timer name="hpet" present="no"/>
Nov 08 23:21:17 user nova-compute[75045]:   </clock>
Nov 08 23:21:17 user nova-compute[75045]:   <cpu mode="custom" match="exact">
Nov 08 23:21:17 user nova-compute[75045]:     <model>Nehalem</model>
Nov 08 23:21:17 user nova-compute[75045]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 23:21:17 user nova-compute[75045]:   </cpu>
Nov 08 23:21:17 user nova-compute[75045]:   <devices>
Nov 08 23:21:17 user nova-compute[75045]:     <disk type="block" device="disk">
Nov 08 23:21:17 user nova-compute[75045]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 23:21:17 user nova-compute[75045]:       <source dev="/dev/sdh"/>
Nov 08 23:21:17 user nova-compute[75045]:       <target dev="vda" bus="virtio"/>
Nov 08 23:21:17 user nova-compute[75045]:       <serial>e7df0819-9ce3-4a97-b0f9-217e351b22ab</serial>
Nov 08 23:21:17 user nova-compute[75045]:     </disk>
Nov 08 23:21:17 user nova-compute[75045]:     <disk type="file" device="disk">
Nov 08 23:21:17 user nova-compute[75045]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 23:21:17 user nova-compute[75045]:       <source file="/opt/stack/data/nova/instances/d2c911cf-d5f4-4c19-8335-8c7834184a7e/disk.rescue"/>
Nov 08 23:21:17 user nova-compute[75045]:       <target dev="vdb" bus="virtio"/>
Nov 08 23:21:17 user nova-compute[75045]:       <boot order="1"/>
Nov 08 23:21:17 user nova-compute[75045]:     </disk>
Nov 08 23:21:17 user nova-compute[75045]:     <interface type="ethernet">
Nov 08 23:21:17 user nova-compute[75045]:       <mac address="fa:16:3e:49:6b:27"/>
Nov 08 23:21:17 user nova-compute[75045]:       <model type="virtio"/>
Nov 08 23:21:17 user nova-compute[75045]:       <mtu size="1442"/>
Nov 08 23:21:17 user nova-compute[75045]:       <target dev="tapf4321c52-b9"/>
Nov 08 23:21:17 user nova-compute[75045]:     </interface>
Nov 08 23:21:17 user nova-compute[75045]:     <serial type="pty">
Nov 08 23:21:17 user nova-compute[75045]:       <log file="/opt/stack/data/nova/instances/d2c911cf-d5f4-4c19-8335-8c7834184a7e/console.log" append="off"/>
Nov 08 23:21:17 user nova-compute[75045]:     </serial>
Nov 08 23:21:17 user nova-compute[75045]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 23:21:17 user nova-compute[75045]:     <video>
Nov 08 23:21:17 user nova-compute[75045]:       <model type="virtio"/>
Nov 08 23:21:17 user nova-compute[75045]:     </video>
Nov 08 23:21:17 user nova-compute[75045]:     <rng model="virtio">
Nov 08 23:21:17 user nova-compute[75045]:       <backend model="random">/dev/urandom</backend>
Nov 08 23:21:17 user nova-compute[75045]:     </rng>
Nov 08 23:21:17 user nova-compute[75045]:     <controller type="usb" index="0" model="none"/>
Nov 08 23:21:17 user nova-compute[75045]:     <memballoon model="virtio">
Nov 08 23:21:17 user nova-compute[75045]:       <stats period="10"/>
Nov 08 23:21:17 user nova-compute[75045]:     </memballoon>
Nov 08 23:21:17 user nova-compute[75045]:   </devices>
Nov 08 23:21:17 user nova-compute[75045]: </domain>
Nov 08 23:21:17 user nova-compute[75045]:  {{(pid=75045) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 23:21:17 user nova-compute[75045]: DEBUG nova.compute.manager [None req-94fec9d7-9ae4-4304-b898-f34905377c4d tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] [instance: 43f31110-89ec-4b20-9842-7c9dd7df0e14] Start building block device mappings for instance. {{(pid=75045) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 23:21:17 user nova-compute[75045]: INFO nova.virt.libvirt.driver [-] [instance: d2c911cf-d5f4-4c19-8335-8c7834184a7e] Instance destroyed successfully.
Nov 08 23:21:17 user nova-compute[75045]: DEBUG nova.policy [None req-94fec9d7-9ae4-4304-b898-f34905377c4d tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4a05b178abe74b779a991e887bf135b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eff4be777d24514be52868961bf7a25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75045) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 23:21:17 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-67eeb900-b53a-46c6-ad9f-de31511f3fa4 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] No BDM found with device name vda, not building metadata. {{(pid=75045) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 23:21:17 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-67eeb900-b53a-46c6-ad9f-de31511f3fa4 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75045) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 23:21:17 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-67eeb900-b53a-46c6-ad9f-de31511f3fa4 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] No VIF found with MAC fa:16:3e:49:6b:27, not building metadata {{(pid=75045) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 23:21:17 user nova-compute[75045]: DEBUG nova.compute.manager [None req-94fec9d7-9ae4-4304-b898-f34905377c4d tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] [instance: 43f31110-89ec-4b20-9842-7c9dd7df0e14] Start spawning the instance on the hypervisor. {{(pid=75045) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 23:21:17 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-94fec9d7-9ae4-4304-b898-f34905377c4d tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] [instance: 43f31110-89ec-4b20-9842-7c9dd7df0e14] Creating instance directory {{(pid=75045) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 23:21:17 user nova-compute[75045]: INFO nova.virt.libvirt.driver [None req-94fec9d7-9ae4-4304-b898-f34905377c4d tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] [instance: 43f31110-89ec-4b20-9842-7c9dd7df0e14] Creating image(s)
Nov 08 23:21:17 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-94fec9d7-9ae4-4304-b898-f34905377c4d tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Acquiring lock "/opt/stack/data/nova/instances/43f31110-89ec-4b20-9842-7c9dd7df0e14/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:21:17 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-94fec9d7-9ae4-4304-b898-f34905377c4d tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Lock "/opt/stack/data/nova/instances/43f31110-89ec-4b20-9842-7c9dd7df0e14/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:21:17 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-94fec9d7-9ae4-4304-b898-f34905377c4d tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Lock "/opt/stack/data/nova/instances/43f31110-89ec-4b20-9842-7c9dd7df0e14/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:21:17 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-94fec9d7-9ae4-4304-b898-f34905377c4d tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b59f52a99fff51c56dd1edfb83892fb8f647f2f3 --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:21:18 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-94fec9d7-9ae4-4304-b898-f34905377c4d tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b59f52a99fff51c56dd1edfb83892fb8f647f2f3 --force-share --output=json" returned: 0 in 0.239s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:21:18 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-94fec9d7-9ae4-4304-b898-f34905377c4d tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Acquiring lock "b59f52a99fff51c56dd1edfb83892fb8f647f2f3" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:21:18 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-94fec9d7-9ae4-4304-b898-f34905377c4d tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Lock "b59f52a99fff51c56dd1edfb83892fb8f647f2f3" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:21:18 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-94fec9d7-9ae4-4304-b898-f34905377c4d tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b59f52a99fff51c56dd1edfb83892fb8f647f2f3 --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:21:18 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-94fec9d7-9ae4-4304-b898-f34905377c4d tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b59f52a99fff51c56dd1edfb83892fb8f647f2f3 --force-share --output=json" returned: 0 in 0.177s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:21:18 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-94fec9d7-9ae4-4304-b898-f34905377c4d tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b59f52a99fff51c56dd1edfb83892fb8f647f2f3,backing_fmt=raw /opt/stack/data/nova/instances/43f31110-89ec-4b20-9842-7c9dd7df0e14/disk 1073741824 {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:21:18 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-94fec9d7-9ae4-4304-b898-f34905377c4d tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b59f52a99fff51c56dd1edfb83892fb8f647f2f3,backing_fmt=raw /opt/stack/data/nova/instances/43f31110-89ec-4b20-9842-7c9dd7df0e14/disk 1073741824" returned: 0 in 0.073s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:21:18 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-94fec9d7-9ae4-4304-b898-f34905377c4d tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Lock "b59f52a99fff51c56dd1edfb83892fb8f647f2f3" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.259s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:21:18 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-94fec9d7-9ae4-4304-b898-f34905377c4d tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b59f52a99fff51c56dd1edfb83892fb8f647f2f3 --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:21:18 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-94fec9d7-9ae4-4304-b898-f34905377c4d tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b59f52a99fff51c56dd1edfb83892fb8f647f2f3 --force-share --output=json" returned: 0 in 0.196s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:21:18 user nova-compute[75045]: DEBUG nova.virt.disk.api [None req-94fec9d7-9ae4-4304-b898-f34905377c4d tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Checking if we can resize image /opt/stack/data/nova/instances/43f31110-89ec-4b20-9842-7c9dd7df0e14/disk. size=1073741824 {{(pid=75045) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 23:21:18 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-94fec9d7-9ae4-4304-b898-f34905377c4d tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43f31110-89ec-4b20-9842-7c9dd7df0e14/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:21:18 user nova-compute[75045]: DEBUG nova.network.neutron [None req-94fec9d7-9ae4-4304-b898-f34905377c4d tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] [instance: 43f31110-89ec-4b20-9842-7c9dd7df0e14] Successfully created port: 509a96ec-b573-4408-bf93-87bccca95836 {{(pid=75045) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 23:21:18 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-94fec9d7-9ae4-4304-b898-f34905377c4d tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43f31110-89ec-4b20-9842-7c9dd7df0e14/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:21:18 user nova-compute[75045]: DEBUG nova.virt.disk.api [None req-94fec9d7-9ae4-4304-b898-f34905377c4d tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Cannot resize image /opt/stack/data/nova/instances/43f31110-89ec-4b20-9842-7c9dd7df0e14/disk to a smaller size. {{(pid=75045) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 08 23:21:18 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-94fec9d7-9ae4-4304-b898-f34905377c4d tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] [instance: 43f31110-89ec-4b20-9842-7c9dd7df0e14] Created local disks {{(pid=75045) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 23:21:18 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-94fec9d7-9ae4-4304-b898-f34905377c4d tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] [instance: 43f31110-89ec-4b20-9842-7c9dd7df0e14] Ensure instance console log exists: /opt/stack/data/nova/instances/43f31110-89ec-4b20-9842-7c9dd7df0e14/console.log {{(pid=75045) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 23:21:18 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-94fec9d7-9ae4-4304-b898-f34905377c4d tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:21:18 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-94fec9d7-9ae4-4304-b898-f34905377c4d tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:21:18 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-94fec9d7-9ae4-4304-b898-f34905377c4d tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:21:19 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:21:19 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:21:19 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:21:19 user nova-compute[75045]: DEBUG nova.compute.manager [req-3934a5d5-a1a9-4044-91d1-5f1678074e72 req-b5f24ff2-5202-4e0b-b214-24164321b60b service nova] [instance: d2c911cf-d5f4-4c19-8335-8c7834184a7e] Received event network-vif-plugged-f4321c52-b9d5-434c-820f-25cab4239ef4 {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:21:19 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-3934a5d5-a1a9-4044-91d1-5f1678074e72 req-b5f24ff2-5202-4e0b-b214-24164321b60b service nova] Acquiring lock "d2c911cf-d5f4-4c19-8335-8c7834184a7e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:21:19 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-3934a5d5-a1a9-4044-91d1-5f1678074e72 req-b5f24ff2-5202-4e0b-b214-24164321b60b service nova] Lock "d2c911cf-d5f4-4c19-8335-8c7834184a7e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:21:19 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-3934a5d5-a1a9-4044-91d1-5f1678074e72 req-b5f24ff2-5202-4e0b-b214-24164321b60b service nova] Lock "d2c911cf-d5f4-4c19-8335-8c7834184a7e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:21:19 user nova-compute[75045]: DEBUG nova.compute.manager [req-3934a5d5-a1a9-4044-91d1-5f1678074e72 req-b5f24ff2-5202-4e0b-b214-24164321b60b service nova] [instance: d2c911cf-d5f4-4c19-8335-8c7834184a7e] No waiting events found dispatching network-vif-plugged-f4321c52-b9d5-434c-820f-25cab4239ef4 {{(pid=75045) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 23:21:19 user nova-compute[75045]: WARNING nova.compute.manager [req-3934a5d5-a1a9-4044-91d1-5f1678074e72 req-b5f24ff2-5202-4e0b-b214-24164321b60b service nova] [instance: d2c911cf-d5f4-4c19-8335-8c7834184a7e] Received unexpected event network-vif-plugged-f4321c52-b9d5-434c-820f-25cab4239ef4 for instance with vm_state active and task_state rescuing.
Nov 08 23:21:19 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:21:19 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:21:19 user nova-compute[75045]: DEBUG nova.network.neutron [None req-94fec9d7-9ae4-4304-b898-f34905377c4d tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] [instance: 43f31110-89ec-4b20-9842-7c9dd7df0e14] Successfully updated port: 509a96ec-b573-4408-bf93-87bccca95836 {{(pid=75045) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 23:21:19 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-94fec9d7-9ae4-4304-b898-f34905377c4d tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Acquiring lock "refresh_cache-43f31110-89ec-4b20-9842-7c9dd7df0e14" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 23:21:19 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-94fec9d7-9ae4-4304-b898-f34905377c4d tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Acquired lock "refresh_cache-43f31110-89ec-4b20-9842-7c9dd7df0e14" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 23:21:19 user nova-compute[75045]: DEBUG nova.network.neutron [None req-94fec9d7-9ae4-4304-b898-f34905377c4d tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] [instance: 43f31110-89ec-4b20-9842-7c9dd7df0e14] Building network info cache for instance {{(pid=75045) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 23:21:19 user nova-compute[75045]: DEBUG nova.compute.manager [req-a091a97d-623b-43c1-a623-5aa50ff2a169 req-e0f1725e-4bc7-4728-be44-604af166f2b8 service nova] [instance: 43f31110-89ec-4b20-9842-7c9dd7df0e14] Received event network-changed-509a96ec-b573-4408-bf93-87bccca95836 {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:21:19 user nova-compute[75045]: DEBUG nova.compute.manager [req-a091a97d-623b-43c1-a623-5aa50ff2a169 req-e0f1725e-4bc7-4728-be44-604af166f2b8 service nova] [instance: 43f31110-89ec-4b20-9842-7c9dd7df0e14] Refreshing instance network info cache due to event network-changed-509a96ec-b573-4408-bf93-87bccca95836. {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 23:21:19 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-a091a97d-623b-43c1-a623-5aa50ff2a169 req-e0f1725e-4bc7-4728-be44-604af166f2b8 service nova] Acquiring lock "refresh_cache-43f31110-89ec-4b20-9842-7c9dd7df0e14" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 23:21:19 user nova-compute[75045]: DEBUG nova.network.neutron [None req-94fec9d7-9ae4-4304-b898-f34905377c4d tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] [instance: 43f31110-89ec-4b20-9842-7c9dd7df0e14] Instance cache missing network info. {{(pid=75045) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 23:21:20 user nova-compute[75045]: DEBUG nova.network.neutron [None req-94fec9d7-9ae4-4304-b898-f34905377c4d tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] [instance: 43f31110-89ec-4b20-9842-7c9dd7df0e14] Updating instance_info_cache with network_info: [{"id": "509a96ec-b573-4408-bf93-87bccca95836", "address": "fa:16:3e:db:57:7b", "network": {"id": "2f33d93d-98ec-4b87-a0c0-efe2d2ac8f6d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-719527911-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7eff4be777d24514be52868961bf7a25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap509a96ec-b5", "ovs_interfaceid": "509a96ec-b573-4408-bf93-87bccca95836", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75045) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 23:21:20 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-94fec9d7-9ae4-4304-b898-f34905377c4d tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Releasing lock "refresh_cache-43f31110-89ec-4b20-9842-7c9dd7df0e14" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 23:21:20 user nova-compute[75045]: DEBUG nova.compute.manager [None req-94fec9d7-9ae4-4304-b898-f34905377c4d tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] [instance: 43f31110-89ec-4b20-9842-7c9dd7df0e14] Instance network_info: |[{"id": "509a96ec-b573-4408-bf93-87bccca95836", "address": "fa:16:3e:db:57:7b", "network": {"id": "2f33d93d-98ec-4b87-a0c0-efe2d2ac8f6d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-719527911-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7eff4be777d24514be52868961bf7a25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap509a96ec-b5", "ovs_interfaceid": "509a96ec-b573-4408-bf93-87bccca95836", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75045) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 23:21:20 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-a091a97d-623b-43c1-a623-5aa50ff2a169 req-e0f1725e-4bc7-4728-be44-604af166f2b8 service nova] Acquired lock "refresh_cache-43f31110-89ec-4b20-9842-7c9dd7df0e14" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 23:21:20 user nova-compute[75045]: DEBUG nova.network.neutron [req-a091a97d-623b-43c1-a623-5aa50ff2a169 req-e0f1725e-4bc7-4728-be44-604af166f2b8 service nova] [instance: 43f31110-89ec-4b20-9842-7c9dd7df0e14] Refreshing network info cache for port 509a96ec-b573-4408-bf93-87bccca95836 {{(pid=75045) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 23:21:20 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-94fec9d7-9ae4-4304-b898-f34905377c4d tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] [instance: 43f31110-89ec-4b20-9842-7c9dd7df0e14] Start _get_guest_xml network_info=[{"id": "509a96ec-b573-4408-bf93-87bccca95836", "address": "fa:16:3e:db:57:7b", "network": {"id": "2f33d93d-98ec-4b87-a0c0-efe2d2ac8f6d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-719527911-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7eff4be777d24514be52868961bf7a25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap509a96ec-b5", "ovs_interfaceid": "509a96ec-b573-4408-bf93-87bccca95836", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T23:11:54Z,direct_url=<?>,disk_format='qcow2',id=a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b1beba2cc4e7465ea249e2225fb494dc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T23:11:56Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'disk_bus': 'virtio', 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': 'a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75045) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 23:21:20 user nova-compute[75045]: WARNING nova.virt.libvirt.driver [None req-94fec9d7-9ae4-4304-b898-f34905377c4d tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 23:21:20 user nova-compute[75045]: WARNING nova.virt.libvirt.driver [None req-94fec9d7-9ae4-4304-b898-f34905377c4d tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 23:21:20 user nova-compute[75045]: DEBUG nova.virt.libvirt.host [None req-94fec9d7-9ae4-4304-b898-f34905377c4d tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75045) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 23:21:20 user nova-compute[75045]: DEBUG nova.virt.libvirt.host [None req-94fec9d7-9ae4-4304-b898-f34905377c4d tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] CPU controller missing on host. {{(pid=75045) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 23:21:20 user nova-compute[75045]: DEBUG nova.virt.libvirt.host [None req-94fec9d7-9ae4-4304-b898-f34905377c4d tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75045) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 23:21:20 user nova-compute[75045]: DEBUG nova.virt.libvirt.host [None req-94fec9d7-9ae4-4304-b898-f34905377c4d tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] CPU controller found on host. {{(pid=75045) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 23:21:20 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-94fec9d7-9ae4-4304-b898-f34905377c4d tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75045) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 23:21:20 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-94fec9d7-9ae4-4304-b898-f34905377c4d tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T23:11:41Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T23:11:54Z,direct_url=<?>,disk_format='qcow2',id=a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b1beba2cc4e7465ea249e2225fb494dc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T23:11:56Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75045) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 23:21:20 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-94fec9d7-9ae4-4304-b898-f34905377c4d tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Flavor limits 0:0:0 {{(pid=75045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 23:21:20 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-94fec9d7-9ae4-4304-b898-f34905377c4d tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Image limits 0:0:0 {{(pid=75045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 23:21:20 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-94fec9d7-9ae4-4304-b898-f34905377c4d tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Flavor pref 0:0:0 {{(pid=75045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 23:21:20 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-94fec9d7-9ae4-4304-b898-f34905377c4d tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Image pref 0:0:0 {{(pid=75045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 23:21:20 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-94fec9d7-9ae4-4304-b898-f34905377c4d tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 23:21:20 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-94fec9d7-9ae4-4304-b898-f34905377c4d tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75045) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 23:21:20 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-94fec9d7-9ae4-4304-b898-f34905377c4d tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75045) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 23:21:20 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-94fec9d7-9ae4-4304-b898-f34905377c4d tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Got 1 possible topologies {{(pid=75045) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 23:21:20 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-94fec9d7-9ae4-4304-b898-f34905377c4d tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75045) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 23:21:20 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-94fec9d7-9ae4-4304-b898-f34905377c4d tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75045) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 23:21:20 user nova-compute[75045]: DEBUG nova.virt.libvirt.vif [None req-94fec9d7-9ae4-4304-b898-f34905377c4d tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T23:21:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-783057773',display_name='tempest-AttachVolumeNegativeTest-server-783057773',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-783057773',id=15,image_ref='a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIweSQytcBQHNyjBYp3RpOdxAOvFr8UkfBLh3g9yswv90eIjFmeErVHAiDu2rmOkHQ5M+KoQ37TqrcX8GUX8vKPmJPj26oGSiSDAr3sTIs8x/z9rJp6ocR3khkX9KB9SEA==',key_name='tempest-keypair-205969788',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7eff4be777d24514be52868961bf7a25',ramdisk_id='',reservation_id='r-j1j7y1ap',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1522456563',owner_user_name='tempest-AttachVolumeNegativeTest-1522456563-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T23:21:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4a05b178abe74b779a991e887bf135b2',uuid=43f31110-89ec-4b20-9842-7c9dd7df0e14,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "509a96ec-b573-4408-bf93-87bccca95836", "address": "fa:16:3e:db:57:7b", "network": {"id": "2f33d93d-98ec-4b87-a0c0-efe2d2ac8f6d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-719527911-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7eff4be777d24514be52868961bf7a25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap509a96ec-b5", "ovs_interfaceid": "509a96ec-b573-4408-bf93-87bccca95836", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75045) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 23:21:20 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-94fec9d7-9ae4-4304-b898-f34905377c4d tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Converting VIF {"id": "509a96ec-b573-4408-bf93-87bccca95836", "address": "fa:16:3e:db:57:7b", "network": {"id": "2f33d93d-98ec-4b87-a0c0-efe2d2ac8f6d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-719527911-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7eff4be777d24514be52868961bf7a25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap509a96ec-b5", "ovs_interfaceid": "509a96ec-b573-4408-bf93-87bccca95836", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 23:21:20 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-94fec9d7-9ae4-4304-b898-f34905377c4d tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:db:57:7b,bridge_name='br-int',has_traffic_filtering=True,id=509a96ec-b573-4408-bf93-87bccca95836,network=Network(2f33d93d-98ec-4b87-a0c0-efe2d2ac8f6d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap509a96ec-b5') {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 23:21:20 user nova-compute[75045]: DEBUG nova.objects.instance [None req-94fec9d7-9ae4-4304-b898-f34905377c4d tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Lazy-loading 'pci_devices' on Instance uuid 43f31110-89ec-4b20-9842-7c9dd7df0e14 {{(pid=75045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 23:21:20 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-94fec9d7-9ae4-4304-b898-f34905377c4d tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] [instance: 43f31110-89ec-4b20-9842-7c9dd7df0e14] End _get_guest_xml xml=<domain type="kvm">
Nov 08 23:21:20 user nova-compute[75045]:   <uuid>43f31110-89ec-4b20-9842-7c9dd7df0e14</uuid>
Nov 08 23:21:20 user nova-compute[75045]:   <name>instance-0000000f</name>
Nov 08 23:21:20 user nova-compute[75045]:   <memory>524288</memory>
Nov 08 23:21:20 user nova-compute[75045]:   <vcpu>1</vcpu>
Nov 08 23:21:20 user nova-compute[75045]:   <metadata>
Nov 08 23:21:20 user nova-compute[75045]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 23:21:20 user nova-compute[75045]:       <nova:package version="0.0.0"/>
Nov 08 23:21:20 user nova-compute[75045]:       <nova:name>tempest-AttachVolumeNegativeTest-server-783057773</nova:name>
Nov 08 23:21:20 user nova-compute[75045]:       <nova:creationTime>2023-11-08 23:21:20</nova:creationTime>
Nov 08 23:21:20 user nova-compute[75045]:       <nova:flavor name="m1.tiny">
Nov 08 23:21:20 user nova-compute[75045]:         <nova:memory>512</nova:memory>
Nov 08 23:21:20 user nova-compute[75045]:         <nova:disk>1</nova:disk>
Nov 08 23:21:20 user nova-compute[75045]:         <nova:swap>0</nova:swap>
Nov 08 23:21:20 user nova-compute[75045]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 23:21:20 user nova-compute[75045]:         <nova:vcpus>1</nova:vcpus>
Nov 08 23:21:20 user nova-compute[75045]:       </nova:flavor>
Nov 08 23:21:20 user nova-compute[75045]:       <nova:owner>
Nov 08 23:21:20 user nova-compute[75045]:         <nova:user uuid="4a05b178abe74b779a991e887bf135b2">tempest-AttachVolumeNegativeTest-1522456563-project-member</nova:user>
Nov 08 23:21:20 user nova-compute[75045]:         <nova:project uuid="7eff4be777d24514be52868961bf7a25">tempest-AttachVolumeNegativeTest-1522456563</nova:project>
Nov 08 23:21:20 user nova-compute[75045]:       </nova:owner>
Nov 08 23:21:20 user nova-compute[75045]:       <nova:root type="image" uuid="a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb"/>
Nov 08 23:21:20 user nova-compute[75045]:       <nova:ports>
Nov 08 23:21:20 user nova-compute[75045]:         <nova:port uuid="509a96ec-b573-4408-bf93-87bccca95836">
Nov 08 23:21:20 user nova-compute[75045]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 08 23:21:20 user nova-compute[75045]:         </nova:port>
Nov 08 23:21:20 user nova-compute[75045]:       </nova:ports>
Nov 08 23:21:20 user nova-compute[75045]:     </nova:instance>
Nov 08 23:21:20 user nova-compute[75045]:   </metadata>
Nov 08 23:21:20 user nova-compute[75045]:   <sysinfo type="smbios">
Nov 08 23:21:20 user nova-compute[75045]:     <system>
Nov 08 23:21:20 user nova-compute[75045]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 23:21:20 user nova-compute[75045]:       <entry name="product">OpenStack Nova</entry>
Nov 08 23:21:20 user nova-compute[75045]:       <entry name="version">0.0.0</entry>
Nov 08 23:21:20 user nova-compute[75045]:       <entry name="serial">43f31110-89ec-4b20-9842-7c9dd7df0e14</entry>
Nov 08 23:21:20 user nova-compute[75045]:       <entry name="uuid">43f31110-89ec-4b20-9842-7c9dd7df0e14</entry>
Nov 08 23:21:20 user nova-compute[75045]:       <entry name="family">Virtual Machine</entry>
Nov 08 23:21:20 user nova-compute[75045]:     </system>
Nov 08 23:21:20 user nova-compute[75045]:   </sysinfo>
Nov 08 23:21:20 user nova-compute[75045]:   <os>
Nov 08 23:21:20 user nova-compute[75045]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 23:21:20 user nova-compute[75045]:     <boot dev="hd"/>
Nov 08 23:21:20 user nova-compute[75045]:     <smbios mode="sysinfo"/>
Nov 08 23:21:20 user nova-compute[75045]:   </os>
Nov 08 23:21:20 user nova-compute[75045]:   <features>
Nov 08 23:21:20 user nova-compute[75045]:     <acpi/>
Nov 08 23:21:20 user nova-compute[75045]:     <apic/>
Nov 08 23:21:20 user nova-compute[75045]:     <vmcoreinfo/>
Nov 08 23:21:20 user nova-compute[75045]:   </features>
Nov 08 23:21:20 user nova-compute[75045]:   <clock offset="utc">
Nov 08 23:21:20 user nova-compute[75045]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 23:21:20 user nova-compute[75045]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 23:21:20 user nova-compute[75045]:     <timer name="hpet" present="no"/>
Nov 08 23:21:20 user nova-compute[75045]:   </clock>
Nov 08 23:21:20 user nova-compute[75045]:   <cpu mode="custom" match="exact">
Nov 08 23:21:20 user nova-compute[75045]:     <model>Nehalem</model>
Nov 08 23:21:20 user nova-compute[75045]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 23:21:20 user nova-compute[75045]:   </cpu>
Nov 08 23:21:20 user nova-compute[75045]:   <devices>
Nov 08 23:21:20 user nova-compute[75045]:     <disk type="file" device="disk">
Nov 08 23:21:20 user nova-compute[75045]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 23:21:20 user nova-compute[75045]:       <source file="/opt/stack/data/nova/instances/43f31110-89ec-4b20-9842-7c9dd7df0e14/disk"/>
Nov 08 23:21:20 user nova-compute[75045]:       <target dev="vda" bus="virtio"/>
Nov 08 23:21:20 user nova-compute[75045]:     </disk>
Nov 08 23:21:20 user nova-compute[75045]:     <interface type="ethernet">
Nov 08 23:21:20 user nova-compute[75045]:       <mac address="fa:16:3e:db:57:7b"/>
Nov 08 23:21:20 user nova-compute[75045]:       <model type="virtio"/>
Nov 08 23:21:20 user nova-compute[75045]:       <mtu size="1442"/>
Nov 08 23:21:20 user nova-compute[75045]:       <target dev="tap509a96ec-b5"/>
Nov 08 23:21:20 user nova-compute[75045]:     </interface>
Nov 08 23:21:20 user nova-compute[75045]:     <serial type="pty">
Nov 08 23:21:20 user nova-compute[75045]:       <log file="/opt/stack/data/nova/instances/43f31110-89ec-4b20-9842-7c9dd7df0e14/console.log" append="off"/>
Nov 08 23:21:20 user nova-compute[75045]:     </serial>
Nov 08 23:21:20 user nova-compute[75045]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 23:21:20 user nova-compute[75045]:     <video>
Nov 08 23:21:20 user nova-compute[75045]:       <model type="virtio"/>
Nov 08 23:21:20 user nova-compute[75045]:     </video>
Nov 08 23:21:20 user nova-compute[75045]:     <rng model="virtio">
Nov 08 23:21:20 user nova-compute[75045]:       <backend model="random">/dev/urandom</backend>
Nov 08 23:21:20 user nova-compute[75045]:     </rng>
Nov 08 23:21:20 user nova-compute[75045]:     <controller type="usb" index="0" model="none"/>
Nov 08 23:21:20 user nova-compute[75045]:     <memballoon model="virtio">
Nov 08 23:21:20 user nova-compute[75045]:       <stats period="10"/>
Nov 08 23:21:20 user nova-compute[75045]:     </memballoon>
Nov 08 23:21:20 user nova-compute[75045]:   </devices>
Nov 08 23:21:20 user nova-compute[75045]: </domain>
Nov 08 23:21:20 user nova-compute[75045]:  {{(pid=75045) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 23:21:20 user nova-compute[75045]: DEBUG nova.virt.libvirt.vif [None req-94fec9d7-9ae4-4304-b898-f34905377c4d tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T23:21:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-783057773',display_name='tempest-AttachVolumeNegativeTest-server-783057773',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-783057773',id=15,image_ref='a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIweSQytcBQHNyjBYp3RpOdxAOvFr8UkfBLh3g9yswv90eIjFmeErVHAiDu2rmOkHQ5M+KoQ37TqrcX8GUX8vKPmJPj26oGSiSDAr3sTIs8x/z9rJp6ocR3khkX9KB9SEA==',key_name='tempest-keypair-205969788',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7eff4be777d24514be52868961bf7a25',ramdisk_id='',reservation_id='r-j1j7y1ap',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1522456563',owner_user_name='tempest-AttachVolumeNegativeTest-1522456563-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T23:21:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4a05b178abe74b779a991e887bf135b2',uuid=43f31110-89ec-4b20-9842-7c9dd7df0e14,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "509a96ec-b573-4408-bf93-87bccca95836", "address": "fa:16:3e:db:57:7b", "network": {"id": "2f33d93d-98ec-4b87-a0c0-efe2d2ac8f6d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-719527911-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7eff4be777d24514be52868961bf7a25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap509a96ec-b5", "ovs_interfaceid": "509a96ec-b573-4408-bf93-87bccca95836", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75045) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 23:21:20 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-94fec9d7-9ae4-4304-b898-f34905377c4d tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Converting VIF {"id": "509a96ec-b573-4408-bf93-87bccca95836", "address": "fa:16:3e:db:57:7b", "network": {"id": "2f33d93d-98ec-4b87-a0c0-efe2d2ac8f6d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-719527911-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7eff4be777d24514be52868961bf7a25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap509a96ec-b5", "ovs_interfaceid": "509a96ec-b573-4408-bf93-87bccca95836", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 23:21:20 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-94fec9d7-9ae4-4304-b898-f34905377c4d tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:db:57:7b,bridge_name='br-int',has_traffic_filtering=True,id=509a96ec-b573-4408-bf93-87bccca95836,network=Network(2f33d93d-98ec-4b87-a0c0-efe2d2ac8f6d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap509a96ec-b5') {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 23:21:20 user nova-compute[75045]: DEBUG os_vif [None req-94fec9d7-9ae4-4304-b898-f34905377c4d tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:db:57:7b,bridge_name='br-int',has_traffic_filtering=True,id=509a96ec-b573-4408-bf93-87bccca95836,network=Network(2f33d93d-98ec-4b87-a0c0-efe2d2ac8f6d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap509a96ec-b5') {{(pid=75045) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 23:21:20 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:21:20 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:21:20 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 23:21:20 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:21:20 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '067f3c2e-8c19-5807-82f1-9335a60ed10b', '_type': 'linux-noop'}}, row=False) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:21:20 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:21:20 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:21:20 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:21:20 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap509a96ec-b5, may_exist=True, interface_attrs={}) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:21:20 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap509a96ec-b5, col_values=(('qos', UUID('874c1cbc-a930-4238-85dd-6660303118a0')),), if_exists=True) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:21:20 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap509a96ec-b5, col_values=(('external_ids', {'iface-id': '509a96ec-b573-4408-bf93-87bccca95836', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:db:57:7b', 'vm-uuid': '43f31110-89ec-4b20-9842-7c9dd7df0e14'}),), if_exists=True) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:21:20 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:21:20 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 23:21:20 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:21:20 user nova-compute[75045]: INFO os_vif [None req-94fec9d7-9ae4-4304-b898-f34905377c4d tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:db:57:7b,bridge_name='br-int',has_traffic_filtering=True,id=509a96ec-b573-4408-bf93-87bccca95836,network=Network(2f33d93d-98ec-4b87-a0c0-efe2d2ac8f6d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap509a96ec-b5')
Nov 08 23:21:20 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-94fec9d7-9ae4-4304-b898-f34905377c4d tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] No BDM found with device name vda, not building metadata. {{(pid=75045) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 23:21:20 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-94fec9d7-9ae4-4304-b898-f34905377c4d tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] No VIF found with MAC fa:16:3e:db:57:7b, not building metadata {{(pid=75045) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 23:21:20 user nova-compute[75045]: DEBUG nova.network.neutron [req-a091a97d-623b-43c1-a623-5aa50ff2a169 req-e0f1725e-4bc7-4728-be44-604af166f2b8 service nova] [instance: 43f31110-89ec-4b20-9842-7c9dd7df0e14] Updated VIF entry in instance network info cache for port 509a96ec-b573-4408-bf93-87bccca95836. {{(pid=75045) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 23:21:20 user nova-compute[75045]: DEBUG nova.network.neutron [req-a091a97d-623b-43c1-a623-5aa50ff2a169 req-e0f1725e-4bc7-4728-be44-604af166f2b8 service nova] [instance: 43f31110-89ec-4b20-9842-7c9dd7df0e14] Updating instance_info_cache with network_info: [{"id": "509a96ec-b573-4408-bf93-87bccca95836", "address": "fa:16:3e:db:57:7b", "network": {"id": "2f33d93d-98ec-4b87-a0c0-efe2d2ac8f6d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-719527911-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7eff4be777d24514be52868961bf7a25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap509a96ec-b5", "ovs_interfaceid": "509a96ec-b573-4408-bf93-87bccca95836", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75045) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 23:21:20 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-a091a97d-623b-43c1-a623-5aa50ff2a169 req-e0f1725e-4bc7-4728-be44-604af166f2b8 service nova] Releasing lock "refresh_cache-43f31110-89ec-4b20-9842-7c9dd7df0e14" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 23:21:20 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:21:21 user nova-compute[75045]: DEBUG nova.compute.manager [req-de6f4d55-0181-4dfe-a98a-2f021e9d5e7d req-db7b13d2-a100-4fef-9648-08b6cb4d64de service nova] [instance: d2c911cf-d5f4-4c19-8335-8c7834184a7e] Received event network-vif-plugged-f4321c52-b9d5-434c-820f-25cab4239ef4 {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:21:21 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-de6f4d55-0181-4dfe-a98a-2f021e9d5e7d req-db7b13d2-a100-4fef-9648-08b6cb4d64de service nova] Acquiring lock "d2c911cf-d5f4-4c19-8335-8c7834184a7e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:21:21 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-de6f4d55-0181-4dfe-a98a-2f021e9d5e7d req-db7b13d2-a100-4fef-9648-08b6cb4d64de service nova] Lock "d2c911cf-d5f4-4c19-8335-8c7834184a7e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:21:21 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-de6f4d55-0181-4dfe-a98a-2f021e9d5e7d req-db7b13d2-a100-4fef-9648-08b6cb4d64de service nova] Lock "d2c911cf-d5f4-4c19-8335-8c7834184a7e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:21:21 user nova-compute[75045]: DEBUG nova.compute.manager [req-de6f4d55-0181-4dfe-a98a-2f021e9d5e7d req-db7b13d2-a100-4fef-9648-08b6cb4d64de service nova] [instance: d2c911cf-d5f4-4c19-8335-8c7834184a7e] No waiting events found dispatching network-vif-plugged-f4321c52-b9d5-434c-820f-25cab4239ef4 {{(pid=75045) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 23:21:21 user nova-compute[75045]: WARNING nova.compute.manager [req-de6f4d55-0181-4dfe-a98a-2f021e9d5e7d req-db7b13d2-a100-4fef-9648-08b6cb4d64de service nova] [instance: d2c911cf-d5f4-4c19-8335-8c7834184a7e] Received unexpected event network-vif-plugged-f4321c52-b9d5-434c-820f-25cab4239ef4 for instance with vm_state active and task_state rescuing.
Nov 08 23:21:21 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:21:21 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:21:21 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:21:21 user nova-compute[75045]: DEBUG nova.compute.manager [None req-67eeb900-b53a-46c6-ad9f-de31511f3fa4 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] [instance: d2c911cf-d5f4-4c19-8335-8c7834184a7e] Checking state {{(pid=75045) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 23:21:21 user nova-compute[75045]: DEBUG nova.compute.manager [req-5327264c-8087-4cdb-a630-73a7810b6c39 req-c248780b-79da-439e-bbca-1956a16246b4 service nova] [instance: 43f31110-89ec-4b20-9842-7c9dd7df0e14] Received event network-vif-plugged-509a96ec-b573-4408-bf93-87bccca95836 {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:21:21 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-5327264c-8087-4cdb-a630-73a7810b6c39 req-c248780b-79da-439e-bbca-1956a16246b4 service nova] Acquiring lock "43f31110-89ec-4b20-9842-7c9dd7df0e14-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:21:21 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-5327264c-8087-4cdb-a630-73a7810b6c39 req-c248780b-79da-439e-bbca-1956a16246b4 service nova] Lock "43f31110-89ec-4b20-9842-7c9dd7df0e14-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:21:21 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-5327264c-8087-4cdb-a630-73a7810b6c39 req-c248780b-79da-439e-bbca-1956a16246b4 service nova] Lock "43f31110-89ec-4b20-9842-7c9dd7df0e14-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:21:21 user nova-compute[75045]: DEBUG nova.compute.manager [req-5327264c-8087-4cdb-a630-73a7810b6c39 req-c248780b-79da-439e-bbca-1956a16246b4 service nova] [instance: 43f31110-89ec-4b20-9842-7c9dd7df0e14] No waiting events found dispatching network-vif-plugged-509a96ec-b573-4408-bf93-87bccca95836 {{(pid=75045) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 23:21:21 user nova-compute[75045]: WARNING nova.compute.manager [req-5327264c-8087-4cdb-a630-73a7810b6c39 req-c248780b-79da-439e-bbca-1956a16246b4 service nova] [instance: 43f31110-89ec-4b20-9842-7c9dd7df0e14] Received unexpected event network-vif-plugged-509a96ec-b573-4408-bf93-87bccca95836 for instance with vm_state building and task_state spawning.
Nov 08 23:21:22 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:21:22 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:21:22 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:21:24 user nova-compute[75045]: DEBUG nova.compute.manager [req-4008ce1b-6e03-414e-b0c2-d6cc7f290f31 req-3ba63267-ee25-4b65-8867-085ff5d8d05e service nova] [instance: 43f31110-89ec-4b20-9842-7c9dd7df0e14] Received event network-vif-plugged-509a96ec-b573-4408-bf93-87bccca95836 {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:21:24 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-4008ce1b-6e03-414e-b0c2-d6cc7f290f31 req-3ba63267-ee25-4b65-8867-085ff5d8d05e service nova] Acquiring lock "43f31110-89ec-4b20-9842-7c9dd7df0e14-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:21:24 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-4008ce1b-6e03-414e-b0c2-d6cc7f290f31 req-3ba63267-ee25-4b65-8867-085ff5d8d05e service nova] Lock "43f31110-89ec-4b20-9842-7c9dd7df0e14-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:21:24 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-4008ce1b-6e03-414e-b0c2-d6cc7f290f31 req-3ba63267-ee25-4b65-8867-085ff5d8d05e service nova] Lock "43f31110-89ec-4b20-9842-7c9dd7df0e14-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:21:24 user nova-compute[75045]: DEBUG nova.compute.manager [req-4008ce1b-6e03-414e-b0c2-d6cc7f290f31 req-3ba63267-ee25-4b65-8867-085ff5d8d05e service nova] [instance: 43f31110-89ec-4b20-9842-7c9dd7df0e14] No waiting events found dispatching network-vif-plugged-509a96ec-b573-4408-bf93-87bccca95836 {{(pid=75045) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 23:21:24 user nova-compute[75045]: WARNING nova.compute.manager [req-4008ce1b-6e03-414e-b0c2-d6cc7f290f31 req-3ba63267-ee25-4b65-8867-085ff5d8d05e service nova] [instance: 43f31110-89ec-4b20-9842-7c9dd7df0e14] Received unexpected event network-vif-plugged-509a96ec-b573-4408-bf93-87bccca95836 for instance with vm_state building and task_state spawning.
Nov 08 23:21:24 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:21:24 user nova-compute[75045]: DEBUG nova.compute.manager [None req-94fec9d7-9ae4-4304-b898-f34905377c4d tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] [instance: 43f31110-89ec-4b20-9842-7c9dd7df0e14] Instance event wait completed in 0 seconds for  {{(pid=75045) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 23:21:24 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-94fec9d7-9ae4-4304-b898-f34905377c4d tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] [instance: 43f31110-89ec-4b20-9842-7c9dd7df0e14] Guest created on hypervisor {{(pid=75045) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 23:21:24 user nova-compute[75045]: INFO nova.virt.libvirt.driver [-] [instance: 43f31110-89ec-4b20-9842-7c9dd7df0e14] Instance spawned successfully.
Nov 08 23:21:24 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-94fec9d7-9ae4-4304-b898-f34905377c4d tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] [instance: 43f31110-89ec-4b20-9842-7c9dd7df0e14] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75045) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 23:21:24 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-94fec9d7-9ae4-4304-b898-f34905377c4d tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] [instance: 43f31110-89ec-4b20-9842-7c9dd7df0e14] Found default for hw_cdrom_bus of ide {{(pid=75045) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 23:21:24 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-94fec9d7-9ae4-4304-b898-f34905377c4d tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] [instance: 43f31110-89ec-4b20-9842-7c9dd7df0e14] Found default for hw_disk_bus of virtio {{(pid=75045) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 23:21:24 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-94fec9d7-9ae4-4304-b898-f34905377c4d tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] [instance: 43f31110-89ec-4b20-9842-7c9dd7df0e14] Found default for hw_input_bus of None {{(pid=75045) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 23:21:24 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-94fec9d7-9ae4-4304-b898-f34905377c4d tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] [instance: 43f31110-89ec-4b20-9842-7c9dd7df0e14] Found default for hw_pointer_model of None {{(pid=75045) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 23:21:24 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-94fec9d7-9ae4-4304-b898-f34905377c4d tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] [instance: 43f31110-89ec-4b20-9842-7c9dd7df0e14] Found default for hw_video_model of virtio {{(pid=75045) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 23:21:24 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-94fec9d7-9ae4-4304-b898-f34905377c4d tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] [instance: 43f31110-89ec-4b20-9842-7c9dd7df0e14] Found default for hw_vif_model of virtio {{(pid=75045) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 23:21:24 user nova-compute[75045]: INFO nova.compute.manager [None req-94fec9d7-9ae4-4304-b898-f34905377c4d tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] [instance: 43f31110-89ec-4b20-9842-7c9dd7df0e14] Took 6.53 seconds to spawn the instance on the hypervisor.
Nov 08 23:21:24 user nova-compute[75045]: DEBUG nova.compute.manager [None req-94fec9d7-9ae4-4304-b898-f34905377c4d tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] [instance: 43f31110-89ec-4b20-9842-7c9dd7df0e14] Checking state {{(pid=75045) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 23:21:24 user nova-compute[75045]: INFO nova.compute.manager [None req-94fec9d7-9ae4-4304-b898-f34905377c4d tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] [instance: 43f31110-89ec-4b20-9842-7c9dd7df0e14] Took 7.51 seconds to build instance.
Nov 08 23:21:24 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-94fec9d7-9ae4-4304-b898-f34905377c4d tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Lock "43f31110-89ec-4b20-9842-7c9dd7df0e14" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.628s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:21:25 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:21:25 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:21:26 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:21:27 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:21:27 user nova-compute[75045]: DEBUG nova.compute.manager [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Cleaning up deleted instances with incomplete migration  {{(pid=75045) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 08 23:21:29 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-1f99ea05-2cf9-4156-b99a-32adf7676ee0 tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] Acquiring lock "83d225e0-e39e-4500-b7ae-52dfbd8b8588" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:21:29 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-1f99ea05-2cf9-4156-b99a-32adf7676ee0 tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] Lock "83d225e0-e39e-4500-b7ae-52dfbd8b8588" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:21:29 user nova-compute[75045]: DEBUG nova.compute.manager [None req-1f99ea05-2cf9-4156-b99a-32adf7676ee0 tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] [instance: 83d225e0-e39e-4500-b7ae-52dfbd8b8588] Starting instance... {{(pid=75045) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 23:21:29 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-1f99ea05-2cf9-4156-b99a-32adf7676ee0 tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:21:29 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-1f99ea05-2cf9-4156-b99a-32adf7676ee0 tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:21:29 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-1f99ea05-2cf9-4156-b99a-32adf7676ee0 tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75045) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 23:21:29 user nova-compute[75045]: INFO nova.compute.claims [None req-1f99ea05-2cf9-4156-b99a-32adf7676ee0 tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] [instance: 83d225e0-e39e-4500-b7ae-52dfbd8b8588] Claim successful on node user
Nov 08 23:21:29 user nova-compute[75045]: DEBUG nova.compute.provider_tree [None req-1f99ea05-2cf9-4156-b99a-32adf7676ee0 tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] Inventory has not changed in ProviderTree for provider: 62ba5f85-c74d-4b58-986e-d4197e813fd7 {{(pid=75045) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 23:21:29 user nova-compute[75045]: DEBUG nova.scheduler.client.report [None req-1f99ea05-2cf9-4156-b99a-32adf7676ee0 tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] Inventory has not changed for provider 62ba5f85-c74d-4b58-986e-d4197e813fd7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75045) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 23:21:29 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-1f99ea05-2cf9-4156-b99a-32adf7676ee0 tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.387s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:21:29 user nova-compute[75045]: DEBUG nova.compute.manager [None req-1f99ea05-2cf9-4156-b99a-32adf7676ee0 tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] [instance: 83d225e0-e39e-4500-b7ae-52dfbd8b8588] Start building networks asynchronously for instance. {{(pid=75045) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 23:21:29 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:21:30 user nova-compute[75045]: DEBUG nova.compute.manager [None req-1f99ea05-2cf9-4156-b99a-32adf7676ee0 tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] [instance: 83d225e0-e39e-4500-b7ae-52dfbd8b8588] Allocating IP information in the background. {{(pid=75045) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 23:21:30 user nova-compute[75045]: DEBUG nova.network.neutron [None req-1f99ea05-2cf9-4156-b99a-32adf7676ee0 tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] [instance: 83d225e0-e39e-4500-b7ae-52dfbd8b8588] allocate_for_instance() {{(pid=75045) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 23:21:30 user nova-compute[75045]: INFO nova.virt.libvirt.driver [None req-1f99ea05-2cf9-4156-b99a-32adf7676ee0 tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] [instance: 83d225e0-e39e-4500-b7ae-52dfbd8b8588] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 23:21:30 user nova-compute[75045]: DEBUG nova.compute.manager [None req-1f99ea05-2cf9-4156-b99a-32adf7676ee0 tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] [instance: 83d225e0-e39e-4500-b7ae-52dfbd8b8588] Start building block device mappings for instance. {{(pid=75045) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 23:21:30 user nova-compute[75045]: DEBUG nova.policy [None req-1f99ea05-2cf9-4156-b99a-32adf7676ee0 tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '57d0c13f5a9f4c1bbb0458b93de348cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '467f0ecc3b93457f9fe83886b99c6285', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75045) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 23:21:30 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:21:30 user nova-compute[75045]: DEBUG nova.compute.manager [None req-1f99ea05-2cf9-4156-b99a-32adf7676ee0 tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] [instance: 83d225e0-e39e-4500-b7ae-52dfbd8b8588] Start spawning the instance on the hypervisor. {{(pid=75045) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 23:21:30 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-1f99ea05-2cf9-4156-b99a-32adf7676ee0 tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] [instance: 83d225e0-e39e-4500-b7ae-52dfbd8b8588] Creating instance directory {{(pid=75045) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 23:21:30 user nova-compute[75045]: INFO nova.virt.libvirt.driver [None req-1f99ea05-2cf9-4156-b99a-32adf7676ee0 tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] [instance: 83d225e0-e39e-4500-b7ae-52dfbd8b8588] Creating image(s)
Nov 08 23:21:30 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-1f99ea05-2cf9-4156-b99a-32adf7676ee0 tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] Acquiring lock "/opt/stack/data/nova/instances/83d225e0-e39e-4500-b7ae-52dfbd8b8588/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:21:30 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-1f99ea05-2cf9-4156-b99a-32adf7676ee0 tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] Lock "/opt/stack/data/nova/instances/83d225e0-e39e-4500-b7ae-52dfbd8b8588/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:21:30 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-1f99ea05-2cf9-4156-b99a-32adf7676ee0 tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] Lock "/opt/stack/data/nova/instances/83d225e0-e39e-4500-b7ae-52dfbd8b8588/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:21:30 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-1f99ea05-2cf9-4156-b99a-32adf7676ee0 tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b59f52a99fff51c56dd1edfb83892fb8f647f2f3 --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:21:30 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-1f99ea05-2cf9-4156-b99a-32adf7676ee0 tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b59f52a99fff51c56dd1edfb83892fb8f647f2f3 --force-share --output=json" returned: 0 in 0.216s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:21:30 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-1f99ea05-2cf9-4156-b99a-32adf7676ee0 tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] Acquiring lock "b59f52a99fff51c56dd1edfb83892fb8f647f2f3" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:21:30 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-1f99ea05-2cf9-4156-b99a-32adf7676ee0 tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] Lock "b59f52a99fff51c56dd1edfb83892fb8f647f2f3" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:21:30 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-1f99ea05-2cf9-4156-b99a-32adf7676ee0 tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b59f52a99fff51c56dd1edfb83892fb8f647f2f3 --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:21:30 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-1f99ea05-2cf9-4156-b99a-32adf7676ee0 tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b59f52a99fff51c56dd1edfb83892fb8f647f2f3 --force-share --output=json" returned: 0 in 0.198s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:21:30 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-1f99ea05-2cf9-4156-b99a-32adf7676ee0 tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b59f52a99fff51c56dd1edfb83892fb8f647f2f3,backing_fmt=raw /opt/stack/data/nova/instances/83d225e0-e39e-4500-b7ae-52dfbd8b8588/disk 1073741824 {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:21:30 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:21:30 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-1f99ea05-2cf9-4156-b99a-32adf7676ee0 tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b59f52a99fff51c56dd1edfb83892fb8f647f2f3,backing_fmt=raw /opt/stack/data/nova/instances/83d225e0-e39e-4500-b7ae-52dfbd8b8588/disk 1073741824" returned: 0 in 0.061s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:21:30 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-1f99ea05-2cf9-4156-b99a-32adf7676ee0 tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] Lock "b59f52a99fff51c56dd1edfb83892fb8f647f2f3" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.269s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:21:30 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-1f99ea05-2cf9-4156-b99a-32adf7676ee0 tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b59f52a99fff51c56dd1edfb83892fb8f647f2f3 --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:21:30 user nova-compute[75045]: DEBUG nova.network.neutron [None req-1f99ea05-2cf9-4156-b99a-32adf7676ee0 tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] [instance: 83d225e0-e39e-4500-b7ae-52dfbd8b8588] Successfully created port: f34eef67-0428-49ea-91c3-08510ac690c8 {{(pid=75045) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 23:21:30 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:21:30 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-1f99ea05-2cf9-4156-b99a-32adf7676ee0 tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b59f52a99fff51c56dd1edfb83892fb8f647f2f3 --force-share --output=json" returned: 0 in 0.199s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:21:30 user nova-compute[75045]: DEBUG nova.virt.disk.api [None req-1f99ea05-2cf9-4156-b99a-32adf7676ee0 tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] Checking if we can resize image /opt/stack/data/nova/instances/83d225e0-e39e-4500-b7ae-52dfbd8b8588/disk. size=1073741824 {{(pid=75045) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 23:21:30 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-1f99ea05-2cf9-4156-b99a-32adf7676ee0 tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83d225e0-e39e-4500-b7ae-52dfbd8b8588/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:21:31 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-1f99ea05-2cf9-4156-b99a-32adf7676ee0 tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83d225e0-e39e-4500-b7ae-52dfbd8b8588/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:21:31 user nova-compute[75045]: DEBUG nova.virt.disk.api [None req-1f99ea05-2cf9-4156-b99a-32adf7676ee0 tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] Cannot resize image /opt/stack/data/nova/instances/83d225e0-e39e-4500-b7ae-52dfbd8b8588/disk to a smaller size. {{(pid=75045) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 08 23:21:31 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-1f99ea05-2cf9-4156-b99a-32adf7676ee0 tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] [instance: 83d225e0-e39e-4500-b7ae-52dfbd8b8588] Created local disks {{(pid=75045) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 23:21:31 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-1f99ea05-2cf9-4156-b99a-32adf7676ee0 tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] [instance: 83d225e0-e39e-4500-b7ae-52dfbd8b8588] Ensure instance console log exists: /opt/stack/data/nova/instances/83d225e0-e39e-4500-b7ae-52dfbd8b8588/console.log {{(pid=75045) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 23:21:31 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-1f99ea05-2cf9-4156-b99a-32adf7676ee0 tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:21:31 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-1f99ea05-2cf9-4156-b99a-32adf7676ee0 tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:21:31 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-1f99ea05-2cf9-4156-b99a-32adf7676ee0 tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:21:31 user nova-compute[75045]: DEBUG nova.network.neutron [None req-1f99ea05-2cf9-4156-b99a-32adf7676ee0 tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] [instance: 83d225e0-e39e-4500-b7ae-52dfbd8b8588] Successfully updated port: f34eef67-0428-49ea-91c3-08510ac690c8 {{(pid=75045) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 23:21:31 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-1f99ea05-2cf9-4156-b99a-32adf7676ee0 tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] Acquiring lock "refresh_cache-83d225e0-e39e-4500-b7ae-52dfbd8b8588" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 23:21:31 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-1f99ea05-2cf9-4156-b99a-32adf7676ee0 tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] Acquired lock "refresh_cache-83d225e0-e39e-4500-b7ae-52dfbd8b8588" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 23:21:31 user nova-compute[75045]: DEBUG nova.network.neutron [None req-1f99ea05-2cf9-4156-b99a-32adf7676ee0 tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] [instance: 83d225e0-e39e-4500-b7ae-52dfbd8b8588] Building network info cache for instance {{(pid=75045) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 23:21:31 user nova-compute[75045]: DEBUG nova.compute.manager [req-885b72de-7b95-4b85-93f3-1266a3ce2f8d req-1f5ad7bc-fc92-427b-84f0-78ec3447f3fe service nova] [instance: 83d225e0-e39e-4500-b7ae-52dfbd8b8588] Received event network-changed-f34eef67-0428-49ea-91c3-08510ac690c8 {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:21:31 user nova-compute[75045]: DEBUG nova.compute.manager [req-885b72de-7b95-4b85-93f3-1266a3ce2f8d req-1f5ad7bc-fc92-427b-84f0-78ec3447f3fe service nova] [instance: 83d225e0-e39e-4500-b7ae-52dfbd8b8588] Refreshing instance network info cache due to event network-changed-f34eef67-0428-49ea-91c3-08510ac690c8. {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 23:21:31 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-885b72de-7b95-4b85-93f3-1266a3ce2f8d req-1f5ad7bc-fc92-427b-84f0-78ec3447f3fe service nova] Acquiring lock "refresh_cache-83d225e0-e39e-4500-b7ae-52dfbd8b8588" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 23:21:31 user nova-compute[75045]: DEBUG nova.network.neutron [None req-1f99ea05-2cf9-4156-b99a-32adf7676ee0 tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] [instance: 83d225e0-e39e-4500-b7ae-52dfbd8b8588] Instance cache missing network info. {{(pid=75045) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 23:21:31 user nova-compute[75045]: DEBUG nova.network.neutron [None req-1f99ea05-2cf9-4156-b99a-32adf7676ee0 tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] [instance: 83d225e0-e39e-4500-b7ae-52dfbd8b8588] Updating instance_info_cache with network_info: [{"id": "f34eef67-0428-49ea-91c3-08510ac690c8", "address": "fa:16:3e:d9:92:a4", "network": {"id": "d177c8b8-5960-4e40-bf9b-920a2f6ba4f7", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-497258569-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "467f0ecc3b93457f9fe83886b99c6285", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf34eef67-04", "ovs_interfaceid": "f34eef67-0428-49ea-91c3-08510ac690c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75045) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 23:21:31 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-1f99ea05-2cf9-4156-b99a-32adf7676ee0 tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] Releasing lock "refresh_cache-83d225e0-e39e-4500-b7ae-52dfbd8b8588" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 23:21:31 user nova-compute[75045]: DEBUG nova.compute.manager [None req-1f99ea05-2cf9-4156-b99a-32adf7676ee0 tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] [instance: 83d225e0-e39e-4500-b7ae-52dfbd8b8588] Instance network_info: |[{"id": "f34eef67-0428-49ea-91c3-08510ac690c8", "address": "fa:16:3e:d9:92:a4", "network": {"id": "d177c8b8-5960-4e40-bf9b-920a2f6ba4f7", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-497258569-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "467f0ecc3b93457f9fe83886b99c6285", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf34eef67-04", "ovs_interfaceid": "f34eef67-0428-49ea-91c3-08510ac690c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75045) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 23:21:31 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-885b72de-7b95-4b85-93f3-1266a3ce2f8d req-1f5ad7bc-fc92-427b-84f0-78ec3447f3fe service nova] Acquired lock "refresh_cache-83d225e0-e39e-4500-b7ae-52dfbd8b8588" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 23:21:31 user nova-compute[75045]: DEBUG nova.network.neutron [req-885b72de-7b95-4b85-93f3-1266a3ce2f8d req-1f5ad7bc-fc92-427b-84f0-78ec3447f3fe service nova] [instance: 83d225e0-e39e-4500-b7ae-52dfbd8b8588] Refreshing network info cache for port f34eef67-0428-49ea-91c3-08510ac690c8 {{(pid=75045) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 23:21:31 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-1f99ea05-2cf9-4156-b99a-32adf7676ee0 tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] [instance: 83d225e0-e39e-4500-b7ae-52dfbd8b8588] Start _get_guest_xml network_info=[{"id": "f34eef67-0428-49ea-91c3-08510ac690c8", "address": "fa:16:3e:d9:92:a4", "network": {"id": "d177c8b8-5960-4e40-bf9b-920a2f6ba4f7", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-497258569-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "467f0ecc3b93457f9fe83886b99c6285", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf34eef67-04", "ovs_interfaceid": "f34eef67-0428-49ea-91c3-08510ac690c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T23:11:54Z,direct_url=<?>,disk_format='qcow2',id=a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b1beba2cc4e7465ea249e2225fb494dc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T23:11:56Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'disk_bus': 'virtio', 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': 'a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75045) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 23:21:31 user nova-compute[75045]: WARNING nova.virt.libvirt.driver [None req-1f99ea05-2cf9-4156-b99a-32adf7676ee0 tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 23:21:31 user nova-compute[75045]: WARNING nova.virt.libvirt.driver [None req-1f99ea05-2cf9-4156-b99a-32adf7676ee0 tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 23:21:31 user nova-compute[75045]: DEBUG nova.virt.libvirt.host [None req-1f99ea05-2cf9-4156-b99a-32adf7676ee0 tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75045) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 23:21:31 user nova-compute[75045]: DEBUG nova.virt.libvirt.host [None req-1f99ea05-2cf9-4156-b99a-32adf7676ee0 tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] CPU controller missing on host. {{(pid=75045) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 23:21:31 user nova-compute[75045]: DEBUG nova.virt.libvirt.host [None req-1f99ea05-2cf9-4156-b99a-32adf7676ee0 tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75045) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 23:21:31 user nova-compute[75045]: DEBUG nova.virt.libvirt.host [None req-1f99ea05-2cf9-4156-b99a-32adf7676ee0 tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] CPU controller found on host. {{(pid=75045) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 23:21:31 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-1f99ea05-2cf9-4156-b99a-32adf7676ee0 tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75045) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 23:21:31 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-1f99ea05-2cf9-4156-b99a-32adf7676ee0 tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T23:11:41Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T23:11:54Z,direct_url=<?>,disk_format='qcow2',id=a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b1beba2cc4e7465ea249e2225fb494dc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T23:11:56Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75045) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 23:21:31 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-1f99ea05-2cf9-4156-b99a-32adf7676ee0 tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] Flavor limits 0:0:0 {{(pid=75045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 23:21:31 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-1f99ea05-2cf9-4156-b99a-32adf7676ee0 tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] Image limits 0:0:0 {{(pid=75045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 23:21:31 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-1f99ea05-2cf9-4156-b99a-32adf7676ee0 tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] Flavor pref 0:0:0 {{(pid=75045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 23:21:31 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-1f99ea05-2cf9-4156-b99a-32adf7676ee0 tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] Image pref 0:0:0 {{(pid=75045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 23:21:31 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-1f99ea05-2cf9-4156-b99a-32adf7676ee0 tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 23:21:31 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-1f99ea05-2cf9-4156-b99a-32adf7676ee0 tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75045) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 23:21:31 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-1f99ea05-2cf9-4156-b99a-32adf7676ee0 tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75045) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 23:21:31 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-1f99ea05-2cf9-4156-b99a-32adf7676ee0 tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] Got 1 possible topologies {{(pid=75045) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 23:21:31 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-1f99ea05-2cf9-4156-b99a-32adf7676ee0 tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75045) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 23:21:31 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-1f99ea05-2cf9-4156-b99a-32adf7676ee0 tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75045) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 23:21:31 user nova-compute[75045]: DEBUG nova.virt.libvirt.vif [None req-1f99ea05-2cf9-4156-b99a-32adf7676ee0 tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T23:21:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-52454361',display_name='tempest-ServerActionsTestOtherB-server-52454361',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-52454361',id=16,image_ref='a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIPmBc8a5DafKsuCJlskOYpDDhPwBioEg4bK8XJOdFwOvE3kerS9/OlDrIi5hKJ4t8vHYgazIqYE6C9fG+r7udy2il9kXgn4I4yPKUfyTlGPaqAfUG4gtg1sBgzfEDpsow==',key_name='tempest-keypair-1494902868',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='467f0ecc3b93457f9fe83886b99c6285',ramdisk_id='',reservation_id='r-mtlunwmw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-299728934',owner_user_name='tempest-ServerActionsTestOtherB-299728934-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T23:21:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='57d0c13f5a9f4c1bbb0458b93de348cb',uuid=83d225e0-e39e-4500-b7ae-52dfbd8b8588,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f34eef67-0428-49ea-91c3-08510ac690c8", "address": "fa:16:3e:d9:92:a4", "network": {"id": "d177c8b8-5960-4e40-bf9b-920a2f6ba4f7", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-497258569-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "467f0ecc3b93457f9fe83886b99c6285", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf34eef67-04", "ovs_interfaceid": "f34eef67-0428-49ea-91c3-08510ac690c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75045) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 23:21:31 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-1f99ea05-2cf9-4156-b99a-32adf7676ee0 tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] Converting VIF {"id": "f34eef67-0428-49ea-91c3-08510ac690c8", "address": "fa:16:3e:d9:92:a4", "network": {"id": "d177c8b8-5960-4e40-bf9b-920a2f6ba4f7", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-497258569-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "467f0ecc3b93457f9fe83886b99c6285", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf34eef67-04", "ovs_interfaceid": "f34eef67-0428-49ea-91c3-08510ac690c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 23:21:31 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-1f99ea05-2cf9-4156-b99a-32adf7676ee0 tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d9:92:a4,bridge_name='br-int',has_traffic_filtering=True,id=f34eef67-0428-49ea-91c3-08510ac690c8,network=Network(d177c8b8-5960-4e40-bf9b-920a2f6ba4f7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf34eef67-04') {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 23:21:31 user nova-compute[75045]: DEBUG nova.objects.instance [None req-1f99ea05-2cf9-4156-b99a-32adf7676ee0 tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] Lazy-loading 'pci_devices' on Instance uuid 83d225e0-e39e-4500-b7ae-52dfbd8b8588 {{(pid=75045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 23:21:32 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-1f99ea05-2cf9-4156-b99a-32adf7676ee0 tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] [instance: 83d225e0-e39e-4500-b7ae-52dfbd8b8588] End _get_guest_xml xml=<domain type="kvm">
Nov 08 23:21:32 user nova-compute[75045]:   <uuid>83d225e0-e39e-4500-b7ae-52dfbd8b8588</uuid>
Nov 08 23:21:32 user nova-compute[75045]:   <name>instance-00000010</name>
Nov 08 23:21:32 user nova-compute[75045]:   <memory>524288</memory>
Nov 08 23:21:32 user nova-compute[75045]:   <vcpu>1</vcpu>
Nov 08 23:21:32 user nova-compute[75045]:   <metadata>
Nov 08 23:21:32 user nova-compute[75045]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 23:21:32 user nova-compute[75045]:       <nova:package version="0.0.0"/>
Nov 08 23:21:32 user nova-compute[75045]:       <nova:name>tempest-ServerActionsTestOtherB-server-52454361</nova:name>
Nov 08 23:21:32 user nova-compute[75045]:       <nova:creationTime>2023-11-08 23:21:31</nova:creationTime>
Nov 08 23:21:32 user nova-compute[75045]:       <nova:flavor name="m1.tiny">
Nov 08 23:21:32 user nova-compute[75045]:         <nova:memory>512</nova:memory>
Nov 08 23:21:32 user nova-compute[75045]:         <nova:disk>1</nova:disk>
Nov 08 23:21:32 user nova-compute[75045]:         <nova:swap>0</nova:swap>
Nov 08 23:21:32 user nova-compute[75045]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 23:21:32 user nova-compute[75045]:         <nova:vcpus>1</nova:vcpus>
Nov 08 23:21:32 user nova-compute[75045]:       </nova:flavor>
Nov 08 23:21:32 user nova-compute[75045]:       <nova:owner>
Nov 08 23:21:32 user nova-compute[75045]:         <nova:user uuid="57d0c13f5a9f4c1bbb0458b93de348cb">tempest-ServerActionsTestOtherB-299728934-project-member</nova:user>
Nov 08 23:21:32 user nova-compute[75045]:         <nova:project uuid="467f0ecc3b93457f9fe83886b99c6285">tempest-ServerActionsTestOtherB-299728934</nova:project>
Nov 08 23:21:32 user nova-compute[75045]:       </nova:owner>
Nov 08 23:21:32 user nova-compute[75045]:       <nova:root type="image" uuid="a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb"/>
Nov 08 23:21:32 user nova-compute[75045]:       <nova:ports>
Nov 08 23:21:32 user nova-compute[75045]:         <nova:port uuid="f34eef67-0428-49ea-91c3-08510ac690c8">
Nov 08 23:21:32 user nova-compute[75045]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 08 23:21:32 user nova-compute[75045]:         </nova:port>
Nov 08 23:21:32 user nova-compute[75045]:       </nova:ports>
Nov 08 23:21:32 user nova-compute[75045]:     </nova:instance>
Nov 08 23:21:32 user nova-compute[75045]:   </metadata>
Nov 08 23:21:32 user nova-compute[75045]:   <sysinfo type="smbios">
Nov 08 23:21:32 user nova-compute[75045]:     <system>
Nov 08 23:21:32 user nova-compute[75045]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 23:21:32 user nova-compute[75045]:       <entry name="product">OpenStack Nova</entry>
Nov 08 23:21:32 user nova-compute[75045]:       <entry name="version">0.0.0</entry>
Nov 08 23:21:32 user nova-compute[75045]:       <entry name="serial">83d225e0-e39e-4500-b7ae-52dfbd8b8588</entry>
Nov 08 23:21:32 user nova-compute[75045]:       <entry name="uuid">83d225e0-e39e-4500-b7ae-52dfbd8b8588</entry>
Nov 08 23:21:32 user nova-compute[75045]:       <entry name="family">Virtual Machine</entry>
Nov 08 23:21:32 user nova-compute[75045]:     </system>
Nov 08 23:21:32 user nova-compute[75045]:   </sysinfo>
Nov 08 23:21:32 user nova-compute[75045]:   <os>
Nov 08 23:21:32 user nova-compute[75045]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 23:21:32 user nova-compute[75045]:     <boot dev="hd"/>
Nov 08 23:21:32 user nova-compute[75045]:     <smbios mode="sysinfo"/>
Nov 08 23:21:32 user nova-compute[75045]:   </os>
Nov 08 23:21:32 user nova-compute[75045]:   <features>
Nov 08 23:21:32 user nova-compute[75045]:     <acpi/>
Nov 08 23:21:32 user nova-compute[75045]:     <apic/>
Nov 08 23:21:32 user nova-compute[75045]:     <vmcoreinfo/>
Nov 08 23:21:32 user nova-compute[75045]:   </features>
Nov 08 23:21:32 user nova-compute[75045]:   <clock offset="utc">
Nov 08 23:21:32 user nova-compute[75045]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 23:21:32 user nova-compute[75045]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 23:21:32 user nova-compute[75045]:     <timer name="hpet" present="no"/>
Nov 08 23:21:32 user nova-compute[75045]:   </clock>
Nov 08 23:21:32 user nova-compute[75045]:   <cpu mode="custom" match="exact">
Nov 08 23:21:32 user nova-compute[75045]:     <model>Nehalem</model>
Nov 08 23:21:32 user nova-compute[75045]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 23:21:32 user nova-compute[75045]:   </cpu>
Nov 08 23:21:32 user nova-compute[75045]:   <devices>
Nov 08 23:21:32 user nova-compute[75045]:     <disk type="file" device="disk">
Nov 08 23:21:32 user nova-compute[75045]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 23:21:32 user nova-compute[75045]:       <source file="/opt/stack/data/nova/instances/83d225e0-e39e-4500-b7ae-52dfbd8b8588/disk"/>
Nov 08 23:21:32 user nova-compute[75045]:       <target dev="vda" bus="virtio"/>
Nov 08 23:21:32 user nova-compute[75045]:     </disk>
Nov 08 23:21:32 user nova-compute[75045]:     <interface type="ethernet">
Nov 08 23:21:32 user nova-compute[75045]:       <mac address="fa:16:3e:d9:92:a4"/>
Nov 08 23:21:32 user nova-compute[75045]:       <model type="virtio"/>
Nov 08 23:21:32 user nova-compute[75045]:       <mtu size="1442"/>
Nov 08 23:21:32 user nova-compute[75045]:       <target dev="tapf34eef67-04"/>
Nov 08 23:21:32 user nova-compute[75045]:     </interface>
Nov 08 23:21:32 user nova-compute[75045]:     <serial type="pty">
Nov 08 23:21:32 user nova-compute[75045]:       <log file="/opt/stack/data/nova/instances/83d225e0-e39e-4500-b7ae-52dfbd8b8588/console.log" append="off"/>
Nov 08 23:21:32 user nova-compute[75045]:     </serial>
Nov 08 23:21:32 user nova-compute[75045]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 23:21:32 user nova-compute[75045]:     <video>
Nov 08 23:21:32 user nova-compute[75045]:       <model type="virtio"/>
Nov 08 23:21:32 user nova-compute[75045]:     </video>
Nov 08 23:21:32 user nova-compute[75045]:     <rng model="virtio">
Nov 08 23:21:32 user nova-compute[75045]:       <backend model="random">/dev/urandom</backend>
Nov 08 23:21:32 user nova-compute[75045]:     </rng>
Nov 08 23:21:32 user nova-compute[75045]:     <controller type="usb" index="0" model="none"/>
Nov 08 23:21:32 user nova-compute[75045]:     <memballoon model="virtio">
Nov 08 23:21:32 user nova-compute[75045]:       <stats period="10"/>
Nov 08 23:21:32 user nova-compute[75045]:     </memballoon>
Nov 08 23:21:32 user nova-compute[75045]:   </devices>
Nov 08 23:21:32 user nova-compute[75045]: </domain>
Nov 08 23:21:32 user nova-compute[75045]:  {{(pid=75045) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 23:21:32 user nova-compute[75045]: DEBUG nova.virt.libvirt.vif [None req-1f99ea05-2cf9-4156-b99a-32adf7676ee0 tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T23:21:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-52454361',display_name='tempest-ServerActionsTestOtherB-server-52454361',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-52454361',id=16,image_ref='a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIPmBc8a5DafKsuCJlskOYpDDhPwBioEg4bK8XJOdFwOvE3kerS9/OlDrIi5hKJ4t8vHYgazIqYE6C9fG+r7udy2il9kXgn4I4yPKUfyTlGPaqAfUG4gtg1sBgzfEDpsow==',key_name='tempest-keypair-1494902868',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='467f0ecc3b93457f9fe83886b99c6285',ramdisk_id='',reservation_id='r-mtlunwmw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-299728934',owner_user_name='tempest-ServerActionsTestOtherB-299728934-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T23:21:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='57d0c13f5a9f4c1bbb0458b93de348cb',uuid=83d225e0-e39e-4500-b7ae-52dfbd8b8588,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f34eef67-0428-49ea-91c3-08510ac690c8", "address": "fa:16:3e:d9:92:a4", "network": {"id": "d177c8b8-5960-4e40-bf9b-920a2f6ba4f7", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-497258569-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "467f0ecc3b93457f9fe83886b99c6285", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf34eef67-04", "ovs_interfaceid": "f34eef67-0428-49ea-91c3-08510ac690c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75045) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 23:21:32 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-1f99ea05-2cf9-4156-b99a-32adf7676ee0 tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] Converting VIF {"id": "f34eef67-0428-49ea-91c3-08510ac690c8", "address": "fa:16:3e:d9:92:a4", "network": {"id": "d177c8b8-5960-4e40-bf9b-920a2f6ba4f7", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-497258569-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "467f0ecc3b93457f9fe83886b99c6285", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf34eef67-04", "ovs_interfaceid": "f34eef67-0428-49ea-91c3-08510ac690c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 23:21:32 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-1f99ea05-2cf9-4156-b99a-32adf7676ee0 tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d9:92:a4,bridge_name='br-int',has_traffic_filtering=True,id=f34eef67-0428-49ea-91c3-08510ac690c8,network=Network(d177c8b8-5960-4e40-bf9b-920a2f6ba4f7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf34eef67-04') {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 23:21:32 user nova-compute[75045]: DEBUG os_vif [None req-1f99ea05-2cf9-4156-b99a-32adf7676ee0 tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d9:92:a4,bridge_name='br-int',has_traffic_filtering=True,id=f34eef67-0428-49ea-91c3-08510ac690c8,network=Network(d177c8b8-5960-4e40-bf9b-920a2f6ba4f7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf34eef67-04') {{(pid=75045) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 23:21:32 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:21:32 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:21:32 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 23:21:32 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:21:32 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f0cd464b-9d86-5c16-aea4-d9e38240ae43', '_type': 'linux-noop'}}, row=False) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:21:32 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:21:32 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:21:32 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:21:32 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf34eef67-04, may_exist=True, interface_attrs={}) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:21:32 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf34eef67-04, col_values=(('qos', UUID('0dba3a87-de17-4cc7-bc17-4691385bd53f')),), if_exists=True) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:21:32 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf34eef67-04, col_values=(('external_ids', {'iface-id': 'f34eef67-0428-49ea-91c3-08510ac690c8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d9:92:a4', 'vm-uuid': '83d225e0-e39e-4500-b7ae-52dfbd8b8588'}),), if_exists=True) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:21:32 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:21:32 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 23:21:32 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:21:32 user nova-compute[75045]: INFO os_vif [None req-1f99ea05-2cf9-4156-b99a-32adf7676ee0 tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d9:92:a4,bridge_name='br-int',has_traffic_filtering=True,id=f34eef67-0428-49ea-91c3-08510ac690c8,network=Network(d177c8b8-5960-4e40-bf9b-920a2f6ba4f7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf34eef67-04')
Nov 08 23:21:32 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-1f99ea05-2cf9-4156-b99a-32adf7676ee0 tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] No BDM found with device name vda, not building metadata. {{(pid=75045) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 23:21:32 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-1f99ea05-2cf9-4156-b99a-32adf7676ee0 tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] No VIF found with MAC fa:16:3e:d9:92:a4, not building metadata {{(pid=75045) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 23:21:32 user nova-compute[75045]: DEBUG nova.compute.manager [req-2ed61294-a94f-4bf1-966d-7c9492d72ed0 req-17edf993-4578-4626-a7fc-44fcc653dc26 service nova] [instance: 032e20aa-8887-4215-808e-68299a0d8d0b] Received event network-changed-9cd2b9ae-f99a-4f33-8b8b-e2013d3c05e6 {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:21:32 user nova-compute[75045]: DEBUG nova.compute.manager [req-2ed61294-a94f-4bf1-966d-7c9492d72ed0 req-17edf993-4578-4626-a7fc-44fcc653dc26 service nova] [instance: 032e20aa-8887-4215-808e-68299a0d8d0b] Refreshing instance network info cache due to event network-changed-9cd2b9ae-f99a-4f33-8b8b-e2013d3c05e6. {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 23:21:32 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-2ed61294-a94f-4bf1-966d-7c9492d72ed0 req-17edf993-4578-4626-a7fc-44fcc653dc26 service nova] Acquiring lock "refresh_cache-032e20aa-8887-4215-808e-68299a0d8d0b" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 23:21:32 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-2ed61294-a94f-4bf1-966d-7c9492d72ed0 req-17edf993-4578-4626-a7fc-44fcc653dc26 service nova] Acquired lock "refresh_cache-032e20aa-8887-4215-808e-68299a0d8d0b" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 23:21:32 user nova-compute[75045]: DEBUG nova.network.neutron [req-2ed61294-a94f-4bf1-966d-7c9492d72ed0 req-17edf993-4578-4626-a7fc-44fcc653dc26 service nova] [instance: 032e20aa-8887-4215-808e-68299a0d8d0b] Refreshing network info cache for port 9cd2b9ae-f99a-4f33-8b8b-e2013d3c05e6 {{(pid=75045) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 23:21:32 user nova-compute[75045]: DEBUG nova.network.neutron [req-885b72de-7b95-4b85-93f3-1266a3ce2f8d req-1f5ad7bc-fc92-427b-84f0-78ec3447f3fe service nova] [instance: 83d225e0-e39e-4500-b7ae-52dfbd8b8588] Updated VIF entry in instance network info cache for port f34eef67-0428-49ea-91c3-08510ac690c8. {{(pid=75045) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 23:21:32 user nova-compute[75045]: DEBUG nova.network.neutron [req-885b72de-7b95-4b85-93f3-1266a3ce2f8d req-1f5ad7bc-fc92-427b-84f0-78ec3447f3fe service nova] [instance: 83d225e0-e39e-4500-b7ae-52dfbd8b8588] Updating instance_info_cache with network_info: [{"id": "f34eef67-0428-49ea-91c3-08510ac690c8", "address": "fa:16:3e:d9:92:a4", "network": {"id": "d177c8b8-5960-4e40-bf9b-920a2f6ba4f7", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-497258569-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "467f0ecc3b93457f9fe83886b99c6285", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf34eef67-04", "ovs_interfaceid": "f34eef67-0428-49ea-91c3-08510ac690c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75045) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 23:21:32 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-885b72de-7b95-4b85-93f3-1266a3ce2f8d req-1f5ad7bc-fc92-427b-84f0-78ec3447f3fe service nova] Releasing lock "refresh_cache-83d225e0-e39e-4500-b7ae-52dfbd8b8588" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 23:21:32 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-70b26a86-392c-45f9-a7c8-ebfc1306ca40 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Acquiring lock "032e20aa-8887-4215-808e-68299a0d8d0b" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:21:32 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-70b26a86-392c-45f9-a7c8-ebfc1306ca40 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Lock "032e20aa-8887-4215-808e-68299a0d8d0b" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:21:32 user nova-compute[75045]: DEBUG nova.network.neutron [req-2ed61294-a94f-4bf1-966d-7c9492d72ed0 req-17edf993-4578-4626-a7fc-44fcc653dc26 service nova] [instance: 032e20aa-8887-4215-808e-68299a0d8d0b] Updated VIF entry in instance network info cache for port 9cd2b9ae-f99a-4f33-8b8b-e2013d3c05e6. {{(pid=75045) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 23:21:32 user nova-compute[75045]: DEBUG nova.network.neutron [req-2ed61294-a94f-4bf1-966d-7c9492d72ed0 req-17edf993-4578-4626-a7fc-44fcc653dc26 service nova] [instance: 032e20aa-8887-4215-808e-68299a0d8d0b] Updating instance_info_cache with network_info: [{"id": "9cd2b9ae-f99a-4f33-8b8b-e2013d3c05e6", "address": "fa:16:3e:df:66:51", "network": {"id": "700b5784-d35b-45c0-a4d3-1ab8aa4c48aa", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-194469807-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.181", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e63623113f11463d9035bb990de43510", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9cd2b9ae-f9", "ovs_interfaceid": "9cd2b9ae-f99a-4f33-8b8b-e2013d3c05e6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75045) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 23:21:32 user nova-compute[75045]: DEBUG nova.objects.instance [None req-70b26a86-392c-45f9-a7c8-ebfc1306ca40 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Lazy-loading 'flavor' on Instance uuid 032e20aa-8887-4215-808e-68299a0d8d0b {{(pid=75045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 23:21:32 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-2ed61294-a94f-4bf1-966d-7c9492d72ed0 req-17edf993-4578-4626-a7fc-44fcc653dc26 service nova] Releasing lock "refresh_cache-032e20aa-8887-4215-808e-68299a0d8d0b" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 23:21:32 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-70b26a86-392c-45f9-a7c8-ebfc1306ca40 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Lock "032e20aa-8887-4215-808e-68299a0d8d0b" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.082s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:21:32 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:21:32 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:21:33 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-70b26a86-392c-45f9-a7c8-ebfc1306ca40 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Acquiring lock "032e20aa-8887-4215-808e-68299a0d8d0b" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:21:33 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-70b26a86-392c-45f9-a7c8-ebfc1306ca40 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Lock "032e20aa-8887-4215-808e-68299a0d8d0b" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:21:33 user nova-compute[75045]: INFO nova.compute.manager [None req-70b26a86-392c-45f9-a7c8-ebfc1306ca40 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] [instance: 032e20aa-8887-4215-808e-68299a0d8d0b] Attaching volume 45f1b635-c8a3-4727-a4c7-c2ac441388ff to /dev/vdb
Nov 08 23:21:33 user nova-compute[75045]: DEBUG os_brick.utils [None req-70b26a86-392c-45f9-a7c8-ebfc1306ca40 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75045) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 23:21:33 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:21:33 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:21:33 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[21bfc1fb-3e2e-4cc1-a8c0-e2434169fc6d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6217bd6e884\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:21:33 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:21:33 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.022s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:21:33 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3209630-0129-45cf-90f5-453c08840bd0]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:21:33 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:21:33 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.025s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:21:33 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[c562e464-945d-43fd-9c88-c41b6abc3124]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:21:33 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[3144dd95-88c2-4916-a076-f22aafae7891]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:21:33 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-70b26a86-392c-45f9-a7c8-ebfc1306ca40 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Running cmd (subprocess): nvme version {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:21:33 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-70b26a86-392c-45f9-a7c8-ebfc1306ca40 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] 'nvme version' failed. Not Retrying. {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 23:21:33 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.nvmeof [None req-70b26a86-392c-45f9-a7c8-ebfc1306ca40 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] nvme not present on system {{(pid=75045) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 23:21:33 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:21:33 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 23:21:33 user nova-compute[75045]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 23:21:33 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[c131eacf-6920-47ef-b019-23f0c9a0dc78]: (4, '') {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:21:33 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.lightos [None req-70b26a86-392c-45f9-a7c8-ebfc1306ca40 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75045) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 23:21:33 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.lightos [None req-70b26a86-392c-45f9-a7c8-ebfc1306ca40 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75045) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 23:21:33 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.lightos [None req-70b26a86-392c-45f9-a7c8-ebfc1306ca40 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] LIGHTOS: no hostnqn found. {{(pid=75045) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 23:21:33 user nova-compute[75045]: DEBUG os_brick.utils [None req-70b26a86-392c-45f9-a7c8-ebfc1306ca40 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] <== get_connector_properties: return (162ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6217bd6e884', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75045) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 23:21:33 user nova-compute[75045]: DEBUG nova.virt.block_device [None req-70b26a86-392c-45f9-a7c8-ebfc1306ca40 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] [instance: 032e20aa-8887-4215-808e-68299a0d8d0b] Updating existing volume attachment record: 68dcbc06-9faa-4baf-9877-f30ee86b89cb {{(pid=75045) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 23:21:33 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:21:33 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:21:33 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:21:33 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:21:33 user nova-compute[75045]: DEBUG nova.compute.manager [req-dcd73ad7-debc-4cb5-a289-e8097093e2d9 req-a2bb981e-b7b8-4cb0-95b8-58e7925c881f service nova] [instance: 83d225e0-e39e-4500-b7ae-52dfbd8b8588] Received event network-vif-plugged-f34eef67-0428-49ea-91c3-08510ac690c8 {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:21:33 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-dcd73ad7-debc-4cb5-a289-e8097093e2d9 req-a2bb981e-b7b8-4cb0-95b8-58e7925c881f service nova] Acquiring lock "83d225e0-e39e-4500-b7ae-52dfbd8b8588-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:21:33 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-dcd73ad7-debc-4cb5-a289-e8097093e2d9 req-a2bb981e-b7b8-4cb0-95b8-58e7925c881f service nova] Lock "83d225e0-e39e-4500-b7ae-52dfbd8b8588-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:21:33 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-dcd73ad7-debc-4cb5-a289-e8097093e2d9 req-a2bb981e-b7b8-4cb0-95b8-58e7925c881f service nova] Lock "83d225e0-e39e-4500-b7ae-52dfbd8b8588-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:21:33 user nova-compute[75045]: DEBUG nova.compute.manager [req-dcd73ad7-debc-4cb5-a289-e8097093e2d9 req-a2bb981e-b7b8-4cb0-95b8-58e7925c881f service nova] [instance: 83d225e0-e39e-4500-b7ae-52dfbd8b8588] No waiting events found dispatching network-vif-plugged-f34eef67-0428-49ea-91c3-08510ac690c8 {{(pid=75045) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 23:21:33 user nova-compute[75045]: WARNING nova.compute.manager [req-dcd73ad7-debc-4cb5-a289-e8097093e2d9 req-a2bb981e-b7b8-4cb0-95b8-58e7925c881f service nova] [instance: 83d225e0-e39e-4500-b7ae-52dfbd8b8588] Received unexpected event network-vif-plugged-f34eef67-0428-49ea-91c3-08510ac690c8 for instance with vm_state building and task_state spawning.
Nov 08 23:21:34 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:21:34 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:21:34 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:21:34 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:21:34 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:21:35 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:21:35 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:21:35 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:21:35 user nova-compute[75045]: DEBUG nova.compute.manager [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Starting heal instance info cache {{(pid=75045) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 23:21:36 user nova-compute[75045]: DEBUG nova.compute.manager [req-3b6bf158-6e08-488d-8ff7-9067522067f8 req-2003eb0f-b0f7-4f0b-8959-558ae41805e9 service nova] [instance: 83d225e0-e39e-4500-b7ae-52dfbd8b8588] Received event network-vif-plugged-f34eef67-0428-49ea-91c3-08510ac690c8 {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:21:36 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-3b6bf158-6e08-488d-8ff7-9067522067f8 req-2003eb0f-b0f7-4f0b-8959-558ae41805e9 service nova] Acquiring lock "83d225e0-e39e-4500-b7ae-52dfbd8b8588-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:21:36 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-3b6bf158-6e08-488d-8ff7-9067522067f8 req-2003eb0f-b0f7-4f0b-8959-558ae41805e9 service nova] Lock "83d225e0-e39e-4500-b7ae-52dfbd8b8588-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:21:36 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-3b6bf158-6e08-488d-8ff7-9067522067f8 req-2003eb0f-b0f7-4f0b-8959-558ae41805e9 service nova] Lock "83d225e0-e39e-4500-b7ae-52dfbd8b8588-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:21:36 user nova-compute[75045]: DEBUG nova.compute.manager [req-3b6bf158-6e08-488d-8ff7-9067522067f8 req-2003eb0f-b0f7-4f0b-8959-558ae41805e9 service nova] [instance: 83d225e0-e39e-4500-b7ae-52dfbd8b8588] No waiting events found dispatching network-vif-plugged-f34eef67-0428-49ea-91c3-08510ac690c8 {{(pid=75045) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 23:21:36 user nova-compute[75045]: WARNING nova.compute.manager [req-3b6bf158-6e08-488d-8ff7-9067522067f8 req-2003eb0f-b0f7-4f0b-8959-558ae41805e9 service nova] [instance: 83d225e0-e39e-4500-b7ae-52dfbd8b8588] Received unexpected event network-vif-plugged-f34eef67-0428-49ea-91c3-08510ac690c8 for instance with vm_state building and task_state spawning.
Nov 08 23:21:36 user nova-compute[75045]: DEBUG nova.compute.manager [None req-1f99ea05-2cf9-4156-b99a-32adf7676ee0 tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] [instance: 83d225e0-e39e-4500-b7ae-52dfbd8b8588] Instance event wait completed in 0 seconds for  {{(pid=75045) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 23:21:36 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-1f99ea05-2cf9-4156-b99a-32adf7676ee0 tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] [instance: 83d225e0-e39e-4500-b7ae-52dfbd8b8588] Guest created on hypervisor {{(pid=75045) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 23:21:36 user nova-compute[75045]: INFO nova.virt.libvirt.driver [-] [instance: 83d225e0-e39e-4500-b7ae-52dfbd8b8588] Instance spawned successfully.
Nov 08 23:21:36 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-1f99ea05-2cf9-4156-b99a-32adf7676ee0 tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] [instance: 83d225e0-e39e-4500-b7ae-52dfbd8b8588] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75045) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 23:21:36 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-1f99ea05-2cf9-4156-b99a-32adf7676ee0 tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] [instance: 83d225e0-e39e-4500-b7ae-52dfbd8b8588] Found default for hw_cdrom_bus of ide {{(pid=75045) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 23:21:36 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-1f99ea05-2cf9-4156-b99a-32adf7676ee0 tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] [instance: 83d225e0-e39e-4500-b7ae-52dfbd8b8588] Found default for hw_disk_bus of virtio {{(pid=75045) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 23:21:36 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-1f99ea05-2cf9-4156-b99a-32adf7676ee0 tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] [instance: 83d225e0-e39e-4500-b7ae-52dfbd8b8588] Found default for hw_input_bus of None {{(pid=75045) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 23:21:36 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-1f99ea05-2cf9-4156-b99a-32adf7676ee0 tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] [instance: 83d225e0-e39e-4500-b7ae-52dfbd8b8588] Found default for hw_pointer_model of None {{(pid=75045) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 23:21:36 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-1f99ea05-2cf9-4156-b99a-32adf7676ee0 tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] [instance: 83d225e0-e39e-4500-b7ae-52dfbd8b8588] Found default for hw_video_model of virtio {{(pid=75045) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 23:21:36 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-1f99ea05-2cf9-4156-b99a-32adf7676ee0 tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] [instance: 83d225e0-e39e-4500-b7ae-52dfbd8b8588] Found default for hw_vif_model of virtio {{(pid=75045) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 23:21:36 user nova-compute[75045]: INFO nova.compute.manager [None req-1f99ea05-2cf9-4156-b99a-32adf7676ee0 tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] [instance: 83d225e0-e39e-4500-b7ae-52dfbd8b8588] Took 5.94 seconds to spawn the instance on the hypervisor.
Nov 08 23:21:36 user nova-compute[75045]: DEBUG nova.compute.manager [None req-1f99ea05-2cf9-4156-b99a-32adf7676ee0 tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] [instance: 83d225e0-e39e-4500-b7ae-52dfbd8b8588] Checking state {{(pid=75045) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 23:21:36 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Acquiring lock "refresh_cache-fde91f7c-31e3-456c-b252-6ce37fa3b600" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 23:21:36 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Acquired lock "refresh_cache-fde91f7c-31e3-456c-b252-6ce37fa3b600" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 23:21:36 user nova-compute[75045]: DEBUG nova.network.neutron [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] [instance: fde91f7c-31e3-456c-b252-6ce37fa3b600] Forcefully refreshing network info cache for instance {{(pid=75045) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 23:21:36 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-c1adc332-a2d8-4fbd-88d0-288020b56c91 tempest-TestShelveInstance-1634360024 tempest-TestShelveInstance-1634360024-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:21:36 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-c1adc332-a2d8-4fbd-88d0-288020b56c91 tempest-TestShelveInstance-1634360024 tempest-TestShelveInstance-1634360024-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:21:36 user nova-compute[75045]: DEBUG nova.objects.instance [None req-c1adc332-a2d8-4fbd-88d0-288020b56c91 tempest-TestShelveInstance-1634360024 tempest-TestShelveInstance-1634360024-project-member] Lazy-loading 'pci_requests' on Instance uuid 725866aa-0e2a-4af3-af20-48157e6d2fcb {{(pid=75045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 23:21:36 user nova-compute[75045]: INFO nova.compute.manager [None req-1f99ea05-2cf9-4156-b99a-32adf7676ee0 tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] [instance: 83d225e0-e39e-4500-b7ae-52dfbd8b8588] Took 6.70 seconds to build instance.
Nov 08 23:21:36 user nova-compute[75045]: DEBUG nova.objects.instance [None req-c1adc332-a2d8-4fbd-88d0-288020b56c91 tempest-TestShelveInstance-1634360024 tempest-TestShelveInstance-1634360024-project-member] Lazy-loading 'numa_topology' on Instance uuid 725866aa-0e2a-4af3-af20-48157e6d2fcb {{(pid=75045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 23:21:36 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-1f99ea05-2cf9-4156-b99a-32adf7676ee0 tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] Lock "83d225e0-e39e-4500-b7ae-52dfbd8b8588" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.821s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:21:36 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-c1adc332-a2d8-4fbd-88d0-288020b56c91 tempest-TestShelveInstance-1634360024 tempest-TestShelveInstance-1634360024-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75045) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 23:21:36 user nova-compute[75045]: INFO nova.compute.claims [None req-c1adc332-a2d8-4fbd-88d0-288020b56c91 tempest-TestShelveInstance-1634360024 tempest-TestShelveInstance-1634360024-project-member] [instance: 725866aa-0e2a-4af3-af20-48157e6d2fcb] Claim successful on node user
Nov 08 23:21:36 user nova-compute[75045]: DEBUG nova.scheduler.client.report [None req-c1adc332-a2d8-4fbd-88d0-288020b56c91 tempest-TestShelveInstance-1634360024 tempest-TestShelveInstance-1634360024-project-member] Refreshing inventories for resource provider 62ba5f85-c74d-4b58-986e-d4197e813fd7 {{(pid=75045) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 08 23:21:36 user nova-compute[75045]: DEBUG nova.scheduler.client.report [None req-c1adc332-a2d8-4fbd-88d0-288020b56c91 tempest-TestShelveInstance-1634360024 tempest-TestShelveInstance-1634360024-project-member] Updating ProviderTree inventory for provider 62ba5f85-c74d-4b58-986e-d4197e813fd7 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75045) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 08 23:21:36 user nova-compute[75045]: DEBUG nova.compute.provider_tree [None req-c1adc332-a2d8-4fbd-88d0-288020b56c91 tempest-TestShelveInstance-1634360024 tempest-TestShelveInstance-1634360024-project-member] Updating inventory in ProviderTree for provider 62ba5f85-c74d-4b58-986e-d4197e813fd7 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75045) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 08 23:21:36 user nova-compute[75045]: DEBUG nova.scheduler.client.report [None req-c1adc332-a2d8-4fbd-88d0-288020b56c91 tempest-TestShelveInstance-1634360024 tempest-TestShelveInstance-1634360024-project-member] Refreshing aggregate associations for resource provider 62ba5f85-c74d-4b58-986e-d4197e813fd7, aggregates: None {{(pid=75045) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 08 23:21:36 user nova-compute[75045]: DEBUG nova.scheduler.client.report [None req-c1adc332-a2d8-4fbd-88d0-288020b56c91 tempest-TestShelveInstance-1634360024 tempest-TestShelveInstance-1634360024-project-member] Refreshing trait associations for resource provider 62ba5f85-c74d-4b58-986e-d4197e813fd7, traits: COMPUTE_STORAGE_BUS_SCSI,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_TRUSTED_CERTS,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_VIRTIO,HW_CPU_X86_SSSE3,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_FDC,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_RESCUE_BFV,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSE2,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN {{(pid=75045) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 08 23:21:36 user nova-compute[75045]: DEBUG nova.network.neutron [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] [instance: fde91f7c-31e3-456c-b252-6ce37fa3b600] Updating instance_info_cache with network_info: [{"id": "cf7f2506-395a-4404-a256-6600a5c0a06e", "address": "fa:16:3e:a5:67:d3", "network": {"id": "d1b282d5-4d48-4a16-9f0d-82241f8add26", "bridge": "br-int", "label": "tempest-TestVolumeSwap-340739462-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.52", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8fc58c033ee9468fa80d2d84f19c2f4c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf7f2506-39", "ovs_interfaceid": "cf7f2506-395a-4404-a256-6600a5c0a06e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75045) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 23:21:36 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Releasing lock "refresh_cache-fde91f7c-31e3-456c-b252-6ce37fa3b600" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 23:21:36 user nova-compute[75045]: DEBUG nova.compute.manager [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] [instance: fde91f7c-31e3-456c-b252-6ce37fa3b600] Updated the network info_cache for instance {{(pid=75045) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 23:21:36 user nova-compute[75045]: DEBUG nova.compute.provider_tree [None req-c1adc332-a2d8-4fbd-88d0-288020b56c91 tempest-TestShelveInstance-1634360024 tempest-TestShelveInstance-1634360024-project-member] Inventory has not changed in ProviderTree for provider: 62ba5f85-c74d-4b58-986e-d4197e813fd7 {{(pid=75045) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 23:21:36 user nova-compute[75045]: DEBUG nova.scheduler.client.report [None req-c1adc332-a2d8-4fbd-88d0-288020b56c91 tempest-TestShelveInstance-1634360024 tempest-TestShelveInstance-1634360024-project-member] Inventory has not changed for provider 62ba5f85-c74d-4b58-986e-d4197e813fd7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75045) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 23:21:36 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-c1adc332-a2d8-4fbd-88d0-288020b56c91 tempest-TestShelveInstance-1634360024 tempest-TestShelveInstance-1634360024-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.740s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:21:36 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:21:36 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:21:36 user nova-compute[75045]: DEBUG nova.compute.manager [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75045) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 23:21:36 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager.update_available_resource {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:21:37 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:21:37 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.002s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:21:37 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:21:37 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Auditing locally available compute resources for user (node: user) {{(pid=75045) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 23:21:37 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:21:37 user nova-compute[75045]: INFO nova.network.neutron [None req-c1adc332-a2d8-4fbd-88d0-288020b56c91 tempest-TestShelveInstance-1634360024 tempest-TestShelveInstance-1634360024-project-member] [instance: 725866aa-0e2a-4af3-af20-48157e6d2fcb] Updating port 9a617e54-a69a-4204-b94e-dbe71b1432d2 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Nov 08 23:21:37 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ae5ff6b-6f2c-4dfd-a4c6-da4809e2cf27/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:21:37 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:21:37 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ae5ff6b-6f2c-4dfd-a4c6-da4809e2cf27/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:21:37 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ae5ff6b-6f2c-4dfd-a4c6-da4809e2cf27/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:21:37 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ae5ff6b-6f2c-4dfd-a4c6-da4809e2cf27/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:21:37 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] skipping disk /dev/sdh (vda) as it is a volume {{(pid=75045) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 23:21:37 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2c911cf-d5f4-4c19-8335-8c7834184a7e/disk.rescue --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:21:37 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2c911cf-d5f4-4c19-8335-8c7834184a7e/disk.rescue --force-share --output=json" returned: 0 in 0.184s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:21:37 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2c911cf-d5f4-4c19-8335-8c7834184a7e/disk.rescue --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:21:38 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-c1adc332-a2d8-4fbd-88d0-288020b56c91 tempest-TestShelveInstance-1634360024 tempest-TestShelveInstance-1634360024-project-member] Acquiring lock "refresh_cache-725866aa-0e2a-4af3-af20-48157e6d2fcb" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 23:21:38 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-c1adc332-a2d8-4fbd-88d0-288020b56c91 tempest-TestShelveInstance-1634360024 tempest-TestShelveInstance-1634360024-project-member] Acquired lock "refresh_cache-725866aa-0e2a-4af3-af20-48157e6d2fcb" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 23:21:38 user nova-compute[75045]: DEBUG nova.network.neutron [None req-c1adc332-a2d8-4fbd-88d0-288020b56c91 tempest-TestShelveInstance-1634360024 tempest-TestShelveInstance-1634360024-project-member] [instance: 725866aa-0e2a-4af3-af20-48157e6d2fcb] Building network info cache for instance {{(pid=75045) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 23:21:38 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2c911cf-d5f4-4c19-8335-8c7834184a7e/disk.rescue --force-share --output=json" returned: 0 in 0.220s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:21:38 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f21fcd3-ac5f-499e-9c34-82af806fda1d/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:21:38 user nova-compute[75045]: DEBUG nova.compute.manager [req-0be98426-b7f5-40e7-8aa4-ce6985b7896b req-6074d52d-de9c-469b-807b-bd9ea83f3183 service nova] [instance: 725866aa-0e2a-4af3-af20-48157e6d2fcb] Received event network-changed-9a617e54-a69a-4204-b94e-dbe71b1432d2 {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:21:38 user nova-compute[75045]: DEBUG nova.compute.manager [req-0be98426-b7f5-40e7-8aa4-ce6985b7896b req-6074d52d-de9c-469b-807b-bd9ea83f3183 service nova] [instance: 725866aa-0e2a-4af3-af20-48157e6d2fcb] Refreshing instance network info cache due to event network-changed-9a617e54-a69a-4204-b94e-dbe71b1432d2. {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 23:21:38 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-0be98426-b7f5-40e7-8aa4-ce6985b7896b req-6074d52d-de9c-469b-807b-bd9ea83f3183 service nova] Acquiring lock "refresh_cache-725866aa-0e2a-4af3-af20-48157e6d2fcb" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 23:21:38 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f21fcd3-ac5f-499e-9c34-82af806fda1d/disk --force-share --output=json" returned: 0 in 0.255s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:21:38 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f21fcd3-ac5f-499e-9c34-82af806fda1d/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:21:38 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f21fcd3-ac5f-499e-9c34-82af806fda1d/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:21:38 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fde91f7c-31e3-456c-b252-6ce37fa3b600/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:21:38 user nova-compute[75045]: DEBUG nova.network.neutron [None req-c1adc332-a2d8-4fbd-88d0-288020b56c91 tempest-TestShelveInstance-1634360024 tempest-TestShelveInstance-1634360024-project-member] [instance: 725866aa-0e2a-4af3-af20-48157e6d2fcb] Updating instance_info_cache with network_info: [{"id": "9a617e54-a69a-4204-b94e-dbe71b1432d2", "address": "fa:16:3e:64:ef:b6", "network": {"id": "25b429b3-693b-4e72-9035-71c276706294", "bridge": "br-int", "label": "tempest-TestShelveInstance-437524717-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.40", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec089e7050c542c9860d9fc5f3ae9392", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a617e54-a6", "ovs_interfaceid": "9a617e54-a69a-4204-b94e-dbe71b1432d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75045) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 23:21:38 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fde91f7c-31e3-456c-b252-6ce37fa3b600/disk --force-share --output=json" returned: 0 in 0.243s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:21:38 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fde91f7c-31e3-456c-b252-6ce37fa3b600/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:21:38 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-c1adc332-a2d8-4fbd-88d0-288020b56c91 tempest-TestShelveInstance-1634360024 tempest-TestShelveInstance-1634360024-project-member] Releasing lock "refresh_cache-725866aa-0e2a-4af3-af20-48157e6d2fcb" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 23:21:38 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-c1adc332-a2d8-4fbd-88d0-288020b56c91 tempest-TestShelveInstance-1634360024 tempest-TestShelveInstance-1634360024-project-member] [instance: 725866aa-0e2a-4af3-af20-48157e6d2fcb] Creating instance directory {{(pid=75045) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 23:21:38 user nova-compute[75045]: INFO nova.virt.libvirt.driver [None req-c1adc332-a2d8-4fbd-88d0-288020b56c91 tempest-TestShelveInstance-1634360024 tempest-TestShelveInstance-1634360024-project-member] [instance: 725866aa-0e2a-4af3-af20-48157e6d2fcb] Creating image(s)
Nov 08 23:21:38 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-c1adc332-a2d8-4fbd-88d0-288020b56c91 tempest-TestShelveInstance-1634360024 tempest-TestShelveInstance-1634360024-project-member] [instance: 725866aa-0e2a-4af3-af20-48157e6d2fcb] Did not create local disks {{(pid=75045) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 08 23:21:38 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-c1adc332-a2d8-4fbd-88d0-288020b56c91 tempest-TestShelveInstance-1634360024 tempest-TestShelveInstance-1634360024-project-member] [instance: 725866aa-0e2a-4af3-af20-48157e6d2fcb] Ensure instance console log exists: /opt/stack/data/nova/instances/725866aa-0e2a-4af3-af20-48157e6d2fcb/console.log {{(pid=75045) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 23:21:38 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-c1adc332-a2d8-4fbd-88d0-288020b56c91 tempest-TestShelveInstance-1634360024 tempest-TestShelveInstance-1634360024-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:21:38 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-c1adc332-a2d8-4fbd-88d0-288020b56c91 tempest-TestShelveInstance-1634360024 tempest-TestShelveInstance-1634360024-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:21:38 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-c1adc332-a2d8-4fbd-88d0-288020b56c91 tempest-TestShelveInstance-1634360024 tempest-TestShelveInstance-1634360024-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:21:38 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-c1adc332-a2d8-4fbd-88d0-288020b56c91 tempest-TestShelveInstance-1634360024 tempest-TestShelveInstance-1634360024-project-member] [instance: 725866aa-0e2a-4af3-af20-48157e6d2fcb] Start _get_guest_xml network_info=[{"id": "9a617e54-a69a-4204-b94e-dbe71b1432d2", "address": "fa:16:3e:64:ef:b6", "network": {"id": "25b429b3-693b-4e72-9035-71c276706294", "bridge": "br-int", "label": "tempest-TestShelveInstance-437524717-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.40", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec089e7050c542c9860d9fc5f3ae9392", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a617e54-a6", "ovs_interfaceid": "9a617e54-a69a-4204-b94e-dbe71b1432d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': True, 'device_type': 'disk', 'attachment_id': '9076c585-292c-4f08-8bb5-405e46473cbd', 'guest_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:d2068946-d374-45a4-9850-e3a690b13ef4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eQScvmpf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '725866aa-0e2a-4af3-af20-48157e6d2fcb', 'attached_at': '', 'detached_at': '', 'volume_id': 'd2068946-d374-45a4-9850-e3a690b13ef4', 'serial': 'd2068946-d374-45a4-9850-e3a690b13ef4'}, 'volume_type': None} {{(pid=75045) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 23:21:38 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-0be98426-b7f5-40e7-8aa4-ce6985b7896b req-6074d52d-de9c-469b-807b-bd9ea83f3183 service nova] Acquired lock "refresh_cache-725866aa-0e2a-4af3-af20-48157e6d2fcb" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 23:21:38 user nova-compute[75045]: DEBUG nova.network.neutron [req-0be98426-b7f5-40e7-8aa4-ce6985b7896b req-6074d52d-de9c-469b-807b-bd9ea83f3183 service nova] [instance: 725866aa-0e2a-4af3-af20-48157e6d2fcb] Refreshing network info cache for port 9a617e54-a69a-4204-b94e-dbe71b1432d2 {{(pid=75045) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 23:21:38 user nova-compute[75045]: WARNING nova.virt.libvirt.driver [None req-c1adc332-a2d8-4fbd-88d0-288020b56c91 tempest-TestShelveInstance-1634360024 tempest-TestShelveInstance-1634360024-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 23:21:38 user nova-compute[75045]: WARNING nova.virt.libvirt.driver [None req-c1adc332-a2d8-4fbd-88d0-288020b56c91 tempest-TestShelveInstance-1634360024 tempest-TestShelveInstance-1634360024-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 23:21:38 user nova-compute[75045]: DEBUG nova.virt.libvirt.host [None req-c1adc332-a2d8-4fbd-88d0-288020b56c91 tempest-TestShelveInstance-1634360024 tempest-TestShelveInstance-1634360024-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75045) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 23:21:38 user nova-compute[75045]: DEBUG nova.virt.libvirt.host [None req-c1adc332-a2d8-4fbd-88d0-288020b56c91 tempest-TestShelveInstance-1634360024 tempest-TestShelveInstance-1634360024-project-member] CPU controller missing on host. {{(pid=75045) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 23:21:38 user nova-compute[75045]: DEBUG nova.virt.libvirt.host [None req-c1adc332-a2d8-4fbd-88d0-288020b56c91 tempest-TestShelveInstance-1634360024 tempest-TestShelveInstance-1634360024-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75045) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 23:21:38 user nova-compute[75045]: DEBUG nova.virt.libvirt.host [None req-c1adc332-a2d8-4fbd-88d0-288020b56c91 tempest-TestShelveInstance-1634360024 tempest-TestShelveInstance-1634360024-project-member] CPU controller found on host. {{(pid=75045) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 23:21:38 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-c1adc332-a2d8-4fbd-88d0-288020b56c91 tempest-TestShelveInstance-1634360024 tempest-TestShelveInstance-1634360024-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75045) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 23:21:38 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-c1adc332-a2d8-4fbd-88d0-288020b56c91 tempest-TestShelveInstance-1634360024 tempest-TestShelveInstance-1634360024-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T23:11:41Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75045) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 23:21:38 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-c1adc332-a2d8-4fbd-88d0-288020b56c91 tempest-TestShelveInstance-1634360024 tempest-TestShelveInstance-1634360024-project-member] Flavor limits 0:0:0 {{(pid=75045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 23:21:38 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-c1adc332-a2d8-4fbd-88d0-288020b56c91 tempest-TestShelveInstance-1634360024 tempest-TestShelveInstance-1634360024-project-member] Image limits 0:0:0 {{(pid=75045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 23:21:38 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-c1adc332-a2d8-4fbd-88d0-288020b56c91 tempest-TestShelveInstance-1634360024 tempest-TestShelveInstance-1634360024-project-member] Flavor pref 0:0:0 {{(pid=75045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 23:21:38 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-c1adc332-a2d8-4fbd-88d0-288020b56c91 tempest-TestShelveInstance-1634360024 tempest-TestShelveInstance-1634360024-project-member] Image pref 0:0:0 {{(pid=75045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 23:21:38 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-c1adc332-a2d8-4fbd-88d0-288020b56c91 tempest-TestShelveInstance-1634360024 tempest-TestShelveInstance-1634360024-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 23:21:38 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-c1adc332-a2d8-4fbd-88d0-288020b56c91 tempest-TestShelveInstance-1634360024 tempest-TestShelveInstance-1634360024-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75045) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 23:21:38 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-c1adc332-a2d8-4fbd-88d0-288020b56c91 tempest-TestShelveInstance-1634360024 tempest-TestShelveInstance-1634360024-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75045) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 23:21:38 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-c1adc332-a2d8-4fbd-88d0-288020b56c91 tempest-TestShelveInstance-1634360024 tempest-TestShelveInstance-1634360024-project-member] Got 1 possible topologies {{(pid=75045) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 23:21:38 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-c1adc332-a2d8-4fbd-88d0-288020b56c91 tempest-TestShelveInstance-1634360024 tempest-TestShelveInstance-1634360024-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75045) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 23:21:38 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-c1adc332-a2d8-4fbd-88d0-288020b56c91 tempest-TestShelveInstance-1634360024 tempest-TestShelveInstance-1634360024-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75045) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 23:21:38 user nova-compute[75045]: DEBUG nova.objects.instance [None req-c1adc332-a2d8-4fbd-88d0-288020b56c91 tempest-TestShelveInstance-1634360024 tempest-TestShelveInstance-1634360024-project-member] Lazy-loading 'vcpu_model' on Instance uuid 725866aa-0e2a-4af3-af20-48157e6d2fcb {{(pid=75045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 23:21:38 user nova-compute[75045]: DEBUG nova.objects.base [None req-c1adc332-a2d8-4fbd-88d0-288020b56c91 tempest-TestShelveInstance-1634360024 tempest-TestShelveInstance-1634360024-project-member] Object Instance<725866aa-0e2a-4af3-af20-48157e6d2fcb> lazy-loaded attributes: pci_requests,vcpu_model {{(pid=75045) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 23:21:38 user nova-compute[75045]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c1adc332-a2d8-4fbd-88d0-288020b56c91 tempest-TestShelveInstance-1634360024 tempest-TestShelveInstance-1634360024-project-member] [instance: 725866aa-0e2a-4af3-af20-48157e6d2fcb] Calling os-brick to attach iSCSI Volume {{(pid=75045) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 23:21:38 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1adc332-a2d8-4fbd-88d0-288020b56c91 tempest-TestShelveInstance-1634360024 tempest-TestShelveInstance-1634360024-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1b68210460>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d2068946-d374-45a4-9850-e3a690b13ef4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eQScvmpf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75045) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 23:21:38 user nova-compute[75045]: WARNING os_brick.initiator.connectors.base [None req-c1adc332-a2d8-4fbd-88d0-288020b56c91 tempest-TestShelveInstance-1634360024 tempest-TestShelveInstance-1634360024-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 23:21:38 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-c1adc332-a2d8-4fbd-88d0-288020b56c91 tempest-TestShelveInstance-1634360024 tempest-TestShelveInstance-1634360024-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 23:21:38 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-c1adc332-a2d8-4fbd-88d0-288020b56c91 tempest-TestShelveInstance-1634360024 tempest-TestShelveInstance-1634360024-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 23:21:38 user nova-compute[75045]: WARNING os_brick.initiator.connectors.base [None req-c1adc332-a2d8-4fbd-88d0-288020b56c91 tempest-TestShelveInstance-1634360024 tempest-TestShelveInstance-1634360024-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 23:21:38 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-c1adc332-a2d8-4fbd-88d0-288020b56c91 tempest-TestShelveInstance-1634360024 tempest-TestShelveInstance-1634360024-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d2068946-d374-45a4-9850-e3a690b13ef4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 23:21:38 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-c1adc332-a2d8-4fbd-88d0-288020b56c91 tempest-TestShelveInstance-1634360024 tempest-TestShelveInstance-1634360024-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d2068946-d374-45a4-9850-e3a690b13ef4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 23:21:38 user nova-compute[75045]: INFO os_brick.initiator.connectors.iscsi [None req-c1adc332-a2d8-4fbd-88d0-288020b56c91 tempest-TestShelveInstance-1634360024 tempest-TestShelveInstance-1634360024-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 23:21:38 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2068946-d374-45a4-9850-e3a690b13ef4 -p 172.16.0.220:3260 {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:21:39 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fde91f7c-31e3-456c-b252-6ce37fa3b600/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:21:39 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] skipping disk /dev/sdi (vdb) as it is a volume {{(pid=75045) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 23:21:39 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/032e20aa-8887-4215-808e-68299a0d8d0b/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:21:39 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2068946-d374-45a4-9850-e3a690b13ef4 -p 172.16.0.220:3260" returned: 21 in 0.027s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:21:39 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[00a50dfc-0430-4a05-b800-894bd06803ba]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:21:39 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1adc332-a2d8-4fbd-88d0-288020b56c91 tempest-TestShelveInstance-1634360024 tempest-TestShelveInstance-1634360024-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 23:21:39 user nova-compute[75045]:  {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:21:39 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2068946-d374-45a4-9850-e3a690b13ef4 -p 172.16.0.220:3260 --interface default --op new {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:21:39 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2068946-d374-45a4-9850-e3a690b13ef4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:21:39 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0312f0f-64f6-44b6-9af7-5df8e90d7c29]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d2068946-d374-45a4-9850-e3a690b13ef4] added\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:21:39 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1adc332-a2d8-4fbd-88d0-288020b56c91 tempest-TestShelveInstance-1634360024 tempest-TestShelveInstance-1634360024-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d2068946-d374-45a4-9850-e3a690b13ef4] added
Nov 08 23:21:39 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:21:39 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2068946-d374-45a4-9850-e3a690b13ef4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:21:39 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2068946-d374-45a4-9850-e3a690b13ef4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.031s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:21:39 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[83e3b404-7c04-4393-8ce9-42fdde8e2a2f]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:21:39 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1adc332-a2d8-4fbd-88d0-288020b56c91 tempest-TestShelveInstance-1634360024 tempest-TestShelveInstance-1634360024-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:21:39 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2068946-d374-45a4-9850-e3a690b13ef4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:21:39 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2068946-d374-45a4-9850-e3a690b13ef4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.028s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:21:39 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e8163c0-4820-464a-b745-5757657e07e4]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:21:39 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1adc332-a2d8-4fbd-88d0-288020b56c91 tempest-TestShelveInstance-1634360024 tempest-TestShelveInstance-1634360024-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:21:39 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2068946-d374-45a4-9850-e3a690b13ef4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eQScvmpf {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:21:39 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2068946-d374-45a4-9850-e3a690b13ef4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eQScvmpf" returned: 0 in 0.026s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:21:39 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[28c67a68-6132-4602-ae9c-b71ffcacc9df]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:21:39 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1adc332-a2d8-4fbd-88d0-288020b56c91 tempest-TestShelveInstance-1634360024 tempest-TestShelveInstance-1634360024-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'eQScvmpf'): stdout= stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:21:39 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2068946-d374-45a4-9850-e3a690b13ef4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:21:39 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/032e20aa-8887-4215-808e-68299a0d8d0b/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:21:39 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/032e20aa-8887-4215-808e-68299a0d8d0b/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:21:39 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2068946-d374-45a4-9850-e3a690b13ef4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:21:39 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[70cb56e3-ad82-4b14-a4e3-47f1dcc1bdd7]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:21:39 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1adc332-a2d8-4fbd-88d0-288020b56c91 tempest-TestShelveInstance-1634360024 tempest-TestShelveInstance-1634360024-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:21:39 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:21:39 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:21:39 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[786253dd-9a65-483f-9f20-5ded4dadb5c1]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7f7084f-f0d7-4d4b-9a14-69065a9c3e41 (non-flash)\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:21:39 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1adc332-a2d8-4fbd-88d0-288020b56c91 tempest-TestShelveInstance-1634360024 tempest-TestShelveInstance-1634360024-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab (non-flash)
Nov 08 23:21:39 user nova-compute[75045]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7f7084f-f0d7-4d4b-9a14-69065a9c3e41 (non-flash)
Nov 08 23:21:39 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 23:21:39 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1adc332-a2d8-4fbd-88d0-288020b56c91 tempest-TestShelveInstance-1634360024 tempest-TestShelveInstance-1634360024-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab (non-flash)
Nov 08 23:21:39 user nova-compute[75045]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7f7084f-f0d7-4d4b-9a14-69065a9c3e41 (non-flash)
Nov 08 23:21:39 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 23:21:39 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2068946-d374-45a4-9850-e3a690b13ef4 -p 172.16.0.220:3260 --login {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:21:39 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2068946-d374-45a4-9850-e3a690b13ef4 -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:21:39 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[b33e34c1-f3dd-4306-823f-8aedbd859899]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d2068946-d374-45a4-9850-e3a690b13ef4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d2068946-d374-45a4-9850-e3a690b13ef4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:21:39 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1adc332-a2d8-4fbd-88d0-288020b56c91 tempest-TestShelveInstance-1634360024 tempest-TestShelveInstance-1634360024-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d2068946-d374-45a4-9850-e3a690b13ef4, portal: 172.16.0.220,3260]
Nov 08 23:21:39 user nova-compute[75045]: Login to [iface: default, target: iqn.2010-10.org.openstack:d2068946-d374-45a4-9850-e3a690b13ef4, portal: 172.16.0.220,3260] successful.
Nov 08 23:21:39 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:21:39 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2068946-d374-45a4-9850-e3a690b13ef4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:21:39 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2068946-d374-45a4-9850-e3a690b13ef4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:21:39 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[df5e781f-5462-4e92-8a5a-c8a9ec9e0d29]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:21:39 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1adc332-a2d8-4fbd-88d0-288020b56c91 tempest-TestShelveInstance-1634360024 tempest-TestShelveInstance-1634360024-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:21:39 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:21:39 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:21:39 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[25905bc9-887b-4d8a-8e2c-bb7908ec906d]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7f7084f-f0d7-4d4b-9a14-69065a9c3e41 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2068946-d374-45a4-9850-e3a690b13ef4 (non-flash)\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:21:39 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1adc332-a2d8-4fbd-88d0-288020b56c91 tempest-TestShelveInstance-1634360024 tempest-TestShelveInstance-1634360024-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab (non-flash)
Nov 08 23:21:39 user nova-compute[75045]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7f7084f-f0d7-4d4b-9a14-69065a9c3e41 (non-flash)
Nov 08 23:21:39 user nova-compute[75045]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2068946-d374-45a4-9850-e3a690b13ef4 (non-flash)
Nov 08 23:21:39 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 23:21:39 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1adc332-a2d8-4fbd-88d0-288020b56c91 tempest-TestShelveInstance-1634360024 tempest-TestShelveInstance-1634360024-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab (non-flash)
Nov 08 23:21:39 user nova-compute[75045]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7f7084f-f0d7-4d4b-9a14-69065a9c3e41 (non-flash)
Nov 08 23:21:39 user nova-compute[75045]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2068946-d374-45a4-9850-e3a690b13ef4 (non-flash)
Nov 08 23:21:39 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 23:21:39 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-c1adc332-a2d8-4fbd-88d0-288020b56c91 tempest-TestShelveInstance-1634360024 tempest-TestShelveInstance-1634360024-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d2068946-d374-45a4-9850-e3a690b13ef4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.455s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 23:21:39 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1adc332-a2d8-4fbd-88d0-288020b56c91 tempest-TestShelveInstance-1634360024 tempest-TestShelveInstance-1634360024-project-member] Connected to 172.16.0.220:3260 {{(pid=75045) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 23:21:39 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-c1adc332-a2d8-4fbd-88d0-288020b56c91 tempest-TestShelveInstance-1634360024 tempest-TestShelveInstance-1634360024-project-member] HCTL ('33', '-', '-', 0) found on session 14 with lun 0 {{(pid=75045) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 23:21:39 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-c1adc332-a2d8-4fbd-88d0-288020b56c91 tempest-TestShelveInstance-1634360024 tempest-TestShelveInstance-1634360024-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75045) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 23:21:39 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:21:39 user nova-compute[75045]: DEBUG nova.network.neutron [req-0be98426-b7f5-40e7-8aa4-ce6985b7896b req-6074d52d-de9c-469b-807b-bd9ea83f3183 service nova] [instance: 725866aa-0e2a-4af3-af20-48157e6d2fcb] Updated VIF entry in instance network info cache for port 9a617e54-a69a-4204-b94e-dbe71b1432d2. {{(pid=75045) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 23:21:39 user nova-compute[75045]: DEBUG nova.network.neutron [req-0be98426-b7f5-40e7-8aa4-ce6985b7896b req-6074d52d-de9c-469b-807b-bd9ea83f3183 service nova] [instance: 725866aa-0e2a-4af3-af20-48157e6d2fcb] Updating instance_info_cache with network_info: [{"id": "9a617e54-a69a-4204-b94e-dbe71b1432d2", "address": "fa:16:3e:64:ef:b6", "network": {"id": "25b429b3-693b-4e72-9035-71c276706294", "bridge": "br-int", "label": "tempest-TestShelveInstance-437524717-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.40", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec089e7050c542c9860d9fc5f3ae9392", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a617e54-a6", "ovs_interfaceid": "9a617e54-a69a-4204-b94e-dbe71b1432d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75045) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 23:21:39 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/032e20aa-8887-4215-808e-68299a0d8d0b/disk --force-share --output=json" returned: 0 in 0.239s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:21:39 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.022s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:21:39 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[005ed01f-5076-42d9-bedd-e6691f5860db]: (4, ('- - 0', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:21:39 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-c1adc332-a2d8-4fbd-88d0-288020b56c91 tempest-TestShelveInstance-1634360024 tempest-TestShelveInstance-1634360024-project-member] Searching for a device in session 14 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75045) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 23:21:39 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1adc332-a2d8-4fbd-88d0-288020b56c91 tempest-TestShelveInstance-1634360024 tempest-TestShelveInstance-1634360024-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:d2068946-d374-45a4-9850-e3a690b13ef4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eQScvmpf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75045) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 23:21:39 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83d225e0-e39e-4500-b7ae-52dfbd8b8588/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:21:39 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-0be98426-b7f5-40e7-8aa4-ce6985b7896b req-6074d52d-de9c-469b-807b-bd9ea83f3183 service nova] Releasing lock "refresh_cache-725866aa-0e2a-4af3-af20-48157e6d2fcb" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 23:21:39 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83d225e0-e39e-4500-b7ae-52dfbd8b8588/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:21:39 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83d225e0-e39e-4500-b7ae-52dfbd8b8588/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:21:39 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83d225e0-e39e-4500-b7ae-52dfbd8b8588/disk --force-share --output=json" returned: 0 in 0.262s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:21:40 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43f31110-89ec-4b20-9842-7c9dd7df0e14/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:21:40 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43f31110-89ec-4b20-9842-7c9dd7df0e14/disk --force-share --output=json" returned: 0 in 0.247s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:21:40 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43f31110-89ec-4b20-9842-7c9dd7df0e14/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:21:40 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43f31110-89ec-4b20-9842-7c9dd7df0e14/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:21:40 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-c1adc332-a2d8-4fbd-88d0-288020b56c91 tempest-TestShelveInstance-1634360024 tempest-TestShelveInstance-1634360024-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.503s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 23:21:40 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1adc332-a2d8-4fbd-88d0-288020b56c91 tempest-TestShelveInstance-1634360024 tempest-TestShelveInstance-1634360024-project-member] <== connect_volume: return (1507ms) {'type': 'block', 'scsi_wwn': '23235663362643230', 'path': '/dev/sdb'} {{(pid=75045) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 23:21:40 user nova-compute[75045]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c1adc332-a2d8-4fbd-88d0-288020b56c91 tempest-TestShelveInstance-1634360024 tempest-TestShelveInstance-1634360024-project-member] [instance: 725866aa-0e2a-4af3-af20-48157e6d2fcb] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23235663362643230', 'path': '/dev/sdb'} {{(pid=75045) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 23:21:40 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:21:40 user nova-compute[75045]: WARNING nova.virt.libvirt.driver [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 23:21:40 user nova-compute[75045]: WARNING nova.virt.libvirt.driver [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 23:21:40 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Hypervisor/Node resource view: name=user free_ram=7834MB free_disk=25.43021011352539GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75045) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 23:21:40 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:21:40 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:21:41 user nova-compute[75045]: DEBUG nova.virt.libvirt.vif [None req-c1adc332-a2d8-4fbd-88d0-288020b56c91 tempest-TestShelveInstance-1634360024 tempest-TestShelveInstance-1634360024-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-08T23:17:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-961488157',display_name='tempest-TestShelveInstance-server-961488157',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-961488157',id=9,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-1861694278',keypairs=<?>,launch_index=0,launched_at=2023-11-08T23:17:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='ec089e7050c542c9860d9fc5f3ae9392',ramdisk_id='',reservation_id='r-2v3622zl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1634360024',owner_user_name='tempest-TestShelveInstance-1634360024-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T23:21:09Z,user_data=None,user_id='e30385ff71444d4f9a799c79e0ab67e9',uuid=725866aa-0e2a-4af3-af20-48157e6d2fcb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "9a617e54-a69a-4204-b94e-dbe71b1432d2", "address": "fa:16:3e:64:ef:b6", "network": {"id": "25b429b3-693b-4e72-9035-71c276706294", "bridge": "br-int", "label": "tempest-TestShelveInstance-437524717-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.40", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec089e7050c542c9860d9fc5f3ae9392", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a617e54-a6", "ovs_interfaceid": "9a617e54-a69a-4204-b94e-dbe71b1432d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75045) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 23:21:41 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-c1adc332-a2d8-4fbd-88d0-288020b56c91 tempest-TestShelveInstance-1634360024 tempest-TestShelveInstance-1634360024-project-member] Converting VIF {"id": "9a617e54-a69a-4204-b94e-dbe71b1432d2", "address": "fa:16:3e:64:ef:b6", "network": {"id": "25b429b3-693b-4e72-9035-71c276706294", "bridge": "br-int", "label": "tempest-TestShelveInstance-437524717-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.40", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec089e7050c542c9860d9fc5f3ae9392", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a617e54-a6", "ovs_interfaceid": "9a617e54-a69a-4204-b94e-dbe71b1432d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 23:21:41 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-c1adc332-a2d8-4fbd-88d0-288020b56c91 tempest-TestShelveInstance-1634360024 tempest-TestShelveInstance-1634360024-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:64:ef:b6,bridge_name='br-int',has_traffic_filtering=True,id=9a617e54-a69a-4204-b94e-dbe71b1432d2,network=Network(25b429b3-693b-4e72-9035-71c276706294),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9a617e54-a6') {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 23:21:41 user nova-compute[75045]: DEBUG nova.objects.instance [None req-c1adc332-a2d8-4fbd-88d0-288020b56c91 tempest-TestShelveInstance-1634360024 tempest-TestShelveInstance-1634360024-project-member] Lazy-loading 'pci_devices' on Instance uuid 725866aa-0e2a-4af3-af20-48157e6d2fcb {{(pid=75045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 23:21:41 user nova-compute[75045]: DEBUG nova.objects.base [None req-c1adc332-a2d8-4fbd-88d0-288020b56c91 tempest-TestShelveInstance-1634360024 tempest-TestShelveInstance-1634360024-project-member] Object Instance<725866aa-0e2a-4af3-af20-48157e6d2fcb> lazy-loaded attributes: pci_requests,vcpu_model,pci_devices {{(pid=75045) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 23:21:41 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-c1adc332-a2d8-4fbd-88d0-288020b56c91 tempest-TestShelveInstance-1634360024 tempest-TestShelveInstance-1634360024-project-member] [instance: 725866aa-0e2a-4af3-af20-48157e6d2fcb] End _get_guest_xml xml=<domain type="kvm">
Nov 08 23:21:41 user nova-compute[75045]:   <uuid>725866aa-0e2a-4af3-af20-48157e6d2fcb</uuid>
Nov 08 23:21:41 user nova-compute[75045]:   <name>instance-00000009</name>
Nov 08 23:21:41 user nova-compute[75045]:   <memory>524288</memory>
Nov 08 23:21:41 user nova-compute[75045]:   <vcpu>1</vcpu>
Nov 08 23:21:41 user nova-compute[75045]:   <metadata>
Nov 08 23:21:41 user nova-compute[75045]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 23:21:41 user nova-compute[75045]:       <nova:package version="0.0.0"/>
Nov 08 23:21:41 user nova-compute[75045]:       <nova:name>tempest-TestShelveInstance-server-961488157</nova:name>
Nov 08 23:21:41 user nova-compute[75045]:       <nova:creationTime>2023-11-08 23:21:38</nova:creationTime>
Nov 08 23:21:41 user nova-compute[75045]:       <nova:flavor name="m1.tiny">
Nov 08 23:21:41 user nova-compute[75045]:         <nova:memory>512</nova:memory>
Nov 08 23:21:41 user nova-compute[75045]:         <nova:disk>1</nova:disk>
Nov 08 23:21:41 user nova-compute[75045]:         <nova:swap>0</nova:swap>
Nov 08 23:21:41 user nova-compute[75045]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 23:21:41 user nova-compute[75045]:         <nova:vcpus>1</nova:vcpus>
Nov 08 23:21:41 user nova-compute[75045]:       </nova:flavor>
Nov 08 23:21:41 user nova-compute[75045]:       <nova:owner>
Nov 08 23:21:41 user nova-compute[75045]:         <nova:user uuid="e30385ff71444d4f9a799c79e0ab67e9">tempest-TestShelveInstance-1634360024-project-member</nova:user>
Nov 08 23:21:41 user nova-compute[75045]:         <nova:project uuid="ec089e7050c542c9860d9fc5f3ae9392">tempest-TestShelveInstance-1634360024</nova:project>
Nov 08 23:21:41 user nova-compute[75045]:       </nova:owner>
Nov 08 23:21:41 user nova-compute[75045]:       <nova:ports>
Nov 08 23:21:41 user nova-compute[75045]:         <nova:port uuid="9a617e54-a69a-4204-b94e-dbe71b1432d2">
Nov 08 23:21:41 user nova-compute[75045]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 08 23:21:41 user nova-compute[75045]:         </nova:port>
Nov 08 23:21:41 user nova-compute[75045]:       </nova:ports>
Nov 08 23:21:41 user nova-compute[75045]:     </nova:instance>
Nov 08 23:21:41 user nova-compute[75045]:   </metadata>
Nov 08 23:21:41 user nova-compute[75045]:   <sysinfo type="smbios">
Nov 08 23:21:41 user nova-compute[75045]:     <system>
Nov 08 23:21:41 user nova-compute[75045]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 23:21:41 user nova-compute[75045]:       <entry name="product">OpenStack Nova</entry>
Nov 08 23:21:41 user nova-compute[75045]:       <entry name="version">0.0.0</entry>
Nov 08 23:21:41 user nova-compute[75045]:       <entry name="serial">725866aa-0e2a-4af3-af20-48157e6d2fcb</entry>
Nov 08 23:21:41 user nova-compute[75045]:       <entry name="uuid">725866aa-0e2a-4af3-af20-48157e6d2fcb</entry>
Nov 08 23:21:41 user nova-compute[75045]:       <entry name="family">Virtual Machine</entry>
Nov 08 23:21:41 user nova-compute[75045]:     </system>
Nov 08 23:21:41 user nova-compute[75045]:   </sysinfo>
Nov 08 23:21:41 user nova-compute[75045]:   <os>
Nov 08 23:21:41 user nova-compute[75045]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 23:21:41 user nova-compute[75045]:     <boot dev="hd"/>
Nov 08 23:21:41 user nova-compute[75045]:     <smbios mode="sysinfo"/>
Nov 08 23:21:41 user nova-compute[75045]:   </os>
Nov 08 23:21:41 user nova-compute[75045]:   <features>
Nov 08 23:21:41 user nova-compute[75045]:     <acpi/>
Nov 08 23:21:41 user nova-compute[75045]:     <apic/>
Nov 08 23:21:41 user nova-compute[75045]:     <vmcoreinfo/>
Nov 08 23:21:41 user nova-compute[75045]:   </features>
Nov 08 23:21:41 user nova-compute[75045]:   <clock offset="utc">
Nov 08 23:21:41 user nova-compute[75045]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 23:21:41 user nova-compute[75045]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 23:21:41 user nova-compute[75045]:     <timer name="hpet" present="no"/>
Nov 08 23:21:41 user nova-compute[75045]:   </clock>
Nov 08 23:21:41 user nova-compute[75045]:   <cpu mode="custom" match="exact">
Nov 08 23:21:41 user nova-compute[75045]:     <model>Nehalem</model>
Nov 08 23:21:41 user nova-compute[75045]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 23:21:41 user nova-compute[75045]:   </cpu>
Nov 08 23:21:41 user nova-compute[75045]:   <devices>
Nov 08 23:21:41 user nova-compute[75045]:     <disk type="block" device="disk">
Nov 08 23:21:41 user nova-compute[75045]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 23:21:41 user nova-compute[75045]:       <source dev="/dev/sdb"/>
Nov 08 23:21:41 user nova-compute[75045]:       <target dev="vda" bus="virtio"/>
Nov 08 23:21:41 user nova-compute[75045]:       <serial>d2068946-d374-45a4-9850-e3a690b13ef4</serial>
Nov 08 23:21:41 user nova-compute[75045]:     </disk>
Nov 08 23:21:41 user nova-compute[75045]:     <interface type="ethernet">
Nov 08 23:21:41 user nova-compute[75045]:       <mac address="fa:16:3e:64:ef:b6"/>
Nov 08 23:21:41 user nova-compute[75045]:       <model type="virtio"/>
Nov 08 23:21:41 user nova-compute[75045]:       <mtu size="1442"/>
Nov 08 23:21:41 user nova-compute[75045]:       <target dev="tap9a617e54-a6"/>
Nov 08 23:21:41 user nova-compute[75045]:     </interface>
Nov 08 23:21:41 user nova-compute[75045]:     <serial type="pty">
Nov 08 23:21:41 user nova-compute[75045]:       <log file="/opt/stack/data/nova/instances/725866aa-0e2a-4af3-af20-48157e6d2fcb/console.log" append="off"/>
Nov 08 23:21:41 user nova-compute[75045]:     </serial>
Nov 08 23:21:41 user nova-compute[75045]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 23:21:41 user nova-compute[75045]:     <video>
Nov 08 23:21:41 user nova-compute[75045]:       <model type="virtio"/>
Nov 08 23:21:41 user nova-compute[75045]:     </video>
Nov 08 23:21:41 user nova-compute[75045]:     <rng model="virtio">
Nov 08 23:21:41 user nova-compute[75045]:       <backend model="random">/dev/urandom</backend>
Nov 08 23:21:41 user nova-compute[75045]:     </rng>
Nov 08 23:21:41 user nova-compute[75045]:     <controller type="usb" index="0" model="none"/>
Nov 08 23:21:41 user nova-compute[75045]:     <memballoon model="virtio">
Nov 08 23:21:41 user nova-compute[75045]:       <stats period="10"/>
Nov 08 23:21:41 user nova-compute[75045]:     </memballoon>
Nov 08 23:21:41 user nova-compute[75045]:   </devices>
Nov 08 23:21:41 user nova-compute[75045]: </domain>
Nov 08 23:21:41 user nova-compute[75045]:  {{(pid=75045) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 23:21:41 user nova-compute[75045]: DEBUG nova.virt.libvirt.vif [None req-c1adc332-a2d8-4fbd-88d0-288020b56c91 tempest-TestShelveInstance-1634360024 tempest-TestShelveInstance-1634360024-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-08T23:17:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-961488157',display_name='tempest-TestShelveInstance-server-961488157',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-961488157',id=9,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-1861694278',keypairs=<?>,launch_index=0,launched_at=2023-11-08T23:17:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='ec089e7050c542c9860d9fc5f3ae9392',ramdisk_id='',reservation_id='r-2v3622zl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1634360024',owner_user_name='tempest-TestShelveInstance-1634360024-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T23:21:09Z,user_data=None,user_id='e30385ff71444d4f9a799c79e0ab67e9',uuid=725866aa-0e2a-4af3-af20-48157e6d2fcb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "9a617e54-a69a-4204-b94e-dbe71b1432d2", "address": "fa:16:3e:64:ef:b6", "network": {"id": "25b429b3-693b-4e72-9035-71c276706294", "bridge": "br-int", "label": "tempest-TestShelveInstance-437524717-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.40", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec089e7050c542c9860d9fc5f3ae9392", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a617e54-a6", "ovs_interfaceid": "9a617e54-a69a-4204-b94e-dbe71b1432d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75045) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 23:21:41 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-c1adc332-a2d8-4fbd-88d0-288020b56c91 tempest-TestShelveInstance-1634360024 tempest-TestShelveInstance-1634360024-project-member] Converting VIF {"id": "9a617e54-a69a-4204-b94e-dbe71b1432d2", "address": "fa:16:3e:64:ef:b6", "network": {"id": "25b429b3-693b-4e72-9035-71c276706294", "bridge": "br-int", "label": "tempest-TestShelveInstance-437524717-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.40", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec089e7050c542c9860d9fc5f3ae9392", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a617e54-a6", "ovs_interfaceid": "9a617e54-a69a-4204-b94e-dbe71b1432d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 23:21:41 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-c1adc332-a2d8-4fbd-88d0-288020b56c91 tempest-TestShelveInstance-1634360024 tempest-TestShelveInstance-1634360024-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:64:ef:b6,bridge_name='br-int',has_traffic_filtering=True,id=9a617e54-a69a-4204-b94e-dbe71b1432d2,network=Network(25b429b3-693b-4e72-9035-71c276706294),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9a617e54-a6') {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 23:21:41 user nova-compute[75045]: DEBUG os_vif [None req-c1adc332-a2d8-4fbd-88d0-288020b56c91 tempest-TestShelveInstance-1634360024 tempest-TestShelveInstance-1634360024-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:64:ef:b6,bridge_name='br-int',has_traffic_filtering=True,id=9a617e54-a69a-4204-b94e-dbe71b1432d2,network=Network(25b429b3-693b-4e72-9035-71c276706294),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9a617e54-a6') {{(pid=75045) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 23:21:41 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:21:41 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:21:41 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 23:21:41 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:21:41 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd5946e1a-9bbd-5676-9568-a82716adc008', '_type': 'linux-noop'}}, row=False) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:21:41 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:21:41 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:21:41 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:21:41 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9a617e54-a6, may_exist=True, interface_attrs={}) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:21:41 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9a617e54-a6, col_values=(('qos', UUID('360e69e5-38a5-477b-a73a-cf20afda4d9f')),), if_exists=True) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:21:41 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9a617e54-a6, col_values=(('external_ids', {'iface-id': '9a617e54-a69a-4204-b94e-dbe71b1432d2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:64:ef:b6', 'vm-uuid': '725866aa-0e2a-4af3-af20-48157e6d2fcb'}),), if_exists=True) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:21:41 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 23:21:41 user nova-compute[75045]: INFO os_vif [None req-c1adc332-a2d8-4fbd-88d0-288020b56c91 tempest-TestShelveInstance-1634360024 tempest-TestShelveInstance-1634360024-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:64:ef:b6,bridge_name='br-int',has_traffic_filtering=True,id=9a617e54-a69a-4204-b94e-dbe71b1432d2,network=Network(25b429b3-693b-4e72-9035-71c276706294),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9a617e54-a6')
Nov 08 23:21:41 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-c1adc332-a2d8-4fbd-88d0-288020b56c91 tempest-TestShelveInstance-1634360024 tempest-TestShelveInstance-1634360024-project-member] No BDM found with device name vda, not building metadata. {{(pid=75045) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 23:21:41 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-c1adc332-a2d8-4fbd-88d0-288020b56c91 tempest-TestShelveInstance-1634360024 tempest-TestShelveInstance-1634360024-project-member] No VIF found with MAC fa:16:3e:64:ef:b6, not building metadata {{(pid=75045) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 23:21:41 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Instance 4ae5ff6b-6f2c-4dfd-a4c6-da4809e2cf27 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75045) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 23:21:41 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Instance 0f21fcd3-ac5f-499e-9c34-82af806fda1d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75045) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 23:21:41 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Instance fde91f7c-31e3-456c-b252-6ce37fa3b600 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75045) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 23:21:41 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Instance d2c911cf-d5f4-4c19-8335-8c7834184a7e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75045) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 23:21:41 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Instance 032e20aa-8887-4215-808e-68299a0d8d0b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75045) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 23:21:41 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] [instance: 725866aa-0e2a-4af3-af20-48157e6d2fcb] Instance with task_state "spawning" is not being actively managed by this compute host but has allocations referencing this compute node (62ba5f85-c74d-4b58-986e-d4197e813fd7): {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. Skipping heal of allocations during the task state transition. {{(pid=75045) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1777}}
Nov 08 23:21:41 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Instance 43f31110-89ec-4b20-9842-7c9dd7df0e14 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75045) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 23:21:41 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Instance 83d225e0-e39e-4500-b7ae-52dfbd8b8588 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75045) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 23:21:41 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=75045) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 23:21:41 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=75045) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 23:21:41 user nova-compute[75045]: DEBUG nova.compute.provider_tree [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Inventory has not changed in ProviderTree for provider: 62ba5f85-c74d-4b58-986e-d4197e813fd7 {{(pid=75045) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 23:21:41 user nova-compute[75045]: DEBUG nova.scheduler.client.report [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Inventory has not changed for provider 62ba5f85-c74d-4b58-986e-d4197e813fd7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75045) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 23:21:41 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Compute_service record updated for user:user {{(pid=75045) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 23:21:41 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.559s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:21:41 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:21:41 user nova-compute[75045]: DEBUG nova.compute.manager [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Cleaning up deleted instances {{(pid=75045) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 08 23:21:41 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-da465c1e-a2be-4731-905c-e0139ec27a7d tempest-VolumesActionsTest-1040491269 tempest-VolumesActionsTest-1040491269-project-member] Acquiring lock "9de31aa1-6996-4c4a-bd44-fce18e0890f4" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:21:41 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-da465c1e-a2be-4731-905c-e0139ec27a7d tempest-VolumesActionsTest-1040491269 tempest-VolumesActionsTest-1040491269-project-member] Lock "9de31aa1-6996-4c4a-bd44-fce18e0890f4" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:21:41 user nova-compute[75045]: DEBUG nova.compute.manager [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] There are 0 instances to clean {{(pid=75045) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 08 23:21:41 user nova-compute[75045]: DEBUG nova.compute.manager [None req-da465c1e-a2be-4731-905c-e0139ec27a7d tempest-VolumesActionsTest-1040491269 tempest-VolumesActionsTest-1040491269-project-member] [instance: 9de31aa1-6996-4c4a-bd44-fce18e0890f4] Starting instance... {{(pid=75045) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 23:21:41 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-da465c1e-a2be-4731-905c-e0139ec27a7d tempest-VolumesActionsTest-1040491269 tempest-VolumesActionsTest-1040491269-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:21:41 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-da465c1e-a2be-4731-905c-e0139ec27a7d tempest-VolumesActionsTest-1040491269 tempest-VolumesActionsTest-1040491269-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:21:41 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-da465c1e-a2be-4731-905c-e0139ec27a7d tempest-VolumesActionsTest-1040491269 tempest-VolumesActionsTest-1040491269-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75045) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 23:21:41 user nova-compute[75045]: INFO nova.compute.claims [None req-da465c1e-a2be-4731-905c-e0139ec27a7d tempest-VolumesActionsTest-1040491269 tempest-VolumesActionsTest-1040491269-project-member] [instance: 9de31aa1-6996-4c4a-bd44-fce18e0890f4] Claim successful on node user
Nov 08 23:21:42 user nova-compute[75045]: DEBUG nova.compute.provider_tree [None req-da465c1e-a2be-4731-905c-e0139ec27a7d tempest-VolumesActionsTest-1040491269 tempest-VolumesActionsTest-1040491269-project-member] Inventory has not changed in ProviderTree for provider: 62ba5f85-c74d-4b58-986e-d4197e813fd7 {{(pid=75045) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 23:21:42 user nova-compute[75045]: DEBUG nova.scheduler.client.report [None req-da465c1e-a2be-4731-905c-e0139ec27a7d tempest-VolumesActionsTest-1040491269 tempest-VolumesActionsTest-1040491269-project-member] Inventory has not changed for provider 62ba5f85-c74d-4b58-986e-d4197e813fd7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75045) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 23:21:42 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:21:42 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-da465c1e-a2be-4731-905c-e0139ec27a7d tempest-VolumesActionsTest-1040491269 tempest-VolumesActionsTest-1040491269-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.481s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:21:42 user nova-compute[75045]: DEBUG nova.compute.manager [None req-da465c1e-a2be-4731-905c-e0139ec27a7d tempest-VolumesActionsTest-1040491269 tempest-VolumesActionsTest-1040491269-project-member] [instance: 9de31aa1-6996-4c4a-bd44-fce18e0890f4] Start building networks asynchronously for instance. {{(pid=75045) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 23:21:42 user nova-compute[75045]: DEBUG nova.compute.manager [None req-da465c1e-a2be-4731-905c-e0139ec27a7d tempest-VolumesActionsTest-1040491269 tempest-VolumesActionsTest-1040491269-project-member] [instance: 9de31aa1-6996-4c4a-bd44-fce18e0890f4] Allocating IP information in the background. {{(pid=75045) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 23:21:42 user nova-compute[75045]: DEBUG nova.network.neutron [None req-da465c1e-a2be-4731-905c-e0139ec27a7d tempest-VolumesActionsTest-1040491269 tempest-VolumesActionsTest-1040491269-project-member] [instance: 9de31aa1-6996-4c4a-bd44-fce18e0890f4] allocate_for_instance() {{(pid=75045) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 23:21:42 user nova-compute[75045]: INFO nova.virt.libvirt.driver [None req-da465c1e-a2be-4731-905c-e0139ec27a7d tempest-VolumesActionsTest-1040491269 tempest-VolumesActionsTest-1040491269-project-member] [instance: 9de31aa1-6996-4c4a-bd44-fce18e0890f4] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 23:21:42 user nova-compute[75045]: DEBUG nova.compute.manager [None req-da465c1e-a2be-4731-905c-e0139ec27a7d tempest-VolumesActionsTest-1040491269 tempest-VolumesActionsTest-1040491269-project-member] [instance: 9de31aa1-6996-4c4a-bd44-fce18e0890f4] Start building block device mappings for instance. {{(pid=75045) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 23:21:42 user nova-compute[75045]: DEBUG nova.policy [None req-da465c1e-a2be-4731-905c-e0139ec27a7d tempest-VolumesActionsTest-1040491269 tempest-VolumesActionsTest-1040491269-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '47fd89109eff4cf9a4a5d8b5f53b8980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd400c9e6a57b4b8b830b7fd7a83bc8c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75045) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 23:21:42 user nova-compute[75045]: DEBUG nova.compute.manager [None req-da465c1e-a2be-4731-905c-e0139ec27a7d tempest-VolumesActionsTest-1040491269 tempest-VolumesActionsTest-1040491269-project-member] [instance: 9de31aa1-6996-4c4a-bd44-fce18e0890f4] Start spawning the instance on the hypervisor. {{(pid=75045) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 23:21:42 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-da465c1e-a2be-4731-905c-e0139ec27a7d tempest-VolumesActionsTest-1040491269 tempest-VolumesActionsTest-1040491269-project-member] [instance: 9de31aa1-6996-4c4a-bd44-fce18e0890f4] Creating instance directory {{(pid=75045) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 23:21:42 user nova-compute[75045]: INFO nova.virt.libvirt.driver [None req-da465c1e-a2be-4731-905c-e0139ec27a7d tempest-VolumesActionsTest-1040491269 tempest-VolumesActionsTest-1040491269-project-member] [instance: 9de31aa1-6996-4c4a-bd44-fce18e0890f4] Creating image(s)
Nov 08 23:21:42 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-da465c1e-a2be-4731-905c-e0139ec27a7d tempest-VolumesActionsTest-1040491269 tempest-VolumesActionsTest-1040491269-project-member] Acquiring lock "/opt/stack/data/nova/instances/9de31aa1-6996-4c4a-bd44-fce18e0890f4/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:21:42 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-da465c1e-a2be-4731-905c-e0139ec27a7d tempest-VolumesActionsTest-1040491269 tempest-VolumesActionsTest-1040491269-project-member] Lock "/opt/stack/data/nova/instances/9de31aa1-6996-4c4a-bd44-fce18e0890f4/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:21:42 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-da465c1e-a2be-4731-905c-e0139ec27a7d tempest-VolumesActionsTest-1040491269 tempest-VolumesActionsTest-1040491269-project-member] Lock "/opt/stack/data/nova/instances/9de31aa1-6996-4c4a-bd44-fce18e0890f4/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:21:42 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-da465c1e-a2be-4731-905c-e0139ec27a7d tempest-VolumesActionsTest-1040491269 tempest-VolumesActionsTest-1040491269-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b59f52a99fff51c56dd1edfb83892fb8f647f2f3 --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:21:42 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:21:42 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-da465c1e-a2be-4731-905c-e0139ec27a7d tempest-VolumesActionsTest-1040491269 tempest-VolumesActionsTest-1040491269-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b59f52a99fff51c56dd1edfb83892fb8f647f2f3 --force-share --output=json" returned: 0 in 0.195s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:21:42 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-da465c1e-a2be-4731-905c-e0139ec27a7d tempest-VolumesActionsTest-1040491269 tempest-VolumesActionsTest-1040491269-project-member] Acquiring lock "b59f52a99fff51c56dd1edfb83892fb8f647f2f3" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:21:42 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-da465c1e-a2be-4731-905c-e0139ec27a7d tempest-VolumesActionsTest-1040491269 tempest-VolumesActionsTest-1040491269-project-member] Lock "b59f52a99fff51c56dd1edfb83892fb8f647f2f3" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:21:42 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-da465c1e-a2be-4731-905c-e0139ec27a7d tempest-VolumesActionsTest-1040491269 tempest-VolumesActionsTest-1040491269-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b59f52a99fff51c56dd1edfb83892fb8f647f2f3 --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:21:42 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:21:42 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:21:42 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:21:42 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-da465c1e-a2be-4731-905c-e0139ec27a7d tempest-VolumesActionsTest-1040491269 tempest-VolumesActionsTest-1040491269-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b59f52a99fff51c56dd1edfb83892fb8f647f2f3 --force-share --output=json" returned: 0 in 0.256s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:21:42 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-da465c1e-a2be-4731-905c-e0139ec27a7d tempest-VolumesActionsTest-1040491269 tempest-VolumesActionsTest-1040491269-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b59f52a99fff51c56dd1edfb83892fb8f647f2f3,backing_fmt=raw /opt/stack/data/nova/instances/9de31aa1-6996-4c4a-bd44-fce18e0890f4/disk 1073741824 {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:21:42 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-da465c1e-a2be-4731-905c-e0139ec27a7d tempest-VolumesActionsTest-1040491269 tempest-VolumesActionsTest-1040491269-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b59f52a99fff51c56dd1edfb83892fb8f647f2f3,backing_fmt=raw /opt/stack/data/nova/instances/9de31aa1-6996-4c4a-bd44-fce18e0890f4/disk 1073741824" returned: 0 in 0.110s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:21:42 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-da465c1e-a2be-4731-905c-e0139ec27a7d tempest-VolumesActionsTest-1040491269 tempest-VolumesActionsTest-1040491269-project-member] Lock "b59f52a99fff51c56dd1edfb83892fb8f647f2f3" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.373s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:21:42 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-da465c1e-a2be-4731-905c-e0139ec27a7d tempest-VolumesActionsTest-1040491269 tempest-VolumesActionsTest-1040491269-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b59f52a99fff51c56dd1edfb83892fb8f647f2f3 --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:21:43 user nova-compute[75045]: DEBUG nova.compute.manager [req-98a4b2a9-007d-4c88-86d4-328693f36827 req-a95c1f27-79cf-46b6-8804-49be33136618 service nova] [instance: 725866aa-0e2a-4af3-af20-48157e6d2fcb] Received event network-vif-plugged-9a617e54-a69a-4204-b94e-dbe71b1432d2 {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:21:43 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-98a4b2a9-007d-4c88-86d4-328693f36827 req-a95c1f27-79cf-46b6-8804-49be33136618 service nova] Acquiring lock "725866aa-0e2a-4af3-af20-48157e6d2fcb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:21:43 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-98a4b2a9-007d-4c88-86d4-328693f36827 req-a95c1f27-79cf-46b6-8804-49be33136618 service nova] Lock "725866aa-0e2a-4af3-af20-48157e6d2fcb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:21:43 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-98a4b2a9-007d-4c88-86d4-328693f36827 req-a95c1f27-79cf-46b6-8804-49be33136618 service nova] Lock "725866aa-0e2a-4af3-af20-48157e6d2fcb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:21:43 user nova-compute[75045]: DEBUG nova.compute.manager [req-98a4b2a9-007d-4c88-86d4-328693f36827 req-a95c1f27-79cf-46b6-8804-49be33136618 service nova] [instance: 725866aa-0e2a-4af3-af20-48157e6d2fcb] No waiting events found dispatching network-vif-plugged-9a617e54-a69a-4204-b94e-dbe71b1432d2 {{(pid=75045) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 23:21:43 user nova-compute[75045]: WARNING nova.compute.manager [req-98a4b2a9-007d-4c88-86d4-328693f36827 req-a95c1f27-79cf-46b6-8804-49be33136618 service nova] [instance: 725866aa-0e2a-4af3-af20-48157e6d2fcb] Received unexpected event network-vif-plugged-9a617e54-a69a-4204-b94e-dbe71b1432d2 for instance with vm_state shelved_offloaded and task_state spawning.
Nov 08 23:21:43 user nova-compute[75045]: DEBUG nova.network.neutron [None req-da465c1e-a2be-4731-905c-e0139ec27a7d tempest-VolumesActionsTest-1040491269 tempest-VolumesActionsTest-1040491269-project-member] [instance: 9de31aa1-6996-4c4a-bd44-fce18e0890f4] Successfully created port: e1fd4958-e47c-48f4-aa6f-31066cb3f571 {{(pid=75045) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 23:21:43 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-da465c1e-a2be-4731-905c-e0139ec27a7d tempest-VolumesActionsTest-1040491269 tempest-VolumesActionsTest-1040491269-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b59f52a99fff51c56dd1edfb83892fb8f647f2f3 --force-share --output=json" returned: 0 in 0.211s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:21:43 user nova-compute[75045]: DEBUG nova.virt.disk.api [None req-da465c1e-a2be-4731-905c-e0139ec27a7d tempest-VolumesActionsTest-1040491269 tempest-VolumesActionsTest-1040491269-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9de31aa1-6996-4c4a-bd44-fce18e0890f4/disk. size=1073741824 {{(pid=75045) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 23:21:43 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-da465c1e-a2be-4731-905c-e0139ec27a7d tempest-VolumesActionsTest-1040491269 tempest-VolumesActionsTest-1040491269-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9de31aa1-6996-4c4a-bd44-fce18e0890f4/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:21:43 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-da465c1e-a2be-4731-905c-e0139ec27a7d tempest-VolumesActionsTest-1040491269 tempest-VolumesActionsTest-1040491269-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9de31aa1-6996-4c4a-bd44-fce18e0890f4/disk --force-share --output=json" returned: 0 in 0.249s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:21:43 user nova-compute[75045]: DEBUG nova.virt.disk.api [None req-da465c1e-a2be-4731-905c-e0139ec27a7d tempest-VolumesActionsTest-1040491269 tempest-VolumesActionsTest-1040491269-project-member] Cannot resize image /opt/stack/data/nova/instances/9de31aa1-6996-4c4a-bd44-fce18e0890f4/disk to a smaller size. {{(pid=75045) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 08 23:21:43 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-da465c1e-a2be-4731-905c-e0139ec27a7d tempest-VolumesActionsTest-1040491269 tempest-VolumesActionsTest-1040491269-project-member] [instance: 9de31aa1-6996-4c4a-bd44-fce18e0890f4] Created local disks {{(pid=75045) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 23:21:43 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-da465c1e-a2be-4731-905c-e0139ec27a7d tempest-VolumesActionsTest-1040491269 tempest-VolumesActionsTest-1040491269-project-member] [instance: 9de31aa1-6996-4c4a-bd44-fce18e0890f4] Ensure instance console log exists: /opt/stack/data/nova/instances/9de31aa1-6996-4c4a-bd44-fce18e0890f4/console.log {{(pid=75045) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 23:21:43 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-da465c1e-a2be-4731-905c-e0139ec27a7d tempest-VolumesActionsTest-1040491269 tempest-VolumesActionsTest-1040491269-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:21:43 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-da465c1e-a2be-4731-905c-e0139ec27a7d tempest-VolumesActionsTest-1040491269 tempest-VolumesActionsTest-1040491269-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.011s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:21:43 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-da465c1e-a2be-4731-905c-e0139ec27a7d tempest-VolumesActionsTest-1040491269 tempest-VolumesActionsTest-1040491269-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:21:43 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:21:43 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:21:43 user nova-compute[75045]: DEBUG nova.network.neutron [None req-da465c1e-a2be-4731-905c-e0139ec27a7d tempest-VolumesActionsTest-1040491269 tempest-VolumesActionsTest-1040491269-project-member] [instance: 9de31aa1-6996-4c4a-bd44-fce18e0890f4] Successfully updated port: e1fd4958-e47c-48f4-aa6f-31066cb3f571 {{(pid=75045) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 23:21:43 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-da465c1e-a2be-4731-905c-e0139ec27a7d tempest-VolumesActionsTest-1040491269 tempest-VolumesActionsTest-1040491269-project-member] Acquiring lock "refresh_cache-9de31aa1-6996-4c4a-bd44-fce18e0890f4" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 23:21:43 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-da465c1e-a2be-4731-905c-e0139ec27a7d tempest-VolumesActionsTest-1040491269 tempest-VolumesActionsTest-1040491269-project-member] Acquired lock "refresh_cache-9de31aa1-6996-4c4a-bd44-fce18e0890f4" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 23:21:43 user nova-compute[75045]: DEBUG nova.network.neutron [None req-da465c1e-a2be-4731-905c-e0139ec27a7d tempest-VolumesActionsTest-1040491269 tempest-VolumesActionsTest-1040491269-project-member] [instance: 9de31aa1-6996-4c4a-bd44-fce18e0890f4] Building network info cache for instance {{(pid=75045) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 23:21:44 user nova-compute[75045]: DEBUG nova.compute.manager [req-50b9d508-44c6-497d-ad05-e4ae6c9b130c req-838ea278-4abb-490c-9ecf-a4df69fb7c6e service nova] [instance: 9de31aa1-6996-4c4a-bd44-fce18e0890f4] Received event network-changed-e1fd4958-e47c-48f4-aa6f-31066cb3f571 {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:21:44 user nova-compute[75045]: DEBUG nova.compute.manager [req-50b9d508-44c6-497d-ad05-e4ae6c9b130c req-838ea278-4abb-490c-9ecf-a4df69fb7c6e service nova] [instance: 9de31aa1-6996-4c4a-bd44-fce18e0890f4] Refreshing instance network info cache due to event network-changed-e1fd4958-e47c-48f4-aa6f-31066cb3f571. {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 23:21:44 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-50b9d508-44c6-497d-ad05-e4ae6c9b130c req-838ea278-4abb-490c-9ecf-a4df69fb7c6e service nova] Acquiring lock "refresh_cache-9de31aa1-6996-4c4a-bd44-fce18e0890f4" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 23:21:44 user nova-compute[75045]: DEBUG nova.network.neutron [None req-da465c1e-a2be-4731-905c-e0139ec27a7d tempest-VolumesActionsTest-1040491269 tempest-VolumesActionsTest-1040491269-project-member] [instance: 9de31aa1-6996-4c4a-bd44-fce18e0890f4] Instance cache missing network info. {{(pid=75045) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 23:21:44 user nova-compute[75045]: DEBUG nova.network.neutron [None req-da465c1e-a2be-4731-905c-e0139ec27a7d tempest-VolumesActionsTest-1040491269 tempest-VolumesActionsTest-1040491269-project-member] [instance: 9de31aa1-6996-4c4a-bd44-fce18e0890f4] Updating instance_info_cache with network_info: [{"id": "e1fd4958-e47c-48f4-aa6f-31066cb3f571", "address": "fa:16:3e:6f:06:fe", "network": {"id": "8f7dd756-4715-4085-bfab-8432f99f2e77", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1836278743-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d400c9e6a57b4b8b830b7fd7a83bc8c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1fd4958-e4", "ovs_interfaceid": "e1fd4958-e47c-48f4-aa6f-31066cb3f571", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75045) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 23:21:44 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-da465c1e-a2be-4731-905c-e0139ec27a7d tempest-VolumesActionsTest-1040491269 tempest-VolumesActionsTest-1040491269-project-member] Releasing lock "refresh_cache-9de31aa1-6996-4c4a-bd44-fce18e0890f4" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 23:21:44 user nova-compute[75045]: DEBUG nova.compute.manager [None req-da465c1e-a2be-4731-905c-e0139ec27a7d tempest-VolumesActionsTest-1040491269 tempest-VolumesActionsTest-1040491269-project-member] [instance: 9de31aa1-6996-4c4a-bd44-fce18e0890f4] Instance network_info: |[{"id": "e1fd4958-e47c-48f4-aa6f-31066cb3f571", "address": "fa:16:3e:6f:06:fe", "network": {"id": "8f7dd756-4715-4085-bfab-8432f99f2e77", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1836278743-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d400c9e6a57b4b8b830b7fd7a83bc8c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1fd4958-e4", "ovs_interfaceid": "e1fd4958-e47c-48f4-aa6f-31066cb3f571", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75045) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 23:21:44 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-50b9d508-44c6-497d-ad05-e4ae6c9b130c req-838ea278-4abb-490c-9ecf-a4df69fb7c6e service nova] Acquired lock "refresh_cache-9de31aa1-6996-4c4a-bd44-fce18e0890f4" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 23:21:44 user nova-compute[75045]: DEBUG nova.network.neutron [req-50b9d508-44c6-497d-ad05-e4ae6c9b130c req-838ea278-4abb-490c-9ecf-a4df69fb7c6e service nova] [instance: 9de31aa1-6996-4c4a-bd44-fce18e0890f4] Refreshing network info cache for port e1fd4958-e47c-48f4-aa6f-31066cb3f571 {{(pid=75045) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 23:21:44 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-da465c1e-a2be-4731-905c-e0139ec27a7d tempest-VolumesActionsTest-1040491269 tempest-VolumesActionsTest-1040491269-project-member] [instance: 9de31aa1-6996-4c4a-bd44-fce18e0890f4] Start _get_guest_xml network_info=[{"id": "e1fd4958-e47c-48f4-aa6f-31066cb3f571", "address": "fa:16:3e:6f:06:fe", "network": {"id": "8f7dd756-4715-4085-bfab-8432f99f2e77", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1836278743-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d400c9e6a57b4b8b830b7fd7a83bc8c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1fd4958-e4", "ovs_interfaceid": "e1fd4958-e47c-48f4-aa6f-31066cb3f571", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T23:11:54Z,direct_url=<?>,disk_format='qcow2',id=a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b1beba2cc4e7465ea249e2225fb494dc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T23:11:56Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'disk_bus': 'virtio', 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': 'a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75045) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 23:21:44 user nova-compute[75045]: WARNING nova.virt.libvirt.driver [None req-da465c1e-a2be-4731-905c-e0139ec27a7d tempest-VolumesActionsTest-1040491269 tempest-VolumesActionsTest-1040491269-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 23:21:44 user nova-compute[75045]: WARNING nova.virt.libvirt.driver [None req-da465c1e-a2be-4731-905c-e0139ec27a7d tempest-VolumesActionsTest-1040491269 tempest-VolumesActionsTest-1040491269-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 23:21:44 user nova-compute[75045]: DEBUG nova.virt.libvirt.host [None req-da465c1e-a2be-4731-905c-e0139ec27a7d tempest-VolumesActionsTest-1040491269 tempest-VolumesActionsTest-1040491269-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75045) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 23:21:44 user nova-compute[75045]: DEBUG nova.virt.libvirt.host [None req-da465c1e-a2be-4731-905c-e0139ec27a7d tempest-VolumesActionsTest-1040491269 tempest-VolumesActionsTest-1040491269-project-member] CPU controller missing on host. {{(pid=75045) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 23:21:44 user nova-compute[75045]: DEBUG nova.virt.libvirt.host [None req-da465c1e-a2be-4731-905c-e0139ec27a7d tempest-VolumesActionsTest-1040491269 tempest-VolumesActionsTest-1040491269-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75045) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 23:21:44 user nova-compute[75045]: DEBUG nova.virt.libvirt.host [None req-da465c1e-a2be-4731-905c-e0139ec27a7d tempest-VolumesActionsTest-1040491269 tempest-VolumesActionsTest-1040491269-project-member] CPU controller found on host. {{(pid=75045) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 23:21:44 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-da465c1e-a2be-4731-905c-e0139ec27a7d tempest-VolumesActionsTest-1040491269 tempest-VolumesActionsTest-1040491269-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75045) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 23:21:44 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-da465c1e-a2be-4731-905c-e0139ec27a7d tempest-VolumesActionsTest-1040491269 tempest-VolumesActionsTest-1040491269-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T23:11:41Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T23:11:54Z,direct_url=<?>,disk_format='qcow2',id=a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b1beba2cc4e7465ea249e2225fb494dc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T23:11:56Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75045) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 23:21:44 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-da465c1e-a2be-4731-905c-e0139ec27a7d tempest-VolumesActionsTest-1040491269 tempest-VolumesActionsTest-1040491269-project-member] Flavor limits 0:0:0 {{(pid=75045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 23:21:44 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-da465c1e-a2be-4731-905c-e0139ec27a7d tempest-VolumesActionsTest-1040491269 tempest-VolumesActionsTest-1040491269-project-member] Image limits 0:0:0 {{(pid=75045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 23:21:44 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-da465c1e-a2be-4731-905c-e0139ec27a7d tempest-VolumesActionsTest-1040491269 tempest-VolumesActionsTest-1040491269-project-member] Flavor pref 0:0:0 {{(pid=75045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 23:21:44 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-da465c1e-a2be-4731-905c-e0139ec27a7d tempest-VolumesActionsTest-1040491269 tempest-VolumesActionsTest-1040491269-project-member] Image pref 0:0:0 {{(pid=75045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 23:21:44 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-da465c1e-a2be-4731-905c-e0139ec27a7d tempest-VolumesActionsTest-1040491269 tempest-VolumesActionsTest-1040491269-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 23:21:44 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-da465c1e-a2be-4731-905c-e0139ec27a7d tempest-VolumesActionsTest-1040491269 tempest-VolumesActionsTest-1040491269-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75045) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 23:21:44 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-da465c1e-a2be-4731-905c-e0139ec27a7d tempest-VolumesActionsTest-1040491269 tempest-VolumesActionsTest-1040491269-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75045) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 23:21:44 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-da465c1e-a2be-4731-905c-e0139ec27a7d tempest-VolumesActionsTest-1040491269 tempest-VolumesActionsTest-1040491269-project-member] Got 1 possible topologies {{(pid=75045) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 23:21:44 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-da465c1e-a2be-4731-905c-e0139ec27a7d tempest-VolumesActionsTest-1040491269 tempest-VolumesActionsTest-1040491269-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75045) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 23:21:44 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-da465c1e-a2be-4731-905c-e0139ec27a7d tempest-VolumesActionsTest-1040491269 tempest-VolumesActionsTest-1040491269-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75045) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 23:21:45 user nova-compute[75045]: DEBUG nova.virt.libvirt.vif [None req-da465c1e-a2be-4731-905c-e0139ec27a7d tempest-VolumesActionsTest-1040491269 tempest-VolumesActionsTest-1040491269-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T23:21:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1282366556',display_name='tempest-VolumesActionsTest-instance-1282366556',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1282366556',id=17,image_ref='a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d400c9e6a57b4b8b830b7fd7a83bc8c5',ramdisk_id='',reservation_id='r-1m6jo0ih',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1040491269',owner_user_name='tempest-VolumesActionsTest-1040491269-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T23:21:42Z,user_data=None,user_id='47fd89109eff4cf9a4a5d8b5f53b8980',uuid=9de31aa1-6996-4c4a-bd44-fce18e0890f4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e1fd4958-e47c-48f4-aa6f-31066cb3f571", "address": "fa:16:3e:6f:06:fe", "network": {"id": "8f7dd756-4715-4085-bfab-8432f99f2e77", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1836278743-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d400c9e6a57b4b8b830b7fd7a83bc8c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1fd4958-e4", "ovs_interfaceid": "e1fd4958-e47c-48f4-aa6f-31066cb3f571", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75045) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 23:21:45 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-da465c1e-a2be-4731-905c-e0139ec27a7d tempest-VolumesActionsTest-1040491269 tempest-VolumesActionsTest-1040491269-project-member] Converting VIF {"id": "e1fd4958-e47c-48f4-aa6f-31066cb3f571", "address": "fa:16:3e:6f:06:fe", "network": {"id": "8f7dd756-4715-4085-bfab-8432f99f2e77", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1836278743-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d400c9e6a57b4b8b830b7fd7a83bc8c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1fd4958-e4", "ovs_interfaceid": "e1fd4958-e47c-48f4-aa6f-31066cb3f571", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 23:21:45 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-da465c1e-a2be-4731-905c-e0139ec27a7d tempest-VolumesActionsTest-1040491269 tempest-VolumesActionsTest-1040491269-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6f:06:fe,bridge_name='br-int',has_traffic_filtering=True,id=e1fd4958-e47c-48f4-aa6f-31066cb3f571,network=Network(8f7dd756-4715-4085-bfab-8432f99f2e77),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape1fd4958-e4') {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 23:21:45 user nova-compute[75045]: DEBUG nova.objects.instance [None req-da465c1e-a2be-4731-905c-e0139ec27a7d tempest-VolumesActionsTest-1040491269 tempest-VolumesActionsTest-1040491269-project-member] Lazy-loading 'pci_devices' on Instance uuid 9de31aa1-6996-4c4a-bd44-fce18e0890f4 {{(pid=75045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 23:21:45 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-da465c1e-a2be-4731-905c-e0139ec27a7d tempest-VolumesActionsTest-1040491269 tempest-VolumesActionsTest-1040491269-project-member] [instance: 9de31aa1-6996-4c4a-bd44-fce18e0890f4] End _get_guest_xml xml=<domain type="kvm">
Nov 08 23:21:45 user nova-compute[75045]:   <uuid>9de31aa1-6996-4c4a-bd44-fce18e0890f4</uuid>
Nov 08 23:21:45 user nova-compute[75045]:   <name>instance-00000011</name>
Nov 08 23:21:45 user nova-compute[75045]:   <memory>524288</memory>
Nov 08 23:21:45 user nova-compute[75045]:   <vcpu>1</vcpu>
Nov 08 23:21:45 user nova-compute[75045]:   <metadata>
Nov 08 23:21:45 user nova-compute[75045]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 23:21:45 user nova-compute[75045]:       <nova:package version="0.0.0"/>
Nov 08 23:21:45 user nova-compute[75045]:       <nova:name>tempest-VolumesActionsTest-instance-1282366556</nova:name>
Nov 08 23:21:45 user nova-compute[75045]:       <nova:creationTime>2023-11-08 23:21:44</nova:creationTime>
Nov 08 23:21:45 user nova-compute[75045]:       <nova:flavor name="m1.tiny">
Nov 08 23:21:45 user nova-compute[75045]:         <nova:memory>512</nova:memory>
Nov 08 23:21:45 user nova-compute[75045]:         <nova:disk>1</nova:disk>
Nov 08 23:21:45 user nova-compute[75045]:         <nova:swap>0</nova:swap>
Nov 08 23:21:45 user nova-compute[75045]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 23:21:45 user nova-compute[75045]:         <nova:vcpus>1</nova:vcpus>
Nov 08 23:21:45 user nova-compute[75045]:       </nova:flavor>
Nov 08 23:21:45 user nova-compute[75045]:       <nova:owner>
Nov 08 23:21:45 user nova-compute[75045]:         <nova:user uuid="47fd89109eff4cf9a4a5d8b5f53b8980">tempest-VolumesActionsTest-1040491269-project-member</nova:user>
Nov 08 23:21:45 user nova-compute[75045]:         <nova:project uuid="d400c9e6a57b4b8b830b7fd7a83bc8c5">tempest-VolumesActionsTest-1040491269</nova:project>
Nov 08 23:21:45 user nova-compute[75045]:       </nova:owner>
Nov 08 23:21:45 user nova-compute[75045]:       <nova:root type="image" uuid="a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb"/>
Nov 08 23:21:45 user nova-compute[75045]:       <nova:ports>
Nov 08 23:21:45 user nova-compute[75045]:         <nova:port uuid="e1fd4958-e47c-48f4-aa6f-31066cb3f571">
Nov 08 23:21:45 user nova-compute[75045]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 08 23:21:45 user nova-compute[75045]:         </nova:port>
Nov 08 23:21:45 user nova-compute[75045]:       </nova:ports>
Nov 08 23:21:45 user nova-compute[75045]:     </nova:instance>
Nov 08 23:21:45 user nova-compute[75045]:   </metadata>
Nov 08 23:21:45 user nova-compute[75045]:   <sysinfo type="smbios">
Nov 08 23:21:45 user nova-compute[75045]:     <system>
Nov 08 23:21:45 user nova-compute[75045]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 23:21:45 user nova-compute[75045]:       <entry name="product">OpenStack Nova</entry>
Nov 08 23:21:45 user nova-compute[75045]:       <entry name="version">0.0.0</entry>
Nov 08 23:21:45 user nova-compute[75045]:       <entry name="serial">9de31aa1-6996-4c4a-bd44-fce18e0890f4</entry>
Nov 08 23:21:45 user nova-compute[75045]:       <entry name="uuid">9de31aa1-6996-4c4a-bd44-fce18e0890f4</entry>
Nov 08 23:21:45 user nova-compute[75045]:       <entry name="family">Virtual Machine</entry>
Nov 08 23:21:45 user nova-compute[75045]:     </system>
Nov 08 23:21:45 user nova-compute[75045]:   </sysinfo>
Nov 08 23:21:45 user nova-compute[75045]:   <os>
Nov 08 23:21:45 user nova-compute[75045]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 23:21:45 user nova-compute[75045]:     <boot dev="hd"/>
Nov 08 23:21:45 user nova-compute[75045]:     <smbios mode="sysinfo"/>
Nov 08 23:21:45 user nova-compute[75045]:   </os>
Nov 08 23:21:45 user nova-compute[75045]:   <features>
Nov 08 23:21:45 user nova-compute[75045]:     <acpi/>
Nov 08 23:21:45 user nova-compute[75045]:     <apic/>
Nov 08 23:21:45 user nova-compute[75045]:     <vmcoreinfo/>
Nov 08 23:21:45 user nova-compute[75045]:   </features>
Nov 08 23:21:45 user nova-compute[75045]:   <clock offset="utc">
Nov 08 23:21:45 user nova-compute[75045]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 23:21:45 user nova-compute[75045]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 23:21:45 user nova-compute[75045]:     <timer name="hpet" present="no"/>
Nov 08 23:21:45 user nova-compute[75045]:   </clock>
Nov 08 23:21:45 user nova-compute[75045]:   <cpu mode="custom" match="exact">
Nov 08 23:21:45 user nova-compute[75045]:     <model>Nehalem</model>
Nov 08 23:21:45 user nova-compute[75045]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 23:21:45 user nova-compute[75045]:   </cpu>
Nov 08 23:21:45 user nova-compute[75045]:   <devices>
Nov 08 23:21:45 user nova-compute[75045]:     <disk type="file" device="disk">
Nov 08 23:21:45 user nova-compute[75045]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 23:21:45 user nova-compute[75045]:       <source file="/opt/stack/data/nova/instances/9de31aa1-6996-4c4a-bd44-fce18e0890f4/disk"/>
Nov 08 23:21:45 user nova-compute[75045]:       <target dev="vda" bus="virtio"/>
Nov 08 23:21:45 user nova-compute[75045]:     </disk>
Nov 08 23:21:45 user nova-compute[75045]:     <interface type="ethernet">
Nov 08 23:21:45 user nova-compute[75045]:       <mac address="fa:16:3e:6f:06:fe"/>
Nov 08 23:21:45 user nova-compute[75045]:       <model type="virtio"/>
Nov 08 23:21:45 user nova-compute[75045]:       <mtu size="1442"/>
Nov 08 23:21:45 user nova-compute[75045]:       <target dev="tape1fd4958-e4"/>
Nov 08 23:21:45 user nova-compute[75045]:     </interface>
Nov 08 23:21:45 user nova-compute[75045]:     <serial type="pty">
Nov 08 23:21:45 user nova-compute[75045]:       <log file="/opt/stack/data/nova/instances/9de31aa1-6996-4c4a-bd44-fce18e0890f4/console.log" append="off"/>
Nov 08 23:21:45 user nova-compute[75045]:     </serial>
Nov 08 23:21:45 user nova-compute[75045]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 23:21:45 user nova-compute[75045]:     <video>
Nov 08 23:21:45 user nova-compute[75045]:       <model type="virtio"/>
Nov 08 23:21:45 user nova-compute[75045]:     </video>
Nov 08 23:21:45 user nova-compute[75045]:     <rng model="virtio">
Nov 08 23:21:45 user nova-compute[75045]:       <backend model="random">/dev/urandom</backend>
Nov 08 23:21:45 user nova-compute[75045]:     </rng>
Nov 08 23:21:45 user nova-compute[75045]:     <controller type="usb" index="0" model="none"/>
Nov 08 23:21:45 user nova-compute[75045]:     <memballoon model="virtio">
Nov 08 23:21:45 user nova-compute[75045]:       <stats period="10"/>
Nov 08 23:21:45 user nova-compute[75045]:     </memballoon>
Nov 08 23:21:45 user nova-compute[75045]:   </devices>
Nov 08 23:21:45 user nova-compute[75045]: </domain>
Nov 08 23:21:45 user nova-compute[75045]:  {{(pid=75045) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 23:21:45 user nova-compute[75045]: DEBUG nova.virt.libvirt.vif [None req-da465c1e-a2be-4731-905c-e0139ec27a7d tempest-VolumesActionsTest-1040491269 tempest-VolumesActionsTest-1040491269-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T23:21:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1282366556',display_name='tempest-VolumesActionsTest-instance-1282366556',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1282366556',id=17,image_ref='a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d400c9e6a57b4b8b830b7fd7a83bc8c5',ramdisk_id='',reservation_id='r-1m6jo0ih',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1040491269',owner_user_name='tempest-VolumesActionsTest-1040491269-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T23:21:42Z,user_data=None,user_id='47fd89109eff4cf9a4a5d8b5f53b8980',uuid=9de31aa1-6996-4c4a-bd44-fce18e0890f4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e1fd4958-e47c-48f4-aa6f-31066cb3f571", "address": "fa:16:3e:6f:06:fe", "network": {"id": "8f7dd756-4715-4085-bfab-8432f99f2e77", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1836278743-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d400c9e6a57b4b8b830b7fd7a83bc8c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1fd4958-e4", "ovs_interfaceid": "e1fd4958-e47c-48f4-aa6f-31066cb3f571", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75045) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 23:21:45 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-da465c1e-a2be-4731-905c-e0139ec27a7d tempest-VolumesActionsTest-1040491269 tempest-VolumesActionsTest-1040491269-project-member] Converting VIF {"id": "e1fd4958-e47c-48f4-aa6f-31066cb3f571", "address": "fa:16:3e:6f:06:fe", "network": {"id": "8f7dd756-4715-4085-bfab-8432f99f2e77", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1836278743-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d400c9e6a57b4b8b830b7fd7a83bc8c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1fd4958-e4", "ovs_interfaceid": "e1fd4958-e47c-48f4-aa6f-31066cb3f571", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 23:21:45 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-da465c1e-a2be-4731-905c-e0139ec27a7d tempest-VolumesActionsTest-1040491269 tempest-VolumesActionsTest-1040491269-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6f:06:fe,bridge_name='br-int',has_traffic_filtering=True,id=e1fd4958-e47c-48f4-aa6f-31066cb3f571,network=Network(8f7dd756-4715-4085-bfab-8432f99f2e77),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape1fd4958-e4') {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 23:21:45 user nova-compute[75045]: DEBUG os_vif [None req-da465c1e-a2be-4731-905c-e0139ec27a7d tempest-VolumesActionsTest-1040491269 tempest-VolumesActionsTest-1040491269-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6f:06:fe,bridge_name='br-int',has_traffic_filtering=True,id=e1fd4958-e47c-48f4-aa6f-31066cb3f571,network=Network(8f7dd756-4715-4085-bfab-8432f99f2e77),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape1fd4958-e4') {{(pid=75045) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 23:21:45 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:21:45 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:21:45 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 23:21:45 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:21:45 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '41235de3-7e10-5215-af4b-3be623051004', '_type': 'linux-noop'}}, row=False) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:21:45 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:21:45 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 23:21:45 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:21:45 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape1fd4958-e4, may_exist=True, interface_attrs={}) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:21:45 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape1fd4958-e4, col_values=(('qos', UUID('4df74b60-7cf7-48ee-a487-c2c8dd317087')),), if_exists=True) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:21:45 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape1fd4958-e4, col_values=(('external_ids', {'iface-id': 'e1fd4958-e47c-48f4-aa6f-31066cb3f571', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6f:06:fe', 'vm-uuid': '9de31aa1-6996-4c4a-bd44-fce18e0890f4'}),), if_exists=True) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:21:45 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:21:45 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 23:21:45 user nova-compute[75045]: DEBUG nova.compute.manager [None req-c1adc332-a2d8-4fbd-88d0-288020b56c91 tempest-TestShelveInstance-1634360024 tempest-TestShelveInstance-1634360024-project-member] [instance: 725866aa-0e2a-4af3-af20-48157e6d2fcb] Instance event wait completed in 0 seconds for  {{(pid=75045) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 23:21:45 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-c1adc332-a2d8-4fbd-88d0-288020b56c91 tempest-TestShelveInstance-1634360024 tempest-TestShelveInstance-1634360024-project-member] [instance: 725866aa-0e2a-4af3-af20-48157e6d2fcb] Guest created on hypervisor {{(pid=75045) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 23:21:45 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:21:45 user nova-compute[75045]: INFO os_vif [None req-da465c1e-a2be-4731-905c-e0139ec27a7d tempest-VolumesActionsTest-1040491269 tempest-VolumesActionsTest-1040491269-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6f:06:fe,bridge_name='br-int',has_traffic_filtering=True,id=e1fd4958-e47c-48f4-aa6f-31066cb3f571,network=Network(8f7dd756-4715-4085-bfab-8432f99f2e77),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape1fd4958-e4')
Nov 08 23:21:45 user nova-compute[75045]: INFO nova.virt.libvirt.driver [-] [instance: 725866aa-0e2a-4af3-af20-48157e6d2fcb] Instance spawned successfully.
Nov 08 23:21:45 user nova-compute[75045]: DEBUG nova.compute.manager [None req-c1adc332-a2d8-4fbd-88d0-288020b56c91 tempest-TestShelveInstance-1634360024 tempest-TestShelveInstance-1634360024-project-member] [instance: 725866aa-0e2a-4af3-af20-48157e6d2fcb] Checking state {{(pid=75045) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 23:21:45 user nova-compute[75045]: DEBUG nova.compute.manager [req-c9fc7036-f2ba-4b2b-905c-02cf7132e40c req-37582863-56c3-4ef6-ae5a-91c529dc9d81 service nova] [instance: 725866aa-0e2a-4af3-af20-48157e6d2fcb] Received event network-vif-plugged-9a617e54-a69a-4204-b94e-dbe71b1432d2 {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:21:45 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-c9fc7036-f2ba-4b2b-905c-02cf7132e40c req-37582863-56c3-4ef6-ae5a-91c529dc9d81 service nova] Acquiring lock "725866aa-0e2a-4af3-af20-48157e6d2fcb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:21:45 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-c9fc7036-f2ba-4b2b-905c-02cf7132e40c req-37582863-56c3-4ef6-ae5a-91c529dc9d81 service nova] Lock "725866aa-0e2a-4af3-af20-48157e6d2fcb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:21:45 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-c9fc7036-f2ba-4b2b-905c-02cf7132e40c req-37582863-56c3-4ef6-ae5a-91c529dc9d81 service nova] Lock "725866aa-0e2a-4af3-af20-48157e6d2fcb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:21:45 user nova-compute[75045]: DEBUG nova.compute.manager [req-c9fc7036-f2ba-4b2b-905c-02cf7132e40c req-37582863-56c3-4ef6-ae5a-91c529dc9d81 service nova] [instance: 725866aa-0e2a-4af3-af20-48157e6d2fcb] No waiting events found dispatching network-vif-plugged-9a617e54-a69a-4204-b94e-dbe71b1432d2 {{(pid=75045) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 23:21:45 user nova-compute[75045]: WARNING nova.compute.manager [req-c9fc7036-f2ba-4b2b-905c-02cf7132e40c req-37582863-56c3-4ef6-ae5a-91c529dc9d81 service nova] [instance: 725866aa-0e2a-4af3-af20-48157e6d2fcb] Received unexpected event network-vif-plugged-9a617e54-a69a-4204-b94e-dbe71b1432d2 for instance with vm_state shelved_offloaded and task_state spawning.
Nov 08 23:21:45 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-da465c1e-a2be-4731-905c-e0139ec27a7d tempest-VolumesActionsTest-1040491269 tempest-VolumesActionsTest-1040491269-project-member] No BDM found with device name vda, not building metadata. {{(pid=75045) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 23:21:45 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-da465c1e-a2be-4731-905c-e0139ec27a7d tempest-VolumesActionsTest-1040491269 tempest-VolumesActionsTest-1040491269-project-member] No VIF found with MAC fa:16:3e:6f:06:fe, not building metadata {{(pid=75045) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 23:21:45 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-c1adc332-a2d8-4fbd-88d0-288020b56c91 tempest-TestShelveInstance-1634360024 tempest-TestShelveInstance-1634360024-project-member] Lock "725866aa-0e2a-4af3-af20-48157e6d2fcb" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 36.580s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:21:45 user nova-compute[75045]: DEBUG nova.network.neutron [req-50b9d508-44c6-497d-ad05-e4ae6c9b130c req-838ea278-4abb-490c-9ecf-a4df69fb7c6e service nova] [instance: 9de31aa1-6996-4c4a-bd44-fce18e0890f4] Updated VIF entry in instance network info cache for port e1fd4958-e47c-48f4-aa6f-31066cb3f571. {{(pid=75045) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 23:21:45 user nova-compute[75045]: DEBUG nova.network.neutron [req-50b9d508-44c6-497d-ad05-e4ae6c9b130c req-838ea278-4abb-490c-9ecf-a4df69fb7c6e service nova] [instance: 9de31aa1-6996-4c4a-bd44-fce18e0890f4] Updating instance_info_cache with network_info: [{"id": "e1fd4958-e47c-48f4-aa6f-31066cb3f571", "address": "fa:16:3e:6f:06:fe", "network": {"id": "8f7dd756-4715-4085-bfab-8432f99f2e77", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1836278743-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d400c9e6a57b4b8b830b7fd7a83bc8c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1fd4958-e4", "ovs_interfaceid": "e1fd4958-e47c-48f4-aa6f-31066cb3f571", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75045) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 23:21:45 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-50b9d508-44c6-497d-ad05-e4ae6c9b130c req-838ea278-4abb-490c-9ecf-a4df69fb7c6e service nova] Releasing lock "refresh_cache-9de31aa1-6996-4c4a-bd44-fce18e0890f4" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 23:21:45 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:21:46 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:21:46 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:21:46 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:21:46 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:21:47 user nova-compute[75045]: DEBUG nova.compute.manager [req-f66c0b97-9ac3-484b-8536-950fca437fdd req-f8113a5e-6732-447c-8e79-0acdddd4f3be service nova] [instance: 9de31aa1-6996-4c4a-bd44-fce18e0890f4] Received event network-vif-plugged-e1fd4958-e47c-48f4-aa6f-31066cb3f571 {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:21:47 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-f66c0b97-9ac3-484b-8536-950fca437fdd req-f8113a5e-6732-447c-8e79-0acdddd4f3be service nova] Acquiring lock "9de31aa1-6996-4c4a-bd44-fce18e0890f4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:21:47 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-f66c0b97-9ac3-484b-8536-950fca437fdd req-f8113a5e-6732-447c-8e79-0acdddd4f3be service nova] Lock "9de31aa1-6996-4c4a-bd44-fce18e0890f4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:21:47 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-f66c0b97-9ac3-484b-8536-950fca437fdd req-f8113a5e-6732-447c-8e79-0acdddd4f3be service nova] Lock "9de31aa1-6996-4c4a-bd44-fce18e0890f4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:21:47 user nova-compute[75045]: DEBUG nova.compute.manager [req-f66c0b97-9ac3-484b-8536-950fca437fdd req-f8113a5e-6732-447c-8e79-0acdddd4f3be service nova] [instance: 9de31aa1-6996-4c4a-bd44-fce18e0890f4] No waiting events found dispatching network-vif-plugged-e1fd4958-e47c-48f4-aa6f-31066cb3f571 {{(pid=75045) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 23:21:47 user nova-compute[75045]: WARNING nova.compute.manager [req-f66c0b97-9ac3-484b-8536-950fca437fdd req-f8113a5e-6732-447c-8e79-0acdddd4f3be service nova] [instance: 9de31aa1-6996-4c4a-bd44-fce18e0890f4] Received unexpected event network-vif-plugged-e1fd4958-e47c-48f4-aa6f-31066cb3f571 for instance with vm_state building and task_state spawning.
Nov 08 23:21:47 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:21:47 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:21:47 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:21:48 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._sync_power_states {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:21:48 user nova-compute[75045]: DEBUG nova.compute.manager [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Triggering sync for uuid 4ae5ff6b-6f2c-4dfd-a4c6-da4809e2cf27 {{(pid=75045) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 08 23:21:48 user nova-compute[75045]: DEBUG nova.compute.manager [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Triggering sync for uuid 0f21fcd3-ac5f-499e-9c34-82af806fda1d {{(pid=75045) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 08 23:21:48 user nova-compute[75045]: DEBUG nova.compute.manager [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Triggering sync for uuid fde91f7c-31e3-456c-b252-6ce37fa3b600 {{(pid=75045) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 08 23:21:48 user nova-compute[75045]: DEBUG nova.compute.manager [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Triggering sync for uuid d2c911cf-d5f4-4c19-8335-8c7834184a7e {{(pid=75045) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 08 23:21:48 user nova-compute[75045]: DEBUG nova.compute.manager [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Triggering sync for uuid 032e20aa-8887-4215-808e-68299a0d8d0b {{(pid=75045) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 08 23:21:48 user nova-compute[75045]: DEBUG nova.compute.manager [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Triggering sync for uuid 43f31110-89ec-4b20-9842-7c9dd7df0e14 {{(pid=75045) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 08 23:21:48 user nova-compute[75045]: DEBUG nova.compute.manager [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Triggering sync for uuid 83d225e0-e39e-4500-b7ae-52dfbd8b8588 {{(pid=75045) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 08 23:21:48 user nova-compute[75045]: DEBUG nova.compute.manager [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Triggering sync for uuid 9de31aa1-6996-4c4a-bd44-fce18e0890f4 {{(pid=75045) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 08 23:21:48 user nova-compute[75045]: DEBUG nova.compute.manager [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Triggering sync for uuid 725866aa-0e2a-4af3-af20-48157e6d2fcb {{(pid=75045) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 08 23:21:48 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Acquiring lock "4ae5ff6b-6f2c-4dfd-a4c6-da4809e2cf27" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:21:48 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Lock "4ae5ff6b-6f2c-4dfd-a4c6-da4809e2cf27" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:21:48 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Acquiring lock "0f21fcd3-ac5f-499e-9c34-82af806fda1d" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:21:48 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Lock "0f21fcd3-ac5f-499e-9c34-82af806fda1d" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:21:48 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Acquiring lock "fde91f7c-31e3-456c-b252-6ce37fa3b600" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:21:48 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Lock "fde91f7c-31e3-456c-b252-6ce37fa3b600" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:21:48 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Acquiring lock "d2c911cf-d5f4-4c19-8335-8c7834184a7e" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:21:48 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Lock "d2c911cf-d5f4-4c19-8335-8c7834184a7e" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:21:48 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Acquiring lock "032e20aa-8887-4215-808e-68299a0d8d0b" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:21:48 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Acquiring lock "43f31110-89ec-4b20-9842-7c9dd7df0e14" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:21:48 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Lock "43f31110-89ec-4b20-9842-7c9dd7df0e14" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:21:48 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Acquiring lock "83d225e0-e39e-4500-b7ae-52dfbd8b8588" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:21:48 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Lock "83d225e0-e39e-4500-b7ae-52dfbd8b8588" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:21:48 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Acquiring lock "9de31aa1-6996-4c4a-bd44-fce18e0890f4" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:21:48 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Acquiring lock "725866aa-0e2a-4af3-af20-48157e6d2fcb" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:21:48 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Lock "725866aa-0e2a-4af3-af20-48157e6d2fcb" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:21:48 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Lock "0f21fcd3-ac5f-499e-9c34-82af806fda1d" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.086s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:21:48 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Lock "43f31110-89ec-4b20-9842-7c9dd7df0e14" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.089s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:21:48 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Lock "4ae5ff6b-6f2c-4dfd-a4c6-da4809e2cf27" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.098s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:21:48 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Lock "d2c911cf-d5f4-4c19-8335-8c7834184a7e" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.102s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:21:48 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Lock "725866aa-0e2a-4af3-af20-48157e6d2fcb" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.119s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:21:48 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Lock "fde91f7c-31e3-456c-b252-6ce37fa3b600" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.148s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:21:48 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Lock "83d225e0-e39e-4500-b7ae-52dfbd8b8588" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.149s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:21:49 user nova-compute[75045]: DEBUG nova.compute.manager [req-1daefd1a-8c84-4ea8-a135-3031f659e9db req-d637088f-aafb-4eb8-88e2-28ad8f2ed889 service nova] [instance: 9de31aa1-6996-4c4a-bd44-fce18e0890f4] Received event network-vif-plugged-e1fd4958-e47c-48f4-aa6f-31066cb3f571 {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:21:49 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-1daefd1a-8c84-4ea8-a135-3031f659e9db req-d637088f-aafb-4eb8-88e2-28ad8f2ed889 service nova] Acquiring lock "9de31aa1-6996-4c4a-bd44-fce18e0890f4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:21:49 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-1daefd1a-8c84-4ea8-a135-3031f659e9db req-d637088f-aafb-4eb8-88e2-28ad8f2ed889 service nova] Lock "9de31aa1-6996-4c4a-bd44-fce18e0890f4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:21:49 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-1daefd1a-8c84-4ea8-a135-3031f659e9db req-d637088f-aafb-4eb8-88e2-28ad8f2ed889 service nova] Lock "9de31aa1-6996-4c4a-bd44-fce18e0890f4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:21:49 user nova-compute[75045]: DEBUG nova.compute.manager [req-1daefd1a-8c84-4ea8-a135-3031f659e9db req-d637088f-aafb-4eb8-88e2-28ad8f2ed889 service nova] [instance: 9de31aa1-6996-4c4a-bd44-fce18e0890f4] No waiting events found dispatching network-vif-plugged-e1fd4958-e47c-48f4-aa6f-31066cb3f571 {{(pid=75045) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 23:21:49 user nova-compute[75045]: WARNING nova.compute.manager [req-1daefd1a-8c84-4ea8-a135-3031f659e9db req-d637088f-aafb-4eb8-88e2-28ad8f2ed889 service nova] [instance: 9de31aa1-6996-4c4a-bd44-fce18e0890f4] Received unexpected event network-vif-plugged-e1fd4958-e47c-48f4-aa6f-31066cb3f571 for instance with vm_state building and task_state spawning.
Nov 08 23:21:49 user nova-compute[75045]: DEBUG nova.compute.manager [None req-da465c1e-a2be-4731-905c-e0139ec27a7d tempest-VolumesActionsTest-1040491269 tempest-VolumesActionsTest-1040491269-project-member] [instance: 9de31aa1-6996-4c4a-bd44-fce18e0890f4] Instance event wait completed in 0 seconds for  {{(pid=75045) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 23:21:49 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-da465c1e-a2be-4731-905c-e0139ec27a7d tempest-VolumesActionsTest-1040491269 tempest-VolumesActionsTest-1040491269-project-member] [instance: 9de31aa1-6996-4c4a-bd44-fce18e0890f4] Guest created on hypervisor {{(pid=75045) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 23:21:49 user nova-compute[75045]: INFO nova.virt.libvirt.driver [-] [instance: 9de31aa1-6996-4c4a-bd44-fce18e0890f4] Instance spawned successfully.
Nov 08 23:21:49 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-da465c1e-a2be-4731-905c-e0139ec27a7d tempest-VolumesActionsTest-1040491269 tempest-VolumesActionsTest-1040491269-project-member] [instance: 9de31aa1-6996-4c4a-bd44-fce18e0890f4] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75045) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 23:21:49 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-da465c1e-a2be-4731-905c-e0139ec27a7d tempest-VolumesActionsTest-1040491269 tempest-VolumesActionsTest-1040491269-project-member] [instance: 9de31aa1-6996-4c4a-bd44-fce18e0890f4] Found default for hw_cdrom_bus of ide {{(pid=75045) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 23:21:49 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-da465c1e-a2be-4731-905c-e0139ec27a7d tempest-VolumesActionsTest-1040491269 tempest-VolumesActionsTest-1040491269-project-member] [instance: 9de31aa1-6996-4c4a-bd44-fce18e0890f4] Found default for hw_disk_bus of virtio {{(pid=75045) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 23:21:49 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-da465c1e-a2be-4731-905c-e0139ec27a7d tempest-VolumesActionsTest-1040491269 tempest-VolumesActionsTest-1040491269-project-member] [instance: 9de31aa1-6996-4c4a-bd44-fce18e0890f4] Found default for hw_input_bus of None {{(pid=75045) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 23:21:49 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-da465c1e-a2be-4731-905c-e0139ec27a7d tempest-VolumesActionsTest-1040491269 tempest-VolumesActionsTest-1040491269-project-member] [instance: 9de31aa1-6996-4c4a-bd44-fce18e0890f4] Found default for hw_pointer_model of None {{(pid=75045) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 23:21:49 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-da465c1e-a2be-4731-905c-e0139ec27a7d tempest-VolumesActionsTest-1040491269 tempest-VolumesActionsTest-1040491269-project-member] [instance: 9de31aa1-6996-4c4a-bd44-fce18e0890f4] Found default for hw_video_model of virtio {{(pid=75045) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 23:21:49 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-da465c1e-a2be-4731-905c-e0139ec27a7d tempest-VolumesActionsTest-1040491269 tempest-VolumesActionsTest-1040491269-project-member] [instance: 9de31aa1-6996-4c4a-bd44-fce18e0890f4] Found default for hw_vif_model of virtio {{(pid=75045) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 23:21:49 user nova-compute[75045]: INFO nova.compute.manager [None req-da465c1e-a2be-4731-905c-e0139ec27a7d tempest-VolumesActionsTest-1040491269 tempest-VolumesActionsTest-1040491269-project-member] [instance: 9de31aa1-6996-4c4a-bd44-fce18e0890f4] Took 7.25 seconds to spawn the instance on the hypervisor.
Nov 08 23:21:49 user nova-compute[75045]: DEBUG nova.compute.manager [None req-da465c1e-a2be-4731-905c-e0139ec27a7d tempest-VolumesActionsTest-1040491269 tempest-VolumesActionsTest-1040491269-project-member] [instance: 9de31aa1-6996-4c4a-bd44-fce18e0890f4] Checking state {{(pid=75045) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 23:21:49 user nova-compute[75045]: INFO nova.compute.manager [None req-da465c1e-a2be-4731-905c-e0139ec27a7d tempest-VolumesActionsTest-1040491269 tempest-VolumesActionsTest-1040491269-project-member] [instance: 9de31aa1-6996-4c4a-bd44-fce18e0890f4] Took 8.10 seconds to build instance.
Nov 08 23:21:49 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-da465c1e-a2be-4731-905c-e0139ec27a7d tempest-VolumesActionsTest-1040491269 tempest-VolumesActionsTest-1040491269-project-member] Lock "9de31aa1-6996-4c4a-bd44-fce18e0890f4" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.201s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:21:49 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Lock "9de31aa1-6996-4c4a-bd44-fce18e0890f4" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 1.520s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:21:49 user nova-compute[75045]: INFO nova.compute.manager [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] [instance: 9de31aa1-6996-4c4a-bd44-fce18e0890f4] During sync_power_state the instance has a pending task (spawning). Skip.
Nov 08 23:21:49 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Lock "9de31aa1-6996-4c4a-bd44-fce18e0890f4" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:21:50 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:21:50 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:21:55 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:21:55 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:21:59 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:22:00 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:22:00 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:22:02 user nova-compute[75045]: DEBUG nova.virt.libvirt.volume.iscsi [None req-70b26a86-392c-45f9-a7c8-ebfc1306ca40 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] [instance: 032e20aa-8887-4215-808e-68299a0d8d0b] Calling os-brick to attach iSCSI Volume {{(pid=75045) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 23:22:02 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-70b26a86-392c-45f9-a7c8-ebfc1306ca40 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1b68210460>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:45f1b635-c8a3-4727-a4c7-c2ac441388ff', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SPlwFCBD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75045) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 23:22:02 user nova-compute[75045]: WARNING os_brick.initiator.connectors.base [None req-70b26a86-392c-45f9-a7c8-ebfc1306ca40 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 23:22:02 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-70b26a86-392c-45f9-a7c8-ebfc1306ca40 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 23:22:02 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-70b26a86-392c-45f9-a7c8-ebfc1306ca40 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 23:22:02 user nova-compute[75045]: WARNING os_brick.initiator.connectors.base [None req-70b26a86-392c-45f9-a7c8-ebfc1306ca40 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 23:22:02 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-70b26a86-392c-45f9-a7c8-ebfc1306ca40 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:45f1b635-c8a3-4727-a4c7-c2ac441388ff" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 23:22:02 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-70b26a86-392c-45f9-a7c8-ebfc1306ca40 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:45f1b635-c8a3-4727-a4c7-c2ac441388ff" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 23:22:02 user nova-compute[75045]: INFO os_brick.initiator.connectors.iscsi [None req-70b26a86-392c-45f9-a7c8-ebfc1306ca40 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 23:22:02 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45f1b635-c8a3-4727-a4c7-c2ac441388ff -p 172.16.0.220:3260 {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:22:02 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45f1b635-c8a3-4727-a4c7-c2ac441388ff -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:22:02 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[27bf2985-8202-4c17-904a-bbe5466273ee]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:22:02 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-70b26a86-392c-45f9-a7c8-ebfc1306ca40 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 23:22:02 user nova-compute[75045]:  {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:22:02 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45f1b635-c8a3-4727-a4c7-c2ac441388ff -p 172.16.0.220:3260 --interface default --op new {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:22:02 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45f1b635-c8a3-4727-a4c7-c2ac441388ff -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:22:02 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a96a942-c76d-475c-8a4a-3af70c1eae14]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:45f1b635-c8a3-4727-a4c7-c2ac441388ff] added\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:22:02 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-70b26a86-392c-45f9-a7c8-ebfc1306ca40 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:45f1b635-c8a3-4727-a4c7-c2ac441388ff] added
Nov 08 23:22:02 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:22:02 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45f1b635-c8a3-4727-a4c7-c2ac441388ff -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:22:02 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45f1b635-c8a3-4727-a4c7-c2ac441388ff -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:22:02 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[66a88ed9-e8e0-4910-8f62-794351981ca4]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:22:02 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-70b26a86-392c-45f9-a7c8-ebfc1306ca40 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:22:02 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45f1b635-c8a3-4727-a4c7-c2ac441388ff -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:22:02 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45f1b635-c8a3-4727-a4c7-c2ac441388ff -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:22:02 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[632c555b-5d98-4fee-b774-6e3c39c96eb1]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:22:02 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-70b26a86-392c-45f9-a7c8-ebfc1306ca40 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:22:02 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45f1b635-c8a3-4727-a4c7-c2ac441388ff -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SPlwFCBD {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:22:02 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45f1b635-c8a3-4727-a4c7-c2ac441388ff -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SPlwFCBD" returned: 0 in 0.020s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:22:02 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[614b1f4f-aaa0-409c-9db1-497213475950]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:22:02 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-70b26a86-392c-45f9-a7c8-ebfc1306ca40 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'SPlwFCBD'): stdout= stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:22:02 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45f1b635-c8a3-4727-a4c7-c2ac441388ff -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:22:02 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45f1b635-c8a3-4727-a4c7-c2ac441388ff -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.027s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:22:02 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e4002c9-6c69-4488-b2a9-e31c3b6fc168]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:22:02 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-70b26a86-392c-45f9-a7c8-ebfc1306ca40 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:22:02 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:22:02 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:22:02 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[49a56b93-7855-4199-9b4d-1597cc660ab2]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7f7084f-f0d7-4d4b-9a14-69065a9c3e41 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2068946-d374-45a4-9850-e3a690b13ef4 (non-flash)\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:22:02 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-70b26a86-392c-45f9-a7c8-ebfc1306ca40 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab (non-flash)
Nov 08 23:22:02 user nova-compute[75045]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7f7084f-f0d7-4d4b-9a14-69065a9c3e41 (non-flash)
Nov 08 23:22:02 user nova-compute[75045]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2068946-d374-45a4-9850-e3a690b13ef4 (non-flash)
Nov 08 23:22:02 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 23:22:02 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-70b26a86-392c-45f9-a7c8-ebfc1306ca40 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab (non-flash)
Nov 08 23:22:02 user nova-compute[75045]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7f7084f-f0d7-4d4b-9a14-69065a9c3e41 (non-flash)
Nov 08 23:22:02 user nova-compute[75045]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2068946-d374-45a4-9850-e3a690b13ef4 (non-flash)
Nov 08 23:22:02 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 23:22:02 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45f1b635-c8a3-4727-a4c7-c2ac441388ff -p 172.16.0.220:3260 --login {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:22:02 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45f1b635-c8a3-4727-a4c7-c2ac441388ff -p 172.16.0.220:3260 --login" returned: 0 in 0.079s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:22:02 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[269376ef-5e21-42ef-95a5-6a88f95af914]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:45f1b635-c8a3-4727-a4c7-c2ac441388ff, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:45f1b635-c8a3-4727-a4c7-c2ac441388ff, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:22:02 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-70b26a86-392c-45f9-a7c8-ebfc1306ca40 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:45f1b635-c8a3-4727-a4c7-c2ac441388ff, portal: 172.16.0.220,3260]
Nov 08 23:22:02 user nova-compute[75045]: Login to [iface: default, target: iqn.2010-10.org.openstack:45f1b635-c8a3-4727-a4c7-c2ac441388ff, portal: 172.16.0.220,3260] successful.
Nov 08 23:22:02 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:22:02 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45f1b635-c8a3-4727-a4c7-c2ac441388ff -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:22:02 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45f1b635-c8a3-4727-a4c7-c2ac441388ff -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:22:02 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[074d14bd-c6be-417f-8b0c-8d07ec309f6f]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:22:02 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-70b26a86-392c-45f9-a7c8-ebfc1306ca40 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:22:02 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:22:02 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:22:02 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3995b4b-7cfa-4f05-98f4-98cec6cddbb3]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7f7084f-f0d7-4d4b-9a14-69065a9c3e41 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2068946-d374-45a4-9850-e3a690b13ef4 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45f1b635-c8a3-4727-a4c7-c2ac441388ff (non-flash)\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:22:02 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-70b26a86-392c-45f9-a7c8-ebfc1306ca40 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab (non-flash)
Nov 08 23:22:02 user nova-compute[75045]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7f7084f-f0d7-4d4b-9a14-69065a9c3e41 (non-flash)
Nov 08 23:22:02 user nova-compute[75045]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2068946-d374-45a4-9850-e3a690b13ef4 (non-flash)
Nov 08 23:22:02 user nova-compute[75045]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45f1b635-c8a3-4727-a4c7-c2ac441388ff (non-flash)
Nov 08 23:22:02 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 23:22:02 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-70b26a86-392c-45f9-a7c8-ebfc1306ca40 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab (non-flash)
Nov 08 23:22:02 user nova-compute[75045]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7f7084f-f0d7-4d4b-9a14-69065a9c3e41 (non-flash)
Nov 08 23:22:02 user nova-compute[75045]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2068946-d374-45a4-9850-e3a690b13ef4 (non-flash)
Nov 08 23:22:02 user nova-compute[75045]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45f1b635-c8a3-4727-a4c7-c2ac441388ff (non-flash)
Nov 08 23:22:02 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 23:22:02 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-70b26a86-392c-45f9-a7c8-ebfc1306ca40 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:45f1b635-c8a3-4727-a4c7-c2ac441388ff" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.342s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 23:22:02 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-70b26a86-392c-45f9-a7c8-ebfc1306ca40 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Connected to 172.16.0.220:3260 {{(pid=75045) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 23:22:02 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-70b26a86-392c-45f9-a7c8-ebfc1306ca40 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] HCTL ('34', '-', '-', 0) found on session 15 with lun 0 {{(pid=75045) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 23:22:02 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-70b26a86-392c-45f9-a7c8-ebfc1306ca40 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75045) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 23:22:02 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:22:02 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.031s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:22:02 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4731b26-d20c-454e-b2a4-84d5b5041170]: (4, ('- - 0', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:22:02 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-70b26a86-392c-45f9-a7c8-ebfc1306ca40 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Searching for a device in session 15 and hctl ['34', '*', '*', 0] yield: None {{(pid=75045) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 23:22:03 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:22:03 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-70b26a86-392c-45f9-a7c8-ebfc1306ca40 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Searching for a device in session 15 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75045) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 23:22:03 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-70b26a86-392c-45f9-a7c8-ebfc1306ca40 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:45f1b635-c8a3-4727-a4c7-c2ac441388ff', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SPlwFCBD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75045) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 23:22:03 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-70b26a86-392c-45f9-a7c8-ebfc1306ca40 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.388s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 23:22:03 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-70b26a86-392c-45f9-a7c8-ebfc1306ca40 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] <== connect_volume: return (1390ms) {'type': 'block', 'scsi_wwn': '23132653939646233', 'path': '/dev/sdc'} {{(pid=75045) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 23:22:03 user nova-compute[75045]: DEBUG nova.virt.libvirt.volume.iscsi [None req-70b26a86-392c-45f9-a7c8-ebfc1306ca40 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] [instance: 032e20aa-8887-4215-808e-68299a0d8d0b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23132653939646233', 'path': '/dev/sdc'} {{(pid=75045) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 23:22:03 user nova-compute[75045]: DEBUG nova.objects.instance [None req-70b26a86-392c-45f9-a7c8-ebfc1306ca40 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Lazy-loading 'flavor' on Instance uuid 032e20aa-8887-4215-808e-68299a0d8d0b {{(pid=75045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 23:22:04 user nova-compute[75045]: DEBUG nova.virt.libvirt.guest [None req-70b26a86-392c-45f9-a7c8-ebfc1306ca40 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] attach device xml: <disk type="block" device="disk">
Nov 08 23:22:04 user nova-compute[75045]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 23:22:04 user nova-compute[75045]:   <source dev="/dev/sdc"/>
Nov 08 23:22:04 user nova-compute[75045]:   <target dev="vdb" bus="virtio"/>
Nov 08 23:22:04 user nova-compute[75045]:   <serial>45f1b635-c8a3-4727-a4c7-c2ac441388ff</serial>
Nov 08 23:22:04 user nova-compute[75045]: </disk>
Nov 08 23:22:04 user nova-compute[75045]:  {{(pid=75045) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 08 23:22:04 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-70b26a86-392c-45f9-a7c8-ebfc1306ca40 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] No BDM found with device name vda, not building metadata. {{(pid=75045) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 23:22:04 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-70b26a86-392c-45f9-a7c8-ebfc1306ca40 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75045) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 23:22:04 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-70b26a86-392c-45f9-a7c8-ebfc1306ca40 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] No VIF found with MAC fa:16:3e:df:66:51, not building metadata {{(pid=75045) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 23:22:04 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-70b26a86-392c-45f9-a7c8-ebfc1306ca40 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Lock "032e20aa-8887-4215-808e-68299a0d8d0b" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 31.650s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:22:04 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Lock "032e20aa-8887-4215-808e-68299a0d8d0b" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 16.446s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:22:04 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Lock "032e20aa-8887-4215-808e-68299a0d8d0b" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.042s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:22:05 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:22:05 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:22:06 user nova-compute[75045]: INFO nova.compute.manager [None req-66576810-7ef0-4d4a-ac8d-372aab6bc9bb tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] [instance: 032e20aa-8887-4215-808e-68299a0d8d0b] Rebuilding instance
Nov 08 23:22:06 user nova-compute[75045]: DEBUG nova.compute.manager [None req-66576810-7ef0-4d4a-ac8d-372aab6bc9bb tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] [instance: 032e20aa-8887-4215-808e-68299a0d8d0b] Checking state {{(pid=75045) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 23:22:06 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:22:06 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:22:06 user nova-compute[75045]: DEBUG nova.compute.manager [req-a87a77d0-e96a-435f-a7bc-7447aadcb85b req-ef19730c-4648-4dc5-afe2-834a2d58f5bc service nova] [instance: 032e20aa-8887-4215-808e-68299a0d8d0b] Received event network-vif-unplugged-9cd2b9ae-f99a-4f33-8b8b-e2013d3c05e6 {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:22:06 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-a87a77d0-e96a-435f-a7bc-7447aadcb85b req-ef19730c-4648-4dc5-afe2-834a2d58f5bc service nova] Acquiring lock "032e20aa-8887-4215-808e-68299a0d8d0b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:22:06 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-a87a77d0-e96a-435f-a7bc-7447aadcb85b req-ef19730c-4648-4dc5-afe2-834a2d58f5bc service nova] Lock "032e20aa-8887-4215-808e-68299a0d8d0b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:22:06 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-a87a77d0-e96a-435f-a7bc-7447aadcb85b req-ef19730c-4648-4dc5-afe2-834a2d58f5bc service nova] Lock "032e20aa-8887-4215-808e-68299a0d8d0b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:22:06 user nova-compute[75045]: DEBUG nova.compute.manager [req-a87a77d0-e96a-435f-a7bc-7447aadcb85b req-ef19730c-4648-4dc5-afe2-834a2d58f5bc service nova] [instance: 032e20aa-8887-4215-808e-68299a0d8d0b] No waiting events found dispatching network-vif-unplugged-9cd2b9ae-f99a-4f33-8b8b-e2013d3c05e6 {{(pid=75045) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 23:22:06 user nova-compute[75045]: WARNING nova.compute.manager [req-a87a77d0-e96a-435f-a7bc-7447aadcb85b req-ef19730c-4648-4dc5-afe2-834a2d58f5bc service nova] [instance: 032e20aa-8887-4215-808e-68299a0d8d0b] Received unexpected event network-vif-unplugged-9cd2b9ae-f99a-4f33-8b8b-e2013d3c05e6 for instance with vm_state active and task_state rebuilding.
Nov 08 23:22:06 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:22:06 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:22:07 user nova-compute[75045]: INFO nova.virt.libvirt.driver [-] [instance: 032e20aa-8887-4215-808e-68299a0d8d0b] Instance destroyed successfully.
Nov 08 23:22:07 user nova-compute[75045]: INFO nova.compute.manager [None req-66576810-7ef0-4d4a-ac8d-372aab6bc9bb tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] [instance: 032e20aa-8887-4215-808e-68299a0d8d0b] Detaching volume 45f1b635-c8a3-4727-a4c7-c2ac441388ff
Nov 08 23:22:07 user nova-compute[75045]: INFO nova.virt.block_device [None req-66576810-7ef0-4d4a-ac8d-372aab6bc9bb tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] [instance: 032e20aa-8887-4215-808e-68299a0d8d0b] Attempting to driver detach volume 45f1b635-c8a3-4727-a4c7-c2ac441388ff from mountpoint /dev/vdb
Nov 08 23:22:07 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-66576810-7ef0-4d4a-ac8d-372aab6bc9bb tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Attempting to detach device vdb from instance 032e20aa-8887-4215-808e-68299a0d8d0b from the persistent domain config. {{(pid=75045) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 08 23:22:07 user nova-compute[75045]: DEBUG nova.virt.libvirt.guest [None req-66576810-7ef0-4d4a-ac8d-372aab6bc9bb tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 23:22:07 user nova-compute[75045]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 23:22:07 user nova-compute[75045]:   <source dev="/dev/sdc"/>
Nov 08 23:22:07 user nova-compute[75045]:   <target dev="vdb" bus="virtio"/>
Nov 08 23:22:07 user nova-compute[75045]:   <serial>45f1b635-c8a3-4727-a4c7-c2ac441388ff</serial>
Nov 08 23:22:07 user nova-compute[75045]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 08 23:22:07 user nova-compute[75045]: </disk>
Nov 08 23:22:07 user nova-compute[75045]:  {{(pid=75045) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 23:22:07 user nova-compute[75045]: INFO nova.virt.libvirt.driver [None req-66576810-7ef0-4d4a-ac8d-372aab6bc9bb tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Successfully detached device vdb from instance 032e20aa-8887-4215-808e-68299a0d8d0b from the persistent domain config.
Nov 08 23:22:07 user nova-compute[75045]: DEBUG nova.virt.libvirt.volume.iscsi [None req-66576810-7ef0-4d4a-ac8d-372aab6bc9bb tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] [instance: 032e20aa-8887-4215-808e-68299a0d8d0b] calling os-brick to detach iSCSI Volume {{(pid=75045) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 23:22:07 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-66576810-7ef0-4d4a-ac8d-372aab6bc9bb tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1b68210460>, {'target_iqn': 'iqn.2010-10.org.openstack:45f1b635-c8a3-4727-a4c7-c2ac441388ff', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SPlwFCBD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75045) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 23:22:07 user nova-compute[75045]: WARNING os_brick.initiator.connectors.base [None req-66576810-7ef0-4d4a-ac8d-372aab6bc9bb tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 08 23:22:07 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-66576810-7ef0-4d4a-ac8d-372aab6bc9bb tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 23:22:07 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-66576810-7ef0-4d4a-ac8d-372aab6bc9bb tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 23:22:07 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:22:07 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.028s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:22:07 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[34855ca4-da05-4f8e-9e33-5e24e568c84b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:45f1b635-c8a3-4727-a4c7-c2ac441388ff\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c7f7084f-f0d7-4d4b-9a14-69065a9c3e41\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d2068946-d374-45a4-9850-e3a690b13ef4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:22:07 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-66576810-7ef0-4d4a-ac8d-372aab6bc9bb tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 23:22:07 user nova-compute[75045]: No targets found.
Nov 08 23:22:07 user nova-compute[75045]: iSNS:
Nov 08 23:22:07 user nova-compute[75045]: No targets found.
Nov 08 23:22:07 user nova-compute[75045]: STATIC:
Nov 08 23:22:07 user nova-compute[75045]: Target: iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab
Nov 08 23:22:07 user nova-compute[75045]:         Portal: 172.16.0.220:3260,-1
Nov 08 23:22:07 user nova-compute[75045]:                 Iface Name: default
Nov 08 23:22:07 user nova-compute[75045]: Target: iqn.2010-10.org.openstack:45f1b635-c8a3-4727-a4c7-c2ac441388ff
Nov 08 23:22:07 user nova-compute[75045]:         Portal: 172.16.0.220:3260,-1
Nov 08 23:22:07 user nova-compute[75045]:                 Iface Name: default
Nov 08 23:22:07 user nova-compute[75045]: Target: iqn.2010-10.org.openstack:c7f7084f-f0d7-4d4b-9a14-69065a9c3e41
Nov 08 23:22:07 user nova-compute[75045]:         Portal: 172.16.0.220:3260,-1
Nov 08 23:22:07 user nova-compute[75045]:                 Iface Name: default
Nov 08 23:22:07 user nova-compute[75045]: Target: iqn.2010-10.org.openstack:d2068946-d374-45a4-9850-e3a690b13ef4
Nov 08 23:22:07 user nova-compute[75045]:         Portal: 172.16.0.220:3260,-1
Nov 08 23:22:07 user nova-compute[75045]:                 Iface Name: default
Nov 08 23:22:07 user nova-compute[75045]: FIRMWARE:
Nov 08 23:22:07 user nova-compute[75045]: No targets found.
Nov 08 23:22:07 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 23:22:07 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-66576810-7ef0-4d4a-ac8d-372aab6bc9bb tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 23:22:07 user nova-compute[75045]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 23:22:07 user nova-compute[75045]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75045) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 23:22:07 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-66576810-7ef0-4d4a-ac8d-372aab6bc9bb tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:45f1b635-c8a3-4727-a4c7-c2ac441388ff', 0)] {{(pid=75045) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 23:22:07 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:22:07 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:22:07 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e03d5bc-202d-4743-a21d-857493d39ec8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:45f1b635-c8a3-4727-a4c7-c2ac441388ff\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c7f7084f-f0d7-4d4b-9a14-69065a9c3e41\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d2068946-d374-45a4-9850-e3a690b13ef4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:22:07 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:22:07 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:22:07 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[2432b3c7-8f65-405a-b12d-6a6f89ed37bf]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7f7084f-f0d7-4d4b-9a14-69065a9c3e41 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2068946-d374-45a4-9850-e3a690b13ef4 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45f1b635-c8a3-4727-a4c7-c2ac441388ff (non-flash)\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:22:07 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-66576810-7ef0-4d4a-ac8d-372aab6bc9bb tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab (non-flash)
Nov 08 23:22:07 user nova-compute[75045]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7f7084f-f0d7-4d4b-9a14-69065a9c3e41 (non-flash)
Nov 08 23:22:07 user nova-compute[75045]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2068946-d374-45a4-9850-e3a690b13ef4 (non-flash)
Nov 08 23:22:07 user nova-compute[75045]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45f1b635-c8a3-4727-a4c7-c2ac441388ff (non-flash)
Nov 08 23:22:07 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 23:22:07 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-66576810-7ef0-4d4a-ac8d-372aab6bc9bb tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab (non-flash)
Nov 08 23:22:07 user nova-compute[75045]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7f7084f-f0d7-4d4b-9a14-69065a9c3e41 (non-flash)
Nov 08 23:22:07 user nova-compute[75045]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2068946-d374-45a4-9850-e3a690b13ef4 (non-flash)
Nov 08 23:22:07 user nova-compute[75045]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45f1b635-c8a3-4727-a4c7-c2ac441388ff (non-flash)
Nov 08 23:22:07 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 23:22:07 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-66576810-7ef0-4d4a-ac8d-372aab6bc9bb tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1b48421870>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:45f1b635-c8a3-4727-a4c7-c2ac441388ff'): ({'sdc'}, set())}) {{(pid=75045) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 23:22:07 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-66576810-7ef0-4d4a-ac8d-372aab6bc9bb tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Removing single pathed devices sdc {{(pid=75045) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 23:22:07 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:22:07 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:22:07 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d482f2e-d424-40da-9486-79d9e2c1a73b]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:22:07 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:22:07 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.027s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:22:07 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b336de1-f40d-441a-bf44-6b69f210258e]: (4, ('ok\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:22:07 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-66576810-7ef0-4d4a-ac8d-372aab6bc9bb tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Flushing IO for device /dev/sdc {{(pid=75045) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 23:22:07 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:22:07 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.016s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:22:07 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[00c4f4ab-bb9b-4bfe-831a-b2a804fc5f95]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:22:07 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-66576810-7ef0-4d4a-ac8d-372aab6bc9bb tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75045) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 23:22:07 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:22:07 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.044s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:22:07 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[67da574a-b87b-4a8a-ab62-6ea29930e28c]: (4, ('1', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:22:07 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-66576810-7ef0-4d4a-ac8d-372aab6bc9bb tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75045) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 23:22:07 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-66576810-7ef0-4d4a-ac8d-372aab6bc9bb tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] SCSI volumes sdc have been removed. {{(pid=75045) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 23:22:07 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-66576810-7ef0-4d4a-ac8d-372aab6bc9bb tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:45f1b635-c8a3-4727-a4c7-c2ac441388ff')] {{(pid=75045) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 23:22:07 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45f1b635-c8a3-4727-a4c7-c2ac441388ff -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:22:07 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45f1b635-c8a3-4727-a4c7-c2ac441388ff -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:22:07 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[6164fad2-9c3d-4684-9399-ac7b412551d0]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:22:07 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-66576810-7ef0-4d4a-ac8d-372aab6bc9bb tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:22:07 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45f1b635-c8a3-4727-a4c7-c2ac441388ff -p 172.16.0.220:3260 --logout {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:22:07 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45f1b635-c8a3-4727-a4c7-c2ac441388ff -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:22:07 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[a007a7e9-61de-4ddb-ac4e-2cef48082373]: (4, ('Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:45f1b635-c8a3-4727-a4c7-c2ac441388ff, portal: 172.16.0.220,3260]\nLogout of [sid: 15, target: iqn.2010-10.org.openstack:45f1b635-c8a3-4727-a4c7-c2ac441388ff, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:22:07 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-66576810-7ef0-4d4a-ac8d-372aab6bc9bb tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:45f1b635-c8a3-4727-a4c7-c2ac441388ff, portal: 172.16.0.220,3260]
Nov 08 23:22:07 user nova-compute[75045]: Logout of [sid: 15, target: iqn.2010-10.org.openstack:45f1b635-c8a3-4727-a4c7-c2ac441388ff, portal: 172.16.0.220,3260] successful.
Nov 08 23:22:07 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:22:07 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45f1b635-c8a3-4727-a4c7-c2ac441388ff -p 172.16.0.220:3260 --op delete {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:22:07 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45f1b635-c8a3-4727-a4c7-c2ac441388ff -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:22:07 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[36899f39-5c77-43e0-9c8b-31a1671817e1]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:22:07 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-66576810-7ef0-4d4a-ac8d-372aab6bc9bb tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:22:07 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-66576810-7ef0-4d4a-ac8d-372aab6bc9bb tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.353s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 23:22:07 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-66576810-7ef0-4d4a-ac8d-372aab6bc9bb tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] <== disconnect_volume: return (355ms) None {{(pid=75045) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 23:22:07 user nova-compute[75045]: DEBUG nova.virt.libvirt.volume.iscsi [None req-66576810-7ef0-4d4a-ac8d-372aab6bc9bb tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] [instance: 032e20aa-8887-4215-808e-68299a0d8d0b] Disconnected iSCSI Volume {{(pid=75045) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 23:22:08 user nova-compute[75045]: DEBUG nova.compute.manager [req-1abbb80e-4c5a-4197-9a3b-4963c59214b4 req-c23c23db-df5a-45ac-b45d-6710d1f6a59c service nova] [instance: 032e20aa-8887-4215-808e-68299a0d8d0b] Received event network-vif-plugged-9cd2b9ae-f99a-4f33-8b8b-e2013d3c05e6 {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:22:08 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-1abbb80e-4c5a-4197-9a3b-4963c59214b4 req-c23c23db-df5a-45ac-b45d-6710d1f6a59c service nova] Acquiring lock "032e20aa-8887-4215-808e-68299a0d8d0b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:22:08 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-1abbb80e-4c5a-4197-9a3b-4963c59214b4 req-c23c23db-df5a-45ac-b45d-6710d1f6a59c service nova] Lock "032e20aa-8887-4215-808e-68299a0d8d0b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:22:08 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-1abbb80e-4c5a-4197-9a3b-4963c59214b4 req-c23c23db-df5a-45ac-b45d-6710d1f6a59c service nova] Lock "032e20aa-8887-4215-808e-68299a0d8d0b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:22:08 user nova-compute[75045]: DEBUG nova.compute.manager [req-1abbb80e-4c5a-4197-9a3b-4963c59214b4 req-c23c23db-df5a-45ac-b45d-6710d1f6a59c service nova] [instance: 032e20aa-8887-4215-808e-68299a0d8d0b] No waiting events found dispatching network-vif-plugged-9cd2b9ae-f99a-4f33-8b8b-e2013d3c05e6 {{(pid=75045) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 23:22:08 user nova-compute[75045]: WARNING nova.compute.manager [req-1abbb80e-4c5a-4197-9a3b-4963c59214b4 req-c23c23db-df5a-45ac-b45d-6710d1f6a59c service nova] [instance: 032e20aa-8887-4215-808e-68299a0d8d0b] Received unexpected event network-vif-plugged-9cd2b9ae-f99a-4f33-8b8b-e2013d3c05e6 for instance with vm_state active and task_state rebuilding.
Nov 08 23:22:08 user nova-compute[75045]: INFO nova.virt.libvirt.driver [-] [instance: 032e20aa-8887-4215-808e-68299a0d8d0b] Instance destroyed successfully.
Nov 08 23:22:08 user nova-compute[75045]: DEBUG nova.virt.libvirt.vif [None req-66576810-7ef0-4d4a-ac8d-372aab6bc9bb tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T23:19:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1752899834',display_name='tempest-ServerActionsTestOtherA-server-1825293127',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1752899834',id=14,image_ref='a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM+q2m9WsZpZxsu7IWDJqTSDAyt9zen9gZBXmCH3tBzXyeyKdTBcMPy8pYQxPGeGnPRc+jFEID8sOJopOMmrv8cAChFAOof4/DA6j4PlbpQ3YcCnU4/0PdUKZbkLWBt7Jg==',key_name='tempest-keypair-1151386852',keypairs=<?>,launch_index=0,launched_at=2023-11-08T23:19:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='e63623113f11463d9035bb990de43510',ramdisk_id='',reservation_id='r-vxqzthcz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-2056815713',owner_user_name='tempest-ServerActionsTestOtherA-2056815713-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T23:22:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='75fc508f268d4a569ad78598ff019c14',uuid=032e20aa-8887-4215-808e-68299a0d8d0b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9cd2b9ae-f99a-4f33-8b8b-e2013d3c05e6", "address": "fa:16:3e:df:66:51", "network": {"id": "700b5784-d35b-45c0-a4d3-1ab8aa4c48aa", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-194469807-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.181", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e63623113f11463d9035bb990de43510", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9cd2b9ae-f9", "ovs_interfaceid": "9cd2b9ae-f99a-4f33-8b8b-e2013d3c05e6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75045) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 23:22:08 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-66576810-7ef0-4d4a-ac8d-372aab6bc9bb tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Converting VIF {"id": "9cd2b9ae-f99a-4f33-8b8b-e2013d3c05e6", "address": "fa:16:3e:df:66:51", "network": {"id": "700b5784-d35b-45c0-a4d3-1ab8aa4c48aa", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-194469807-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.181", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e63623113f11463d9035bb990de43510", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9cd2b9ae-f9", "ovs_interfaceid": "9cd2b9ae-f99a-4f33-8b8b-e2013d3c05e6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 23:22:08 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-66576810-7ef0-4d4a-ac8d-372aab6bc9bb tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:df:66:51,bridge_name='br-int',has_traffic_filtering=True,id=9cd2b9ae-f99a-4f33-8b8b-e2013d3c05e6,network=Network(700b5784-d35b-45c0-a4d3-1ab8aa4c48aa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9cd2b9ae-f9') {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 23:22:08 user nova-compute[75045]: DEBUG os_vif [None req-66576810-7ef0-4d4a-ac8d-372aab6bc9bb tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:df:66:51,bridge_name='br-int',has_traffic_filtering=True,id=9cd2b9ae-f99a-4f33-8b8b-e2013d3c05e6,network=Network(700b5784-d35b-45c0-a4d3-1ab8aa4c48aa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9cd2b9ae-f9') {{(pid=75045) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 23:22:08 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:22:08 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9cd2b9ae-f9, bridge=br-int, if_exists=True) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:22:08 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:22:08 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 23:22:08 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:22:08 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=bb55dbcd-bee4-4825-b793-de14cf5c4f3e) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:22:08 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:22:08 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 23:22:08 user nova-compute[75045]: INFO os_vif [None req-66576810-7ef0-4d4a-ac8d-372aab6bc9bb tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:df:66:51,bridge_name='br-int',has_traffic_filtering=True,id=9cd2b9ae-f99a-4f33-8b8b-e2013d3c05e6,network=Network(700b5784-d35b-45c0-a4d3-1ab8aa4c48aa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9cd2b9ae-f9')
Nov 08 23:22:08 user nova-compute[75045]: DEBUG nova.virt.libvirt.volume.iscsi [None req-66576810-7ef0-4d4a-ac8d-372aab6bc9bb tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] [instance: 032e20aa-8887-4215-808e-68299a0d8d0b] calling os-brick to detach iSCSI Volume {{(pid=75045) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 23:22:08 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-66576810-7ef0-4d4a-ac8d-372aab6bc9bb tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1b68210460>, {'target_iqn': 'iqn.2010-10.org.openstack:45f1b635-c8a3-4727-a4c7-c2ac441388ff', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SPlwFCBD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75045) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 23:22:08 user nova-compute[75045]: WARNING os_brick.initiator.connectors.base [None req-66576810-7ef0-4d4a-ac8d-372aab6bc9bb tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 08 23:22:08 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-66576810-7ef0-4d4a-ac8d-372aab6bc9bb tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 23:22:08 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-66576810-7ef0-4d4a-ac8d-372aab6bc9bb tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 23:22:08 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:22:08 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:22:08 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b1ac010-69a4-4a31-b631-f95e063b6336]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c7f7084f-f0d7-4d4b-9a14-69065a9c3e41\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d2068946-d374-45a4-9850-e3a690b13ef4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:22:08 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-66576810-7ef0-4d4a-ac8d-372aab6bc9bb tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 23:22:08 user nova-compute[75045]: No targets found.
Nov 08 23:22:08 user nova-compute[75045]: iSNS:
Nov 08 23:22:08 user nova-compute[75045]: No targets found.
Nov 08 23:22:08 user nova-compute[75045]: STATIC:
Nov 08 23:22:08 user nova-compute[75045]: Target: iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab
Nov 08 23:22:08 user nova-compute[75045]:         Portal: 172.16.0.220:3260,-1
Nov 08 23:22:08 user nova-compute[75045]:                 Iface Name: default
Nov 08 23:22:08 user nova-compute[75045]: Target: iqn.2010-10.org.openstack:c7f7084f-f0d7-4d4b-9a14-69065a9c3e41
Nov 08 23:22:08 user nova-compute[75045]:         Portal: 172.16.0.220:3260,-1
Nov 08 23:22:08 user nova-compute[75045]:                 Iface Name: default
Nov 08 23:22:08 user nova-compute[75045]: Target: iqn.2010-10.org.openstack:d2068946-d374-45a4-9850-e3a690b13ef4
Nov 08 23:22:08 user nova-compute[75045]:         Portal: 172.16.0.220:3260,-1
Nov 08 23:22:08 user nova-compute[75045]:                 Iface Name: default
Nov 08 23:22:08 user nova-compute[75045]: FIRMWARE:
Nov 08 23:22:08 user nova-compute[75045]: No targets found.
Nov 08 23:22:08 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 23:22:08 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-66576810-7ef0-4d4a-ac8d-372aab6bc9bb tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 23:22:08 user nova-compute[75045]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 23:22:08 user nova-compute[75045]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75045) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 23:22:08 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-66576810-7ef0-4d4a-ac8d-372aab6bc9bb tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:45f1b635-c8a3-4727-a4c7-c2ac441388ff', 0)] {{(pid=75045) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 23:22:08 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:22:08 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:22:08 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[5203fd07-e123-4b1f-8b14-912fa2164a3c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c7f7084f-f0d7-4d4b-9a14-69065a9c3e41\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d2068946-d374-45a4-9850-e3a690b13ef4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:22:08 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:22:08 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:22:08 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3d1b510-800e-4ada-b4f1-ca68807aac3d]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7f7084f-f0d7-4d4b-9a14-69065a9c3e41 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2068946-d374-45a4-9850-e3a690b13ef4 (non-flash)\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:22:08 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-66576810-7ef0-4d4a-ac8d-372aab6bc9bb tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab (non-flash)
Nov 08 23:22:08 user nova-compute[75045]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7f7084f-f0d7-4d4b-9a14-69065a9c3e41 (non-flash)
Nov 08 23:22:08 user nova-compute[75045]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2068946-d374-45a4-9850-e3a690b13ef4 (non-flash)
Nov 08 23:22:08 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 23:22:08 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-66576810-7ef0-4d4a-ac8d-372aab6bc9bb tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab (non-flash)
Nov 08 23:22:08 user nova-compute[75045]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7f7084f-f0d7-4d4b-9a14-69065a9c3e41 (non-flash)
Nov 08 23:22:08 user nova-compute[75045]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2068946-d374-45a4-9850-e3a690b13ef4 (non-flash)
Nov 08 23:22:08 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 23:22:08 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-66576810-7ef0-4d4a-ac8d-372aab6bc9bb tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1b48422200>, {}) {{(pid=75045) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 23:22:08 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-66576810-7ef0-4d4a-ac8d-372aab6bc9bb tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Disconnecting from: [] {{(pid=75045) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 23:22:08 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-66576810-7ef0-4d4a-ac8d-372aab6bc9bb tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.073s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 23:22:08 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-66576810-7ef0-4d4a-ac8d-372aab6bc9bb tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] <== disconnect_volume: return (76ms) None {{(pid=75045) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 23:22:08 user nova-compute[75045]: DEBUG nova.virt.libvirt.volume.iscsi [None req-66576810-7ef0-4d4a-ac8d-372aab6bc9bb tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] [instance: 032e20aa-8887-4215-808e-68299a0d8d0b] Disconnected iSCSI Volume {{(pid=75045) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 23:22:08 user nova-compute[75045]: INFO nova.virt.libvirt.driver [None req-66576810-7ef0-4d4a-ac8d-372aab6bc9bb tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] [instance: 032e20aa-8887-4215-808e-68299a0d8d0b] Deleting instance files /opt/stack/data/nova/instances/032e20aa-8887-4215-808e-68299a0d8d0b_del
Nov 08 23:22:08 user nova-compute[75045]: INFO nova.virt.libvirt.driver [None req-66576810-7ef0-4d4a-ac8d-372aab6bc9bb tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] [instance: 032e20aa-8887-4215-808e-68299a0d8d0b] Deletion of /opt/stack/data/nova/instances/032e20aa-8887-4215-808e-68299a0d8d0b_del complete
Nov 08 23:22:09 user nova-compute[75045]: INFO nova.virt.block_device [None req-66576810-7ef0-4d4a-ac8d-372aab6bc9bb tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] [instance: 032e20aa-8887-4215-808e-68299a0d8d0b] Booting with volume 45f1b635-c8a3-4727-a4c7-c2ac441388ff at /dev/vdb
Nov 08 23:22:09 user nova-compute[75045]: DEBUG os_brick.utils [None req-66576810-7ef0-4d4a-ac8d-372aab6bc9bb tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75045) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 23:22:09 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:22:09 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:22:09 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2a53e6d-c64b-4646-bc7b-9d918d6e1459]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6217bd6e884\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:22:09 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:22:09 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:22:09 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c83c319-3a51-434d-acc8-f820c87f9684]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:22:09 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:22:09 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:22:09 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d18d615-b67d-4123-bed3-034aa95cd38a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:22:09 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[42f64f8c-604c-42a7-9160-fd73225ac1cc]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:22:09 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-66576810-7ef0-4d4a-ac8d-372aab6bc9bb tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Running cmd (subprocess): nvme version {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:22:09 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-66576810-7ef0-4d4a-ac8d-372aab6bc9bb tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] 'nvme version' failed. Not Retrying. {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 23:22:09 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.nvmeof [None req-66576810-7ef0-4d4a-ac8d-372aab6bc9bb tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] nvme not present on system {{(pid=75045) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 23:22:09 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:22:09 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 23:22:09 user nova-compute[75045]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 23:22:09 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[efbf85f4-9423-4bdf-bddd-0e9fbb82165a]: (4, '') {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:22:09 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.lightos [None req-66576810-7ef0-4d4a-ac8d-372aab6bc9bb tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75045) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 23:22:09 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.lightos [None req-66576810-7ef0-4d4a-ac8d-372aab6bc9bb tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75045) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 23:22:09 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.lightos [None req-66576810-7ef0-4d4a-ac8d-372aab6bc9bb tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] LIGHTOS: no hostnqn found. {{(pid=75045) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 23:22:09 user nova-compute[75045]: DEBUG os_brick.utils [None req-66576810-7ef0-4d4a-ac8d-372aab6bc9bb tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6217bd6e884', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75045) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 23:22:09 user nova-compute[75045]: DEBUG nova.virt.block_device [None req-66576810-7ef0-4d4a-ac8d-372aab6bc9bb tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] [instance: 032e20aa-8887-4215-808e-68299a0d8d0b] Updating existing volume attachment record: 5c8de9dd-6d29-453e-b63d-0870a5043cfd {{(pid=75045) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 23:22:10 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:22:11 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:22:13 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:22:13 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:22:15 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:22:15 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:22:18 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:22:19 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:22:20 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:22:20 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:22:22 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:22:23 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:22:25 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:22:26 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-a58321b1-eeae-4836-a5ba-ffb0289e387c tempest-TestServerVolumeAttachmentScenario-1899063447 tempest-TestServerVolumeAttachmentScenario-1899063447-project-member] Acquiring lock "25cd59d1-6884-471a-813e-52e97c2e1208" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:22:26 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-a58321b1-eeae-4836-a5ba-ffb0289e387c tempest-TestServerVolumeAttachmentScenario-1899063447 tempest-TestServerVolumeAttachmentScenario-1899063447-project-member] Lock "25cd59d1-6884-471a-813e-52e97c2e1208" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:22:26 user nova-compute[75045]: DEBUG nova.compute.manager [None req-a58321b1-eeae-4836-a5ba-ffb0289e387c tempest-TestServerVolumeAttachmentScenario-1899063447 tempest-TestServerVolumeAttachmentScenario-1899063447-project-member] [instance: 25cd59d1-6884-471a-813e-52e97c2e1208] Starting instance... {{(pid=75045) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 23:22:26 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-a58321b1-eeae-4836-a5ba-ffb0289e387c tempest-TestServerVolumeAttachmentScenario-1899063447 tempest-TestServerVolumeAttachmentScenario-1899063447-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:22:26 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-a58321b1-eeae-4836-a5ba-ffb0289e387c tempest-TestServerVolumeAttachmentScenario-1899063447 tempest-TestServerVolumeAttachmentScenario-1899063447-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:22:26 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-a58321b1-eeae-4836-a5ba-ffb0289e387c tempest-TestServerVolumeAttachmentScenario-1899063447 tempest-TestServerVolumeAttachmentScenario-1899063447-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75045) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 23:22:26 user nova-compute[75045]: INFO nova.compute.claims [None req-a58321b1-eeae-4836-a5ba-ffb0289e387c tempest-TestServerVolumeAttachmentScenario-1899063447 tempest-TestServerVolumeAttachmentScenario-1899063447-project-member] [instance: 25cd59d1-6884-471a-813e-52e97c2e1208] Claim successful on node user
Nov 08 23:22:27 user nova-compute[75045]: DEBUG nova.compute.provider_tree [None req-a58321b1-eeae-4836-a5ba-ffb0289e387c tempest-TestServerVolumeAttachmentScenario-1899063447 tempest-TestServerVolumeAttachmentScenario-1899063447-project-member] Inventory has not changed in ProviderTree for provider: 62ba5f85-c74d-4b58-986e-d4197e813fd7 {{(pid=75045) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 23:22:27 user nova-compute[75045]: DEBUG nova.scheduler.client.report [None req-a58321b1-eeae-4836-a5ba-ffb0289e387c tempest-TestServerVolumeAttachmentScenario-1899063447 tempest-TestServerVolumeAttachmentScenario-1899063447-project-member] Inventory has not changed for provider 62ba5f85-c74d-4b58-986e-d4197e813fd7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75045) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 23:22:27 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-a58321b1-eeae-4836-a5ba-ffb0289e387c tempest-TestServerVolumeAttachmentScenario-1899063447 tempest-TestServerVolumeAttachmentScenario-1899063447-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.516s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:22:27 user nova-compute[75045]: DEBUG nova.compute.manager [None req-a58321b1-eeae-4836-a5ba-ffb0289e387c tempest-TestServerVolumeAttachmentScenario-1899063447 tempest-TestServerVolumeAttachmentScenario-1899063447-project-member] [instance: 25cd59d1-6884-471a-813e-52e97c2e1208] Start building networks asynchronously for instance. {{(pid=75045) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 23:22:27 user nova-compute[75045]: DEBUG nova.compute.manager [None req-a58321b1-eeae-4836-a5ba-ffb0289e387c tempest-TestServerVolumeAttachmentScenario-1899063447 tempest-TestServerVolumeAttachmentScenario-1899063447-project-member] [instance: 25cd59d1-6884-471a-813e-52e97c2e1208] Allocating IP information in the background. {{(pid=75045) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 23:22:27 user nova-compute[75045]: DEBUG nova.network.neutron [None req-a58321b1-eeae-4836-a5ba-ffb0289e387c tempest-TestServerVolumeAttachmentScenario-1899063447 tempest-TestServerVolumeAttachmentScenario-1899063447-project-member] [instance: 25cd59d1-6884-471a-813e-52e97c2e1208] allocate_for_instance() {{(pid=75045) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 23:22:27 user nova-compute[75045]: INFO nova.virt.libvirt.driver [None req-a58321b1-eeae-4836-a5ba-ffb0289e387c tempest-TestServerVolumeAttachmentScenario-1899063447 tempest-TestServerVolumeAttachmentScenario-1899063447-project-member] [instance: 25cd59d1-6884-471a-813e-52e97c2e1208] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 23:22:27 user nova-compute[75045]: DEBUG nova.compute.manager [None req-a58321b1-eeae-4836-a5ba-ffb0289e387c tempest-TestServerVolumeAttachmentScenario-1899063447 tempest-TestServerVolumeAttachmentScenario-1899063447-project-member] [instance: 25cd59d1-6884-471a-813e-52e97c2e1208] Start building block device mappings for instance. {{(pid=75045) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 23:22:27 user nova-compute[75045]: DEBUG nova.policy [None req-a58321b1-eeae-4836-a5ba-ffb0289e387c tempest-TestServerVolumeAttachmentScenario-1899063447 tempest-TestServerVolumeAttachmentScenario-1899063447-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1826508cfeff4d5081f84e7e0bf0ff5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea775ad7c664da7ab23a480d913dda4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75045) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 23:22:27 user nova-compute[75045]: DEBUG nova.compute.manager [None req-a58321b1-eeae-4836-a5ba-ffb0289e387c tempest-TestServerVolumeAttachmentScenario-1899063447 tempest-TestServerVolumeAttachmentScenario-1899063447-project-member] [instance: 25cd59d1-6884-471a-813e-52e97c2e1208] Start spawning the instance on the hypervisor. {{(pid=75045) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 23:22:27 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-a58321b1-eeae-4836-a5ba-ffb0289e387c tempest-TestServerVolumeAttachmentScenario-1899063447 tempest-TestServerVolumeAttachmentScenario-1899063447-project-member] [instance: 25cd59d1-6884-471a-813e-52e97c2e1208] Creating instance directory {{(pid=75045) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 23:22:27 user nova-compute[75045]: INFO nova.virt.libvirt.driver [None req-a58321b1-eeae-4836-a5ba-ffb0289e387c tempest-TestServerVolumeAttachmentScenario-1899063447 tempest-TestServerVolumeAttachmentScenario-1899063447-project-member] [instance: 25cd59d1-6884-471a-813e-52e97c2e1208] Creating image(s)
Nov 08 23:22:27 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-a58321b1-eeae-4836-a5ba-ffb0289e387c tempest-TestServerVolumeAttachmentScenario-1899063447 tempest-TestServerVolumeAttachmentScenario-1899063447-project-member] Acquiring lock "/opt/stack/data/nova/instances/25cd59d1-6884-471a-813e-52e97c2e1208/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:22:27 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-a58321b1-eeae-4836-a5ba-ffb0289e387c tempest-TestServerVolumeAttachmentScenario-1899063447 tempest-TestServerVolumeAttachmentScenario-1899063447-project-member] Lock "/opt/stack/data/nova/instances/25cd59d1-6884-471a-813e-52e97c2e1208/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:22:27 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-a58321b1-eeae-4836-a5ba-ffb0289e387c tempest-TestServerVolumeAttachmentScenario-1899063447 tempest-TestServerVolumeAttachmentScenario-1899063447-project-member] Lock "/opt/stack/data/nova/instances/25cd59d1-6884-471a-813e-52e97c2e1208/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:22:27 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-a58321b1-eeae-4836-a5ba-ffb0289e387c tempest-TestServerVolumeAttachmentScenario-1899063447 tempest-TestServerVolumeAttachmentScenario-1899063447-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b59f52a99fff51c56dd1edfb83892fb8f647f2f3 --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:22:27 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-a58321b1-eeae-4836-a5ba-ffb0289e387c tempest-TestServerVolumeAttachmentScenario-1899063447 tempest-TestServerVolumeAttachmentScenario-1899063447-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b59f52a99fff51c56dd1edfb83892fb8f647f2f3 --force-share --output=json" returned: 0 in 0.250s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:22:27 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-a58321b1-eeae-4836-a5ba-ffb0289e387c tempest-TestServerVolumeAttachmentScenario-1899063447 tempest-TestServerVolumeAttachmentScenario-1899063447-project-member] Acquiring lock "b59f52a99fff51c56dd1edfb83892fb8f647f2f3" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:22:27 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-a58321b1-eeae-4836-a5ba-ffb0289e387c tempest-TestServerVolumeAttachmentScenario-1899063447 tempest-TestServerVolumeAttachmentScenario-1899063447-project-member] Lock "b59f52a99fff51c56dd1edfb83892fb8f647f2f3" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:22:27 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-a58321b1-eeae-4836-a5ba-ffb0289e387c tempest-TestServerVolumeAttachmentScenario-1899063447 tempest-TestServerVolumeAttachmentScenario-1899063447-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b59f52a99fff51c56dd1edfb83892fb8f647f2f3 --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:22:28 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-a58321b1-eeae-4836-a5ba-ffb0289e387c tempest-TestServerVolumeAttachmentScenario-1899063447 tempest-TestServerVolumeAttachmentScenario-1899063447-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b59f52a99fff51c56dd1edfb83892fb8f647f2f3 --force-share --output=json" returned: 0 in 0.216s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:22:28 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-a58321b1-eeae-4836-a5ba-ffb0289e387c tempest-TestServerVolumeAttachmentScenario-1899063447 tempest-TestServerVolumeAttachmentScenario-1899063447-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b59f52a99fff51c56dd1edfb83892fb8f647f2f3,backing_fmt=raw /opt/stack/data/nova/instances/25cd59d1-6884-471a-813e-52e97c2e1208/disk 1073741824 {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:22:28 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-a58321b1-eeae-4836-a5ba-ffb0289e387c tempest-TestServerVolumeAttachmentScenario-1899063447 tempest-TestServerVolumeAttachmentScenario-1899063447-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b59f52a99fff51c56dd1edfb83892fb8f647f2f3,backing_fmt=raw /opt/stack/data/nova/instances/25cd59d1-6884-471a-813e-52e97c2e1208/disk 1073741824" returned: 0 in 0.064s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:22:28 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-a58321b1-eeae-4836-a5ba-ffb0289e387c tempest-TestServerVolumeAttachmentScenario-1899063447 tempest-TestServerVolumeAttachmentScenario-1899063447-project-member] Lock "b59f52a99fff51c56dd1edfb83892fb8f647f2f3" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.291s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:22:28 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-a58321b1-eeae-4836-a5ba-ffb0289e387c tempest-TestServerVolumeAttachmentScenario-1899063447 tempest-TestServerVolumeAttachmentScenario-1899063447-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b59f52a99fff51c56dd1edfb83892fb8f647f2f3 --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:22:28 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-a58321b1-eeae-4836-a5ba-ffb0289e387c tempest-TestServerVolumeAttachmentScenario-1899063447 tempest-TestServerVolumeAttachmentScenario-1899063447-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b59f52a99fff51c56dd1edfb83892fb8f647f2f3 --force-share --output=json" returned: 0 in 0.229s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:22:28 user nova-compute[75045]: DEBUG nova.virt.disk.api [None req-a58321b1-eeae-4836-a5ba-ffb0289e387c tempest-TestServerVolumeAttachmentScenario-1899063447 tempest-TestServerVolumeAttachmentScenario-1899063447-project-member] Checking if we can resize image /opt/stack/data/nova/instances/25cd59d1-6884-471a-813e-52e97c2e1208/disk. size=1073741824 {{(pid=75045) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 23:22:28 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-a58321b1-eeae-4836-a5ba-ffb0289e387c tempest-TestServerVolumeAttachmentScenario-1899063447 tempest-TestServerVolumeAttachmentScenario-1899063447-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25cd59d1-6884-471a-813e-52e97c2e1208/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:22:28 user nova-compute[75045]: DEBUG nova.network.neutron [None req-a58321b1-eeae-4836-a5ba-ffb0289e387c tempest-TestServerVolumeAttachmentScenario-1899063447 tempest-TestServerVolumeAttachmentScenario-1899063447-project-member] [instance: 25cd59d1-6884-471a-813e-52e97c2e1208] Successfully created port: 43fa5cbb-d817-41af-8e03-3be477de48c8 {{(pid=75045) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 23:22:28 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-a58321b1-eeae-4836-a5ba-ffb0289e387c tempest-TestServerVolumeAttachmentScenario-1899063447 tempest-TestServerVolumeAttachmentScenario-1899063447-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25cd59d1-6884-471a-813e-52e97c2e1208/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:22:28 user nova-compute[75045]: DEBUG nova.virt.disk.api [None req-a58321b1-eeae-4836-a5ba-ffb0289e387c tempest-TestServerVolumeAttachmentScenario-1899063447 tempest-TestServerVolumeAttachmentScenario-1899063447-project-member] Cannot resize image /opt/stack/data/nova/instances/25cd59d1-6884-471a-813e-52e97c2e1208/disk to a smaller size. {{(pid=75045) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 08 23:22:28 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-a58321b1-eeae-4836-a5ba-ffb0289e387c tempest-TestServerVolumeAttachmentScenario-1899063447 tempest-TestServerVolumeAttachmentScenario-1899063447-project-member] [instance: 25cd59d1-6884-471a-813e-52e97c2e1208] Created local disks {{(pid=75045) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 23:22:28 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-a58321b1-eeae-4836-a5ba-ffb0289e387c tempest-TestServerVolumeAttachmentScenario-1899063447 tempest-TestServerVolumeAttachmentScenario-1899063447-project-member] [instance: 25cd59d1-6884-471a-813e-52e97c2e1208] Ensure instance console log exists: /opt/stack/data/nova/instances/25cd59d1-6884-471a-813e-52e97c2e1208/console.log {{(pid=75045) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 23:22:28 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-a58321b1-eeae-4836-a5ba-ffb0289e387c tempest-TestServerVolumeAttachmentScenario-1899063447 tempest-TestServerVolumeAttachmentScenario-1899063447-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:22:28 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-a58321b1-eeae-4836-a5ba-ffb0289e387c tempest-TestServerVolumeAttachmentScenario-1899063447 tempest-TestServerVolumeAttachmentScenario-1899063447-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:22:28 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-a58321b1-eeae-4836-a5ba-ffb0289e387c tempest-TestServerVolumeAttachmentScenario-1899063447 tempest-TestServerVolumeAttachmentScenario-1899063447-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:22:28 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:22:29 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:22:29 user nova-compute[75045]: DEBUG nova.network.neutron [None req-a58321b1-eeae-4836-a5ba-ffb0289e387c tempest-TestServerVolumeAttachmentScenario-1899063447 tempest-TestServerVolumeAttachmentScenario-1899063447-project-member] [instance: 25cd59d1-6884-471a-813e-52e97c2e1208] Successfully updated port: 43fa5cbb-d817-41af-8e03-3be477de48c8 {{(pid=75045) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 23:22:29 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-a58321b1-eeae-4836-a5ba-ffb0289e387c tempest-TestServerVolumeAttachmentScenario-1899063447 tempest-TestServerVolumeAttachmentScenario-1899063447-project-member] Acquiring lock "refresh_cache-25cd59d1-6884-471a-813e-52e97c2e1208" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 23:22:29 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-a58321b1-eeae-4836-a5ba-ffb0289e387c tempest-TestServerVolumeAttachmentScenario-1899063447 tempest-TestServerVolumeAttachmentScenario-1899063447-project-member] Acquired lock "refresh_cache-25cd59d1-6884-471a-813e-52e97c2e1208" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 23:22:29 user nova-compute[75045]: DEBUG nova.network.neutron [None req-a58321b1-eeae-4836-a5ba-ffb0289e387c tempest-TestServerVolumeAttachmentScenario-1899063447 tempest-TestServerVolumeAttachmentScenario-1899063447-project-member] [instance: 25cd59d1-6884-471a-813e-52e97c2e1208] Building network info cache for instance {{(pid=75045) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 23:22:29 user nova-compute[75045]: DEBUG nova.compute.manager [req-418ce896-224f-48cc-bc9b-34918bb62437 req-30bf9de1-adac-4382-999c-47cd17a79016 service nova] [instance: 25cd59d1-6884-471a-813e-52e97c2e1208] Received event network-changed-43fa5cbb-d817-41af-8e03-3be477de48c8 {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:22:29 user nova-compute[75045]: DEBUG nova.compute.manager [req-418ce896-224f-48cc-bc9b-34918bb62437 req-30bf9de1-adac-4382-999c-47cd17a79016 service nova] [instance: 25cd59d1-6884-471a-813e-52e97c2e1208] Refreshing instance network info cache due to event network-changed-43fa5cbb-d817-41af-8e03-3be477de48c8. {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 23:22:29 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-418ce896-224f-48cc-bc9b-34918bb62437 req-30bf9de1-adac-4382-999c-47cd17a79016 service nova] Acquiring lock "refresh_cache-25cd59d1-6884-471a-813e-52e97c2e1208" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 23:22:29 user nova-compute[75045]: DEBUG nova.network.neutron [None req-a58321b1-eeae-4836-a5ba-ffb0289e387c tempest-TestServerVolumeAttachmentScenario-1899063447 tempest-TestServerVolumeAttachmentScenario-1899063447-project-member] [instance: 25cd59d1-6884-471a-813e-52e97c2e1208] Instance cache missing network info. {{(pid=75045) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 23:22:29 user nova-compute[75045]: DEBUG nova.network.neutron [None req-a58321b1-eeae-4836-a5ba-ffb0289e387c tempest-TestServerVolumeAttachmentScenario-1899063447 tempest-TestServerVolumeAttachmentScenario-1899063447-project-member] [instance: 25cd59d1-6884-471a-813e-52e97c2e1208] Updating instance_info_cache with network_info: [{"id": "43fa5cbb-d817-41af-8e03-3be477de48c8", "address": "fa:16:3e:bd:cb:ae", "network": {"id": "b584f5a8-5791-4f2f-9846-8f4929b1f061", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1436131566-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ea775ad7c664da7ab23a480d913dda4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43fa5cbb-d8", "ovs_interfaceid": "43fa5cbb-d817-41af-8e03-3be477de48c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75045) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 23:22:29 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-a58321b1-eeae-4836-a5ba-ffb0289e387c tempest-TestServerVolumeAttachmentScenario-1899063447 tempest-TestServerVolumeAttachmentScenario-1899063447-project-member] Releasing lock "refresh_cache-25cd59d1-6884-471a-813e-52e97c2e1208" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 23:22:29 user nova-compute[75045]: DEBUG nova.compute.manager [None req-a58321b1-eeae-4836-a5ba-ffb0289e387c tempest-TestServerVolumeAttachmentScenario-1899063447 tempest-TestServerVolumeAttachmentScenario-1899063447-project-member] [instance: 25cd59d1-6884-471a-813e-52e97c2e1208] Instance network_info: |[{"id": "43fa5cbb-d817-41af-8e03-3be477de48c8", "address": "fa:16:3e:bd:cb:ae", "network": {"id": "b584f5a8-5791-4f2f-9846-8f4929b1f061", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1436131566-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ea775ad7c664da7ab23a480d913dda4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43fa5cbb-d8", "ovs_interfaceid": "43fa5cbb-d817-41af-8e03-3be477de48c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75045) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 23:22:29 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-418ce896-224f-48cc-bc9b-34918bb62437 req-30bf9de1-adac-4382-999c-47cd17a79016 service nova] Acquired lock "refresh_cache-25cd59d1-6884-471a-813e-52e97c2e1208" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 23:22:29 user nova-compute[75045]: DEBUG nova.network.neutron [req-418ce896-224f-48cc-bc9b-34918bb62437 req-30bf9de1-adac-4382-999c-47cd17a79016 service nova] [instance: 25cd59d1-6884-471a-813e-52e97c2e1208] Refreshing network info cache for port 43fa5cbb-d817-41af-8e03-3be477de48c8 {{(pid=75045) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 23:22:29 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-a58321b1-eeae-4836-a5ba-ffb0289e387c tempest-TestServerVolumeAttachmentScenario-1899063447 tempest-TestServerVolumeAttachmentScenario-1899063447-project-member] [instance: 25cd59d1-6884-471a-813e-52e97c2e1208] Start _get_guest_xml network_info=[{"id": "43fa5cbb-d817-41af-8e03-3be477de48c8", "address": "fa:16:3e:bd:cb:ae", "network": {"id": "b584f5a8-5791-4f2f-9846-8f4929b1f061", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1436131566-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ea775ad7c664da7ab23a480d913dda4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43fa5cbb-d8", "ovs_interfaceid": "43fa5cbb-d817-41af-8e03-3be477de48c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T23:11:54Z,direct_url=<?>,disk_format='qcow2',id=a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b1beba2cc4e7465ea249e2225fb494dc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T23:11:56Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'disk_bus': 'virtio', 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': 'a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75045) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 23:22:29 user nova-compute[75045]: WARNING nova.virt.libvirt.driver [None req-a58321b1-eeae-4836-a5ba-ffb0289e387c tempest-TestServerVolumeAttachmentScenario-1899063447 tempest-TestServerVolumeAttachmentScenario-1899063447-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 23:22:29 user nova-compute[75045]: WARNING nova.virt.libvirt.driver [None req-a58321b1-eeae-4836-a5ba-ffb0289e387c tempest-TestServerVolumeAttachmentScenario-1899063447 tempest-TestServerVolumeAttachmentScenario-1899063447-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 23:22:29 user nova-compute[75045]: DEBUG nova.virt.libvirt.host [None req-a58321b1-eeae-4836-a5ba-ffb0289e387c tempest-TestServerVolumeAttachmentScenario-1899063447 tempest-TestServerVolumeAttachmentScenario-1899063447-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75045) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 23:22:29 user nova-compute[75045]: DEBUG nova.virt.libvirt.host [None req-a58321b1-eeae-4836-a5ba-ffb0289e387c tempest-TestServerVolumeAttachmentScenario-1899063447 tempest-TestServerVolumeAttachmentScenario-1899063447-project-member] CPU controller missing on host. {{(pid=75045) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 23:22:29 user nova-compute[75045]: DEBUG nova.virt.libvirt.host [None req-a58321b1-eeae-4836-a5ba-ffb0289e387c tempest-TestServerVolumeAttachmentScenario-1899063447 tempest-TestServerVolumeAttachmentScenario-1899063447-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75045) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 23:22:29 user nova-compute[75045]: DEBUG nova.virt.libvirt.host [None req-a58321b1-eeae-4836-a5ba-ffb0289e387c tempest-TestServerVolumeAttachmentScenario-1899063447 tempest-TestServerVolumeAttachmentScenario-1899063447-project-member] CPU controller found on host. {{(pid=75045) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 23:22:29 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-a58321b1-eeae-4836-a5ba-ffb0289e387c tempest-TestServerVolumeAttachmentScenario-1899063447 tempest-TestServerVolumeAttachmentScenario-1899063447-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75045) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 23:22:29 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-a58321b1-eeae-4836-a5ba-ffb0289e387c tempest-TestServerVolumeAttachmentScenario-1899063447 tempest-TestServerVolumeAttachmentScenario-1899063447-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T23:11:41Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T23:11:54Z,direct_url=<?>,disk_format='qcow2',id=a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b1beba2cc4e7465ea249e2225fb494dc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T23:11:56Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75045) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 23:22:29 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-a58321b1-eeae-4836-a5ba-ffb0289e387c tempest-TestServerVolumeAttachmentScenario-1899063447 tempest-TestServerVolumeAttachmentScenario-1899063447-project-member] Flavor limits 0:0:0 {{(pid=75045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 23:22:29 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-a58321b1-eeae-4836-a5ba-ffb0289e387c tempest-TestServerVolumeAttachmentScenario-1899063447 tempest-TestServerVolumeAttachmentScenario-1899063447-project-member] Image limits 0:0:0 {{(pid=75045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 23:22:29 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-a58321b1-eeae-4836-a5ba-ffb0289e387c tempest-TestServerVolumeAttachmentScenario-1899063447 tempest-TestServerVolumeAttachmentScenario-1899063447-project-member] Flavor pref 0:0:0 {{(pid=75045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 23:22:29 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-a58321b1-eeae-4836-a5ba-ffb0289e387c tempest-TestServerVolumeAttachmentScenario-1899063447 tempest-TestServerVolumeAttachmentScenario-1899063447-project-member] Image pref 0:0:0 {{(pid=75045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 23:22:29 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-a58321b1-eeae-4836-a5ba-ffb0289e387c tempest-TestServerVolumeAttachmentScenario-1899063447 tempest-TestServerVolumeAttachmentScenario-1899063447-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 23:22:29 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-a58321b1-eeae-4836-a5ba-ffb0289e387c tempest-TestServerVolumeAttachmentScenario-1899063447 tempest-TestServerVolumeAttachmentScenario-1899063447-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75045) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 23:22:29 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-a58321b1-eeae-4836-a5ba-ffb0289e387c tempest-TestServerVolumeAttachmentScenario-1899063447 tempest-TestServerVolumeAttachmentScenario-1899063447-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75045) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 23:22:29 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-a58321b1-eeae-4836-a5ba-ffb0289e387c tempest-TestServerVolumeAttachmentScenario-1899063447 tempest-TestServerVolumeAttachmentScenario-1899063447-project-member] Got 1 possible topologies {{(pid=75045) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 23:22:29 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-a58321b1-eeae-4836-a5ba-ffb0289e387c tempest-TestServerVolumeAttachmentScenario-1899063447 tempest-TestServerVolumeAttachmentScenario-1899063447-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75045) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 23:22:29 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-a58321b1-eeae-4836-a5ba-ffb0289e387c tempest-TestServerVolumeAttachmentScenario-1899063447 tempest-TestServerVolumeAttachmentScenario-1899063447-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75045) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 23:22:29 user nova-compute[75045]: DEBUG nova.virt.libvirt.vif [None req-a58321b1-eeae-4836-a5ba-ffb0289e387c tempest-TestServerVolumeAttachmentScenario-1899063447 tempest-TestServerVolumeAttachmentScenario-1899063447-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T23:22:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-141548488',display_name='tempest-TestServerVolumeAttachmentScenario-server-141548488',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-141548488',id=18,image_ref='a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBbIVSSV3Ibe3HDw1MwmY8Snp6aQhY2JGXHgPLXQ2dpKdNAgl4CRRrCsi0/GGMBPrJk7A6or8JaT5LNTXkYg928atu8+Xt9n/HYeTddgr3sdZuMBqy0DwYu06uvjGxvjeQ==',key_name='tempest-keypair-1294221093',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0ea775ad7c664da7ab23a480d913dda4',ramdisk_id='',reservation_id='r-bcuyggc6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-1899063447',owner_user_name='tempest-TestServerVolumeAttachmentScenario-1899063447-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T23:22:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1826508cfeff4d5081f84e7e0bf0ff5e',uuid=25cd59d1-6884-471a-813e-52e97c2e1208,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "43fa5cbb-d817-41af-8e03-3be477de48c8", "address": "fa:16:3e:bd:cb:ae", "network": {"id": "b584f5a8-5791-4f2f-9846-8f4929b1f061", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1436131566-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ea775ad7c664da7ab23a480d913dda4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43fa5cbb-d8", "ovs_interfaceid": "43fa5cbb-d817-41af-8e03-3be477de48c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75045) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 23:22:29 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-a58321b1-eeae-4836-a5ba-ffb0289e387c tempest-TestServerVolumeAttachmentScenario-1899063447 tempest-TestServerVolumeAttachmentScenario-1899063447-project-member] Converting VIF {"id": "43fa5cbb-d817-41af-8e03-3be477de48c8", "address": "fa:16:3e:bd:cb:ae", "network": {"id": "b584f5a8-5791-4f2f-9846-8f4929b1f061", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1436131566-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ea775ad7c664da7ab23a480d913dda4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43fa5cbb-d8", "ovs_interfaceid": "43fa5cbb-d817-41af-8e03-3be477de48c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 23:22:29 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-a58321b1-eeae-4836-a5ba-ffb0289e387c tempest-TestServerVolumeAttachmentScenario-1899063447 tempest-TestServerVolumeAttachmentScenario-1899063447-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bd:cb:ae,bridge_name='br-int',has_traffic_filtering=True,id=43fa5cbb-d817-41af-8e03-3be477de48c8,network=Network(b584f5a8-5791-4f2f-9846-8f4929b1f061),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap43fa5cbb-d8') {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 23:22:29 user nova-compute[75045]: DEBUG nova.objects.instance [None req-a58321b1-eeae-4836-a5ba-ffb0289e387c tempest-TestServerVolumeAttachmentScenario-1899063447 tempest-TestServerVolumeAttachmentScenario-1899063447-project-member] Lazy-loading 'pci_devices' on Instance uuid 25cd59d1-6884-471a-813e-52e97c2e1208 {{(pid=75045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 23:22:29 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-a58321b1-eeae-4836-a5ba-ffb0289e387c tempest-TestServerVolumeAttachmentScenario-1899063447 tempest-TestServerVolumeAttachmentScenario-1899063447-project-member] [instance: 25cd59d1-6884-471a-813e-52e97c2e1208] End _get_guest_xml xml=<domain type="kvm">
Nov 08 23:22:29 user nova-compute[75045]:   <uuid>25cd59d1-6884-471a-813e-52e97c2e1208</uuid>
Nov 08 23:22:29 user nova-compute[75045]:   <name>instance-00000012</name>
Nov 08 23:22:29 user nova-compute[75045]:   <memory>524288</memory>
Nov 08 23:22:29 user nova-compute[75045]:   <vcpu>1</vcpu>
Nov 08 23:22:29 user nova-compute[75045]:   <metadata>
Nov 08 23:22:29 user nova-compute[75045]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 23:22:29 user nova-compute[75045]:       <nova:package version="0.0.0"/>
Nov 08 23:22:29 user nova-compute[75045]:       <nova:name>tempest-TestServerVolumeAttachmentScenario-server-141548488</nova:name>
Nov 08 23:22:29 user nova-compute[75045]:       <nova:creationTime>2023-11-08 23:22:29</nova:creationTime>
Nov 08 23:22:29 user nova-compute[75045]:       <nova:flavor name="m1.tiny">
Nov 08 23:22:29 user nova-compute[75045]:         <nova:memory>512</nova:memory>
Nov 08 23:22:29 user nova-compute[75045]:         <nova:disk>1</nova:disk>
Nov 08 23:22:29 user nova-compute[75045]:         <nova:swap>0</nova:swap>
Nov 08 23:22:29 user nova-compute[75045]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 23:22:29 user nova-compute[75045]:         <nova:vcpus>1</nova:vcpus>
Nov 08 23:22:29 user nova-compute[75045]:       </nova:flavor>
Nov 08 23:22:29 user nova-compute[75045]:       <nova:owner>
Nov 08 23:22:29 user nova-compute[75045]:         <nova:user uuid="1826508cfeff4d5081f84e7e0bf0ff5e">tempest-TestServerVolumeAttachmentScenario-1899063447-project-member</nova:user>
Nov 08 23:22:29 user nova-compute[75045]:         <nova:project uuid="0ea775ad7c664da7ab23a480d913dda4">tempest-TestServerVolumeAttachmentScenario-1899063447</nova:project>
Nov 08 23:22:29 user nova-compute[75045]:       </nova:owner>
Nov 08 23:22:29 user nova-compute[75045]:       <nova:root type="image" uuid="a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb"/>
Nov 08 23:22:29 user nova-compute[75045]:       <nova:ports>
Nov 08 23:22:29 user nova-compute[75045]:         <nova:port uuid="43fa5cbb-d817-41af-8e03-3be477de48c8">
Nov 08 23:22:29 user nova-compute[75045]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 08 23:22:29 user nova-compute[75045]:         </nova:port>
Nov 08 23:22:29 user nova-compute[75045]:       </nova:ports>
Nov 08 23:22:29 user nova-compute[75045]:     </nova:instance>
Nov 08 23:22:29 user nova-compute[75045]:   </metadata>
Nov 08 23:22:29 user nova-compute[75045]:   <sysinfo type="smbios">
Nov 08 23:22:29 user nova-compute[75045]:     <system>
Nov 08 23:22:29 user nova-compute[75045]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 23:22:29 user nova-compute[75045]:       <entry name="product">OpenStack Nova</entry>
Nov 08 23:22:29 user nova-compute[75045]:       <entry name="version">0.0.0</entry>
Nov 08 23:22:29 user nova-compute[75045]:       <entry name="serial">25cd59d1-6884-471a-813e-52e97c2e1208</entry>
Nov 08 23:22:29 user nova-compute[75045]:       <entry name="uuid">25cd59d1-6884-471a-813e-52e97c2e1208</entry>
Nov 08 23:22:29 user nova-compute[75045]:       <entry name="family">Virtual Machine</entry>
Nov 08 23:22:29 user nova-compute[75045]:     </system>
Nov 08 23:22:29 user nova-compute[75045]:   </sysinfo>
Nov 08 23:22:29 user nova-compute[75045]:   <os>
Nov 08 23:22:29 user nova-compute[75045]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 23:22:29 user nova-compute[75045]:     <boot dev="hd"/>
Nov 08 23:22:29 user nova-compute[75045]:     <smbios mode="sysinfo"/>
Nov 08 23:22:29 user nova-compute[75045]:   </os>
Nov 08 23:22:29 user nova-compute[75045]:   <features>
Nov 08 23:22:29 user nova-compute[75045]:     <acpi/>
Nov 08 23:22:29 user nova-compute[75045]:     <apic/>
Nov 08 23:22:29 user nova-compute[75045]:     <vmcoreinfo/>
Nov 08 23:22:29 user nova-compute[75045]:   </features>
Nov 08 23:22:29 user nova-compute[75045]:   <clock offset="utc">
Nov 08 23:22:29 user nova-compute[75045]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 23:22:29 user nova-compute[75045]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 23:22:29 user nova-compute[75045]:     <timer name="hpet" present="no"/>
Nov 08 23:22:29 user nova-compute[75045]:   </clock>
Nov 08 23:22:29 user nova-compute[75045]:   <cpu mode="custom" match="exact">
Nov 08 23:22:29 user nova-compute[75045]:     <model>Nehalem</model>
Nov 08 23:22:29 user nova-compute[75045]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 23:22:29 user nova-compute[75045]:   </cpu>
Nov 08 23:22:29 user nova-compute[75045]:   <devices>
Nov 08 23:22:29 user nova-compute[75045]:     <disk type="file" device="disk">
Nov 08 23:22:29 user nova-compute[75045]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 23:22:29 user nova-compute[75045]:       <source file="/opt/stack/data/nova/instances/25cd59d1-6884-471a-813e-52e97c2e1208/disk"/>
Nov 08 23:22:29 user nova-compute[75045]:       <target dev="vda" bus="virtio"/>
Nov 08 23:22:29 user nova-compute[75045]:     </disk>
Nov 08 23:22:29 user nova-compute[75045]:     <interface type="ethernet">
Nov 08 23:22:29 user nova-compute[75045]:       <mac address="fa:16:3e:bd:cb:ae"/>
Nov 08 23:22:29 user nova-compute[75045]:       <model type="virtio"/>
Nov 08 23:22:29 user nova-compute[75045]:       <mtu size="1442"/>
Nov 08 23:22:29 user nova-compute[75045]:       <target dev="tap43fa5cbb-d8"/>
Nov 08 23:22:29 user nova-compute[75045]:     </interface>
Nov 08 23:22:29 user nova-compute[75045]:     <serial type="pty">
Nov 08 23:22:29 user nova-compute[75045]:       <log file="/opt/stack/data/nova/instances/25cd59d1-6884-471a-813e-52e97c2e1208/console.log" append="off"/>
Nov 08 23:22:29 user nova-compute[75045]:     </serial>
Nov 08 23:22:29 user nova-compute[75045]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 23:22:29 user nova-compute[75045]:     <video>
Nov 08 23:22:29 user nova-compute[75045]:       <model type="virtio"/>
Nov 08 23:22:29 user nova-compute[75045]:     </video>
Nov 08 23:22:29 user nova-compute[75045]:     <rng model="virtio">
Nov 08 23:22:29 user nova-compute[75045]:       <backend model="random">/dev/urandom</backend>
Nov 08 23:22:29 user nova-compute[75045]:     </rng>
Nov 08 23:22:29 user nova-compute[75045]:     <controller type="usb" index="0" model="none"/>
Nov 08 23:22:29 user nova-compute[75045]:     <memballoon model="virtio">
Nov 08 23:22:29 user nova-compute[75045]:       <stats period="10"/>
Nov 08 23:22:29 user nova-compute[75045]:     </memballoon>
Nov 08 23:22:29 user nova-compute[75045]:   </devices>
Nov 08 23:22:29 user nova-compute[75045]: </domain>
Nov 08 23:22:29 user nova-compute[75045]:  {{(pid=75045) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 23:22:29 user nova-compute[75045]: DEBUG nova.virt.libvirt.vif [None req-a58321b1-eeae-4836-a5ba-ffb0289e387c tempest-TestServerVolumeAttachmentScenario-1899063447 tempest-TestServerVolumeAttachmentScenario-1899063447-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T23:22:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-141548488',display_name='tempest-TestServerVolumeAttachmentScenario-server-141548488',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-141548488',id=18,image_ref='a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBbIVSSV3Ibe3HDw1MwmY8Snp6aQhY2JGXHgPLXQ2dpKdNAgl4CRRrCsi0/GGMBPrJk7A6or8JaT5LNTXkYg928atu8+Xt9n/HYeTddgr3sdZuMBqy0DwYu06uvjGxvjeQ==',key_name='tempest-keypair-1294221093',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0ea775ad7c664da7ab23a480d913dda4',ramdisk_id='',reservation_id='r-bcuyggc6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-1899063447',owner_user_name='tempest-TestServerVolumeAttachmentScenario-1899063447-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T23:22:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1826508cfeff4d5081f84e7e0bf0ff5e',uuid=25cd59d1-6884-471a-813e-52e97c2e1208,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "43fa5cbb-d817-41af-8e03-3be477de48c8", "address": "fa:16:3e:bd:cb:ae", "network": {"id": "b584f5a8-5791-4f2f-9846-8f4929b1f061", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1436131566-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ea775ad7c664da7ab23a480d913dda4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43fa5cbb-d8", "ovs_interfaceid": "43fa5cbb-d817-41af-8e03-3be477de48c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75045) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 23:22:29 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-a58321b1-eeae-4836-a5ba-ffb0289e387c tempest-TestServerVolumeAttachmentScenario-1899063447 tempest-TestServerVolumeAttachmentScenario-1899063447-project-member] Converting VIF {"id": "43fa5cbb-d817-41af-8e03-3be477de48c8", "address": "fa:16:3e:bd:cb:ae", "network": {"id": "b584f5a8-5791-4f2f-9846-8f4929b1f061", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1436131566-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ea775ad7c664da7ab23a480d913dda4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43fa5cbb-d8", "ovs_interfaceid": "43fa5cbb-d817-41af-8e03-3be477de48c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 23:22:29 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-a58321b1-eeae-4836-a5ba-ffb0289e387c tempest-TestServerVolumeAttachmentScenario-1899063447 tempest-TestServerVolumeAttachmentScenario-1899063447-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bd:cb:ae,bridge_name='br-int',has_traffic_filtering=True,id=43fa5cbb-d817-41af-8e03-3be477de48c8,network=Network(b584f5a8-5791-4f2f-9846-8f4929b1f061),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap43fa5cbb-d8') {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 23:22:29 user nova-compute[75045]: DEBUG os_vif [None req-a58321b1-eeae-4836-a5ba-ffb0289e387c tempest-TestServerVolumeAttachmentScenario-1899063447 tempest-TestServerVolumeAttachmentScenario-1899063447-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bd:cb:ae,bridge_name='br-int',has_traffic_filtering=True,id=43fa5cbb-d817-41af-8e03-3be477de48c8,network=Network(b584f5a8-5791-4f2f-9846-8f4929b1f061),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap43fa5cbb-d8') {{(pid=75045) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 23:22:29 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:22:29 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:22:29 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 23:22:29 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:22:29 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5fc4e6bd-9bf7-5d1c-ab02-7466ca8974a6', '_type': 'linux-noop'}}, row=False) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:22:29 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:22:29 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 23:22:29 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:22:29 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap43fa5cbb-d8, may_exist=True, interface_attrs={}) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:22:29 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap43fa5cbb-d8, col_values=(('qos', UUID('ed24fb02-dad4-430e-96d3-4b4137f331fb')),), if_exists=True) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:22:29 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap43fa5cbb-d8, col_values=(('external_ids', {'iface-id': '43fa5cbb-d817-41af-8e03-3be477de48c8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:bd:cb:ae', 'vm-uuid': '25cd59d1-6884-471a-813e-52e97c2e1208'}),), if_exists=True) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:22:29 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:22:29 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 23:22:29 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:22:29 user nova-compute[75045]: INFO os_vif [None req-a58321b1-eeae-4836-a5ba-ffb0289e387c tempest-TestServerVolumeAttachmentScenario-1899063447 tempest-TestServerVolumeAttachmentScenario-1899063447-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bd:cb:ae,bridge_name='br-int',has_traffic_filtering=True,id=43fa5cbb-d817-41af-8e03-3be477de48c8,network=Network(b584f5a8-5791-4f2f-9846-8f4929b1f061),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap43fa5cbb-d8')
Nov 08 23:22:30 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-a58321b1-eeae-4836-a5ba-ffb0289e387c tempest-TestServerVolumeAttachmentScenario-1899063447 tempest-TestServerVolumeAttachmentScenario-1899063447-project-member] No BDM found with device name vda, not building metadata. {{(pid=75045) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 23:22:30 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-a58321b1-eeae-4836-a5ba-ffb0289e387c tempest-TestServerVolumeAttachmentScenario-1899063447 tempest-TestServerVolumeAttachmentScenario-1899063447-project-member] No VIF found with MAC fa:16:3e:bd:cb:ae, not building metadata {{(pid=75045) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 23:22:30 user nova-compute[75045]: DEBUG nova.network.neutron [req-418ce896-224f-48cc-bc9b-34918bb62437 req-30bf9de1-adac-4382-999c-47cd17a79016 service nova] [instance: 25cd59d1-6884-471a-813e-52e97c2e1208] Updated VIF entry in instance network info cache for port 43fa5cbb-d817-41af-8e03-3be477de48c8. {{(pid=75045) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 23:22:30 user nova-compute[75045]: DEBUG nova.network.neutron [req-418ce896-224f-48cc-bc9b-34918bb62437 req-30bf9de1-adac-4382-999c-47cd17a79016 service nova] [instance: 25cd59d1-6884-471a-813e-52e97c2e1208] Updating instance_info_cache with network_info: [{"id": "43fa5cbb-d817-41af-8e03-3be477de48c8", "address": "fa:16:3e:bd:cb:ae", "network": {"id": "b584f5a8-5791-4f2f-9846-8f4929b1f061", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1436131566-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ea775ad7c664da7ab23a480d913dda4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43fa5cbb-d8", "ovs_interfaceid": "43fa5cbb-d817-41af-8e03-3be477de48c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75045) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 23:22:30 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-418ce896-224f-48cc-bc9b-34918bb62437 req-30bf9de1-adac-4382-999c-47cd17a79016 service nova] Releasing lock "refresh_cache-25cd59d1-6884-471a-813e-52e97c2e1208" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 23:22:30 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:22:31 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:22:31 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:22:31 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:22:31 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:22:31 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:22:31 user nova-compute[75045]: DEBUG nova.compute.manager [req-fac9bfe1-9a95-4bf5-a294-b35ba3853985 req-dd34cac4-7ad8-45d2-90a8-d2f23117033e service nova] [instance: 25cd59d1-6884-471a-813e-52e97c2e1208] Received event network-vif-plugged-43fa5cbb-d817-41af-8e03-3be477de48c8 {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:22:31 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-fac9bfe1-9a95-4bf5-a294-b35ba3853985 req-dd34cac4-7ad8-45d2-90a8-d2f23117033e service nova] Acquiring lock "25cd59d1-6884-471a-813e-52e97c2e1208-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:22:31 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-fac9bfe1-9a95-4bf5-a294-b35ba3853985 req-dd34cac4-7ad8-45d2-90a8-d2f23117033e service nova] Lock "25cd59d1-6884-471a-813e-52e97c2e1208-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:22:31 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-fac9bfe1-9a95-4bf5-a294-b35ba3853985 req-dd34cac4-7ad8-45d2-90a8-d2f23117033e service nova] Lock "25cd59d1-6884-471a-813e-52e97c2e1208-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:22:31 user nova-compute[75045]: DEBUG nova.compute.manager [req-fac9bfe1-9a95-4bf5-a294-b35ba3853985 req-dd34cac4-7ad8-45d2-90a8-d2f23117033e service nova] [instance: 25cd59d1-6884-471a-813e-52e97c2e1208] No waiting events found dispatching network-vif-plugged-43fa5cbb-d817-41af-8e03-3be477de48c8 {{(pid=75045) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 23:22:31 user nova-compute[75045]: WARNING nova.compute.manager [req-fac9bfe1-9a95-4bf5-a294-b35ba3853985 req-dd34cac4-7ad8-45d2-90a8-d2f23117033e service nova] [instance: 25cd59d1-6884-471a-813e-52e97c2e1208] Received unexpected event network-vif-plugged-43fa5cbb-d817-41af-8e03-3be477de48c8 for instance with vm_state building and task_state spawning.
Nov 08 23:22:32 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:22:32 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:22:32 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:22:32 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:22:32 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:22:32 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:22:33 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-8c4065e6-c3fd-47af-a18e-7048ffadfe81 tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] Acquiring lock "b5fc7f02-2143-4bcf-92ac-078d5ec10747" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:22:33 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-8c4065e6-c3fd-47af-a18e-7048ffadfe81 tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] Lock "b5fc7f02-2143-4bcf-92ac-078d5ec10747" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:22:33 user nova-compute[75045]: DEBUG nova.compute.manager [None req-8c4065e6-c3fd-47af-a18e-7048ffadfe81 tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] [instance: b5fc7f02-2143-4bcf-92ac-078d5ec10747] Starting instance... {{(pid=75045) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 23:22:33 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-8c4065e6-c3fd-47af-a18e-7048ffadfe81 tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:22:33 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-8c4065e6-c3fd-47af-a18e-7048ffadfe81 tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:22:33 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-8c4065e6-c3fd-47af-a18e-7048ffadfe81 tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75045) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 23:22:33 user nova-compute[75045]: INFO nova.compute.claims [None req-8c4065e6-c3fd-47af-a18e-7048ffadfe81 tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] [instance: b5fc7f02-2143-4bcf-92ac-078d5ec10747] Claim successful on node user
Nov 08 23:22:33 user nova-compute[75045]: DEBUG nova.compute.manager [req-fabff05d-ff85-49fe-b006-712d461940f9 req-93b9ee6c-3def-4346-894b-d38d4cf5676c service nova] [instance: 25cd59d1-6884-471a-813e-52e97c2e1208] Received event network-vif-plugged-43fa5cbb-d817-41af-8e03-3be477de48c8 {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:22:33 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-fabff05d-ff85-49fe-b006-712d461940f9 req-93b9ee6c-3def-4346-894b-d38d4cf5676c service nova] Acquiring lock "25cd59d1-6884-471a-813e-52e97c2e1208-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:22:33 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-fabff05d-ff85-49fe-b006-712d461940f9 req-93b9ee6c-3def-4346-894b-d38d4cf5676c service nova] Lock "25cd59d1-6884-471a-813e-52e97c2e1208-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:22:33 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-fabff05d-ff85-49fe-b006-712d461940f9 req-93b9ee6c-3def-4346-894b-d38d4cf5676c service nova] Lock "25cd59d1-6884-471a-813e-52e97c2e1208-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:22:33 user nova-compute[75045]: DEBUG nova.compute.manager [req-fabff05d-ff85-49fe-b006-712d461940f9 req-93b9ee6c-3def-4346-894b-d38d4cf5676c service nova] [instance: 25cd59d1-6884-471a-813e-52e97c2e1208] No waiting events found dispatching network-vif-plugged-43fa5cbb-d817-41af-8e03-3be477de48c8 {{(pid=75045) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 23:22:33 user nova-compute[75045]: WARNING nova.compute.manager [req-fabff05d-ff85-49fe-b006-712d461940f9 req-93b9ee6c-3def-4346-894b-d38d4cf5676c service nova] [instance: 25cd59d1-6884-471a-813e-52e97c2e1208] Received unexpected event network-vif-plugged-43fa5cbb-d817-41af-8e03-3be477de48c8 for instance with vm_state building and task_state spawning.
Nov 08 23:22:33 user nova-compute[75045]: DEBUG nova.compute.manager [None req-a58321b1-eeae-4836-a5ba-ffb0289e387c tempest-TestServerVolumeAttachmentScenario-1899063447 tempest-TestServerVolumeAttachmentScenario-1899063447-project-member] [instance: 25cd59d1-6884-471a-813e-52e97c2e1208] Instance event wait completed in 0 seconds for  {{(pid=75045) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 23:22:33 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-a58321b1-eeae-4836-a5ba-ffb0289e387c tempest-TestServerVolumeAttachmentScenario-1899063447 tempest-TestServerVolumeAttachmentScenario-1899063447-project-member] [instance: 25cd59d1-6884-471a-813e-52e97c2e1208] Guest created on hypervisor {{(pid=75045) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 23:22:33 user nova-compute[75045]: INFO nova.virt.libvirt.driver [-] [instance: 25cd59d1-6884-471a-813e-52e97c2e1208] Instance spawned successfully.
Nov 08 23:22:33 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-a58321b1-eeae-4836-a5ba-ffb0289e387c tempest-TestServerVolumeAttachmentScenario-1899063447 tempest-TestServerVolumeAttachmentScenario-1899063447-project-member] [instance: 25cd59d1-6884-471a-813e-52e97c2e1208] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75045) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 23:22:34 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-a58321b1-eeae-4836-a5ba-ffb0289e387c tempest-TestServerVolumeAttachmentScenario-1899063447 tempest-TestServerVolumeAttachmentScenario-1899063447-project-member] [instance: 25cd59d1-6884-471a-813e-52e97c2e1208] Found default for hw_cdrom_bus of ide {{(pid=75045) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 23:22:34 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-a58321b1-eeae-4836-a5ba-ffb0289e387c tempest-TestServerVolumeAttachmentScenario-1899063447 tempest-TestServerVolumeAttachmentScenario-1899063447-project-member] [instance: 25cd59d1-6884-471a-813e-52e97c2e1208] Found default for hw_disk_bus of virtio {{(pid=75045) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 23:22:34 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-a58321b1-eeae-4836-a5ba-ffb0289e387c tempest-TestServerVolumeAttachmentScenario-1899063447 tempest-TestServerVolumeAttachmentScenario-1899063447-project-member] [instance: 25cd59d1-6884-471a-813e-52e97c2e1208] Found default for hw_input_bus of None {{(pid=75045) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 23:22:34 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-a58321b1-eeae-4836-a5ba-ffb0289e387c tempest-TestServerVolumeAttachmentScenario-1899063447 tempest-TestServerVolumeAttachmentScenario-1899063447-project-member] [instance: 25cd59d1-6884-471a-813e-52e97c2e1208] Found default for hw_pointer_model of None {{(pid=75045) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 23:22:34 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-a58321b1-eeae-4836-a5ba-ffb0289e387c tempest-TestServerVolumeAttachmentScenario-1899063447 tempest-TestServerVolumeAttachmentScenario-1899063447-project-member] [instance: 25cd59d1-6884-471a-813e-52e97c2e1208] Found default for hw_video_model of virtio {{(pid=75045) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 23:22:34 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-a58321b1-eeae-4836-a5ba-ffb0289e387c tempest-TestServerVolumeAttachmentScenario-1899063447 tempest-TestServerVolumeAttachmentScenario-1899063447-project-member] [instance: 25cd59d1-6884-471a-813e-52e97c2e1208] Found default for hw_vif_model of virtio {{(pid=75045) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 23:22:34 user nova-compute[75045]: INFO nova.compute.manager [None req-a58321b1-eeae-4836-a5ba-ffb0289e387c tempest-TestServerVolumeAttachmentScenario-1899063447 tempest-TestServerVolumeAttachmentScenario-1899063447-project-member] [instance: 25cd59d1-6884-471a-813e-52e97c2e1208] Took 6.54 seconds to spawn the instance on the hypervisor.
Nov 08 23:22:34 user nova-compute[75045]: DEBUG nova.compute.manager [None req-a58321b1-eeae-4836-a5ba-ffb0289e387c tempest-TestServerVolumeAttachmentScenario-1899063447 tempest-TestServerVolumeAttachmentScenario-1899063447-project-member] [instance: 25cd59d1-6884-471a-813e-52e97c2e1208] Checking state {{(pid=75045) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 23:22:34 user nova-compute[75045]: DEBUG nova.compute.provider_tree [None req-8c4065e6-c3fd-47af-a18e-7048ffadfe81 tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] Inventory has not changed in ProviderTree for provider: 62ba5f85-c74d-4b58-986e-d4197e813fd7 {{(pid=75045) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 23:22:34 user nova-compute[75045]: DEBUG nova.scheduler.client.report [None req-8c4065e6-c3fd-47af-a18e-7048ffadfe81 tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] Inventory has not changed for provider 62ba5f85-c74d-4b58-986e-d4197e813fd7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75045) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 23:22:34 user nova-compute[75045]: INFO nova.compute.manager [None req-a58321b1-eeae-4836-a5ba-ffb0289e387c tempest-TestServerVolumeAttachmentScenario-1899063447 tempest-TestServerVolumeAttachmentScenario-1899063447-project-member] [instance: 25cd59d1-6884-471a-813e-52e97c2e1208] Took 7.55 seconds to build instance.
Nov 08 23:22:34 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-a58321b1-eeae-4836-a5ba-ffb0289e387c tempest-TestServerVolumeAttachmentScenario-1899063447 tempest-TestServerVolumeAttachmentScenario-1899063447-project-member] Lock "25cd59d1-6884-471a-813e-52e97c2e1208" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.689s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:22:34 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-8c4065e6-c3fd-47af-a18e-7048ffadfe81 tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.602s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:22:34 user nova-compute[75045]: DEBUG nova.compute.manager [None req-8c4065e6-c3fd-47af-a18e-7048ffadfe81 tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] [instance: b5fc7f02-2143-4bcf-92ac-078d5ec10747] Start building networks asynchronously for instance. {{(pid=75045) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 23:22:34 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-5261c1af-07e3-4bcb-ab02-74001e8faf9a tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] Acquiring lock "0b84f2b1-01a3-4789-bcef-8b7c4334132b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:22:34 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-5261c1af-07e3-4bcb-ab02-74001e8faf9a tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] Lock "0b84f2b1-01a3-4789-bcef-8b7c4334132b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:22:34 user nova-compute[75045]: DEBUG nova.compute.manager [None req-8c4065e6-c3fd-47af-a18e-7048ffadfe81 tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] [instance: b5fc7f02-2143-4bcf-92ac-078d5ec10747] Allocating IP information in the background. {{(pid=75045) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 23:22:34 user nova-compute[75045]: DEBUG nova.network.neutron [None req-8c4065e6-c3fd-47af-a18e-7048ffadfe81 tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] [instance: b5fc7f02-2143-4bcf-92ac-078d5ec10747] allocate_for_instance() {{(pid=75045) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 23:22:34 user nova-compute[75045]: DEBUG nova.compute.manager [None req-5261c1af-07e3-4bcb-ab02-74001e8faf9a tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] [instance: 0b84f2b1-01a3-4789-bcef-8b7c4334132b] Starting instance... {{(pid=75045) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 23:22:34 user nova-compute[75045]: INFO nova.virt.libvirt.driver [None req-8c4065e6-c3fd-47af-a18e-7048ffadfe81 tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] [instance: b5fc7f02-2143-4bcf-92ac-078d5ec10747] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 23:22:34 user nova-compute[75045]: DEBUG nova.compute.manager [None req-8c4065e6-c3fd-47af-a18e-7048ffadfe81 tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] [instance: b5fc7f02-2143-4bcf-92ac-078d5ec10747] Start building block device mappings for instance. {{(pid=75045) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 23:22:34 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-5261c1af-07e3-4bcb-ab02-74001e8faf9a tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:22:34 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-5261c1af-07e3-4bcb-ab02-74001e8faf9a tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:22:34 user nova-compute[75045]: DEBUG nova.policy [None req-8c4065e6-c3fd-47af-a18e-7048ffadfe81 tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f16e465ffb49488db3de445a473fd77a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbb640407ef94f568aea892f1834d6d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75045) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 23:22:34 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-5261c1af-07e3-4bcb-ab02-74001e8faf9a tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75045) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 23:22:34 user nova-compute[75045]: INFO nova.compute.claims [None req-5261c1af-07e3-4bcb-ab02-74001e8faf9a tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] [instance: 0b84f2b1-01a3-4789-bcef-8b7c4334132b] Claim successful on node user
Nov 08 23:22:34 user nova-compute[75045]: DEBUG nova.compute.manager [None req-8c4065e6-c3fd-47af-a18e-7048ffadfe81 tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] [instance: b5fc7f02-2143-4bcf-92ac-078d5ec10747] Start spawning the instance on the hypervisor. {{(pid=75045) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 23:22:34 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-8c4065e6-c3fd-47af-a18e-7048ffadfe81 tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] [instance: b5fc7f02-2143-4bcf-92ac-078d5ec10747] Creating instance directory {{(pid=75045) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 23:22:34 user nova-compute[75045]: INFO nova.virt.libvirt.driver [None req-8c4065e6-c3fd-47af-a18e-7048ffadfe81 tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] [instance: b5fc7f02-2143-4bcf-92ac-078d5ec10747] Creating image(s)
Nov 08 23:22:34 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-8c4065e6-c3fd-47af-a18e-7048ffadfe81 tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] Acquiring lock "/opt/stack/data/nova/instances/b5fc7f02-2143-4bcf-92ac-078d5ec10747/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:22:34 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-8c4065e6-c3fd-47af-a18e-7048ffadfe81 tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] Lock "/opt/stack/data/nova/instances/b5fc7f02-2143-4bcf-92ac-078d5ec10747/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:22:34 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-8c4065e6-c3fd-47af-a18e-7048ffadfe81 tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] Lock "/opt/stack/data/nova/instances/b5fc7f02-2143-4bcf-92ac-078d5ec10747/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:22:34 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-8c4065e6-c3fd-47af-a18e-7048ffadfe81 tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b59f52a99fff51c56dd1edfb83892fb8f647f2f3 --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:22:34 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-8c4065e6-c3fd-47af-a18e-7048ffadfe81 tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b59f52a99fff51c56dd1edfb83892fb8f647f2f3 --force-share --output=json" returned: 0 in 0.222s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:22:34 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-8c4065e6-c3fd-47af-a18e-7048ffadfe81 tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] Acquiring lock "b59f52a99fff51c56dd1edfb83892fb8f647f2f3" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:22:34 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-8c4065e6-c3fd-47af-a18e-7048ffadfe81 tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] Lock "b59f52a99fff51c56dd1edfb83892fb8f647f2f3" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:22:34 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-8c4065e6-c3fd-47af-a18e-7048ffadfe81 tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b59f52a99fff51c56dd1edfb83892fb8f647f2f3 --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:22:34 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:22:34 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:22:35 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-8c4065e6-c3fd-47af-a18e-7048ffadfe81 tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b59f52a99fff51c56dd1edfb83892fb8f647f2f3 --force-share --output=json" returned: 0 in 0.246s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:22:35 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-8c4065e6-c3fd-47af-a18e-7048ffadfe81 tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b59f52a99fff51c56dd1edfb83892fb8f647f2f3,backing_fmt=raw /opt/stack/data/nova/instances/b5fc7f02-2143-4bcf-92ac-078d5ec10747/disk 1073741824 {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:22:35 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-8c4065e6-c3fd-47af-a18e-7048ffadfe81 tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b59f52a99fff51c56dd1edfb83892fb8f647f2f3,backing_fmt=raw /opt/stack/data/nova/instances/b5fc7f02-2143-4bcf-92ac-078d5ec10747/disk 1073741824" returned: 0 in 0.060s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:22:35 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-8c4065e6-c3fd-47af-a18e-7048ffadfe81 tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] Lock "b59f52a99fff51c56dd1edfb83892fb8f647f2f3" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.311s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:22:35 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-8c4065e6-c3fd-47af-a18e-7048ffadfe81 tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b59f52a99fff51c56dd1edfb83892fb8f647f2f3 --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:22:35 user nova-compute[75045]: DEBUG nova.compute.provider_tree [None req-5261c1af-07e3-4bcb-ab02-74001e8faf9a tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] Inventory has not changed in ProviderTree for provider: 62ba5f85-c74d-4b58-986e-d4197e813fd7 {{(pid=75045) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 23:22:35 user nova-compute[75045]: DEBUG nova.scheduler.client.report [None req-5261c1af-07e3-4bcb-ab02-74001e8faf9a tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] Inventory has not changed for provider 62ba5f85-c74d-4b58-986e-d4197e813fd7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75045) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 23:22:35 user nova-compute[75045]: DEBUG nova.network.neutron [None req-8c4065e6-c3fd-47af-a18e-7048ffadfe81 tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] [instance: b5fc7f02-2143-4bcf-92ac-078d5ec10747] Successfully created port: cde7cd95-3b8b-4980-8abc-be5c221a40ff {{(pid=75045) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 23:22:35 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-5261c1af-07e3-4bcb-ab02-74001e8faf9a tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.834s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:22:35 user nova-compute[75045]: DEBUG nova.compute.manager [None req-5261c1af-07e3-4bcb-ab02-74001e8faf9a tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] [instance: 0b84f2b1-01a3-4789-bcef-8b7c4334132b] Start building networks asynchronously for instance. {{(pid=75045) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 23:22:35 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-8c4065e6-c3fd-47af-a18e-7048ffadfe81 tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b59f52a99fff51c56dd1edfb83892fb8f647f2f3 --force-share --output=json" returned: 0 in 0.287s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:22:35 user nova-compute[75045]: DEBUG nova.virt.disk.api [None req-8c4065e6-c3fd-47af-a18e-7048ffadfe81 tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b5fc7f02-2143-4bcf-92ac-078d5ec10747/disk. size=1073741824 {{(pid=75045) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 23:22:35 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-8c4065e6-c3fd-47af-a18e-7048ffadfe81 tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5fc7f02-2143-4bcf-92ac-078d5ec10747/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:22:35 user nova-compute[75045]: DEBUG nova.compute.manager [None req-5261c1af-07e3-4bcb-ab02-74001e8faf9a tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] [instance: 0b84f2b1-01a3-4789-bcef-8b7c4334132b] Allocating IP information in the background. {{(pid=75045) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 23:22:35 user nova-compute[75045]: DEBUG nova.network.neutron [None req-5261c1af-07e3-4bcb-ab02-74001e8faf9a tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] [instance: 0b84f2b1-01a3-4789-bcef-8b7c4334132b] allocate_for_instance() {{(pid=75045) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 23:22:35 user nova-compute[75045]: INFO nova.virt.libvirt.driver [None req-5261c1af-07e3-4bcb-ab02-74001e8faf9a tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] [instance: 0b84f2b1-01a3-4789-bcef-8b7c4334132b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 23:22:35 user nova-compute[75045]: DEBUG nova.compute.manager [None req-5261c1af-07e3-4bcb-ab02-74001e8faf9a tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] [instance: 0b84f2b1-01a3-4789-bcef-8b7c4334132b] Start building block device mappings for instance. {{(pid=75045) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 23:22:35 user nova-compute[75045]: DEBUG nova.policy [None req-5261c1af-07e3-4bcb-ab02-74001e8faf9a tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f16e465ffb49488db3de445a473fd77a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbb640407ef94f568aea892f1834d6d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75045) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 23:22:35 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-8c4065e6-c3fd-47af-a18e-7048ffadfe81 tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5fc7f02-2143-4bcf-92ac-078d5ec10747/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:22:35 user nova-compute[75045]: DEBUG nova.virt.disk.api [None req-8c4065e6-c3fd-47af-a18e-7048ffadfe81 tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] Cannot resize image /opt/stack/data/nova/instances/b5fc7f02-2143-4bcf-92ac-078d5ec10747/disk to a smaller size. {{(pid=75045) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 08 23:22:35 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-8c4065e6-c3fd-47af-a18e-7048ffadfe81 tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] [instance: b5fc7f02-2143-4bcf-92ac-078d5ec10747] Created local disks {{(pid=75045) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 23:22:35 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-8c4065e6-c3fd-47af-a18e-7048ffadfe81 tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] [instance: b5fc7f02-2143-4bcf-92ac-078d5ec10747] Ensure instance console log exists: /opt/stack/data/nova/instances/b5fc7f02-2143-4bcf-92ac-078d5ec10747/console.log {{(pid=75045) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 23:22:35 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-8c4065e6-c3fd-47af-a18e-7048ffadfe81 tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:22:35 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-8c4065e6-c3fd-47af-a18e-7048ffadfe81 tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:22:35 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-8c4065e6-c3fd-47af-a18e-7048ffadfe81 tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:22:35 user nova-compute[75045]: DEBUG nova.compute.manager [None req-5261c1af-07e3-4bcb-ab02-74001e8faf9a tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] [instance: 0b84f2b1-01a3-4789-bcef-8b7c4334132b] Start spawning the instance on the hypervisor. {{(pid=75045) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 23:22:35 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-5261c1af-07e3-4bcb-ab02-74001e8faf9a tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] [instance: 0b84f2b1-01a3-4789-bcef-8b7c4334132b] Creating instance directory {{(pid=75045) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 23:22:35 user nova-compute[75045]: INFO nova.virt.libvirt.driver [None req-5261c1af-07e3-4bcb-ab02-74001e8faf9a tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] [instance: 0b84f2b1-01a3-4789-bcef-8b7c4334132b] Creating image(s)
Nov 08 23:22:35 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-5261c1af-07e3-4bcb-ab02-74001e8faf9a tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] Acquiring lock "/opt/stack/data/nova/instances/0b84f2b1-01a3-4789-bcef-8b7c4334132b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:22:35 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-5261c1af-07e3-4bcb-ab02-74001e8faf9a tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] Lock "/opt/stack/data/nova/instances/0b84f2b1-01a3-4789-bcef-8b7c4334132b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:22:35 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-5261c1af-07e3-4bcb-ab02-74001e8faf9a tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] Lock "/opt/stack/data/nova/instances/0b84f2b1-01a3-4789-bcef-8b7c4334132b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.085s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:22:35 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-5261c1af-07e3-4bcb-ab02-74001e8faf9a tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b59f52a99fff51c56dd1edfb83892fb8f647f2f3 --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:22:35 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:22:35 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:22:35 user nova-compute[75045]: DEBUG nova.compute.manager [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Starting heal instance info cache {{(pid=75045) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 23:22:36 user nova-compute[75045]: DEBUG nova.compute.manager [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Didn't find any instances for network info cache update. {{(pid=75045) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 08 23:22:36 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:22:36 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-5261c1af-07e3-4bcb-ab02-74001e8faf9a tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b59f52a99fff51c56dd1edfb83892fb8f647f2f3 --force-share --output=json" returned: 0 in 0.253s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:22:36 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-5261c1af-07e3-4bcb-ab02-74001e8faf9a tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] Acquiring lock "b59f52a99fff51c56dd1edfb83892fb8f647f2f3" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:22:36 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-5261c1af-07e3-4bcb-ab02-74001e8faf9a tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] Lock "b59f52a99fff51c56dd1edfb83892fb8f647f2f3" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:22:36 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-5261c1af-07e3-4bcb-ab02-74001e8faf9a tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b59f52a99fff51c56dd1edfb83892fb8f647f2f3 --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:22:36 user nova-compute[75045]: DEBUG nova.network.neutron [None req-8c4065e6-c3fd-47af-a18e-7048ffadfe81 tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] [instance: b5fc7f02-2143-4bcf-92ac-078d5ec10747] Successfully updated port: cde7cd95-3b8b-4980-8abc-be5c221a40ff {{(pid=75045) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 23:22:36 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-8c4065e6-c3fd-47af-a18e-7048ffadfe81 tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] Acquiring lock "refresh_cache-b5fc7f02-2143-4bcf-92ac-078d5ec10747" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 23:22:36 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-8c4065e6-c3fd-47af-a18e-7048ffadfe81 tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] Acquired lock "refresh_cache-b5fc7f02-2143-4bcf-92ac-078d5ec10747" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 23:22:36 user nova-compute[75045]: DEBUG nova.network.neutron [None req-8c4065e6-c3fd-47af-a18e-7048ffadfe81 tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] [instance: b5fc7f02-2143-4bcf-92ac-078d5ec10747] Building network info cache for instance {{(pid=75045) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 23:22:36 user nova-compute[75045]: DEBUG nova.compute.manager [req-439d205d-4c15-4f36-b380-edbac0456ca1 req-51817d41-f3f8-40ce-96ac-db41411c5e4a service nova] [instance: b5fc7f02-2143-4bcf-92ac-078d5ec10747] Received event network-changed-cde7cd95-3b8b-4980-8abc-be5c221a40ff {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:22:36 user nova-compute[75045]: DEBUG nova.compute.manager [req-439d205d-4c15-4f36-b380-edbac0456ca1 req-51817d41-f3f8-40ce-96ac-db41411c5e4a service nova] [instance: b5fc7f02-2143-4bcf-92ac-078d5ec10747] Refreshing instance network info cache due to event network-changed-cde7cd95-3b8b-4980-8abc-be5c221a40ff. {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 23:22:36 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-439d205d-4c15-4f36-b380-edbac0456ca1 req-51817d41-f3f8-40ce-96ac-db41411c5e4a service nova] Acquiring lock "refresh_cache-b5fc7f02-2143-4bcf-92ac-078d5ec10747" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 23:22:36 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-5261c1af-07e3-4bcb-ab02-74001e8faf9a tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b59f52a99fff51c56dd1edfb83892fb8f647f2f3 --force-share --output=json" returned: 0 in 0.274s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:22:36 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-5261c1af-07e3-4bcb-ab02-74001e8faf9a tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b59f52a99fff51c56dd1edfb83892fb8f647f2f3,backing_fmt=raw /opt/stack/data/nova/instances/0b84f2b1-01a3-4789-bcef-8b7c4334132b/disk 1073741824 {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:22:36 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-5261c1af-07e3-4bcb-ab02-74001e8faf9a tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b59f52a99fff51c56dd1edfb83892fb8f647f2f3,backing_fmt=raw /opt/stack/data/nova/instances/0b84f2b1-01a3-4789-bcef-8b7c4334132b/disk 1073741824" returned: 0 in 0.074s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:22:36 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-5261c1af-07e3-4bcb-ab02-74001e8faf9a tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] Lock "b59f52a99fff51c56dd1edfb83892fb8f647f2f3" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.358s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:22:36 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-5261c1af-07e3-4bcb-ab02-74001e8faf9a tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b59f52a99fff51c56dd1edfb83892fb8f647f2f3 --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:22:36 user nova-compute[75045]: DEBUG nova.network.neutron [None req-5261c1af-07e3-4bcb-ab02-74001e8faf9a tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] [instance: 0b84f2b1-01a3-4789-bcef-8b7c4334132b] Successfully created port: c0a20899-be58-4d47-95e2-e129f636162c {{(pid=75045) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 23:22:36 user nova-compute[75045]: DEBUG nova.network.neutron [None req-8c4065e6-c3fd-47af-a18e-7048ffadfe81 tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] [instance: b5fc7f02-2143-4bcf-92ac-078d5ec10747] Instance cache missing network info. {{(pid=75045) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 23:22:36 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-5261c1af-07e3-4bcb-ab02-74001e8faf9a tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b59f52a99fff51c56dd1edfb83892fb8f647f2f3 --force-share --output=json" returned: 0 in 0.219s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:22:36 user nova-compute[75045]: DEBUG nova.virt.disk.api [None req-5261c1af-07e3-4bcb-ab02-74001e8faf9a tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0b84f2b1-01a3-4789-bcef-8b7c4334132b/disk. size=1073741824 {{(pid=75045) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 23:22:36 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-5261c1af-07e3-4bcb-ab02-74001e8faf9a tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b84f2b1-01a3-4789-bcef-8b7c4334132b/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:22:36 user nova-compute[75045]: DEBUG nova.network.neutron [None req-8c4065e6-c3fd-47af-a18e-7048ffadfe81 tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] [instance: b5fc7f02-2143-4bcf-92ac-078d5ec10747] Updating instance_info_cache with network_info: [{"id": "cde7cd95-3b8b-4980-8abc-be5c221a40ff", "address": "fa:16:3e:2d:09:a7", "network": {"id": "08d1669a-f667-4c79-8e49-0ad183f57046", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1863648032-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bbb640407ef94f568aea892f1834d6d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcde7cd95-3b", "ovs_interfaceid": "cde7cd95-3b8b-4980-8abc-be5c221a40ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75045) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 23:22:36 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-5261c1af-07e3-4bcb-ab02-74001e8faf9a tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b84f2b1-01a3-4789-bcef-8b7c4334132b/disk --force-share --output=json" returned: 0 in 0.233s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:22:36 user nova-compute[75045]: DEBUG nova.virt.disk.api [None req-5261c1af-07e3-4bcb-ab02-74001e8faf9a tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] Cannot resize image /opt/stack/data/nova/instances/0b84f2b1-01a3-4789-bcef-8b7c4334132b/disk to a smaller size. {{(pid=75045) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 08 23:22:36 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-5261c1af-07e3-4bcb-ab02-74001e8faf9a tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] [instance: 0b84f2b1-01a3-4789-bcef-8b7c4334132b] Created local disks {{(pid=75045) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 23:22:36 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-5261c1af-07e3-4bcb-ab02-74001e8faf9a tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] [instance: 0b84f2b1-01a3-4789-bcef-8b7c4334132b] Ensure instance console log exists: /opt/stack/data/nova/instances/0b84f2b1-01a3-4789-bcef-8b7c4334132b/console.log {{(pid=75045) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 23:22:36 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-5261c1af-07e3-4bcb-ab02-74001e8faf9a tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:22:36 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-5261c1af-07e3-4bcb-ab02-74001e8faf9a tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:22:36 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-5261c1af-07e3-4bcb-ab02-74001e8faf9a tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:22:36 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-8c4065e6-c3fd-47af-a18e-7048ffadfe81 tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] Releasing lock "refresh_cache-b5fc7f02-2143-4bcf-92ac-078d5ec10747" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 23:22:36 user nova-compute[75045]: DEBUG nova.compute.manager [None req-8c4065e6-c3fd-47af-a18e-7048ffadfe81 tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] [instance: b5fc7f02-2143-4bcf-92ac-078d5ec10747] Instance network_info: |[{"id": "cde7cd95-3b8b-4980-8abc-be5c221a40ff", "address": "fa:16:3e:2d:09:a7", "network": {"id": "08d1669a-f667-4c79-8e49-0ad183f57046", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1863648032-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bbb640407ef94f568aea892f1834d6d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcde7cd95-3b", "ovs_interfaceid": "cde7cd95-3b8b-4980-8abc-be5c221a40ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75045) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 23:22:36 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-439d205d-4c15-4f36-b380-edbac0456ca1 req-51817d41-f3f8-40ce-96ac-db41411c5e4a service nova] Acquired lock "refresh_cache-b5fc7f02-2143-4bcf-92ac-078d5ec10747" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 23:22:36 user nova-compute[75045]: DEBUG nova.network.neutron [req-439d205d-4c15-4f36-b380-edbac0456ca1 req-51817d41-f3f8-40ce-96ac-db41411c5e4a service nova] [instance: b5fc7f02-2143-4bcf-92ac-078d5ec10747] Refreshing network info cache for port cde7cd95-3b8b-4980-8abc-be5c221a40ff {{(pid=75045) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 23:22:36 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-8c4065e6-c3fd-47af-a18e-7048ffadfe81 tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] [instance: b5fc7f02-2143-4bcf-92ac-078d5ec10747] Start _get_guest_xml network_info=[{"id": "cde7cd95-3b8b-4980-8abc-be5c221a40ff", "address": "fa:16:3e:2d:09:a7", "network": {"id": "08d1669a-f667-4c79-8e49-0ad183f57046", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1863648032-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bbb640407ef94f568aea892f1834d6d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcde7cd95-3b", "ovs_interfaceid": "cde7cd95-3b8b-4980-8abc-be5c221a40ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T23:11:54Z,direct_url=<?>,disk_format='qcow2',id=a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b1beba2cc4e7465ea249e2225fb494dc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T23:11:56Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'disk_bus': 'virtio', 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': 'a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75045) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 23:22:36 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:22:36 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:22:36 user nova-compute[75045]: DEBUG nova.compute.manager [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75045) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 23:22:37 user nova-compute[75045]: WARNING nova.virt.libvirt.driver [None req-8c4065e6-c3fd-47af-a18e-7048ffadfe81 tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 23:22:37 user nova-compute[75045]: WARNING nova.virt.libvirt.driver [None req-8c4065e6-c3fd-47af-a18e-7048ffadfe81 tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 23:22:37 user nova-compute[75045]: DEBUG nova.virt.libvirt.host [None req-8c4065e6-c3fd-47af-a18e-7048ffadfe81 tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75045) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 23:22:37 user nova-compute[75045]: DEBUG nova.virt.libvirt.host [None req-8c4065e6-c3fd-47af-a18e-7048ffadfe81 tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] CPU controller missing on host. {{(pid=75045) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 23:22:37 user nova-compute[75045]: DEBUG nova.virt.libvirt.host [None req-8c4065e6-c3fd-47af-a18e-7048ffadfe81 tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75045) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 23:22:37 user nova-compute[75045]: DEBUG nova.virt.libvirt.host [None req-8c4065e6-c3fd-47af-a18e-7048ffadfe81 tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] CPU controller found on host. {{(pid=75045) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 23:22:37 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-8c4065e6-c3fd-47af-a18e-7048ffadfe81 tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75045) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 23:22:37 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-8c4065e6-c3fd-47af-a18e-7048ffadfe81 tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T23:11:41Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T23:11:54Z,direct_url=<?>,disk_format='qcow2',id=a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b1beba2cc4e7465ea249e2225fb494dc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T23:11:56Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75045) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 23:22:37 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-8c4065e6-c3fd-47af-a18e-7048ffadfe81 tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] Flavor limits 0:0:0 {{(pid=75045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 23:22:37 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-8c4065e6-c3fd-47af-a18e-7048ffadfe81 tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] Image limits 0:0:0 {{(pid=75045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 23:22:37 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-8c4065e6-c3fd-47af-a18e-7048ffadfe81 tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] Flavor pref 0:0:0 {{(pid=75045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 23:22:37 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-8c4065e6-c3fd-47af-a18e-7048ffadfe81 tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] Image pref 0:0:0 {{(pid=75045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 23:22:37 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-8c4065e6-c3fd-47af-a18e-7048ffadfe81 tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 23:22:37 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-8c4065e6-c3fd-47af-a18e-7048ffadfe81 tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75045) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 23:22:37 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-8c4065e6-c3fd-47af-a18e-7048ffadfe81 tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75045) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 23:22:37 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-8c4065e6-c3fd-47af-a18e-7048ffadfe81 tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] Got 1 possible topologies {{(pid=75045) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 23:22:37 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-8c4065e6-c3fd-47af-a18e-7048ffadfe81 tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75045) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 23:22:37 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-8c4065e6-c3fd-47af-a18e-7048ffadfe81 tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75045) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 23:22:37 user nova-compute[75045]: DEBUG nova.virt.libvirt.vif [None req-8c4065e6-c3fd-47af-a18e-7048ffadfe81 tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T23:22:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1199401266',display_name='tempest-ServerRescueNegativeTestJSON-server-1199401266',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1199401266',id=19,image_ref='a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bbb640407ef94f568aea892f1834d6d1',ramdisk_id='',reservation_id='r-h0qi02cc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-187452128',owner_user_name='tempest-ServerRescueNegativeTestJSON-187452128-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T23:22:35Z,user_data=None,user_id='f16e465ffb49488db3de445a473fd77a',uuid=b5fc7f02-2143-4bcf-92ac-078d5ec10747,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cde7cd95-3b8b-4980-8abc-be5c221a40ff", "address": "fa:16:3e:2d:09:a7", "network": {"id": "08d1669a-f667-4c79-8e49-0ad183f57046", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1863648032-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bbb640407ef94f568aea892f1834d6d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcde7cd95-3b", "ovs_interfaceid": "cde7cd95-3b8b-4980-8abc-be5c221a40ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75045) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 23:22:37 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-8c4065e6-c3fd-47af-a18e-7048ffadfe81 tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] Converting VIF {"id": "cde7cd95-3b8b-4980-8abc-be5c221a40ff", "address": "fa:16:3e:2d:09:a7", "network": {"id": "08d1669a-f667-4c79-8e49-0ad183f57046", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1863648032-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bbb640407ef94f568aea892f1834d6d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcde7cd95-3b", "ovs_interfaceid": "cde7cd95-3b8b-4980-8abc-be5c221a40ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 23:22:37 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-8c4065e6-c3fd-47af-a18e-7048ffadfe81 tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2d:09:a7,bridge_name='br-int',has_traffic_filtering=True,id=cde7cd95-3b8b-4980-8abc-be5c221a40ff,network=Network(08d1669a-f667-4c79-8e49-0ad183f57046),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcde7cd95-3b') {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 23:22:37 user nova-compute[75045]: DEBUG nova.objects.instance [None req-8c4065e6-c3fd-47af-a18e-7048ffadfe81 tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] Lazy-loading 'pci_devices' on Instance uuid b5fc7f02-2143-4bcf-92ac-078d5ec10747 {{(pid=75045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 23:22:37 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-8c4065e6-c3fd-47af-a18e-7048ffadfe81 tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] [instance: b5fc7f02-2143-4bcf-92ac-078d5ec10747] End _get_guest_xml xml=<domain type="kvm">
Nov 08 23:22:37 user nova-compute[75045]:   <uuid>b5fc7f02-2143-4bcf-92ac-078d5ec10747</uuid>
Nov 08 23:22:37 user nova-compute[75045]:   <name>instance-00000013</name>
Nov 08 23:22:37 user nova-compute[75045]:   <memory>524288</memory>
Nov 08 23:22:37 user nova-compute[75045]:   <vcpu>1</vcpu>
Nov 08 23:22:37 user nova-compute[75045]:   <metadata>
Nov 08 23:22:37 user nova-compute[75045]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 23:22:37 user nova-compute[75045]:       <nova:package version="0.0.0"/>
Nov 08 23:22:37 user nova-compute[75045]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1199401266</nova:name>
Nov 08 23:22:37 user nova-compute[75045]:       <nova:creationTime>2023-11-08 23:22:37</nova:creationTime>
Nov 08 23:22:37 user nova-compute[75045]:       <nova:flavor name="m1.tiny">
Nov 08 23:22:37 user nova-compute[75045]:         <nova:memory>512</nova:memory>
Nov 08 23:22:37 user nova-compute[75045]:         <nova:disk>1</nova:disk>
Nov 08 23:22:37 user nova-compute[75045]:         <nova:swap>0</nova:swap>
Nov 08 23:22:37 user nova-compute[75045]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 23:22:37 user nova-compute[75045]:         <nova:vcpus>1</nova:vcpus>
Nov 08 23:22:37 user nova-compute[75045]:       </nova:flavor>
Nov 08 23:22:37 user nova-compute[75045]:       <nova:owner>
Nov 08 23:22:37 user nova-compute[75045]:         <nova:user uuid="f16e465ffb49488db3de445a473fd77a">tempest-ServerRescueNegativeTestJSON-187452128-project-member</nova:user>
Nov 08 23:22:37 user nova-compute[75045]:         <nova:project uuid="bbb640407ef94f568aea892f1834d6d1">tempest-ServerRescueNegativeTestJSON-187452128</nova:project>
Nov 08 23:22:37 user nova-compute[75045]:       </nova:owner>
Nov 08 23:22:37 user nova-compute[75045]:       <nova:root type="image" uuid="a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb"/>
Nov 08 23:22:37 user nova-compute[75045]:       <nova:ports>
Nov 08 23:22:37 user nova-compute[75045]:         <nova:port uuid="cde7cd95-3b8b-4980-8abc-be5c221a40ff">
Nov 08 23:22:37 user nova-compute[75045]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 08 23:22:37 user nova-compute[75045]:         </nova:port>
Nov 08 23:22:37 user nova-compute[75045]:       </nova:ports>
Nov 08 23:22:37 user nova-compute[75045]:     </nova:instance>
Nov 08 23:22:37 user nova-compute[75045]:   </metadata>
Nov 08 23:22:37 user nova-compute[75045]:   <sysinfo type="smbios">
Nov 08 23:22:37 user nova-compute[75045]:     <system>
Nov 08 23:22:37 user nova-compute[75045]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 23:22:37 user nova-compute[75045]:       <entry name="product">OpenStack Nova</entry>
Nov 08 23:22:37 user nova-compute[75045]:       <entry name="version">0.0.0</entry>
Nov 08 23:22:37 user nova-compute[75045]:       <entry name="serial">b5fc7f02-2143-4bcf-92ac-078d5ec10747</entry>
Nov 08 23:22:37 user nova-compute[75045]:       <entry name="uuid">b5fc7f02-2143-4bcf-92ac-078d5ec10747</entry>
Nov 08 23:22:37 user nova-compute[75045]:       <entry name="family">Virtual Machine</entry>
Nov 08 23:22:37 user nova-compute[75045]:     </system>
Nov 08 23:22:37 user nova-compute[75045]:   </sysinfo>
Nov 08 23:22:37 user nova-compute[75045]:   <os>
Nov 08 23:22:37 user nova-compute[75045]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 23:22:37 user nova-compute[75045]:     <boot dev="hd"/>
Nov 08 23:22:37 user nova-compute[75045]:     <smbios mode="sysinfo"/>
Nov 08 23:22:37 user nova-compute[75045]:   </os>
Nov 08 23:22:37 user nova-compute[75045]:   <features>
Nov 08 23:22:37 user nova-compute[75045]:     <acpi/>
Nov 08 23:22:37 user nova-compute[75045]:     <apic/>
Nov 08 23:22:37 user nova-compute[75045]:     <vmcoreinfo/>
Nov 08 23:22:37 user nova-compute[75045]:   </features>
Nov 08 23:22:37 user nova-compute[75045]:   <clock offset="utc">
Nov 08 23:22:37 user nova-compute[75045]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 23:22:37 user nova-compute[75045]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 23:22:37 user nova-compute[75045]:     <timer name="hpet" present="no"/>
Nov 08 23:22:37 user nova-compute[75045]:   </clock>
Nov 08 23:22:37 user nova-compute[75045]:   <cpu mode="custom" match="exact">
Nov 08 23:22:37 user nova-compute[75045]:     <model>Nehalem</model>
Nov 08 23:22:37 user nova-compute[75045]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 23:22:37 user nova-compute[75045]:   </cpu>
Nov 08 23:22:37 user nova-compute[75045]:   <devices>
Nov 08 23:22:37 user nova-compute[75045]:     <disk type="file" device="disk">
Nov 08 23:22:37 user nova-compute[75045]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 23:22:37 user nova-compute[75045]:       <source file="/opt/stack/data/nova/instances/b5fc7f02-2143-4bcf-92ac-078d5ec10747/disk"/>
Nov 08 23:22:37 user nova-compute[75045]:       <target dev="vda" bus="virtio"/>
Nov 08 23:22:37 user nova-compute[75045]:     </disk>
Nov 08 23:22:37 user nova-compute[75045]:     <interface type="ethernet">
Nov 08 23:22:37 user nova-compute[75045]:       <mac address="fa:16:3e:2d:09:a7"/>
Nov 08 23:22:37 user nova-compute[75045]:       <model type="virtio"/>
Nov 08 23:22:37 user nova-compute[75045]:       <mtu size="1442"/>
Nov 08 23:22:37 user nova-compute[75045]:       <target dev="tapcde7cd95-3b"/>
Nov 08 23:22:37 user nova-compute[75045]:     </interface>
Nov 08 23:22:37 user nova-compute[75045]:     <serial type="pty">
Nov 08 23:22:37 user nova-compute[75045]:       <log file="/opt/stack/data/nova/instances/b5fc7f02-2143-4bcf-92ac-078d5ec10747/console.log" append="off"/>
Nov 08 23:22:37 user nova-compute[75045]:     </serial>
Nov 08 23:22:37 user nova-compute[75045]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 23:22:37 user nova-compute[75045]:     <video>
Nov 08 23:22:37 user nova-compute[75045]:       <model type="virtio"/>
Nov 08 23:22:37 user nova-compute[75045]:     </video>
Nov 08 23:22:37 user nova-compute[75045]:     <rng model="virtio">
Nov 08 23:22:37 user nova-compute[75045]:       <backend model="random">/dev/urandom</backend>
Nov 08 23:22:37 user nova-compute[75045]:     </rng>
Nov 08 23:22:37 user nova-compute[75045]:     <controller type="usb" index="0" model="none"/>
Nov 08 23:22:37 user nova-compute[75045]:     <memballoon model="virtio">
Nov 08 23:22:37 user nova-compute[75045]:       <stats period="10"/>
Nov 08 23:22:37 user nova-compute[75045]:     </memballoon>
Nov 08 23:22:37 user nova-compute[75045]:   </devices>
Nov 08 23:22:37 user nova-compute[75045]: </domain>
Nov 08 23:22:37 user nova-compute[75045]:  {{(pid=75045) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 23:22:37 user nova-compute[75045]: DEBUG nova.virt.libvirt.vif [None req-8c4065e6-c3fd-47af-a18e-7048ffadfe81 tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T23:22:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1199401266',display_name='tempest-ServerRescueNegativeTestJSON-server-1199401266',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1199401266',id=19,image_ref='a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bbb640407ef94f568aea892f1834d6d1',ramdisk_id='',reservation_id='r-h0qi02cc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-187452128',owner_user_name='tempest-ServerRescueNegativeTestJSON-187452128-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T23:22:35Z,user_data=None,user_id='f16e465ffb49488db3de445a473fd77a',uuid=b5fc7f02-2143-4bcf-92ac-078d5ec10747,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cde7cd95-3b8b-4980-8abc-be5c221a40ff", "address": "fa:16:3e:2d:09:a7", "network": {"id": "08d1669a-f667-4c79-8e49-0ad183f57046", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1863648032-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bbb640407ef94f568aea892f1834d6d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcde7cd95-3b", "ovs_interfaceid": "cde7cd95-3b8b-4980-8abc-be5c221a40ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75045) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 23:22:37 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-8c4065e6-c3fd-47af-a18e-7048ffadfe81 tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] Converting VIF {"id": "cde7cd95-3b8b-4980-8abc-be5c221a40ff", "address": "fa:16:3e:2d:09:a7", "network": {"id": "08d1669a-f667-4c79-8e49-0ad183f57046", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1863648032-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bbb640407ef94f568aea892f1834d6d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcde7cd95-3b", "ovs_interfaceid": "cde7cd95-3b8b-4980-8abc-be5c221a40ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 23:22:37 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-8c4065e6-c3fd-47af-a18e-7048ffadfe81 tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2d:09:a7,bridge_name='br-int',has_traffic_filtering=True,id=cde7cd95-3b8b-4980-8abc-be5c221a40ff,network=Network(08d1669a-f667-4c79-8e49-0ad183f57046),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcde7cd95-3b') {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 23:22:37 user nova-compute[75045]: DEBUG os_vif [None req-8c4065e6-c3fd-47af-a18e-7048ffadfe81 tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2d:09:a7,bridge_name='br-int',has_traffic_filtering=True,id=cde7cd95-3b8b-4980-8abc-be5c221a40ff,network=Network(08d1669a-f667-4c79-8e49-0ad183f57046),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcde7cd95-3b') {{(pid=75045) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 23:22:37 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:22:37 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:22:37 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 23:22:37 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:22:37 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ffc17ed6-d1a5-5b38-a5a1-d2bc88a77a69', '_type': 'linux-noop'}}, row=False) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:22:37 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:22:37 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 23:22:37 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:22:37 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapcde7cd95-3b, may_exist=True, interface_attrs={}) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:22:37 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapcde7cd95-3b, col_values=(('qos', UUID('d06cfe41-7432-4e6f-ae2a-16511360a1ea')),), if_exists=True) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:22:37 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapcde7cd95-3b, col_values=(('external_ids', {'iface-id': 'cde7cd95-3b8b-4980-8abc-be5c221a40ff', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2d:09:a7', 'vm-uuid': 'b5fc7f02-2143-4bcf-92ac-078d5ec10747'}),), if_exists=True) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:22:37 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:22:37 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 23:22:37 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:22:37 user nova-compute[75045]: INFO os_vif [None req-8c4065e6-c3fd-47af-a18e-7048ffadfe81 tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2d:09:a7,bridge_name='br-int',has_traffic_filtering=True,id=cde7cd95-3b8b-4980-8abc-be5c221a40ff,network=Network(08d1669a-f667-4c79-8e49-0ad183f57046),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcde7cd95-3b')
Nov 08 23:22:37 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-8c4065e6-c3fd-47af-a18e-7048ffadfe81 tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] No BDM found with device name vda, not building metadata. {{(pid=75045) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 23:22:37 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-8c4065e6-c3fd-47af-a18e-7048ffadfe81 tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] No VIF found with MAC fa:16:3e:2d:09:a7, not building metadata {{(pid=75045) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 23:22:37 user nova-compute[75045]: DEBUG nova.network.neutron [None req-5261c1af-07e3-4bcb-ab02-74001e8faf9a tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] [instance: 0b84f2b1-01a3-4789-bcef-8b7c4334132b] Successfully updated port: c0a20899-be58-4d47-95e2-e129f636162c {{(pid=75045) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 23:22:37 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-5261c1af-07e3-4bcb-ab02-74001e8faf9a tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] Acquiring lock "refresh_cache-0b84f2b1-01a3-4789-bcef-8b7c4334132b" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 23:22:37 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-5261c1af-07e3-4bcb-ab02-74001e8faf9a tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] Acquired lock "refresh_cache-0b84f2b1-01a3-4789-bcef-8b7c4334132b" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 23:22:37 user nova-compute[75045]: DEBUG nova.network.neutron [None req-5261c1af-07e3-4bcb-ab02-74001e8faf9a tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] [instance: 0b84f2b1-01a3-4789-bcef-8b7c4334132b] Building network info cache for instance {{(pid=75045) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 23:22:37 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-66576810-7ef0-4d4a-ac8d-372aab6bc9bb tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] [instance: 032e20aa-8887-4215-808e-68299a0d8d0b] Creating instance directory {{(pid=75045) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 23:22:37 user nova-compute[75045]: INFO nova.virt.libvirt.driver [None req-66576810-7ef0-4d4a-ac8d-372aab6bc9bb tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] [instance: 032e20aa-8887-4215-808e-68299a0d8d0b] Creating image(s)
Nov 08 23:22:37 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-66576810-7ef0-4d4a-ac8d-372aab6bc9bb tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Acquiring lock "/opt/stack/data/nova/instances/032e20aa-8887-4215-808e-68299a0d8d0b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:22:37 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-66576810-7ef0-4d4a-ac8d-372aab6bc9bb tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Lock "/opt/stack/data/nova/instances/032e20aa-8887-4215-808e-68299a0d8d0b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:22:37 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-66576810-7ef0-4d4a-ac8d-372aab6bc9bb tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Lock "/opt/stack/data/nova/instances/032e20aa-8887-4215-808e-68299a0d8d0b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:22:37 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-66576810-7ef0-4d4a-ac8d-372aab6bc9bb tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b59f52a99fff51c56dd1edfb83892fb8f647f2f3 --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:22:37 user nova-compute[75045]: DEBUG nova.network.neutron [None req-5261c1af-07e3-4bcb-ab02-74001e8faf9a tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] [instance: 0b84f2b1-01a3-4789-bcef-8b7c4334132b] Instance cache missing network info. {{(pid=75045) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 23:22:37 user nova-compute[75045]: DEBUG nova.compute.manager [req-f73c1941-7784-4fd6-9b88-724b419c24b4 req-eca9aee8-f7d8-4c02-ac50-d6c058c6f5da service nova] [instance: 0b84f2b1-01a3-4789-bcef-8b7c4334132b] Received event network-changed-c0a20899-be58-4d47-95e2-e129f636162c {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:22:37 user nova-compute[75045]: DEBUG nova.compute.manager [req-f73c1941-7784-4fd6-9b88-724b419c24b4 req-eca9aee8-f7d8-4c02-ac50-d6c058c6f5da service nova] [instance: 0b84f2b1-01a3-4789-bcef-8b7c4334132b] Refreshing instance network info cache due to event network-changed-c0a20899-be58-4d47-95e2-e129f636162c. {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 23:22:37 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-f73c1941-7784-4fd6-9b88-724b419c24b4 req-eca9aee8-f7d8-4c02-ac50-d6c058c6f5da service nova] Acquiring lock "refresh_cache-0b84f2b1-01a3-4789-bcef-8b7c4334132b" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 23:22:37 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-66576810-7ef0-4d4a-ac8d-372aab6bc9bb tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b59f52a99fff51c56dd1edfb83892fb8f647f2f3 --force-share --output=json" returned: 0 in 0.228s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:22:37 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-66576810-7ef0-4d4a-ac8d-372aab6bc9bb tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Acquiring lock "b59f52a99fff51c56dd1edfb83892fb8f647f2f3" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:22:37 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-66576810-7ef0-4d4a-ac8d-372aab6bc9bb tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Lock "b59f52a99fff51c56dd1edfb83892fb8f647f2f3" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:22:37 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-66576810-7ef0-4d4a-ac8d-372aab6bc9bb tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b59f52a99fff51c56dd1edfb83892fb8f647f2f3 --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:22:37 user nova-compute[75045]: DEBUG nova.network.neutron [req-439d205d-4c15-4f36-b380-edbac0456ca1 req-51817d41-f3f8-40ce-96ac-db41411c5e4a service nova] [instance: b5fc7f02-2143-4bcf-92ac-078d5ec10747] Updated VIF entry in instance network info cache for port cde7cd95-3b8b-4980-8abc-be5c221a40ff. {{(pid=75045) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 23:22:37 user nova-compute[75045]: DEBUG nova.network.neutron [req-439d205d-4c15-4f36-b380-edbac0456ca1 req-51817d41-f3f8-40ce-96ac-db41411c5e4a service nova] [instance: b5fc7f02-2143-4bcf-92ac-078d5ec10747] Updating instance_info_cache with network_info: [{"id": "cde7cd95-3b8b-4980-8abc-be5c221a40ff", "address": "fa:16:3e:2d:09:a7", "network": {"id": "08d1669a-f667-4c79-8e49-0ad183f57046", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1863648032-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bbb640407ef94f568aea892f1834d6d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcde7cd95-3b", "ovs_interfaceid": "cde7cd95-3b8b-4980-8abc-be5c221a40ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75045) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 23:22:37 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-439d205d-4c15-4f36-b380-edbac0456ca1 req-51817d41-f3f8-40ce-96ac-db41411c5e4a service nova] Releasing lock "refresh_cache-b5fc7f02-2143-4bcf-92ac-078d5ec10747" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 23:22:37 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-66576810-7ef0-4d4a-ac8d-372aab6bc9bb tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b59f52a99fff51c56dd1edfb83892fb8f647f2f3 --force-share --output=json" returned: 0 in 0.201s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:22:37 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-66576810-7ef0-4d4a-ac8d-372aab6bc9bb tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b59f52a99fff51c56dd1edfb83892fb8f647f2f3,backing_fmt=raw /opt/stack/data/nova/instances/032e20aa-8887-4215-808e-68299a0d8d0b/disk 1073741824 {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:22:37 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-66576810-7ef0-4d4a-ac8d-372aab6bc9bb tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b59f52a99fff51c56dd1edfb83892fb8f647f2f3,backing_fmt=raw /opt/stack/data/nova/instances/032e20aa-8887-4215-808e-68299a0d8d0b/disk 1073741824" returned: 0 in 0.050s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:22:37 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-66576810-7ef0-4d4a-ac8d-372aab6bc9bb tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Lock "b59f52a99fff51c56dd1edfb83892fb8f647f2f3" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.258s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:22:37 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-66576810-7ef0-4d4a-ac8d-372aab6bc9bb tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b59f52a99fff51c56dd1edfb83892fb8f647f2f3 --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:22:38 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-66576810-7ef0-4d4a-ac8d-372aab6bc9bb tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b59f52a99fff51c56dd1edfb83892fb8f647f2f3 --force-share --output=json" returned: 0 in 0.183s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:22:38 user nova-compute[75045]: DEBUG nova.virt.disk.api [None req-66576810-7ef0-4d4a-ac8d-372aab6bc9bb tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Checking if we can resize image /opt/stack/data/nova/instances/032e20aa-8887-4215-808e-68299a0d8d0b/disk. size=1073741824 {{(pid=75045) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 23:22:38 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-66576810-7ef0-4d4a-ac8d-372aab6bc9bb tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/032e20aa-8887-4215-808e-68299a0d8d0b/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:22:38 user nova-compute[75045]: DEBUG nova.network.neutron [None req-5261c1af-07e3-4bcb-ab02-74001e8faf9a tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] [instance: 0b84f2b1-01a3-4789-bcef-8b7c4334132b] Updating instance_info_cache with network_info: [{"id": "c0a20899-be58-4d47-95e2-e129f636162c", "address": "fa:16:3e:69:a7:d0", "network": {"id": "08d1669a-f667-4c79-8e49-0ad183f57046", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1863648032-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bbb640407ef94f568aea892f1834d6d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0a20899-be", "ovs_interfaceid": "c0a20899-be58-4d47-95e2-e129f636162c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75045) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 23:22:38 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-5261c1af-07e3-4bcb-ab02-74001e8faf9a tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] Releasing lock "refresh_cache-0b84f2b1-01a3-4789-bcef-8b7c4334132b" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 23:22:38 user nova-compute[75045]: DEBUG nova.compute.manager [None req-5261c1af-07e3-4bcb-ab02-74001e8faf9a tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] [instance: 0b84f2b1-01a3-4789-bcef-8b7c4334132b] Instance network_info: |[{"id": "c0a20899-be58-4d47-95e2-e129f636162c", "address": "fa:16:3e:69:a7:d0", "network": {"id": "08d1669a-f667-4c79-8e49-0ad183f57046", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1863648032-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bbb640407ef94f568aea892f1834d6d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0a20899-be", "ovs_interfaceid": "c0a20899-be58-4d47-95e2-e129f636162c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75045) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 23:22:38 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-f73c1941-7784-4fd6-9b88-724b419c24b4 req-eca9aee8-f7d8-4c02-ac50-d6c058c6f5da service nova] Acquired lock "refresh_cache-0b84f2b1-01a3-4789-bcef-8b7c4334132b" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 23:22:38 user nova-compute[75045]: DEBUG nova.network.neutron [req-f73c1941-7784-4fd6-9b88-724b419c24b4 req-eca9aee8-f7d8-4c02-ac50-d6c058c6f5da service nova] [instance: 0b84f2b1-01a3-4789-bcef-8b7c4334132b] Refreshing network info cache for port c0a20899-be58-4d47-95e2-e129f636162c {{(pid=75045) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 23:22:38 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-5261c1af-07e3-4bcb-ab02-74001e8faf9a tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] [instance: 0b84f2b1-01a3-4789-bcef-8b7c4334132b] Start _get_guest_xml network_info=[{"id": "c0a20899-be58-4d47-95e2-e129f636162c", "address": "fa:16:3e:69:a7:d0", "network": {"id": "08d1669a-f667-4c79-8e49-0ad183f57046", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1863648032-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bbb640407ef94f568aea892f1834d6d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0a20899-be", "ovs_interfaceid": "c0a20899-be58-4d47-95e2-e129f636162c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T23:11:54Z,direct_url=<?>,disk_format='qcow2',id=a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b1beba2cc4e7465ea249e2225fb494dc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T23:11:56Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'disk_bus': 'virtio', 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': 'a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75045) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 23:22:38 user nova-compute[75045]: WARNING nova.virt.libvirt.driver [None req-5261c1af-07e3-4bcb-ab02-74001e8faf9a tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 23:22:38 user nova-compute[75045]: WARNING nova.virt.libvirt.driver [None req-5261c1af-07e3-4bcb-ab02-74001e8faf9a tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 23:22:38 user nova-compute[75045]: DEBUG nova.virt.libvirt.host [None req-5261c1af-07e3-4bcb-ab02-74001e8faf9a tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75045) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 23:22:38 user nova-compute[75045]: DEBUG nova.virt.libvirt.host [None req-5261c1af-07e3-4bcb-ab02-74001e8faf9a tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] CPU controller missing on host. {{(pid=75045) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 23:22:38 user nova-compute[75045]: DEBUG nova.virt.libvirt.host [None req-5261c1af-07e3-4bcb-ab02-74001e8faf9a tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75045) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 23:22:38 user nova-compute[75045]: DEBUG nova.virt.libvirt.host [None req-5261c1af-07e3-4bcb-ab02-74001e8faf9a tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] CPU controller found on host. {{(pid=75045) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 23:22:38 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-5261c1af-07e3-4bcb-ab02-74001e8faf9a tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75045) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 23:22:38 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-5261c1af-07e3-4bcb-ab02-74001e8faf9a tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T23:11:41Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T23:11:54Z,direct_url=<?>,disk_format='qcow2',id=a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b1beba2cc4e7465ea249e2225fb494dc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T23:11:56Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75045) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 23:22:38 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-5261c1af-07e3-4bcb-ab02-74001e8faf9a tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] Flavor limits 0:0:0 {{(pid=75045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 23:22:38 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-5261c1af-07e3-4bcb-ab02-74001e8faf9a tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] Image limits 0:0:0 {{(pid=75045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 23:22:38 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-5261c1af-07e3-4bcb-ab02-74001e8faf9a tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] Flavor pref 0:0:0 {{(pid=75045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 23:22:38 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-5261c1af-07e3-4bcb-ab02-74001e8faf9a tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] Image pref 0:0:0 {{(pid=75045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 23:22:38 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-5261c1af-07e3-4bcb-ab02-74001e8faf9a tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 23:22:38 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-5261c1af-07e3-4bcb-ab02-74001e8faf9a tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75045) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 23:22:38 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-5261c1af-07e3-4bcb-ab02-74001e8faf9a tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75045) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 23:22:38 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-5261c1af-07e3-4bcb-ab02-74001e8faf9a tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] Got 1 possible topologies {{(pid=75045) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 23:22:38 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-5261c1af-07e3-4bcb-ab02-74001e8faf9a tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75045) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 23:22:38 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-5261c1af-07e3-4bcb-ab02-74001e8faf9a tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75045) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 23:22:38 user nova-compute[75045]: DEBUG nova.virt.libvirt.vif [None req-5261c1af-07e3-4bcb-ab02-74001e8faf9a tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T23:22:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-2049313631',display_name='tempest-ServerRescueNegativeTestJSON-server-2049313631',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-2049313631',id=20,image_ref='a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bbb640407ef94f568aea892f1834d6d1',ramdisk_id='',reservation_id='r-boxb4qwm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-187452128',owner_user_name='tempest-ServerRescueNegativeTestJSON-187452128-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T23:22:36Z,user_data=None,user_id='f16e465ffb49488db3de445a473fd77a',uuid=0b84f2b1-01a3-4789-bcef-8b7c4334132b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c0a20899-be58-4d47-95e2-e129f636162c", "address": "fa:16:3e:69:a7:d0", "network": {"id": "08d1669a-f667-4c79-8e49-0ad183f57046", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1863648032-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bbb640407ef94f568aea892f1834d6d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0a20899-be", "ovs_interfaceid": "c0a20899-be58-4d47-95e2-e129f636162c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75045) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 23:22:38 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-5261c1af-07e3-4bcb-ab02-74001e8faf9a tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] Converting VIF {"id": "c0a20899-be58-4d47-95e2-e129f636162c", "address": "fa:16:3e:69:a7:d0", "network": {"id": "08d1669a-f667-4c79-8e49-0ad183f57046", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1863648032-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bbb640407ef94f568aea892f1834d6d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0a20899-be", "ovs_interfaceid": "c0a20899-be58-4d47-95e2-e129f636162c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 23:22:38 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-5261c1af-07e3-4bcb-ab02-74001e8faf9a tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:69:a7:d0,bridge_name='br-int',has_traffic_filtering=True,id=c0a20899-be58-4d47-95e2-e129f636162c,network=Network(08d1669a-f667-4c79-8e49-0ad183f57046),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc0a20899-be') {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 23:22:38 user nova-compute[75045]: DEBUG nova.objects.instance [None req-5261c1af-07e3-4bcb-ab02-74001e8faf9a tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] Lazy-loading 'pci_devices' on Instance uuid 0b84f2b1-01a3-4789-bcef-8b7c4334132b {{(pid=75045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 23:22:38 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-66576810-7ef0-4d4a-ac8d-372aab6bc9bb tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/032e20aa-8887-4215-808e-68299a0d8d0b/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:22:38 user nova-compute[75045]: DEBUG nova.virt.disk.api [None req-66576810-7ef0-4d4a-ac8d-372aab6bc9bb tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Cannot resize image /opt/stack/data/nova/instances/032e20aa-8887-4215-808e-68299a0d8d0b/disk to a smaller size. {{(pid=75045) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 08 23:22:38 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-66576810-7ef0-4d4a-ac8d-372aab6bc9bb tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] [instance: 032e20aa-8887-4215-808e-68299a0d8d0b] Created local disks {{(pid=75045) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 23:22:38 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-66576810-7ef0-4d4a-ac8d-372aab6bc9bb tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] [instance: 032e20aa-8887-4215-808e-68299a0d8d0b] Ensure instance console log exists: /opt/stack/data/nova/instances/032e20aa-8887-4215-808e-68299a0d8d0b/console.log {{(pid=75045) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 23:22:38 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-66576810-7ef0-4d4a-ac8d-372aab6bc9bb tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:22:38 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-66576810-7ef0-4d4a-ac8d-372aab6bc9bb tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:22:38 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-66576810-7ef0-4d4a-ac8d-372aab6bc9bb tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:22:38 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-66576810-7ef0-4d4a-ac8d-372aab6bc9bb tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] [instance: 032e20aa-8887-4215-808e-68299a0d8d0b] Start _get_guest_xml network_info=[{"id": "9cd2b9ae-f99a-4f33-8b8b-e2013d3c05e6", "address": "fa:16:3e:df:66:51", "network": {"id": "700b5784-d35b-45c0-a4d3-1ab8aa4c48aa", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-194469807-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.181", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e63623113f11463d9035bb990de43510", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9cd2b9ae-f9", "ovs_interfaceid": "9cd2b9ae-f99a-4f33-8b8b-e2013d3c05e6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T23:11:54Z,direct_url=<?>,disk_format='qcow2',id=a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b1beba2cc4e7465ea249e2225fb494dc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T23:11:56Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'disk_bus': 'virtio', 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': 'a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb'}], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'device_type': 'disk', 'attachment_id': '5c8de9dd-6d29-453e-b63d-0870a5043cfd', 'guest_format': None, 'disk_bus': 'virtio', 'boot_index': None, 'mount_device': '/dev/vdb', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:45f1b635-c8a3-4727-a4c7-c2ac441388ff', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SPlwFCBD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '032e20aa-8887-4215-808e-68299a0d8d0b', 'attached_at': '', 'detached_at': '', 'volume_id': '45f1b635-c8a3-4727-a4c7-c2ac441388ff', 'serial': '45f1b635-c8a3-4727-a4c7-c2ac441388ff'}, 'volume_type': None} {{(pid=75045) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 23:22:38 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-5261c1af-07e3-4bcb-ab02-74001e8faf9a tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] [instance: 0b84f2b1-01a3-4789-bcef-8b7c4334132b] End _get_guest_xml xml=<domain type="kvm">
Nov 08 23:22:38 user nova-compute[75045]:   <uuid>0b84f2b1-01a3-4789-bcef-8b7c4334132b</uuid>
Nov 08 23:22:38 user nova-compute[75045]:   <name>instance-00000014</name>
Nov 08 23:22:38 user nova-compute[75045]:   <memory>524288</memory>
Nov 08 23:22:38 user nova-compute[75045]:   <vcpu>1</vcpu>
Nov 08 23:22:38 user nova-compute[75045]:   <metadata>
Nov 08 23:22:38 user nova-compute[75045]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 23:22:38 user nova-compute[75045]:       <nova:package version="0.0.0"/>
Nov 08 23:22:38 user nova-compute[75045]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-2049313631</nova:name>
Nov 08 23:22:38 user nova-compute[75045]:       <nova:creationTime>2023-11-08 23:22:38</nova:creationTime>
Nov 08 23:22:38 user nova-compute[75045]:       <nova:flavor name="m1.tiny">
Nov 08 23:22:38 user nova-compute[75045]:         <nova:memory>512</nova:memory>
Nov 08 23:22:38 user nova-compute[75045]:         <nova:disk>1</nova:disk>
Nov 08 23:22:38 user nova-compute[75045]:         <nova:swap>0</nova:swap>
Nov 08 23:22:38 user nova-compute[75045]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 23:22:38 user nova-compute[75045]:         <nova:vcpus>1</nova:vcpus>
Nov 08 23:22:38 user nova-compute[75045]:       </nova:flavor>
Nov 08 23:22:38 user nova-compute[75045]:       <nova:owner>
Nov 08 23:22:38 user nova-compute[75045]:         <nova:user uuid="f16e465ffb49488db3de445a473fd77a">tempest-ServerRescueNegativeTestJSON-187452128-project-member</nova:user>
Nov 08 23:22:38 user nova-compute[75045]:         <nova:project uuid="bbb640407ef94f568aea892f1834d6d1">tempest-ServerRescueNegativeTestJSON-187452128</nova:project>
Nov 08 23:22:38 user nova-compute[75045]:       </nova:owner>
Nov 08 23:22:38 user nova-compute[75045]:       <nova:root type="image" uuid="a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb"/>
Nov 08 23:22:38 user nova-compute[75045]:       <nova:ports>
Nov 08 23:22:38 user nova-compute[75045]:         <nova:port uuid="c0a20899-be58-4d47-95e2-e129f636162c">
Nov 08 23:22:38 user nova-compute[75045]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 08 23:22:38 user nova-compute[75045]:         </nova:port>
Nov 08 23:22:38 user nova-compute[75045]:       </nova:ports>
Nov 08 23:22:38 user nova-compute[75045]:     </nova:instance>
Nov 08 23:22:38 user nova-compute[75045]:   </metadata>
Nov 08 23:22:38 user nova-compute[75045]:   <sysinfo type="smbios">
Nov 08 23:22:38 user nova-compute[75045]:     <system>
Nov 08 23:22:38 user nova-compute[75045]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 23:22:38 user nova-compute[75045]:       <entry name="product">OpenStack Nova</entry>
Nov 08 23:22:38 user nova-compute[75045]:       <entry name="version">0.0.0</entry>
Nov 08 23:22:38 user nova-compute[75045]:       <entry name="serial">0b84f2b1-01a3-4789-bcef-8b7c4334132b</entry>
Nov 08 23:22:38 user nova-compute[75045]:       <entry name="uuid">0b84f2b1-01a3-4789-bcef-8b7c4334132b</entry>
Nov 08 23:22:38 user nova-compute[75045]:       <entry name="family">Virtual Machine</entry>
Nov 08 23:22:38 user nova-compute[75045]:     </system>
Nov 08 23:22:38 user nova-compute[75045]:   </sysinfo>
Nov 08 23:22:38 user nova-compute[75045]:   <os>
Nov 08 23:22:38 user nova-compute[75045]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 23:22:38 user nova-compute[75045]:     <boot dev="hd"/>
Nov 08 23:22:38 user nova-compute[75045]:     <smbios mode="sysinfo"/>
Nov 08 23:22:38 user nova-compute[75045]:   </os>
Nov 08 23:22:38 user nova-compute[75045]:   <features>
Nov 08 23:22:38 user nova-compute[75045]:     <acpi/>
Nov 08 23:22:38 user nova-compute[75045]:     <apic/>
Nov 08 23:22:38 user nova-compute[75045]:     <vmcoreinfo/>
Nov 08 23:22:38 user nova-compute[75045]:   </features>
Nov 08 23:22:38 user nova-compute[75045]:   <clock offset="utc">
Nov 08 23:22:38 user nova-compute[75045]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 23:22:38 user nova-compute[75045]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 23:22:38 user nova-compute[75045]:     <timer name="hpet" present="no"/>
Nov 08 23:22:38 user nova-compute[75045]:   </clock>
Nov 08 23:22:38 user nova-compute[75045]:   <cpu mode="custom" match="exact">
Nov 08 23:22:38 user nova-compute[75045]:     <model>Nehalem</model>
Nov 08 23:22:38 user nova-compute[75045]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 23:22:38 user nova-compute[75045]:   </cpu>
Nov 08 23:22:38 user nova-compute[75045]:   <devices>
Nov 08 23:22:38 user nova-compute[75045]:     <disk type="file" device="disk">
Nov 08 23:22:38 user nova-compute[75045]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 23:22:38 user nova-compute[75045]:       <source file="/opt/stack/data/nova/instances/0b84f2b1-01a3-4789-bcef-8b7c4334132b/disk"/>
Nov 08 23:22:38 user nova-compute[75045]:       <target dev="vda" bus="virtio"/>
Nov 08 23:22:38 user nova-compute[75045]:     </disk>
Nov 08 23:22:38 user nova-compute[75045]:     <interface type="ethernet">
Nov 08 23:22:38 user nova-compute[75045]:       <mac address="fa:16:3e:69:a7:d0"/>
Nov 08 23:22:38 user nova-compute[75045]:       <model type="virtio"/>
Nov 08 23:22:38 user nova-compute[75045]:       <mtu size="1442"/>
Nov 08 23:22:38 user nova-compute[75045]:       <target dev="tapc0a20899-be"/>
Nov 08 23:22:38 user nova-compute[75045]:     </interface>
Nov 08 23:22:38 user nova-compute[75045]:     <serial type="pty">
Nov 08 23:22:38 user nova-compute[75045]:       <log file="/opt/stack/data/nova/instances/0b84f2b1-01a3-4789-bcef-8b7c4334132b/console.log" append="off"/>
Nov 08 23:22:38 user nova-compute[75045]:     </serial>
Nov 08 23:22:38 user nova-compute[75045]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 23:22:38 user nova-compute[75045]:     <video>
Nov 08 23:22:38 user nova-compute[75045]:       <model type="virtio"/>
Nov 08 23:22:38 user nova-compute[75045]:     </video>
Nov 08 23:22:38 user nova-compute[75045]:     <rng model="virtio">
Nov 08 23:22:38 user nova-compute[75045]:       <backend model="random">/dev/urandom</backend>
Nov 08 23:22:38 user nova-compute[75045]:     </rng>
Nov 08 23:22:38 user nova-compute[75045]:     <controller type="usb" index="0" model="none"/>
Nov 08 23:22:38 user nova-compute[75045]:     <memballoon model="virtio">
Nov 08 23:22:38 user nova-compute[75045]:       <stats period="10"/>
Nov 08 23:22:38 user nova-compute[75045]:     </memballoon>
Nov 08 23:22:38 user nova-compute[75045]:   </devices>
Nov 08 23:22:38 user nova-compute[75045]: </domain>
Nov 08 23:22:38 user nova-compute[75045]:  {{(pid=75045) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 23:22:38 user nova-compute[75045]: DEBUG nova.virt.libvirt.vif [None req-5261c1af-07e3-4bcb-ab02-74001e8faf9a tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T23:22:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-2049313631',display_name='tempest-ServerRescueNegativeTestJSON-server-2049313631',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-2049313631',id=20,image_ref='a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bbb640407ef94f568aea892f1834d6d1',ramdisk_id='',reservation_id='r-boxb4qwm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-187452128',owner_user_name='tempest-ServerRescueNegativeTestJSON-187452128-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T23:22:36Z,user_data=None,user_id='f16e465ffb49488db3de445a473fd77a',uuid=0b84f2b1-01a3-4789-bcef-8b7c4334132b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c0a20899-be58-4d47-95e2-e129f636162c", "address": "fa:16:3e:69:a7:d0", "network": {"id": "08d1669a-f667-4c79-8e49-0ad183f57046", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1863648032-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bbb640407ef94f568aea892f1834d6d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0a20899-be", "ovs_interfaceid": "c0a20899-be58-4d47-95e2-e129f636162c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75045) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 23:22:38 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-5261c1af-07e3-4bcb-ab02-74001e8faf9a tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] Converting VIF {"id": "c0a20899-be58-4d47-95e2-e129f636162c", "address": "fa:16:3e:69:a7:d0", "network": {"id": "08d1669a-f667-4c79-8e49-0ad183f57046", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1863648032-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bbb640407ef94f568aea892f1834d6d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0a20899-be", "ovs_interfaceid": "c0a20899-be58-4d47-95e2-e129f636162c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 23:22:38 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-5261c1af-07e3-4bcb-ab02-74001e8faf9a tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:69:a7:d0,bridge_name='br-int',has_traffic_filtering=True,id=c0a20899-be58-4d47-95e2-e129f636162c,network=Network(08d1669a-f667-4c79-8e49-0ad183f57046),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc0a20899-be') {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 23:22:38 user nova-compute[75045]: DEBUG os_vif [None req-5261c1af-07e3-4bcb-ab02-74001e8faf9a tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:69:a7:d0,bridge_name='br-int',has_traffic_filtering=True,id=c0a20899-be58-4d47-95e2-e129f636162c,network=Network(08d1669a-f667-4c79-8e49-0ad183f57046),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc0a20899-be') {{(pid=75045) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 23:22:38 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:22:38 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:22:38 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 23:22:38 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:22:38 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '68d2c91d-a785-59d9-b4e1-3c88159307b9', '_type': 'linux-noop'}}, row=False) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:22:38 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:22:38 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 23:22:38 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:22:38 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:22:38 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc0a20899-be, may_exist=True, interface_attrs={}) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:22:38 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc0a20899-be, col_values=(('qos', UUID('ac4d8242-652e-4a40-a439-eec265e16d98')),), if_exists=True) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:22:38 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc0a20899-be, col_values=(('external_ids', {'iface-id': 'c0a20899-be58-4d47-95e2-e129f636162c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:69:a7:d0', 'vm-uuid': '0b84f2b1-01a3-4789-bcef-8b7c4334132b'}),), if_exists=True) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:22:38 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:22:38 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 23:22:38 user nova-compute[75045]: WARNING nova.virt.libvirt.driver [None req-66576810-7ef0-4d4a-ac8d-372aab6bc9bb tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 08 23:22:38 user nova-compute[75045]: WARNING nova.virt.libvirt.driver [None req-66576810-7ef0-4d4a-ac8d-372aab6bc9bb tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 08 23:22:38 user nova-compute[75045]: DEBUG nova.virt.libvirt.host [None req-66576810-7ef0-4d4a-ac8d-372aab6bc9bb tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75045) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 23:22:38 user nova-compute[75045]: DEBUG nova.virt.libvirt.host [None req-66576810-7ef0-4d4a-ac8d-372aab6bc9bb tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] CPU controller missing on host. {{(pid=75045) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 23:22:38 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:22:38 user nova-compute[75045]: INFO os_vif [None req-5261c1af-07e3-4bcb-ab02-74001e8faf9a tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:69:a7:d0,bridge_name='br-int',has_traffic_filtering=True,id=c0a20899-be58-4d47-95e2-e129f636162c,network=Network(08d1669a-f667-4c79-8e49-0ad183f57046),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc0a20899-be')
Nov 08 23:22:38 user nova-compute[75045]: DEBUG nova.virt.libvirt.host [None req-66576810-7ef0-4d4a-ac8d-372aab6bc9bb tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75045) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 23:22:38 user nova-compute[75045]: DEBUG nova.virt.libvirt.host [None req-66576810-7ef0-4d4a-ac8d-372aab6bc9bb tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] CPU controller found on host. {{(pid=75045) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 23:22:38 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-66576810-7ef0-4d4a-ac8d-372aab6bc9bb tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75045) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 23:22:38 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-66576810-7ef0-4d4a-ac8d-372aab6bc9bb tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T23:11:41Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T23:11:54Z,direct_url=<?>,disk_format='qcow2',id=a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b1beba2cc4e7465ea249e2225fb494dc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T23:11:56Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75045) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 23:22:38 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-66576810-7ef0-4d4a-ac8d-372aab6bc9bb tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Flavor limits 0:0:0 {{(pid=75045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 23:22:38 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-66576810-7ef0-4d4a-ac8d-372aab6bc9bb tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Image limits 0:0:0 {{(pid=75045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 23:22:38 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-66576810-7ef0-4d4a-ac8d-372aab6bc9bb tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Flavor pref 0:0:0 {{(pid=75045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 23:22:38 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-66576810-7ef0-4d4a-ac8d-372aab6bc9bb tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Image pref 0:0:0 {{(pid=75045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 23:22:38 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-66576810-7ef0-4d4a-ac8d-372aab6bc9bb tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 23:22:38 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-66576810-7ef0-4d4a-ac8d-372aab6bc9bb tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75045) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 23:22:38 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-66576810-7ef0-4d4a-ac8d-372aab6bc9bb tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75045) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 23:22:38 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-66576810-7ef0-4d4a-ac8d-372aab6bc9bb tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Got 1 possible topologies {{(pid=75045) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 23:22:38 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-66576810-7ef0-4d4a-ac8d-372aab6bc9bb tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75045) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 23:22:38 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-66576810-7ef0-4d4a-ac8d-372aab6bc9bb tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75045) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 23:22:38 user nova-compute[75045]: DEBUG nova.objects.instance [None req-66576810-7ef0-4d4a-ac8d-372aab6bc9bb tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Lazy-loading 'vcpu_model' on Instance uuid 032e20aa-8887-4215-808e-68299a0d8d0b {{(pid=75045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 23:22:38 user nova-compute[75045]: DEBUG nova.virt.libvirt.volume.iscsi [None req-66576810-7ef0-4d4a-ac8d-372aab6bc9bb tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] [instance: 032e20aa-8887-4215-808e-68299a0d8d0b] Calling os-brick to attach iSCSI Volume {{(pid=75045) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 23:22:38 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-66576810-7ef0-4d4a-ac8d-372aab6bc9bb tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1b68210460>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:45f1b635-c8a3-4727-a4c7-c2ac441388ff', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SPlwFCBD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75045) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 23:22:38 user nova-compute[75045]: WARNING os_brick.initiator.connectors.base [None req-66576810-7ef0-4d4a-ac8d-372aab6bc9bb tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 08 23:22:38 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-66576810-7ef0-4d4a-ac8d-372aab6bc9bb tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 23:22:38 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-66576810-7ef0-4d4a-ac8d-372aab6bc9bb tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 23:22:38 user nova-compute[75045]: WARNING os_brick.initiator.connectors.base [None req-66576810-7ef0-4d4a-ac8d-372aab6bc9bb tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 08 23:22:38 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-66576810-7ef0-4d4a-ac8d-372aab6bc9bb tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:45f1b635-c8a3-4727-a4c7-c2ac441388ff" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 23:22:38 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-66576810-7ef0-4d4a-ac8d-372aab6bc9bb tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:45f1b635-c8a3-4727-a4c7-c2ac441388ff" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 23:22:38 user nova-compute[75045]: INFO os_brick.initiator.connectors.iscsi [None req-66576810-7ef0-4d4a-ac8d-372aab6bc9bb tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 23:22:38 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45f1b635-c8a3-4727-a4c7-c2ac441388ff -p 172.16.0.220:3260 {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:22:38 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45f1b635-c8a3-4727-a4c7-c2ac441388ff -p 172.16.0.220:3260" returned: 21 in 0.025s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:22:38 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a5f61ae-b96b-431b-8e3c-ffebd133c591]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:22:38 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-66576810-7ef0-4d4a-ac8d-372aab6bc9bb tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 23:22:38 user nova-compute[75045]:  {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:22:38 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45f1b635-c8a3-4727-a4c7-c2ac441388ff -p 172.16.0.220:3260 --interface default --op new {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:22:38 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-5261c1af-07e3-4bcb-ab02-74001e8faf9a tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] No BDM found with device name vda, not building metadata. {{(pid=75045) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 23:22:38 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-5261c1af-07e3-4bcb-ab02-74001e8faf9a tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] No VIF found with MAC fa:16:3e:69:a7:d0, not building metadata {{(pid=75045) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 23:22:38 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45f1b635-c8a3-4727-a4c7-c2ac441388ff -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:22:38 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ea4a196-84d6-4562-b037-9e5e50a7d322]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:45f1b635-c8a3-4727-a4c7-c2ac441388ff] added\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:22:38 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-66576810-7ef0-4d4a-ac8d-372aab6bc9bb tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:45f1b635-c8a3-4727-a4c7-c2ac441388ff] added
Nov 08 23:22:38 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:22:38 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45f1b635-c8a3-4727-a4c7-c2ac441388ff -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:22:38 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45f1b635-c8a3-4727-a4c7-c2ac441388ff -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:22:38 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[db7745a6-4f69-4a62-b053-c12599dc4d89]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:22:38 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-66576810-7ef0-4d4a-ac8d-372aab6bc9bb tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:22:38 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45f1b635-c8a3-4727-a4c7-c2ac441388ff -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:22:38 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45f1b635-c8a3-4727-a4c7-c2ac441388ff -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:22:38 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbe38287-8bdd-41a2-b25b-80fa81e4687d]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:22:38 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-66576810-7ef0-4d4a-ac8d-372aab6bc9bb tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:22:38 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45f1b635-c8a3-4727-a4c7-c2ac441388ff -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SPlwFCBD {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:22:38 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45f1b635-c8a3-4727-a4c7-c2ac441388ff -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SPlwFCBD" returned: 0 in 0.023s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:22:38 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[316ecee2-1375-46ba-8577-eefef62d7318]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:22:38 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-66576810-7ef0-4d4a-ac8d-372aab6bc9bb tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'SPlwFCBD'): stdout= stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:22:38 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45f1b635-c8a3-4727-a4c7-c2ac441388ff -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:22:38 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45f1b635-c8a3-4727-a4c7-c2ac441388ff -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:22:38 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dfd4a79-477f-4ae9-9b3a-d3c1e5588e69]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:22:38 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-66576810-7ef0-4d4a-ac8d-372aab6bc9bb tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:22:38 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:22:38 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:22:38 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec4ce3ac-45b7-4203-abb7-de710868cb1b]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7f7084f-f0d7-4d4b-9a14-69065a9c3e41 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2068946-d374-45a4-9850-e3a690b13ef4 (non-flash)\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:22:38 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-66576810-7ef0-4d4a-ac8d-372aab6bc9bb tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab (non-flash)
Nov 08 23:22:38 user nova-compute[75045]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7f7084f-f0d7-4d4b-9a14-69065a9c3e41 (non-flash)
Nov 08 23:22:38 user nova-compute[75045]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2068946-d374-45a4-9850-e3a690b13ef4 (non-flash)
Nov 08 23:22:38 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 23:22:38 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-66576810-7ef0-4d4a-ac8d-372aab6bc9bb tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab (non-flash)
Nov 08 23:22:38 user nova-compute[75045]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7f7084f-f0d7-4d4b-9a14-69065a9c3e41 (non-flash)
Nov 08 23:22:38 user nova-compute[75045]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2068946-d374-45a4-9850-e3a690b13ef4 (non-flash)
Nov 08 23:22:38 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 23:22:38 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45f1b635-c8a3-4727-a4c7-c2ac441388ff -p 172.16.0.220:3260 --login {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:22:38 user nova-compute[75045]: DEBUG nova.network.neutron [req-f73c1941-7784-4fd6-9b88-724b419c24b4 req-eca9aee8-f7d8-4c02-ac50-d6c058c6f5da service nova] [instance: 0b84f2b1-01a3-4789-bcef-8b7c4334132b] Updated VIF entry in instance network info cache for port c0a20899-be58-4d47-95e2-e129f636162c. {{(pid=75045) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 23:22:38 user nova-compute[75045]: DEBUG nova.network.neutron [req-f73c1941-7784-4fd6-9b88-724b419c24b4 req-eca9aee8-f7d8-4c02-ac50-d6c058c6f5da service nova] [instance: 0b84f2b1-01a3-4789-bcef-8b7c4334132b] Updating instance_info_cache with network_info: [{"id": "c0a20899-be58-4d47-95e2-e129f636162c", "address": "fa:16:3e:69:a7:d0", "network": {"id": "08d1669a-f667-4c79-8e49-0ad183f57046", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1863648032-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bbb640407ef94f568aea892f1834d6d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0a20899-be", "ovs_interfaceid": "c0a20899-be58-4d47-95e2-e129f636162c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75045) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 23:22:38 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-f73c1941-7784-4fd6-9b88-724b419c24b4 req-eca9aee8-f7d8-4c02-ac50-d6c058c6f5da service nova] Releasing lock "refresh_cache-0b84f2b1-01a3-4789-bcef-8b7c4334132b" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 23:22:38 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45f1b635-c8a3-4727-a4c7-c2ac441388ff -p 172.16.0.220:3260 --login" returned: 0 in 0.073s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:22:38 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[125def60-8bac-4f05-9679-156cb9e015dd]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:45f1b635-c8a3-4727-a4c7-c2ac441388ff, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:45f1b635-c8a3-4727-a4c7-c2ac441388ff, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:22:38 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-66576810-7ef0-4d4a-ac8d-372aab6bc9bb tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:45f1b635-c8a3-4727-a4c7-c2ac441388ff, portal: 172.16.0.220,3260]
Nov 08 23:22:38 user nova-compute[75045]: Login to [iface: default, target: iqn.2010-10.org.openstack:45f1b635-c8a3-4727-a4c7-c2ac441388ff, portal: 172.16.0.220,3260] successful.
Nov 08 23:22:38 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:22:38 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45f1b635-c8a3-4727-a4c7-c2ac441388ff -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:22:38 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45f1b635-c8a3-4727-a4c7-c2ac441388ff -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:22:38 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[a60e9904-8107-49a4-96fb-84d908862491]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:22:38 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-66576810-7ef0-4d4a-ac8d-372aab6bc9bb tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:22:38 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:22:38 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:22:38 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcdaacae-27bf-4d50-8440-32659bb15f98]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7f7084f-f0d7-4d4b-9a14-69065a9c3e41 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2068946-d374-45a4-9850-e3a690b13ef4 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45f1b635-c8a3-4727-a4c7-c2ac441388ff (non-flash)\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:22:38 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-66576810-7ef0-4d4a-ac8d-372aab6bc9bb tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab (non-flash)
Nov 08 23:22:38 user nova-compute[75045]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7f7084f-f0d7-4d4b-9a14-69065a9c3e41 (non-flash)
Nov 08 23:22:38 user nova-compute[75045]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2068946-d374-45a4-9850-e3a690b13ef4 (non-flash)
Nov 08 23:22:38 user nova-compute[75045]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45f1b635-c8a3-4727-a4c7-c2ac441388ff (non-flash)
Nov 08 23:22:38 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 23:22:38 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-66576810-7ef0-4d4a-ac8d-372aab6bc9bb tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab (non-flash)
Nov 08 23:22:38 user nova-compute[75045]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7f7084f-f0d7-4d4b-9a14-69065a9c3e41 (non-flash)
Nov 08 23:22:38 user nova-compute[75045]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2068946-d374-45a4-9850-e3a690b13ef4 (non-flash)
Nov 08 23:22:38 user nova-compute[75045]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45f1b635-c8a3-4727-a4c7-c2ac441388ff (non-flash)
Nov 08 23:22:38 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 23:22:38 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-66576810-7ef0-4d4a-ac8d-372aab6bc9bb tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:45f1b635-c8a3-4727-a4c7-c2ac441388ff" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.369s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 23:22:38 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-66576810-7ef0-4d4a-ac8d-372aab6bc9bb tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Connected to 172.16.0.220:3260 {{(pid=75045) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 23:22:38 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-66576810-7ef0-4d4a-ac8d-372aab6bc9bb tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] HCTL ('34', '-', '-', 0) found on session 16 with lun 0 {{(pid=75045) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 23:22:38 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-66576810-7ef0-4d4a-ac8d-372aab6bc9bb tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75045) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 23:22:38 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:22:38 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:22:38 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[1301855c-4595-44e0-9a0a-ac1c656f5118]: (4, ('- - 0', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:22:38 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-66576810-7ef0-4d4a-ac8d-372aab6bc9bb tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Searching for a device in session 16 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75045) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 23:22:38 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-66576810-7ef0-4d4a-ac8d-372aab6bc9bb tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:45f1b635-c8a3-4727-a4c7-c2ac441388ff', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SPlwFCBD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75045) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 23:22:38 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:22:38 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:22:38 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:22:38 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:22:38 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:22:38 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager.update_available_resource {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:22:39 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:22:39 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:22:39 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:22:39 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Auditing locally available compute resources for user (node: user) {{(pid=75045) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 23:22:39 user nova-compute[75045]: DEBUG nova.compute.manager [req-606b7f5f-d8d0-4b31-b0d9-5d4ec61825aa req-bbabe8fb-44a3-4650-b452-9d4d85736389 service nova] [instance: b5fc7f02-2143-4bcf-92ac-078d5ec10747] Received event network-vif-plugged-cde7cd95-3b8b-4980-8abc-be5c221a40ff {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:22:39 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-606b7f5f-d8d0-4b31-b0d9-5d4ec61825aa req-bbabe8fb-44a3-4650-b452-9d4d85736389 service nova] Acquiring lock "b5fc7f02-2143-4bcf-92ac-078d5ec10747-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:22:39 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-606b7f5f-d8d0-4b31-b0d9-5d4ec61825aa req-bbabe8fb-44a3-4650-b452-9d4d85736389 service nova] Lock "b5fc7f02-2143-4bcf-92ac-078d5ec10747-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:22:39 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-606b7f5f-d8d0-4b31-b0d9-5d4ec61825aa req-bbabe8fb-44a3-4650-b452-9d4d85736389 service nova] Lock "b5fc7f02-2143-4bcf-92ac-078d5ec10747-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:22:39 user nova-compute[75045]: DEBUG nova.compute.manager [req-606b7f5f-d8d0-4b31-b0d9-5d4ec61825aa req-bbabe8fb-44a3-4650-b452-9d4d85736389 service nova] [instance: b5fc7f02-2143-4bcf-92ac-078d5ec10747] No waiting events found dispatching network-vif-plugged-cde7cd95-3b8b-4980-8abc-be5c221a40ff {{(pid=75045) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 23:22:39 user nova-compute[75045]: WARNING nova.compute.manager [req-606b7f5f-d8d0-4b31-b0d9-5d4ec61825aa req-bbabe8fb-44a3-4650-b452-9d4d85736389 service nova] [instance: b5fc7f02-2143-4bcf-92ac-078d5ec10747] Received unexpected event network-vif-plugged-cde7cd95-3b8b-4980-8abc-be5c221a40ff for instance with vm_state building and task_state spawning.
Nov 08 23:22:39 user nova-compute[75045]: DEBUG nova.compute.manager [req-606b7f5f-d8d0-4b31-b0d9-5d4ec61825aa req-bbabe8fb-44a3-4650-b452-9d4d85736389 service nova] [instance: b5fc7f02-2143-4bcf-92ac-078d5ec10747] Received event network-vif-plugged-cde7cd95-3b8b-4980-8abc-be5c221a40ff {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:22:39 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-606b7f5f-d8d0-4b31-b0d9-5d4ec61825aa req-bbabe8fb-44a3-4650-b452-9d4d85736389 service nova] Acquiring lock "b5fc7f02-2143-4bcf-92ac-078d5ec10747-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:22:39 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-606b7f5f-d8d0-4b31-b0d9-5d4ec61825aa req-bbabe8fb-44a3-4650-b452-9d4d85736389 service nova] Lock "b5fc7f02-2143-4bcf-92ac-078d5ec10747-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:22:39 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-606b7f5f-d8d0-4b31-b0d9-5d4ec61825aa req-bbabe8fb-44a3-4650-b452-9d4d85736389 service nova] Lock "b5fc7f02-2143-4bcf-92ac-078d5ec10747-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:22:39 user nova-compute[75045]: DEBUG nova.compute.manager [req-606b7f5f-d8d0-4b31-b0d9-5d4ec61825aa req-bbabe8fb-44a3-4650-b452-9d4d85736389 service nova] [instance: b5fc7f02-2143-4bcf-92ac-078d5ec10747] No waiting events found dispatching network-vif-plugged-cde7cd95-3b8b-4980-8abc-be5c221a40ff {{(pid=75045) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 23:22:39 user nova-compute[75045]: WARNING nova.compute.manager [req-606b7f5f-d8d0-4b31-b0d9-5d4ec61825aa req-bbabe8fb-44a3-4650-b452-9d4d85736389 service nova] [instance: b5fc7f02-2143-4bcf-92ac-078d5ec10747] Received unexpected event network-vif-plugged-cde7cd95-3b8b-4980-8abc-be5c221a40ff for instance with vm_state building and task_state spawning.
Nov 08 23:22:39 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:22:39 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:22:39 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:22:39 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:22:39 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:22:39 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-66576810-7ef0-4d4a-ac8d-372aab6bc9bb tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.410s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 23:22:39 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-66576810-7ef0-4d4a-ac8d-372aab6bc9bb tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] <== connect_volume: return (1413ms) {'type': 'block', 'scsi_wwn': '23132653939646233', 'path': '/dev/sdc'} {{(pid=75045) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 23:22:39 user nova-compute[75045]: DEBUG nova.virt.libvirt.volume.iscsi [None req-66576810-7ef0-4d4a-ac8d-372aab6bc9bb tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] [instance: 032e20aa-8887-4215-808e-68299a0d8d0b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23132653939646233', 'path': '/dev/sdc'} {{(pid=75045) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 23:22:39 user nova-compute[75045]: DEBUG nova.virt.libvirt.vif [None req-66576810-7ef0-4d4a-ac8d-372aab6bc9bb tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-08T23:19:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1752899834',display_name='tempest-ServerActionsTestOtherA-server-1825293127',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1752899834',id=14,image_ref='a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM+q2m9WsZpZxsu7IWDJqTSDAyt9zen9gZBXmCH3tBzXyeyKdTBcMPy8pYQxPGeGnPRc+jFEID8sOJopOMmrv8cAChFAOof4/DA6j4PlbpQ3YcCnU4/0PdUKZbkLWBt7Jg==',key_name='tempest-keypair-1151386852',keypairs=<?>,launch_index=0,launched_at=2023-11-08T23:19:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='e63623113f11463d9035bb990de43510',ramdisk_id='',reservation_id='r-vxqzthcz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-2056815713',owner_user_name='tempest-ServerActionsTestOtherA-2056815713-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T23:22:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='75fc508f268d4a569ad78598ff019c14',uuid=032e20aa-8887-4215-808e-68299a0d8d0b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9cd2b9ae-f99a-4f33-8b8b-e2013d3c05e6", "address": "fa:16:3e:df:66:51", "network": {"id": "700b5784-d35b-45c0-a4d3-1ab8aa4c48aa", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-194469807-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.181", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e63623113f11463d9035bb990de43510", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9cd2b9ae-f9", "ovs_interfaceid": "9cd2b9ae-f99a-4f33-8b8b-e2013d3c05e6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75045) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 23:22:39 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-66576810-7ef0-4d4a-ac8d-372aab6bc9bb tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Converting VIF {"id": "9cd2b9ae-f99a-4f33-8b8b-e2013d3c05e6", "address": "fa:16:3e:df:66:51", "network": {"id": "700b5784-d35b-45c0-a4d3-1ab8aa4c48aa", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-194469807-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.181", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e63623113f11463d9035bb990de43510", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9cd2b9ae-f9", "ovs_interfaceid": "9cd2b9ae-f99a-4f33-8b8b-e2013d3c05e6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 23:22:39 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-66576810-7ef0-4d4a-ac8d-372aab6bc9bb tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:df:66:51,bridge_name='br-int',has_traffic_filtering=True,id=9cd2b9ae-f99a-4f33-8b8b-e2013d3c05e6,network=Network(700b5784-d35b-45c0-a4d3-1ab8aa4c48aa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9cd2b9ae-f9') {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 23:22:39 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-66576810-7ef0-4d4a-ac8d-372aab6bc9bb tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] [instance: 032e20aa-8887-4215-808e-68299a0d8d0b] End _get_guest_xml xml=<domain type="kvm">
Nov 08 23:22:39 user nova-compute[75045]:   <uuid>032e20aa-8887-4215-808e-68299a0d8d0b</uuid>
Nov 08 23:22:39 user nova-compute[75045]:   <name>instance-0000000e</name>
Nov 08 23:22:39 user nova-compute[75045]:   <memory>524288</memory>
Nov 08 23:22:39 user nova-compute[75045]:   <vcpu>1</vcpu>
Nov 08 23:22:39 user nova-compute[75045]:   <metadata>
Nov 08 23:22:39 user nova-compute[75045]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 23:22:39 user nova-compute[75045]:       <nova:package version="0.0.0"/>
Nov 08 23:22:39 user nova-compute[75045]:       <nova:name>tempest-ServerActionsTestOtherA-server-1825293127</nova:name>
Nov 08 23:22:39 user nova-compute[75045]:       <nova:creationTime>2023-11-08 23:22:38</nova:creationTime>
Nov 08 23:22:39 user nova-compute[75045]:       <nova:flavor name="m1.tiny">
Nov 08 23:22:39 user nova-compute[75045]:         <nova:memory>512</nova:memory>
Nov 08 23:22:39 user nova-compute[75045]:         <nova:disk>1</nova:disk>
Nov 08 23:22:39 user nova-compute[75045]:         <nova:swap>0</nova:swap>
Nov 08 23:22:39 user nova-compute[75045]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 23:22:39 user nova-compute[75045]:         <nova:vcpus>1</nova:vcpus>
Nov 08 23:22:39 user nova-compute[75045]:       </nova:flavor>
Nov 08 23:22:39 user nova-compute[75045]:       <nova:owner>
Nov 08 23:22:39 user nova-compute[75045]:         <nova:user uuid="75fc508f268d4a569ad78598ff019c14">tempest-ServerActionsTestOtherA-2056815713-project-member</nova:user>
Nov 08 23:22:39 user nova-compute[75045]:         <nova:project uuid="e63623113f11463d9035bb990de43510">tempest-ServerActionsTestOtherA-2056815713</nova:project>
Nov 08 23:22:39 user nova-compute[75045]:       </nova:owner>
Nov 08 23:22:39 user nova-compute[75045]:       <nova:root type="image" uuid="a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb"/>
Nov 08 23:22:39 user nova-compute[75045]:       <nova:ports>
Nov 08 23:22:39 user nova-compute[75045]:         <nova:port uuid="9cd2b9ae-f99a-4f33-8b8b-e2013d3c05e6">
Nov 08 23:22:39 user nova-compute[75045]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 08 23:22:39 user nova-compute[75045]:         </nova:port>
Nov 08 23:22:39 user nova-compute[75045]:       </nova:ports>
Nov 08 23:22:39 user nova-compute[75045]:     </nova:instance>
Nov 08 23:22:39 user nova-compute[75045]:   </metadata>
Nov 08 23:22:39 user nova-compute[75045]:   <sysinfo type="smbios">
Nov 08 23:22:39 user nova-compute[75045]:     <system>
Nov 08 23:22:39 user nova-compute[75045]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 23:22:39 user nova-compute[75045]:       <entry name="product">OpenStack Nova</entry>
Nov 08 23:22:39 user nova-compute[75045]:       <entry name="version">0.0.0</entry>
Nov 08 23:22:39 user nova-compute[75045]:       <entry name="serial">032e20aa-8887-4215-808e-68299a0d8d0b</entry>
Nov 08 23:22:39 user nova-compute[75045]:       <entry name="uuid">032e20aa-8887-4215-808e-68299a0d8d0b</entry>
Nov 08 23:22:39 user nova-compute[75045]:       <entry name="family">Virtual Machine</entry>
Nov 08 23:22:39 user nova-compute[75045]:     </system>
Nov 08 23:22:39 user nova-compute[75045]:   </sysinfo>
Nov 08 23:22:39 user nova-compute[75045]:   <os>
Nov 08 23:22:39 user nova-compute[75045]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 23:22:39 user nova-compute[75045]:     <boot dev="hd"/>
Nov 08 23:22:39 user nova-compute[75045]:     <smbios mode="sysinfo"/>
Nov 08 23:22:39 user nova-compute[75045]:   </os>
Nov 08 23:22:39 user nova-compute[75045]:   <features>
Nov 08 23:22:39 user nova-compute[75045]:     <acpi/>
Nov 08 23:22:39 user nova-compute[75045]:     <apic/>
Nov 08 23:22:39 user nova-compute[75045]:     <vmcoreinfo/>
Nov 08 23:22:39 user nova-compute[75045]:   </features>
Nov 08 23:22:39 user nova-compute[75045]:   <clock offset="utc">
Nov 08 23:22:39 user nova-compute[75045]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 23:22:39 user nova-compute[75045]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 23:22:39 user nova-compute[75045]:     <timer name="hpet" present="no"/>
Nov 08 23:22:39 user nova-compute[75045]:   </clock>
Nov 08 23:22:39 user nova-compute[75045]:   <cpu mode="custom" match="exact">
Nov 08 23:22:39 user nova-compute[75045]:     <model>Nehalem</model>
Nov 08 23:22:39 user nova-compute[75045]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 23:22:39 user nova-compute[75045]:   </cpu>
Nov 08 23:22:39 user nova-compute[75045]:   <devices>
Nov 08 23:22:39 user nova-compute[75045]:     <disk type="file" device="disk">
Nov 08 23:22:39 user nova-compute[75045]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 23:22:39 user nova-compute[75045]:       <source file="/opt/stack/data/nova/instances/032e20aa-8887-4215-808e-68299a0d8d0b/disk"/>
Nov 08 23:22:39 user nova-compute[75045]:       <target dev="vda" bus="virtio"/>
Nov 08 23:22:39 user nova-compute[75045]:     </disk>
Nov 08 23:22:39 user nova-compute[75045]:     <disk type="block" device="disk">
Nov 08 23:22:39 user nova-compute[75045]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 23:22:39 user nova-compute[75045]:       <source dev="/dev/sdc"/>
Nov 08 23:22:39 user nova-compute[75045]:       <target dev="vdb" bus="virtio"/>
Nov 08 23:22:39 user nova-compute[75045]:       <serial>45f1b635-c8a3-4727-a4c7-c2ac441388ff</serial>
Nov 08 23:22:39 user nova-compute[75045]:     </disk>
Nov 08 23:22:39 user nova-compute[75045]:     <interface type="ethernet">
Nov 08 23:22:39 user nova-compute[75045]:       <mac address="fa:16:3e:df:66:51"/>
Nov 08 23:22:39 user nova-compute[75045]:       <model type="virtio"/>
Nov 08 23:22:39 user nova-compute[75045]:       <mtu size="1442"/>
Nov 08 23:22:39 user nova-compute[75045]:       <target dev="tap9cd2b9ae-f9"/>
Nov 08 23:22:39 user nova-compute[75045]:     </interface>
Nov 08 23:22:39 user nova-compute[75045]:     <serial type="pty">
Nov 08 23:22:39 user nova-compute[75045]:       <log file="/opt/stack/data/nova/instances/032e20aa-8887-4215-808e-68299a0d8d0b/console.log" append="off"/>
Nov 08 23:22:39 user nova-compute[75045]:     </serial>
Nov 08 23:22:39 user nova-compute[75045]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 23:22:39 user nova-compute[75045]:     <video>
Nov 08 23:22:39 user nova-compute[75045]:       <model type="virtio"/>
Nov 08 23:22:39 user nova-compute[75045]:     </video>
Nov 08 23:22:39 user nova-compute[75045]:     <rng model="virtio">
Nov 08 23:22:39 user nova-compute[75045]:       <backend model="random">/dev/urandom</backend>
Nov 08 23:22:39 user nova-compute[75045]:     </rng>
Nov 08 23:22:39 user nova-compute[75045]:     <controller type="usb" index="0" model="none"/>
Nov 08 23:22:39 user nova-compute[75045]:     <memballoon model="virtio">
Nov 08 23:22:39 user nova-compute[75045]:       <stats period="10"/>
Nov 08 23:22:39 user nova-compute[75045]:     </memballoon>
Nov 08 23:22:39 user nova-compute[75045]:   </devices>
Nov 08 23:22:39 user nova-compute[75045]: </domain>
Nov 08 23:22:39 user nova-compute[75045]:  {{(pid=75045) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 23:22:39 user nova-compute[75045]: DEBUG nova.virt.libvirt.vif [None req-66576810-7ef0-4d4a-ac8d-372aab6bc9bb tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-08T23:19:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1752899834',display_name='tempest-ServerActionsTestOtherA-server-1825293127',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1752899834',id=14,image_ref='a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM+q2m9WsZpZxsu7IWDJqTSDAyt9zen9gZBXmCH3tBzXyeyKdTBcMPy8pYQxPGeGnPRc+jFEID8sOJopOMmrv8cAChFAOof4/DA6j4PlbpQ3YcCnU4/0PdUKZbkLWBt7Jg==',key_name='tempest-keypair-1151386852',keypairs=<?>,launch_index=0,launched_at=2023-11-08T23:19:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='e63623113f11463d9035bb990de43510',ramdisk_id='',reservation_id='r-vxqzthcz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-2056815713',owner_user_name='tempest-ServerActionsTestOtherA-2056815713-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T23:22:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='75fc508f268d4a569ad78598ff019c14',uuid=032e20aa-8887-4215-808e-68299a0d8d0b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9cd2b9ae-f99a-4f33-8b8b-e2013d3c05e6", "address": "fa:16:3e:df:66:51", "network": {"id": "700b5784-d35b-45c0-a4d3-1ab8aa4c48aa", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-194469807-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.181", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e63623113f11463d9035bb990de43510", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9cd2b9ae-f9", "ovs_interfaceid": "9cd2b9ae-f99a-4f33-8b8b-e2013d3c05e6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75045) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 23:22:39 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-66576810-7ef0-4d4a-ac8d-372aab6bc9bb tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Converting VIF {"id": "9cd2b9ae-f99a-4f33-8b8b-e2013d3c05e6", "address": "fa:16:3e:df:66:51", "network": {"id": "700b5784-d35b-45c0-a4d3-1ab8aa4c48aa", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-194469807-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.181", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e63623113f11463d9035bb990de43510", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9cd2b9ae-f9", "ovs_interfaceid": "9cd2b9ae-f99a-4f33-8b8b-e2013d3c05e6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 23:22:39 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-66576810-7ef0-4d4a-ac8d-372aab6bc9bb tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:df:66:51,bridge_name='br-int',has_traffic_filtering=True,id=9cd2b9ae-f99a-4f33-8b8b-e2013d3c05e6,network=Network(700b5784-d35b-45c0-a4d3-1ab8aa4c48aa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9cd2b9ae-f9') {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 23:22:39 user nova-compute[75045]: DEBUG os_vif [None req-66576810-7ef0-4d4a-ac8d-372aab6bc9bb tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:df:66:51,bridge_name='br-int',has_traffic_filtering=True,id=9cd2b9ae-f99a-4f33-8b8b-e2013d3c05e6,network=Network(700b5784-d35b-45c0-a4d3-1ab8aa4c48aa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9cd2b9ae-f9') {{(pid=75045) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 23:22:39 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:22:39 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:22:39 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 23:22:39 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:22:39 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd5aa8d43-4bad-5e40-84b6-e61495b4fa74', '_type': 'linux-noop'}}, row=False) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:22:39 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:22:39 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 23:22:39 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:22:39 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:22:39 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9cd2b9ae-f9, may_exist=True, interface_attrs={}) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:22:39 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9cd2b9ae-f9, col_values=(('qos', UUID('e2fac339-762c-4c34-93e2-d1f406bd302e')),), if_exists=True) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:22:39 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9cd2b9ae-f9, col_values=(('external_ids', {'iface-id': '9cd2b9ae-f99a-4f33-8b8b-e2013d3c05e6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:df:66:51', 'vm-uuid': '032e20aa-8887-4215-808e-68299a0d8d0b'}),), if_exists=True) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:22:39 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:22:39 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 23:22:39 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:22:39 user nova-compute[75045]: INFO os_vif [None req-66576810-7ef0-4d4a-ac8d-372aab6bc9bb tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:df:66:51,bridge_name='br-int',has_traffic_filtering=True,id=9cd2b9ae-f99a-4f33-8b8b-e2013d3c05e6,network=Network(700b5784-d35b-45c0-a4d3-1ab8aa4c48aa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9cd2b9ae-f9')
Nov 08 23:22:40 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-66576810-7ef0-4d4a-ac8d-372aab6bc9bb tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] No BDM found with device name vda, not building metadata. {{(pid=75045) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 23:22:40 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-66576810-7ef0-4d4a-ac8d-372aab6bc9bb tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75045) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 23:22:40 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-66576810-7ef0-4d4a-ac8d-372aab6bc9bb tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] No VIF found with MAC fa:16:3e:df:66:51, not building metadata {{(pid=75045) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 23:22:40 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:22:41 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:22:41 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:22:41 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:22:41 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:22:41 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:22:41 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:22:42 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:22:42 user nova-compute[75045]: DEBUG nova.compute.manager [req-1ee60685-03ed-4adb-90cc-49b417cd14d8 req-f042911a-3ad9-448c-8706-e8f2458ed889 service nova] [instance: 0b84f2b1-01a3-4789-bcef-8b7c4334132b] Received event network-vif-plugged-c0a20899-be58-4d47-95e2-e129f636162c {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:22:42 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-1ee60685-03ed-4adb-90cc-49b417cd14d8 req-f042911a-3ad9-448c-8706-e8f2458ed889 service nova] Acquiring lock "0b84f2b1-01a3-4789-bcef-8b7c4334132b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:22:42 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-1ee60685-03ed-4adb-90cc-49b417cd14d8 req-f042911a-3ad9-448c-8706-e8f2458ed889 service nova] Lock "0b84f2b1-01a3-4789-bcef-8b7c4334132b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:22:42 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-1ee60685-03ed-4adb-90cc-49b417cd14d8 req-f042911a-3ad9-448c-8706-e8f2458ed889 service nova] Lock "0b84f2b1-01a3-4789-bcef-8b7c4334132b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:22:42 user nova-compute[75045]: DEBUG nova.compute.manager [req-1ee60685-03ed-4adb-90cc-49b417cd14d8 req-f042911a-3ad9-448c-8706-e8f2458ed889 service nova] [instance: 0b84f2b1-01a3-4789-bcef-8b7c4334132b] No waiting events found dispatching network-vif-plugged-c0a20899-be58-4d47-95e2-e129f636162c {{(pid=75045) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 23:22:42 user nova-compute[75045]: WARNING nova.compute.manager [req-1ee60685-03ed-4adb-90cc-49b417cd14d8 req-f042911a-3ad9-448c-8706-e8f2458ed889 service nova] [instance: 0b84f2b1-01a3-4789-bcef-8b7c4334132b] Received unexpected event network-vif-plugged-c0a20899-be58-4d47-95e2-e129f636162c for instance with vm_state building and task_state spawning.
Nov 08 23:22:42 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:22:43 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ae5ff6b-6f2c-4dfd-a4c6-da4809e2cf27/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:22:43 user nova-compute[75045]: DEBUG nova.compute.manager [None req-8c4065e6-c3fd-47af-a18e-7048ffadfe81 tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] [instance: b5fc7f02-2143-4bcf-92ac-078d5ec10747] Instance event wait completed in 0 seconds for  {{(pid=75045) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 23:22:43 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-8c4065e6-c3fd-47af-a18e-7048ffadfe81 tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] [instance: b5fc7f02-2143-4bcf-92ac-078d5ec10747] Guest created on hypervisor {{(pid=75045) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 23:22:43 user nova-compute[75045]: INFO nova.virt.libvirt.driver [-] [instance: b5fc7f02-2143-4bcf-92ac-078d5ec10747] Instance spawned successfully.
Nov 08 23:22:43 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-8c4065e6-c3fd-47af-a18e-7048ffadfe81 tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] [instance: b5fc7f02-2143-4bcf-92ac-078d5ec10747] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75045) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 23:22:43 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-8c4065e6-c3fd-47af-a18e-7048ffadfe81 tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] [instance: b5fc7f02-2143-4bcf-92ac-078d5ec10747] Found default for hw_cdrom_bus of ide {{(pid=75045) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 23:22:43 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-8c4065e6-c3fd-47af-a18e-7048ffadfe81 tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] [instance: b5fc7f02-2143-4bcf-92ac-078d5ec10747] Found default for hw_disk_bus of virtio {{(pid=75045) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 23:22:43 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-8c4065e6-c3fd-47af-a18e-7048ffadfe81 tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] [instance: b5fc7f02-2143-4bcf-92ac-078d5ec10747] Found default for hw_input_bus of None {{(pid=75045) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 23:22:43 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-8c4065e6-c3fd-47af-a18e-7048ffadfe81 tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] [instance: b5fc7f02-2143-4bcf-92ac-078d5ec10747] Found default for hw_pointer_model of None {{(pid=75045) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 23:22:43 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-8c4065e6-c3fd-47af-a18e-7048ffadfe81 tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] [instance: b5fc7f02-2143-4bcf-92ac-078d5ec10747] Found default for hw_video_model of virtio {{(pid=75045) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 23:22:43 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-8c4065e6-c3fd-47af-a18e-7048ffadfe81 tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] [instance: b5fc7f02-2143-4bcf-92ac-078d5ec10747] Found default for hw_vif_model of virtio {{(pid=75045) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 23:22:43 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ae5ff6b-6f2c-4dfd-a4c6-da4809e2cf27/disk --force-share --output=json" returned: 0 in 0.240s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:22:43 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ae5ff6b-6f2c-4dfd-a4c6-da4809e2cf27/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:22:43 user nova-compute[75045]: INFO nova.compute.manager [None req-8c4065e6-c3fd-47af-a18e-7048ffadfe81 tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] [instance: b5fc7f02-2143-4bcf-92ac-078d5ec10747] Took 8.78 seconds to spawn the instance on the hypervisor.
Nov 08 23:22:43 user nova-compute[75045]: DEBUG nova.compute.manager [None req-8c4065e6-c3fd-47af-a18e-7048ffadfe81 tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] [instance: b5fc7f02-2143-4bcf-92ac-078d5ec10747] Checking state {{(pid=75045) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 23:22:43 user nova-compute[75045]: INFO nova.compute.manager [None req-8c4065e6-c3fd-47af-a18e-7048ffadfe81 tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] [instance: b5fc7f02-2143-4bcf-92ac-078d5ec10747] Took 9.88 seconds to build instance.
Nov 08 23:22:43 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ae5ff6b-6f2c-4dfd-a4c6-da4809e2cf27/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:22:43 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-8c4065e6-c3fd-47af-a18e-7048ffadfe81 tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] Lock "b5fc7f02-2143-4bcf-92ac-078d5ec10747" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:22:43 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] skipping disk /dev/sdh (vda) as it is a volume {{(pid=75045) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 23:22:43 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2c911cf-d5f4-4c19-8335-8c7834184a7e/disk.rescue --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:22:43 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2c911cf-d5f4-4c19-8335-8c7834184a7e/disk.rescue --force-share --output=json" returned: 0 in 0.270s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:22:43 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2c911cf-d5f4-4c19-8335-8c7834184a7e/disk.rescue --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:22:44 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2c911cf-d5f4-4c19-8335-8c7834184a7e/disk.rescue --force-share --output=json" returned: 0 in 0.258s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:22:44 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/032e20aa-8887-4215-808e-68299a0d8d0b/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:22:44 user nova-compute[75045]: DEBUG nova.compute.manager [req-679dc519-d6c9-451d-bb56-6bbf0e941977 req-b130924d-4035-4ec8-b118-1c690f616c5e service nova] [instance: 0b84f2b1-01a3-4789-bcef-8b7c4334132b] Received event network-vif-plugged-c0a20899-be58-4d47-95e2-e129f636162c {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:22:44 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-679dc519-d6c9-451d-bb56-6bbf0e941977 req-b130924d-4035-4ec8-b118-1c690f616c5e service nova] Acquiring lock "0b84f2b1-01a3-4789-bcef-8b7c4334132b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:22:44 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-679dc519-d6c9-451d-bb56-6bbf0e941977 req-b130924d-4035-4ec8-b118-1c690f616c5e service nova] Lock "0b84f2b1-01a3-4789-bcef-8b7c4334132b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:22:44 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-679dc519-d6c9-451d-bb56-6bbf0e941977 req-b130924d-4035-4ec8-b118-1c690f616c5e service nova] Lock "0b84f2b1-01a3-4789-bcef-8b7c4334132b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:22:44 user nova-compute[75045]: DEBUG nova.compute.manager [req-679dc519-d6c9-451d-bb56-6bbf0e941977 req-b130924d-4035-4ec8-b118-1c690f616c5e service nova] [instance: 0b84f2b1-01a3-4789-bcef-8b7c4334132b] No waiting events found dispatching network-vif-plugged-c0a20899-be58-4d47-95e2-e129f636162c {{(pid=75045) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 23:22:44 user nova-compute[75045]: WARNING nova.compute.manager [req-679dc519-d6c9-451d-bb56-6bbf0e941977 req-b130924d-4035-4ec8-b118-1c690f616c5e service nova] [instance: 0b84f2b1-01a3-4789-bcef-8b7c4334132b] Received unexpected event network-vif-plugged-c0a20899-be58-4d47-95e2-e129f636162c for instance with vm_state building and task_state spawning.
Nov 08 23:22:44 user nova-compute[75045]: DEBUG nova.compute.manager [req-679dc519-d6c9-451d-bb56-6bbf0e941977 req-b130924d-4035-4ec8-b118-1c690f616c5e service nova] [instance: 032e20aa-8887-4215-808e-68299a0d8d0b] Received event network-vif-plugged-9cd2b9ae-f99a-4f33-8b8b-e2013d3c05e6 {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:22:44 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-679dc519-d6c9-451d-bb56-6bbf0e941977 req-b130924d-4035-4ec8-b118-1c690f616c5e service nova] Acquiring lock "032e20aa-8887-4215-808e-68299a0d8d0b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:22:44 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-679dc519-d6c9-451d-bb56-6bbf0e941977 req-b130924d-4035-4ec8-b118-1c690f616c5e service nova] Lock "032e20aa-8887-4215-808e-68299a0d8d0b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:22:44 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-679dc519-d6c9-451d-bb56-6bbf0e941977 req-b130924d-4035-4ec8-b118-1c690f616c5e service nova] Lock "032e20aa-8887-4215-808e-68299a0d8d0b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:22:44 user nova-compute[75045]: DEBUG nova.compute.manager [req-679dc519-d6c9-451d-bb56-6bbf0e941977 req-b130924d-4035-4ec8-b118-1c690f616c5e service nova] [instance: 032e20aa-8887-4215-808e-68299a0d8d0b] No waiting events found dispatching network-vif-plugged-9cd2b9ae-f99a-4f33-8b8b-e2013d3c05e6 {{(pid=75045) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 23:22:44 user nova-compute[75045]: WARNING nova.compute.manager [req-679dc519-d6c9-451d-bb56-6bbf0e941977 req-b130924d-4035-4ec8-b118-1c690f616c5e service nova] [instance: 032e20aa-8887-4215-808e-68299a0d8d0b] Received unexpected event network-vif-plugged-9cd2b9ae-f99a-4f33-8b8b-e2013d3c05e6 for instance with vm_state active and task_state rebuild_spawning.
Nov 08 23:22:44 user nova-compute[75045]: DEBUG nova.compute.manager [req-679dc519-d6c9-451d-bb56-6bbf0e941977 req-b130924d-4035-4ec8-b118-1c690f616c5e service nova] [instance: 032e20aa-8887-4215-808e-68299a0d8d0b] Received event network-vif-plugged-9cd2b9ae-f99a-4f33-8b8b-e2013d3c05e6 {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:22:44 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-679dc519-d6c9-451d-bb56-6bbf0e941977 req-b130924d-4035-4ec8-b118-1c690f616c5e service nova] Acquiring lock "032e20aa-8887-4215-808e-68299a0d8d0b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:22:44 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-679dc519-d6c9-451d-bb56-6bbf0e941977 req-b130924d-4035-4ec8-b118-1c690f616c5e service nova] Lock "032e20aa-8887-4215-808e-68299a0d8d0b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:22:44 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-679dc519-d6c9-451d-bb56-6bbf0e941977 req-b130924d-4035-4ec8-b118-1c690f616c5e service nova] Lock "032e20aa-8887-4215-808e-68299a0d8d0b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:22:44 user nova-compute[75045]: DEBUG nova.compute.manager [req-679dc519-d6c9-451d-bb56-6bbf0e941977 req-b130924d-4035-4ec8-b118-1c690f616c5e service nova] [instance: 032e20aa-8887-4215-808e-68299a0d8d0b] No waiting events found dispatching network-vif-plugged-9cd2b9ae-f99a-4f33-8b8b-e2013d3c05e6 {{(pid=75045) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 23:22:44 user nova-compute[75045]: WARNING nova.compute.manager [req-679dc519-d6c9-451d-bb56-6bbf0e941977 req-b130924d-4035-4ec8-b118-1c690f616c5e service nova] [instance: 032e20aa-8887-4215-808e-68299a0d8d0b] Received unexpected event network-vif-plugged-9cd2b9ae-f99a-4f33-8b8b-e2013d3c05e6 for instance with vm_state active and task_state rebuild_spawning.
Nov 08 23:22:44 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/032e20aa-8887-4215-808e-68299a0d8d0b/disk --force-share --output=json" returned: 0 in 0.276s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:22:44 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/032e20aa-8887-4215-808e-68299a0d8d0b/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:22:44 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/032e20aa-8887-4215-808e-68299a0d8d0b/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:22:44 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75045) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 23:22:44 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f21fcd3-ac5f-499e-9c34-82af806fda1d/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:22:44 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f21fcd3-ac5f-499e-9c34-82af806fda1d/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:22:44 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f21fcd3-ac5f-499e-9c34-82af806fda1d/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:22:44 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:22:44 user nova-compute[75045]: DEBUG nova.compute.manager [None req-5261c1af-07e3-4bcb-ab02-74001e8faf9a tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] [instance: 0b84f2b1-01a3-4789-bcef-8b7c4334132b] Instance event wait completed in 0 seconds for  {{(pid=75045) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 23:22:44 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-5261c1af-07e3-4bcb-ab02-74001e8faf9a tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] [instance: 0b84f2b1-01a3-4789-bcef-8b7c4334132b] Guest created on hypervisor {{(pid=75045) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 23:22:44 user nova-compute[75045]: INFO nova.virt.libvirt.driver [-] [instance: 0b84f2b1-01a3-4789-bcef-8b7c4334132b] Instance spawned successfully.
Nov 08 23:22:45 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-5261c1af-07e3-4bcb-ab02-74001e8faf9a tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] [instance: 0b84f2b1-01a3-4789-bcef-8b7c4334132b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75045) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 23:22:45 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-5261c1af-07e3-4bcb-ab02-74001e8faf9a tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] [instance: 0b84f2b1-01a3-4789-bcef-8b7c4334132b] Found default for hw_cdrom_bus of ide {{(pid=75045) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 23:22:45 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-5261c1af-07e3-4bcb-ab02-74001e8faf9a tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] [instance: 0b84f2b1-01a3-4789-bcef-8b7c4334132b] Found default for hw_disk_bus of virtio {{(pid=75045) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 23:22:45 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-5261c1af-07e3-4bcb-ab02-74001e8faf9a tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] [instance: 0b84f2b1-01a3-4789-bcef-8b7c4334132b] Found default for hw_input_bus of None {{(pid=75045) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 23:22:45 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-5261c1af-07e3-4bcb-ab02-74001e8faf9a tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] [instance: 0b84f2b1-01a3-4789-bcef-8b7c4334132b] Found default for hw_pointer_model of None {{(pid=75045) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 23:22:45 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-5261c1af-07e3-4bcb-ab02-74001e8faf9a tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] [instance: 0b84f2b1-01a3-4789-bcef-8b7c4334132b] Found default for hw_video_model of virtio {{(pid=75045) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 23:22:45 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-5261c1af-07e3-4bcb-ab02-74001e8faf9a tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] [instance: 0b84f2b1-01a3-4789-bcef-8b7c4334132b] Found default for hw_vif_model of virtio {{(pid=75045) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 23:22:45 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f21fcd3-ac5f-499e-9c34-82af806fda1d/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:22:45 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9de31aa1-6996-4c4a-bd44-fce18e0890f4/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:22:45 user nova-compute[75045]: DEBUG nova.compute.manager [None req-66576810-7ef0-4d4a-ac8d-372aab6bc9bb tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] [instance: 032e20aa-8887-4215-808e-68299a0d8d0b] Instance event wait completed in 0 seconds for  {{(pid=75045) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 23:22:45 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-66576810-7ef0-4d4a-ac8d-372aab6bc9bb tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] [instance: 032e20aa-8887-4215-808e-68299a0d8d0b] Guest created on hypervisor {{(pid=75045) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 23:22:45 user nova-compute[75045]: INFO nova.virt.libvirt.driver [-] [instance: 032e20aa-8887-4215-808e-68299a0d8d0b] Instance spawned successfully.
Nov 08 23:22:45 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-66576810-7ef0-4d4a-ac8d-372aab6bc9bb tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] [instance: 032e20aa-8887-4215-808e-68299a0d8d0b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75045) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 23:22:45 user nova-compute[75045]: INFO nova.compute.manager [None req-5261c1af-07e3-4bcb-ab02-74001e8faf9a tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] [instance: 0b84f2b1-01a3-4789-bcef-8b7c4334132b] Took 9.42 seconds to spawn the instance on the hypervisor.
Nov 08 23:22:45 user nova-compute[75045]: DEBUG nova.compute.manager [None req-5261c1af-07e3-4bcb-ab02-74001e8faf9a tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] [instance: 0b84f2b1-01a3-4789-bcef-8b7c4334132b] Checking state {{(pid=75045) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 23:22:45 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-66576810-7ef0-4d4a-ac8d-372aab6bc9bb tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] [instance: 032e20aa-8887-4215-808e-68299a0d8d0b] Found default for hw_cdrom_bus of ide {{(pid=75045) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 23:22:45 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-66576810-7ef0-4d4a-ac8d-372aab6bc9bb tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] [instance: 032e20aa-8887-4215-808e-68299a0d8d0b] Found default for hw_disk_bus of virtio {{(pid=75045) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 23:22:45 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-66576810-7ef0-4d4a-ac8d-372aab6bc9bb tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] [instance: 032e20aa-8887-4215-808e-68299a0d8d0b] Found default for hw_input_bus of None {{(pid=75045) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 23:22:45 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-66576810-7ef0-4d4a-ac8d-372aab6bc9bb tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] [instance: 032e20aa-8887-4215-808e-68299a0d8d0b] Found default for hw_pointer_model of None {{(pid=75045) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 23:22:45 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-66576810-7ef0-4d4a-ac8d-372aab6bc9bb tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] [instance: 032e20aa-8887-4215-808e-68299a0d8d0b] Found default for hw_video_model of virtio {{(pid=75045) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 23:22:45 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-66576810-7ef0-4d4a-ac8d-372aab6bc9bb tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] [instance: 032e20aa-8887-4215-808e-68299a0d8d0b] Found default for hw_vif_model of virtio {{(pid=75045) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 23:22:45 user nova-compute[75045]: INFO nova.compute.manager [None req-5261c1af-07e3-4bcb-ab02-74001e8faf9a tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] [instance: 0b84f2b1-01a3-4789-bcef-8b7c4334132b] Took 10.81 seconds to build instance.
Nov 08 23:22:45 user nova-compute[75045]: DEBUG nova.compute.manager [None req-66576810-7ef0-4d4a-ac8d-372aab6bc9bb tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] [instance: 032e20aa-8887-4215-808e-68299a0d8d0b] Checking state {{(pid=75045) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 23:22:45 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9de31aa1-6996-4c4a-bd44-fce18e0890f4/disk --force-share --output=json" returned: 0 in 0.287s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:22:45 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9de31aa1-6996-4c4a-bd44-fce18e0890f4/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:22:45 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-5261c1af-07e3-4bcb-ab02-74001e8faf9a tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] Lock "0b84f2b1-01a3-4789-bcef-8b7c4334132b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.061s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:22:45 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-66576810-7ef0-4d4a-ac8d-372aab6bc9bb tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:22:45 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-66576810-7ef0-4d4a-ac8d-372aab6bc9bb tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.002s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:22:45 user nova-compute[75045]: DEBUG nova.objects.instance [None req-66576810-7ef0-4d4a-ac8d-372aab6bc9bb tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] [instance: 032e20aa-8887-4215-808e-68299a0d8d0b] Trying to apply a migration context that does not seem to be set for this instance {{(pid=75045) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Nov 08 23:22:45 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-66576810-7ef0-4d4a-ac8d-372aab6bc9bb tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.153s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:22:45 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9de31aa1-6996-4c4a-bd44-fce18e0890f4/disk --force-share --output=json" returned: 0 in 0.265s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:22:45 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fde91f7c-31e3-456c-b252-6ce37fa3b600/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:22:45 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:22:45 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fde91f7c-31e3-456c-b252-6ce37fa3b600/disk --force-share --output=json" returned: 0 in 0.269s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:22:45 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fde91f7c-31e3-456c-b252-6ce37fa3b600/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:22:46 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fde91f7c-31e3-456c-b252-6ce37fa3b600/disk --force-share --output=json" returned: 0 in 0.239s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:22:46 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] skipping disk /dev/sdi (vdb) as it is a volume {{(pid=75045) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 23:22:46 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83d225e0-e39e-4500-b7ae-52dfbd8b8588/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:22:46 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83d225e0-e39e-4500-b7ae-52dfbd8b8588/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:22:46 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83d225e0-e39e-4500-b7ae-52dfbd8b8588/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:22:46 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83d225e0-e39e-4500-b7ae-52dfbd8b8588/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:22:46 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43f31110-89ec-4b20-9842-7c9dd7df0e14/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:22:46 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43f31110-89ec-4b20-9842-7c9dd7df0e14/disk --force-share --output=json" returned: 0 in 0.233s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:22:46 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43f31110-89ec-4b20-9842-7c9dd7df0e14/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:22:47 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43f31110-89ec-4b20-9842-7c9dd7df0e14/disk --force-share --output=json" returned: 0 in 0.262s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:22:47 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25cd59d1-6884-471a-813e-52e97c2e1208/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:22:47 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25cd59d1-6884-471a-813e-52e97c2e1208/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:22:47 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25cd59d1-6884-471a-813e-52e97c2e1208/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:22:47 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25cd59d1-6884-471a-813e-52e97c2e1208/disk --force-share --output=json" returned: 0 in 0.244s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:22:47 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5fc7f02-2143-4bcf-92ac-078d5ec10747/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:22:47 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5fc7f02-2143-4bcf-92ac-078d5ec10747/disk --force-share --output=json" returned: 0 in 0.263s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:22:47 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5fc7f02-2143-4bcf-92ac-078d5ec10747/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:22:48 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5fc7f02-2143-4bcf-92ac-078d5ec10747/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:22:48 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75045) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 23:22:48 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b84f2b1-01a3-4789-bcef-8b7c4334132b/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:22:48 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b84f2b1-01a3-4789-bcef-8b7c4334132b/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:22:48 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b84f2b1-01a3-4789-bcef-8b7c4334132b/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:22:48 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b84f2b1-01a3-4789-bcef-8b7c4334132b/disk --force-share --output=json" returned: 0 in 0.298s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:22:49 user nova-compute[75045]: WARNING nova.virt.libvirt.driver [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 23:22:49 user nova-compute[75045]: WARNING nova.virt.libvirt.driver [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 23:22:49 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Hypervisor/Node resource view: name=user free_ram=7315MB free_disk=25.35529327392578GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75045) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 23:22:49 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:22:49 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.002s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:22:49 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Instance 4ae5ff6b-6f2c-4dfd-a4c6-da4809e2cf27 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75045) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 23:22:49 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Instance 0f21fcd3-ac5f-499e-9c34-82af806fda1d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75045) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 23:22:49 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Instance fde91f7c-31e3-456c-b252-6ce37fa3b600 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75045) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 23:22:49 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Instance d2c911cf-d5f4-4c19-8335-8c7834184a7e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75045) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 23:22:49 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Instance 032e20aa-8887-4215-808e-68299a0d8d0b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75045) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 23:22:49 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Instance 725866aa-0e2a-4af3-af20-48157e6d2fcb actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75045) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 23:22:49 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Instance 43f31110-89ec-4b20-9842-7c9dd7df0e14 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75045) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 23:22:49 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Instance 83d225e0-e39e-4500-b7ae-52dfbd8b8588 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75045) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 23:22:49 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Instance 9de31aa1-6996-4c4a-bd44-fce18e0890f4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75045) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 23:22:49 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Instance 25cd59d1-6884-471a-813e-52e97c2e1208 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75045) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 23:22:49 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Instance b5fc7f02-2143-4bcf-92ac-078d5ec10747 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75045) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 23:22:49 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Instance 0b84f2b1-01a3-4789-bcef-8b7c4334132b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75045) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 23:22:49 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=75045) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 23:22:49 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=75045) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 23:22:49 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:22:50 user nova-compute[75045]: DEBUG nova.compute.provider_tree [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Inventory has not changed in ProviderTree for provider: 62ba5f85-c74d-4b58-986e-d4197e813fd7 {{(pid=75045) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 23:22:50 user nova-compute[75045]: DEBUG nova.scheduler.client.report [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Inventory has not changed for provider 62ba5f85-c74d-4b58-986e-d4197e813fd7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75045) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 23:22:50 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Compute_service record updated for user:user {{(pid=75045) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 23:22:50 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.799s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:22:50 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:22:54 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:22:55 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:22:59 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:23:00 user nova-compute[75045]: DEBUG nova.compute.manager [req-b700bb17-eeb6-43ac-85f8-1b60e14a3178 req-94492206-3225-43df-936c-b98cd103c93a service nova] [instance: 725866aa-0e2a-4af3-af20-48157e6d2fcb] Received event network-changed-9a617e54-a69a-4204-b94e-dbe71b1432d2 {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:23:00 user nova-compute[75045]: DEBUG nova.compute.manager [req-b700bb17-eeb6-43ac-85f8-1b60e14a3178 req-94492206-3225-43df-936c-b98cd103c93a service nova] [instance: 725866aa-0e2a-4af3-af20-48157e6d2fcb] Refreshing instance network info cache due to event network-changed-9a617e54-a69a-4204-b94e-dbe71b1432d2. {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 23:23:00 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-b700bb17-eeb6-43ac-85f8-1b60e14a3178 req-94492206-3225-43df-936c-b98cd103c93a service nova] Acquiring lock "refresh_cache-725866aa-0e2a-4af3-af20-48157e6d2fcb" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 23:23:00 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-b700bb17-eeb6-43ac-85f8-1b60e14a3178 req-94492206-3225-43df-936c-b98cd103c93a service nova] Acquired lock "refresh_cache-725866aa-0e2a-4af3-af20-48157e6d2fcb" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 23:23:00 user nova-compute[75045]: DEBUG nova.network.neutron [req-b700bb17-eeb6-43ac-85f8-1b60e14a3178 req-94492206-3225-43df-936c-b98cd103c93a service nova] [instance: 725866aa-0e2a-4af3-af20-48157e6d2fcb] Refreshing network info cache for port 9a617e54-a69a-4204-b94e-dbe71b1432d2 {{(pid=75045) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 23:23:00 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-743a6f4b-c7e2-4bbe-8f6f-60de7e0cd44d tempest-TestShelveInstance-1634360024 tempest-TestShelveInstance-1634360024-project-member] Acquiring lock "725866aa-0e2a-4af3-af20-48157e6d2fcb" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:23:00 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-743a6f4b-c7e2-4bbe-8f6f-60de7e0cd44d tempest-TestShelveInstance-1634360024 tempest-TestShelveInstance-1634360024-project-member] Lock "725866aa-0e2a-4af3-af20-48157e6d2fcb" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:23:00 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-743a6f4b-c7e2-4bbe-8f6f-60de7e0cd44d tempest-TestShelveInstance-1634360024 tempest-TestShelveInstance-1634360024-project-member] Acquiring lock "725866aa-0e2a-4af3-af20-48157e6d2fcb-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:23:00 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-743a6f4b-c7e2-4bbe-8f6f-60de7e0cd44d tempest-TestShelveInstance-1634360024 tempest-TestShelveInstance-1634360024-project-member] Lock "725866aa-0e2a-4af3-af20-48157e6d2fcb-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:23:00 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-743a6f4b-c7e2-4bbe-8f6f-60de7e0cd44d tempest-TestShelveInstance-1634360024 tempest-TestShelveInstance-1634360024-project-member] Lock "725866aa-0e2a-4af3-af20-48157e6d2fcb-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.006s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:23:00 user nova-compute[75045]: INFO nova.compute.manager [None req-743a6f4b-c7e2-4bbe-8f6f-60de7e0cd44d tempest-TestShelveInstance-1634360024 tempest-TestShelveInstance-1634360024-project-member] [instance: 725866aa-0e2a-4af3-af20-48157e6d2fcb] Terminating instance
Nov 08 23:23:00 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:23:00 user nova-compute[75045]: DEBUG nova.compute.manager [None req-743a6f4b-c7e2-4bbe-8f6f-60de7e0cd44d tempest-TestShelveInstance-1634360024 tempest-TestShelveInstance-1634360024-project-member] [instance: 725866aa-0e2a-4af3-af20-48157e6d2fcb] Start destroying the instance on the hypervisor. {{(pid=75045) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 23:23:01 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:23:01 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:23:01 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:23:01 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:23:01 user nova-compute[75045]: DEBUG nova.compute.manager [req-a06223ef-10ee-45df-b9c8-36caddcc55df req-737503ba-b91f-4c21-9ef7-3ea22803d10b service nova] [instance: 725866aa-0e2a-4af3-af20-48157e6d2fcb] Received event network-vif-unplugged-9a617e54-a69a-4204-b94e-dbe71b1432d2 {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:23:01 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-a06223ef-10ee-45df-b9c8-36caddcc55df req-737503ba-b91f-4c21-9ef7-3ea22803d10b service nova] Acquiring lock "725866aa-0e2a-4af3-af20-48157e6d2fcb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:23:01 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-a06223ef-10ee-45df-b9c8-36caddcc55df req-737503ba-b91f-4c21-9ef7-3ea22803d10b service nova] Lock "725866aa-0e2a-4af3-af20-48157e6d2fcb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:23:01 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-a06223ef-10ee-45df-b9c8-36caddcc55df req-737503ba-b91f-4c21-9ef7-3ea22803d10b service nova] Lock "725866aa-0e2a-4af3-af20-48157e6d2fcb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:23:01 user nova-compute[75045]: DEBUG nova.compute.manager [req-a06223ef-10ee-45df-b9c8-36caddcc55df req-737503ba-b91f-4c21-9ef7-3ea22803d10b service nova] [instance: 725866aa-0e2a-4af3-af20-48157e6d2fcb] No waiting events found dispatching network-vif-unplugged-9a617e54-a69a-4204-b94e-dbe71b1432d2 {{(pid=75045) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 23:23:01 user nova-compute[75045]: DEBUG nova.compute.manager [req-a06223ef-10ee-45df-b9c8-36caddcc55df req-737503ba-b91f-4c21-9ef7-3ea22803d10b service nova] [instance: 725866aa-0e2a-4af3-af20-48157e6d2fcb] Received event network-vif-unplugged-9a617e54-a69a-4204-b94e-dbe71b1432d2 for instance with task_state deleting. {{(pid=75045) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 23:23:01 user nova-compute[75045]: DEBUG nova.network.neutron [req-b700bb17-eeb6-43ac-85f8-1b60e14a3178 req-94492206-3225-43df-936c-b98cd103c93a service nova] [instance: 725866aa-0e2a-4af3-af20-48157e6d2fcb] Updated VIF entry in instance network info cache for port 9a617e54-a69a-4204-b94e-dbe71b1432d2. {{(pid=75045) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 23:23:01 user nova-compute[75045]: DEBUG nova.network.neutron [req-b700bb17-eeb6-43ac-85f8-1b60e14a3178 req-94492206-3225-43df-936c-b98cd103c93a service nova] [instance: 725866aa-0e2a-4af3-af20-48157e6d2fcb] Updating instance_info_cache with network_info: [{"id": "9a617e54-a69a-4204-b94e-dbe71b1432d2", "address": "fa:16:3e:64:ef:b6", "network": {"id": "25b429b3-693b-4e72-9035-71c276706294", "bridge": "br-int", "label": "tempest-TestShelveInstance-437524717-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec089e7050c542c9860d9fc5f3ae9392", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a617e54-a6", "ovs_interfaceid": "9a617e54-a69a-4204-b94e-dbe71b1432d2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75045) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 23:23:01 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-b700bb17-eeb6-43ac-85f8-1b60e14a3178 req-94492206-3225-43df-936c-b98cd103c93a service nova] Releasing lock "refresh_cache-725866aa-0e2a-4af3-af20-48157e6d2fcb" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 23:23:01 user nova-compute[75045]: INFO nova.virt.libvirt.driver [-] [instance: 725866aa-0e2a-4af3-af20-48157e6d2fcb] Instance destroyed successfully.
Nov 08 23:23:01 user nova-compute[75045]: DEBUG nova.objects.instance [None req-743a6f4b-c7e2-4bbe-8f6f-60de7e0cd44d tempest-TestShelveInstance-1634360024 tempest-TestShelveInstance-1634360024-project-member] Lazy-loading 'resources' on Instance uuid 725866aa-0e2a-4af3-af20-48157e6d2fcb {{(pid=75045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 23:23:01 user nova-compute[75045]: DEBUG nova.virt.libvirt.vif [None req-743a6f4b-c7e2-4bbe-8f6f-60de7e0cd44d tempest-TestShelveInstance-1634360024 tempest-TestShelveInstance-1634360024-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-08T23:17:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-961488157',display_name='tempest-TestShelveInstance-server-961488157',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-961488157',id=9,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPdSdRn8WciiiK68fvoPSG0DN5FXQxOXxXUm/XL4qxnEmO5qC4nYOWk8Lgcyp12BuaZBz/IIiTtq1Y4TgPZ8aXxKhhN+gEPxX15QF8o4xT2o0K09li/F7ysXt5rBzWL/Lw==',key_name='tempest-TestShelveInstance-1861694278',keypairs=<?>,launch_index=0,launched_at=2023-11-08T23:21:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ec089e7050c542c9860d9fc5f3ae9392',ramdisk_id='',reservation_id='r-2v3622zl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1634360024',owner_user_name='tempest-TestShelveInstance-1634360024-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T23:21:45Z,user_data=None,user_id='e30385ff71444d4f9a799c79e0ab67e9',uuid=725866aa-0e2a-4af3-af20-48157e6d2fcb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9a617e54-a69a-4204-b94e-dbe71b1432d2", "address": "fa:16:3e:64:ef:b6", "network": {"id": "25b429b3-693b-4e72-9035-71c276706294", "bridge": "br-int", "label": "tempest-TestShelveInstance-437524717-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.40", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec089e7050c542c9860d9fc5f3ae9392", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a617e54-a6", "ovs_interfaceid": "9a617e54-a69a-4204-b94e-dbe71b1432d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75045) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 23:23:01 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-743a6f4b-c7e2-4bbe-8f6f-60de7e0cd44d tempest-TestShelveInstance-1634360024 tempest-TestShelveInstance-1634360024-project-member] Converting VIF {"id": "9a617e54-a69a-4204-b94e-dbe71b1432d2", "address": "fa:16:3e:64:ef:b6", "network": {"id": "25b429b3-693b-4e72-9035-71c276706294", "bridge": "br-int", "label": "tempest-TestShelveInstance-437524717-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.40", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec089e7050c542c9860d9fc5f3ae9392", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a617e54-a6", "ovs_interfaceid": "9a617e54-a69a-4204-b94e-dbe71b1432d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 23:23:01 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-743a6f4b-c7e2-4bbe-8f6f-60de7e0cd44d tempest-TestShelveInstance-1634360024 tempest-TestShelveInstance-1634360024-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:64:ef:b6,bridge_name='br-int',has_traffic_filtering=True,id=9a617e54-a69a-4204-b94e-dbe71b1432d2,network=Network(25b429b3-693b-4e72-9035-71c276706294),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9a617e54-a6') {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 23:23:01 user nova-compute[75045]: DEBUG os_vif [None req-743a6f4b-c7e2-4bbe-8f6f-60de7e0cd44d tempest-TestShelveInstance-1634360024 tempest-TestShelveInstance-1634360024-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:64:ef:b6,bridge_name='br-int',has_traffic_filtering=True,id=9a617e54-a69a-4204-b94e-dbe71b1432d2,network=Network(25b429b3-693b-4e72-9035-71c276706294),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9a617e54-a6') {{(pid=75045) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 23:23:01 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:23:01 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9a617e54-a6, bridge=br-int, if_exists=True) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:23:01 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:23:01 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 23:23:01 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:23:01 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=360e69e5-38a5-477b-a73a-cf20afda4d9f) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:23:01 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:23:01 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:23:01 user nova-compute[75045]: INFO os_vif [None req-743a6f4b-c7e2-4bbe-8f6f-60de7e0cd44d tempest-TestShelveInstance-1634360024 tempest-TestShelveInstance-1634360024-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:64:ef:b6,bridge_name='br-int',has_traffic_filtering=True,id=9a617e54-a69a-4204-b94e-dbe71b1432d2,network=Network(25b429b3-693b-4e72-9035-71c276706294),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9a617e54-a6')
Nov 08 23:23:01 user nova-compute[75045]: DEBUG nova.virt.libvirt.volume.iscsi [None req-743a6f4b-c7e2-4bbe-8f6f-60de7e0cd44d tempest-TestShelveInstance-1634360024 tempest-TestShelveInstance-1634360024-project-member] [instance: 725866aa-0e2a-4af3-af20-48157e6d2fcb] calling os-brick to detach iSCSI Volume {{(pid=75045) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 23:23:01 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-743a6f4b-c7e2-4bbe-8f6f-60de7e0cd44d tempest-TestShelveInstance-1634360024 tempest-TestShelveInstance-1634360024-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1b68210460>, {'target_iqn': 'iqn.2010-10.org.openstack:d2068946-d374-45a4-9850-e3a690b13ef4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eQScvmpf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75045) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 23:23:01 user nova-compute[75045]: WARNING os_brick.initiator.connectors.base [None req-743a6f4b-c7e2-4bbe-8f6f-60de7e0cd44d tempest-TestShelveInstance-1634360024 tempest-TestShelveInstance-1634360024-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 23:23:01 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-743a6f4b-c7e2-4bbe-8f6f-60de7e0cd44d tempest-TestShelveInstance-1634360024 tempest-TestShelveInstance-1634360024-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 23:23:01 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-743a6f4b-c7e2-4bbe-8f6f-60de7e0cd44d tempest-TestShelveInstance-1634360024 tempest-TestShelveInstance-1634360024-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 23:23:01 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:23:01 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.027s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:23:01 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5d2bd5f-5ee4-4d4a-8ba4-c76705e72bbb]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:45f1b635-c8a3-4727-a4c7-c2ac441388ff\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c7f7084f-f0d7-4d4b-9a14-69065a9c3e41\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d2068946-d374-45a4-9850-e3a690b13ef4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:23:01 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-743a6f4b-c7e2-4bbe-8f6f-60de7e0cd44d tempest-TestShelveInstance-1634360024 tempest-TestShelveInstance-1634360024-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 23:23:01 user nova-compute[75045]: No targets found.
Nov 08 23:23:01 user nova-compute[75045]: iSNS:
Nov 08 23:23:01 user nova-compute[75045]: No targets found.
Nov 08 23:23:01 user nova-compute[75045]: STATIC:
Nov 08 23:23:01 user nova-compute[75045]: Target: iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab
Nov 08 23:23:01 user nova-compute[75045]:         Portal: 172.16.0.220:3260,-1
Nov 08 23:23:01 user nova-compute[75045]:                 Iface Name: default
Nov 08 23:23:01 user nova-compute[75045]: Target: iqn.2010-10.org.openstack:45f1b635-c8a3-4727-a4c7-c2ac441388ff
Nov 08 23:23:01 user nova-compute[75045]:         Portal: 172.16.0.220:3260,-1
Nov 08 23:23:01 user nova-compute[75045]:                 Iface Name: default
Nov 08 23:23:01 user nova-compute[75045]: Target: iqn.2010-10.org.openstack:c7f7084f-f0d7-4d4b-9a14-69065a9c3e41
Nov 08 23:23:01 user nova-compute[75045]:         Portal: 172.16.0.220:3260,-1
Nov 08 23:23:01 user nova-compute[75045]:                 Iface Name: default
Nov 08 23:23:01 user nova-compute[75045]: Target: iqn.2010-10.org.openstack:d2068946-d374-45a4-9850-e3a690b13ef4
Nov 08 23:23:01 user nova-compute[75045]:         Portal: 172.16.0.220:3260,-1
Nov 08 23:23:01 user nova-compute[75045]:                 Iface Name: default
Nov 08 23:23:01 user nova-compute[75045]: FIRMWARE:
Nov 08 23:23:01 user nova-compute[75045]: No targets found.
Nov 08 23:23:01 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 23:23:01 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-743a6f4b-c7e2-4bbe-8f6f-60de7e0cd44d tempest-TestShelveInstance-1634360024 tempest-TestShelveInstance-1634360024-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 23:23:01 user nova-compute[75045]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 23:23:01 user nova-compute[75045]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75045) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 23:23:01 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-743a6f4b-c7e2-4bbe-8f6f-60de7e0cd44d tempest-TestShelveInstance-1634360024 tempest-TestShelveInstance-1634360024-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d2068946-d374-45a4-9850-e3a690b13ef4', 0)] {{(pid=75045) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 23:23:01 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:23:02 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:23:02 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad2049f1-1601-4d48-ad61-d0bb9c753425]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:45f1b635-c8a3-4727-a4c7-c2ac441388ff\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c7f7084f-f0d7-4d4b-9a14-69065a9c3e41\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d2068946-d374-45a4-9850-e3a690b13ef4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:23:02 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:23:02 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:23:02 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[54e9e6e4-9e62-4c3d-a02a-0a454543f514]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7f7084f-f0d7-4d4b-9a14-69065a9c3e41 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2068946-d374-45a4-9850-e3a690b13ef4 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45f1b635-c8a3-4727-a4c7-c2ac441388ff (non-flash)\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:23:02 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-743a6f4b-c7e2-4bbe-8f6f-60de7e0cd44d tempest-TestShelveInstance-1634360024 tempest-TestShelveInstance-1634360024-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab (non-flash)
Nov 08 23:23:02 user nova-compute[75045]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7f7084f-f0d7-4d4b-9a14-69065a9c3e41 (non-flash)
Nov 08 23:23:02 user nova-compute[75045]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2068946-d374-45a4-9850-e3a690b13ef4 (non-flash)
Nov 08 23:23:02 user nova-compute[75045]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45f1b635-c8a3-4727-a4c7-c2ac441388ff (non-flash)
Nov 08 23:23:02 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 23:23:02 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-743a6f4b-c7e2-4bbe-8f6f-60de7e0cd44d tempest-TestShelveInstance-1634360024 tempest-TestShelveInstance-1634360024-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab (non-flash)
Nov 08 23:23:02 user nova-compute[75045]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7f7084f-f0d7-4d4b-9a14-69065a9c3e41 (non-flash)
Nov 08 23:23:02 user nova-compute[75045]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2068946-d374-45a4-9850-e3a690b13ef4 (non-flash)
Nov 08 23:23:02 user nova-compute[75045]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45f1b635-c8a3-4727-a4c7-c2ac441388ff (non-flash)
Nov 08 23:23:02 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 23:23:02 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-743a6f4b-c7e2-4bbe-8f6f-60de7e0cd44d tempest-TestShelveInstance-1634360024 tempest-TestShelveInstance-1634360024-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1b4848d000>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d2068946-d374-45a4-9850-e3a690b13ef4'): ({'sdb'}, set())}) {{(pid=75045) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 23:23:02 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-743a6f4b-c7e2-4bbe-8f6f-60de7e0cd44d tempest-TestShelveInstance-1634360024 tempest-TestShelveInstance-1634360024-project-member] Removing single pathed devices sdb {{(pid=75045) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 23:23:02 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:23:02 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:23:02 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[4df7e9a2-f2f6-4f0e-b559-1ca64e757773]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:23:02 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:23:02 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:23:02 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8537a53-fd3d-435a-96e7-379af4be9de8]: (4, ('ok\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:23:02 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-743a6f4b-c7e2-4bbe-8f6f-60de7e0cd44d tempest-TestShelveInstance-1634360024 tempest-TestShelveInstance-1634360024-project-member] Flushing IO for device /dev/sdb {{(pid=75045) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 23:23:02 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:23:02 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.022s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:23:02 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[84de7a6a-8aa8-496b-bf6c-dfcb98446be1]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:23:02 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-743a6f4b-c7e2-4bbe-8f6f-60de7e0cd44d tempest-TestShelveInstance-1634360024 tempest-TestShelveInstance-1634360024-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75045) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 23:23:02 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:23:02 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.045s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:23:02 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[28efe06a-79f7-46c3-ad3c-c3595efa5d72]: (4, ('1', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:23:02 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-743a6f4b-c7e2-4bbe-8f6f-60de7e0cd44d tempest-TestShelveInstance-1634360024 tempest-TestShelveInstance-1634360024-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75045) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 23:23:02 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-743a6f4b-c7e2-4bbe-8f6f-60de7e0cd44d tempest-TestShelveInstance-1634360024 tempest-TestShelveInstance-1634360024-project-member] SCSI volumes sdb have been removed. {{(pid=75045) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 23:23:02 user nova-compute[75045]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-23235663362643230', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_a9c397bf', '/dev/disk/by-id/scsi-1SCST_BIOa9c397bf-25f3bd20302e9766') {{(pid=86132) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 08 23:23:02 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[b309972f-7615-44c0-974f-b4f5ac3fc58a]: (4, None) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:23:02 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-743a6f4b-c7e2-4bbe-8f6f-60de7e0cd44d tempest-TestShelveInstance-1634360024 tempest-TestShelveInstance-1634360024-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d2068946-d374-45a4-9850-e3a690b13ef4')] {{(pid=75045) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 23:23:02 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2068946-d374-45a4-9850-e3a690b13ef4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:23:02 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2068946-d374-45a4-9850-e3a690b13ef4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:23:02 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fcec168-8232-4df1-90d2-4ccc61ebac5e]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:23:02 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-743a6f4b-c7e2-4bbe-8f6f-60de7e0cd44d tempest-TestShelveInstance-1634360024 tempest-TestShelveInstance-1634360024-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:23:02 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2068946-d374-45a4-9850-e3a690b13ef4 -p 172.16.0.220:3260 --logout {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:23:02 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2068946-d374-45a4-9850-e3a690b13ef4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:23:02 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bf0ce35-bb68-4b3c-b8df-4cd9df141119]: (4, ('Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:d2068946-d374-45a4-9850-e3a690b13ef4, portal: 172.16.0.220,3260]\nLogout of [sid: 14, target: iqn.2010-10.org.openstack:d2068946-d374-45a4-9850-e3a690b13ef4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:23:02 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-743a6f4b-c7e2-4bbe-8f6f-60de7e0cd44d tempest-TestShelveInstance-1634360024 tempest-TestShelveInstance-1634360024-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:d2068946-d374-45a4-9850-e3a690b13ef4, portal: 172.16.0.220,3260]
Nov 08 23:23:02 user nova-compute[75045]: Logout of [sid: 14, target: iqn.2010-10.org.openstack:d2068946-d374-45a4-9850-e3a690b13ef4, portal: 172.16.0.220,3260] successful.
Nov 08 23:23:02 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:23:02 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2068946-d374-45a4-9850-e3a690b13ef4 -p 172.16.0.220:3260 --op delete {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:23:02 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2068946-d374-45a4-9850-e3a690b13ef4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:23:02 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[59ab2595-b5dd-4fc2-867a-18b6fe134633]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:23:02 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-743a6f4b-c7e2-4bbe-8f6f-60de7e0cd44d tempest-TestShelveInstance-1634360024 tempest-TestShelveInstance-1634360024-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:23:02 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-743a6f4b-c7e2-4bbe-8f6f-60de7e0cd44d tempest-TestShelveInstance-1634360024 tempest-TestShelveInstance-1634360024-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.359s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 23:23:02 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-743a6f4b-c7e2-4bbe-8f6f-60de7e0cd44d tempest-TestShelveInstance-1634360024 tempest-TestShelveInstance-1634360024-project-member] <== disconnect_volume: return (360ms) None {{(pid=75045) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 23:23:02 user nova-compute[75045]: DEBUG nova.virt.libvirt.volume.iscsi [None req-743a6f4b-c7e2-4bbe-8f6f-60de7e0cd44d tempest-TestShelveInstance-1634360024 tempest-TestShelveInstance-1634360024-project-member] [instance: 725866aa-0e2a-4af3-af20-48157e6d2fcb] Disconnected iSCSI Volume {{(pid=75045) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 23:23:02 user nova-compute[75045]: INFO nova.virt.libvirt.driver [None req-743a6f4b-c7e2-4bbe-8f6f-60de7e0cd44d tempest-TestShelveInstance-1634360024 tempest-TestShelveInstance-1634360024-project-member] [instance: 725866aa-0e2a-4af3-af20-48157e6d2fcb] Deleting instance files /opt/stack/data/nova/instances/725866aa-0e2a-4af3-af20-48157e6d2fcb_del
Nov 08 23:23:02 user nova-compute[75045]: INFO nova.virt.libvirt.driver [None req-743a6f4b-c7e2-4bbe-8f6f-60de7e0cd44d tempest-TestShelveInstance-1634360024 tempest-TestShelveInstance-1634360024-project-member] [instance: 725866aa-0e2a-4af3-af20-48157e6d2fcb] Deletion of /opt/stack/data/nova/instances/725866aa-0e2a-4af3-af20-48157e6d2fcb_del complete
Nov 08 23:23:02 user nova-compute[75045]: INFO nova.compute.manager [None req-743a6f4b-c7e2-4bbe-8f6f-60de7e0cd44d tempest-TestShelveInstance-1634360024 tempest-TestShelveInstance-1634360024-project-member] [instance: 725866aa-0e2a-4af3-af20-48157e6d2fcb] Took 1.49 seconds to destroy the instance on the hypervisor.
Nov 08 23:23:02 user nova-compute[75045]: DEBUG oslo.service.loopingcall [None req-743a6f4b-c7e2-4bbe-8f6f-60de7e0cd44d tempest-TestShelveInstance-1634360024 tempest-TestShelveInstance-1634360024-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75045) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 23:23:02 user nova-compute[75045]: DEBUG nova.compute.manager [-] [instance: 725866aa-0e2a-4af3-af20-48157e6d2fcb] Deallocating network for instance {{(pid=75045) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 23:23:02 user nova-compute[75045]: DEBUG nova.network.neutron [-] [instance: 725866aa-0e2a-4af3-af20-48157e6d2fcb] deallocate_for_instance() {{(pid=75045) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 23:23:03 user nova-compute[75045]: DEBUG nova.network.neutron [-] [instance: 725866aa-0e2a-4af3-af20-48157e6d2fcb] Updating instance_info_cache with network_info: [] {{(pid=75045) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 23:23:03 user nova-compute[75045]: INFO nova.compute.manager [-] [instance: 725866aa-0e2a-4af3-af20-48157e6d2fcb] Took 0.62 seconds to deallocate network for instance.
Nov 08 23:23:03 user nova-compute[75045]: DEBUG nova.compute.manager [req-e73d6e38-d995-4853-98e5-98ac4ce7d5cb req-9a6926ee-a538-40fe-9280-99f893a08896 service nova] [instance: 725866aa-0e2a-4af3-af20-48157e6d2fcb] Received event network-vif-plugged-9a617e54-a69a-4204-b94e-dbe71b1432d2 {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:23:03 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-e73d6e38-d995-4853-98e5-98ac4ce7d5cb req-9a6926ee-a538-40fe-9280-99f893a08896 service nova] Acquiring lock "725866aa-0e2a-4af3-af20-48157e6d2fcb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:23:03 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-e73d6e38-d995-4853-98e5-98ac4ce7d5cb req-9a6926ee-a538-40fe-9280-99f893a08896 service nova] Lock "725866aa-0e2a-4af3-af20-48157e6d2fcb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:23:03 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-e73d6e38-d995-4853-98e5-98ac4ce7d5cb req-9a6926ee-a538-40fe-9280-99f893a08896 service nova] Lock "725866aa-0e2a-4af3-af20-48157e6d2fcb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:23:03 user nova-compute[75045]: DEBUG nova.compute.manager [req-e73d6e38-d995-4853-98e5-98ac4ce7d5cb req-9a6926ee-a538-40fe-9280-99f893a08896 service nova] [instance: 725866aa-0e2a-4af3-af20-48157e6d2fcb] No waiting events found dispatching network-vif-plugged-9a617e54-a69a-4204-b94e-dbe71b1432d2 {{(pid=75045) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 23:23:03 user nova-compute[75045]: WARNING nova.compute.manager [req-e73d6e38-d995-4853-98e5-98ac4ce7d5cb req-9a6926ee-a538-40fe-9280-99f893a08896 service nova] [instance: 725866aa-0e2a-4af3-af20-48157e6d2fcb] Received unexpected event network-vif-plugged-9a617e54-a69a-4204-b94e-dbe71b1432d2 for instance with vm_state active and task_state deleting.
Nov 08 23:23:03 user nova-compute[75045]: DEBUG nova.compute.manager [req-e73d6e38-d995-4853-98e5-98ac4ce7d5cb req-9a6926ee-a538-40fe-9280-99f893a08896 service nova] [instance: 725866aa-0e2a-4af3-af20-48157e6d2fcb] Received event network-vif-deleted-9a617e54-a69a-4204-b94e-dbe71b1432d2 {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:23:04 user nova-compute[75045]: INFO nova.compute.manager [None req-743a6f4b-c7e2-4bbe-8f6f-60de7e0cd44d tempest-TestShelveInstance-1634360024 tempest-TestShelveInstance-1634360024-project-member] [instance: 725866aa-0e2a-4af3-af20-48157e6d2fcb] Took 1.06 seconds to detach 1 volumes for instance.
Nov 08 23:23:04 user nova-compute[75045]: DEBUG nova.compute.manager [None req-743a6f4b-c7e2-4bbe-8f6f-60de7e0cd44d tempest-TestShelveInstance-1634360024 tempest-TestShelveInstance-1634360024-project-member] [instance: 725866aa-0e2a-4af3-af20-48157e6d2fcb] Deleting volume: d2068946-d374-45a4-9850-e3a690b13ef4 {{(pid=75045) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 08 23:23:04 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-743a6f4b-c7e2-4bbe-8f6f-60de7e0cd44d tempest-TestShelveInstance-1634360024 tempest-TestShelveInstance-1634360024-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:23:04 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-743a6f4b-c7e2-4bbe-8f6f-60de7e0cd44d tempest-TestShelveInstance-1634360024 tempest-TestShelveInstance-1634360024-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:23:04 user nova-compute[75045]: INFO nova.compute.manager [None req-a79d58dc-f969-4189-86b7-e2c2412e9bbb tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] [instance: d2c911cf-d5f4-4c19-8335-8c7834184a7e] Unrescuing
Nov 08 23:23:04 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-a79d58dc-f969-4189-86b7-e2c2412e9bbb tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Acquiring lock "refresh_cache-d2c911cf-d5f4-4c19-8335-8c7834184a7e" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 23:23:04 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-a79d58dc-f969-4189-86b7-e2c2412e9bbb tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Acquired lock "refresh_cache-d2c911cf-d5f4-4c19-8335-8c7834184a7e" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 23:23:04 user nova-compute[75045]: DEBUG nova.network.neutron [None req-a79d58dc-f969-4189-86b7-e2c2412e9bbb tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] [instance: d2c911cf-d5f4-4c19-8335-8c7834184a7e] Building network info cache for instance {{(pid=75045) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 23:23:04 user nova-compute[75045]: DEBUG nova.compute.provider_tree [None req-743a6f4b-c7e2-4bbe-8f6f-60de7e0cd44d tempest-TestShelveInstance-1634360024 tempest-TestShelveInstance-1634360024-project-member] Inventory has not changed in ProviderTree for provider: 62ba5f85-c74d-4b58-986e-d4197e813fd7 {{(pid=75045) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 23:23:04 user nova-compute[75045]: DEBUG nova.scheduler.client.report [None req-743a6f4b-c7e2-4bbe-8f6f-60de7e0cd44d tempest-TestShelveInstance-1634360024 tempest-TestShelveInstance-1634360024-project-member] Inventory has not changed for provider 62ba5f85-c74d-4b58-986e-d4197e813fd7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75045) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 23:23:04 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-743a6f4b-c7e2-4bbe-8f6f-60de7e0cd44d tempest-TestShelveInstance-1634360024 tempest-TestShelveInstance-1634360024-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.520s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:23:04 user nova-compute[75045]: INFO nova.scheduler.client.report [None req-743a6f4b-c7e2-4bbe-8f6f-60de7e0cd44d tempest-TestShelveInstance-1634360024 tempest-TestShelveInstance-1634360024-project-member] Deleted allocations for instance 725866aa-0e2a-4af3-af20-48157e6d2fcb
Nov 08 23:23:04 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-743a6f4b-c7e2-4bbe-8f6f-60de7e0cd44d tempest-TestShelveInstance-1634360024 tempest-TestShelveInstance-1634360024-project-member] Lock "725866aa-0e2a-4af3-af20-48157e6d2fcb" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.983s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:23:05 user nova-compute[75045]: DEBUG nova.network.neutron [None req-a79d58dc-f969-4189-86b7-e2c2412e9bbb tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] [instance: d2c911cf-d5f4-4c19-8335-8c7834184a7e] Updating instance_info_cache with network_info: [{"id": "f4321c52-b9d5-434c-820f-25cab4239ef4", "address": "fa:16:3e:49:6b:27", "network": {"id": "d4cd6998-66d1-4389-bc82-dd000c8962de", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-323966879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bfb6963a6c145d4a7b7e47c8fde7e60", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4321c52-b9", "ovs_interfaceid": "f4321c52-b9d5-434c-820f-25cab4239ef4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75045) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 23:23:05 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-a79d58dc-f969-4189-86b7-e2c2412e9bbb tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Releasing lock "refresh_cache-d2c911cf-d5f4-4c19-8335-8c7834184a7e" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 23:23:05 user nova-compute[75045]: DEBUG nova.objects.instance [None req-a79d58dc-f969-4189-86b7-e2c2412e9bbb tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Lazy-loading 'flavor' on Instance uuid d2c911cf-d5f4-4c19-8335-8c7834184a7e {{(pid=75045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 23:23:05 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:23:05 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:23:05 user nova-compute[75045]: DEBUG nova.compute.manager [req-d0a03576-81d8-4f2b-98b0-97d2fc2ffb11 req-717391d7-4a7e-4adf-8f1e-04ad8546c945 service nova] [instance: d2c911cf-d5f4-4c19-8335-8c7834184a7e] Received event network-vif-unplugged-f4321c52-b9d5-434c-820f-25cab4239ef4 {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:23:05 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-d0a03576-81d8-4f2b-98b0-97d2fc2ffb11 req-717391d7-4a7e-4adf-8f1e-04ad8546c945 service nova] Acquiring lock "d2c911cf-d5f4-4c19-8335-8c7834184a7e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:23:05 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-d0a03576-81d8-4f2b-98b0-97d2fc2ffb11 req-717391d7-4a7e-4adf-8f1e-04ad8546c945 service nova] Lock "d2c911cf-d5f4-4c19-8335-8c7834184a7e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:23:05 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-d0a03576-81d8-4f2b-98b0-97d2fc2ffb11 req-717391d7-4a7e-4adf-8f1e-04ad8546c945 service nova] Lock "d2c911cf-d5f4-4c19-8335-8c7834184a7e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:23:05 user nova-compute[75045]: DEBUG nova.compute.manager [req-d0a03576-81d8-4f2b-98b0-97d2fc2ffb11 req-717391d7-4a7e-4adf-8f1e-04ad8546c945 service nova] [instance: d2c911cf-d5f4-4c19-8335-8c7834184a7e] No waiting events found dispatching network-vif-unplugged-f4321c52-b9d5-434c-820f-25cab4239ef4 {{(pid=75045) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 23:23:05 user nova-compute[75045]: WARNING nova.compute.manager [req-d0a03576-81d8-4f2b-98b0-97d2fc2ffb11 req-717391d7-4a7e-4adf-8f1e-04ad8546c945 service nova] [instance: d2c911cf-d5f4-4c19-8335-8c7834184a7e] Received unexpected event network-vif-unplugged-f4321c52-b9d5-434c-820f-25cab4239ef4 for instance with vm_state rescued and task_state unrescuing.
Nov 08 23:23:05 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:23:05 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:23:05 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:23:05 user nova-compute[75045]: INFO nova.virt.libvirt.driver [-] [instance: d2c911cf-d5f4-4c19-8335-8c7834184a7e] Instance destroyed successfully.
Nov 08 23:23:06 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:23:07 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:23:07 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:23:07 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:23:07 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:23:07 user nova-compute[75045]: DEBUG nova.compute.manager [req-2799df55-f87d-4892-b5cc-eee5671cf22b req-2d3cb878-aa30-47d7-8dad-ffc3484abca5 service nova] [instance: d2c911cf-d5f4-4c19-8335-8c7834184a7e] Received event network-vif-plugged-f4321c52-b9d5-434c-820f-25cab4239ef4 {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:23:07 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-2799df55-f87d-4892-b5cc-eee5671cf22b req-2d3cb878-aa30-47d7-8dad-ffc3484abca5 service nova] Acquiring lock "d2c911cf-d5f4-4c19-8335-8c7834184a7e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:23:07 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-2799df55-f87d-4892-b5cc-eee5671cf22b req-2d3cb878-aa30-47d7-8dad-ffc3484abca5 service nova] Lock "d2c911cf-d5f4-4c19-8335-8c7834184a7e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:23:07 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-2799df55-f87d-4892-b5cc-eee5671cf22b req-2d3cb878-aa30-47d7-8dad-ffc3484abca5 service nova] Lock "d2c911cf-d5f4-4c19-8335-8c7834184a7e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:23:07 user nova-compute[75045]: DEBUG nova.compute.manager [req-2799df55-f87d-4892-b5cc-eee5671cf22b req-2d3cb878-aa30-47d7-8dad-ffc3484abca5 service nova] [instance: d2c911cf-d5f4-4c19-8335-8c7834184a7e] No waiting events found dispatching network-vif-plugged-f4321c52-b9d5-434c-820f-25cab4239ef4 {{(pid=75045) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 23:23:07 user nova-compute[75045]: WARNING nova.compute.manager [req-2799df55-f87d-4892-b5cc-eee5671cf22b req-2d3cb878-aa30-47d7-8dad-ffc3484abca5 service nova] [instance: d2c911cf-d5f4-4c19-8335-8c7834184a7e] Received unexpected event network-vif-plugged-f4321c52-b9d5-434c-820f-25cab4239ef4 for instance with vm_state rescued and task_state unrescuing.
Nov 08 23:23:07 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:23:09 user nova-compute[75045]: DEBUG nova.compute.manager [req-92bc8d49-67e9-46b6-bc8d-b15bd89adc48 req-f867bf53-f6fd-46da-b7f3-1956c9af52f8 service nova] [instance: d2c911cf-d5f4-4c19-8335-8c7834184a7e] Received event network-vif-plugged-f4321c52-b9d5-434c-820f-25cab4239ef4 {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:23:09 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-92bc8d49-67e9-46b6-bc8d-b15bd89adc48 req-f867bf53-f6fd-46da-b7f3-1956c9af52f8 service nova] Acquiring lock "d2c911cf-d5f4-4c19-8335-8c7834184a7e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:23:09 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-92bc8d49-67e9-46b6-bc8d-b15bd89adc48 req-f867bf53-f6fd-46da-b7f3-1956c9af52f8 service nova] Lock "d2c911cf-d5f4-4c19-8335-8c7834184a7e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:23:09 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-92bc8d49-67e9-46b6-bc8d-b15bd89adc48 req-f867bf53-f6fd-46da-b7f3-1956c9af52f8 service nova] Lock "d2c911cf-d5f4-4c19-8335-8c7834184a7e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:23:09 user nova-compute[75045]: DEBUG nova.compute.manager [req-92bc8d49-67e9-46b6-bc8d-b15bd89adc48 req-f867bf53-f6fd-46da-b7f3-1956c9af52f8 service nova] [instance: d2c911cf-d5f4-4c19-8335-8c7834184a7e] No waiting events found dispatching network-vif-plugged-f4321c52-b9d5-434c-820f-25cab4239ef4 {{(pid=75045) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 23:23:09 user nova-compute[75045]: WARNING nova.compute.manager [req-92bc8d49-67e9-46b6-bc8d-b15bd89adc48 req-f867bf53-f6fd-46da-b7f3-1956c9af52f8 service nova] [instance: d2c911cf-d5f4-4c19-8335-8c7834184a7e] Received unexpected event network-vif-plugged-f4321c52-b9d5-434c-820f-25cab4239ef4 for instance with vm_state rescued and task_state unrescuing.
Nov 08 23:23:09 user nova-compute[75045]: DEBUG nova.compute.manager [req-92bc8d49-67e9-46b6-bc8d-b15bd89adc48 req-f867bf53-f6fd-46da-b7f3-1956c9af52f8 service nova] [instance: d2c911cf-d5f4-4c19-8335-8c7834184a7e] Received event network-vif-plugged-f4321c52-b9d5-434c-820f-25cab4239ef4 {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:23:09 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-92bc8d49-67e9-46b6-bc8d-b15bd89adc48 req-f867bf53-f6fd-46da-b7f3-1956c9af52f8 service nova] Acquiring lock "d2c911cf-d5f4-4c19-8335-8c7834184a7e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:23:09 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-92bc8d49-67e9-46b6-bc8d-b15bd89adc48 req-f867bf53-f6fd-46da-b7f3-1956c9af52f8 service nova] Lock "d2c911cf-d5f4-4c19-8335-8c7834184a7e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:23:09 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-92bc8d49-67e9-46b6-bc8d-b15bd89adc48 req-f867bf53-f6fd-46da-b7f3-1956c9af52f8 service nova] Lock "d2c911cf-d5f4-4c19-8335-8c7834184a7e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:23:09 user nova-compute[75045]: DEBUG nova.compute.manager [req-92bc8d49-67e9-46b6-bc8d-b15bd89adc48 req-f867bf53-f6fd-46da-b7f3-1956c9af52f8 service nova] [instance: d2c911cf-d5f4-4c19-8335-8c7834184a7e] No waiting events found dispatching network-vif-plugged-f4321c52-b9d5-434c-820f-25cab4239ef4 {{(pid=75045) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 23:23:09 user nova-compute[75045]: WARNING nova.compute.manager [req-92bc8d49-67e9-46b6-bc8d-b15bd89adc48 req-f867bf53-f6fd-46da-b7f3-1956c9af52f8 service nova] [instance: d2c911cf-d5f4-4c19-8335-8c7834184a7e] Received unexpected event network-vif-plugged-f4321c52-b9d5-434c-820f-25cab4239ef4 for instance with vm_state rescued and task_state unrescuing.
Nov 08 23:23:09 user nova-compute[75045]: DEBUG nova.compute.manager [req-92bc8d49-67e9-46b6-bc8d-b15bd89adc48 req-f867bf53-f6fd-46da-b7f3-1956c9af52f8 service nova] [instance: 43f31110-89ec-4b20-9842-7c9dd7df0e14] Received event network-changed-509a96ec-b573-4408-bf93-87bccca95836 {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:23:09 user nova-compute[75045]: DEBUG nova.compute.manager [req-92bc8d49-67e9-46b6-bc8d-b15bd89adc48 req-f867bf53-f6fd-46da-b7f3-1956c9af52f8 service nova] [instance: 43f31110-89ec-4b20-9842-7c9dd7df0e14] Refreshing instance network info cache due to event network-changed-509a96ec-b573-4408-bf93-87bccca95836. {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 23:23:09 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-92bc8d49-67e9-46b6-bc8d-b15bd89adc48 req-f867bf53-f6fd-46da-b7f3-1956c9af52f8 service nova] Acquiring lock "refresh_cache-43f31110-89ec-4b20-9842-7c9dd7df0e14" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 23:23:09 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-92bc8d49-67e9-46b6-bc8d-b15bd89adc48 req-f867bf53-f6fd-46da-b7f3-1956c9af52f8 service nova] Acquired lock "refresh_cache-43f31110-89ec-4b20-9842-7c9dd7df0e14" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 23:23:09 user nova-compute[75045]: DEBUG nova.network.neutron [req-92bc8d49-67e9-46b6-bc8d-b15bd89adc48 req-f867bf53-f6fd-46da-b7f3-1956c9af52f8 service nova] [instance: 43f31110-89ec-4b20-9842-7c9dd7df0e14] Refreshing network info cache for port 509a96ec-b573-4408-bf93-87bccca95836 {{(pid=75045) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 23:23:09 user nova-compute[75045]: DEBUG nova.compute.manager [None req-a79d58dc-f969-4189-86b7-e2c2412e9bbb tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] [instance: d2c911cf-d5f4-4c19-8335-8c7834184a7e] Checking state {{(pid=75045) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 23:23:10 user nova-compute[75045]: DEBUG nova.network.neutron [req-92bc8d49-67e9-46b6-bc8d-b15bd89adc48 req-f867bf53-f6fd-46da-b7f3-1956c9af52f8 service nova] [instance: 43f31110-89ec-4b20-9842-7c9dd7df0e14] Updated VIF entry in instance network info cache for port 509a96ec-b573-4408-bf93-87bccca95836. {{(pid=75045) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 23:23:10 user nova-compute[75045]: DEBUG nova.network.neutron [req-92bc8d49-67e9-46b6-bc8d-b15bd89adc48 req-f867bf53-f6fd-46da-b7f3-1956c9af52f8 service nova] [instance: 43f31110-89ec-4b20-9842-7c9dd7df0e14] Updating instance_info_cache with network_info: [{"id": "509a96ec-b573-4408-bf93-87bccca95836", "address": "fa:16:3e:db:57:7b", "network": {"id": "2f33d93d-98ec-4b87-a0c0-efe2d2ac8f6d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-719527911-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.162", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7eff4be777d24514be52868961bf7a25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap509a96ec-b5", "ovs_interfaceid": "509a96ec-b573-4408-bf93-87bccca95836", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75045) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 23:23:10 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-92bc8d49-67e9-46b6-bc8d-b15bd89adc48 req-f867bf53-f6fd-46da-b7f3-1956c9af52f8 service nova] Releasing lock "refresh_cache-43f31110-89ec-4b20-9842-7c9dd7df0e14" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 23:23:10 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:23:11 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:23:15 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:23:15 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-ce82b8f5-de24-457b-81ba-71103bd1a772 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Acquiring lock "43f31110-89ec-4b20-9842-7c9dd7df0e14" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:23:15 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-ce82b8f5-de24-457b-81ba-71103bd1a772 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Lock "43f31110-89ec-4b20-9842-7c9dd7df0e14" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:23:16 user nova-compute[75045]: DEBUG nova.objects.instance [None req-ce82b8f5-de24-457b-81ba-71103bd1a772 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Lazy-loading 'flavor' on Instance uuid 43f31110-89ec-4b20-9842-7c9dd7df0e14 {{(pid=75045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 23:23:16 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-ce82b8f5-de24-457b-81ba-71103bd1a772 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Lock "43f31110-89ec-4b20-9842-7c9dd7df0e14" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.069s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:23:16 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-445e7274-8e0f-445e-af25-de588565f906 tempest-TestVolumeSwap-1282852572 tempest-TestVolumeSwap-1282852572-project-member] Acquiring lock "fde91f7c-31e3-456c-b252-6ce37fa3b600" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:23:16 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-445e7274-8e0f-445e-af25-de588565f906 tempest-TestVolumeSwap-1282852572 tempest-TestVolumeSwap-1282852572-project-member] Lock "fde91f7c-31e3-456c-b252-6ce37fa3b600" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:23:16 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-445e7274-8e0f-445e-af25-de588565f906 tempest-TestVolumeSwap-1282852572 tempest-TestVolumeSwap-1282852572-project-member] Acquiring lock "fde91f7c-31e3-456c-b252-6ce37fa3b600-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:23:16 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-445e7274-8e0f-445e-af25-de588565f906 tempest-TestVolumeSwap-1282852572 tempest-TestVolumeSwap-1282852572-project-member] Lock "fde91f7c-31e3-456c-b252-6ce37fa3b600-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:23:16 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-445e7274-8e0f-445e-af25-de588565f906 tempest-TestVolumeSwap-1282852572 tempest-TestVolumeSwap-1282852572-project-member] Lock "fde91f7c-31e3-456c-b252-6ce37fa3b600-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:23:16 user nova-compute[75045]: INFO nova.compute.manager [None req-445e7274-8e0f-445e-af25-de588565f906 tempest-TestVolumeSwap-1282852572 tempest-TestVolumeSwap-1282852572-project-member] [instance: fde91f7c-31e3-456c-b252-6ce37fa3b600] Terminating instance
Nov 08 23:23:16 user nova-compute[75045]: DEBUG nova.compute.manager [None req-445e7274-8e0f-445e-af25-de588565f906 tempest-TestVolumeSwap-1282852572 tempest-TestVolumeSwap-1282852572-project-member] [instance: fde91f7c-31e3-456c-b252-6ce37fa3b600] Start destroying the instance on the hypervisor. {{(pid=75045) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 23:23:16 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:23:16 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-ce82b8f5-de24-457b-81ba-71103bd1a772 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Acquiring lock "43f31110-89ec-4b20-9842-7c9dd7df0e14" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:23:16 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-ce82b8f5-de24-457b-81ba-71103bd1a772 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Lock "43f31110-89ec-4b20-9842-7c9dd7df0e14" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:23:16 user nova-compute[75045]: INFO nova.compute.manager [None req-ce82b8f5-de24-457b-81ba-71103bd1a772 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] [instance: 43f31110-89ec-4b20-9842-7c9dd7df0e14] Attaching volume cd1b2206-989e-409d-84c6-49b37ac252d8 to /dev/vdb
Nov 08 23:23:16 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:23:16 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:23:16 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:23:16 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:23:16 user nova-compute[75045]: DEBUG os_brick.utils [None req-ce82b8f5-de24-457b-81ba-71103bd1a772 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75045) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 23:23:16 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:23:16 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:23:16 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e6d95d1-fe91-4daa-91ac-22f3f13771de]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6217bd6e884\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:23:16 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:23:16 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.024s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:23:16 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[366e0424-adb4-4621-a936-4e2bffe54e58]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:23:16 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:23:16 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:23:16 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[0691ef37-cc38-40fc-b2a0-944e16585edb]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:23:16 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[62b53b31-f5bc-4724-a9e8-0f7c3a560fd5]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:23:16 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-ce82b8f5-de24-457b-81ba-71103bd1a772 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Running cmd (subprocess): nvme version {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:23:16 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-ce82b8f5-de24-457b-81ba-71103bd1a772 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] 'nvme version' failed. Not Retrying. {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 23:23:16 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ce82b8f5-de24-457b-81ba-71103bd1a772 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] nvme not present on system {{(pid=75045) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 23:23:16 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:23:16 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 23:23:16 user nova-compute[75045]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 23:23:16 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fab1c8a-5ee5-48c6-ba4b-06550ca7eae3]: (4, '') {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:23:16 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.lightos [None req-ce82b8f5-de24-457b-81ba-71103bd1a772 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75045) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 23:23:16 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.lightos [None req-ce82b8f5-de24-457b-81ba-71103bd1a772 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75045) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 23:23:16 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.lightos [None req-ce82b8f5-de24-457b-81ba-71103bd1a772 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] LIGHTOS: no hostnqn found. {{(pid=75045) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 23:23:16 user nova-compute[75045]: DEBUG os_brick.utils [None req-ce82b8f5-de24-457b-81ba-71103bd1a772 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] <== get_connector_properties: return (148ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6217bd6e884', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75045) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 23:23:16 user nova-compute[75045]: DEBUG nova.virt.block_device [None req-ce82b8f5-de24-457b-81ba-71103bd1a772 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] [instance: 43f31110-89ec-4b20-9842-7c9dd7df0e14] Updating existing volume attachment record: 99045592-dac5-4389-86d4-87549233bd39 {{(pid=75045) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 23:23:16 user nova-compute[75045]: DEBUG nova.compute.manager [req-ad9e7388-9970-4be7-84a1-4bd00fe51ef4 req-0f6d95cd-17ba-4b57-81b5-217c40e51374 service nova] [instance: fde91f7c-31e3-456c-b252-6ce37fa3b600] Received event network-vif-unplugged-cf7f2506-395a-4404-a256-6600a5c0a06e {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:23:16 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-ad9e7388-9970-4be7-84a1-4bd00fe51ef4 req-0f6d95cd-17ba-4b57-81b5-217c40e51374 service nova] Acquiring lock "fde91f7c-31e3-456c-b252-6ce37fa3b600-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:23:16 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-ad9e7388-9970-4be7-84a1-4bd00fe51ef4 req-0f6d95cd-17ba-4b57-81b5-217c40e51374 service nova] Lock "fde91f7c-31e3-456c-b252-6ce37fa3b600-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:23:16 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-ad9e7388-9970-4be7-84a1-4bd00fe51ef4 req-0f6d95cd-17ba-4b57-81b5-217c40e51374 service nova] Lock "fde91f7c-31e3-456c-b252-6ce37fa3b600-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:23:16 user nova-compute[75045]: DEBUG nova.compute.manager [req-ad9e7388-9970-4be7-84a1-4bd00fe51ef4 req-0f6d95cd-17ba-4b57-81b5-217c40e51374 service nova] [instance: fde91f7c-31e3-456c-b252-6ce37fa3b600] No waiting events found dispatching network-vif-unplugged-cf7f2506-395a-4404-a256-6600a5c0a06e {{(pid=75045) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 23:23:16 user nova-compute[75045]: DEBUG nova.compute.manager [req-ad9e7388-9970-4be7-84a1-4bd00fe51ef4 req-0f6d95cd-17ba-4b57-81b5-217c40e51374 service nova] [instance: fde91f7c-31e3-456c-b252-6ce37fa3b600] Received event network-vif-unplugged-cf7f2506-395a-4404-a256-6600a5c0a06e for instance with task_state deleting. {{(pid=75045) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 23:23:16 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:23:16 user nova-compute[75045]: INFO nova.virt.libvirt.driver [-] [instance: fde91f7c-31e3-456c-b252-6ce37fa3b600] Instance destroyed successfully.
Nov 08 23:23:16 user nova-compute[75045]: DEBUG nova.objects.instance [None req-445e7274-8e0f-445e-af25-de588565f906 tempest-TestVolumeSwap-1282852572 tempest-TestVolumeSwap-1282852572-project-member] Lazy-loading 'resources' on Instance uuid fde91f7c-31e3-456c-b252-6ce37fa3b600 {{(pid=75045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 23:23:16 user nova-compute[75045]: DEBUG nova.virt.libvirt.vif [None req-445e7274-8e0f-445e-af25-de588565f906 tempest-TestVolumeSwap-1282852572 tempest-TestVolumeSwap-1282852572-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T23:16:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1418546643',display_name='tempest-TestVolumeSwap-server-1418546643',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1418546643',id=6,image_ref='a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN1W5rqC2nnvk7eMxQ2T5tQtsZDwK+TwKsWdIZ7qiVucbGH37x5tmeEhGGFYLh6qFb8AtpEA0f7Xzdq2TpYUmjQcpxylzIbfaQuZFI+0ZojI9YD5D8w0aSQGp5gnntIYyA==',key_name='tempest-keypair-616158558',keypairs=<?>,launch_index=0,launched_at=2023-11-08T23:16:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8fc58c033ee9468fa80d2d84f19c2f4c',ramdisk_id='',reservation_id='r-2bkhdz1g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeSwap-1282852572',owner_user_name='tempest-TestVolumeSwap-1282852572-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T23:16:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='be84d5fb901848d5b5f2bd19c6bdf5a1',uuid=fde91f7c-31e3-456c-b252-6ce37fa3b600,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cf7f2506-395a-4404-a256-6600a5c0a06e", "address": "fa:16:3e:a5:67:d3", "network": {"id": "d1b282d5-4d48-4a16-9f0d-82241f8add26", "bridge": "br-int", "label": "tempest-TestVolumeSwap-340739462-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.52", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8fc58c033ee9468fa80d2d84f19c2f4c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf7f2506-39", "ovs_interfaceid": "cf7f2506-395a-4404-a256-6600a5c0a06e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75045) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 23:23:16 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-445e7274-8e0f-445e-af25-de588565f906 tempest-TestVolumeSwap-1282852572 tempest-TestVolumeSwap-1282852572-project-member] Converting VIF {"id": "cf7f2506-395a-4404-a256-6600a5c0a06e", "address": "fa:16:3e:a5:67:d3", "network": {"id": "d1b282d5-4d48-4a16-9f0d-82241f8add26", "bridge": "br-int", "label": "tempest-TestVolumeSwap-340739462-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.52", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8fc58c033ee9468fa80d2d84f19c2f4c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf7f2506-39", "ovs_interfaceid": "cf7f2506-395a-4404-a256-6600a5c0a06e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 23:23:16 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-445e7274-8e0f-445e-af25-de588565f906 tempest-TestVolumeSwap-1282852572 tempest-TestVolumeSwap-1282852572-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a5:67:d3,bridge_name='br-int',has_traffic_filtering=True,id=cf7f2506-395a-4404-a256-6600a5c0a06e,network=Network(d1b282d5-4d48-4a16-9f0d-82241f8add26),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcf7f2506-39') {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 23:23:16 user nova-compute[75045]: DEBUG os_vif [None req-445e7274-8e0f-445e-af25-de588565f906 tempest-TestVolumeSwap-1282852572 tempest-TestVolumeSwap-1282852572-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a5:67:d3,bridge_name='br-int',has_traffic_filtering=True,id=cf7f2506-395a-4404-a256-6600a5c0a06e,network=Network(d1b282d5-4d48-4a16-9f0d-82241f8add26),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcf7f2506-39') {{(pid=75045) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 23:23:16 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:23:16 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapcf7f2506-39, bridge=br-int, if_exists=True) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:23:16 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:23:16 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:23:16 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:23:16 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2a41b476-713f-4dd2-9f00-7fc2a7103c1a) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:23:16 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:23:17 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 23:23:17 user nova-compute[75045]: INFO os_vif [None req-445e7274-8e0f-445e-af25-de588565f906 tempest-TestVolumeSwap-1282852572 tempest-TestVolumeSwap-1282852572-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a5:67:d3,bridge_name='br-int',has_traffic_filtering=True,id=cf7f2506-395a-4404-a256-6600a5c0a06e,network=Network(d1b282d5-4d48-4a16-9f0d-82241f8add26),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcf7f2506-39')
Nov 08 23:23:17 user nova-compute[75045]: DEBUG nova.virt.libvirt.volume.iscsi [None req-445e7274-8e0f-445e-af25-de588565f906 tempest-TestVolumeSwap-1282852572 tempest-TestVolumeSwap-1282852572-project-member] [instance: fde91f7c-31e3-456c-b252-6ce37fa3b600] calling os-brick to detach iSCSI Volume {{(pid=75045) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 23:23:17 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-445e7274-8e0f-445e-af25-de588565f906 tempest-TestVolumeSwap-1282852572 tempest-TestVolumeSwap-1282852572-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1b68210460>, {'target_iqn': 'iqn.2010-10.org.openstack:c7f7084f-f0d7-4d4b-9a14-69065a9c3e41', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mCxrFhHs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi', 'volume_id': 'c7f7084f-f0d7-4d4b-9a14-69065a9c3e41'}, None), 'kwargs': True}}" {{(pid=75045) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 23:23:17 user nova-compute[75045]: WARNING os_brick.initiator.connectors.base [None req-445e7274-8e0f-445e-af25-de588565f906 tempest-TestVolumeSwap-1282852572 tempest-TestVolumeSwap-1282852572-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 23:23:17 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-445e7274-8e0f-445e-af25-de588565f906 tempest-TestVolumeSwap-1282852572 tempest-TestVolumeSwap-1282852572-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 23:23:17 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-445e7274-8e0f-445e-af25-de588565f906 tempest-TestVolumeSwap-1282852572 tempest-TestVolumeSwap-1282852572-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 23:23:17 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:23:17 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:23:17 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[15ba3804-bffc-4ad8-9ef2-c9ea75bb1151]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:45f1b635-c8a3-4727-a4c7-c2ac441388ff\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c7f7084f-f0d7-4d4b-9a14-69065a9c3e41\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:23:17 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-445e7274-8e0f-445e-af25-de588565f906 tempest-TestVolumeSwap-1282852572 tempest-TestVolumeSwap-1282852572-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 23:23:17 user nova-compute[75045]: No targets found.
Nov 08 23:23:17 user nova-compute[75045]: iSNS:
Nov 08 23:23:17 user nova-compute[75045]: No targets found.
Nov 08 23:23:17 user nova-compute[75045]: STATIC:
Nov 08 23:23:17 user nova-compute[75045]: Target: iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab
Nov 08 23:23:17 user nova-compute[75045]:         Portal: 172.16.0.220:3260,-1
Nov 08 23:23:17 user nova-compute[75045]:                 Iface Name: default
Nov 08 23:23:17 user nova-compute[75045]: Target: iqn.2010-10.org.openstack:45f1b635-c8a3-4727-a4c7-c2ac441388ff
Nov 08 23:23:17 user nova-compute[75045]:         Portal: 172.16.0.220:3260,-1
Nov 08 23:23:17 user nova-compute[75045]:                 Iface Name: default
Nov 08 23:23:17 user nova-compute[75045]: Target: iqn.2010-10.org.openstack:c7f7084f-f0d7-4d4b-9a14-69065a9c3e41
Nov 08 23:23:17 user nova-compute[75045]:         Portal: 172.16.0.220:3260,-1
Nov 08 23:23:17 user nova-compute[75045]:                 Iface Name: default
Nov 08 23:23:17 user nova-compute[75045]: FIRMWARE:
Nov 08 23:23:17 user nova-compute[75045]: No targets found.
Nov 08 23:23:17 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 23:23:17 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-445e7274-8e0f-445e-af25-de588565f906 tempest-TestVolumeSwap-1282852572 tempest-TestVolumeSwap-1282852572-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 23:23:17 user nova-compute[75045]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 23:23:17 user nova-compute[75045]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75045) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 23:23:17 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-445e7274-8e0f-445e-af25-de588565f906 tempest-TestVolumeSwap-1282852572 tempest-TestVolumeSwap-1282852572-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c7f7084f-f0d7-4d4b-9a14-69065a9c3e41', 0)] {{(pid=75045) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 23:23:17 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:23:17 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:23:17 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[472bd258-a3b1-4c7c-aaef-4c54b283a0dd]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:45f1b635-c8a3-4727-a4c7-c2ac441388ff\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c7f7084f-f0d7-4d4b-9a14-69065a9c3e41\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:23:17 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:23:17 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:23:17 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[77a1fa7d-aaf2-4ed6-90a4-87f87afba102]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7f7084f-f0d7-4d4b-9a14-69065a9c3e41 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45f1b635-c8a3-4727-a4c7-c2ac441388ff (non-flash)\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:23:17 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-445e7274-8e0f-445e-af25-de588565f906 tempest-TestVolumeSwap-1282852572 tempest-TestVolumeSwap-1282852572-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab (non-flash)
Nov 08 23:23:17 user nova-compute[75045]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7f7084f-f0d7-4d4b-9a14-69065a9c3e41 (non-flash)
Nov 08 23:23:17 user nova-compute[75045]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45f1b635-c8a3-4727-a4c7-c2ac441388ff (non-flash)
Nov 08 23:23:17 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 23:23:17 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-445e7274-8e0f-445e-af25-de588565f906 tempest-TestVolumeSwap-1282852572 tempest-TestVolumeSwap-1282852572-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab (non-flash)
Nov 08 23:23:17 user nova-compute[75045]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7f7084f-f0d7-4d4b-9a14-69065a9c3e41 (non-flash)
Nov 08 23:23:17 user nova-compute[75045]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45f1b635-c8a3-4727-a4c7-c2ac441388ff (non-flash)
Nov 08 23:23:17 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 23:23:17 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-445e7274-8e0f-445e-af25-de588565f906 tempest-TestVolumeSwap-1282852572 tempest-TestVolumeSwap-1282852572-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1b485ea7a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c7f7084f-f0d7-4d4b-9a14-69065a9c3e41'): ({'sdi'}, set())}) {{(pid=75045) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 23:23:17 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-445e7274-8e0f-445e-af25-de588565f906 tempest-TestVolumeSwap-1282852572 tempest-TestVolumeSwap-1282852572-project-member] Removing single pathed devices sdi {{(pid=75045) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 23:23:17 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:23:17 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:23:17 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a026f83-1614-480e-b674-6e3aec5cb112]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:23:17 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdi {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:23:17 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdi" returned: 0 in 0.021s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:23:17 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[af35becd-eea5-4004-ae50-9dacaf186493]: (4, ('ok\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:23:17 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-445e7274-8e0f-445e-af25-de588565f906 tempest-TestVolumeSwap-1282852572 tempest-TestVolumeSwap-1282852572-project-member] Flushing IO for device /dev/sdi {{(pid=75045) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 23:23:17 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdi {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:23:17 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdi" returned: 0 in 0.013s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:23:17 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2268318-0441-4d23-a505-6378faee93bd]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:23:17 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-445e7274-8e0f-445e-af25-de588565f906 tempest-TestVolumeSwap-1282852572 tempest-TestVolumeSwap-1282852572-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=75045) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 23:23:17 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdi/device/delete {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:23:17 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdi/device/delete" returned: 0 in 0.052s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:23:17 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[c65538cb-db61-4580-9742-21848c30cec6]: (4, ('1', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:23:17 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-445e7274-8e0f-445e-af25-de588565f906 tempest-TestVolumeSwap-1282852572 tempest-TestVolumeSwap-1282852572-project-member] Checking to see if SCSI volumes sdi have been removed. {{(pid=75045) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 23:23:17 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-445e7274-8e0f-445e-af25-de588565f906 tempest-TestVolumeSwap-1282852572 tempest-TestVolumeSwap-1282852572-project-member] SCSI volumes sdi have been removed. {{(pid=75045) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 23:23:17 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-445e7274-8e0f-445e-af25-de588565f906 tempest-TestVolumeSwap-1282852572 tempest-TestVolumeSwap-1282852572-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c7f7084f-f0d7-4d4b-9a14-69065a9c3e41')] {{(pid=75045) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 23:23:17 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7f7084f-f0d7-4d4b-9a14-69065a9c3e41 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:23:17 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7f7084f-f0d7-4d4b-9a14-69065a9c3e41 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:23:17 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[50dcf091-7621-4757-ac5c-fc0808b572f8]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:23:17 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-445e7274-8e0f-445e-af25-de588565f906 tempest-TestVolumeSwap-1282852572 tempest-TestVolumeSwap-1282852572-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:23:17 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7f7084f-f0d7-4d4b-9a14-69065a9c3e41 -p 172.16.0.220:3260 --logout {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:23:17 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7f7084f-f0d7-4d4b-9a14-69065a9c3e41 -p 172.16.0.220:3260 --logout" returned: 0 in 0.074s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:23:17 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd233ef6-bdd8-482b-bce2-7c3473b93967]: (4, ('Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:c7f7084f-f0d7-4d4b-9a14-69065a9c3e41, portal: 172.16.0.220,3260]\nLogout of [sid: 12, target: iqn.2010-10.org.openstack:c7f7084f-f0d7-4d4b-9a14-69065a9c3e41, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:23:17 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-445e7274-8e0f-445e-af25-de588565f906 tempest-TestVolumeSwap-1282852572 tempest-TestVolumeSwap-1282852572-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:c7f7084f-f0d7-4d4b-9a14-69065a9c3e41, portal: 172.16.0.220,3260]
Nov 08 23:23:17 user nova-compute[75045]: Logout of [sid: 12, target: iqn.2010-10.org.openstack:c7f7084f-f0d7-4d4b-9a14-69065a9c3e41, portal: 172.16.0.220,3260] successful.
Nov 08 23:23:17 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:23:17 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7f7084f-f0d7-4d4b-9a14-69065a9c3e41 -p 172.16.0.220:3260 --op delete {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:23:17 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7f7084f-f0d7-4d4b-9a14-69065a9c3e41 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:23:17 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[98c5652c-f0c8-4046-baf6-b58a73b6f0e1]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:23:17 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-445e7274-8e0f-445e-af25-de588565f906 tempest-TestVolumeSwap-1282852572 tempest-TestVolumeSwap-1282852572-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:23:17 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-445e7274-8e0f-445e-af25-de588565f906 tempest-TestVolumeSwap-1282852572 tempest-TestVolumeSwap-1282852572-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.345s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 23:23:17 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-445e7274-8e0f-445e-af25-de588565f906 tempest-TestVolumeSwap-1282852572 tempest-TestVolumeSwap-1282852572-project-member] <== disconnect_volume: return (346ms) None {{(pid=75045) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 23:23:17 user nova-compute[75045]: DEBUG nova.virt.libvirt.volume.iscsi [None req-445e7274-8e0f-445e-af25-de588565f906 tempest-TestVolumeSwap-1282852572 tempest-TestVolumeSwap-1282852572-project-member] [instance: fde91f7c-31e3-456c-b252-6ce37fa3b600] Disconnected iSCSI Volume {{(pid=75045) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 23:23:17 user nova-compute[75045]: INFO nova.virt.libvirt.driver [None req-445e7274-8e0f-445e-af25-de588565f906 tempest-TestVolumeSwap-1282852572 tempest-TestVolumeSwap-1282852572-project-member] [instance: fde91f7c-31e3-456c-b252-6ce37fa3b600] Deleting instance files /opt/stack/data/nova/instances/fde91f7c-31e3-456c-b252-6ce37fa3b600_del
Nov 08 23:23:17 user nova-compute[75045]: INFO nova.virt.libvirt.driver [None req-445e7274-8e0f-445e-af25-de588565f906 tempest-TestVolumeSwap-1282852572 tempest-TestVolumeSwap-1282852572-project-member] [instance: fde91f7c-31e3-456c-b252-6ce37fa3b600] Deletion of /opt/stack/data/nova/instances/fde91f7c-31e3-456c-b252-6ce37fa3b600_del complete
Nov 08 23:23:17 user nova-compute[75045]: INFO nova.compute.manager [None req-445e7274-8e0f-445e-af25-de588565f906 tempest-TestVolumeSwap-1282852572 tempest-TestVolumeSwap-1282852572-project-member] [instance: fde91f7c-31e3-456c-b252-6ce37fa3b600] Took 1.29 seconds to destroy the instance on the hypervisor.
Nov 08 23:23:17 user nova-compute[75045]: DEBUG oslo.service.loopingcall [None req-445e7274-8e0f-445e-af25-de588565f906 tempest-TestVolumeSwap-1282852572 tempest-TestVolumeSwap-1282852572-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75045) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 23:23:17 user nova-compute[75045]: DEBUG nova.compute.manager [-] [instance: fde91f7c-31e3-456c-b252-6ce37fa3b600] Deallocating network for instance {{(pid=75045) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 23:23:17 user nova-compute[75045]: DEBUG nova.network.neutron [-] [instance: fde91f7c-31e3-456c-b252-6ce37fa3b600] deallocate_for_instance() {{(pid=75045) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 23:23:18 user nova-compute[75045]: DEBUG nova.network.neutron [-] [instance: fde91f7c-31e3-456c-b252-6ce37fa3b600] Updating instance_info_cache with network_info: [] {{(pid=75045) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 23:23:18 user nova-compute[75045]: DEBUG nova.compute.manager [req-3e6382fb-6545-4726-aa72-bf8a64a1204f req-94f2e8c9-7a4a-464e-b7cc-6a29544f33e2 service nova] [instance: fde91f7c-31e3-456c-b252-6ce37fa3b600] Received event network-vif-deleted-cf7f2506-395a-4404-a256-6600a5c0a06e {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:23:18 user nova-compute[75045]: INFO nova.compute.manager [req-3e6382fb-6545-4726-aa72-bf8a64a1204f req-94f2e8c9-7a4a-464e-b7cc-6a29544f33e2 service nova] [instance: fde91f7c-31e3-456c-b252-6ce37fa3b600] Neutron deleted interface cf7f2506-395a-4404-a256-6600a5c0a06e; detaching it from the instance and deleting it from the info cache
Nov 08 23:23:18 user nova-compute[75045]: DEBUG nova.network.neutron [req-3e6382fb-6545-4726-aa72-bf8a64a1204f req-94f2e8c9-7a4a-464e-b7cc-6a29544f33e2 service nova] [instance: fde91f7c-31e3-456c-b252-6ce37fa3b600] Updating instance_info_cache with network_info: [] {{(pid=75045) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 23:23:18 user nova-compute[75045]: INFO nova.compute.manager [-] [instance: fde91f7c-31e3-456c-b252-6ce37fa3b600] Took 0.91 seconds to deallocate network for instance.
Nov 08 23:23:18 user nova-compute[75045]: DEBUG nova.compute.manager [req-3e6382fb-6545-4726-aa72-bf8a64a1204f req-94f2e8c9-7a4a-464e-b7cc-6a29544f33e2 service nova] [instance: fde91f7c-31e3-456c-b252-6ce37fa3b600] Detach interface failed, port_id=cf7f2506-395a-4404-a256-6600a5c0a06e, reason: Instance fde91f7c-31e3-456c-b252-6ce37fa3b600 could not be found. {{(pid=75045) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 08 23:23:18 user nova-compute[75045]: DEBUG nova.compute.manager [req-e1c18094-5ac3-4861-82cf-7f0efb99ab48 req-8b6b13a0-9667-4061-bd3a-8f24aa29996c service nova] [instance: fde91f7c-31e3-456c-b252-6ce37fa3b600] Received event network-vif-plugged-cf7f2506-395a-4404-a256-6600a5c0a06e {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:23:18 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-e1c18094-5ac3-4861-82cf-7f0efb99ab48 req-8b6b13a0-9667-4061-bd3a-8f24aa29996c service nova] Acquiring lock "fde91f7c-31e3-456c-b252-6ce37fa3b600-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:23:18 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-e1c18094-5ac3-4861-82cf-7f0efb99ab48 req-8b6b13a0-9667-4061-bd3a-8f24aa29996c service nova] Lock "fde91f7c-31e3-456c-b252-6ce37fa3b600-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:23:18 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-e1c18094-5ac3-4861-82cf-7f0efb99ab48 req-8b6b13a0-9667-4061-bd3a-8f24aa29996c service nova] Lock "fde91f7c-31e3-456c-b252-6ce37fa3b600-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:23:18 user nova-compute[75045]: DEBUG nova.compute.manager [req-e1c18094-5ac3-4861-82cf-7f0efb99ab48 req-8b6b13a0-9667-4061-bd3a-8f24aa29996c service nova] [instance: fde91f7c-31e3-456c-b252-6ce37fa3b600] No waiting events found dispatching network-vif-plugged-cf7f2506-395a-4404-a256-6600a5c0a06e {{(pid=75045) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 23:23:18 user nova-compute[75045]: WARNING nova.compute.manager [req-e1c18094-5ac3-4861-82cf-7f0efb99ab48 req-8b6b13a0-9667-4061-bd3a-8f24aa29996c service nova] [instance: fde91f7c-31e3-456c-b252-6ce37fa3b600] Received unexpected event network-vif-plugged-cf7f2506-395a-4404-a256-6600a5c0a06e for instance with vm_state active and task_state deleting.
Nov 08 23:23:19 user nova-compute[75045]: INFO nova.compute.manager [None req-445e7274-8e0f-445e-af25-de588565f906 tempest-TestVolumeSwap-1282852572 tempest-TestVolumeSwap-1282852572-project-member] [instance: fde91f7c-31e3-456c-b252-6ce37fa3b600] Took 1.03 seconds to detach 1 volumes for instance.
Nov 08 23:23:19 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-445e7274-8e0f-445e-af25-de588565f906 tempest-TestVolumeSwap-1282852572 tempest-TestVolumeSwap-1282852572-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:23:19 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-445e7274-8e0f-445e-af25-de588565f906 tempest-TestVolumeSwap-1282852572 tempest-TestVolumeSwap-1282852572-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:23:19 user nova-compute[75045]: DEBUG nova.compute.provider_tree [None req-445e7274-8e0f-445e-af25-de588565f906 tempest-TestVolumeSwap-1282852572 tempest-TestVolumeSwap-1282852572-project-member] Inventory has not changed in ProviderTree for provider: 62ba5f85-c74d-4b58-986e-d4197e813fd7 {{(pid=75045) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 23:23:19 user nova-compute[75045]: DEBUG nova.scheduler.client.report [None req-445e7274-8e0f-445e-af25-de588565f906 tempest-TestVolumeSwap-1282852572 tempest-TestVolumeSwap-1282852572-project-member] Inventory has not changed for provider 62ba5f85-c74d-4b58-986e-d4197e813fd7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75045) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 23:23:19 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-445e7274-8e0f-445e-af25-de588565f906 tempest-TestVolumeSwap-1282852572 tempest-TestVolumeSwap-1282852572-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.442s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:23:19 user nova-compute[75045]: INFO nova.scheduler.client.report [None req-445e7274-8e0f-445e-af25-de588565f906 tempest-TestVolumeSwap-1282852572 tempest-TestVolumeSwap-1282852572-project-member] Deleted allocations for instance fde91f7c-31e3-456c-b252-6ce37fa3b600
Nov 08 23:23:20 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-445e7274-8e0f-445e-af25-de588565f906 tempest-TestVolumeSwap-1282852572 tempest-TestVolumeSwap-1282852572-project-member] Lock "fde91f7c-31e3-456c-b252-6ce37fa3b600" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.930s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:23:20 user nova-compute[75045]: DEBUG nova.compute.manager [req-ff140dcf-c5a6-4edd-af0f-ba4513ae82be req-b8459731-c506-494e-9531-b0102396aaf8 service nova] [instance: 83d225e0-e39e-4500-b7ae-52dfbd8b8588] Received event network-changed-f34eef67-0428-49ea-91c3-08510ac690c8 {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:23:20 user nova-compute[75045]: DEBUG nova.compute.manager [req-ff140dcf-c5a6-4edd-af0f-ba4513ae82be req-b8459731-c506-494e-9531-b0102396aaf8 service nova] [instance: 83d225e0-e39e-4500-b7ae-52dfbd8b8588] Refreshing instance network info cache due to event network-changed-f34eef67-0428-49ea-91c3-08510ac690c8. {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 23:23:20 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-ff140dcf-c5a6-4edd-af0f-ba4513ae82be req-b8459731-c506-494e-9531-b0102396aaf8 service nova] Acquiring lock "refresh_cache-83d225e0-e39e-4500-b7ae-52dfbd8b8588" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 23:23:20 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-ff140dcf-c5a6-4edd-af0f-ba4513ae82be req-b8459731-c506-494e-9531-b0102396aaf8 service nova] Acquired lock "refresh_cache-83d225e0-e39e-4500-b7ae-52dfbd8b8588" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 23:23:20 user nova-compute[75045]: DEBUG nova.network.neutron [req-ff140dcf-c5a6-4edd-af0f-ba4513ae82be req-b8459731-c506-494e-9531-b0102396aaf8 service nova] [instance: 83d225e0-e39e-4500-b7ae-52dfbd8b8588] Refreshing network info cache for port f34eef67-0428-49ea-91c3-08510ac690c8 {{(pid=75045) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 23:23:20 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:23:21 user nova-compute[75045]: DEBUG nova.network.neutron [req-ff140dcf-c5a6-4edd-af0f-ba4513ae82be req-b8459731-c506-494e-9531-b0102396aaf8 service nova] [instance: 83d225e0-e39e-4500-b7ae-52dfbd8b8588] Updated VIF entry in instance network info cache for port f34eef67-0428-49ea-91c3-08510ac690c8. {{(pid=75045) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 23:23:21 user nova-compute[75045]: DEBUG nova.network.neutron [req-ff140dcf-c5a6-4edd-af0f-ba4513ae82be req-b8459731-c506-494e-9531-b0102396aaf8 service nova] [instance: 83d225e0-e39e-4500-b7ae-52dfbd8b8588] Updating instance_info_cache with network_info: [{"id": "f34eef67-0428-49ea-91c3-08510ac690c8", "address": "fa:16:3e:d9:92:a4", "network": {"id": "d177c8b8-5960-4e40-bf9b-920a2f6ba4f7", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-497258569-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.31", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "467f0ecc3b93457f9fe83886b99c6285", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf34eef67-04", "ovs_interfaceid": "f34eef67-0428-49ea-91c3-08510ac690c8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75045) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 23:23:21 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-ff140dcf-c5a6-4edd-af0f-ba4513ae82be req-b8459731-c506-494e-9531-b0102396aaf8 service nova] Releasing lock "refresh_cache-83d225e0-e39e-4500-b7ae-52dfbd8b8588" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 23:23:21 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:23:25 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:23:25 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:23:26 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:23:29 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:23:30 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:23:32 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:23:33 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:23:35 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:23:35 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:23:37 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:23:37 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:23:40 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:23:41 user nova-compute[75045]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ce82b8f5-de24-457b-81ba-71103bd1a772 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] [instance: 43f31110-89ec-4b20-9842-7c9dd7df0e14] Calling os-brick to attach iSCSI Volume {{(pid=75045) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 23:23:41 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce82b8f5-de24-457b-81ba-71103bd1a772 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1b68210460>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:cd1b2206-989e-409d-84c6-49b37ac252d8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pHMZXvYa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75045) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 23:23:41 user nova-compute[75045]: WARNING os_brick.initiator.connectors.base [None req-ce82b8f5-de24-457b-81ba-71103bd1a772 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 23:23:41 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-ce82b8f5-de24-457b-81ba-71103bd1a772 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 23:23:41 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-ce82b8f5-de24-457b-81ba-71103bd1a772 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 23:23:41 user nova-compute[75045]: WARNING os_brick.initiator.connectors.base [None req-ce82b8f5-de24-457b-81ba-71103bd1a772 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 23:23:41 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-ce82b8f5-de24-457b-81ba-71103bd1a772 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cd1b2206-989e-409d-84c6-49b37ac252d8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 23:23:41 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-ce82b8f5-de24-457b-81ba-71103bd1a772 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cd1b2206-989e-409d-84c6-49b37ac252d8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 23:23:41 user nova-compute[75045]: INFO os_brick.initiator.connectors.iscsi [None req-ce82b8f5-de24-457b-81ba-71103bd1a772 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 23:23:41 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cd1b2206-989e-409d-84c6-49b37ac252d8 -p 172.16.0.220:3260 {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:23:41 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cd1b2206-989e-409d-84c6-49b37ac252d8 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:23:41 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[412dc0a9-0d6d-4321-9ee6-85a3e1ebbb59]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:23:41 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce82b8f5-de24-457b-81ba-71103bd1a772 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 23:23:41 user nova-compute[75045]:  {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:23:41 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cd1b2206-989e-409d-84c6-49b37ac252d8 -p 172.16.0.220:3260 --interface default --op new {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:23:41 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cd1b2206-989e-409d-84c6-49b37ac252d8 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:23:41 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[45974431-ec6b-4977-a281-392db7c1357c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cd1b2206-989e-409d-84c6-49b37ac252d8] added\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:23:41 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce82b8f5-de24-457b-81ba-71103bd1a772 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cd1b2206-989e-409d-84c6-49b37ac252d8] added
Nov 08 23:23:41 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:23:41 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cd1b2206-989e-409d-84c6-49b37ac252d8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:23:41 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cd1b2206-989e-409d-84c6-49b37ac252d8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:23:41 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7636465-7b0b-4b11-a3b9-a254a8722d3a]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:23:41 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce82b8f5-de24-457b-81ba-71103bd1a772 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:23:41 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cd1b2206-989e-409d-84c6-49b37ac252d8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:23:41 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cd1b2206-989e-409d-84c6-49b37ac252d8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:23:41 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[d85b678b-613d-4943-baef-d7db4aa9df53]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:23:41 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce82b8f5-de24-457b-81ba-71103bd1a772 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:23:41 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cd1b2206-989e-409d-84c6-49b37ac252d8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pHMZXvYa {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:23:41 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cd1b2206-989e-409d-84c6-49b37ac252d8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pHMZXvYa" returned: 0 in 0.020s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:23:41 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e1c1556-7cb0-4b4f-a34f-82d0bb5e181c]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:23:41 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce82b8f5-de24-457b-81ba-71103bd1a772 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'pHMZXvYa'): stdout= stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:23:41 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cd1b2206-989e-409d-84c6-49b37ac252d8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:23:41 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cd1b2206-989e-409d-84c6-49b37ac252d8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:23:41 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[88b2b3db-835d-4c95-84e0-4da5f14db94e]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:23:41 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce82b8f5-de24-457b-81ba-71103bd1a772 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:23:41 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:23:41 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:23:41 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[765b6882-3436-4e8b-9b77-83e240a5fa06]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45f1b635-c8a3-4727-a4c7-c2ac441388ff (non-flash)\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:23:41 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce82b8f5-de24-457b-81ba-71103bd1a772 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab (non-flash)
Nov 08 23:23:41 user nova-compute[75045]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45f1b635-c8a3-4727-a4c7-c2ac441388ff (non-flash)
Nov 08 23:23:41 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 23:23:41 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce82b8f5-de24-457b-81ba-71103bd1a772 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab (non-flash)
Nov 08 23:23:41 user nova-compute[75045]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45f1b635-c8a3-4727-a4c7-c2ac441388ff (non-flash)
Nov 08 23:23:41 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 23:23:41 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cd1b2206-989e-409d-84c6-49b37ac252d8 -p 172.16.0.220:3260 --login {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:23:41 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cd1b2206-989e-409d-84c6-49b37ac252d8 -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:23:41 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe255663-4f96-41b0-a7c6-db5c13e24ea4]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:cd1b2206-989e-409d-84c6-49b37ac252d8, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:cd1b2206-989e-409d-84c6-49b37ac252d8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:23:41 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce82b8f5-de24-457b-81ba-71103bd1a772 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:cd1b2206-989e-409d-84c6-49b37ac252d8, portal: 172.16.0.220,3260]
Nov 08 23:23:41 user nova-compute[75045]: Login to [iface: default, target: iqn.2010-10.org.openstack:cd1b2206-989e-409d-84c6-49b37ac252d8, portal: 172.16.0.220,3260] successful.
Nov 08 23:23:41 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:23:41 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cd1b2206-989e-409d-84c6-49b37ac252d8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:23:41 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cd1b2206-989e-409d-84c6-49b37ac252d8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:23:41 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3353c3b-3009-46e1-a30d-74af810a4068]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:23:41 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce82b8f5-de24-457b-81ba-71103bd1a772 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:23:41 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:23:41 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:23:41 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cad8ea5-91e9-4a2d-9eda-ed988fbad028]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45f1b635-c8a3-4727-a4c7-c2ac441388ff (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd1b2206-989e-409d-84c6-49b37ac252d8 (non-flash)\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:23:41 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce82b8f5-de24-457b-81ba-71103bd1a772 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab (non-flash)
Nov 08 23:23:41 user nova-compute[75045]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45f1b635-c8a3-4727-a4c7-c2ac441388ff (non-flash)
Nov 08 23:23:41 user nova-compute[75045]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd1b2206-989e-409d-84c6-49b37ac252d8 (non-flash)
Nov 08 23:23:41 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 23:23:41 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce82b8f5-de24-457b-81ba-71103bd1a772 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab (non-flash)
Nov 08 23:23:41 user nova-compute[75045]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45f1b635-c8a3-4727-a4c7-c2ac441388ff (non-flash)
Nov 08 23:23:41 user nova-compute[75045]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd1b2206-989e-409d-84c6-49b37ac252d8 (non-flash)
Nov 08 23:23:41 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 23:23:41 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-ce82b8f5-de24-457b-81ba-71103bd1a772 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cd1b2206-989e-409d-84c6-49b37ac252d8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.283s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 23:23:41 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce82b8f5-de24-457b-81ba-71103bd1a772 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Connected to 172.16.0.220:3260 {{(pid=75045) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 23:23:41 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-ce82b8f5-de24-457b-81ba-71103bd1a772 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] HCTL ('33', '-', '-', 0) found on session 17 with lun 0 {{(pid=75045) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 23:23:41 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-ce82b8f5-de24-457b-81ba-71103bd1a772 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75045) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 23:23:41 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:23:41 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.021s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:23:41 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ff9a506-f99b-4b6d-bf3e-40f89ed905f5]: (4, ('- - 0', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:23:41 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-ce82b8f5-de24-457b-81ba-71103bd1a772 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Searching for a device in session 17 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75045) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 23:23:41 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce82b8f5-de24-457b-81ba-71103bd1a772 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:cd1b2206-989e-409d-84c6-49b37ac252d8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pHMZXvYa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75045) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 23:23:42 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:23:42 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-ce82b8f5-de24-457b-81ba-71103bd1a772 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.325s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 23:23:42 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce82b8f5-de24-457b-81ba-71103bd1a772 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] <== connect_volume: return (1327ms) {'type': 'block', 'scsi_wwn': '26534373664633432', 'path': '/dev/sdb'} {{(pid=75045) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 23:23:42 user nova-compute[75045]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ce82b8f5-de24-457b-81ba-71103bd1a772 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] [instance: 43f31110-89ec-4b20-9842-7c9dd7df0e14] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26534373664633432', 'path': '/dev/sdb'} {{(pid=75045) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 23:23:42 user nova-compute[75045]: DEBUG nova.objects.instance [None req-ce82b8f5-de24-457b-81ba-71103bd1a772 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Lazy-loading 'flavor' on Instance uuid 43f31110-89ec-4b20-9842-7c9dd7df0e14 {{(pid=75045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 23:23:42 user nova-compute[75045]: DEBUG nova.virt.libvirt.guest [None req-ce82b8f5-de24-457b-81ba-71103bd1a772 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] attach device xml: <disk type="block" device="disk">
Nov 08 23:23:42 user nova-compute[75045]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 23:23:42 user nova-compute[75045]:   <source dev="/dev/sdb"/>
Nov 08 23:23:42 user nova-compute[75045]:   <target dev="vdb" bus="virtio"/>
Nov 08 23:23:42 user nova-compute[75045]:   <serial>cd1b2206-989e-409d-84c6-49b37ac252d8</serial>
Nov 08 23:23:42 user nova-compute[75045]: </disk>
Nov 08 23:23:42 user nova-compute[75045]:  {{(pid=75045) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 08 23:23:42 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-ce82b8f5-de24-457b-81ba-71103bd1a772 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] No BDM found with device name vda, not building metadata. {{(pid=75045) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 23:23:42 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-ce82b8f5-de24-457b-81ba-71103bd1a772 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75045) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 23:23:42 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-ce82b8f5-de24-457b-81ba-71103bd1a772 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] No VIF found with MAC fa:16:3e:db:57:7b, not building metadata {{(pid=75045) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 23:23:42 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-ce82b8f5-de24-457b-81ba-71103bd1a772 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Lock "43f31110-89ec-4b20-9842-7c9dd7df0e14" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 26.735s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:23:44 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:23:44 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:23:44 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:23:44 user nova-compute[75045]: DEBUG nova.compute.manager [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Starting heal instance info cache {{(pid=75045) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 23:23:44 user nova-compute[75045]: DEBUG nova.compute.manager [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Rebuilding the list of instances to heal {{(pid=75045) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 08 23:23:44 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Acquiring lock "refresh_cache-4ae5ff6b-6f2c-4dfd-a4c6-da4809e2cf27" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 23:23:44 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Acquired lock "refresh_cache-4ae5ff6b-6f2c-4dfd-a4c6-da4809e2cf27" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 23:23:44 user nova-compute[75045]: DEBUG nova.network.neutron [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] [instance: 4ae5ff6b-6f2c-4dfd-a4c6-da4809e2cf27] Forcefully refreshing network info cache for instance {{(pid=75045) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 23:23:44 user nova-compute[75045]: DEBUG nova.objects.instance [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Lazy-loading 'info_cache' on Instance uuid 4ae5ff6b-6f2c-4dfd-a4c6-da4809e2cf27 {{(pid=75045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 23:23:44 user nova-compute[75045]: DEBUG nova.network.neutron [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] [instance: 4ae5ff6b-6f2c-4dfd-a4c6-da4809e2cf27] Updating instance_info_cache with network_info: [{"id": "cfa24a0c-4dce-4dae-a5d7-10ebfa1cc305", "address": "fa:16:3e:33:11:13", "network": {"id": "d4cd6998-66d1-4389-bc82-dd000c8962de", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-323966879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bfb6963a6c145d4a7b7e47c8fde7e60", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcfa24a0c-4d", "ovs_interfaceid": "cfa24a0c-4dce-4dae-a5d7-10ebfa1cc305", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75045) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 23:23:44 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Releasing lock "refresh_cache-4ae5ff6b-6f2c-4dfd-a4c6-da4809e2cf27" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 23:23:44 user nova-compute[75045]: DEBUG nova.compute.manager [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] [instance: 4ae5ff6b-6f2c-4dfd-a4c6-da4809e2cf27] Updated the network info_cache for instance {{(pid=75045) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 23:23:44 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:23:44 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:23:44 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:23:44 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:23:44 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:23:44 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:23:44 user nova-compute[75045]: DEBUG nova.compute.manager [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75045) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 23:23:44 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager.update_available_resource {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:23:44 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:23:44 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:23:44 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:23:44 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Auditing locally available compute resources for user (node: user) {{(pid=75045) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 23:23:44 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ae5ff6b-6f2c-4dfd-a4c6-da4809e2cf27/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:23:45 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ae5ff6b-6f2c-4dfd-a4c6-da4809e2cf27/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:23:45 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ae5ff6b-6f2c-4dfd-a4c6-da4809e2cf27/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:23:45 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ae5ff6b-6f2c-4dfd-a4c6-da4809e2cf27/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:23:45 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] skipping disk /dev/sdh (vda) as it is a volume {{(pid=75045) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 23:23:45 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/032e20aa-8887-4215-808e-68299a0d8d0b/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:23:45 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/032e20aa-8887-4215-808e-68299a0d8d0b/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:23:45 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/032e20aa-8887-4215-808e-68299a0d8d0b/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:23:45 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/032e20aa-8887-4215-808e-68299a0d8d0b/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:23:45 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75045) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 23:23:45 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f21fcd3-ac5f-499e-9c34-82af806fda1d/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:23:45 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-d4d8e0f1-e54e-448c-88e9-1ce845a80a75 tempest-VolumesActionsTest-1040491269 tempest-VolumesActionsTest-1040491269-project-member] Acquiring lock "9de31aa1-6996-4c4a-bd44-fce18e0890f4" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:23:45 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-d4d8e0f1-e54e-448c-88e9-1ce845a80a75 tempest-VolumesActionsTest-1040491269 tempest-VolumesActionsTest-1040491269-project-member] Lock "9de31aa1-6996-4c4a-bd44-fce18e0890f4" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.003s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:23:45 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-d4d8e0f1-e54e-448c-88e9-1ce845a80a75 tempest-VolumesActionsTest-1040491269 tempest-VolumesActionsTest-1040491269-project-member] Acquiring lock "9de31aa1-6996-4c4a-bd44-fce18e0890f4-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:23:45 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-d4d8e0f1-e54e-448c-88e9-1ce845a80a75 tempest-VolumesActionsTest-1040491269 tempest-VolumesActionsTest-1040491269-project-member] Lock "9de31aa1-6996-4c4a-bd44-fce18e0890f4-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:23:45 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-d4d8e0f1-e54e-448c-88e9-1ce845a80a75 tempest-VolumesActionsTest-1040491269 tempest-VolumesActionsTest-1040491269-project-member] Lock "9de31aa1-6996-4c4a-bd44-fce18e0890f4-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:23:45 user nova-compute[75045]: INFO nova.compute.manager [None req-d4d8e0f1-e54e-448c-88e9-1ce845a80a75 tempest-VolumesActionsTest-1040491269 tempest-VolumesActionsTest-1040491269-project-member] [instance: 9de31aa1-6996-4c4a-bd44-fce18e0890f4] Terminating instance
Nov 08 23:23:45 user nova-compute[75045]: DEBUG nova.compute.manager [None req-d4d8e0f1-e54e-448c-88e9-1ce845a80a75 tempest-VolumesActionsTest-1040491269 tempest-VolumesActionsTest-1040491269-project-member] [instance: 9de31aa1-6996-4c4a-bd44-fce18e0890f4] Start destroying the instance on the hypervisor. {{(pid=75045) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 23:23:45 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:23:45 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:23:45 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:23:45 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:23:46 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f21fcd3-ac5f-499e-9c34-82af806fda1d/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:23:46 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f21fcd3-ac5f-499e-9c34-82af806fda1d/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:23:46 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:23:46 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-cf67e48d-6a96-4329-a5f5-8a73e9cc0463 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Acquiring lock "7ee70847-10de-49b6-9731-6d65b06532c8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:23:46 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-cf67e48d-6a96-4329-a5f5-8a73e9cc0463 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Lock "7ee70847-10de-49b6-9731-6d65b06532c8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:23:46 user nova-compute[75045]: DEBUG nova.compute.manager [None req-cf67e48d-6a96-4329-a5f5-8a73e9cc0463 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] [instance: 7ee70847-10de-49b6-9731-6d65b06532c8] Starting instance... {{(pid=75045) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 23:23:46 user nova-compute[75045]: DEBUG nova.compute.manager [req-52dbf1cd-6338-45ec-b926-44dc9514eb00 req-415222b2-6dfc-4fe7-891a-b5c46cc340e2 service nova] [instance: 9de31aa1-6996-4c4a-bd44-fce18e0890f4] Received event network-vif-unplugged-e1fd4958-e47c-48f4-aa6f-31066cb3f571 {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:23:46 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-52dbf1cd-6338-45ec-b926-44dc9514eb00 req-415222b2-6dfc-4fe7-891a-b5c46cc340e2 service nova] Acquiring lock "9de31aa1-6996-4c4a-bd44-fce18e0890f4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:23:46 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-52dbf1cd-6338-45ec-b926-44dc9514eb00 req-415222b2-6dfc-4fe7-891a-b5c46cc340e2 service nova] Lock "9de31aa1-6996-4c4a-bd44-fce18e0890f4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:23:46 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-52dbf1cd-6338-45ec-b926-44dc9514eb00 req-415222b2-6dfc-4fe7-891a-b5c46cc340e2 service nova] Lock "9de31aa1-6996-4c4a-bd44-fce18e0890f4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:23:46 user nova-compute[75045]: DEBUG nova.compute.manager [req-52dbf1cd-6338-45ec-b926-44dc9514eb00 req-415222b2-6dfc-4fe7-891a-b5c46cc340e2 service nova] [instance: 9de31aa1-6996-4c4a-bd44-fce18e0890f4] No waiting events found dispatching network-vif-unplugged-e1fd4958-e47c-48f4-aa6f-31066cb3f571 {{(pid=75045) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 23:23:46 user nova-compute[75045]: DEBUG nova.compute.manager [req-52dbf1cd-6338-45ec-b926-44dc9514eb00 req-415222b2-6dfc-4fe7-891a-b5c46cc340e2 service nova] [instance: 9de31aa1-6996-4c4a-bd44-fce18e0890f4] Received event network-vif-unplugged-e1fd4958-e47c-48f4-aa6f-31066cb3f571 for instance with task_state deleting. {{(pid=75045) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 23:23:46 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f21fcd3-ac5f-499e-9c34-82af806fda1d/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:23:46 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-cf67e48d-6a96-4329-a5f5-8a73e9cc0463 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:23:46 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-cf67e48d-6a96-4329-a5f5-8a73e9cc0463 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:23:46 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-cf67e48d-6a96-4329-a5f5-8a73e9cc0463 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75045) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 23:23:46 user nova-compute[75045]: INFO nova.compute.claims [None req-cf67e48d-6a96-4329-a5f5-8a73e9cc0463 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] [instance: 7ee70847-10de-49b6-9731-6d65b06532c8] Claim successful on node user
Nov 08 23:23:46 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9de31aa1-6996-4c4a-bd44-fce18e0890f4/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:23:46 user nova-compute[75045]: INFO nova.virt.libvirt.driver [-] [instance: 9de31aa1-6996-4c4a-bd44-fce18e0890f4] Instance destroyed successfully.
Nov 08 23:23:46 user nova-compute[75045]: DEBUG nova.objects.instance [None req-d4d8e0f1-e54e-448c-88e9-1ce845a80a75 tempest-VolumesActionsTest-1040491269 tempest-VolumesActionsTest-1040491269-project-member] Lazy-loading 'resources' on Instance uuid 9de31aa1-6996-4c4a-bd44-fce18e0890f4 {{(pid=75045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 23:23:46 user nova-compute[75045]: DEBUG nova.virt.libvirt.vif [None req-d4d8e0f1-e54e-448c-88e9-1ce845a80a75 tempest-VolumesActionsTest-1040491269 tempest-VolumesActionsTest-1040491269-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T23:21:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1282366556',display_name='tempest-VolumesActionsTest-instance-1282366556',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1282366556',id=17,image_ref='a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-08T23:21:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d400c9e6a57b4b8b830b7fd7a83bc8c5',ramdisk_id='',reservation_id='r-1m6jo0ih',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1040491269',owner_user_name='tempest-VolumesActionsTest-1040491269-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T23:21:50Z,user_data=None,user_id='47fd89109eff4cf9a4a5d8b5f53b8980',uuid=9de31aa1-6996-4c4a-bd44-fce18e0890f4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e1fd4958-e47c-48f4-aa6f-31066cb3f571", "address": "fa:16:3e:6f:06:fe", "network": {"id": "8f7dd756-4715-4085-bfab-8432f99f2e77", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1836278743-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d400c9e6a57b4b8b830b7fd7a83bc8c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1fd4958-e4", "ovs_interfaceid": "e1fd4958-e47c-48f4-aa6f-31066cb3f571", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75045) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 23:23:46 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-d4d8e0f1-e54e-448c-88e9-1ce845a80a75 tempest-VolumesActionsTest-1040491269 tempest-VolumesActionsTest-1040491269-project-member] Converting VIF {"id": "e1fd4958-e47c-48f4-aa6f-31066cb3f571", "address": "fa:16:3e:6f:06:fe", "network": {"id": "8f7dd756-4715-4085-bfab-8432f99f2e77", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1836278743-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d400c9e6a57b4b8b830b7fd7a83bc8c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1fd4958-e4", "ovs_interfaceid": "e1fd4958-e47c-48f4-aa6f-31066cb3f571", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 23:23:46 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-d4d8e0f1-e54e-448c-88e9-1ce845a80a75 tempest-VolumesActionsTest-1040491269 tempest-VolumesActionsTest-1040491269-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6f:06:fe,bridge_name='br-int',has_traffic_filtering=True,id=e1fd4958-e47c-48f4-aa6f-31066cb3f571,network=Network(8f7dd756-4715-4085-bfab-8432f99f2e77),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape1fd4958-e4') {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 23:23:46 user nova-compute[75045]: DEBUG os_vif [None req-d4d8e0f1-e54e-448c-88e9-1ce845a80a75 tempest-VolumesActionsTest-1040491269 tempest-VolumesActionsTest-1040491269-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6f:06:fe,bridge_name='br-int',has_traffic_filtering=True,id=e1fd4958-e47c-48f4-aa6f-31066cb3f571,network=Network(8f7dd756-4715-4085-bfab-8432f99f2e77),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape1fd4958-e4') {{(pid=75045) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 23:23:46 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:23:46 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape1fd4958-e4, bridge=br-int, if_exists=True) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:23:46 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:23:46 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 23:23:46 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:23:46 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4df74b60-7cf7-48ee-a487-c2c8dd317087) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:23:46 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:23:46 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:23:46 user nova-compute[75045]: INFO os_vif [None req-d4d8e0f1-e54e-448c-88e9-1ce845a80a75 tempest-VolumesActionsTest-1040491269 tempest-VolumesActionsTest-1040491269-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6f:06:fe,bridge_name='br-int',has_traffic_filtering=True,id=e1fd4958-e47c-48f4-aa6f-31066cb3f571,network=Network(8f7dd756-4715-4085-bfab-8432f99f2e77),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape1fd4958-e4')
Nov 08 23:23:46 user nova-compute[75045]: INFO nova.virt.libvirt.driver [None req-d4d8e0f1-e54e-448c-88e9-1ce845a80a75 tempest-VolumesActionsTest-1040491269 tempest-VolumesActionsTest-1040491269-project-member] [instance: 9de31aa1-6996-4c4a-bd44-fce18e0890f4] Deleting instance files /opt/stack/data/nova/instances/9de31aa1-6996-4c4a-bd44-fce18e0890f4_del
Nov 08 23:23:46 user nova-compute[75045]: INFO nova.virt.libvirt.driver [None req-d4d8e0f1-e54e-448c-88e9-1ce845a80a75 tempest-VolumesActionsTest-1040491269 tempest-VolumesActionsTest-1040491269-project-member] [instance: 9de31aa1-6996-4c4a-bd44-fce18e0890f4] Deletion of /opt/stack/data/nova/instances/9de31aa1-6996-4c4a-bd44-fce18e0890f4_del complete
Nov 08 23:23:46 user nova-compute[75045]: INFO nova.compute.manager [None req-d4d8e0f1-e54e-448c-88e9-1ce845a80a75 tempest-VolumesActionsTest-1040491269 tempest-VolumesActionsTest-1040491269-project-member] [instance: 9de31aa1-6996-4c4a-bd44-fce18e0890f4] Took 0.83 seconds to destroy the instance on the hypervisor.
Nov 08 23:23:46 user nova-compute[75045]: DEBUG oslo.service.loopingcall [None req-d4d8e0f1-e54e-448c-88e9-1ce845a80a75 tempest-VolumesActionsTest-1040491269 tempest-VolumesActionsTest-1040491269-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75045) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 23:23:46 user nova-compute[75045]: DEBUG nova.compute.manager [-] [instance: 9de31aa1-6996-4c4a-bd44-fce18e0890f4] Deallocating network for instance {{(pid=75045) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 23:23:46 user nova-compute[75045]: DEBUG nova.network.neutron [-] [instance: 9de31aa1-6996-4c4a-bd44-fce18e0890f4] deallocate_for_instance() {{(pid=75045) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 23:23:46 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9de31aa1-6996-4c4a-bd44-fce18e0890f4/disk --force-share --output=json" returned: 1 in 0.205s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:23:46 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9de31aa1-6996-4c4a-bd44-fce18e0890f4/disk --force-share --output=json' failed. Not Retrying. {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 23:23:46 user nova-compute[75045]: WARNING nova.virt.libvirt.driver [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Periodic task is updating the host stats, it is trying to get disk info for instance-00000011, but the backing disk storage was removed by a concurrent operation such as resize. Error: No disk at /opt/stack/data/nova/instances/9de31aa1-6996-4c4a-bd44-fce18e0890f4/disk: nova.exception.DiskNotFound: No disk at /opt/stack/data/nova/instances/9de31aa1-6996-4c4a-bd44-fce18e0890f4/disk
Nov 08 23:23:46 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83d225e0-e39e-4500-b7ae-52dfbd8b8588/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:23:46 user nova-compute[75045]: DEBUG nova.compute.provider_tree [None req-cf67e48d-6a96-4329-a5f5-8a73e9cc0463 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Inventory has not changed in ProviderTree for provider: 62ba5f85-c74d-4b58-986e-d4197e813fd7 {{(pid=75045) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 23:23:46 user nova-compute[75045]: DEBUG nova.scheduler.client.report [None req-cf67e48d-6a96-4329-a5f5-8a73e9cc0463 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Inventory has not changed for provider 62ba5f85-c74d-4b58-986e-d4197e813fd7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75045) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 23:23:46 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-cf67e48d-6a96-4329-a5f5-8a73e9cc0463 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.627s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:23:46 user nova-compute[75045]: DEBUG nova.compute.manager [None req-cf67e48d-6a96-4329-a5f5-8a73e9cc0463 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] [instance: 7ee70847-10de-49b6-9731-6d65b06532c8] Start building networks asynchronously for instance. {{(pid=75045) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 23:23:46 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83d225e0-e39e-4500-b7ae-52dfbd8b8588/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:23:46 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83d225e0-e39e-4500-b7ae-52dfbd8b8588/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:23:46 user nova-compute[75045]: DEBUG nova.compute.manager [None req-cf67e48d-6a96-4329-a5f5-8a73e9cc0463 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] [instance: 7ee70847-10de-49b6-9731-6d65b06532c8] Allocating IP information in the background. {{(pid=75045) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 23:23:46 user nova-compute[75045]: DEBUG nova.network.neutron [None req-cf67e48d-6a96-4329-a5f5-8a73e9cc0463 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] [instance: 7ee70847-10de-49b6-9731-6d65b06532c8] allocate_for_instance() {{(pid=75045) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 23:23:46 user nova-compute[75045]: INFO nova.virt.libvirt.driver [None req-cf67e48d-6a96-4329-a5f5-8a73e9cc0463 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] [instance: 7ee70847-10de-49b6-9731-6d65b06532c8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 23:23:47 user nova-compute[75045]: DEBUG nova.compute.manager [None req-cf67e48d-6a96-4329-a5f5-8a73e9cc0463 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] [instance: 7ee70847-10de-49b6-9731-6d65b06532c8] Start building block device mappings for instance. {{(pid=75045) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 23:23:47 user nova-compute[75045]: DEBUG nova.policy [None req-cf67e48d-6a96-4329-a5f5-8a73e9cc0463 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4a05b178abe74b779a991e887bf135b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eff4be777d24514be52868961bf7a25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75045) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 23:23:47 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83d225e0-e39e-4500-b7ae-52dfbd8b8588/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:23:47 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43f31110-89ec-4b20-9842-7c9dd7df0e14/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:23:47 user nova-compute[75045]: DEBUG nova.compute.manager [None req-cf67e48d-6a96-4329-a5f5-8a73e9cc0463 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] [instance: 7ee70847-10de-49b6-9731-6d65b06532c8] Start spawning the instance on the hypervisor. {{(pid=75045) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 23:23:47 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-cf67e48d-6a96-4329-a5f5-8a73e9cc0463 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] [instance: 7ee70847-10de-49b6-9731-6d65b06532c8] Creating instance directory {{(pid=75045) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 23:23:47 user nova-compute[75045]: INFO nova.virt.libvirt.driver [None req-cf67e48d-6a96-4329-a5f5-8a73e9cc0463 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] [instance: 7ee70847-10de-49b6-9731-6d65b06532c8] Creating image(s)
Nov 08 23:23:47 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-cf67e48d-6a96-4329-a5f5-8a73e9cc0463 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Acquiring lock "/opt/stack/data/nova/instances/7ee70847-10de-49b6-9731-6d65b06532c8/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:23:47 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-cf67e48d-6a96-4329-a5f5-8a73e9cc0463 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Lock "/opt/stack/data/nova/instances/7ee70847-10de-49b6-9731-6d65b06532c8/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:23:47 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-cf67e48d-6a96-4329-a5f5-8a73e9cc0463 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Lock "/opt/stack/data/nova/instances/7ee70847-10de-49b6-9731-6d65b06532c8/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.009s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:23:47 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-cf67e48d-6a96-4329-a5f5-8a73e9cc0463 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b59f52a99fff51c56dd1edfb83892fb8f647f2f3 --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:23:47 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43f31110-89ec-4b20-9842-7c9dd7df0e14/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:23:47 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43f31110-89ec-4b20-9842-7c9dd7df0e14/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:23:47 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-cf67e48d-6a96-4329-a5f5-8a73e9cc0463 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b59f52a99fff51c56dd1edfb83892fb8f647f2f3 --force-share --output=json" returned: 0 in 0.201s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:23:47 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-cf67e48d-6a96-4329-a5f5-8a73e9cc0463 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Acquiring lock "b59f52a99fff51c56dd1edfb83892fb8f647f2f3" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:23:47 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-cf67e48d-6a96-4329-a5f5-8a73e9cc0463 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Lock "b59f52a99fff51c56dd1edfb83892fb8f647f2f3" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:23:47 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-cf67e48d-6a96-4329-a5f5-8a73e9cc0463 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b59f52a99fff51c56dd1edfb83892fb8f647f2f3 --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:23:47 user nova-compute[75045]: DEBUG nova.network.neutron [-] [instance: 9de31aa1-6996-4c4a-bd44-fce18e0890f4] Updating instance_info_cache with network_info: [] {{(pid=75045) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 23:23:47 user nova-compute[75045]: INFO nova.compute.manager [-] [instance: 9de31aa1-6996-4c4a-bd44-fce18e0890f4] Took 0.77 seconds to deallocate network for instance.
Nov 08 23:23:47 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43f31110-89ec-4b20-9842-7c9dd7df0e14/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:23:47 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75045) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 23:23:47 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25cd59d1-6884-471a-813e-52e97c2e1208/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:23:47 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-d4d8e0f1-e54e-448c-88e9-1ce845a80a75 tempest-VolumesActionsTest-1040491269 tempest-VolumesActionsTest-1040491269-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:23:47 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-d4d8e0f1-e54e-448c-88e9-1ce845a80a75 tempest-VolumesActionsTest-1040491269 tempest-VolumesActionsTest-1040491269-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.003s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:23:47 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-cf67e48d-6a96-4329-a5f5-8a73e9cc0463 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b59f52a99fff51c56dd1edfb83892fb8f647f2f3 --force-share --output=json" returned: 0 in 0.195s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:23:47 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-cf67e48d-6a96-4329-a5f5-8a73e9cc0463 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b59f52a99fff51c56dd1edfb83892fb8f647f2f3,backing_fmt=raw /opt/stack/data/nova/instances/7ee70847-10de-49b6-9731-6d65b06532c8/disk 1073741824 {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:23:47 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-cf67e48d-6a96-4329-a5f5-8a73e9cc0463 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b59f52a99fff51c56dd1edfb83892fb8f647f2f3,backing_fmt=raw /opt/stack/data/nova/instances/7ee70847-10de-49b6-9731-6d65b06532c8/disk 1073741824" returned: 0 in 0.057s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:23:47 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-cf67e48d-6a96-4329-a5f5-8a73e9cc0463 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Lock "b59f52a99fff51c56dd1edfb83892fb8f647f2f3" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.256s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:23:47 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-cf67e48d-6a96-4329-a5f5-8a73e9cc0463 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b59f52a99fff51c56dd1edfb83892fb8f647f2f3 --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:23:47 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25cd59d1-6884-471a-813e-52e97c2e1208/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:23:47 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25cd59d1-6884-471a-813e-52e97c2e1208/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:23:47 user nova-compute[75045]: DEBUG nova.network.neutron [None req-cf67e48d-6a96-4329-a5f5-8a73e9cc0463 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] [instance: 7ee70847-10de-49b6-9731-6d65b06532c8] Successfully created port: d6445a4b-3c64-4aa0-b7c7-a5756db64532 {{(pid=75045) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 23:23:47 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-cf67e48d-6a96-4329-a5f5-8a73e9cc0463 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b59f52a99fff51c56dd1edfb83892fb8f647f2f3 --force-share --output=json" returned: 0 in 0.235s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:23:47 user nova-compute[75045]: DEBUG nova.virt.disk.api [None req-cf67e48d-6a96-4329-a5f5-8a73e9cc0463 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7ee70847-10de-49b6-9731-6d65b06532c8/disk. size=1073741824 {{(pid=75045) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 23:23:47 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-cf67e48d-6a96-4329-a5f5-8a73e9cc0463 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ee70847-10de-49b6-9731-6d65b06532c8/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:23:47 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25cd59d1-6884-471a-813e-52e97c2e1208/disk --force-share --output=json" returned: 0 in 0.234s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:23:47 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5fc7f02-2143-4bcf-92ac-078d5ec10747/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:23:48 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-cf67e48d-6a96-4329-a5f5-8a73e9cc0463 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ee70847-10de-49b6-9731-6d65b06532c8/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:23:48 user nova-compute[75045]: DEBUG nova.virt.disk.api [None req-cf67e48d-6a96-4329-a5f5-8a73e9cc0463 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Cannot resize image /opt/stack/data/nova/instances/7ee70847-10de-49b6-9731-6d65b06532c8/disk to a smaller size. {{(pid=75045) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 08 23:23:48 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-cf67e48d-6a96-4329-a5f5-8a73e9cc0463 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] [instance: 7ee70847-10de-49b6-9731-6d65b06532c8] Created local disks {{(pid=75045) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 23:23:48 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-cf67e48d-6a96-4329-a5f5-8a73e9cc0463 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] [instance: 7ee70847-10de-49b6-9731-6d65b06532c8] Ensure instance console log exists: /opt/stack/data/nova/instances/7ee70847-10de-49b6-9731-6d65b06532c8/console.log {{(pid=75045) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 23:23:48 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-cf67e48d-6a96-4329-a5f5-8a73e9cc0463 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:23:48 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-cf67e48d-6a96-4329-a5f5-8a73e9cc0463 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:23:48 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-cf67e48d-6a96-4329-a5f5-8a73e9cc0463 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:23:48 user nova-compute[75045]: DEBUG nova.compute.provider_tree [None req-d4d8e0f1-e54e-448c-88e9-1ce845a80a75 tempest-VolumesActionsTest-1040491269 tempest-VolumesActionsTest-1040491269-project-member] Inventory has not changed in ProviderTree for provider: 62ba5f85-c74d-4b58-986e-d4197e813fd7 {{(pid=75045) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 23:23:48 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5fc7f02-2143-4bcf-92ac-078d5ec10747/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:23:48 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5fc7f02-2143-4bcf-92ac-078d5ec10747/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:23:48 user nova-compute[75045]: DEBUG nova.scheduler.client.report [None req-d4d8e0f1-e54e-448c-88e9-1ce845a80a75 tempest-VolumesActionsTest-1040491269 tempest-VolumesActionsTest-1040491269-project-member] Inventory has not changed for provider 62ba5f85-c74d-4b58-986e-d4197e813fd7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75045) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 23:23:48 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-d4d8e0f1-e54e-448c-88e9-1ce845a80a75 tempest-VolumesActionsTest-1040491269 tempest-VolumesActionsTest-1040491269-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.661s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:23:48 user nova-compute[75045]: DEBUG nova.compute.manager [req-4e9e5ff4-8e8e-4140-bfd3-adcc0f9db8e8 req-173c3fc0-90da-4c6b-af4f-0d9ce0b0530a service nova] [instance: 9de31aa1-6996-4c4a-bd44-fce18e0890f4] Received event network-vif-plugged-e1fd4958-e47c-48f4-aa6f-31066cb3f571 {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:23:48 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-4e9e5ff4-8e8e-4140-bfd3-adcc0f9db8e8 req-173c3fc0-90da-4c6b-af4f-0d9ce0b0530a service nova] Acquiring lock "9de31aa1-6996-4c4a-bd44-fce18e0890f4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:23:48 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-4e9e5ff4-8e8e-4140-bfd3-adcc0f9db8e8 req-173c3fc0-90da-4c6b-af4f-0d9ce0b0530a service nova] Lock "9de31aa1-6996-4c4a-bd44-fce18e0890f4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:23:48 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-4e9e5ff4-8e8e-4140-bfd3-adcc0f9db8e8 req-173c3fc0-90da-4c6b-af4f-0d9ce0b0530a service nova] Lock "9de31aa1-6996-4c4a-bd44-fce18e0890f4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:23:48 user nova-compute[75045]: DEBUG nova.compute.manager [req-4e9e5ff4-8e8e-4140-bfd3-adcc0f9db8e8 req-173c3fc0-90da-4c6b-af4f-0d9ce0b0530a service nova] [instance: 9de31aa1-6996-4c4a-bd44-fce18e0890f4] No waiting events found dispatching network-vif-plugged-e1fd4958-e47c-48f4-aa6f-31066cb3f571 {{(pid=75045) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 23:23:48 user nova-compute[75045]: WARNING nova.compute.manager [req-4e9e5ff4-8e8e-4140-bfd3-adcc0f9db8e8 req-173c3fc0-90da-4c6b-af4f-0d9ce0b0530a service nova] [instance: 9de31aa1-6996-4c4a-bd44-fce18e0890f4] Received unexpected event network-vif-plugged-e1fd4958-e47c-48f4-aa6f-31066cb3f571 for instance with vm_state deleted and task_state None.
Nov 08 23:23:48 user nova-compute[75045]: DEBUG nova.compute.manager [req-4e9e5ff4-8e8e-4140-bfd3-adcc0f9db8e8 req-173c3fc0-90da-4c6b-af4f-0d9ce0b0530a service nova] [instance: 9de31aa1-6996-4c4a-bd44-fce18e0890f4] Received event network-vif-deleted-e1fd4958-e47c-48f4-aa6f-31066cb3f571 {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:23:48 user nova-compute[75045]: INFO nova.scheduler.client.report [None req-d4d8e0f1-e54e-448c-88e9-1ce845a80a75 tempest-VolumesActionsTest-1040491269 tempest-VolumesActionsTest-1040491269-project-member] Deleted allocations for instance 9de31aa1-6996-4c4a-bd44-fce18e0890f4
Nov 08 23:23:48 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5fc7f02-2143-4bcf-92ac-078d5ec10747/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:23:48 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-d4d8e0f1-e54e-448c-88e9-1ce845a80a75 tempest-VolumesActionsTest-1040491269 tempest-VolumesActionsTest-1040491269-project-member] Lock "9de31aa1-6996-4c4a-bd44-fce18e0890f4" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.506s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:23:48 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b84f2b1-01a3-4789-bcef-8b7c4334132b/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:23:48 user nova-compute[75045]: DEBUG nova.network.neutron [None req-cf67e48d-6a96-4329-a5f5-8a73e9cc0463 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] [instance: 7ee70847-10de-49b6-9731-6d65b06532c8] Successfully updated port: d6445a4b-3c64-4aa0-b7c7-a5756db64532 {{(pid=75045) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 23:23:48 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-cf67e48d-6a96-4329-a5f5-8a73e9cc0463 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Acquiring lock "refresh_cache-7ee70847-10de-49b6-9731-6d65b06532c8" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 23:23:48 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-cf67e48d-6a96-4329-a5f5-8a73e9cc0463 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Acquired lock "refresh_cache-7ee70847-10de-49b6-9731-6d65b06532c8" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 23:23:48 user nova-compute[75045]: DEBUG nova.network.neutron [None req-cf67e48d-6a96-4329-a5f5-8a73e9cc0463 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] [instance: 7ee70847-10de-49b6-9731-6d65b06532c8] Building network info cache for instance {{(pid=75045) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 23:23:48 user nova-compute[75045]: DEBUG nova.compute.manager [req-06c15a86-431f-4e77-b577-aa6d03942cc3 req-077e025a-a3e4-42b1-9600-6f8f41b0e499 service nova] [instance: 7ee70847-10de-49b6-9731-6d65b06532c8] Received event network-changed-d6445a4b-3c64-4aa0-b7c7-a5756db64532 {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:23:48 user nova-compute[75045]: DEBUG nova.compute.manager [req-06c15a86-431f-4e77-b577-aa6d03942cc3 req-077e025a-a3e4-42b1-9600-6f8f41b0e499 service nova] [instance: 7ee70847-10de-49b6-9731-6d65b06532c8] Refreshing instance network info cache due to event network-changed-d6445a4b-3c64-4aa0-b7c7-a5756db64532. {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 23:23:48 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-06c15a86-431f-4e77-b577-aa6d03942cc3 req-077e025a-a3e4-42b1-9600-6f8f41b0e499 service nova] Acquiring lock "refresh_cache-7ee70847-10de-49b6-9731-6d65b06532c8" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 23:23:48 user nova-compute[75045]: DEBUG nova.network.neutron [None req-cf67e48d-6a96-4329-a5f5-8a73e9cc0463 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] [instance: 7ee70847-10de-49b6-9731-6d65b06532c8] Instance cache missing network info. {{(pid=75045) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 23:23:48 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b84f2b1-01a3-4789-bcef-8b7c4334132b/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:23:48 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b84f2b1-01a3-4789-bcef-8b7c4334132b/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:23:48 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b84f2b1-01a3-4789-bcef-8b7c4334132b/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:23:48 user nova-compute[75045]: DEBUG nova.network.neutron [None req-cf67e48d-6a96-4329-a5f5-8a73e9cc0463 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] [instance: 7ee70847-10de-49b6-9731-6d65b06532c8] Updating instance_info_cache with network_info: [{"id": "d6445a4b-3c64-4aa0-b7c7-a5756db64532", "address": "fa:16:3e:9f:ee:36", "network": {"id": "2f33d93d-98ec-4b87-a0c0-efe2d2ac8f6d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-719527911-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7eff4be777d24514be52868961bf7a25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6445a4b-3c", "ovs_interfaceid": "d6445a4b-3c64-4aa0-b7c7-a5756db64532", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75045) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 23:23:49 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-cf67e48d-6a96-4329-a5f5-8a73e9cc0463 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Releasing lock "refresh_cache-7ee70847-10de-49b6-9731-6d65b06532c8" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 23:23:49 user nova-compute[75045]: DEBUG nova.compute.manager [None req-cf67e48d-6a96-4329-a5f5-8a73e9cc0463 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] [instance: 7ee70847-10de-49b6-9731-6d65b06532c8] Instance network_info: |[{"id": "d6445a4b-3c64-4aa0-b7c7-a5756db64532", "address": "fa:16:3e:9f:ee:36", "network": {"id": "2f33d93d-98ec-4b87-a0c0-efe2d2ac8f6d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-719527911-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7eff4be777d24514be52868961bf7a25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6445a4b-3c", "ovs_interfaceid": "d6445a4b-3c64-4aa0-b7c7-a5756db64532", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75045) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 23:23:49 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-06c15a86-431f-4e77-b577-aa6d03942cc3 req-077e025a-a3e4-42b1-9600-6f8f41b0e499 service nova] Acquired lock "refresh_cache-7ee70847-10de-49b6-9731-6d65b06532c8" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 23:23:49 user nova-compute[75045]: DEBUG nova.network.neutron [req-06c15a86-431f-4e77-b577-aa6d03942cc3 req-077e025a-a3e4-42b1-9600-6f8f41b0e499 service nova] [instance: 7ee70847-10de-49b6-9731-6d65b06532c8] Refreshing network info cache for port d6445a4b-3c64-4aa0-b7c7-a5756db64532 {{(pid=75045) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 23:23:49 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-cf67e48d-6a96-4329-a5f5-8a73e9cc0463 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] [instance: 7ee70847-10de-49b6-9731-6d65b06532c8] Start _get_guest_xml network_info=[{"id": "d6445a4b-3c64-4aa0-b7c7-a5756db64532", "address": "fa:16:3e:9f:ee:36", "network": {"id": "2f33d93d-98ec-4b87-a0c0-efe2d2ac8f6d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-719527911-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7eff4be777d24514be52868961bf7a25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6445a4b-3c", "ovs_interfaceid": "d6445a4b-3c64-4aa0-b7c7-a5756db64532", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T23:11:54Z,direct_url=<?>,disk_format='qcow2',id=a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b1beba2cc4e7465ea249e2225fb494dc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T23:11:56Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'disk_bus': 'virtio', 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': 'a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75045) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 23:23:49 user nova-compute[75045]: WARNING nova.virt.libvirt.driver [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 23:23:49 user nova-compute[75045]: WARNING nova.virt.libvirt.driver [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 23:23:49 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Hypervisor/Node resource view: name=user free_ram=7298MB free_disk=25.241840362548828GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75045) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 23:23:49 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:23:49 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:23:49 user nova-compute[75045]: WARNING nova.virt.libvirt.driver [None req-cf67e48d-6a96-4329-a5f5-8a73e9cc0463 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 23:23:49 user nova-compute[75045]: WARNING nova.virt.libvirt.driver [None req-cf67e48d-6a96-4329-a5f5-8a73e9cc0463 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 23:23:49 user nova-compute[75045]: DEBUG nova.virt.libvirt.host [None req-cf67e48d-6a96-4329-a5f5-8a73e9cc0463 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75045) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 23:23:49 user nova-compute[75045]: DEBUG nova.virt.libvirt.host [None req-cf67e48d-6a96-4329-a5f5-8a73e9cc0463 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] CPU controller missing on host. {{(pid=75045) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 23:23:49 user nova-compute[75045]: DEBUG nova.virt.libvirt.host [None req-cf67e48d-6a96-4329-a5f5-8a73e9cc0463 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75045) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 23:23:49 user nova-compute[75045]: DEBUG nova.virt.libvirt.host [None req-cf67e48d-6a96-4329-a5f5-8a73e9cc0463 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] CPU controller found on host. {{(pid=75045) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 23:23:49 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-cf67e48d-6a96-4329-a5f5-8a73e9cc0463 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75045) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 23:23:49 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-cf67e48d-6a96-4329-a5f5-8a73e9cc0463 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T23:11:41Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T23:11:54Z,direct_url=<?>,disk_format='qcow2',id=a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b1beba2cc4e7465ea249e2225fb494dc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T23:11:56Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75045) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 23:23:49 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-cf67e48d-6a96-4329-a5f5-8a73e9cc0463 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Flavor limits 0:0:0 {{(pid=75045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 23:23:49 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-cf67e48d-6a96-4329-a5f5-8a73e9cc0463 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Image limits 0:0:0 {{(pid=75045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 23:23:49 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-cf67e48d-6a96-4329-a5f5-8a73e9cc0463 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Flavor pref 0:0:0 {{(pid=75045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 23:23:49 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-cf67e48d-6a96-4329-a5f5-8a73e9cc0463 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Image pref 0:0:0 {{(pid=75045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 23:23:49 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-cf67e48d-6a96-4329-a5f5-8a73e9cc0463 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 23:23:49 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-cf67e48d-6a96-4329-a5f5-8a73e9cc0463 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75045) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 23:23:49 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-cf67e48d-6a96-4329-a5f5-8a73e9cc0463 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75045) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 23:23:49 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-cf67e48d-6a96-4329-a5f5-8a73e9cc0463 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Got 1 possible topologies {{(pid=75045) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 23:23:49 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-cf67e48d-6a96-4329-a5f5-8a73e9cc0463 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75045) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 23:23:49 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-cf67e48d-6a96-4329-a5f5-8a73e9cc0463 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75045) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 23:23:49 user nova-compute[75045]: DEBUG nova.virt.libvirt.vif [None req-cf67e48d-6a96-4329-a5f5-8a73e9cc0463 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T23:23:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-205119403',display_name='tempest-AttachVolumeNegativeTest-server-205119403',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-205119403',id=21,image_ref='a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF/AcMHCN1yLsphPUOJymoB8arG9AmwYlVpV2pXrg/5qqM85Y12212xIUjFveTFgUBwxO2xmPilEz4sPYEiW3rB8q4VeflZETWT76OVfLPHA9Ve/wohAW0gjaQZUpMDPuw==',key_name='tempest-keypair-1571543808',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7eff4be777d24514be52868961bf7a25',ramdisk_id='',reservation_id='r-kmwlghe3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1522456563',owner_user_name='tempest-AttachVolumeNegativeTest-1522456563-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T23:23:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4a05b178abe74b779a991e887bf135b2',uuid=7ee70847-10de-49b6-9731-6d65b06532c8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d6445a4b-3c64-4aa0-b7c7-a5756db64532", "address": "fa:16:3e:9f:ee:36", "network": {"id": "2f33d93d-98ec-4b87-a0c0-efe2d2ac8f6d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-719527911-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7eff4be777d24514be52868961bf7a25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6445a4b-3c", "ovs_interfaceid": "d6445a4b-3c64-4aa0-b7c7-a5756db64532", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75045) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 23:23:49 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-cf67e48d-6a96-4329-a5f5-8a73e9cc0463 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Converting VIF {"id": "d6445a4b-3c64-4aa0-b7c7-a5756db64532", "address": "fa:16:3e:9f:ee:36", "network": {"id": "2f33d93d-98ec-4b87-a0c0-efe2d2ac8f6d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-719527911-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7eff4be777d24514be52868961bf7a25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6445a4b-3c", "ovs_interfaceid": "d6445a4b-3c64-4aa0-b7c7-a5756db64532", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 23:23:49 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-cf67e48d-6a96-4329-a5f5-8a73e9cc0463 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9f:ee:36,bridge_name='br-int',has_traffic_filtering=True,id=d6445a4b-3c64-4aa0-b7c7-a5756db64532,network=Network(2f33d93d-98ec-4b87-a0c0-efe2d2ac8f6d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd6445a4b-3c') {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 23:23:49 user nova-compute[75045]: DEBUG nova.objects.instance [None req-cf67e48d-6a96-4329-a5f5-8a73e9cc0463 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Lazy-loading 'pci_devices' on Instance uuid 7ee70847-10de-49b6-9731-6d65b06532c8 {{(pid=75045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 23:23:49 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-cf67e48d-6a96-4329-a5f5-8a73e9cc0463 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] [instance: 7ee70847-10de-49b6-9731-6d65b06532c8] End _get_guest_xml xml=<domain type="kvm">
Nov 08 23:23:49 user nova-compute[75045]:   <uuid>7ee70847-10de-49b6-9731-6d65b06532c8</uuid>
Nov 08 23:23:49 user nova-compute[75045]:   <name>instance-00000015</name>
Nov 08 23:23:49 user nova-compute[75045]:   <memory>524288</memory>
Nov 08 23:23:49 user nova-compute[75045]:   <vcpu>1</vcpu>
Nov 08 23:23:49 user nova-compute[75045]:   <metadata>
Nov 08 23:23:49 user nova-compute[75045]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 23:23:49 user nova-compute[75045]:       <nova:package version="0.0.0"/>
Nov 08 23:23:49 user nova-compute[75045]:       <nova:name>tempest-AttachVolumeNegativeTest-server-205119403</nova:name>
Nov 08 23:23:49 user nova-compute[75045]:       <nova:creationTime>2023-11-08 23:23:49</nova:creationTime>
Nov 08 23:23:49 user nova-compute[75045]:       <nova:flavor name="m1.tiny">
Nov 08 23:23:49 user nova-compute[75045]:         <nova:memory>512</nova:memory>
Nov 08 23:23:49 user nova-compute[75045]:         <nova:disk>1</nova:disk>
Nov 08 23:23:49 user nova-compute[75045]:         <nova:swap>0</nova:swap>
Nov 08 23:23:49 user nova-compute[75045]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 23:23:49 user nova-compute[75045]:         <nova:vcpus>1</nova:vcpus>
Nov 08 23:23:49 user nova-compute[75045]:       </nova:flavor>
Nov 08 23:23:49 user nova-compute[75045]:       <nova:owner>
Nov 08 23:23:49 user nova-compute[75045]:         <nova:user uuid="4a05b178abe74b779a991e887bf135b2">tempest-AttachVolumeNegativeTest-1522456563-project-member</nova:user>
Nov 08 23:23:49 user nova-compute[75045]:         <nova:project uuid="7eff4be777d24514be52868961bf7a25">tempest-AttachVolumeNegativeTest-1522456563</nova:project>
Nov 08 23:23:49 user nova-compute[75045]:       </nova:owner>
Nov 08 23:23:49 user nova-compute[75045]:       <nova:root type="image" uuid="a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb"/>
Nov 08 23:23:49 user nova-compute[75045]:       <nova:ports>
Nov 08 23:23:49 user nova-compute[75045]:         <nova:port uuid="d6445a4b-3c64-4aa0-b7c7-a5756db64532">
Nov 08 23:23:49 user nova-compute[75045]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 08 23:23:49 user nova-compute[75045]:         </nova:port>
Nov 08 23:23:49 user nova-compute[75045]:       </nova:ports>
Nov 08 23:23:49 user nova-compute[75045]:     </nova:instance>
Nov 08 23:23:49 user nova-compute[75045]:   </metadata>
Nov 08 23:23:49 user nova-compute[75045]:   <sysinfo type="smbios">
Nov 08 23:23:49 user nova-compute[75045]:     <system>
Nov 08 23:23:49 user nova-compute[75045]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 23:23:49 user nova-compute[75045]:       <entry name="product">OpenStack Nova</entry>
Nov 08 23:23:49 user nova-compute[75045]:       <entry name="version">0.0.0</entry>
Nov 08 23:23:49 user nova-compute[75045]:       <entry name="serial">7ee70847-10de-49b6-9731-6d65b06532c8</entry>
Nov 08 23:23:49 user nova-compute[75045]:       <entry name="uuid">7ee70847-10de-49b6-9731-6d65b06532c8</entry>
Nov 08 23:23:49 user nova-compute[75045]:       <entry name="family">Virtual Machine</entry>
Nov 08 23:23:49 user nova-compute[75045]:     </system>
Nov 08 23:23:49 user nova-compute[75045]:   </sysinfo>
Nov 08 23:23:49 user nova-compute[75045]:   <os>
Nov 08 23:23:49 user nova-compute[75045]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 23:23:49 user nova-compute[75045]:     <boot dev="hd"/>
Nov 08 23:23:49 user nova-compute[75045]:     <smbios mode="sysinfo"/>
Nov 08 23:23:49 user nova-compute[75045]:   </os>
Nov 08 23:23:49 user nova-compute[75045]:   <features>
Nov 08 23:23:49 user nova-compute[75045]:     <acpi/>
Nov 08 23:23:49 user nova-compute[75045]:     <apic/>
Nov 08 23:23:49 user nova-compute[75045]:     <vmcoreinfo/>
Nov 08 23:23:49 user nova-compute[75045]:   </features>
Nov 08 23:23:49 user nova-compute[75045]:   <clock offset="utc">
Nov 08 23:23:49 user nova-compute[75045]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 23:23:49 user nova-compute[75045]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 23:23:49 user nova-compute[75045]:     <timer name="hpet" present="no"/>
Nov 08 23:23:49 user nova-compute[75045]:   </clock>
Nov 08 23:23:49 user nova-compute[75045]:   <cpu mode="custom" match="exact">
Nov 08 23:23:49 user nova-compute[75045]:     <model>Nehalem</model>
Nov 08 23:23:49 user nova-compute[75045]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 23:23:49 user nova-compute[75045]:   </cpu>
Nov 08 23:23:49 user nova-compute[75045]:   <devices>
Nov 08 23:23:49 user nova-compute[75045]:     <disk type="file" device="disk">
Nov 08 23:23:49 user nova-compute[75045]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 23:23:49 user nova-compute[75045]:       <source file="/opt/stack/data/nova/instances/7ee70847-10de-49b6-9731-6d65b06532c8/disk"/>
Nov 08 23:23:49 user nova-compute[75045]:       <target dev="vda" bus="virtio"/>
Nov 08 23:23:49 user nova-compute[75045]:     </disk>
Nov 08 23:23:49 user nova-compute[75045]:     <interface type="ethernet">
Nov 08 23:23:49 user nova-compute[75045]:       <mac address="fa:16:3e:9f:ee:36"/>
Nov 08 23:23:49 user nova-compute[75045]:       <model type="virtio"/>
Nov 08 23:23:49 user nova-compute[75045]:       <mtu size="1442"/>
Nov 08 23:23:49 user nova-compute[75045]:       <target dev="tapd6445a4b-3c"/>
Nov 08 23:23:49 user nova-compute[75045]:     </interface>
Nov 08 23:23:49 user nova-compute[75045]:     <serial type="pty">
Nov 08 23:23:49 user nova-compute[75045]:       <log file="/opt/stack/data/nova/instances/7ee70847-10de-49b6-9731-6d65b06532c8/console.log" append="off"/>
Nov 08 23:23:49 user nova-compute[75045]:     </serial>
Nov 08 23:23:49 user nova-compute[75045]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 23:23:49 user nova-compute[75045]:     <video>
Nov 08 23:23:49 user nova-compute[75045]:       <model type="virtio"/>
Nov 08 23:23:49 user nova-compute[75045]:     </video>
Nov 08 23:23:49 user nova-compute[75045]:     <rng model="virtio">
Nov 08 23:23:49 user nova-compute[75045]:       <backend model="random">/dev/urandom</backend>
Nov 08 23:23:49 user nova-compute[75045]:     </rng>
Nov 08 23:23:49 user nova-compute[75045]:     <controller type="usb" index="0" model="none"/>
Nov 08 23:23:49 user nova-compute[75045]:     <memballoon model="virtio">
Nov 08 23:23:49 user nova-compute[75045]:       <stats period="10"/>
Nov 08 23:23:49 user nova-compute[75045]:     </memballoon>
Nov 08 23:23:49 user nova-compute[75045]:   </devices>
Nov 08 23:23:49 user nova-compute[75045]: </domain>
Nov 08 23:23:49 user nova-compute[75045]:  {{(pid=75045) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 23:23:49 user nova-compute[75045]: DEBUG nova.virt.libvirt.vif [None req-cf67e48d-6a96-4329-a5f5-8a73e9cc0463 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T23:23:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-205119403',display_name='tempest-AttachVolumeNegativeTest-server-205119403',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-205119403',id=21,image_ref='a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF/AcMHCN1yLsphPUOJymoB8arG9AmwYlVpV2pXrg/5qqM85Y12212xIUjFveTFgUBwxO2xmPilEz4sPYEiW3rB8q4VeflZETWT76OVfLPHA9Ve/wohAW0gjaQZUpMDPuw==',key_name='tempest-keypair-1571543808',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7eff4be777d24514be52868961bf7a25',ramdisk_id='',reservation_id='r-kmwlghe3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1522456563',owner_user_name='tempest-AttachVolumeNegativeTest-1522456563-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T23:23:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4a05b178abe74b779a991e887bf135b2',uuid=7ee70847-10de-49b6-9731-6d65b06532c8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d6445a4b-3c64-4aa0-b7c7-a5756db64532", "address": "fa:16:3e:9f:ee:36", "network": {"id": "2f33d93d-98ec-4b87-a0c0-efe2d2ac8f6d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-719527911-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7eff4be777d24514be52868961bf7a25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6445a4b-3c", "ovs_interfaceid": "d6445a4b-3c64-4aa0-b7c7-a5756db64532", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75045) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 23:23:49 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-cf67e48d-6a96-4329-a5f5-8a73e9cc0463 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Converting VIF {"id": "d6445a4b-3c64-4aa0-b7c7-a5756db64532", "address": "fa:16:3e:9f:ee:36", "network": {"id": "2f33d93d-98ec-4b87-a0c0-efe2d2ac8f6d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-719527911-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7eff4be777d24514be52868961bf7a25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6445a4b-3c", "ovs_interfaceid": "d6445a4b-3c64-4aa0-b7c7-a5756db64532", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 23:23:49 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-cf67e48d-6a96-4329-a5f5-8a73e9cc0463 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9f:ee:36,bridge_name='br-int',has_traffic_filtering=True,id=d6445a4b-3c64-4aa0-b7c7-a5756db64532,network=Network(2f33d93d-98ec-4b87-a0c0-efe2d2ac8f6d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd6445a4b-3c') {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 23:23:49 user nova-compute[75045]: DEBUG os_vif [None req-cf67e48d-6a96-4329-a5f5-8a73e9cc0463 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9f:ee:36,bridge_name='br-int',has_traffic_filtering=True,id=d6445a4b-3c64-4aa0-b7c7-a5756db64532,network=Network(2f33d93d-98ec-4b87-a0c0-efe2d2ac8f6d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd6445a4b-3c') {{(pid=75045) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 23:23:49 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:23:49 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:23:49 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 23:23:49 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:23:49 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd4b9f3c1-6378-5438-a031-40429413b3b4', '_type': 'linux-noop'}}, row=False) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:23:49 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:23:49 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:23:49 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:23:49 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd6445a4b-3c, may_exist=True, interface_attrs={}) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:23:49 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd6445a4b-3c, col_values=(('qos', UUID('1a9696d2-eada-4909-bb52-ad0367217cd6')),), if_exists=True) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:23:49 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd6445a4b-3c, col_values=(('external_ids', {'iface-id': 'd6445a4b-3c64-4aa0-b7c7-a5756db64532', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9f:ee:36', 'vm-uuid': '7ee70847-10de-49b6-9731-6d65b06532c8'}),), if_exists=True) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:23:49 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:23:49 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 23:23:49 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:23:49 user nova-compute[75045]: INFO os_vif [None req-cf67e48d-6a96-4329-a5f5-8a73e9cc0463 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9f:ee:36,bridge_name='br-int',has_traffic_filtering=True,id=d6445a4b-3c64-4aa0-b7c7-a5756db64532,network=Network(2f33d93d-98ec-4b87-a0c0-efe2d2ac8f6d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd6445a4b-3c')
Nov 08 23:23:49 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-cf67e48d-6a96-4329-a5f5-8a73e9cc0463 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] No BDM found with device name vda, not building metadata. {{(pid=75045) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 23:23:49 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-cf67e48d-6a96-4329-a5f5-8a73e9cc0463 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] No VIF found with MAC fa:16:3e:9f:ee:36, not building metadata {{(pid=75045) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 23:23:49 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Instance 4ae5ff6b-6f2c-4dfd-a4c6-da4809e2cf27 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75045) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 23:23:49 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Instance 0f21fcd3-ac5f-499e-9c34-82af806fda1d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75045) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 23:23:49 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Instance d2c911cf-d5f4-4c19-8335-8c7834184a7e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75045) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 23:23:49 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Instance 032e20aa-8887-4215-808e-68299a0d8d0b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75045) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 23:23:49 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Instance 43f31110-89ec-4b20-9842-7c9dd7df0e14 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75045) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 23:23:49 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Instance 83d225e0-e39e-4500-b7ae-52dfbd8b8588 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75045) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 23:23:49 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Instance 25cd59d1-6884-471a-813e-52e97c2e1208 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75045) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 23:23:49 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Instance b5fc7f02-2143-4bcf-92ac-078d5ec10747 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75045) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 23:23:49 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Instance 0b84f2b1-01a3-4789-bcef-8b7c4334132b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75045) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 23:23:49 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Instance 7ee70847-10de-49b6-9731-6d65b06532c8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75045) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 23:23:49 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=75045) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 23:23:49 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=75045) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 23:23:49 user nova-compute[75045]: DEBUG nova.network.neutron [req-06c15a86-431f-4e77-b577-aa6d03942cc3 req-077e025a-a3e4-42b1-9600-6f8f41b0e499 service nova] [instance: 7ee70847-10de-49b6-9731-6d65b06532c8] Updated VIF entry in instance network info cache for port d6445a4b-3c64-4aa0-b7c7-a5756db64532. {{(pid=75045) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 23:23:49 user nova-compute[75045]: DEBUG nova.network.neutron [req-06c15a86-431f-4e77-b577-aa6d03942cc3 req-077e025a-a3e4-42b1-9600-6f8f41b0e499 service nova] [instance: 7ee70847-10de-49b6-9731-6d65b06532c8] Updating instance_info_cache with network_info: [{"id": "d6445a4b-3c64-4aa0-b7c7-a5756db64532", "address": "fa:16:3e:9f:ee:36", "network": {"id": "2f33d93d-98ec-4b87-a0c0-efe2d2ac8f6d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-719527911-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7eff4be777d24514be52868961bf7a25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6445a4b-3c", "ovs_interfaceid": "d6445a4b-3c64-4aa0-b7c7-a5756db64532", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75045) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 23:23:49 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-06c15a86-431f-4e77-b577-aa6d03942cc3 req-077e025a-a3e4-42b1-9600-6f8f41b0e499 service nova] Releasing lock "refresh_cache-7ee70847-10de-49b6-9731-6d65b06532c8" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 23:23:49 user nova-compute[75045]: DEBUG nova.compute.provider_tree [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Inventory has not changed in ProviderTree for provider: 62ba5f85-c74d-4b58-986e-d4197e813fd7 {{(pid=75045) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 23:23:49 user nova-compute[75045]: DEBUG nova.scheduler.client.report [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Inventory has not changed for provider 62ba5f85-c74d-4b58-986e-d4197e813fd7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75045) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 23:23:49 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Compute_service record updated for user:user {{(pid=75045) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 23:23:49 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.569s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:23:50 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:23:50 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:23:50 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:23:50 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:23:50 user nova-compute[75045]: DEBUG nova.compute.manager [req-b31134a1-0cbc-44df-a154-5232e9d9dde1 req-d7458e42-dde6-4a1a-9be3-06118a57ca86 service nova] [instance: 7ee70847-10de-49b6-9731-6d65b06532c8] Received event network-vif-plugged-d6445a4b-3c64-4aa0-b7c7-a5756db64532 {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:23:50 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-b31134a1-0cbc-44df-a154-5232e9d9dde1 req-d7458e42-dde6-4a1a-9be3-06118a57ca86 service nova] Acquiring lock "7ee70847-10de-49b6-9731-6d65b06532c8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:23:50 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-b31134a1-0cbc-44df-a154-5232e9d9dde1 req-d7458e42-dde6-4a1a-9be3-06118a57ca86 service nova] Lock "7ee70847-10de-49b6-9731-6d65b06532c8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:23:50 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-b31134a1-0cbc-44df-a154-5232e9d9dde1 req-d7458e42-dde6-4a1a-9be3-06118a57ca86 service nova] Lock "7ee70847-10de-49b6-9731-6d65b06532c8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:23:50 user nova-compute[75045]: DEBUG nova.compute.manager [req-b31134a1-0cbc-44df-a154-5232e9d9dde1 req-d7458e42-dde6-4a1a-9be3-06118a57ca86 service nova] [instance: 7ee70847-10de-49b6-9731-6d65b06532c8] No waiting events found dispatching network-vif-plugged-d6445a4b-3c64-4aa0-b7c7-a5756db64532 {{(pid=75045) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 23:23:50 user nova-compute[75045]: WARNING nova.compute.manager [req-b31134a1-0cbc-44df-a154-5232e9d9dde1 req-d7458e42-dde6-4a1a-9be3-06118a57ca86 service nova] [instance: 7ee70847-10de-49b6-9731-6d65b06532c8] Received unexpected event network-vif-plugged-d6445a4b-3c64-4aa0-b7c7-a5756db64532 for instance with vm_state building and task_state spawning.
Nov 08 23:23:50 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:23:50 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:23:50 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:23:52 user nova-compute[75045]: DEBUG nova.compute.manager [req-d8227bbe-f597-4776-ab8c-fa7a871aca87 req-650b4f0f-7afb-4f7f-a491-477df5f14aa9 service nova] [instance: 7ee70847-10de-49b6-9731-6d65b06532c8] Received event network-vif-plugged-d6445a4b-3c64-4aa0-b7c7-a5756db64532 {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:23:52 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-d8227bbe-f597-4776-ab8c-fa7a871aca87 req-650b4f0f-7afb-4f7f-a491-477df5f14aa9 service nova] Acquiring lock "7ee70847-10de-49b6-9731-6d65b06532c8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:23:52 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-d8227bbe-f597-4776-ab8c-fa7a871aca87 req-650b4f0f-7afb-4f7f-a491-477df5f14aa9 service nova] Lock "7ee70847-10de-49b6-9731-6d65b06532c8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:23:52 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-d8227bbe-f597-4776-ab8c-fa7a871aca87 req-650b4f0f-7afb-4f7f-a491-477df5f14aa9 service nova] Lock "7ee70847-10de-49b6-9731-6d65b06532c8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:23:52 user nova-compute[75045]: DEBUG nova.compute.manager [req-d8227bbe-f597-4776-ab8c-fa7a871aca87 req-650b4f0f-7afb-4f7f-a491-477df5f14aa9 service nova] [instance: 7ee70847-10de-49b6-9731-6d65b06532c8] No waiting events found dispatching network-vif-plugged-d6445a4b-3c64-4aa0-b7c7-a5756db64532 {{(pid=75045) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 23:23:52 user nova-compute[75045]: WARNING nova.compute.manager [req-d8227bbe-f597-4776-ab8c-fa7a871aca87 req-650b4f0f-7afb-4f7f-a491-477df5f14aa9 service nova] [instance: 7ee70847-10de-49b6-9731-6d65b06532c8] Received unexpected event network-vif-plugged-d6445a4b-3c64-4aa0-b7c7-a5756db64532 for instance with vm_state building and task_state spawning.
Nov 08 23:23:53 user nova-compute[75045]: DEBUG nova.compute.manager [None req-cf67e48d-6a96-4329-a5f5-8a73e9cc0463 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] [instance: 7ee70847-10de-49b6-9731-6d65b06532c8] Instance event wait completed in 0 seconds for  {{(pid=75045) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 23:23:53 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-cf67e48d-6a96-4329-a5f5-8a73e9cc0463 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] [instance: 7ee70847-10de-49b6-9731-6d65b06532c8] Guest created on hypervisor {{(pid=75045) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 23:23:53 user nova-compute[75045]: INFO nova.virt.libvirt.driver [-] [instance: 7ee70847-10de-49b6-9731-6d65b06532c8] Instance spawned successfully.
Nov 08 23:23:53 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-cf67e48d-6a96-4329-a5f5-8a73e9cc0463 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] [instance: 7ee70847-10de-49b6-9731-6d65b06532c8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75045) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 23:23:53 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-cf67e48d-6a96-4329-a5f5-8a73e9cc0463 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] [instance: 7ee70847-10de-49b6-9731-6d65b06532c8] Found default for hw_cdrom_bus of ide {{(pid=75045) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 23:23:53 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-cf67e48d-6a96-4329-a5f5-8a73e9cc0463 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] [instance: 7ee70847-10de-49b6-9731-6d65b06532c8] Found default for hw_disk_bus of virtio {{(pid=75045) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 23:23:53 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-cf67e48d-6a96-4329-a5f5-8a73e9cc0463 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] [instance: 7ee70847-10de-49b6-9731-6d65b06532c8] Found default for hw_input_bus of None {{(pid=75045) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 23:23:53 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-cf67e48d-6a96-4329-a5f5-8a73e9cc0463 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] [instance: 7ee70847-10de-49b6-9731-6d65b06532c8] Found default for hw_pointer_model of None {{(pid=75045) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 23:23:53 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-cf67e48d-6a96-4329-a5f5-8a73e9cc0463 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] [instance: 7ee70847-10de-49b6-9731-6d65b06532c8] Found default for hw_video_model of virtio {{(pid=75045) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 23:23:53 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-cf67e48d-6a96-4329-a5f5-8a73e9cc0463 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] [instance: 7ee70847-10de-49b6-9731-6d65b06532c8] Found default for hw_vif_model of virtio {{(pid=75045) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 23:23:53 user nova-compute[75045]: INFO nova.compute.manager [None req-cf67e48d-6a96-4329-a5f5-8a73e9cc0463 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] [instance: 7ee70847-10de-49b6-9731-6d65b06532c8] Took 6.00 seconds to spawn the instance on the hypervisor.
Nov 08 23:23:53 user nova-compute[75045]: DEBUG nova.compute.manager [None req-cf67e48d-6a96-4329-a5f5-8a73e9cc0463 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] [instance: 7ee70847-10de-49b6-9731-6d65b06532c8] Checking state {{(pid=75045) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 23:23:53 user nova-compute[75045]: INFO nova.compute.manager [None req-cf67e48d-6a96-4329-a5f5-8a73e9cc0463 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] [instance: 7ee70847-10de-49b6-9731-6d65b06532c8] Took 7.05 seconds to build instance.
Nov 08 23:23:53 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-cf67e48d-6a96-4329-a5f5-8a73e9cc0463 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Lock "7ee70847-10de-49b6-9731-6d65b06532c8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.168s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:23:53 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:23:54 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:23:55 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:23:57 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:23:58 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-7b48f1e9-661b-4ec3-8c5a-1467cd11279c tempest-ServerActionsV293TestJSON-1645081958 tempest-ServerActionsV293TestJSON-1645081958-project-member] Acquiring lock "667d20c3-3eda-4aa5-b799-6dcee3443833" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:23:58 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-7b48f1e9-661b-4ec3-8c5a-1467cd11279c tempest-ServerActionsV293TestJSON-1645081958 tempest-ServerActionsV293TestJSON-1645081958-project-member] Lock "667d20c3-3eda-4aa5-b799-6dcee3443833" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:23:58 user nova-compute[75045]: DEBUG nova.compute.manager [None req-7b48f1e9-661b-4ec3-8c5a-1467cd11279c tempest-ServerActionsV293TestJSON-1645081958 tempest-ServerActionsV293TestJSON-1645081958-project-member] [instance: 667d20c3-3eda-4aa5-b799-6dcee3443833] Starting instance... {{(pid=75045) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 23:23:58 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-7b48f1e9-661b-4ec3-8c5a-1467cd11279c tempest-ServerActionsV293TestJSON-1645081958 tempest-ServerActionsV293TestJSON-1645081958-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:23:58 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-7b48f1e9-661b-4ec3-8c5a-1467cd11279c tempest-ServerActionsV293TestJSON-1645081958 tempest-ServerActionsV293TestJSON-1645081958-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:23:58 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-7b48f1e9-661b-4ec3-8c5a-1467cd11279c tempest-ServerActionsV293TestJSON-1645081958 tempest-ServerActionsV293TestJSON-1645081958-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75045) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 23:23:58 user nova-compute[75045]: INFO nova.compute.claims [None req-7b48f1e9-661b-4ec3-8c5a-1467cd11279c tempest-ServerActionsV293TestJSON-1645081958 tempest-ServerActionsV293TestJSON-1645081958-project-member] [instance: 667d20c3-3eda-4aa5-b799-6dcee3443833] Claim successful on node user
Nov 08 23:23:58 user nova-compute[75045]: DEBUG nova.compute.provider_tree [None req-7b48f1e9-661b-4ec3-8c5a-1467cd11279c tempest-ServerActionsV293TestJSON-1645081958 tempest-ServerActionsV293TestJSON-1645081958-project-member] Inventory has not changed in ProviderTree for provider: 62ba5f85-c74d-4b58-986e-d4197e813fd7 {{(pid=75045) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 23:23:58 user nova-compute[75045]: DEBUG nova.scheduler.client.report [None req-7b48f1e9-661b-4ec3-8c5a-1467cd11279c tempest-ServerActionsV293TestJSON-1645081958 tempest-ServerActionsV293TestJSON-1645081958-project-member] Inventory has not changed for provider 62ba5f85-c74d-4b58-986e-d4197e813fd7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75045) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 23:23:59 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-7b48f1e9-661b-4ec3-8c5a-1467cd11279c tempest-ServerActionsV293TestJSON-1645081958 tempest-ServerActionsV293TestJSON-1645081958-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.576s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:23:59 user nova-compute[75045]: DEBUG nova.compute.manager [None req-7b48f1e9-661b-4ec3-8c5a-1467cd11279c tempest-ServerActionsV293TestJSON-1645081958 tempest-ServerActionsV293TestJSON-1645081958-project-member] [instance: 667d20c3-3eda-4aa5-b799-6dcee3443833] Start building networks asynchronously for instance. {{(pid=75045) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 23:23:59 user nova-compute[75045]: DEBUG nova.compute.manager [None req-7b48f1e9-661b-4ec3-8c5a-1467cd11279c tempest-ServerActionsV293TestJSON-1645081958 tempest-ServerActionsV293TestJSON-1645081958-project-member] [instance: 667d20c3-3eda-4aa5-b799-6dcee3443833] Allocating IP information in the background. {{(pid=75045) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 23:23:59 user nova-compute[75045]: DEBUG nova.network.neutron [None req-7b48f1e9-661b-4ec3-8c5a-1467cd11279c tempest-ServerActionsV293TestJSON-1645081958 tempest-ServerActionsV293TestJSON-1645081958-project-member] [instance: 667d20c3-3eda-4aa5-b799-6dcee3443833] allocate_for_instance() {{(pid=75045) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 23:23:59 user nova-compute[75045]: INFO nova.virt.libvirt.driver [None req-7b48f1e9-661b-4ec3-8c5a-1467cd11279c tempest-ServerActionsV293TestJSON-1645081958 tempest-ServerActionsV293TestJSON-1645081958-project-member] [instance: 667d20c3-3eda-4aa5-b799-6dcee3443833] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 23:23:59 user nova-compute[75045]: DEBUG nova.compute.manager [None req-7b48f1e9-661b-4ec3-8c5a-1467cd11279c tempest-ServerActionsV293TestJSON-1645081958 tempest-ServerActionsV293TestJSON-1645081958-project-member] [instance: 667d20c3-3eda-4aa5-b799-6dcee3443833] Start building block device mappings for instance. {{(pid=75045) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 23:23:59 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:23:59 user nova-compute[75045]: INFO nova.virt.block_device [None req-7b48f1e9-661b-4ec3-8c5a-1467cd11279c tempest-ServerActionsV293TestJSON-1645081958 tempest-ServerActionsV293TestJSON-1645081958-project-member] [instance: 667d20c3-3eda-4aa5-b799-6dcee3443833] Booting with volume 04d02c98-d058-49d8-a350-ab9e63003d6e at /dev/vda
Nov 08 23:23:59 user nova-compute[75045]: DEBUG nova.policy [None req-7b48f1e9-661b-4ec3-8c5a-1467cd11279c tempest-ServerActionsV293TestJSON-1645081958 tempest-ServerActionsV293TestJSON-1645081958-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'fc0a769ab72a476c9ac620728d67c5b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89744dd7de584b14880bc42dd96933af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75045) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 23:23:59 user nova-compute[75045]: DEBUG os_brick.utils [None req-7b48f1e9-661b-4ec3-8c5a-1467cd11279c tempest-ServerActionsV293TestJSON-1645081958 tempest-ServerActionsV293TestJSON-1645081958-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75045) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 23:23:59 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:23:59 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:23:59 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa97205a-56b1-4b9a-9c3f-62a08218310c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6217bd6e884\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:23:59 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:23:59 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:23:59 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[8779ff1b-45f2-46b5-902e-5fb3cec0e1e5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:23:59 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:23:59 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:23:59 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b47fa5f-25fc-4517-a20a-ce0b41c36c0a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:23:59 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c030e21-bd01-498e-b71b-5d0dbb8159f1]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:23:59 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-7b48f1e9-661b-4ec3-8c5a-1467cd11279c tempest-ServerActionsV293TestJSON-1645081958 tempest-ServerActionsV293TestJSON-1645081958-project-member] Running cmd (subprocess): nvme version {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:23:59 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-7b48f1e9-661b-4ec3-8c5a-1467cd11279c tempest-ServerActionsV293TestJSON-1645081958 tempest-ServerActionsV293TestJSON-1645081958-project-member] 'nvme version' failed. Not Retrying. {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 23:23:59 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7b48f1e9-661b-4ec3-8c5a-1467cd11279c tempest-ServerActionsV293TestJSON-1645081958 tempest-ServerActionsV293TestJSON-1645081958-project-member] nvme not present on system {{(pid=75045) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 23:23:59 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:23:59 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 23:23:59 user nova-compute[75045]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 23:23:59 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fbe24fe-cafc-48e7-b428-0888438b7e97]: (4, '') {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:23:59 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.lightos [None req-7b48f1e9-661b-4ec3-8c5a-1467cd11279c tempest-ServerActionsV293TestJSON-1645081958 tempest-ServerActionsV293TestJSON-1645081958-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75045) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 23:23:59 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.lightos [None req-7b48f1e9-661b-4ec3-8c5a-1467cd11279c tempest-ServerActionsV293TestJSON-1645081958 tempest-ServerActionsV293TestJSON-1645081958-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75045) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 23:23:59 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.lightos [None req-7b48f1e9-661b-4ec3-8c5a-1467cd11279c tempest-ServerActionsV293TestJSON-1645081958 tempest-ServerActionsV293TestJSON-1645081958-project-member] LIGHTOS: no hostnqn found. {{(pid=75045) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 23:23:59 user nova-compute[75045]: DEBUG os_brick.utils [None req-7b48f1e9-661b-4ec3-8c5a-1467cd11279c tempest-ServerActionsV293TestJSON-1645081958 tempest-ServerActionsV293TestJSON-1645081958-project-member] <== get_connector_properties: return (155ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6217bd6e884', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75045) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 23:23:59 user nova-compute[75045]: DEBUG nova.virt.block_device [None req-7b48f1e9-661b-4ec3-8c5a-1467cd11279c tempest-ServerActionsV293TestJSON-1645081958 tempest-ServerActionsV293TestJSON-1645081958-project-member] [instance: 667d20c3-3eda-4aa5-b799-6dcee3443833] Updating existing volume attachment record: 8c6e537a-21a7-4484-a895-a1cebbef8128 {{(pid=75045) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 23:24:00 user nova-compute[75045]: DEBUG nova.network.neutron [None req-7b48f1e9-661b-4ec3-8c5a-1467cd11279c tempest-ServerActionsV293TestJSON-1645081958 tempest-ServerActionsV293TestJSON-1645081958-project-member] [instance: 667d20c3-3eda-4aa5-b799-6dcee3443833] Successfully created port: 0d5e497c-3168-46b1-9094-9bb54737cc0f {{(pid=75045) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 23:24:00 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:24:01 user nova-compute[75045]: DEBUG nova.network.neutron [None req-7b48f1e9-661b-4ec3-8c5a-1467cd11279c tempest-ServerActionsV293TestJSON-1645081958 tempest-ServerActionsV293TestJSON-1645081958-project-member] [instance: 667d20c3-3eda-4aa5-b799-6dcee3443833] Successfully updated port: 0d5e497c-3168-46b1-9094-9bb54737cc0f {{(pid=75045) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 23:24:01 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-7b48f1e9-661b-4ec3-8c5a-1467cd11279c tempest-ServerActionsV293TestJSON-1645081958 tempest-ServerActionsV293TestJSON-1645081958-project-member] Acquiring lock "refresh_cache-667d20c3-3eda-4aa5-b799-6dcee3443833" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 23:24:01 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-7b48f1e9-661b-4ec3-8c5a-1467cd11279c tempest-ServerActionsV293TestJSON-1645081958 tempest-ServerActionsV293TestJSON-1645081958-project-member] Acquired lock "refresh_cache-667d20c3-3eda-4aa5-b799-6dcee3443833" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 23:24:01 user nova-compute[75045]: DEBUG nova.network.neutron [None req-7b48f1e9-661b-4ec3-8c5a-1467cd11279c tempest-ServerActionsV293TestJSON-1645081958 tempest-ServerActionsV293TestJSON-1645081958-project-member] [instance: 667d20c3-3eda-4aa5-b799-6dcee3443833] Building network info cache for instance {{(pid=75045) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 23:24:01 user nova-compute[75045]: DEBUG nova.compute.manager [req-e4d460fa-0988-4c2b-bbf6-585e8866b70f req-fe125db6-57b8-4eee-a9a9-4494655fae88 service nova] [instance: 667d20c3-3eda-4aa5-b799-6dcee3443833] Received event network-changed-0d5e497c-3168-46b1-9094-9bb54737cc0f {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:24:01 user nova-compute[75045]: DEBUG nova.compute.manager [req-e4d460fa-0988-4c2b-bbf6-585e8866b70f req-fe125db6-57b8-4eee-a9a9-4494655fae88 service nova] [instance: 667d20c3-3eda-4aa5-b799-6dcee3443833] Refreshing instance network info cache due to event network-changed-0d5e497c-3168-46b1-9094-9bb54737cc0f. {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 23:24:01 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-e4d460fa-0988-4c2b-bbf6-585e8866b70f req-fe125db6-57b8-4eee-a9a9-4494655fae88 service nova] Acquiring lock "refresh_cache-667d20c3-3eda-4aa5-b799-6dcee3443833" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 23:24:01 user nova-compute[75045]: DEBUG nova.network.neutron [None req-7b48f1e9-661b-4ec3-8c5a-1467cd11279c tempest-ServerActionsV293TestJSON-1645081958 tempest-ServerActionsV293TestJSON-1645081958-project-member] [instance: 667d20c3-3eda-4aa5-b799-6dcee3443833] Instance cache missing network info. {{(pid=75045) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 23:24:01 user nova-compute[75045]: DEBUG nova.network.neutron [None req-7b48f1e9-661b-4ec3-8c5a-1467cd11279c tempest-ServerActionsV293TestJSON-1645081958 tempest-ServerActionsV293TestJSON-1645081958-project-member] [instance: 667d20c3-3eda-4aa5-b799-6dcee3443833] Updating instance_info_cache with network_info: [{"id": "0d5e497c-3168-46b1-9094-9bb54737cc0f", "address": "fa:16:3e:80:07:f1", "network": {"id": "22898442-b87a-4538-a8f5-fe275919f44a", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-665667609-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "89744dd7de584b14880bc42dd96933af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d5e497c-31", "ovs_interfaceid": "0d5e497c-3168-46b1-9094-9bb54737cc0f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75045) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 23:24:01 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-7b48f1e9-661b-4ec3-8c5a-1467cd11279c tempest-ServerActionsV293TestJSON-1645081958 tempest-ServerActionsV293TestJSON-1645081958-project-member] Releasing lock "refresh_cache-667d20c3-3eda-4aa5-b799-6dcee3443833" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 23:24:01 user nova-compute[75045]: DEBUG nova.compute.manager [None req-7b48f1e9-661b-4ec3-8c5a-1467cd11279c tempest-ServerActionsV293TestJSON-1645081958 tempest-ServerActionsV293TestJSON-1645081958-project-member] [instance: 667d20c3-3eda-4aa5-b799-6dcee3443833] Instance network_info: |[{"id": "0d5e497c-3168-46b1-9094-9bb54737cc0f", "address": "fa:16:3e:80:07:f1", "network": {"id": "22898442-b87a-4538-a8f5-fe275919f44a", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-665667609-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "89744dd7de584b14880bc42dd96933af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d5e497c-31", "ovs_interfaceid": "0d5e497c-3168-46b1-9094-9bb54737cc0f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75045) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 23:24:01 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-e4d460fa-0988-4c2b-bbf6-585e8866b70f req-fe125db6-57b8-4eee-a9a9-4494655fae88 service nova] Acquired lock "refresh_cache-667d20c3-3eda-4aa5-b799-6dcee3443833" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 23:24:01 user nova-compute[75045]: DEBUG nova.network.neutron [req-e4d460fa-0988-4c2b-bbf6-585e8866b70f req-fe125db6-57b8-4eee-a9a9-4494655fae88 service nova] [instance: 667d20c3-3eda-4aa5-b799-6dcee3443833] Refreshing network info cache for port 0d5e497c-3168-46b1-9094-9bb54737cc0f {{(pid=75045) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 23:24:02 user nova-compute[75045]: DEBUG nova.network.neutron [req-e4d460fa-0988-4c2b-bbf6-585e8866b70f req-fe125db6-57b8-4eee-a9a9-4494655fae88 service nova] [instance: 667d20c3-3eda-4aa5-b799-6dcee3443833] Updated VIF entry in instance network info cache for port 0d5e497c-3168-46b1-9094-9bb54737cc0f. {{(pid=75045) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 23:24:02 user nova-compute[75045]: DEBUG nova.network.neutron [req-e4d460fa-0988-4c2b-bbf6-585e8866b70f req-fe125db6-57b8-4eee-a9a9-4494655fae88 service nova] [instance: 667d20c3-3eda-4aa5-b799-6dcee3443833] Updating instance_info_cache with network_info: [{"id": "0d5e497c-3168-46b1-9094-9bb54737cc0f", "address": "fa:16:3e:80:07:f1", "network": {"id": "22898442-b87a-4538-a8f5-fe275919f44a", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-665667609-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "89744dd7de584b14880bc42dd96933af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d5e497c-31", "ovs_interfaceid": "0d5e497c-3168-46b1-9094-9bb54737cc0f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75045) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 23:24:02 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-e4d460fa-0988-4c2b-bbf6-585e8866b70f req-fe125db6-57b8-4eee-a9a9-4494655fae88 service nova] Releasing lock "refresh_cache-667d20c3-3eda-4aa5-b799-6dcee3443833" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 23:24:04 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:24:05 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:24:09 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:24:10 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:24:14 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:24:15 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:24:17 user nova-compute[75045]: DEBUG nova.compute.manager [req-23d6b5aa-467f-49f6-b256-002c57f1f34a req-3a6bf789-6395-48e4-a5f2-4ead43cdb1b2 service nova] [instance: 25cd59d1-6884-471a-813e-52e97c2e1208] Received event network-changed-43fa5cbb-d817-41af-8e03-3be477de48c8 {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:24:17 user nova-compute[75045]: DEBUG nova.compute.manager [req-23d6b5aa-467f-49f6-b256-002c57f1f34a req-3a6bf789-6395-48e4-a5f2-4ead43cdb1b2 service nova] [instance: 25cd59d1-6884-471a-813e-52e97c2e1208] Refreshing instance network info cache due to event network-changed-43fa5cbb-d817-41af-8e03-3be477de48c8. {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 23:24:17 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-23d6b5aa-467f-49f6-b256-002c57f1f34a req-3a6bf789-6395-48e4-a5f2-4ead43cdb1b2 service nova] Acquiring lock "refresh_cache-25cd59d1-6884-471a-813e-52e97c2e1208" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 23:24:17 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-23d6b5aa-467f-49f6-b256-002c57f1f34a req-3a6bf789-6395-48e4-a5f2-4ead43cdb1b2 service nova] Acquired lock "refresh_cache-25cd59d1-6884-471a-813e-52e97c2e1208" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 23:24:17 user nova-compute[75045]: DEBUG nova.network.neutron [req-23d6b5aa-467f-49f6-b256-002c57f1f34a req-3a6bf789-6395-48e4-a5f2-4ead43cdb1b2 service nova] [instance: 25cd59d1-6884-471a-813e-52e97c2e1208] Refreshing network info cache for port 43fa5cbb-d817-41af-8e03-3be477de48c8 {{(pid=75045) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 23:24:18 user nova-compute[75045]: DEBUG nova.network.neutron [req-23d6b5aa-467f-49f6-b256-002c57f1f34a req-3a6bf789-6395-48e4-a5f2-4ead43cdb1b2 service nova] [instance: 25cd59d1-6884-471a-813e-52e97c2e1208] Updated VIF entry in instance network info cache for port 43fa5cbb-d817-41af-8e03-3be477de48c8. {{(pid=75045) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 23:24:18 user nova-compute[75045]: DEBUG nova.network.neutron [req-23d6b5aa-467f-49f6-b256-002c57f1f34a req-3a6bf789-6395-48e4-a5f2-4ead43cdb1b2 service nova] [instance: 25cd59d1-6884-471a-813e-52e97c2e1208] Updating instance_info_cache with network_info: [{"id": "43fa5cbb-d817-41af-8e03-3be477de48c8", "address": "fa:16:3e:bd:cb:ae", "network": {"id": "b584f5a8-5791-4f2f-9846-8f4929b1f061", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1436131566-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.220", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ea775ad7c664da7ab23a480d913dda4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43fa5cbb-d8", "ovs_interfaceid": "43fa5cbb-d817-41af-8e03-3be477de48c8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75045) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 23:24:18 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-23d6b5aa-467f-49f6-b256-002c57f1f34a req-3a6bf789-6395-48e4-a5f2-4ead43cdb1b2 service nova] Releasing lock "refresh_cache-25cd59d1-6884-471a-813e-52e97c2e1208" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 23:24:18 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-8a730ee5-f350-4317-8d25-c458e9bcec16 tempest-TestServerVolumeAttachmentScenario-1899063447 tempest-TestServerVolumeAttachmentScenario-1899063447-project-member] Acquiring lock "25cd59d1-6884-471a-813e-52e97c2e1208" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:24:18 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-8a730ee5-f350-4317-8d25-c458e9bcec16 tempest-TestServerVolumeAttachmentScenario-1899063447 tempest-TestServerVolumeAttachmentScenario-1899063447-project-member] Lock "25cd59d1-6884-471a-813e-52e97c2e1208" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:24:18 user nova-compute[75045]: DEBUG nova.objects.instance [None req-8a730ee5-f350-4317-8d25-c458e9bcec16 tempest-TestServerVolumeAttachmentScenario-1899063447 tempest-TestServerVolumeAttachmentScenario-1899063447-project-member] Lazy-loading 'flavor' on Instance uuid 25cd59d1-6884-471a-813e-52e97c2e1208 {{(pid=75045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 23:24:18 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-8a730ee5-f350-4317-8d25-c458e9bcec16 tempest-TestServerVolumeAttachmentScenario-1899063447 tempest-TestServerVolumeAttachmentScenario-1899063447-project-member] Lock "25cd59d1-6884-471a-813e-52e97c2e1208" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.060s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:24:18 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-8a730ee5-f350-4317-8d25-c458e9bcec16 tempest-TestServerVolumeAttachmentScenario-1899063447 tempest-TestServerVolumeAttachmentScenario-1899063447-project-member] Acquiring lock "25cd59d1-6884-471a-813e-52e97c2e1208" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:24:18 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-8a730ee5-f350-4317-8d25-c458e9bcec16 tempest-TestServerVolumeAttachmentScenario-1899063447 tempest-TestServerVolumeAttachmentScenario-1899063447-project-member] Lock "25cd59d1-6884-471a-813e-52e97c2e1208" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:24:18 user nova-compute[75045]: INFO nova.compute.manager [None req-8a730ee5-f350-4317-8d25-c458e9bcec16 tempest-TestServerVolumeAttachmentScenario-1899063447 tempest-TestServerVolumeAttachmentScenario-1899063447-project-member] [instance: 25cd59d1-6884-471a-813e-52e97c2e1208] Attaching volume 9c37da13-9531-458a-87cb-1e86e6b84f3a to /dev/vdb
Nov 08 23:24:18 user nova-compute[75045]: DEBUG os_brick.utils [None req-8a730ee5-f350-4317-8d25-c458e9bcec16 tempest-TestServerVolumeAttachmentScenario-1899063447 tempest-TestServerVolumeAttachmentScenario-1899063447-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75045) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 23:24:18 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:24:18 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:24:18 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe45cf4f-80e5-46b9-916c-c32d485c1b9f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6217bd6e884\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:24:18 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:24:18 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:24:18 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dd65b01-ba11-4812-92fc-bbb5c539978e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:24:18 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:24:19 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:24:19 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0195c7f-d841-4313-89fa-23a62909b5d1]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:24:19 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cfb6e69-83a6-4f5e-b265-46678ec74094]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:24:19 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-8a730ee5-f350-4317-8d25-c458e9bcec16 tempest-TestServerVolumeAttachmentScenario-1899063447 tempest-TestServerVolumeAttachmentScenario-1899063447-project-member] Running cmd (subprocess): nvme version {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:24:19 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-8a730ee5-f350-4317-8d25-c458e9bcec16 tempest-TestServerVolumeAttachmentScenario-1899063447 tempest-TestServerVolumeAttachmentScenario-1899063447-project-member] 'nvme version' failed. Not Retrying. {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 23:24:19 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8a730ee5-f350-4317-8d25-c458e9bcec16 tempest-TestServerVolumeAttachmentScenario-1899063447 tempest-TestServerVolumeAttachmentScenario-1899063447-project-member] nvme not present on system {{(pid=75045) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 23:24:19 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:24:19 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 23:24:19 user nova-compute[75045]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 23:24:19 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4d09c37-ce83-49dd-94a0-f57d7194a03b]: (4, '') {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:24:19 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.lightos [None req-8a730ee5-f350-4317-8d25-c458e9bcec16 tempest-TestServerVolumeAttachmentScenario-1899063447 tempest-TestServerVolumeAttachmentScenario-1899063447-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75045) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 23:24:19 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.lightos [None req-8a730ee5-f350-4317-8d25-c458e9bcec16 tempest-TestServerVolumeAttachmentScenario-1899063447 tempest-TestServerVolumeAttachmentScenario-1899063447-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75045) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 23:24:19 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.lightos [None req-8a730ee5-f350-4317-8d25-c458e9bcec16 tempest-TestServerVolumeAttachmentScenario-1899063447 tempest-TestServerVolumeAttachmentScenario-1899063447-project-member] LIGHTOS: no hostnqn found. {{(pid=75045) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 23:24:19 user nova-compute[75045]: DEBUG os_brick.utils [None req-8a730ee5-f350-4317-8d25-c458e9bcec16 tempest-TestServerVolumeAttachmentScenario-1899063447 tempest-TestServerVolumeAttachmentScenario-1899063447-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6217bd6e884', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75045) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 23:24:19 user nova-compute[75045]: DEBUG nova.virt.block_device [None req-8a730ee5-f350-4317-8d25-c458e9bcec16 tempest-TestServerVolumeAttachmentScenario-1899063447 tempest-TestServerVolumeAttachmentScenario-1899063447-project-member] [instance: 25cd59d1-6884-471a-813e-52e97c2e1208] Updating existing volume attachment record: cf6cc604-3262-464d-9597-a6acd2074d6d {{(pid=75045) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 23:24:19 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:24:20 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:24:24 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:24:24 user nova-compute[75045]: INFO nova.compute.manager [None req-77121220-ffd1-4d44-9710-3ce5a2fe4291 tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] [instance: 0b84f2b1-01a3-4789-bcef-8b7c4334132b] Rescuing
Nov 08 23:24:24 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-77121220-ffd1-4d44-9710-3ce5a2fe4291 tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] Acquiring lock "refresh_cache-0b84f2b1-01a3-4789-bcef-8b7c4334132b" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 23:24:24 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-77121220-ffd1-4d44-9710-3ce5a2fe4291 tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] Acquired lock "refresh_cache-0b84f2b1-01a3-4789-bcef-8b7c4334132b" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 23:24:24 user nova-compute[75045]: DEBUG nova.network.neutron [None req-77121220-ffd1-4d44-9710-3ce5a2fe4291 tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] [instance: 0b84f2b1-01a3-4789-bcef-8b7c4334132b] Building network info cache for instance {{(pid=75045) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 23:24:25 user nova-compute[75045]: DEBUG nova.network.neutron [None req-77121220-ffd1-4d44-9710-3ce5a2fe4291 tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] [instance: 0b84f2b1-01a3-4789-bcef-8b7c4334132b] Updating instance_info_cache with network_info: [{"id": "c0a20899-be58-4d47-95e2-e129f636162c", "address": "fa:16:3e:69:a7:d0", "network": {"id": "08d1669a-f667-4c79-8e49-0ad183f57046", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1863648032-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bbb640407ef94f568aea892f1834d6d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0a20899-be", "ovs_interfaceid": "c0a20899-be58-4d47-95e2-e129f636162c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75045) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 23:24:25 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-77121220-ffd1-4d44-9710-3ce5a2fe4291 tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] Releasing lock "refresh_cache-0b84f2b1-01a3-4789-bcef-8b7c4334132b" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 23:24:25 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:24:25 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:24:25 user nova-compute[75045]: DEBUG nova.compute.manager [req-73bbb7ee-f7aa-4a06-a31e-14c44e6a2c5c req-56913ed9-a1d7-4d41-a14e-fa3e0edad756 service nova] [instance: 0b84f2b1-01a3-4789-bcef-8b7c4334132b] Received event network-vif-unplugged-c0a20899-be58-4d47-95e2-e129f636162c {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:24:25 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-73bbb7ee-f7aa-4a06-a31e-14c44e6a2c5c req-56913ed9-a1d7-4d41-a14e-fa3e0edad756 service nova] Acquiring lock "0b84f2b1-01a3-4789-bcef-8b7c4334132b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:24:25 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-73bbb7ee-f7aa-4a06-a31e-14c44e6a2c5c req-56913ed9-a1d7-4d41-a14e-fa3e0edad756 service nova] Lock "0b84f2b1-01a3-4789-bcef-8b7c4334132b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:24:25 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-73bbb7ee-f7aa-4a06-a31e-14c44e6a2c5c req-56913ed9-a1d7-4d41-a14e-fa3e0edad756 service nova] Lock "0b84f2b1-01a3-4789-bcef-8b7c4334132b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:24:25 user nova-compute[75045]: DEBUG nova.compute.manager [req-73bbb7ee-f7aa-4a06-a31e-14c44e6a2c5c req-56913ed9-a1d7-4d41-a14e-fa3e0edad756 service nova] [instance: 0b84f2b1-01a3-4789-bcef-8b7c4334132b] No waiting events found dispatching network-vif-unplugged-c0a20899-be58-4d47-95e2-e129f636162c {{(pid=75045) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 23:24:25 user nova-compute[75045]: WARNING nova.compute.manager [req-73bbb7ee-f7aa-4a06-a31e-14c44e6a2c5c req-56913ed9-a1d7-4d41-a14e-fa3e0edad756 service nova] [instance: 0b84f2b1-01a3-4789-bcef-8b7c4334132b] Received unexpected event network-vif-unplugged-c0a20899-be58-4d47-95e2-e129f636162c for instance with vm_state active and task_state rescuing.
Nov 08 23:24:25 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:24:25 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:24:26 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:24:26 user nova-compute[75045]: INFO nova.virt.libvirt.driver [-] [instance: 0b84f2b1-01a3-4789-bcef-8b7c4334132b] Instance destroyed successfully.
Nov 08 23:24:26 user nova-compute[75045]: INFO nova.virt.libvirt.driver [None req-77121220-ffd1-4d44-9710-3ce5a2fe4291 tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] [instance: 0b84f2b1-01a3-4789-bcef-8b7c4334132b] Attempting rescue
Nov 08 23:24:26 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-77121220-ffd1-4d44-9710-3ce5a2fe4291 tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75045) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 08 23:24:26 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-77121220-ffd1-4d44-9710-3ce5a2fe4291 tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] [instance: 0b84f2b1-01a3-4789-bcef-8b7c4334132b] Instance directory exists: not creating {{(pid=75045) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 08 23:24:26 user nova-compute[75045]: INFO nova.virt.libvirt.driver [None req-77121220-ffd1-4d44-9710-3ce5a2fe4291 tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] [instance: 0b84f2b1-01a3-4789-bcef-8b7c4334132b] Creating image(s)
Nov 08 23:24:26 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-77121220-ffd1-4d44-9710-3ce5a2fe4291 tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] Acquiring lock "/opt/stack/data/nova/instances/0b84f2b1-01a3-4789-bcef-8b7c4334132b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:24:26 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-77121220-ffd1-4d44-9710-3ce5a2fe4291 tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] Lock "/opt/stack/data/nova/instances/0b84f2b1-01a3-4789-bcef-8b7c4334132b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:24:26 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-77121220-ffd1-4d44-9710-3ce5a2fe4291 tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] Lock "/opt/stack/data/nova/instances/0b84f2b1-01a3-4789-bcef-8b7c4334132b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:24:26 user nova-compute[75045]: DEBUG nova.objects.instance [None req-77121220-ffd1-4d44-9710-3ce5a2fe4291 tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] Lazy-loading 'trusted_certs' on Instance uuid 0b84f2b1-01a3-4789-bcef-8b7c4334132b {{(pid=75045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 23:24:26 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-77121220-ffd1-4d44-9710-3ce5a2fe4291 tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] Acquiring lock "b59f52a99fff51c56dd1edfb83892fb8f647f2f3" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:24:26 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-77121220-ffd1-4d44-9710-3ce5a2fe4291 tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] Lock "b59f52a99fff51c56dd1edfb83892fb8f647f2f3" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:24:26 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-77121220-ffd1-4d44-9710-3ce5a2fe4291 tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b59f52a99fff51c56dd1edfb83892fb8f647f2f3 --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:24:26 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-77121220-ffd1-4d44-9710-3ce5a2fe4291 tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b59f52a99fff51c56dd1edfb83892fb8f647f2f3 --force-share --output=json" returned: 0 in 0.176s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:24:26 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-77121220-ffd1-4d44-9710-3ce5a2fe4291 tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b59f52a99fff51c56dd1edfb83892fb8f647f2f3,backing_fmt=raw /opt/stack/data/nova/instances/0b84f2b1-01a3-4789-bcef-8b7c4334132b/disk.rescue {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:24:26 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-77121220-ffd1-4d44-9710-3ce5a2fe4291 tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b59f52a99fff51c56dd1edfb83892fb8f647f2f3,backing_fmt=raw /opt/stack/data/nova/instances/0b84f2b1-01a3-4789-bcef-8b7c4334132b/disk.rescue" returned: 0 in 0.054s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:24:26 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-77121220-ffd1-4d44-9710-3ce5a2fe4291 tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] Lock "b59f52a99fff51c56dd1edfb83892fb8f647f2f3" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.238s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:24:26 user nova-compute[75045]: DEBUG nova.objects.instance [None req-77121220-ffd1-4d44-9710-3ce5a2fe4291 tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] Lazy-loading 'migration_context' on Instance uuid 0b84f2b1-01a3-4789-bcef-8b7c4334132b {{(pid=75045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 23:24:26 user nova-compute[75045]: DEBUG nova.objects.base [None req-77121220-ffd1-4d44-9710-3ce5a2fe4291 tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] Object Instance<0b84f2b1-01a3-4789-bcef-8b7c4334132b> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75045) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 23:24:26 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-77121220-ffd1-4d44-9710-3ce5a2fe4291 tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] [instance: 0b84f2b1-01a3-4789-bcef-8b7c4334132b] Created local disks {{(pid=75045) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 23:24:26 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-77121220-ffd1-4d44-9710-3ce5a2fe4291 tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] [instance: 0b84f2b1-01a3-4789-bcef-8b7c4334132b] Start _get_guest_xml network_info=[{"id": "c0a20899-be58-4d47-95e2-e129f636162c", "address": "fa:16:3e:69:a7:d0", "network": {"id": "08d1669a-f667-4c79-8e49-0ad183f57046", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1863648032-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1863648032-network", "vif_mac": "fa:16:3e:69:a7:d0"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bbb640407ef94f568aea892f1834d6d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0a20899-be", "ovs_interfaceid": "c0a20899-be58-4d47-95e2-e129f636162c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T23:11:54Z,direct_url=<?>,disk_format='qcow2',id=a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b1beba2cc4e7465ea249e2225fb494dc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T23:11:56Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=75045) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 23:24:26 user nova-compute[75045]: DEBUG nova.objects.instance [None req-77121220-ffd1-4d44-9710-3ce5a2fe4291 tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] Lazy-loading 'resources' on Instance uuid 0b84f2b1-01a3-4789-bcef-8b7c4334132b {{(pid=75045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 23:24:26 user nova-compute[75045]: DEBUG nova.objects.base [None req-77121220-ffd1-4d44-9710-3ce5a2fe4291 tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] Object Instance<0b84f2b1-01a3-4789-bcef-8b7c4334132b> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75045) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 23:24:26 user nova-compute[75045]: DEBUG nova.objects.instance [None req-77121220-ffd1-4d44-9710-3ce5a2fe4291 tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] Lazy-loading 'numa_topology' on Instance uuid 0b84f2b1-01a3-4789-bcef-8b7c4334132b {{(pid=75045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 23:24:26 user nova-compute[75045]: DEBUG nova.objects.base [None req-77121220-ffd1-4d44-9710-3ce5a2fe4291 tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] Object Instance<0b84f2b1-01a3-4789-bcef-8b7c4334132b> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75045) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 23:24:26 user nova-compute[75045]: WARNING nova.virt.libvirt.driver [None req-77121220-ffd1-4d44-9710-3ce5a2fe4291 tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 23:24:26 user nova-compute[75045]: WARNING nova.virt.libvirt.driver [None req-77121220-ffd1-4d44-9710-3ce5a2fe4291 tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 23:24:26 user nova-compute[75045]: DEBUG nova.virt.libvirt.host [None req-77121220-ffd1-4d44-9710-3ce5a2fe4291 tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75045) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 23:24:26 user nova-compute[75045]: DEBUG nova.virt.libvirt.host [None req-77121220-ffd1-4d44-9710-3ce5a2fe4291 tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] CPU controller missing on host. {{(pid=75045) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 23:24:26 user nova-compute[75045]: DEBUG nova.virt.libvirt.host [None req-77121220-ffd1-4d44-9710-3ce5a2fe4291 tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75045) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 23:24:26 user nova-compute[75045]: DEBUG nova.virt.libvirt.host [None req-77121220-ffd1-4d44-9710-3ce5a2fe4291 tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] CPU controller found on host. {{(pid=75045) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 23:24:26 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-77121220-ffd1-4d44-9710-3ce5a2fe4291 tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75045) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 23:24:26 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-77121220-ffd1-4d44-9710-3ce5a2fe4291 tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T23:11:41Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T23:11:54Z,direct_url=<?>,disk_format='qcow2',id=a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b1beba2cc4e7465ea249e2225fb494dc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T23:11:56Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75045) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 23:24:26 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-77121220-ffd1-4d44-9710-3ce5a2fe4291 tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] Flavor limits 0:0:0 {{(pid=75045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 23:24:26 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-77121220-ffd1-4d44-9710-3ce5a2fe4291 tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] Image limits 0:0:0 {{(pid=75045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 23:24:26 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-77121220-ffd1-4d44-9710-3ce5a2fe4291 tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] Flavor pref 0:0:0 {{(pid=75045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 23:24:26 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-77121220-ffd1-4d44-9710-3ce5a2fe4291 tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] Image pref 0:0:0 {{(pid=75045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 23:24:26 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-77121220-ffd1-4d44-9710-3ce5a2fe4291 tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 23:24:26 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-77121220-ffd1-4d44-9710-3ce5a2fe4291 tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75045) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 23:24:26 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-77121220-ffd1-4d44-9710-3ce5a2fe4291 tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75045) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 23:24:26 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-77121220-ffd1-4d44-9710-3ce5a2fe4291 tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] Got 1 possible topologies {{(pid=75045) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 23:24:26 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-77121220-ffd1-4d44-9710-3ce5a2fe4291 tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75045) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 23:24:26 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-77121220-ffd1-4d44-9710-3ce5a2fe4291 tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75045) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 23:24:26 user nova-compute[75045]: DEBUG nova.objects.instance [None req-77121220-ffd1-4d44-9710-3ce5a2fe4291 tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] Lazy-loading 'vcpu_model' on Instance uuid 0b84f2b1-01a3-4789-bcef-8b7c4334132b {{(pid=75045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 23:24:26 user nova-compute[75045]: DEBUG nova.objects.base [None req-77121220-ffd1-4d44-9710-3ce5a2fe4291 tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] Object Instance<0b84f2b1-01a3-4789-bcef-8b7c4334132b> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75045) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 23:24:26 user nova-compute[75045]: DEBUG nova.virt.libvirt.vif [None req-77121220-ffd1-4d44-9710-3ce5a2fe4291 tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T23:22:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-2049313631',display_name='tempest-ServerRescueNegativeTestJSON-server-2049313631',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-2049313631',id=20,image_ref='a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-08T23:22:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bbb640407ef94f568aea892f1834d6d1',ramdisk_id='',reservation_id='r-boxb4qwm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-187452128',owner_user_name='tempest-ServerRescueNegativeTestJSON-187452128-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T23:22:45Z,user_data=None,user_id='f16e465ffb49488db3de445a473fd77a',uuid=0b84f2b1-01a3-4789-bcef-8b7c4334132b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c0a20899-be58-4d47-95e2-e129f636162c", "address": "fa:16:3e:69:a7:d0", "network": {"id": "08d1669a-f667-4c79-8e49-0ad183f57046", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1863648032-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1863648032-network", "vif_mac": "fa:16:3e:69:a7:d0"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bbb640407ef94f568aea892f1834d6d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0a20899-be", "ovs_interfaceid": "c0a20899-be58-4d47-95e2-e129f636162c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75045) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 23:24:26 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-77121220-ffd1-4d44-9710-3ce5a2fe4291 tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] Converting VIF {"id": "c0a20899-be58-4d47-95e2-e129f636162c", "address": "fa:16:3e:69:a7:d0", "network": {"id": "08d1669a-f667-4c79-8e49-0ad183f57046", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1863648032-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1863648032-network", "vif_mac": "fa:16:3e:69:a7:d0"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bbb640407ef94f568aea892f1834d6d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0a20899-be", "ovs_interfaceid": "c0a20899-be58-4d47-95e2-e129f636162c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 23:24:26 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-77121220-ffd1-4d44-9710-3ce5a2fe4291 tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:69:a7:d0,bridge_name='br-int',has_traffic_filtering=True,id=c0a20899-be58-4d47-95e2-e129f636162c,network=Network(08d1669a-f667-4c79-8e49-0ad183f57046),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc0a20899-be') {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 23:24:26 user nova-compute[75045]: DEBUG nova.objects.instance [None req-77121220-ffd1-4d44-9710-3ce5a2fe4291 tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] Lazy-loading 'pci_devices' on Instance uuid 0b84f2b1-01a3-4789-bcef-8b7c4334132b {{(pid=75045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 23:24:26 user nova-compute[75045]: DEBUG nova.objects.base [None req-77121220-ffd1-4d44-9710-3ce5a2fe4291 tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] Object Instance<0b84f2b1-01a3-4789-bcef-8b7c4334132b> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75045) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 23:24:26 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-77121220-ffd1-4d44-9710-3ce5a2fe4291 tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] [instance: 0b84f2b1-01a3-4789-bcef-8b7c4334132b] End _get_guest_xml xml=<domain type="kvm">
Nov 08 23:24:26 user nova-compute[75045]:   <uuid>0b84f2b1-01a3-4789-bcef-8b7c4334132b</uuid>
Nov 08 23:24:26 user nova-compute[75045]:   <name>instance-00000014</name>
Nov 08 23:24:26 user nova-compute[75045]:   <memory>524288</memory>
Nov 08 23:24:26 user nova-compute[75045]:   <vcpu>1</vcpu>
Nov 08 23:24:26 user nova-compute[75045]:   <metadata>
Nov 08 23:24:26 user nova-compute[75045]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 23:24:26 user nova-compute[75045]:       <nova:package version="0.0.0"/>
Nov 08 23:24:26 user nova-compute[75045]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-2049313631</nova:name>
Nov 08 23:24:26 user nova-compute[75045]:       <nova:creationTime>2023-11-08 23:24:26</nova:creationTime>
Nov 08 23:24:26 user nova-compute[75045]:       <nova:flavor name="m1.tiny">
Nov 08 23:24:26 user nova-compute[75045]:         <nova:memory>512</nova:memory>
Nov 08 23:24:26 user nova-compute[75045]:         <nova:disk>1</nova:disk>
Nov 08 23:24:26 user nova-compute[75045]:         <nova:swap>0</nova:swap>
Nov 08 23:24:26 user nova-compute[75045]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 23:24:26 user nova-compute[75045]:         <nova:vcpus>1</nova:vcpus>
Nov 08 23:24:26 user nova-compute[75045]:       </nova:flavor>
Nov 08 23:24:26 user nova-compute[75045]:       <nova:owner>
Nov 08 23:24:26 user nova-compute[75045]:         <nova:user uuid="f16e465ffb49488db3de445a473fd77a">tempest-ServerRescueNegativeTestJSON-187452128-project-member</nova:user>
Nov 08 23:24:26 user nova-compute[75045]:         <nova:project uuid="bbb640407ef94f568aea892f1834d6d1">tempest-ServerRescueNegativeTestJSON-187452128</nova:project>
Nov 08 23:24:26 user nova-compute[75045]:       </nova:owner>
Nov 08 23:24:26 user nova-compute[75045]:       <nova:root type="image" uuid="a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb"/>
Nov 08 23:24:26 user nova-compute[75045]:       <nova:ports>
Nov 08 23:24:26 user nova-compute[75045]:         <nova:port uuid="c0a20899-be58-4d47-95e2-e129f636162c">
Nov 08 23:24:26 user nova-compute[75045]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 08 23:24:26 user nova-compute[75045]:         </nova:port>
Nov 08 23:24:26 user nova-compute[75045]:       </nova:ports>
Nov 08 23:24:26 user nova-compute[75045]:     </nova:instance>
Nov 08 23:24:26 user nova-compute[75045]:   </metadata>
Nov 08 23:24:26 user nova-compute[75045]:   <sysinfo type="smbios">
Nov 08 23:24:26 user nova-compute[75045]:     <system>
Nov 08 23:24:26 user nova-compute[75045]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 23:24:26 user nova-compute[75045]:       <entry name="product">OpenStack Nova</entry>
Nov 08 23:24:26 user nova-compute[75045]:       <entry name="version">0.0.0</entry>
Nov 08 23:24:26 user nova-compute[75045]:       <entry name="serial">0b84f2b1-01a3-4789-bcef-8b7c4334132b</entry>
Nov 08 23:24:26 user nova-compute[75045]:       <entry name="uuid">0b84f2b1-01a3-4789-bcef-8b7c4334132b</entry>
Nov 08 23:24:26 user nova-compute[75045]:       <entry name="family">Virtual Machine</entry>
Nov 08 23:24:26 user nova-compute[75045]:     </system>
Nov 08 23:24:26 user nova-compute[75045]:   </sysinfo>
Nov 08 23:24:26 user nova-compute[75045]:   <os>
Nov 08 23:24:26 user nova-compute[75045]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 23:24:26 user nova-compute[75045]:     <smbios mode="sysinfo"/>
Nov 08 23:24:26 user nova-compute[75045]:   </os>
Nov 08 23:24:26 user nova-compute[75045]:   <features>
Nov 08 23:24:26 user nova-compute[75045]:     <acpi/>
Nov 08 23:24:26 user nova-compute[75045]:     <apic/>
Nov 08 23:24:26 user nova-compute[75045]:     <vmcoreinfo/>
Nov 08 23:24:26 user nova-compute[75045]:   </features>
Nov 08 23:24:26 user nova-compute[75045]:   <clock offset="utc">
Nov 08 23:24:26 user nova-compute[75045]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 23:24:26 user nova-compute[75045]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 23:24:26 user nova-compute[75045]:     <timer name="hpet" present="no"/>
Nov 08 23:24:26 user nova-compute[75045]:   </clock>
Nov 08 23:24:26 user nova-compute[75045]:   <cpu mode="custom" match="exact">
Nov 08 23:24:26 user nova-compute[75045]:     <model>Nehalem</model>
Nov 08 23:24:26 user nova-compute[75045]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 23:24:26 user nova-compute[75045]:   </cpu>
Nov 08 23:24:26 user nova-compute[75045]:   <devices>
Nov 08 23:24:26 user nova-compute[75045]:     <disk type="file" device="disk">
Nov 08 23:24:26 user nova-compute[75045]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 23:24:26 user nova-compute[75045]:       <source file="/opt/stack/data/nova/instances/0b84f2b1-01a3-4789-bcef-8b7c4334132b/disk.rescue"/>
Nov 08 23:24:26 user nova-compute[75045]:       <target dev="vda" bus="virtio"/>
Nov 08 23:24:26 user nova-compute[75045]:     </disk>
Nov 08 23:24:26 user nova-compute[75045]:     <disk type="file" device="disk">
Nov 08 23:24:26 user nova-compute[75045]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 23:24:26 user nova-compute[75045]:       <source file="/opt/stack/data/nova/instances/0b84f2b1-01a3-4789-bcef-8b7c4334132b/disk"/>
Nov 08 23:24:26 user nova-compute[75045]:       <target dev="vdb" bus="virtio"/>
Nov 08 23:24:26 user nova-compute[75045]:     </disk>
Nov 08 23:24:26 user nova-compute[75045]:     <interface type="ethernet">
Nov 08 23:24:26 user nova-compute[75045]:       <mac address="fa:16:3e:69:a7:d0"/>
Nov 08 23:24:26 user nova-compute[75045]:       <model type="virtio"/>
Nov 08 23:24:26 user nova-compute[75045]:       <mtu size="1442"/>
Nov 08 23:24:26 user nova-compute[75045]:       <target dev="tapc0a20899-be"/>
Nov 08 23:24:26 user nova-compute[75045]:     </interface>
Nov 08 23:24:26 user nova-compute[75045]:     <serial type="pty">
Nov 08 23:24:26 user nova-compute[75045]:       <log file="/opt/stack/data/nova/instances/0b84f2b1-01a3-4789-bcef-8b7c4334132b/console.log" append="off"/>
Nov 08 23:24:26 user nova-compute[75045]:     </serial>
Nov 08 23:24:26 user nova-compute[75045]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 23:24:26 user nova-compute[75045]:     <video>
Nov 08 23:24:26 user nova-compute[75045]:       <model type="virtio"/>
Nov 08 23:24:26 user nova-compute[75045]:     </video>
Nov 08 23:24:26 user nova-compute[75045]:     <rng model="virtio">
Nov 08 23:24:26 user nova-compute[75045]:       <backend model="random">/dev/urandom</backend>
Nov 08 23:24:26 user nova-compute[75045]:     </rng>
Nov 08 23:24:26 user nova-compute[75045]:     <controller type="usb" index="0" model="none"/>
Nov 08 23:24:26 user nova-compute[75045]:     <memballoon model="virtio">
Nov 08 23:24:26 user nova-compute[75045]:       <stats period="10"/>
Nov 08 23:24:26 user nova-compute[75045]:     </memballoon>
Nov 08 23:24:26 user nova-compute[75045]:   </devices>
Nov 08 23:24:26 user nova-compute[75045]: </domain>
Nov 08 23:24:26 user nova-compute[75045]:  {{(pid=75045) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 23:24:26 user nova-compute[75045]: INFO nova.virt.libvirt.driver [-] [instance: 0b84f2b1-01a3-4789-bcef-8b7c4334132b] Instance destroyed successfully.
Nov 08 23:24:26 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-77121220-ffd1-4d44-9710-3ce5a2fe4291 tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] No BDM found with device name vda, not building metadata. {{(pid=75045) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 23:24:26 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-77121220-ffd1-4d44-9710-3ce5a2fe4291 tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75045) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 23:24:26 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-77121220-ffd1-4d44-9710-3ce5a2fe4291 tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] No VIF found with MAC fa:16:3e:69:a7:d0, not building metadata {{(pid=75045) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 23:24:27 user nova-compute[75045]: DEBUG nova.compute.manager [req-eef3a685-08b3-4e4d-a37e-f37059b99d80 req-494aa62c-2f7a-416d-a218-47464927d855 service nova] [instance: 0b84f2b1-01a3-4789-bcef-8b7c4334132b] Received event network-vif-plugged-c0a20899-be58-4d47-95e2-e129f636162c {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:24:27 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-eef3a685-08b3-4e4d-a37e-f37059b99d80 req-494aa62c-2f7a-416d-a218-47464927d855 service nova] Acquiring lock "0b84f2b1-01a3-4789-bcef-8b7c4334132b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:24:27 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-eef3a685-08b3-4e4d-a37e-f37059b99d80 req-494aa62c-2f7a-416d-a218-47464927d855 service nova] Lock "0b84f2b1-01a3-4789-bcef-8b7c4334132b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:24:27 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-eef3a685-08b3-4e4d-a37e-f37059b99d80 req-494aa62c-2f7a-416d-a218-47464927d855 service nova] Lock "0b84f2b1-01a3-4789-bcef-8b7c4334132b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:24:27 user nova-compute[75045]: DEBUG nova.compute.manager [req-eef3a685-08b3-4e4d-a37e-f37059b99d80 req-494aa62c-2f7a-416d-a218-47464927d855 service nova] [instance: 0b84f2b1-01a3-4789-bcef-8b7c4334132b] No waiting events found dispatching network-vif-plugged-c0a20899-be58-4d47-95e2-e129f636162c {{(pid=75045) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 23:24:27 user nova-compute[75045]: WARNING nova.compute.manager [req-eef3a685-08b3-4e4d-a37e-f37059b99d80 req-494aa62c-2f7a-416d-a218-47464927d855 service nova] [instance: 0b84f2b1-01a3-4789-bcef-8b7c4334132b] Received unexpected event network-vif-plugged-c0a20899-be58-4d47-95e2-e129f636162c for instance with vm_state active and task_state rescuing.
Nov 08 23:24:27 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:24:27 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:24:28 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:24:28 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:24:28 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:24:28 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:24:29 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:24:29 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:24:29 user nova-compute[75045]: DEBUG nova.compute.manager [req-3905fbdc-eeb9-43ef-a571-102b43894037 req-518d6bae-4a87-417d-ac28-d8e64a2257ab service nova] [instance: 0b84f2b1-01a3-4789-bcef-8b7c4334132b] Received event network-vif-plugged-c0a20899-be58-4d47-95e2-e129f636162c {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:24:29 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-3905fbdc-eeb9-43ef-a571-102b43894037 req-518d6bae-4a87-417d-ac28-d8e64a2257ab service nova] Acquiring lock "0b84f2b1-01a3-4789-bcef-8b7c4334132b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:24:29 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-3905fbdc-eeb9-43ef-a571-102b43894037 req-518d6bae-4a87-417d-ac28-d8e64a2257ab service nova] Lock "0b84f2b1-01a3-4789-bcef-8b7c4334132b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:24:29 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-3905fbdc-eeb9-43ef-a571-102b43894037 req-518d6bae-4a87-417d-ac28-d8e64a2257ab service nova] Lock "0b84f2b1-01a3-4789-bcef-8b7c4334132b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:24:29 user nova-compute[75045]: DEBUG nova.compute.manager [req-3905fbdc-eeb9-43ef-a571-102b43894037 req-518d6bae-4a87-417d-ac28-d8e64a2257ab service nova] [instance: 0b84f2b1-01a3-4789-bcef-8b7c4334132b] No waiting events found dispatching network-vif-plugged-c0a20899-be58-4d47-95e2-e129f636162c {{(pid=75045) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 23:24:29 user nova-compute[75045]: WARNING nova.compute.manager [req-3905fbdc-eeb9-43ef-a571-102b43894037 req-518d6bae-4a87-417d-ac28-d8e64a2257ab service nova] [instance: 0b84f2b1-01a3-4789-bcef-8b7c4334132b] Received unexpected event network-vif-plugged-c0a20899-be58-4d47-95e2-e129f636162c for instance with vm_state active and task_state rescuing.
Nov 08 23:24:29 user nova-compute[75045]: DEBUG nova.compute.manager [req-3905fbdc-eeb9-43ef-a571-102b43894037 req-518d6bae-4a87-417d-ac28-d8e64a2257ab service nova] [instance: 0b84f2b1-01a3-4789-bcef-8b7c4334132b] Received event network-vif-plugged-c0a20899-be58-4d47-95e2-e129f636162c {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:24:29 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-3905fbdc-eeb9-43ef-a571-102b43894037 req-518d6bae-4a87-417d-ac28-d8e64a2257ab service nova] Acquiring lock "0b84f2b1-01a3-4789-bcef-8b7c4334132b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:24:29 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-3905fbdc-eeb9-43ef-a571-102b43894037 req-518d6bae-4a87-417d-ac28-d8e64a2257ab service nova] Lock "0b84f2b1-01a3-4789-bcef-8b7c4334132b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:24:29 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-3905fbdc-eeb9-43ef-a571-102b43894037 req-518d6bae-4a87-417d-ac28-d8e64a2257ab service nova] Lock "0b84f2b1-01a3-4789-bcef-8b7c4334132b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:24:29 user nova-compute[75045]: DEBUG nova.compute.manager [req-3905fbdc-eeb9-43ef-a571-102b43894037 req-518d6bae-4a87-417d-ac28-d8e64a2257ab service nova] [instance: 0b84f2b1-01a3-4789-bcef-8b7c4334132b] No waiting events found dispatching network-vif-plugged-c0a20899-be58-4d47-95e2-e129f636162c {{(pid=75045) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 23:24:29 user nova-compute[75045]: WARNING nova.compute.manager [req-3905fbdc-eeb9-43ef-a571-102b43894037 req-518d6bae-4a87-417d-ac28-d8e64a2257ab service nova] [instance: 0b84f2b1-01a3-4789-bcef-8b7c4334132b] Received unexpected event network-vif-plugged-c0a20899-be58-4d47-95e2-e129f636162c for instance with vm_state active and task_state rescuing.
Nov 08 23:24:30 user nova-compute[75045]: DEBUG nova.compute.manager [None req-77121220-ffd1-4d44-9710-3ce5a2fe4291 tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] [instance: 0b84f2b1-01a3-4789-bcef-8b7c4334132b] Checking state {{(pid=75045) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 23:24:31 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:24:34 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:24:36 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:24:38 user nova-compute[75045]: DEBUG nova.compute.manager [None req-7b48f1e9-661b-4ec3-8c5a-1467cd11279c tempest-ServerActionsV293TestJSON-1645081958 tempest-ServerActionsV293TestJSON-1645081958-project-member] [instance: 667d20c3-3eda-4aa5-b799-6dcee3443833] Start spawning the instance on the hypervisor. {{(pid=75045) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 23:24:38 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-7b48f1e9-661b-4ec3-8c5a-1467cd11279c tempest-ServerActionsV293TestJSON-1645081958 tempest-ServerActionsV293TestJSON-1645081958-project-member] [instance: 667d20c3-3eda-4aa5-b799-6dcee3443833] Creating instance directory {{(pid=75045) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 23:24:38 user nova-compute[75045]: INFO nova.virt.libvirt.driver [None req-7b48f1e9-661b-4ec3-8c5a-1467cd11279c tempest-ServerActionsV293TestJSON-1645081958 tempest-ServerActionsV293TestJSON-1645081958-project-member] [instance: 667d20c3-3eda-4aa5-b799-6dcee3443833] Creating image(s)
Nov 08 23:24:38 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-7b48f1e9-661b-4ec3-8c5a-1467cd11279c tempest-ServerActionsV293TestJSON-1645081958 tempest-ServerActionsV293TestJSON-1645081958-project-member] [instance: 667d20c3-3eda-4aa5-b799-6dcee3443833] Did not create local disks {{(pid=75045) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 08 23:24:38 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-7b48f1e9-661b-4ec3-8c5a-1467cd11279c tempest-ServerActionsV293TestJSON-1645081958 tempest-ServerActionsV293TestJSON-1645081958-project-member] [instance: 667d20c3-3eda-4aa5-b799-6dcee3443833] Ensure instance console log exists: /opt/stack/data/nova/instances/667d20c3-3eda-4aa5-b799-6dcee3443833/console.log {{(pid=75045) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 23:24:38 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-7b48f1e9-661b-4ec3-8c5a-1467cd11279c tempest-ServerActionsV293TestJSON-1645081958 tempest-ServerActionsV293TestJSON-1645081958-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:24:38 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-7b48f1e9-661b-4ec3-8c5a-1467cd11279c tempest-ServerActionsV293TestJSON-1645081958 tempest-ServerActionsV293TestJSON-1645081958-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:24:38 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-7b48f1e9-661b-4ec3-8c5a-1467cd11279c tempest-ServerActionsV293TestJSON-1645081958 tempest-ServerActionsV293TestJSON-1645081958-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:24:38 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-7b48f1e9-661b-4ec3-8c5a-1467cd11279c tempest-ServerActionsV293TestJSON-1645081958 tempest-ServerActionsV293TestJSON-1645081958-project-member] [instance: 667d20c3-3eda-4aa5-b799-6dcee3443833] Start _get_guest_xml network_info=[{"id": "0d5e497c-3168-46b1-9094-9bb54737cc0f", "address": "fa:16:3e:80:07:f1", "network": {"id": "22898442-b87a-4538-a8f5-fe275919f44a", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-665667609-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "89744dd7de584b14880bc42dd96933af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d5e497c-31", "ovs_interfaceid": "0d5e497c-3168-46b1-9094-9bb54737cc0f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': True, 'device_type': 'disk', 'attachment_id': '8c6e537a-21a7-4484-a895-a1cebbef8128', 'guest_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:04d02c98-d058-49d8-a350-ab9e63003d6e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uVoSDJjd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '667d20c3-3eda-4aa5-b799-6dcee3443833', 'attached_at': '', 'detached_at': '', 'volume_id': '04d02c98-d058-49d8-a350-ab9e63003d6e', 'serial': '04d02c98-d058-49d8-a350-ab9e63003d6e'}, 'volume_type': None} {{(pid=75045) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 23:24:38 user nova-compute[75045]: WARNING nova.virt.libvirt.driver [None req-7b48f1e9-661b-4ec3-8c5a-1467cd11279c tempest-ServerActionsV293TestJSON-1645081958 tempest-ServerActionsV293TestJSON-1645081958-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 23:24:38 user nova-compute[75045]: WARNING nova.virt.libvirt.driver [None req-7b48f1e9-661b-4ec3-8c5a-1467cd11279c tempest-ServerActionsV293TestJSON-1645081958 tempest-ServerActionsV293TestJSON-1645081958-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 23:24:38 user nova-compute[75045]: DEBUG nova.virt.libvirt.host [None req-7b48f1e9-661b-4ec3-8c5a-1467cd11279c tempest-ServerActionsV293TestJSON-1645081958 tempest-ServerActionsV293TestJSON-1645081958-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75045) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 23:24:38 user nova-compute[75045]: DEBUG nova.virt.libvirt.host [None req-7b48f1e9-661b-4ec3-8c5a-1467cd11279c tempest-ServerActionsV293TestJSON-1645081958 tempest-ServerActionsV293TestJSON-1645081958-project-member] CPU controller missing on host. {{(pid=75045) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 23:24:38 user nova-compute[75045]: DEBUG nova.virt.libvirt.host [None req-7b48f1e9-661b-4ec3-8c5a-1467cd11279c tempest-ServerActionsV293TestJSON-1645081958 tempest-ServerActionsV293TestJSON-1645081958-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75045) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 23:24:38 user nova-compute[75045]: DEBUG nova.virt.libvirt.host [None req-7b48f1e9-661b-4ec3-8c5a-1467cd11279c tempest-ServerActionsV293TestJSON-1645081958 tempest-ServerActionsV293TestJSON-1645081958-project-member] CPU controller found on host. {{(pid=75045) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 23:24:38 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-7b48f1e9-661b-4ec3-8c5a-1467cd11279c tempest-ServerActionsV293TestJSON-1645081958 tempest-ServerActionsV293TestJSON-1645081958-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75045) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 23:24:38 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-7b48f1e9-661b-4ec3-8c5a-1467cd11279c tempest-ServerActionsV293TestJSON-1645081958 tempest-ServerActionsV293TestJSON-1645081958-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T23:11:41Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75045) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 23:24:38 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-7b48f1e9-661b-4ec3-8c5a-1467cd11279c tempest-ServerActionsV293TestJSON-1645081958 tempest-ServerActionsV293TestJSON-1645081958-project-member] Flavor limits 0:0:0 {{(pid=75045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 23:24:38 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-7b48f1e9-661b-4ec3-8c5a-1467cd11279c tempest-ServerActionsV293TestJSON-1645081958 tempest-ServerActionsV293TestJSON-1645081958-project-member] Image limits 0:0:0 {{(pid=75045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 23:24:38 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-7b48f1e9-661b-4ec3-8c5a-1467cd11279c tempest-ServerActionsV293TestJSON-1645081958 tempest-ServerActionsV293TestJSON-1645081958-project-member] Flavor pref 0:0:0 {{(pid=75045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 23:24:38 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-7b48f1e9-661b-4ec3-8c5a-1467cd11279c tempest-ServerActionsV293TestJSON-1645081958 tempest-ServerActionsV293TestJSON-1645081958-project-member] Image pref 0:0:0 {{(pid=75045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 23:24:38 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-7b48f1e9-661b-4ec3-8c5a-1467cd11279c tempest-ServerActionsV293TestJSON-1645081958 tempest-ServerActionsV293TestJSON-1645081958-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 23:24:38 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-7b48f1e9-661b-4ec3-8c5a-1467cd11279c tempest-ServerActionsV293TestJSON-1645081958 tempest-ServerActionsV293TestJSON-1645081958-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75045) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 23:24:38 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-7b48f1e9-661b-4ec3-8c5a-1467cd11279c tempest-ServerActionsV293TestJSON-1645081958 tempest-ServerActionsV293TestJSON-1645081958-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75045) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 23:24:38 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-7b48f1e9-661b-4ec3-8c5a-1467cd11279c tempest-ServerActionsV293TestJSON-1645081958 tempest-ServerActionsV293TestJSON-1645081958-project-member] Got 1 possible topologies {{(pid=75045) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 23:24:38 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-7b48f1e9-661b-4ec3-8c5a-1467cd11279c tempest-ServerActionsV293TestJSON-1645081958 tempest-ServerActionsV293TestJSON-1645081958-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75045) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 23:24:38 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-7b48f1e9-661b-4ec3-8c5a-1467cd11279c tempest-ServerActionsV293TestJSON-1645081958 tempest-ServerActionsV293TestJSON-1645081958-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75045) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 23:24:38 user nova-compute[75045]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7b48f1e9-661b-4ec3-8c5a-1467cd11279c tempest-ServerActionsV293TestJSON-1645081958 tempest-ServerActionsV293TestJSON-1645081958-project-member] [instance: 667d20c3-3eda-4aa5-b799-6dcee3443833] Calling os-brick to attach iSCSI Volume {{(pid=75045) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 23:24:38 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b48f1e9-661b-4ec3-8c5a-1467cd11279c tempest-ServerActionsV293TestJSON-1645081958 tempest-ServerActionsV293TestJSON-1645081958-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1b68210460>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:04d02c98-d058-49d8-a350-ab9e63003d6e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uVoSDJjd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75045) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 23:24:38 user nova-compute[75045]: WARNING os_brick.initiator.connectors.base [None req-7b48f1e9-661b-4ec3-8c5a-1467cd11279c tempest-ServerActionsV293TestJSON-1645081958 tempest-ServerActionsV293TestJSON-1645081958-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 23:24:38 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-7b48f1e9-661b-4ec3-8c5a-1467cd11279c tempest-ServerActionsV293TestJSON-1645081958 tempest-ServerActionsV293TestJSON-1645081958-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 23:24:38 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-7b48f1e9-661b-4ec3-8c5a-1467cd11279c tempest-ServerActionsV293TestJSON-1645081958 tempest-ServerActionsV293TestJSON-1645081958-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 23:24:38 user nova-compute[75045]: WARNING os_brick.initiator.connectors.base [None req-7b48f1e9-661b-4ec3-8c5a-1467cd11279c tempest-ServerActionsV293TestJSON-1645081958 tempest-ServerActionsV293TestJSON-1645081958-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 23:24:38 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-7b48f1e9-661b-4ec3-8c5a-1467cd11279c tempest-ServerActionsV293TestJSON-1645081958 tempest-ServerActionsV293TestJSON-1645081958-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:04d02c98-d058-49d8-a350-ab9e63003d6e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 23:24:38 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-7b48f1e9-661b-4ec3-8c5a-1467cd11279c tempest-ServerActionsV293TestJSON-1645081958 tempest-ServerActionsV293TestJSON-1645081958-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:04d02c98-d058-49d8-a350-ab9e63003d6e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 23:24:38 user nova-compute[75045]: INFO os_brick.initiator.connectors.iscsi [None req-7b48f1e9-661b-4ec3-8c5a-1467cd11279c tempest-ServerActionsV293TestJSON-1645081958 tempest-ServerActionsV293TestJSON-1645081958-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 23:24:38 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04d02c98-d058-49d8-a350-ab9e63003d6e -p 172.16.0.220:3260 {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:24:38 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04d02c98-d058-49d8-a350-ab9e63003d6e -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:24:38 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[626607ba-acbd-4cf1-a7d8-abc5c518624f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:24:38 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b48f1e9-661b-4ec3-8c5a-1467cd11279c tempest-ServerActionsV293TestJSON-1645081958 tempest-ServerActionsV293TestJSON-1645081958-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 23:24:38 user nova-compute[75045]:  {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:24:38 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04d02c98-d058-49d8-a350-ab9e63003d6e -p 172.16.0.220:3260 --interface default --op new {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:24:38 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04d02c98-d058-49d8-a350-ab9e63003d6e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:24:38 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[39644844-e147-4d22-bd72-629bdefdf27c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:04d02c98-d058-49d8-a350-ab9e63003d6e] added\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:24:38 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b48f1e9-661b-4ec3-8c5a-1467cd11279c tempest-ServerActionsV293TestJSON-1645081958 tempest-ServerActionsV293TestJSON-1645081958-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:04d02c98-d058-49d8-a350-ab9e63003d6e] added
Nov 08 23:24:38 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:24:38 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04d02c98-d058-49d8-a350-ab9e63003d6e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:24:38 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04d02c98-d058-49d8-a350-ab9e63003d6e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:24:38 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[41fbe256-3a7d-4090-9b6c-68216956f8a0]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:24:38 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b48f1e9-661b-4ec3-8c5a-1467cd11279c tempest-ServerActionsV293TestJSON-1645081958 tempest-ServerActionsV293TestJSON-1645081958-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:24:38 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04d02c98-d058-49d8-a350-ab9e63003d6e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:24:38 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04d02c98-d058-49d8-a350-ab9e63003d6e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:24:38 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ec23f9d-4a52-456c-adc8-2b96ec4cb054]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:24:38 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b48f1e9-661b-4ec3-8c5a-1467cd11279c tempest-ServerActionsV293TestJSON-1645081958 tempest-ServerActionsV293TestJSON-1645081958-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:24:38 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04d02c98-d058-49d8-a350-ab9e63003d6e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uVoSDJjd {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:24:38 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04d02c98-d058-49d8-a350-ab9e63003d6e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uVoSDJjd" returned: 0 in 0.023s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:24:38 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[22075dc0-1363-434f-a349-bdfcb8761cb4]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:24:38 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b48f1e9-661b-4ec3-8c5a-1467cd11279c tempest-ServerActionsV293TestJSON-1645081958 tempest-ServerActionsV293TestJSON-1645081958-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'uVoSDJjd'): stdout= stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:24:38 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04d02c98-d058-49d8-a350-ab9e63003d6e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:24:38 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04d02c98-d058-49d8-a350-ab9e63003d6e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:24:38 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[1de6f43d-4063-4362-bddf-35eddeb2a4d7]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:24:38 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b48f1e9-661b-4ec3-8c5a-1467cd11279c tempest-ServerActionsV293TestJSON-1645081958 tempest-ServerActionsV293TestJSON-1645081958-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:24:38 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:24:38 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:24:38 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[53f33124-5dfc-4117-b8a2-002a3e76edff]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45f1b635-c8a3-4727-a4c7-c2ac441388ff (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd1b2206-989e-409d-84c6-49b37ac252d8 (non-flash)\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:24:38 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b48f1e9-661b-4ec3-8c5a-1467cd11279c tempest-ServerActionsV293TestJSON-1645081958 tempest-ServerActionsV293TestJSON-1645081958-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab (non-flash)
Nov 08 23:24:38 user nova-compute[75045]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45f1b635-c8a3-4727-a4c7-c2ac441388ff (non-flash)
Nov 08 23:24:38 user nova-compute[75045]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd1b2206-989e-409d-84c6-49b37ac252d8 (non-flash)
Nov 08 23:24:38 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 23:24:38 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b48f1e9-661b-4ec3-8c5a-1467cd11279c tempest-ServerActionsV293TestJSON-1645081958 tempest-ServerActionsV293TestJSON-1645081958-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab (non-flash)
Nov 08 23:24:38 user nova-compute[75045]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45f1b635-c8a3-4727-a4c7-c2ac441388ff (non-flash)
Nov 08 23:24:38 user nova-compute[75045]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd1b2206-989e-409d-84c6-49b37ac252d8 (non-flash)
Nov 08 23:24:38 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 23:24:38 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04d02c98-d058-49d8-a350-ab9e63003d6e -p 172.16.0.220:3260 --login {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:24:38 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04d02c98-d058-49d8-a350-ab9e63003d6e -p 172.16.0.220:3260 --login" returned: 0 in 0.076s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:24:38 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1c8a9b1-db74-4507-ada4-c5370d6771fb]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:04d02c98-d058-49d8-a350-ab9e63003d6e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:04d02c98-d058-49d8-a350-ab9e63003d6e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:24:38 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b48f1e9-661b-4ec3-8c5a-1467cd11279c tempest-ServerActionsV293TestJSON-1645081958 tempest-ServerActionsV293TestJSON-1645081958-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:04d02c98-d058-49d8-a350-ab9e63003d6e, portal: 172.16.0.220,3260]
Nov 08 23:24:38 user nova-compute[75045]: Login to [iface: default, target: iqn.2010-10.org.openstack:04d02c98-d058-49d8-a350-ab9e63003d6e, portal: 172.16.0.220,3260] successful.
Nov 08 23:24:38 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:24:38 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04d02c98-d058-49d8-a350-ab9e63003d6e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:24:38 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04d02c98-d058-49d8-a350-ab9e63003d6e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:24:38 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9d5de1b-afca-4e08-9a17-7b38d8811914]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:24:38 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b48f1e9-661b-4ec3-8c5a-1467cd11279c tempest-ServerActionsV293TestJSON-1645081958 tempest-ServerActionsV293TestJSON-1645081958-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:24:38 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:24:38 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:24:38 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f8499ae-e716-48e3-a263-d2b632968623]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45f1b635-c8a3-4727-a4c7-c2ac441388ff (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd1b2206-989e-409d-84c6-49b37ac252d8 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04d02c98-d058-49d8-a350-ab9e63003d6e (non-flash)\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:24:38 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b48f1e9-661b-4ec3-8c5a-1467cd11279c tempest-ServerActionsV293TestJSON-1645081958 tempest-ServerActionsV293TestJSON-1645081958-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab (non-flash)
Nov 08 23:24:38 user nova-compute[75045]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45f1b635-c8a3-4727-a4c7-c2ac441388ff (non-flash)
Nov 08 23:24:38 user nova-compute[75045]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd1b2206-989e-409d-84c6-49b37ac252d8 (non-flash)
Nov 08 23:24:38 user nova-compute[75045]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04d02c98-d058-49d8-a350-ab9e63003d6e (non-flash)
Nov 08 23:24:38 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 23:24:38 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b48f1e9-661b-4ec3-8c5a-1467cd11279c tempest-ServerActionsV293TestJSON-1645081958 tempest-ServerActionsV293TestJSON-1645081958-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab (non-flash)
Nov 08 23:24:38 user nova-compute[75045]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45f1b635-c8a3-4727-a4c7-c2ac441388ff (non-flash)
Nov 08 23:24:38 user nova-compute[75045]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd1b2206-989e-409d-84c6-49b37ac252d8 (non-flash)
Nov 08 23:24:38 user nova-compute[75045]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04d02c98-d058-49d8-a350-ab9e63003d6e (non-flash)
Nov 08 23:24:38 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 23:24:38 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-7b48f1e9-661b-4ec3-8c5a-1467cd11279c tempest-ServerActionsV293TestJSON-1645081958 tempest-ServerActionsV293TestJSON-1645081958-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:04d02c98-d058-49d8-a350-ab9e63003d6e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.352s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 23:24:38 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b48f1e9-661b-4ec3-8c5a-1467cd11279c tempest-ServerActionsV293TestJSON-1645081958 tempest-ServerActionsV293TestJSON-1645081958-project-member] Connected to 172.16.0.220:3260 {{(pid=75045) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 23:24:38 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-7b48f1e9-661b-4ec3-8c5a-1467cd11279c tempest-ServerActionsV293TestJSON-1645081958 tempest-ServerActionsV293TestJSON-1645081958-project-member] HCTL ('35', '-', '-', 0) found on session 18 with lun 0 {{(pid=75045) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 23:24:38 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-7b48f1e9-661b-4ec3-8c5a-1467cd11279c tempest-ServerActionsV293TestJSON-1645081958 tempest-ServerActionsV293TestJSON-1645081958-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75045) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 23:24:38 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:24:38 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.024s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:24:38 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[812059e0-18a8-4cfc-92da-ff0655249db2]: (4, ('- - 0', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:24:38 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-7b48f1e9-661b-4ec3-8c5a-1467cd11279c tempest-ServerActionsV293TestJSON-1645081958 tempest-ServerActionsV293TestJSON-1645081958-project-member] Searching for a device in session 18 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75045) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 23:24:38 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b48f1e9-661b-4ec3-8c5a-1467cd11279c tempest-ServerActionsV293TestJSON-1645081958 tempest-ServerActionsV293TestJSON-1645081958-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:04d02c98-d058-49d8-a350-ab9e63003d6e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uVoSDJjd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75045) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 23:24:39 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:24:39 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-7b48f1e9-661b-4ec3-8c5a-1467cd11279c tempest-ServerActionsV293TestJSON-1645081958 tempest-ServerActionsV293TestJSON-1645081958-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.393s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 23:24:39 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b48f1e9-661b-4ec3-8c5a-1467cd11279c tempest-ServerActionsV293TestJSON-1645081958 tempest-ServerActionsV293TestJSON-1645081958-project-member] <== connect_volume: return (1395ms) {'type': 'block', 'scsi_wwn': '26530623965343832', 'path': '/dev/sdd'} {{(pid=75045) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 23:24:39 user nova-compute[75045]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7b48f1e9-661b-4ec3-8c5a-1467cd11279c tempest-ServerActionsV293TestJSON-1645081958 tempest-ServerActionsV293TestJSON-1645081958-project-member] [instance: 667d20c3-3eda-4aa5-b799-6dcee3443833] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26530623965343832', 'path': '/dev/sdd'} {{(pid=75045) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 23:24:39 user nova-compute[75045]: DEBUG nova.virt.libvirt.vif [None req-7b48f1e9-661b-4ec3-8c5a-1467cd11279c tempest-ServerActionsV293TestJSON-1645081958 tempest-ServerActionsV293TestJSON-1645081958-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T23:23:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-621912130',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-621912130',id=22,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBApsXoUUj600/jCowZP3//u29Ov5MwB7tYSt8EjtngLjlaZqqKZXWg1HuFDyt4rHiDuYq2TVJTqipV6mcSPV0LYib38MErT/yLzsrNv4x3AUTFC5kAU2nRDHPtRbpYSQ9w==',key_name='tempest-keypair-471552763',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='89744dd7de584b14880bc42dd96933af',ramdisk_id='',reservation_id='r-iwtkqj0a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-1645081958',owner_user_name='tempest-ServerActionsV293TestJSON-1645081958-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T23:23:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fc0a769ab72a476c9ac620728d67c5b6',uuid=667d20c3-3eda-4aa5-b799-6dcee3443833,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0d5e497c-3168-46b1-9094-9bb54737cc0f", "address": "fa:16:3e:80:07:f1", "network": {"id": "22898442-b87a-4538-a8f5-fe275919f44a", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-665667609-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "89744dd7de584b14880bc42dd96933af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d5e497c-31", "ovs_interfaceid": "0d5e497c-3168-46b1-9094-9bb54737cc0f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75045) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 23:24:39 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-7b48f1e9-661b-4ec3-8c5a-1467cd11279c tempest-ServerActionsV293TestJSON-1645081958 tempest-ServerActionsV293TestJSON-1645081958-project-member] Converting VIF {"id": "0d5e497c-3168-46b1-9094-9bb54737cc0f", "address": "fa:16:3e:80:07:f1", "network": {"id": "22898442-b87a-4538-a8f5-fe275919f44a", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-665667609-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "89744dd7de584b14880bc42dd96933af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d5e497c-31", "ovs_interfaceid": "0d5e497c-3168-46b1-9094-9bb54737cc0f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 23:24:39 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-7b48f1e9-661b-4ec3-8c5a-1467cd11279c tempest-ServerActionsV293TestJSON-1645081958 tempest-ServerActionsV293TestJSON-1645081958-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:80:07:f1,bridge_name='br-int',has_traffic_filtering=True,id=0d5e497c-3168-46b1-9094-9bb54737cc0f,network=Network(22898442-b87a-4538-a8f5-fe275919f44a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0d5e497c-31') {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 23:24:39 user nova-compute[75045]: DEBUG nova.objects.instance [None req-7b48f1e9-661b-4ec3-8c5a-1467cd11279c tempest-ServerActionsV293TestJSON-1645081958 tempest-ServerActionsV293TestJSON-1645081958-project-member] Lazy-loading 'pci_devices' on Instance uuid 667d20c3-3eda-4aa5-b799-6dcee3443833 {{(pid=75045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 23:24:39 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-7b48f1e9-661b-4ec3-8c5a-1467cd11279c tempest-ServerActionsV293TestJSON-1645081958 tempest-ServerActionsV293TestJSON-1645081958-project-member] [instance: 667d20c3-3eda-4aa5-b799-6dcee3443833] End _get_guest_xml xml=<domain type="kvm">
Nov 08 23:24:39 user nova-compute[75045]:   <uuid>667d20c3-3eda-4aa5-b799-6dcee3443833</uuid>
Nov 08 23:24:39 user nova-compute[75045]:   <name>instance-00000016</name>
Nov 08 23:24:39 user nova-compute[75045]:   <memory>524288</memory>
Nov 08 23:24:39 user nova-compute[75045]:   <vcpu>1</vcpu>
Nov 08 23:24:39 user nova-compute[75045]:   <metadata>
Nov 08 23:24:39 user nova-compute[75045]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 23:24:39 user nova-compute[75045]:       <nova:package version="0.0.0"/>
Nov 08 23:24:39 user nova-compute[75045]:       <nova:name>tempest-ServerActionsV293TestJSON-server-621912130</nova:name>
Nov 08 23:24:39 user nova-compute[75045]:       <nova:creationTime>2023-11-08 23:24:38</nova:creationTime>
Nov 08 23:24:39 user nova-compute[75045]:       <nova:flavor name="m1.tiny">
Nov 08 23:24:39 user nova-compute[75045]:         <nova:memory>512</nova:memory>
Nov 08 23:24:39 user nova-compute[75045]:         <nova:disk>1</nova:disk>
Nov 08 23:24:39 user nova-compute[75045]:         <nova:swap>0</nova:swap>
Nov 08 23:24:39 user nova-compute[75045]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 23:24:39 user nova-compute[75045]:         <nova:vcpus>1</nova:vcpus>
Nov 08 23:24:39 user nova-compute[75045]:       </nova:flavor>
Nov 08 23:24:39 user nova-compute[75045]:       <nova:owner>
Nov 08 23:24:39 user nova-compute[75045]:         <nova:user uuid="fc0a769ab72a476c9ac620728d67c5b6">tempest-ServerActionsV293TestJSON-1645081958-project-member</nova:user>
Nov 08 23:24:39 user nova-compute[75045]:         <nova:project uuid="89744dd7de584b14880bc42dd96933af">tempest-ServerActionsV293TestJSON-1645081958</nova:project>
Nov 08 23:24:39 user nova-compute[75045]:       </nova:owner>
Nov 08 23:24:39 user nova-compute[75045]:       <nova:ports>
Nov 08 23:24:39 user nova-compute[75045]:         <nova:port uuid="0d5e497c-3168-46b1-9094-9bb54737cc0f">
Nov 08 23:24:39 user nova-compute[75045]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 08 23:24:39 user nova-compute[75045]:         </nova:port>
Nov 08 23:24:39 user nova-compute[75045]:       </nova:ports>
Nov 08 23:24:39 user nova-compute[75045]:     </nova:instance>
Nov 08 23:24:39 user nova-compute[75045]:   </metadata>
Nov 08 23:24:39 user nova-compute[75045]:   <sysinfo type="smbios">
Nov 08 23:24:39 user nova-compute[75045]:     <system>
Nov 08 23:24:39 user nova-compute[75045]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 23:24:39 user nova-compute[75045]:       <entry name="product">OpenStack Nova</entry>
Nov 08 23:24:39 user nova-compute[75045]:       <entry name="version">0.0.0</entry>
Nov 08 23:24:39 user nova-compute[75045]:       <entry name="serial">667d20c3-3eda-4aa5-b799-6dcee3443833</entry>
Nov 08 23:24:39 user nova-compute[75045]:       <entry name="uuid">667d20c3-3eda-4aa5-b799-6dcee3443833</entry>
Nov 08 23:24:39 user nova-compute[75045]:       <entry name="family">Virtual Machine</entry>
Nov 08 23:24:39 user nova-compute[75045]:     </system>
Nov 08 23:24:39 user nova-compute[75045]:   </sysinfo>
Nov 08 23:24:39 user nova-compute[75045]:   <os>
Nov 08 23:24:39 user nova-compute[75045]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 23:24:39 user nova-compute[75045]:     <boot dev="hd"/>
Nov 08 23:24:39 user nova-compute[75045]:     <smbios mode="sysinfo"/>
Nov 08 23:24:39 user nova-compute[75045]:   </os>
Nov 08 23:24:39 user nova-compute[75045]:   <features>
Nov 08 23:24:39 user nova-compute[75045]:     <acpi/>
Nov 08 23:24:39 user nova-compute[75045]:     <apic/>
Nov 08 23:24:39 user nova-compute[75045]:     <vmcoreinfo/>
Nov 08 23:24:39 user nova-compute[75045]:   </features>
Nov 08 23:24:39 user nova-compute[75045]:   <clock offset="utc">
Nov 08 23:24:39 user nova-compute[75045]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 23:24:39 user nova-compute[75045]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 23:24:39 user nova-compute[75045]:     <timer name="hpet" present="no"/>
Nov 08 23:24:39 user nova-compute[75045]:   </clock>
Nov 08 23:24:39 user nova-compute[75045]:   <cpu mode="custom" match="exact">
Nov 08 23:24:39 user nova-compute[75045]:     <model>Nehalem</model>
Nov 08 23:24:39 user nova-compute[75045]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 23:24:39 user nova-compute[75045]:   </cpu>
Nov 08 23:24:39 user nova-compute[75045]:   <devices>
Nov 08 23:24:39 user nova-compute[75045]:     <disk type="block" device="disk">
Nov 08 23:24:39 user nova-compute[75045]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 23:24:39 user nova-compute[75045]:       <source dev="/dev/sdd"/>
Nov 08 23:24:39 user nova-compute[75045]:       <target dev="vda" bus="virtio"/>
Nov 08 23:24:39 user nova-compute[75045]:       <serial>04d02c98-d058-49d8-a350-ab9e63003d6e</serial>
Nov 08 23:24:39 user nova-compute[75045]:     </disk>
Nov 08 23:24:39 user nova-compute[75045]:     <interface type="ethernet">
Nov 08 23:24:39 user nova-compute[75045]:       <mac address="fa:16:3e:80:07:f1"/>
Nov 08 23:24:39 user nova-compute[75045]:       <model type="virtio"/>
Nov 08 23:24:39 user nova-compute[75045]:       <mtu size="1442"/>
Nov 08 23:24:39 user nova-compute[75045]:       <target dev="tap0d5e497c-31"/>
Nov 08 23:24:39 user nova-compute[75045]:     </interface>
Nov 08 23:24:39 user nova-compute[75045]:     <serial type="pty">
Nov 08 23:24:39 user nova-compute[75045]:       <log file="/opt/stack/data/nova/instances/667d20c3-3eda-4aa5-b799-6dcee3443833/console.log" append="off"/>
Nov 08 23:24:39 user nova-compute[75045]:     </serial>
Nov 08 23:24:39 user nova-compute[75045]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 23:24:39 user nova-compute[75045]:     <video>
Nov 08 23:24:39 user nova-compute[75045]:       <model type="virtio"/>
Nov 08 23:24:39 user nova-compute[75045]:     </video>
Nov 08 23:24:39 user nova-compute[75045]:     <rng model="virtio">
Nov 08 23:24:39 user nova-compute[75045]:       <backend model="random">/dev/urandom</backend>
Nov 08 23:24:39 user nova-compute[75045]:     </rng>
Nov 08 23:24:39 user nova-compute[75045]:     <controller type="usb" index="0" model="none"/>
Nov 08 23:24:39 user nova-compute[75045]:     <memballoon model="virtio">
Nov 08 23:24:39 user nova-compute[75045]:       <stats period="10"/>
Nov 08 23:24:39 user nova-compute[75045]:     </memballoon>
Nov 08 23:24:39 user nova-compute[75045]:   </devices>
Nov 08 23:24:39 user nova-compute[75045]: </domain>
Nov 08 23:24:39 user nova-compute[75045]:  {{(pid=75045) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 23:24:39 user nova-compute[75045]: DEBUG nova.virt.libvirt.vif [None req-7b48f1e9-661b-4ec3-8c5a-1467cd11279c tempest-ServerActionsV293TestJSON-1645081958 tempest-ServerActionsV293TestJSON-1645081958-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T23:23:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-621912130',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-621912130',id=22,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBApsXoUUj600/jCowZP3//u29Ov5MwB7tYSt8EjtngLjlaZqqKZXWg1HuFDyt4rHiDuYq2TVJTqipV6mcSPV0LYib38MErT/yLzsrNv4x3AUTFC5kAU2nRDHPtRbpYSQ9w==',key_name='tempest-keypair-471552763',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='89744dd7de584b14880bc42dd96933af',ramdisk_id='',reservation_id='r-iwtkqj0a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-1645081958',owner_user_name='tempest-ServerActionsV293TestJSON-1645081958-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T23:23:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fc0a769ab72a476c9ac620728d67c5b6',uuid=667d20c3-3eda-4aa5-b799-6dcee3443833,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0d5e497c-3168-46b1-9094-9bb54737cc0f", "address": "fa:16:3e:80:07:f1", "network": {"id": "22898442-b87a-4538-a8f5-fe275919f44a", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-665667609-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "89744dd7de584b14880bc42dd96933af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d5e497c-31", "ovs_interfaceid": "0d5e497c-3168-46b1-9094-9bb54737cc0f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75045) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 23:24:39 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-7b48f1e9-661b-4ec3-8c5a-1467cd11279c tempest-ServerActionsV293TestJSON-1645081958 tempest-ServerActionsV293TestJSON-1645081958-project-member] Converting VIF {"id": "0d5e497c-3168-46b1-9094-9bb54737cc0f", "address": "fa:16:3e:80:07:f1", "network": {"id": "22898442-b87a-4538-a8f5-fe275919f44a", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-665667609-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "89744dd7de584b14880bc42dd96933af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d5e497c-31", "ovs_interfaceid": "0d5e497c-3168-46b1-9094-9bb54737cc0f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 23:24:39 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-7b48f1e9-661b-4ec3-8c5a-1467cd11279c tempest-ServerActionsV293TestJSON-1645081958 tempest-ServerActionsV293TestJSON-1645081958-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:80:07:f1,bridge_name='br-int',has_traffic_filtering=True,id=0d5e497c-3168-46b1-9094-9bb54737cc0f,network=Network(22898442-b87a-4538-a8f5-fe275919f44a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0d5e497c-31') {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 23:24:39 user nova-compute[75045]: DEBUG os_vif [None req-7b48f1e9-661b-4ec3-8c5a-1467cd11279c tempest-ServerActionsV293TestJSON-1645081958 tempest-ServerActionsV293TestJSON-1645081958-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:80:07:f1,bridge_name='br-int',has_traffic_filtering=True,id=0d5e497c-3168-46b1-9094-9bb54737cc0f,network=Network(22898442-b87a-4538-a8f5-fe275919f44a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0d5e497c-31') {{(pid=75045) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 23:24:39 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:24:39 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:24:39 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 23:24:39 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:24:39 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c7652d4b-7f5e-5129-bf9f-d9342d4511e8', '_type': 'linux-noop'}}, row=False) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:24:39 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:24:39 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 23:24:39 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:24:39 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0d5e497c-31, may_exist=True, interface_attrs={}) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:24:39 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0d5e497c-31, col_values=(('qos', UUID('b60f6265-8afe-4f46-8024-dee296c63755')),), if_exists=True) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:24:39 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0d5e497c-31, col_values=(('external_ids', {'iface-id': '0d5e497c-3168-46b1-9094-9bb54737cc0f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:80:07:f1', 'vm-uuid': '667d20c3-3eda-4aa5-b799-6dcee3443833'}),), if_exists=True) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:24:39 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:24:39 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 23:24:39 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:24:39 user nova-compute[75045]: INFO os_vif [None req-7b48f1e9-661b-4ec3-8c5a-1467cd11279c tempest-ServerActionsV293TestJSON-1645081958 tempest-ServerActionsV293TestJSON-1645081958-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:80:07:f1,bridge_name='br-int',has_traffic_filtering=True,id=0d5e497c-3168-46b1-9094-9bb54737cc0f,network=Network(22898442-b87a-4538-a8f5-fe275919f44a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0d5e497c-31')
Nov 08 23:24:39 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-7b48f1e9-661b-4ec3-8c5a-1467cd11279c tempest-ServerActionsV293TestJSON-1645081958 tempest-ServerActionsV293TestJSON-1645081958-project-member] No BDM found with device name vda, not building metadata. {{(pid=75045) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 23:24:39 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-7b48f1e9-661b-4ec3-8c5a-1467cd11279c tempest-ServerActionsV293TestJSON-1645081958 tempest-ServerActionsV293TestJSON-1645081958-project-member] No VIF found with MAC fa:16:3e:80:07:f1, not building metadata {{(pid=75045) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 23:24:41 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:24:41 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:24:41 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:24:41 user nova-compute[75045]: DEBUG nova.compute.manager [req-2cbc2bc6-5d83-4c72-86be-45cccdf8b231 req-8a842a4b-1b9e-40a6-89c8-2ce4673eaaff service nova] [instance: 667d20c3-3eda-4aa5-b799-6dcee3443833] Received event network-vif-plugged-0d5e497c-3168-46b1-9094-9bb54737cc0f {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:24:41 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-2cbc2bc6-5d83-4c72-86be-45cccdf8b231 req-8a842a4b-1b9e-40a6-89c8-2ce4673eaaff service nova] Acquiring lock "667d20c3-3eda-4aa5-b799-6dcee3443833-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:24:41 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-2cbc2bc6-5d83-4c72-86be-45cccdf8b231 req-8a842a4b-1b9e-40a6-89c8-2ce4673eaaff service nova] Lock "667d20c3-3eda-4aa5-b799-6dcee3443833-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:24:41 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-2cbc2bc6-5d83-4c72-86be-45cccdf8b231 req-8a842a4b-1b9e-40a6-89c8-2ce4673eaaff service nova] Lock "667d20c3-3eda-4aa5-b799-6dcee3443833-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:24:41 user nova-compute[75045]: DEBUG nova.compute.manager [req-2cbc2bc6-5d83-4c72-86be-45cccdf8b231 req-8a842a4b-1b9e-40a6-89c8-2ce4673eaaff service nova] [instance: 667d20c3-3eda-4aa5-b799-6dcee3443833] No waiting events found dispatching network-vif-plugged-0d5e497c-3168-46b1-9094-9bb54737cc0f {{(pid=75045) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 23:24:41 user nova-compute[75045]: WARNING nova.compute.manager [req-2cbc2bc6-5d83-4c72-86be-45cccdf8b231 req-8a842a4b-1b9e-40a6-89c8-2ce4673eaaff service nova] [instance: 667d20c3-3eda-4aa5-b799-6dcee3443833] Received unexpected event network-vif-plugged-0d5e497c-3168-46b1-9094-9bb54737cc0f for instance with vm_state building and task_state spawning.
Nov 08 23:24:41 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:24:41 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:24:41 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:24:43 user nova-compute[75045]: DEBUG nova.compute.manager [None req-7b48f1e9-661b-4ec3-8c5a-1467cd11279c tempest-ServerActionsV293TestJSON-1645081958 tempest-ServerActionsV293TestJSON-1645081958-project-member] [instance: 667d20c3-3eda-4aa5-b799-6dcee3443833] Instance event wait completed in 0 seconds for  {{(pid=75045) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 23:24:43 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-7b48f1e9-661b-4ec3-8c5a-1467cd11279c tempest-ServerActionsV293TestJSON-1645081958 tempest-ServerActionsV293TestJSON-1645081958-project-member] [instance: 667d20c3-3eda-4aa5-b799-6dcee3443833] Guest created on hypervisor {{(pid=75045) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 23:24:43 user nova-compute[75045]: INFO nova.virt.libvirt.driver [-] [instance: 667d20c3-3eda-4aa5-b799-6dcee3443833] Instance spawned successfully.
Nov 08 23:24:43 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-7b48f1e9-661b-4ec3-8c5a-1467cd11279c tempest-ServerActionsV293TestJSON-1645081958 tempest-ServerActionsV293TestJSON-1645081958-project-member] [instance: 667d20c3-3eda-4aa5-b799-6dcee3443833] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75045) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 23:24:43 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-7b48f1e9-661b-4ec3-8c5a-1467cd11279c tempest-ServerActionsV293TestJSON-1645081958 tempest-ServerActionsV293TestJSON-1645081958-project-member] [instance: 667d20c3-3eda-4aa5-b799-6dcee3443833] Found default for hw_cdrom_bus of ide {{(pid=75045) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 23:24:43 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-7b48f1e9-661b-4ec3-8c5a-1467cd11279c tempest-ServerActionsV293TestJSON-1645081958 tempest-ServerActionsV293TestJSON-1645081958-project-member] [instance: 667d20c3-3eda-4aa5-b799-6dcee3443833] Found default for hw_disk_bus of virtio {{(pid=75045) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 23:24:43 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-7b48f1e9-661b-4ec3-8c5a-1467cd11279c tempest-ServerActionsV293TestJSON-1645081958 tempest-ServerActionsV293TestJSON-1645081958-project-member] [instance: 667d20c3-3eda-4aa5-b799-6dcee3443833] Found default for hw_input_bus of None {{(pid=75045) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 23:24:43 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-7b48f1e9-661b-4ec3-8c5a-1467cd11279c tempest-ServerActionsV293TestJSON-1645081958 tempest-ServerActionsV293TestJSON-1645081958-project-member] [instance: 667d20c3-3eda-4aa5-b799-6dcee3443833] Found default for hw_pointer_model of None {{(pid=75045) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 23:24:43 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-7b48f1e9-661b-4ec3-8c5a-1467cd11279c tempest-ServerActionsV293TestJSON-1645081958 tempest-ServerActionsV293TestJSON-1645081958-project-member] [instance: 667d20c3-3eda-4aa5-b799-6dcee3443833] Found default for hw_video_model of virtio {{(pid=75045) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 23:24:43 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-7b48f1e9-661b-4ec3-8c5a-1467cd11279c tempest-ServerActionsV293TestJSON-1645081958 tempest-ServerActionsV293TestJSON-1645081958-project-member] [instance: 667d20c3-3eda-4aa5-b799-6dcee3443833] Found default for hw_vif_model of virtio {{(pid=75045) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 23:24:43 user nova-compute[75045]: DEBUG nova.compute.manager [req-28251799-4c85-4378-9116-048aad25e835 req-dc3a4f59-5a39-46aa-a56c-72fb03514718 service nova] [instance: 667d20c3-3eda-4aa5-b799-6dcee3443833] Received event network-vif-plugged-0d5e497c-3168-46b1-9094-9bb54737cc0f {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:24:43 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-28251799-4c85-4378-9116-048aad25e835 req-dc3a4f59-5a39-46aa-a56c-72fb03514718 service nova] Acquiring lock "667d20c3-3eda-4aa5-b799-6dcee3443833-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:24:43 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-28251799-4c85-4378-9116-048aad25e835 req-dc3a4f59-5a39-46aa-a56c-72fb03514718 service nova] Lock "667d20c3-3eda-4aa5-b799-6dcee3443833-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:24:43 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-28251799-4c85-4378-9116-048aad25e835 req-dc3a4f59-5a39-46aa-a56c-72fb03514718 service nova] Lock "667d20c3-3eda-4aa5-b799-6dcee3443833-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:24:43 user nova-compute[75045]: DEBUG nova.compute.manager [req-28251799-4c85-4378-9116-048aad25e835 req-dc3a4f59-5a39-46aa-a56c-72fb03514718 service nova] [instance: 667d20c3-3eda-4aa5-b799-6dcee3443833] No waiting events found dispatching network-vif-plugged-0d5e497c-3168-46b1-9094-9bb54737cc0f {{(pid=75045) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 23:24:43 user nova-compute[75045]: WARNING nova.compute.manager [req-28251799-4c85-4378-9116-048aad25e835 req-dc3a4f59-5a39-46aa-a56c-72fb03514718 service nova] [instance: 667d20c3-3eda-4aa5-b799-6dcee3443833] Received unexpected event network-vif-plugged-0d5e497c-3168-46b1-9094-9bb54737cc0f for instance with vm_state building and task_state spawning.
Nov 08 23:24:43 user nova-compute[75045]: INFO nova.compute.manager [None req-7b48f1e9-661b-4ec3-8c5a-1467cd11279c tempest-ServerActionsV293TestJSON-1645081958 tempest-ServerActionsV293TestJSON-1645081958-project-member] [instance: 667d20c3-3eda-4aa5-b799-6dcee3443833] Took 5.61 seconds to spawn the instance on the hypervisor.
Nov 08 23:24:43 user nova-compute[75045]: DEBUG nova.compute.manager [None req-7b48f1e9-661b-4ec3-8c5a-1467cd11279c tempest-ServerActionsV293TestJSON-1645081958 tempest-ServerActionsV293TestJSON-1645081958-project-member] [instance: 667d20c3-3eda-4aa5-b799-6dcee3443833] Checking state {{(pid=75045) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 23:24:43 user nova-compute[75045]: INFO nova.compute.manager [None req-7b48f1e9-661b-4ec3-8c5a-1467cd11279c tempest-ServerActionsV293TestJSON-1645081958 tempest-ServerActionsV293TestJSON-1645081958-project-member] [instance: 667d20c3-3eda-4aa5-b799-6dcee3443833] Took 45.42 seconds to build instance.
Nov 08 23:24:43 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-7b48f1e9-661b-4ec3-8c5a-1467cd11279c tempest-ServerActionsV293TestJSON-1645081958 tempest-ServerActionsV293TestJSON-1645081958-project-member] Lock "667d20c3-3eda-4aa5-b799-6dcee3443833" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 45.534s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:24:44 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:24:45 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:24:46 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:24:47 user nova-compute[75045]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8a730ee5-f350-4317-8d25-c458e9bcec16 tempest-TestServerVolumeAttachmentScenario-1899063447 tempest-TestServerVolumeAttachmentScenario-1899063447-project-member] [instance: 25cd59d1-6884-471a-813e-52e97c2e1208] Calling os-brick to attach iSCSI Volume {{(pid=75045) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 23:24:47 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a730ee5-f350-4317-8d25-c458e9bcec16 tempest-TestServerVolumeAttachmentScenario-1899063447 tempest-TestServerVolumeAttachmentScenario-1899063447-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1b68210460>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9c37da13-9531-458a-87cb-1e86e6b84f3a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aWFTIYZz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75045) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 23:24:47 user nova-compute[75045]: WARNING os_brick.initiator.connectors.base [None req-8a730ee5-f350-4317-8d25-c458e9bcec16 tempest-TestServerVolumeAttachmentScenario-1899063447 tempest-TestServerVolumeAttachmentScenario-1899063447-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 23:24:47 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-8a730ee5-f350-4317-8d25-c458e9bcec16 tempest-TestServerVolumeAttachmentScenario-1899063447 tempest-TestServerVolumeAttachmentScenario-1899063447-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 23:24:47 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-8a730ee5-f350-4317-8d25-c458e9bcec16 tempest-TestServerVolumeAttachmentScenario-1899063447 tempest-TestServerVolumeAttachmentScenario-1899063447-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 23:24:47 user nova-compute[75045]: WARNING os_brick.initiator.connectors.base [None req-8a730ee5-f350-4317-8d25-c458e9bcec16 tempest-TestServerVolumeAttachmentScenario-1899063447 tempest-TestServerVolumeAttachmentScenario-1899063447-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 23:24:47 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-8a730ee5-f350-4317-8d25-c458e9bcec16 tempest-TestServerVolumeAttachmentScenario-1899063447 tempest-TestServerVolumeAttachmentScenario-1899063447-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9c37da13-9531-458a-87cb-1e86e6b84f3a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 23:24:47 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-8a730ee5-f350-4317-8d25-c458e9bcec16 tempest-TestServerVolumeAttachmentScenario-1899063447 tempest-TestServerVolumeAttachmentScenario-1899063447-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9c37da13-9531-458a-87cb-1e86e6b84f3a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 23:24:47 user nova-compute[75045]: INFO os_brick.initiator.connectors.iscsi [None req-8a730ee5-f350-4317-8d25-c458e9bcec16 tempest-TestServerVolumeAttachmentScenario-1899063447 tempest-TestServerVolumeAttachmentScenario-1899063447-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 23:24:47 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c37da13-9531-458a-87cb-1e86e6b84f3a -p 172.16.0.220:3260 {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:24:47 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c37da13-9531-458a-87cb-1e86e6b84f3a -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:24:47 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[f65ac292-4bd8-4e74-bfa6-b3e317dbbd67]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:24:47 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a730ee5-f350-4317-8d25-c458e9bcec16 tempest-TestServerVolumeAttachmentScenario-1899063447 tempest-TestServerVolumeAttachmentScenario-1899063447-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 23:24:47 user nova-compute[75045]:  {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:24:47 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c37da13-9531-458a-87cb-1e86e6b84f3a -p 172.16.0.220:3260 --interface default --op new {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:24:47 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c37da13-9531-458a-87cb-1e86e6b84f3a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:24:47 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f85e911-c3cc-4cca-8f29-4974033d0de0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9c37da13-9531-458a-87cb-1e86e6b84f3a] added\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:24:47 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a730ee5-f350-4317-8d25-c458e9bcec16 tempest-TestServerVolumeAttachmentScenario-1899063447 tempest-TestServerVolumeAttachmentScenario-1899063447-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9c37da13-9531-458a-87cb-1e86e6b84f3a] added
Nov 08 23:24:47 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:24:47 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c37da13-9531-458a-87cb-1e86e6b84f3a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:24:47 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c37da13-9531-458a-87cb-1e86e6b84f3a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:24:47 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[43b9c504-889e-4123-993f-d782418af32c]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:24:47 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a730ee5-f350-4317-8d25-c458e9bcec16 tempest-TestServerVolumeAttachmentScenario-1899063447 tempest-TestServerVolumeAttachmentScenario-1899063447-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:24:47 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c37da13-9531-458a-87cb-1e86e6b84f3a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:24:47 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c37da13-9531-458a-87cb-1e86e6b84f3a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:24:47 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[e38fed0c-a47e-4a95-a94d-96ec0a05adb4]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:24:47 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a730ee5-f350-4317-8d25-c458e9bcec16 tempest-TestServerVolumeAttachmentScenario-1899063447 tempest-TestServerVolumeAttachmentScenario-1899063447-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:24:47 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c37da13-9531-458a-87cb-1e86e6b84f3a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v aWFTIYZz {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:24:47 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c37da13-9531-458a-87cb-1e86e6b84f3a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v aWFTIYZz" returned: 0 in 0.025s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:24:47 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7902aa2-70e2-49ca-9d79-99e97229e675]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:24:47 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a730ee5-f350-4317-8d25-c458e9bcec16 tempest-TestServerVolumeAttachmentScenario-1899063447 tempest-TestServerVolumeAttachmentScenario-1899063447-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'aWFTIYZz'): stdout= stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:24:47 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c37da13-9531-458a-87cb-1e86e6b84f3a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:24:47 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c37da13-9531-458a-87cb-1e86e6b84f3a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:24:47 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[11d59a90-8f17-48f5-b864-56898e91e336]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:24:47 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a730ee5-f350-4317-8d25-c458e9bcec16 tempest-TestServerVolumeAttachmentScenario-1899063447 tempest-TestServerVolumeAttachmentScenario-1899063447-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:24:47 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:24:47 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:24:47 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcb65b3c-fefd-4352-9ecb-4b776c1cd865]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45f1b635-c8a3-4727-a4c7-c2ac441388ff (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd1b2206-989e-409d-84c6-49b37ac252d8 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04d02c98-d058-49d8-a350-ab9e63003d6e (non-flash)\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:24:47 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a730ee5-f350-4317-8d25-c458e9bcec16 tempest-TestServerVolumeAttachmentScenario-1899063447 tempest-TestServerVolumeAttachmentScenario-1899063447-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab (non-flash)
Nov 08 23:24:47 user nova-compute[75045]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45f1b635-c8a3-4727-a4c7-c2ac441388ff (non-flash)
Nov 08 23:24:47 user nova-compute[75045]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd1b2206-989e-409d-84c6-49b37ac252d8 (non-flash)
Nov 08 23:24:47 user nova-compute[75045]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04d02c98-d058-49d8-a350-ab9e63003d6e (non-flash)
Nov 08 23:24:47 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 23:24:47 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a730ee5-f350-4317-8d25-c458e9bcec16 tempest-TestServerVolumeAttachmentScenario-1899063447 tempest-TestServerVolumeAttachmentScenario-1899063447-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab (non-flash)
Nov 08 23:24:47 user nova-compute[75045]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45f1b635-c8a3-4727-a4c7-c2ac441388ff (non-flash)
Nov 08 23:24:47 user nova-compute[75045]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd1b2206-989e-409d-84c6-49b37ac252d8 (non-flash)
Nov 08 23:24:47 user nova-compute[75045]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04d02c98-d058-49d8-a350-ab9e63003d6e (non-flash)
Nov 08 23:24:47 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 23:24:47 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c37da13-9531-458a-87cb-1e86e6b84f3a -p 172.16.0.220:3260 --login {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:24:47 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c37da13-9531-458a-87cb-1e86e6b84f3a -p 172.16.0.220:3260 --login" returned: 0 in 0.077s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:24:47 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[3584da52-2260-4212-bca5-9be0df8a8ba5]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9c37da13-9531-458a-87cb-1e86e6b84f3a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9c37da13-9531-458a-87cb-1e86e6b84f3a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:24:47 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a730ee5-f350-4317-8d25-c458e9bcec16 tempest-TestServerVolumeAttachmentScenario-1899063447 tempest-TestServerVolumeAttachmentScenario-1899063447-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9c37da13-9531-458a-87cb-1e86e6b84f3a, portal: 172.16.0.220,3260]
Nov 08 23:24:47 user nova-compute[75045]: Login to [iface: default, target: iqn.2010-10.org.openstack:9c37da13-9531-458a-87cb-1e86e6b84f3a, portal: 172.16.0.220,3260] successful.
Nov 08 23:24:47 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:24:47 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c37da13-9531-458a-87cb-1e86e6b84f3a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:24:47 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c37da13-9531-458a-87cb-1e86e6b84f3a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.029s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:24:47 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[36736cf6-cb8e-4f5f-9e77-fa37043f9b4f]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:24:47 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a730ee5-f350-4317-8d25-c458e9bcec16 tempest-TestServerVolumeAttachmentScenario-1899063447 tempest-TestServerVolumeAttachmentScenario-1899063447-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:24:47 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:24:47 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:24:47 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c121b20-8051-46de-921f-e4a3092b303e]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45f1b635-c8a3-4727-a4c7-c2ac441388ff (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd1b2206-989e-409d-84c6-49b37ac252d8 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04d02c98-d058-49d8-a350-ab9e63003d6e (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c37da13-9531-458a-87cb-1e86e6b84f3a (non-flash)\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:24:47 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a730ee5-f350-4317-8d25-c458e9bcec16 tempest-TestServerVolumeAttachmentScenario-1899063447 tempest-TestServerVolumeAttachmentScenario-1899063447-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab (non-flash)
Nov 08 23:24:47 user nova-compute[75045]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45f1b635-c8a3-4727-a4c7-c2ac441388ff (non-flash)
Nov 08 23:24:47 user nova-compute[75045]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd1b2206-989e-409d-84c6-49b37ac252d8 (non-flash)
Nov 08 23:24:47 user nova-compute[75045]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04d02c98-d058-49d8-a350-ab9e63003d6e (non-flash)
Nov 08 23:24:47 user nova-compute[75045]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c37da13-9531-458a-87cb-1e86e6b84f3a (non-flash)
Nov 08 23:24:47 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 23:24:47 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a730ee5-f350-4317-8d25-c458e9bcec16 tempest-TestServerVolumeAttachmentScenario-1899063447 tempest-TestServerVolumeAttachmentScenario-1899063447-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab (non-flash)
Nov 08 23:24:47 user nova-compute[75045]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45f1b635-c8a3-4727-a4c7-c2ac441388ff (non-flash)
Nov 08 23:24:47 user nova-compute[75045]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd1b2206-989e-409d-84c6-49b37ac252d8 (non-flash)
Nov 08 23:24:47 user nova-compute[75045]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04d02c98-d058-49d8-a350-ab9e63003d6e (non-flash)
Nov 08 23:24:47 user nova-compute[75045]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c37da13-9531-458a-87cb-1e86e6b84f3a (non-flash)
Nov 08 23:24:47 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 23:24:47 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-8a730ee5-f350-4317-8d25-c458e9bcec16 tempest-TestServerVolumeAttachmentScenario-1899063447 tempest-TestServerVolumeAttachmentScenario-1899063447-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9c37da13-9531-458a-87cb-1e86e6b84f3a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.351s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 23:24:47 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a730ee5-f350-4317-8d25-c458e9bcec16 tempest-TestServerVolumeAttachmentScenario-1899063447 tempest-TestServerVolumeAttachmentScenario-1899063447-project-member] Connected to 172.16.0.220:3260 {{(pid=75045) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 23:24:47 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-8a730ee5-f350-4317-8d25-c458e9bcec16 tempest-TestServerVolumeAttachmentScenario-1899063447 tempest-TestServerVolumeAttachmentScenario-1899063447-project-member] HCTL ('36', '-', '-', 0) found on session 19 with lun 0 {{(pid=75045) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 23:24:47 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-8a730ee5-f350-4317-8d25-c458e9bcec16 tempest-TestServerVolumeAttachmentScenario-1899063447 tempest-TestServerVolumeAttachmentScenario-1899063447-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75045) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 23:24:47 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:24:47 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.019s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:24:47 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[98e8e74e-8be2-43b1-a318-4bba352f4c1c]: (4, ('- - 0', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:24:47 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-8a730ee5-f350-4317-8d25-c458e9bcec16 tempest-TestServerVolumeAttachmentScenario-1899063447 tempest-TestServerVolumeAttachmentScenario-1899063447-project-member] Searching for a device in session 19 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75045) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 23:24:47 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a730ee5-f350-4317-8d25-c458e9bcec16 tempest-TestServerVolumeAttachmentScenario-1899063447 tempest-TestServerVolumeAttachmentScenario-1899063447-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:9c37da13-9531-458a-87cb-1e86e6b84f3a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aWFTIYZz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75045) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 23:24:48 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-8a730ee5-f350-4317-8d25-c458e9bcec16 tempest-TestServerVolumeAttachmentScenario-1899063447 tempest-TestServerVolumeAttachmentScenario-1899063447-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.396s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 23:24:48 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a730ee5-f350-4317-8d25-c458e9bcec16 tempest-TestServerVolumeAttachmentScenario-1899063447 tempest-TestServerVolumeAttachmentScenario-1899063447-project-member] <== connect_volume: return (1399ms) {'type': 'block', 'scsi_wwn': '23065323331646432', 'path': '/dev/sde'} {{(pid=75045) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 23:24:48 user nova-compute[75045]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8a730ee5-f350-4317-8d25-c458e9bcec16 tempest-TestServerVolumeAttachmentScenario-1899063447 tempest-TestServerVolumeAttachmentScenario-1899063447-project-member] [instance: 25cd59d1-6884-471a-813e-52e97c2e1208] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23065323331646432', 'path': '/dev/sde'} {{(pid=75045) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 23:24:48 user nova-compute[75045]: DEBUG nova.objects.instance [None req-8a730ee5-f350-4317-8d25-c458e9bcec16 tempest-TestServerVolumeAttachmentScenario-1899063447 tempest-TestServerVolumeAttachmentScenario-1899063447-project-member] Lazy-loading 'flavor' on Instance uuid 25cd59d1-6884-471a-813e-52e97c2e1208 {{(pid=75045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 23:24:48 user nova-compute[75045]: DEBUG nova.virt.libvirt.guest [None req-8a730ee5-f350-4317-8d25-c458e9bcec16 tempest-TestServerVolumeAttachmentScenario-1899063447 tempest-TestServerVolumeAttachmentScenario-1899063447-project-member] attach device xml: <disk type="block" device="disk">
Nov 08 23:24:48 user nova-compute[75045]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 23:24:48 user nova-compute[75045]:   <source dev="/dev/sde"/>
Nov 08 23:24:48 user nova-compute[75045]:   <target dev="vdb" bus="virtio"/>
Nov 08 23:24:48 user nova-compute[75045]:   <serial>9c37da13-9531-458a-87cb-1e86e6b84f3a</serial>
Nov 08 23:24:48 user nova-compute[75045]: </disk>
Nov 08 23:24:48 user nova-compute[75045]:  {{(pid=75045) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 08 23:24:49 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-8a730ee5-f350-4317-8d25-c458e9bcec16 tempest-TestServerVolumeAttachmentScenario-1899063447 tempest-TestServerVolumeAttachmentScenario-1899063447-project-member] No BDM found with device name vda, not building metadata. {{(pid=75045) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 23:24:49 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-8a730ee5-f350-4317-8d25-c458e9bcec16 tempest-TestServerVolumeAttachmentScenario-1899063447 tempest-TestServerVolumeAttachmentScenario-1899063447-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75045) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 23:24:49 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-8a730ee5-f350-4317-8d25-c458e9bcec16 tempest-TestServerVolumeAttachmentScenario-1899063447 tempest-TestServerVolumeAttachmentScenario-1899063447-project-member] No VIF found with MAC fa:16:3e:bd:cb:ae, not building metadata {{(pid=75045) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 23:24:49 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-8a730ee5-f350-4317-8d25-c458e9bcec16 tempest-TestServerVolumeAttachmentScenario-1899063447 tempest-TestServerVolumeAttachmentScenario-1899063447-project-member] Lock "25cd59d1-6884-471a-813e-52e97c2e1208" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 30.421s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:24:49 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:24:49 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:24:49 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:24:49 user nova-compute[75045]: DEBUG nova.compute.manager [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Starting heal instance info cache {{(pid=75045) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 23:24:49 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Acquiring lock "refresh_cache-0f21fcd3-ac5f-499e-9c34-82af806fda1d" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 23:24:49 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Acquired lock "refresh_cache-0f21fcd3-ac5f-499e-9c34-82af806fda1d" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 23:24:49 user nova-compute[75045]: DEBUG nova.network.neutron [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] [instance: 0f21fcd3-ac5f-499e-9c34-82af806fda1d] Forcefully refreshing network info cache for instance {{(pid=75045) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 23:24:50 user nova-compute[75045]: DEBUG nova.network.neutron [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] [instance: 0f21fcd3-ac5f-499e-9c34-82af806fda1d] Updating instance_info_cache with network_info: [{"id": "ab02704d-73c2-409c-9d43-1a087ebf369a", "address": "fa:16:3e:b3:b2:47", "network": {"id": "700b5784-d35b-45c0-a4d3-1ab8aa4c48aa", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-194469807-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.175", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e63623113f11463d9035bb990de43510", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab02704d-73", "ovs_interfaceid": "ab02704d-73c2-409c-9d43-1a087ebf369a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75045) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 23:24:50 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Releasing lock "refresh_cache-0f21fcd3-ac5f-499e-9c34-82af806fda1d" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 23:24:50 user nova-compute[75045]: DEBUG nova.compute.manager [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] [instance: 0f21fcd3-ac5f-499e-9c34-82af806fda1d] Updated the network info_cache for instance {{(pid=75045) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 23:24:50 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:24:50 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:24:50 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:24:50 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:24:50 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:24:50 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:24:50 user nova-compute[75045]: DEBUG nova.compute.manager [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75045) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 23:24:50 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager.update_available_resource {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:24:50 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:24:50 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:24:50 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:24:50 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Auditing locally available compute resources for user (node: user) {{(pid=75045) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 23:24:51 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:24:51 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75045) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 23:24:51 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ae5ff6b-6f2c-4dfd-a4c6-da4809e2cf27/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:24:51 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ae5ff6b-6f2c-4dfd-a4c6-da4809e2cf27/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:24:51 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ae5ff6b-6f2c-4dfd-a4c6-da4809e2cf27/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:24:51 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ae5ff6b-6f2c-4dfd-a4c6-da4809e2cf27/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:24:51 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] skipping disk /dev/sdh (vda) as it is a volume {{(pid=75045) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 23:24:51 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/032e20aa-8887-4215-808e-68299a0d8d0b/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:24:51 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/032e20aa-8887-4215-808e-68299a0d8d0b/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:24:51 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/032e20aa-8887-4215-808e-68299a0d8d0b/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:24:51 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:24:51 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/032e20aa-8887-4215-808e-68299a0d8d0b/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:24:51 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75045) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 23:24:51 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f21fcd3-ac5f-499e-9c34-82af806fda1d/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:24:52 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f21fcd3-ac5f-499e-9c34-82af806fda1d/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:24:52 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f21fcd3-ac5f-499e-9c34-82af806fda1d/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:24:52 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f21fcd3-ac5f-499e-9c34-82af806fda1d/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:24:52 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ee70847-10de-49b6-9731-6d65b06532c8/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:24:52 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ee70847-10de-49b6-9731-6d65b06532c8/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:24:52 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ee70847-10de-49b6-9731-6d65b06532c8/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:24:52 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ee70847-10de-49b6-9731-6d65b06532c8/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:24:52 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83d225e0-e39e-4500-b7ae-52dfbd8b8588/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:24:52 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-60ff8c3d-8198-436e-bbc1-77adec44e5d5 tempest-TestServerVolumeAttachmentScenario-1899063447 tempest-TestServerVolumeAttachmentScenario-1899063447-project-member] Acquiring lock "25cd59d1-6884-471a-813e-52e97c2e1208" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:24:52 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-60ff8c3d-8198-436e-bbc1-77adec44e5d5 tempest-TestServerVolumeAttachmentScenario-1899063447 tempest-TestServerVolumeAttachmentScenario-1899063447-project-member] Lock "25cd59d1-6884-471a-813e-52e97c2e1208" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.003s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:24:52 user nova-compute[75045]: DEBUG nova.objects.instance [None req-60ff8c3d-8198-436e-bbc1-77adec44e5d5 tempest-TestServerVolumeAttachmentScenario-1899063447 tempest-TestServerVolumeAttachmentScenario-1899063447-project-member] Lazy-loading 'flavor' on Instance uuid 25cd59d1-6884-471a-813e-52e97c2e1208 {{(pid=75045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 23:24:52 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-60ff8c3d-8198-436e-bbc1-77adec44e5d5 tempest-TestServerVolumeAttachmentScenario-1899063447 tempest-TestServerVolumeAttachmentScenario-1899063447-project-member] Lock "25cd59d1-6884-471a-813e-52e97c2e1208" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.065s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:24:53 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83d225e0-e39e-4500-b7ae-52dfbd8b8588/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:24:53 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83d225e0-e39e-4500-b7ae-52dfbd8b8588/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:24:53 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-60ff8c3d-8198-436e-bbc1-77adec44e5d5 tempest-TestServerVolumeAttachmentScenario-1899063447 tempest-TestServerVolumeAttachmentScenario-1899063447-project-member] Acquiring lock "25cd59d1-6884-471a-813e-52e97c2e1208" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:24:53 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-60ff8c3d-8198-436e-bbc1-77adec44e5d5 tempest-TestServerVolumeAttachmentScenario-1899063447 tempest-TestServerVolumeAttachmentScenario-1899063447-project-member] Lock "25cd59d1-6884-471a-813e-52e97c2e1208" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:24:53 user nova-compute[75045]: INFO nova.compute.manager [None req-60ff8c3d-8198-436e-bbc1-77adec44e5d5 tempest-TestServerVolumeAttachmentScenario-1899063447 tempest-TestServerVolumeAttachmentScenario-1899063447-project-member] [instance: 25cd59d1-6884-471a-813e-52e97c2e1208] Attaching volume 0a781e02-49d7-49fb-a2ca-b4c985ab9a23 to /dev/vdc
Nov 08 23:24:53 user nova-compute[75045]: DEBUG os_brick.utils [None req-60ff8c3d-8198-436e-bbc1-77adec44e5d5 tempest-TestServerVolumeAttachmentScenario-1899063447 tempest-TestServerVolumeAttachmentScenario-1899063447-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75045) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 23:24:53 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:24:53 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83d225e0-e39e-4500-b7ae-52dfbd8b8588/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:24:53 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43f31110-89ec-4b20-9842-7c9dd7df0e14/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:24:53 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:24:53 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[0474bfcc-f4c5-462f-9093-e8f81e9f0383]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6217bd6e884\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:24:53 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:24:53 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:24:53 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb5794ac-8e37-49a7-9d98-88c944b6d39e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:24:53 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:24:53 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:24:53 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d372385-171c-4de4-aa88-2ccaaac15440]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:24:53 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[61225d9e-a1a1-4caa-b7e6-50c19ea9becd]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:24:53 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-60ff8c3d-8198-436e-bbc1-77adec44e5d5 tempest-TestServerVolumeAttachmentScenario-1899063447 tempest-TestServerVolumeAttachmentScenario-1899063447-project-member] Running cmd (subprocess): nvme version {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:24:53 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-60ff8c3d-8198-436e-bbc1-77adec44e5d5 tempest-TestServerVolumeAttachmentScenario-1899063447 tempest-TestServerVolumeAttachmentScenario-1899063447-project-member] 'nvme version' failed. Not Retrying. {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 23:24:53 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.nvmeof [None req-60ff8c3d-8198-436e-bbc1-77adec44e5d5 tempest-TestServerVolumeAttachmentScenario-1899063447 tempest-TestServerVolumeAttachmentScenario-1899063447-project-member] nvme not present on system {{(pid=75045) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 23:24:53 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:24:53 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 23:24:53 user nova-compute[75045]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 23:24:53 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b9a4e15-7fc2-4416-81d0-48446c9e7ef7]: (4, '') {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:24:53 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.lightos [None req-60ff8c3d-8198-436e-bbc1-77adec44e5d5 tempest-TestServerVolumeAttachmentScenario-1899063447 tempest-TestServerVolumeAttachmentScenario-1899063447-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75045) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 23:24:53 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.lightos [None req-60ff8c3d-8198-436e-bbc1-77adec44e5d5 tempest-TestServerVolumeAttachmentScenario-1899063447 tempest-TestServerVolumeAttachmentScenario-1899063447-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75045) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 23:24:53 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.lightos [None req-60ff8c3d-8198-436e-bbc1-77adec44e5d5 tempest-TestServerVolumeAttachmentScenario-1899063447 tempest-TestServerVolumeAttachmentScenario-1899063447-project-member] LIGHTOS: no hostnqn found. {{(pid=75045) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 23:24:53 user nova-compute[75045]: DEBUG os_brick.utils [None req-60ff8c3d-8198-436e-bbc1-77adec44e5d5 tempest-TestServerVolumeAttachmentScenario-1899063447 tempest-TestServerVolumeAttachmentScenario-1899063447-project-member] <== get_connector_properties: return (186ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6217bd6e884', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75045) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 23:24:53 user nova-compute[75045]: DEBUG nova.virt.block_device [None req-60ff8c3d-8198-436e-bbc1-77adec44e5d5 tempest-TestServerVolumeAttachmentScenario-1899063447 tempest-TestServerVolumeAttachmentScenario-1899063447-project-member] [instance: 25cd59d1-6884-471a-813e-52e97c2e1208] Updating existing volume attachment record: 884b7ee9-00aa-4d1c-bb13-63834fcdb8b9 {{(pid=75045) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 23:24:53 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43f31110-89ec-4b20-9842-7c9dd7df0e14/disk --force-share --output=json" returned: 0 in 0.233s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:24:53 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43f31110-89ec-4b20-9842-7c9dd7df0e14/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:24:53 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43f31110-89ec-4b20-9842-7c9dd7df0e14/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:24:53 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75045) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 23:24:53 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25cd59d1-6884-471a-813e-52e97c2e1208/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:24:53 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:24:53 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25cd59d1-6884-471a-813e-52e97c2e1208/disk --force-share --output=json" returned: 0 in 0.249s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:24:53 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25cd59d1-6884-471a-813e-52e97c2e1208/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:24:54 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25cd59d1-6884-471a-813e-52e97c2e1208/disk --force-share --output=json" returned: 0 in 0.236s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:24:54 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=75045) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 23:24:54 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5fc7f02-2143-4bcf-92ac-078d5ec10747/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:24:54 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5fc7f02-2143-4bcf-92ac-078d5ec10747/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:24:54 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5fc7f02-2143-4bcf-92ac-078d5ec10747/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:24:54 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5fc7f02-2143-4bcf-92ac-078d5ec10747/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:24:54 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b84f2b1-01a3-4789-bcef-8b7c4334132b/disk.rescue --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:24:54 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:24:54 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b84f2b1-01a3-4789-bcef-8b7c4334132b/disk.rescue --force-share --output=json" returned: 0 in 0.259s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:24:54 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b84f2b1-01a3-4789-bcef-8b7c4334132b/disk.rescue --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:24:55 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b84f2b1-01a3-4789-bcef-8b7c4334132b/disk.rescue --force-share --output=json" returned: 0 in 0.239s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:24:55 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b84f2b1-01a3-4789-bcef-8b7c4334132b/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:24:55 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b84f2b1-01a3-4789-bcef-8b7c4334132b/disk --force-share --output=json" returned: 0 in 0.326s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:24:55 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b84f2b1-01a3-4789-bcef-8b7c4334132b/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:24:55 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b84f2b1-01a3-4789-bcef-8b7c4334132b/disk --force-share --output=json" returned: 0 in 0.277s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:24:56 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:24:56 user nova-compute[75045]: WARNING nova.virt.libvirt.driver [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 23:24:56 user nova-compute[75045]: WARNING nova.virt.libvirt.driver [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 23:24:56 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Hypervisor/Node resource view: name=user free_ram=7349MB free_disk=25.22563934326172GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75045) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 23:24:56 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:24:56 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.002s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:24:56 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:24:56 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Instance 4ae5ff6b-6f2c-4dfd-a4c6-da4809e2cf27 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75045) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 23:24:56 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Instance 0f21fcd3-ac5f-499e-9c34-82af806fda1d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75045) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 23:24:56 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Instance d2c911cf-d5f4-4c19-8335-8c7834184a7e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75045) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 23:24:56 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Instance 032e20aa-8887-4215-808e-68299a0d8d0b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75045) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 23:24:56 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Instance 43f31110-89ec-4b20-9842-7c9dd7df0e14 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75045) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 23:24:56 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Instance 83d225e0-e39e-4500-b7ae-52dfbd8b8588 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75045) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 23:24:56 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Instance 25cd59d1-6884-471a-813e-52e97c2e1208 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75045) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 23:24:56 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Instance b5fc7f02-2143-4bcf-92ac-078d5ec10747 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75045) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 23:24:56 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Instance 0b84f2b1-01a3-4789-bcef-8b7c4334132b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75045) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 23:24:56 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Instance 7ee70847-10de-49b6-9731-6d65b06532c8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75045) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 23:24:56 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Instance 667d20c3-3eda-4aa5-b799-6dcee3443833 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75045) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 23:24:56 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=75045) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 23:24:56 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=75045) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 23:24:57 user nova-compute[75045]: DEBUG nova.compute.provider_tree [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Inventory has not changed in ProviderTree for provider: 62ba5f85-c74d-4b58-986e-d4197e813fd7 {{(pid=75045) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 23:24:57 user nova-compute[75045]: DEBUG nova.scheduler.client.report [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Inventory has not changed for provider 62ba5f85-c74d-4b58-986e-d4197e813fd7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75045) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 23:24:57 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Compute_service record updated for user:user {{(pid=75045) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 23:24:57 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.864s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:24:57 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-ae9c1fbb-d415-4b46-9a9b-0c4d0e6b34c4 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Acquiring lock "fa67b237-f598-4111-87ba-d761aa50d95e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:24:57 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-ae9c1fbb-d415-4b46-9a9b-0c4d0e6b34c4 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Lock "fa67b237-f598-4111-87ba-d761aa50d95e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:24:57 user nova-compute[75045]: DEBUG nova.compute.manager [None req-ae9c1fbb-d415-4b46-9a9b-0c4d0e6b34c4 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] [instance: fa67b237-f598-4111-87ba-d761aa50d95e] Starting instance... {{(pid=75045) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 23:24:57 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-ae9c1fbb-d415-4b46-9a9b-0c4d0e6b34c4 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:24:57 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-ae9c1fbb-d415-4b46-9a9b-0c4d0e6b34c4 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:24:57 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-ae9c1fbb-d415-4b46-9a9b-0c4d0e6b34c4 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75045) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 23:24:57 user nova-compute[75045]: INFO nova.compute.claims [None req-ae9c1fbb-d415-4b46-9a9b-0c4d0e6b34c4 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] [instance: fa67b237-f598-4111-87ba-d761aa50d95e] Claim successful on node user
Nov 08 23:24:58 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-df41c91c-fcc0-4833-b993-ae7015bf0db7 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Acquiring lock "032e20aa-8887-4215-808e-68299a0d8d0b" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:24:58 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-df41c91c-fcc0-4833-b993-ae7015bf0db7 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Lock "032e20aa-8887-4215-808e-68299a0d8d0b" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:24:58 user nova-compute[75045]: INFO nova.compute.manager [None req-df41c91c-fcc0-4833-b993-ae7015bf0db7 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] [instance: 032e20aa-8887-4215-808e-68299a0d8d0b] Detaching volume 45f1b635-c8a3-4727-a4c7-c2ac441388ff
Nov 08 23:24:58 user nova-compute[75045]: DEBUG nova.compute.provider_tree [None req-ae9c1fbb-d415-4b46-9a9b-0c4d0e6b34c4 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Inventory has not changed in ProviderTree for provider: 62ba5f85-c74d-4b58-986e-d4197e813fd7 {{(pid=75045) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 23:24:58 user nova-compute[75045]: DEBUG nova.scheduler.client.report [None req-ae9c1fbb-d415-4b46-9a9b-0c4d0e6b34c4 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Inventory has not changed for provider 62ba5f85-c74d-4b58-986e-d4197e813fd7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75045) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 23:24:58 user nova-compute[75045]: INFO nova.virt.block_device [None req-df41c91c-fcc0-4833-b993-ae7015bf0db7 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] [instance: 032e20aa-8887-4215-808e-68299a0d8d0b] Attempting to driver detach volume 45f1b635-c8a3-4727-a4c7-c2ac441388ff from mountpoint /dev/vdb
Nov 08 23:24:58 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-df41c91c-fcc0-4833-b993-ae7015bf0db7 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Attempting to detach device vdb from instance 032e20aa-8887-4215-808e-68299a0d8d0b from the persistent domain config. {{(pid=75045) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 08 23:24:58 user nova-compute[75045]: DEBUG nova.virt.libvirt.guest [None req-df41c91c-fcc0-4833-b993-ae7015bf0db7 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 23:24:58 user nova-compute[75045]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 23:24:58 user nova-compute[75045]:   <source dev="/dev/sdc"/>
Nov 08 23:24:58 user nova-compute[75045]:   <target dev="vdb" bus="virtio"/>
Nov 08 23:24:58 user nova-compute[75045]:   <serial>45f1b635-c8a3-4727-a4c7-c2ac441388ff</serial>
Nov 08 23:24:58 user nova-compute[75045]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 08 23:24:58 user nova-compute[75045]: </disk>
Nov 08 23:24:58 user nova-compute[75045]:  {{(pid=75045) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 23:24:58 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-ae9c1fbb-d415-4b46-9a9b-0c4d0e6b34c4 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.677s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:24:58 user nova-compute[75045]: DEBUG nova.compute.manager [None req-ae9c1fbb-d415-4b46-9a9b-0c4d0e6b34c4 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] [instance: fa67b237-f598-4111-87ba-d761aa50d95e] Start building networks asynchronously for instance. {{(pid=75045) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 23:24:58 user nova-compute[75045]: INFO nova.virt.libvirt.driver [None req-df41c91c-fcc0-4833-b993-ae7015bf0db7 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Successfully detached device vdb from instance 032e20aa-8887-4215-808e-68299a0d8d0b from the persistent domain config.
Nov 08 23:24:58 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-df41c91c-fcc0-4833-b993-ae7015bf0db7 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 032e20aa-8887-4215-808e-68299a0d8d0b from the live domain config. {{(pid=75045) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 08 23:24:58 user nova-compute[75045]: DEBUG nova.virt.libvirt.guest [None req-df41c91c-fcc0-4833-b993-ae7015bf0db7 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 23:24:58 user nova-compute[75045]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 23:24:58 user nova-compute[75045]:   <source dev="/dev/sdc"/>
Nov 08 23:24:58 user nova-compute[75045]:   <target dev="vdb" bus="virtio"/>
Nov 08 23:24:58 user nova-compute[75045]:   <serial>45f1b635-c8a3-4727-a4c7-c2ac441388ff</serial>
Nov 08 23:24:58 user nova-compute[75045]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 08 23:24:58 user nova-compute[75045]: </disk>
Nov 08 23:24:58 user nova-compute[75045]:  {{(pid=75045) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 23:24:58 user nova-compute[75045]: DEBUG nova.compute.manager [None req-ae9c1fbb-d415-4b46-9a9b-0c4d0e6b34c4 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] [instance: fa67b237-f598-4111-87ba-d761aa50d95e] Allocating IP information in the background. {{(pid=75045) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 23:24:58 user nova-compute[75045]: DEBUG nova.network.neutron [None req-ae9c1fbb-d415-4b46-9a9b-0c4d0e6b34c4 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] [instance: fa67b237-f598-4111-87ba-d761aa50d95e] allocate_for_instance() {{(pid=75045) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 23:24:58 user nova-compute[75045]: INFO nova.virt.libvirt.driver [None req-ae9c1fbb-d415-4b46-9a9b-0c4d0e6b34c4 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] [instance: fa67b237-f598-4111-87ba-d761aa50d95e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 23:24:58 user nova-compute[75045]: DEBUG nova.compute.manager [None req-ae9c1fbb-d415-4b46-9a9b-0c4d0e6b34c4 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] [instance: fa67b237-f598-4111-87ba-d761aa50d95e] Start building block device mappings for instance. {{(pid=75045) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 23:24:58 user nova-compute[75045]: DEBUG nova.policy [None req-ae9c1fbb-d415-4b46-9a9b-0c4d0e6b34c4 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '04bb3135250f4465a9947b47f9cde485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bfb6963a6c145d4a7b7e47c8fde7e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75045) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 23:24:58 user nova-compute[75045]: DEBUG nova.compute.manager [None req-ae9c1fbb-d415-4b46-9a9b-0c4d0e6b34c4 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] [instance: fa67b237-f598-4111-87ba-d761aa50d95e] Start spawning the instance on the hypervisor. {{(pid=75045) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 23:24:58 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-ae9c1fbb-d415-4b46-9a9b-0c4d0e6b34c4 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] [instance: fa67b237-f598-4111-87ba-d761aa50d95e] Creating instance directory {{(pid=75045) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 23:24:58 user nova-compute[75045]: INFO nova.virt.libvirt.driver [None req-ae9c1fbb-d415-4b46-9a9b-0c4d0e6b34c4 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] [instance: fa67b237-f598-4111-87ba-d761aa50d95e] Creating image(s)
Nov 08 23:24:58 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-ae9c1fbb-d415-4b46-9a9b-0c4d0e6b34c4 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Acquiring lock "/opt/stack/data/nova/instances/fa67b237-f598-4111-87ba-d761aa50d95e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:24:58 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-ae9c1fbb-d415-4b46-9a9b-0c4d0e6b34c4 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Lock "/opt/stack/data/nova/instances/fa67b237-f598-4111-87ba-d761aa50d95e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:24:58 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-ae9c1fbb-d415-4b46-9a9b-0c4d0e6b34c4 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Lock "/opt/stack/data/nova/instances/fa67b237-f598-4111-87ba-d761aa50d95e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:24:58 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-ae9c1fbb-d415-4b46-9a9b-0c4d0e6b34c4 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b59f52a99fff51c56dd1edfb83892fb8f647f2f3 --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:24:59 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-df41c91c-fcc0-4833-b993-ae7015bf0db7 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 032e20aa-8887-4215-808e-68299a0d8d0b {{(pid=75045) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 08 23:24:59 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-ae9c1fbb-d415-4b46-9a9b-0c4d0e6b34c4 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b59f52a99fff51c56dd1edfb83892fb8f647f2f3 --force-share --output=json" returned: 0 in 0.182s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:24:59 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-ae9c1fbb-d415-4b46-9a9b-0c4d0e6b34c4 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Acquiring lock "b59f52a99fff51c56dd1edfb83892fb8f647f2f3" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:24:59 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-ae9c1fbb-d415-4b46-9a9b-0c4d0e6b34c4 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Lock "b59f52a99fff51c56dd1edfb83892fb8f647f2f3" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:24:59 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-ae9c1fbb-d415-4b46-9a9b-0c4d0e6b34c4 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b59f52a99fff51c56dd1edfb83892fb8f647f2f3 --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:24:59 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-ae9c1fbb-d415-4b46-9a9b-0c4d0e6b34c4 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b59f52a99fff51c56dd1edfb83892fb8f647f2f3 --force-share --output=json" returned: 0 in 0.213s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:24:59 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-ae9c1fbb-d415-4b46-9a9b-0c4d0e6b34c4 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b59f52a99fff51c56dd1edfb83892fb8f647f2f3,backing_fmt=raw /opt/stack/data/nova/instances/fa67b237-f598-4111-87ba-d761aa50d95e/disk 1073741824 {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:24:59 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-ae9c1fbb-d415-4b46-9a9b-0c4d0e6b34c4 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b59f52a99fff51c56dd1edfb83892fb8f647f2f3,backing_fmt=raw /opt/stack/data/nova/instances/fa67b237-f598-4111-87ba-d761aa50d95e/disk 1073741824" returned: 0 in 0.078s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:24:59 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-ae9c1fbb-d415-4b46-9a9b-0c4d0e6b34c4 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Lock "b59f52a99fff51c56dd1edfb83892fb8f647f2f3" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.302s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:24:59 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-ae9c1fbb-d415-4b46-9a9b-0c4d0e6b34c4 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b59f52a99fff51c56dd1edfb83892fb8f647f2f3 --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:24:59 user nova-compute[75045]: DEBUG nova.network.neutron [None req-ae9c1fbb-d415-4b46-9a9b-0c4d0e6b34c4 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] [instance: fa67b237-f598-4111-87ba-d761aa50d95e] Successfully created port: 3682fa30-ac2a-4ef9-ad3d-130a38539b80 {{(pid=75045) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 23:24:59 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-ae9c1fbb-d415-4b46-9a9b-0c4d0e6b34c4 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b59f52a99fff51c56dd1edfb83892fb8f647f2f3 --force-share --output=json" returned: 0 in 0.246s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:24:59 user nova-compute[75045]: DEBUG nova.virt.disk.api [None req-ae9c1fbb-d415-4b46-9a9b-0c4d0e6b34c4 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Checking if we can resize image /opt/stack/data/nova/instances/fa67b237-f598-4111-87ba-d761aa50d95e/disk. size=1073741824 {{(pid=75045) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 23:24:59 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-ae9c1fbb-d415-4b46-9a9b-0c4d0e6b34c4 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa67b237-f598-4111-87ba-d761aa50d95e/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:24:59 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:24:59 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-ae9c1fbb-d415-4b46-9a9b-0c4d0e6b34c4 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa67b237-f598-4111-87ba-d761aa50d95e/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:24:59 user nova-compute[75045]: DEBUG nova.virt.disk.api [None req-ae9c1fbb-d415-4b46-9a9b-0c4d0e6b34c4 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Cannot resize image /opt/stack/data/nova/instances/fa67b237-f598-4111-87ba-d761aa50d95e/disk to a smaller size. {{(pid=75045) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 08 23:24:59 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-ae9c1fbb-d415-4b46-9a9b-0c4d0e6b34c4 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] [instance: fa67b237-f598-4111-87ba-d761aa50d95e] Created local disks {{(pid=75045) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 23:24:59 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-ae9c1fbb-d415-4b46-9a9b-0c4d0e6b34c4 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] [instance: fa67b237-f598-4111-87ba-d761aa50d95e] Ensure instance console log exists: /opt/stack/data/nova/instances/fa67b237-f598-4111-87ba-d761aa50d95e/console.log {{(pid=75045) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 23:24:59 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-ae9c1fbb-d415-4b46-9a9b-0c4d0e6b34c4 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:24:59 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-ae9c1fbb-d415-4b46-9a9b-0c4d0e6b34c4 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:24:59 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-ae9c1fbb-d415-4b46-9a9b-0c4d0e6b34c4 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:25:00 user nova-compute[75045]: DEBUG nova.network.neutron [None req-ae9c1fbb-d415-4b46-9a9b-0c4d0e6b34c4 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] [instance: fa67b237-f598-4111-87ba-d761aa50d95e] Successfully updated port: 3682fa30-ac2a-4ef9-ad3d-130a38539b80 {{(pid=75045) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 23:25:00 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-ae9c1fbb-d415-4b46-9a9b-0c4d0e6b34c4 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Acquiring lock "refresh_cache-fa67b237-f598-4111-87ba-d761aa50d95e" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 23:25:00 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-ae9c1fbb-d415-4b46-9a9b-0c4d0e6b34c4 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Acquired lock "refresh_cache-fa67b237-f598-4111-87ba-d761aa50d95e" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 23:25:00 user nova-compute[75045]: DEBUG nova.network.neutron [None req-ae9c1fbb-d415-4b46-9a9b-0c4d0e6b34c4 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] [instance: fa67b237-f598-4111-87ba-d761aa50d95e] Building network info cache for instance {{(pid=75045) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 23:25:00 user nova-compute[75045]: DEBUG nova.compute.manager [req-08a2440f-394d-4c80-9d7c-8d954c7e3979 req-5afa995b-e170-434a-9bc7-af68beb023c2 service nova] [instance: fa67b237-f598-4111-87ba-d761aa50d95e] Received event network-changed-3682fa30-ac2a-4ef9-ad3d-130a38539b80 {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:25:00 user nova-compute[75045]: DEBUG nova.compute.manager [req-08a2440f-394d-4c80-9d7c-8d954c7e3979 req-5afa995b-e170-434a-9bc7-af68beb023c2 service nova] [instance: fa67b237-f598-4111-87ba-d761aa50d95e] Refreshing instance network info cache due to event network-changed-3682fa30-ac2a-4ef9-ad3d-130a38539b80. {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 23:25:00 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-08a2440f-394d-4c80-9d7c-8d954c7e3979 req-5afa995b-e170-434a-9bc7-af68beb023c2 service nova] Acquiring lock "refresh_cache-fa67b237-f598-4111-87ba-d761aa50d95e" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 23:25:00 user nova-compute[75045]: DEBUG nova.network.neutron [None req-ae9c1fbb-d415-4b46-9a9b-0c4d0e6b34c4 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] [instance: fa67b237-f598-4111-87ba-d761aa50d95e] Instance cache missing network info. {{(pid=75045) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 23:25:00 user nova-compute[75045]: DEBUG nova.network.neutron [None req-ae9c1fbb-d415-4b46-9a9b-0c4d0e6b34c4 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] [instance: fa67b237-f598-4111-87ba-d761aa50d95e] Updating instance_info_cache with network_info: [{"id": "3682fa30-ac2a-4ef9-ad3d-130a38539b80", "address": "fa:16:3e:3a:4c:a0", "network": {"id": "d4cd6998-66d1-4389-bc82-dd000c8962de", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-323966879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bfb6963a6c145d4a7b7e47c8fde7e60", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3682fa30-ac", "ovs_interfaceid": "3682fa30-ac2a-4ef9-ad3d-130a38539b80", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75045) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 23:25:00 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-ae9c1fbb-d415-4b46-9a9b-0c4d0e6b34c4 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Releasing lock "refresh_cache-fa67b237-f598-4111-87ba-d761aa50d95e" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 23:25:00 user nova-compute[75045]: DEBUG nova.compute.manager [None req-ae9c1fbb-d415-4b46-9a9b-0c4d0e6b34c4 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] [instance: fa67b237-f598-4111-87ba-d761aa50d95e] Instance network_info: |[{"id": "3682fa30-ac2a-4ef9-ad3d-130a38539b80", "address": "fa:16:3e:3a:4c:a0", "network": {"id": "d4cd6998-66d1-4389-bc82-dd000c8962de", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-323966879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bfb6963a6c145d4a7b7e47c8fde7e60", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3682fa30-ac", "ovs_interfaceid": "3682fa30-ac2a-4ef9-ad3d-130a38539b80", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75045) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 23:25:00 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-08a2440f-394d-4c80-9d7c-8d954c7e3979 req-5afa995b-e170-434a-9bc7-af68beb023c2 service nova] Acquired lock "refresh_cache-fa67b237-f598-4111-87ba-d761aa50d95e" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 23:25:00 user nova-compute[75045]: DEBUG nova.network.neutron [req-08a2440f-394d-4c80-9d7c-8d954c7e3979 req-5afa995b-e170-434a-9bc7-af68beb023c2 service nova] [instance: fa67b237-f598-4111-87ba-d761aa50d95e] Refreshing network info cache for port 3682fa30-ac2a-4ef9-ad3d-130a38539b80 {{(pid=75045) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 23:25:00 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-ae9c1fbb-d415-4b46-9a9b-0c4d0e6b34c4 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] [instance: fa67b237-f598-4111-87ba-d761aa50d95e] Start _get_guest_xml network_info=[{"id": "3682fa30-ac2a-4ef9-ad3d-130a38539b80", "address": "fa:16:3e:3a:4c:a0", "network": {"id": "d4cd6998-66d1-4389-bc82-dd000c8962de", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-323966879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bfb6963a6c145d4a7b7e47c8fde7e60", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3682fa30-ac", "ovs_interfaceid": "3682fa30-ac2a-4ef9-ad3d-130a38539b80", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T23:11:54Z,direct_url=<?>,disk_format='qcow2',id=a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b1beba2cc4e7465ea249e2225fb494dc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T23:11:56Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'disk_bus': 'virtio', 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': 'a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75045) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 23:25:00 user nova-compute[75045]: WARNING nova.virt.libvirt.driver [None req-ae9c1fbb-d415-4b46-9a9b-0c4d0e6b34c4 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 23:25:00 user nova-compute[75045]: WARNING nova.virt.libvirt.driver [None req-ae9c1fbb-d415-4b46-9a9b-0c4d0e6b34c4 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 23:25:00 user nova-compute[75045]: DEBUG nova.virt.libvirt.host [None req-ae9c1fbb-d415-4b46-9a9b-0c4d0e6b34c4 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75045) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 23:25:00 user nova-compute[75045]: DEBUG nova.virt.libvirt.host [None req-ae9c1fbb-d415-4b46-9a9b-0c4d0e6b34c4 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] CPU controller missing on host. {{(pid=75045) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 23:25:00 user nova-compute[75045]: DEBUG nova.virt.libvirt.host [None req-ae9c1fbb-d415-4b46-9a9b-0c4d0e6b34c4 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75045) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 23:25:00 user nova-compute[75045]: DEBUG nova.virt.libvirt.host [None req-ae9c1fbb-d415-4b46-9a9b-0c4d0e6b34c4 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] CPU controller found on host. {{(pid=75045) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 23:25:00 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-ae9c1fbb-d415-4b46-9a9b-0c4d0e6b34c4 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75045) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 23:25:00 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-ae9c1fbb-d415-4b46-9a9b-0c4d0e6b34c4 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T23:11:41Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T23:11:54Z,direct_url=<?>,disk_format='qcow2',id=a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b1beba2cc4e7465ea249e2225fb494dc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T23:11:56Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75045) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 23:25:00 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-ae9c1fbb-d415-4b46-9a9b-0c4d0e6b34c4 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Flavor limits 0:0:0 {{(pid=75045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 23:25:00 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-ae9c1fbb-d415-4b46-9a9b-0c4d0e6b34c4 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Image limits 0:0:0 {{(pid=75045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 23:25:00 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-ae9c1fbb-d415-4b46-9a9b-0c4d0e6b34c4 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Flavor pref 0:0:0 {{(pid=75045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 23:25:00 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-ae9c1fbb-d415-4b46-9a9b-0c4d0e6b34c4 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Image pref 0:0:0 {{(pid=75045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 23:25:00 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-ae9c1fbb-d415-4b46-9a9b-0c4d0e6b34c4 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 23:25:00 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-ae9c1fbb-d415-4b46-9a9b-0c4d0e6b34c4 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75045) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 23:25:00 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-ae9c1fbb-d415-4b46-9a9b-0c4d0e6b34c4 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75045) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 23:25:00 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-ae9c1fbb-d415-4b46-9a9b-0c4d0e6b34c4 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Got 1 possible topologies {{(pid=75045) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 23:25:00 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-ae9c1fbb-d415-4b46-9a9b-0c4d0e6b34c4 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75045) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 23:25:00 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-ae9c1fbb-d415-4b46-9a9b-0c4d0e6b34c4 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75045) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 23:25:01 user nova-compute[75045]: DEBUG nova.virt.libvirt.vif [None req-ae9c1fbb-d415-4b46-9a9b-0c4d0e6b34c4 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T23:24:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1499622947',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1499622947',id=23,image_ref='a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6bfb6963a6c145d4a7b7e47c8fde7e60',ramdisk_id='',reservation_id='r-ckbtr8ev',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-474110917',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T23:24:59Z,user_data=None,user_id='04bb3135250f4465a9947b47f9cde485',uuid=fa67b237-f598-4111-87ba-d761aa50d95e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3682fa30-ac2a-4ef9-ad3d-130a38539b80", "address": "fa:16:3e:3a:4c:a0", "network": {"id": "d4cd6998-66d1-4389-bc82-dd000c8962de", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-323966879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bfb6963a6c145d4a7b7e47c8fde7e60", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3682fa30-ac", "ovs_interfaceid": "3682fa30-ac2a-4ef9-ad3d-130a38539b80", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75045) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 23:25:01 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-ae9c1fbb-d415-4b46-9a9b-0c4d0e6b34c4 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Converting VIF {"id": "3682fa30-ac2a-4ef9-ad3d-130a38539b80", "address": "fa:16:3e:3a:4c:a0", "network": {"id": "d4cd6998-66d1-4389-bc82-dd000c8962de", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-323966879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bfb6963a6c145d4a7b7e47c8fde7e60", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3682fa30-ac", "ovs_interfaceid": "3682fa30-ac2a-4ef9-ad3d-130a38539b80", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 23:25:01 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-ae9c1fbb-d415-4b46-9a9b-0c4d0e6b34c4 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3a:4c:a0,bridge_name='br-int',has_traffic_filtering=True,id=3682fa30-ac2a-4ef9-ad3d-130a38539b80,network=Network(d4cd6998-66d1-4389-bc82-dd000c8962de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3682fa30-ac') {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 23:25:01 user nova-compute[75045]: DEBUG nova.objects.instance [None req-ae9c1fbb-d415-4b46-9a9b-0c4d0e6b34c4 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Lazy-loading 'pci_devices' on Instance uuid fa67b237-f598-4111-87ba-d761aa50d95e {{(pid=75045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 23:25:01 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:25:01 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-ae9c1fbb-d415-4b46-9a9b-0c4d0e6b34c4 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] [instance: fa67b237-f598-4111-87ba-d761aa50d95e] End _get_guest_xml xml=<domain type="kvm">
Nov 08 23:25:01 user nova-compute[75045]:   <uuid>fa67b237-f598-4111-87ba-d761aa50d95e</uuid>
Nov 08 23:25:01 user nova-compute[75045]:   <name>instance-00000017</name>
Nov 08 23:25:01 user nova-compute[75045]:   <memory>524288</memory>
Nov 08 23:25:01 user nova-compute[75045]:   <vcpu>1</vcpu>
Nov 08 23:25:01 user nova-compute[75045]:   <metadata>
Nov 08 23:25:01 user nova-compute[75045]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 23:25:01 user nova-compute[75045]:       <nova:package version="0.0.0"/>
Nov 08 23:25:01 user nova-compute[75045]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1499622947</nova:name>
Nov 08 23:25:01 user nova-compute[75045]:       <nova:creationTime>2023-11-08 23:25:00</nova:creationTime>
Nov 08 23:25:01 user nova-compute[75045]:       <nova:flavor name="m1.tiny">
Nov 08 23:25:01 user nova-compute[75045]:         <nova:memory>512</nova:memory>
Nov 08 23:25:01 user nova-compute[75045]:         <nova:disk>1</nova:disk>
Nov 08 23:25:01 user nova-compute[75045]:         <nova:swap>0</nova:swap>
Nov 08 23:25:01 user nova-compute[75045]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 23:25:01 user nova-compute[75045]:         <nova:vcpus>1</nova:vcpus>
Nov 08 23:25:01 user nova-compute[75045]:       </nova:flavor>
Nov 08 23:25:01 user nova-compute[75045]:       <nova:owner>
Nov 08 23:25:01 user nova-compute[75045]:         <nova:user uuid="04bb3135250f4465a9947b47f9cde485">tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member</nova:user>
Nov 08 23:25:01 user nova-compute[75045]:         <nova:project uuid="6bfb6963a6c145d4a7b7e47c8fde7e60">tempest-ServerBootFromVolumeStableRescueTest-474110917</nova:project>
Nov 08 23:25:01 user nova-compute[75045]:       </nova:owner>
Nov 08 23:25:01 user nova-compute[75045]:       <nova:root type="image" uuid="a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb"/>
Nov 08 23:25:01 user nova-compute[75045]:       <nova:ports>
Nov 08 23:25:01 user nova-compute[75045]:         <nova:port uuid="3682fa30-ac2a-4ef9-ad3d-130a38539b80">
Nov 08 23:25:01 user nova-compute[75045]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 08 23:25:01 user nova-compute[75045]:         </nova:port>
Nov 08 23:25:01 user nova-compute[75045]:       </nova:ports>
Nov 08 23:25:01 user nova-compute[75045]:     </nova:instance>
Nov 08 23:25:01 user nova-compute[75045]:   </metadata>
Nov 08 23:25:01 user nova-compute[75045]:   <sysinfo type="smbios">
Nov 08 23:25:01 user nova-compute[75045]:     <system>
Nov 08 23:25:01 user nova-compute[75045]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 23:25:01 user nova-compute[75045]:       <entry name="product">OpenStack Nova</entry>
Nov 08 23:25:01 user nova-compute[75045]:       <entry name="version">0.0.0</entry>
Nov 08 23:25:01 user nova-compute[75045]:       <entry name="serial">fa67b237-f598-4111-87ba-d761aa50d95e</entry>
Nov 08 23:25:01 user nova-compute[75045]:       <entry name="uuid">fa67b237-f598-4111-87ba-d761aa50d95e</entry>
Nov 08 23:25:01 user nova-compute[75045]:       <entry name="family">Virtual Machine</entry>
Nov 08 23:25:01 user nova-compute[75045]:     </system>
Nov 08 23:25:01 user nova-compute[75045]:   </sysinfo>
Nov 08 23:25:01 user nova-compute[75045]:   <os>
Nov 08 23:25:01 user nova-compute[75045]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 23:25:01 user nova-compute[75045]:     <boot dev="hd"/>
Nov 08 23:25:01 user nova-compute[75045]:     <smbios mode="sysinfo"/>
Nov 08 23:25:01 user nova-compute[75045]:   </os>
Nov 08 23:25:01 user nova-compute[75045]:   <features>
Nov 08 23:25:01 user nova-compute[75045]:     <acpi/>
Nov 08 23:25:01 user nova-compute[75045]:     <apic/>
Nov 08 23:25:01 user nova-compute[75045]:     <vmcoreinfo/>
Nov 08 23:25:01 user nova-compute[75045]:   </features>
Nov 08 23:25:01 user nova-compute[75045]:   <clock offset="utc">
Nov 08 23:25:01 user nova-compute[75045]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 23:25:01 user nova-compute[75045]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 23:25:01 user nova-compute[75045]:     <timer name="hpet" present="no"/>
Nov 08 23:25:01 user nova-compute[75045]:   </clock>
Nov 08 23:25:01 user nova-compute[75045]:   <cpu mode="custom" match="exact">
Nov 08 23:25:01 user nova-compute[75045]:     <model>Nehalem</model>
Nov 08 23:25:01 user nova-compute[75045]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 23:25:01 user nova-compute[75045]:   </cpu>
Nov 08 23:25:01 user nova-compute[75045]:   <devices>
Nov 08 23:25:01 user nova-compute[75045]:     <disk type="file" device="disk">
Nov 08 23:25:01 user nova-compute[75045]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 23:25:01 user nova-compute[75045]:       <source file="/opt/stack/data/nova/instances/fa67b237-f598-4111-87ba-d761aa50d95e/disk"/>
Nov 08 23:25:01 user nova-compute[75045]:       <target dev="vda" bus="virtio"/>
Nov 08 23:25:01 user nova-compute[75045]:     </disk>
Nov 08 23:25:01 user nova-compute[75045]:     <interface type="ethernet">
Nov 08 23:25:01 user nova-compute[75045]:       <mac address="fa:16:3e:3a:4c:a0"/>
Nov 08 23:25:01 user nova-compute[75045]:       <model type="virtio"/>
Nov 08 23:25:01 user nova-compute[75045]:       <mtu size="1442"/>
Nov 08 23:25:01 user nova-compute[75045]:       <target dev="tap3682fa30-ac"/>
Nov 08 23:25:01 user nova-compute[75045]:     </interface>
Nov 08 23:25:01 user nova-compute[75045]:     <serial type="pty">
Nov 08 23:25:01 user nova-compute[75045]:       <log file="/opt/stack/data/nova/instances/fa67b237-f598-4111-87ba-d761aa50d95e/console.log" append="off"/>
Nov 08 23:25:01 user nova-compute[75045]:     </serial>
Nov 08 23:25:01 user nova-compute[75045]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 23:25:01 user nova-compute[75045]:     <video>
Nov 08 23:25:01 user nova-compute[75045]:       <model type="virtio"/>
Nov 08 23:25:01 user nova-compute[75045]:     </video>
Nov 08 23:25:01 user nova-compute[75045]:     <rng model="virtio">
Nov 08 23:25:01 user nova-compute[75045]:       <backend model="random">/dev/urandom</backend>
Nov 08 23:25:01 user nova-compute[75045]:     </rng>
Nov 08 23:25:01 user nova-compute[75045]:     <controller type="usb" index="0" model="none"/>
Nov 08 23:25:01 user nova-compute[75045]:     <memballoon model="virtio">
Nov 08 23:25:01 user nova-compute[75045]:       <stats period="10"/>
Nov 08 23:25:01 user nova-compute[75045]:     </memballoon>
Nov 08 23:25:01 user nova-compute[75045]:   </devices>
Nov 08 23:25:01 user nova-compute[75045]: </domain>
Nov 08 23:25:01 user nova-compute[75045]:  {{(pid=75045) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 23:25:01 user nova-compute[75045]: DEBUG nova.virt.libvirt.vif [None req-ae9c1fbb-d415-4b46-9a9b-0c4d0e6b34c4 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T23:24:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1499622947',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1499622947',id=23,image_ref='a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6bfb6963a6c145d4a7b7e47c8fde7e60',ramdisk_id='',reservation_id='r-ckbtr8ev',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-474110917',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T23:24:59Z,user_data=None,user_id='04bb3135250f4465a9947b47f9cde485',uuid=fa67b237-f598-4111-87ba-d761aa50d95e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3682fa30-ac2a-4ef9-ad3d-130a38539b80", "address": "fa:16:3e:3a:4c:a0", "network": {"id": "d4cd6998-66d1-4389-bc82-dd000c8962de", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-323966879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bfb6963a6c145d4a7b7e47c8fde7e60", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3682fa30-ac", "ovs_interfaceid": "3682fa30-ac2a-4ef9-ad3d-130a38539b80", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75045) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 23:25:01 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-ae9c1fbb-d415-4b46-9a9b-0c4d0e6b34c4 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Converting VIF {"id": "3682fa30-ac2a-4ef9-ad3d-130a38539b80", "address": "fa:16:3e:3a:4c:a0", "network": {"id": "d4cd6998-66d1-4389-bc82-dd000c8962de", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-323966879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bfb6963a6c145d4a7b7e47c8fde7e60", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3682fa30-ac", "ovs_interfaceid": "3682fa30-ac2a-4ef9-ad3d-130a38539b80", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 23:25:01 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-ae9c1fbb-d415-4b46-9a9b-0c4d0e6b34c4 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3a:4c:a0,bridge_name='br-int',has_traffic_filtering=True,id=3682fa30-ac2a-4ef9-ad3d-130a38539b80,network=Network(d4cd6998-66d1-4389-bc82-dd000c8962de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3682fa30-ac') {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 23:25:01 user nova-compute[75045]: DEBUG os_vif [None req-ae9c1fbb-d415-4b46-9a9b-0c4d0e6b34c4 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3a:4c:a0,bridge_name='br-int',has_traffic_filtering=True,id=3682fa30-ac2a-4ef9-ad3d-130a38539b80,network=Network(d4cd6998-66d1-4389-bc82-dd000c8962de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3682fa30-ac') {{(pid=75045) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 23:25:01 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:25:01 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:25:01 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 23:25:01 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:25:01 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0fc13ef3-f7a8-5e70-8247-d12c5e708243', '_type': 'linux-noop'}}, row=False) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:25:01 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:25:01 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 23:25:01 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:25:01 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3682fa30-ac, may_exist=True, interface_attrs={}) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:25:01 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3682fa30-ac, col_values=(('qos', UUID('1714c564-ba41-4c6e-bbb7-99bc0b791ee0')),), if_exists=True) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:25:01 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3682fa30-ac, col_values=(('external_ids', {'iface-id': '3682fa30-ac2a-4ef9-ad3d-130a38539b80', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3a:4c:a0', 'vm-uuid': 'fa67b237-f598-4111-87ba-d761aa50d95e'}),), if_exists=True) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:25:01 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:25:01 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 23:25:01 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:25:01 user nova-compute[75045]: INFO os_vif [None req-ae9c1fbb-d415-4b46-9a9b-0c4d0e6b34c4 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3a:4c:a0,bridge_name='br-int',has_traffic_filtering=True,id=3682fa30-ac2a-4ef9-ad3d-130a38539b80,network=Network(d4cd6998-66d1-4389-bc82-dd000c8962de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3682fa30-ac')
Nov 08 23:25:01 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-ae9c1fbb-d415-4b46-9a9b-0c4d0e6b34c4 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] No BDM found with device name vda, not building metadata. {{(pid=75045) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 23:25:01 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-ae9c1fbb-d415-4b46-9a9b-0c4d0e6b34c4 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] No VIF found with MAC fa:16:3e:3a:4c:a0, not building metadata {{(pid=75045) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 23:25:01 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:25:02 user nova-compute[75045]: DEBUG nova.network.neutron [req-08a2440f-394d-4c80-9d7c-8d954c7e3979 req-5afa995b-e170-434a-9bc7-af68beb023c2 service nova] [instance: fa67b237-f598-4111-87ba-d761aa50d95e] Updated VIF entry in instance network info cache for port 3682fa30-ac2a-4ef9-ad3d-130a38539b80. {{(pid=75045) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 23:25:02 user nova-compute[75045]: DEBUG nova.network.neutron [req-08a2440f-394d-4c80-9d7c-8d954c7e3979 req-5afa995b-e170-434a-9bc7-af68beb023c2 service nova] [instance: fa67b237-f598-4111-87ba-d761aa50d95e] Updating instance_info_cache with network_info: [{"id": "3682fa30-ac2a-4ef9-ad3d-130a38539b80", "address": "fa:16:3e:3a:4c:a0", "network": {"id": "d4cd6998-66d1-4389-bc82-dd000c8962de", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-323966879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bfb6963a6c145d4a7b7e47c8fde7e60", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3682fa30-ac", "ovs_interfaceid": "3682fa30-ac2a-4ef9-ad3d-130a38539b80", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75045) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 23:25:02 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-08a2440f-394d-4c80-9d7c-8d954c7e3979 req-5afa995b-e170-434a-9bc7-af68beb023c2 service nova] Releasing lock "refresh_cache-fa67b237-f598-4111-87ba-d761aa50d95e" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 23:25:02 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:25:02 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:25:02 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:25:02 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:25:02 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:25:03 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:25:04 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:25:04 user nova-compute[75045]: DEBUG nova.compute.manager [req-fd3748ba-2712-40cc-a823-7f9fc71e5a5e req-b6346c86-1288-404b-adc9-4978e300650c service nova] [instance: fa67b237-f598-4111-87ba-d761aa50d95e] Received event network-vif-plugged-3682fa30-ac2a-4ef9-ad3d-130a38539b80 {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:25:04 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-fd3748ba-2712-40cc-a823-7f9fc71e5a5e req-b6346c86-1288-404b-adc9-4978e300650c service nova] Acquiring lock "fa67b237-f598-4111-87ba-d761aa50d95e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:25:04 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-fd3748ba-2712-40cc-a823-7f9fc71e5a5e req-b6346c86-1288-404b-adc9-4978e300650c service nova] Lock "fa67b237-f598-4111-87ba-d761aa50d95e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:25:04 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-fd3748ba-2712-40cc-a823-7f9fc71e5a5e req-b6346c86-1288-404b-adc9-4978e300650c service nova] Lock "fa67b237-f598-4111-87ba-d761aa50d95e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:25:04 user nova-compute[75045]: DEBUG nova.compute.manager [req-fd3748ba-2712-40cc-a823-7f9fc71e5a5e req-b6346c86-1288-404b-adc9-4978e300650c service nova] [instance: fa67b237-f598-4111-87ba-d761aa50d95e] No waiting events found dispatching network-vif-plugged-3682fa30-ac2a-4ef9-ad3d-130a38539b80 {{(pid=75045) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 23:25:05 user nova-compute[75045]: WARNING nova.compute.manager [req-fd3748ba-2712-40cc-a823-7f9fc71e5a5e req-b6346c86-1288-404b-adc9-4978e300650c service nova] [instance: fa67b237-f598-4111-87ba-d761aa50d95e] Received unexpected event network-vif-plugged-3682fa30-ac2a-4ef9-ad3d-130a38539b80 for instance with vm_state building and task_state spawning.
Nov 08 23:25:05 user nova-compute[75045]: DEBUG nova.compute.manager [None req-ae9c1fbb-d415-4b46-9a9b-0c4d0e6b34c4 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] [instance: fa67b237-f598-4111-87ba-d761aa50d95e] Instance event wait completed in 0 seconds for  {{(pid=75045) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 23:25:05 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-ae9c1fbb-d415-4b46-9a9b-0c4d0e6b34c4 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] [instance: fa67b237-f598-4111-87ba-d761aa50d95e] Guest created on hypervisor {{(pid=75045) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 23:25:05 user nova-compute[75045]: INFO nova.virt.libvirt.driver [-] [instance: fa67b237-f598-4111-87ba-d761aa50d95e] Instance spawned successfully.
Nov 08 23:25:05 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-ae9c1fbb-d415-4b46-9a9b-0c4d0e6b34c4 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] [instance: fa67b237-f598-4111-87ba-d761aa50d95e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75045) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 23:25:05 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-ae9c1fbb-d415-4b46-9a9b-0c4d0e6b34c4 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] [instance: fa67b237-f598-4111-87ba-d761aa50d95e] Found default for hw_cdrom_bus of ide {{(pid=75045) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 23:25:05 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-ae9c1fbb-d415-4b46-9a9b-0c4d0e6b34c4 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] [instance: fa67b237-f598-4111-87ba-d761aa50d95e] Found default for hw_disk_bus of virtio {{(pid=75045) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 23:25:05 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-ae9c1fbb-d415-4b46-9a9b-0c4d0e6b34c4 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] [instance: fa67b237-f598-4111-87ba-d761aa50d95e] Found default for hw_input_bus of None {{(pid=75045) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 23:25:05 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-ae9c1fbb-d415-4b46-9a9b-0c4d0e6b34c4 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] [instance: fa67b237-f598-4111-87ba-d761aa50d95e] Found default for hw_pointer_model of None {{(pid=75045) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 23:25:05 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-ae9c1fbb-d415-4b46-9a9b-0c4d0e6b34c4 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] [instance: fa67b237-f598-4111-87ba-d761aa50d95e] Found default for hw_video_model of virtio {{(pid=75045) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 23:25:05 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-ae9c1fbb-d415-4b46-9a9b-0c4d0e6b34c4 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] [instance: fa67b237-f598-4111-87ba-d761aa50d95e] Found default for hw_vif_model of virtio {{(pid=75045) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 23:25:05 user nova-compute[75045]: INFO nova.compute.manager [None req-ae9c1fbb-d415-4b46-9a9b-0c4d0e6b34c4 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] [instance: fa67b237-f598-4111-87ba-d761aa50d95e] Took 6.42 seconds to spawn the instance on the hypervisor.
Nov 08 23:25:05 user nova-compute[75045]: DEBUG nova.compute.manager [None req-ae9c1fbb-d415-4b46-9a9b-0c4d0e6b34c4 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] [instance: fa67b237-f598-4111-87ba-d761aa50d95e] Checking state {{(pid=75045) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 23:25:05 user nova-compute[75045]: INFO nova.compute.manager [None req-ae9c1fbb-d415-4b46-9a9b-0c4d0e6b34c4 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] [instance: fa67b237-f598-4111-87ba-d761aa50d95e] Took 7.71 seconds to build instance.
Nov 08 23:25:05 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-ae9c1fbb-d415-4b46-9a9b-0c4d0e6b34c4 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Lock "fa67b237-f598-4111-87ba-d761aa50d95e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.858s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:25:06 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:25:06 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:25:06 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:25:07 user nova-compute[75045]: DEBUG nova.compute.manager [req-16162e43-7dfa-4505-85bc-bd31b360fea9 req-e52d4602-c240-43a0-9e36-cca95b1624a8 service nova] [instance: fa67b237-f598-4111-87ba-d761aa50d95e] Received event network-vif-plugged-3682fa30-ac2a-4ef9-ad3d-130a38539b80 {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:25:07 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-16162e43-7dfa-4505-85bc-bd31b360fea9 req-e52d4602-c240-43a0-9e36-cca95b1624a8 service nova] Acquiring lock "fa67b237-f598-4111-87ba-d761aa50d95e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:25:07 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-16162e43-7dfa-4505-85bc-bd31b360fea9 req-e52d4602-c240-43a0-9e36-cca95b1624a8 service nova] Lock "fa67b237-f598-4111-87ba-d761aa50d95e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:25:07 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-16162e43-7dfa-4505-85bc-bd31b360fea9 req-e52d4602-c240-43a0-9e36-cca95b1624a8 service nova] Lock "fa67b237-f598-4111-87ba-d761aa50d95e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:25:07 user nova-compute[75045]: DEBUG nova.compute.manager [req-16162e43-7dfa-4505-85bc-bd31b360fea9 req-e52d4602-c240-43a0-9e36-cca95b1624a8 service nova] [instance: fa67b237-f598-4111-87ba-d761aa50d95e] No waiting events found dispatching network-vif-plugged-3682fa30-ac2a-4ef9-ad3d-130a38539b80 {{(pid=75045) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 23:25:07 user nova-compute[75045]: WARNING nova.compute.manager [req-16162e43-7dfa-4505-85bc-bd31b360fea9 req-e52d4602-c240-43a0-9e36-cca95b1624a8 service nova] [instance: fa67b237-f598-4111-87ba-d761aa50d95e] Received unexpected event network-vif-plugged-3682fa30-ac2a-4ef9-ad3d-130a38539b80 for instance with vm_state active and task_state None.
Nov 08 23:25:08 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-0161cadb-17b4-40f1-af93-e3017f777832 tempest-VolumesAdminNegativeTest-215528111 tempest-VolumesAdminNegativeTest-215528111-project-member] Acquiring lock "7e92ab9a-8ea4-4452-a458-db181d4a59b7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:25:08 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-0161cadb-17b4-40f1-af93-e3017f777832 tempest-VolumesAdminNegativeTest-215528111 tempest-VolumesAdminNegativeTest-215528111-project-member] Lock "7e92ab9a-8ea4-4452-a458-db181d4a59b7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:25:08 user nova-compute[75045]: DEBUG nova.compute.manager [None req-0161cadb-17b4-40f1-af93-e3017f777832 tempest-VolumesAdminNegativeTest-215528111 tempest-VolumesAdminNegativeTest-215528111-project-member] [instance: 7e92ab9a-8ea4-4452-a458-db181d4a59b7] Starting instance... {{(pid=75045) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 23:25:08 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-0161cadb-17b4-40f1-af93-e3017f777832 tempest-VolumesAdminNegativeTest-215528111 tempest-VolumesAdminNegativeTest-215528111-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:25:08 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-0161cadb-17b4-40f1-af93-e3017f777832 tempest-VolumesAdminNegativeTest-215528111 tempest-VolumesAdminNegativeTest-215528111-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:25:08 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-0161cadb-17b4-40f1-af93-e3017f777832 tempest-VolumesAdminNegativeTest-215528111 tempest-VolumesAdminNegativeTest-215528111-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75045) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 23:25:08 user nova-compute[75045]: INFO nova.compute.claims [None req-0161cadb-17b4-40f1-af93-e3017f777832 tempest-VolumesAdminNegativeTest-215528111 tempest-VolumesAdminNegativeTest-215528111-project-member] [instance: 7e92ab9a-8ea4-4452-a458-db181d4a59b7] Claim successful on node user
Nov 08 23:25:09 user nova-compute[75045]: DEBUG nova.compute.provider_tree [None req-0161cadb-17b4-40f1-af93-e3017f777832 tempest-VolumesAdminNegativeTest-215528111 tempest-VolumesAdminNegativeTest-215528111-project-member] Inventory has not changed in ProviderTree for provider: 62ba5f85-c74d-4b58-986e-d4197e813fd7 {{(pid=75045) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 23:25:09 user nova-compute[75045]: DEBUG nova.scheduler.client.report [None req-0161cadb-17b4-40f1-af93-e3017f777832 tempest-VolumesAdminNegativeTest-215528111 tempest-VolumesAdminNegativeTest-215528111-project-member] Inventory has not changed for provider 62ba5f85-c74d-4b58-986e-d4197e813fd7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75045) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 23:25:09 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-0161cadb-17b4-40f1-af93-e3017f777832 tempest-VolumesAdminNegativeTest-215528111 tempest-VolumesAdminNegativeTest-215528111-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.706s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:25:09 user nova-compute[75045]: DEBUG nova.compute.manager [None req-0161cadb-17b4-40f1-af93-e3017f777832 tempest-VolumesAdminNegativeTest-215528111 tempest-VolumesAdminNegativeTest-215528111-project-member] [instance: 7e92ab9a-8ea4-4452-a458-db181d4a59b7] Start building networks asynchronously for instance. {{(pid=75045) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 23:25:09 user nova-compute[75045]: DEBUG nova.compute.manager [None req-0161cadb-17b4-40f1-af93-e3017f777832 tempest-VolumesAdminNegativeTest-215528111 tempest-VolumesAdminNegativeTest-215528111-project-member] [instance: 7e92ab9a-8ea4-4452-a458-db181d4a59b7] Allocating IP information in the background. {{(pid=75045) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 23:25:09 user nova-compute[75045]: DEBUG nova.network.neutron [None req-0161cadb-17b4-40f1-af93-e3017f777832 tempest-VolumesAdminNegativeTest-215528111 tempest-VolumesAdminNegativeTest-215528111-project-member] [instance: 7e92ab9a-8ea4-4452-a458-db181d4a59b7] allocate_for_instance() {{(pid=75045) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 23:25:09 user nova-compute[75045]: INFO nova.virt.libvirt.driver [None req-0161cadb-17b4-40f1-af93-e3017f777832 tempest-VolumesAdminNegativeTest-215528111 tempest-VolumesAdminNegativeTest-215528111-project-member] [instance: 7e92ab9a-8ea4-4452-a458-db181d4a59b7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 23:25:09 user nova-compute[75045]: DEBUG nova.compute.manager [None req-0161cadb-17b4-40f1-af93-e3017f777832 tempest-VolumesAdminNegativeTest-215528111 tempest-VolumesAdminNegativeTest-215528111-project-member] [instance: 7e92ab9a-8ea4-4452-a458-db181d4a59b7] Start building block device mappings for instance. {{(pid=75045) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 23:25:09 user nova-compute[75045]: DEBUG nova.compute.manager [None req-0161cadb-17b4-40f1-af93-e3017f777832 tempest-VolumesAdminNegativeTest-215528111 tempest-VolumesAdminNegativeTest-215528111-project-member] [instance: 7e92ab9a-8ea4-4452-a458-db181d4a59b7] Start spawning the instance on the hypervisor. {{(pid=75045) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 23:25:09 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-0161cadb-17b4-40f1-af93-e3017f777832 tempest-VolumesAdminNegativeTest-215528111 tempest-VolumesAdminNegativeTest-215528111-project-member] [instance: 7e92ab9a-8ea4-4452-a458-db181d4a59b7] Creating instance directory {{(pid=75045) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 23:25:09 user nova-compute[75045]: INFO nova.virt.libvirt.driver [None req-0161cadb-17b4-40f1-af93-e3017f777832 tempest-VolumesAdminNegativeTest-215528111 tempest-VolumesAdminNegativeTest-215528111-project-member] [instance: 7e92ab9a-8ea4-4452-a458-db181d4a59b7] Creating image(s)
Nov 08 23:25:09 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-0161cadb-17b4-40f1-af93-e3017f777832 tempest-VolumesAdminNegativeTest-215528111 tempest-VolumesAdminNegativeTest-215528111-project-member] Acquiring lock "/opt/stack/data/nova/instances/7e92ab9a-8ea4-4452-a458-db181d4a59b7/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:25:09 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-0161cadb-17b4-40f1-af93-e3017f777832 tempest-VolumesAdminNegativeTest-215528111 tempest-VolumesAdminNegativeTest-215528111-project-member] Lock "/opt/stack/data/nova/instances/7e92ab9a-8ea4-4452-a458-db181d4a59b7/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:25:09 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-0161cadb-17b4-40f1-af93-e3017f777832 tempest-VolumesAdminNegativeTest-215528111 tempest-VolumesAdminNegativeTest-215528111-project-member] Lock "/opt/stack/data/nova/instances/7e92ab9a-8ea4-4452-a458-db181d4a59b7/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:25:09 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-0161cadb-17b4-40f1-af93-e3017f777832 tempest-VolumesAdminNegativeTest-215528111 tempest-VolumesAdminNegativeTest-215528111-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b59f52a99fff51c56dd1edfb83892fb8f647f2f3 --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:25:10 user nova-compute[75045]: DEBUG nova.policy [None req-0161cadb-17b4-40f1-af93-e3017f777832 tempest-VolumesAdminNegativeTest-215528111 tempest-VolumesAdminNegativeTest-215528111-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8e1203c75e084399aa70a7da8546b122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd25d9a8d6af45bb97e0555101d61489', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75045) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 23:25:10 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-0161cadb-17b4-40f1-af93-e3017f777832 tempest-VolumesAdminNegativeTest-215528111 tempest-VolumesAdminNegativeTest-215528111-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b59f52a99fff51c56dd1edfb83892fb8f647f2f3 --force-share --output=json" returned: 0 in 0.250s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:25:10 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-0161cadb-17b4-40f1-af93-e3017f777832 tempest-VolumesAdminNegativeTest-215528111 tempest-VolumesAdminNegativeTest-215528111-project-member] Acquiring lock "b59f52a99fff51c56dd1edfb83892fb8f647f2f3" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:25:10 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-0161cadb-17b4-40f1-af93-e3017f777832 tempest-VolumesAdminNegativeTest-215528111 tempest-VolumesAdminNegativeTest-215528111-project-member] Lock "b59f52a99fff51c56dd1edfb83892fb8f647f2f3" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:25:10 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-0161cadb-17b4-40f1-af93-e3017f777832 tempest-VolumesAdminNegativeTest-215528111 tempest-VolumesAdminNegativeTest-215528111-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b59f52a99fff51c56dd1edfb83892fb8f647f2f3 --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:25:10 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-0161cadb-17b4-40f1-af93-e3017f777832 tempest-VolumesAdminNegativeTest-215528111 tempest-VolumesAdminNegativeTest-215528111-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b59f52a99fff51c56dd1edfb83892fb8f647f2f3 --force-share --output=json" returned: 0 in 0.241s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:25:10 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-0161cadb-17b4-40f1-af93-e3017f777832 tempest-VolumesAdminNegativeTest-215528111 tempest-VolumesAdminNegativeTest-215528111-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b59f52a99fff51c56dd1edfb83892fb8f647f2f3,backing_fmt=raw /opt/stack/data/nova/instances/7e92ab9a-8ea4-4452-a458-db181d4a59b7/disk 1073741824 {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:25:10 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-0161cadb-17b4-40f1-af93-e3017f777832 tempest-VolumesAdminNegativeTest-215528111 tempest-VolumesAdminNegativeTest-215528111-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b59f52a99fff51c56dd1edfb83892fb8f647f2f3,backing_fmt=raw /opt/stack/data/nova/instances/7e92ab9a-8ea4-4452-a458-db181d4a59b7/disk 1073741824" returned: 0 in 0.062s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:25:10 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-0161cadb-17b4-40f1-af93-e3017f777832 tempest-VolumesAdminNegativeTest-215528111 tempest-VolumesAdminNegativeTest-215528111-project-member] Lock "b59f52a99fff51c56dd1edfb83892fb8f647f2f3" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.311s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:25:10 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-0161cadb-17b4-40f1-af93-e3017f777832 tempest-VolumesAdminNegativeTest-215528111 tempest-VolumesAdminNegativeTest-215528111-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b59f52a99fff51c56dd1edfb83892fb8f647f2f3 --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:25:10 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-0161cadb-17b4-40f1-af93-e3017f777832 tempest-VolumesAdminNegativeTest-215528111 tempest-VolumesAdminNegativeTest-215528111-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b59f52a99fff51c56dd1edfb83892fb8f647f2f3 --force-share --output=json" returned: 0 in 0.221s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:25:10 user nova-compute[75045]: DEBUG nova.virt.disk.api [None req-0161cadb-17b4-40f1-af93-e3017f777832 tempest-VolumesAdminNegativeTest-215528111 tempest-VolumesAdminNegativeTest-215528111-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7e92ab9a-8ea4-4452-a458-db181d4a59b7/disk. size=1073741824 {{(pid=75045) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 23:25:10 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-0161cadb-17b4-40f1-af93-e3017f777832 tempest-VolumesAdminNegativeTest-215528111 tempest-VolumesAdminNegativeTest-215528111-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e92ab9a-8ea4-4452-a458-db181d4a59b7/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:25:10 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-0161cadb-17b4-40f1-af93-e3017f777832 tempest-VolumesAdminNegativeTest-215528111 tempest-VolumesAdminNegativeTest-215528111-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e92ab9a-8ea4-4452-a458-db181d4a59b7/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:25:10 user nova-compute[75045]: DEBUG nova.virt.disk.api [None req-0161cadb-17b4-40f1-af93-e3017f777832 tempest-VolumesAdminNegativeTest-215528111 tempest-VolumesAdminNegativeTest-215528111-project-member] Cannot resize image /opt/stack/data/nova/instances/7e92ab9a-8ea4-4452-a458-db181d4a59b7/disk to a smaller size. {{(pid=75045) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 08 23:25:10 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-0161cadb-17b4-40f1-af93-e3017f777832 tempest-VolumesAdminNegativeTest-215528111 tempest-VolumesAdminNegativeTest-215528111-project-member] [instance: 7e92ab9a-8ea4-4452-a458-db181d4a59b7] Created local disks {{(pid=75045) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 23:25:10 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-0161cadb-17b4-40f1-af93-e3017f777832 tempest-VolumesAdminNegativeTest-215528111 tempest-VolumesAdminNegativeTest-215528111-project-member] [instance: 7e92ab9a-8ea4-4452-a458-db181d4a59b7] Ensure instance console log exists: /opt/stack/data/nova/instances/7e92ab9a-8ea4-4452-a458-db181d4a59b7/console.log {{(pid=75045) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 23:25:10 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-0161cadb-17b4-40f1-af93-e3017f777832 tempest-VolumesAdminNegativeTest-215528111 tempest-VolumesAdminNegativeTest-215528111-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:25:10 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-0161cadb-17b4-40f1-af93-e3017f777832 tempest-VolumesAdminNegativeTest-215528111 tempest-VolumesAdminNegativeTest-215528111-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:25:11 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-0161cadb-17b4-40f1-af93-e3017f777832 tempest-VolumesAdminNegativeTest-215528111 tempest-VolumesAdminNegativeTest-215528111-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:25:11 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:25:11 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:25:11 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:25:11 user nova-compute[75045]: DEBUG nova.network.neutron [None req-0161cadb-17b4-40f1-af93-e3017f777832 tempest-VolumesAdminNegativeTest-215528111 tempest-VolumesAdminNegativeTest-215528111-project-member] [instance: 7e92ab9a-8ea4-4452-a458-db181d4a59b7] Successfully created port: 5bdaffe7-9bbb-4391-bd1e-406a8fb06ce8 {{(pid=75045) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 23:25:11 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-03a4c0ee-568a-4663-a9ca-0617ba0edb13 tempest-TestStampPattern-2120781434 tempest-TestStampPattern-2120781434-project-member] Acquiring lock "72c9d731-2b35-434c-8463-1cd6c18fbd6a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:25:11 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-03a4c0ee-568a-4663-a9ca-0617ba0edb13 tempest-TestStampPattern-2120781434 tempest-TestStampPattern-2120781434-project-member] Lock "72c9d731-2b35-434c-8463-1cd6c18fbd6a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:25:11 user nova-compute[75045]: DEBUG nova.compute.manager [None req-03a4c0ee-568a-4663-a9ca-0617ba0edb13 tempest-TestStampPattern-2120781434 tempest-TestStampPattern-2120781434-project-member] [instance: 72c9d731-2b35-434c-8463-1cd6c18fbd6a] Starting instance... {{(pid=75045) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 23:25:11 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-03a4c0ee-568a-4663-a9ca-0617ba0edb13 tempest-TestStampPattern-2120781434 tempest-TestStampPattern-2120781434-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:25:11 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-03a4c0ee-568a-4663-a9ca-0617ba0edb13 tempest-TestStampPattern-2120781434 tempest-TestStampPattern-2120781434-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.003s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:25:11 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-03a4c0ee-568a-4663-a9ca-0617ba0edb13 tempest-TestStampPattern-2120781434 tempest-TestStampPattern-2120781434-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75045) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 23:25:11 user nova-compute[75045]: INFO nova.compute.claims [None req-03a4c0ee-568a-4663-a9ca-0617ba0edb13 tempest-TestStampPattern-2120781434 tempest-TestStampPattern-2120781434-project-member] [instance: 72c9d731-2b35-434c-8463-1cd6c18fbd6a] Claim successful on node user
Nov 08 23:25:11 user nova-compute[75045]: DEBUG nova.network.neutron [None req-0161cadb-17b4-40f1-af93-e3017f777832 tempest-VolumesAdminNegativeTest-215528111 tempest-VolumesAdminNegativeTest-215528111-project-member] [instance: 7e92ab9a-8ea4-4452-a458-db181d4a59b7] Successfully updated port: 5bdaffe7-9bbb-4391-bd1e-406a8fb06ce8 {{(pid=75045) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 23:25:12 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-0161cadb-17b4-40f1-af93-e3017f777832 tempest-VolumesAdminNegativeTest-215528111 tempest-VolumesAdminNegativeTest-215528111-project-member] Acquiring lock "refresh_cache-7e92ab9a-8ea4-4452-a458-db181d4a59b7" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 23:25:12 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-0161cadb-17b4-40f1-af93-e3017f777832 tempest-VolumesAdminNegativeTest-215528111 tempest-VolumesAdminNegativeTest-215528111-project-member] Acquired lock "refresh_cache-7e92ab9a-8ea4-4452-a458-db181d4a59b7" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 23:25:12 user nova-compute[75045]: DEBUG nova.network.neutron [None req-0161cadb-17b4-40f1-af93-e3017f777832 tempest-VolumesAdminNegativeTest-215528111 tempest-VolumesAdminNegativeTest-215528111-project-member] [instance: 7e92ab9a-8ea4-4452-a458-db181d4a59b7] Building network info cache for instance {{(pid=75045) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 23:25:12 user nova-compute[75045]: DEBUG nova.compute.manager [req-e379e8b5-7d54-4ad3-ada6-4d451d4a3594 req-9d4f4eab-1354-4f71-b8d6-7a6bd2238483 service nova] [instance: 7e92ab9a-8ea4-4452-a458-db181d4a59b7] Received event network-changed-5bdaffe7-9bbb-4391-bd1e-406a8fb06ce8 {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:25:12 user nova-compute[75045]: DEBUG nova.compute.manager [req-e379e8b5-7d54-4ad3-ada6-4d451d4a3594 req-9d4f4eab-1354-4f71-b8d6-7a6bd2238483 service nova] [instance: 7e92ab9a-8ea4-4452-a458-db181d4a59b7] Refreshing instance network info cache due to event network-changed-5bdaffe7-9bbb-4391-bd1e-406a8fb06ce8. {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 23:25:12 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-e379e8b5-7d54-4ad3-ada6-4d451d4a3594 req-9d4f4eab-1354-4f71-b8d6-7a6bd2238483 service nova] Acquiring lock "refresh_cache-7e92ab9a-8ea4-4452-a458-db181d4a59b7" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 23:25:12 user nova-compute[75045]: DEBUG nova.network.neutron [None req-0161cadb-17b4-40f1-af93-e3017f777832 tempest-VolumesAdminNegativeTest-215528111 tempest-VolumesAdminNegativeTest-215528111-project-member] [instance: 7e92ab9a-8ea4-4452-a458-db181d4a59b7] Instance cache missing network info. {{(pid=75045) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 23:25:12 user nova-compute[75045]: DEBUG nova.compute.provider_tree [None req-03a4c0ee-568a-4663-a9ca-0617ba0edb13 tempest-TestStampPattern-2120781434 tempest-TestStampPattern-2120781434-project-member] Inventory has not changed in ProviderTree for provider: 62ba5f85-c74d-4b58-986e-d4197e813fd7 {{(pid=75045) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 23:25:12 user nova-compute[75045]: DEBUG nova.scheduler.client.report [None req-03a4c0ee-568a-4663-a9ca-0617ba0edb13 tempest-TestStampPattern-2120781434 tempest-TestStampPattern-2120781434-project-member] Inventory has not changed for provider 62ba5f85-c74d-4b58-986e-d4197e813fd7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75045) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 23:25:12 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-03a4c0ee-568a-4663-a9ca-0617ba0edb13 tempest-TestStampPattern-2120781434 tempest-TestStampPattern-2120781434-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.789s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:25:12 user nova-compute[75045]: DEBUG nova.compute.manager [None req-03a4c0ee-568a-4663-a9ca-0617ba0edb13 tempest-TestStampPattern-2120781434 tempest-TestStampPattern-2120781434-project-member] [instance: 72c9d731-2b35-434c-8463-1cd6c18fbd6a] Start building networks asynchronously for instance. {{(pid=75045) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 23:25:12 user nova-compute[75045]: DEBUG nova.compute.manager [None req-03a4c0ee-568a-4663-a9ca-0617ba0edb13 tempest-TestStampPattern-2120781434 tempest-TestStampPattern-2120781434-project-member] [instance: 72c9d731-2b35-434c-8463-1cd6c18fbd6a] Allocating IP information in the background. {{(pid=75045) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 23:25:12 user nova-compute[75045]: DEBUG nova.network.neutron [None req-03a4c0ee-568a-4663-a9ca-0617ba0edb13 tempest-TestStampPattern-2120781434 tempest-TestStampPattern-2120781434-project-member] [instance: 72c9d731-2b35-434c-8463-1cd6c18fbd6a] allocate_for_instance() {{(pid=75045) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 23:25:12 user nova-compute[75045]: INFO nova.virt.libvirt.driver [None req-03a4c0ee-568a-4663-a9ca-0617ba0edb13 tempest-TestStampPattern-2120781434 tempest-TestStampPattern-2120781434-project-member] [instance: 72c9d731-2b35-434c-8463-1cd6c18fbd6a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 23:25:12 user nova-compute[75045]: DEBUG nova.compute.manager [None req-03a4c0ee-568a-4663-a9ca-0617ba0edb13 tempest-TestStampPattern-2120781434 tempest-TestStampPattern-2120781434-project-member] [instance: 72c9d731-2b35-434c-8463-1cd6c18fbd6a] Start building block device mappings for instance. {{(pid=75045) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 23:25:12 user nova-compute[75045]: DEBUG nova.policy [None req-03a4c0ee-568a-4663-a9ca-0617ba0edb13 tempest-TestStampPattern-2120781434 tempest-TestStampPattern-2120781434-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5aea9d6528d3454eaf0f8b2cc9df7c46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824ed65954dd4eccbe68827aa92fd99f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75045) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 23:25:12 user nova-compute[75045]: DEBUG nova.network.neutron [None req-0161cadb-17b4-40f1-af93-e3017f777832 tempest-VolumesAdminNegativeTest-215528111 tempest-VolumesAdminNegativeTest-215528111-project-member] [instance: 7e92ab9a-8ea4-4452-a458-db181d4a59b7] Updating instance_info_cache with network_info: [{"id": "5bdaffe7-9bbb-4391-bd1e-406a8fb06ce8", "address": "fa:16:3e:13:a9:e5", "network": {"id": "e7c66e39-e1ba-4907-8701-33ae849858b2", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-420335537-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd25d9a8d6af45bb97e0555101d61489", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5bdaffe7-9b", "ovs_interfaceid": "5bdaffe7-9bbb-4391-bd1e-406a8fb06ce8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75045) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 23:25:12 user nova-compute[75045]: DEBUG nova.compute.manager [None req-03a4c0ee-568a-4663-a9ca-0617ba0edb13 tempest-TestStampPattern-2120781434 tempest-TestStampPattern-2120781434-project-member] [instance: 72c9d731-2b35-434c-8463-1cd6c18fbd6a] Start spawning the instance on the hypervisor. {{(pid=75045) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 23:25:12 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-03a4c0ee-568a-4663-a9ca-0617ba0edb13 tempest-TestStampPattern-2120781434 tempest-TestStampPattern-2120781434-project-member] [instance: 72c9d731-2b35-434c-8463-1cd6c18fbd6a] Creating instance directory {{(pid=75045) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 23:25:12 user nova-compute[75045]: INFO nova.virt.libvirt.driver [None req-03a4c0ee-568a-4663-a9ca-0617ba0edb13 tempest-TestStampPattern-2120781434 tempest-TestStampPattern-2120781434-project-member] [instance: 72c9d731-2b35-434c-8463-1cd6c18fbd6a] Creating image(s)
Nov 08 23:25:12 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-03a4c0ee-568a-4663-a9ca-0617ba0edb13 tempest-TestStampPattern-2120781434 tempest-TestStampPattern-2120781434-project-member] Acquiring lock "/opt/stack/data/nova/instances/72c9d731-2b35-434c-8463-1cd6c18fbd6a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:25:12 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-03a4c0ee-568a-4663-a9ca-0617ba0edb13 tempest-TestStampPattern-2120781434 tempest-TestStampPattern-2120781434-project-member] Lock "/opt/stack/data/nova/instances/72c9d731-2b35-434c-8463-1cd6c18fbd6a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:25:12 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-03a4c0ee-568a-4663-a9ca-0617ba0edb13 tempest-TestStampPattern-2120781434 tempest-TestStampPattern-2120781434-project-member] Lock "/opt/stack/data/nova/instances/72c9d731-2b35-434c-8463-1cd6c18fbd6a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.011s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:25:12 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-03a4c0ee-568a-4663-a9ca-0617ba0edb13 tempest-TestStampPattern-2120781434 tempest-TestStampPattern-2120781434-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b59f52a99fff51c56dd1edfb83892fb8f647f2f3 --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:25:12 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-0161cadb-17b4-40f1-af93-e3017f777832 tempest-VolumesAdminNegativeTest-215528111 tempest-VolumesAdminNegativeTest-215528111-project-member] Releasing lock "refresh_cache-7e92ab9a-8ea4-4452-a458-db181d4a59b7" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 23:25:12 user nova-compute[75045]: DEBUG nova.compute.manager [None req-0161cadb-17b4-40f1-af93-e3017f777832 tempest-VolumesAdminNegativeTest-215528111 tempest-VolumesAdminNegativeTest-215528111-project-member] [instance: 7e92ab9a-8ea4-4452-a458-db181d4a59b7] Instance network_info: |[{"id": "5bdaffe7-9bbb-4391-bd1e-406a8fb06ce8", "address": "fa:16:3e:13:a9:e5", "network": {"id": "e7c66e39-e1ba-4907-8701-33ae849858b2", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-420335537-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd25d9a8d6af45bb97e0555101d61489", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5bdaffe7-9b", "ovs_interfaceid": "5bdaffe7-9bbb-4391-bd1e-406a8fb06ce8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75045) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 23:25:12 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-e379e8b5-7d54-4ad3-ada6-4d451d4a3594 req-9d4f4eab-1354-4f71-b8d6-7a6bd2238483 service nova] Acquired lock "refresh_cache-7e92ab9a-8ea4-4452-a458-db181d4a59b7" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 23:25:12 user nova-compute[75045]: DEBUG nova.network.neutron [req-e379e8b5-7d54-4ad3-ada6-4d451d4a3594 req-9d4f4eab-1354-4f71-b8d6-7a6bd2238483 service nova] [instance: 7e92ab9a-8ea4-4452-a458-db181d4a59b7] Refreshing network info cache for port 5bdaffe7-9bbb-4391-bd1e-406a8fb06ce8 {{(pid=75045) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 23:25:12 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-0161cadb-17b4-40f1-af93-e3017f777832 tempest-VolumesAdminNegativeTest-215528111 tempest-VolumesAdminNegativeTest-215528111-project-member] [instance: 7e92ab9a-8ea4-4452-a458-db181d4a59b7] Start _get_guest_xml network_info=[{"id": "5bdaffe7-9bbb-4391-bd1e-406a8fb06ce8", "address": "fa:16:3e:13:a9:e5", "network": {"id": "e7c66e39-e1ba-4907-8701-33ae849858b2", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-420335537-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd25d9a8d6af45bb97e0555101d61489", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5bdaffe7-9b", "ovs_interfaceid": "5bdaffe7-9bbb-4391-bd1e-406a8fb06ce8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T23:11:54Z,direct_url=<?>,disk_format='qcow2',id=a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b1beba2cc4e7465ea249e2225fb494dc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T23:11:56Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'disk_bus': 'virtio', 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': 'a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75045) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 23:25:12 user nova-compute[75045]: WARNING nova.virt.libvirt.driver [None req-0161cadb-17b4-40f1-af93-e3017f777832 tempest-VolumesAdminNegativeTest-215528111 tempest-VolumesAdminNegativeTest-215528111-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 23:25:12 user nova-compute[75045]: WARNING nova.virt.libvirt.driver [None req-0161cadb-17b4-40f1-af93-e3017f777832 tempest-VolumesAdminNegativeTest-215528111 tempest-VolumesAdminNegativeTest-215528111-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 23:25:12 user nova-compute[75045]: DEBUG nova.virt.libvirt.host [None req-0161cadb-17b4-40f1-af93-e3017f777832 tempest-VolumesAdminNegativeTest-215528111 tempest-VolumesAdminNegativeTest-215528111-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75045) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 23:25:12 user nova-compute[75045]: DEBUG nova.virt.libvirt.host [None req-0161cadb-17b4-40f1-af93-e3017f777832 tempest-VolumesAdminNegativeTest-215528111 tempest-VolumesAdminNegativeTest-215528111-project-member] CPU controller missing on host. {{(pid=75045) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 23:25:12 user nova-compute[75045]: DEBUG nova.virt.libvirt.host [None req-0161cadb-17b4-40f1-af93-e3017f777832 tempest-VolumesAdminNegativeTest-215528111 tempest-VolumesAdminNegativeTest-215528111-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75045) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 23:25:12 user nova-compute[75045]: DEBUG nova.virt.libvirt.host [None req-0161cadb-17b4-40f1-af93-e3017f777832 tempest-VolumesAdminNegativeTest-215528111 tempest-VolumesAdminNegativeTest-215528111-project-member] CPU controller found on host. {{(pid=75045) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 23:25:12 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-0161cadb-17b4-40f1-af93-e3017f777832 tempest-VolumesAdminNegativeTest-215528111 tempest-VolumesAdminNegativeTest-215528111-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75045) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 23:25:12 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-0161cadb-17b4-40f1-af93-e3017f777832 tempest-VolumesAdminNegativeTest-215528111 tempest-VolumesAdminNegativeTest-215528111-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T23:11:41Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T23:11:54Z,direct_url=<?>,disk_format='qcow2',id=a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b1beba2cc4e7465ea249e2225fb494dc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T23:11:56Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75045) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 23:25:12 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-0161cadb-17b4-40f1-af93-e3017f777832 tempest-VolumesAdminNegativeTest-215528111 tempest-VolumesAdminNegativeTest-215528111-project-member] Flavor limits 0:0:0 {{(pid=75045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 23:25:12 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-0161cadb-17b4-40f1-af93-e3017f777832 tempest-VolumesAdminNegativeTest-215528111 tempest-VolumesAdminNegativeTest-215528111-project-member] Image limits 0:0:0 {{(pid=75045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 23:25:12 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-0161cadb-17b4-40f1-af93-e3017f777832 tempest-VolumesAdminNegativeTest-215528111 tempest-VolumesAdminNegativeTest-215528111-project-member] Flavor pref 0:0:0 {{(pid=75045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 23:25:12 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-0161cadb-17b4-40f1-af93-e3017f777832 tempest-VolumesAdminNegativeTest-215528111 tempest-VolumesAdminNegativeTest-215528111-project-member] Image pref 0:0:0 {{(pid=75045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 23:25:12 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-0161cadb-17b4-40f1-af93-e3017f777832 tempest-VolumesAdminNegativeTest-215528111 tempest-VolumesAdminNegativeTest-215528111-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 23:25:12 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-0161cadb-17b4-40f1-af93-e3017f777832 tempest-VolumesAdminNegativeTest-215528111 tempest-VolumesAdminNegativeTest-215528111-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75045) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 23:25:12 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-0161cadb-17b4-40f1-af93-e3017f777832 tempest-VolumesAdminNegativeTest-215528111 tempest-VolumesAdminNegativeTest-215528111-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75045) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 23:25:12 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-0161cadb-17b4-40f1-af93-e3017f777832 tempest-VolumesAdminNegativeTest-215528111 tempest-VolumesAdminNegativeTest-215528111-project-member] Got 1 possible topologies {{(pid=75045) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 23:25:12 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-0161cadb-17b4-40f1-af93-e3017f777832 tempest-VolumesAdminNegativeTest-215528111 tempest-VolumesAdminNegativeTest-215528111-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75045) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 23:25:12 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-0161cadb-17b4-40f1-af93-e3017f777832 tempest-VolumesAdminNegativeTest-215528111 tempest-VolumesAdminNegativeTest-215528111-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75045) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 23:25:12 user nova-compute[75045]: DEBUG nova.virt.libvirt.vif [None req-0161cadb-17b4-40f1-af93-e3017f777832 tempest-VolumesAdminNegativeTest-215528111 tempest-VolumesAdminNegativeTest-215528111-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T23:25:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-559874167',display_name='tempest-VolumesAdminNegativeTest-server-559874167',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-559874167',id=24,image_ref='a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB7OPaZAfHvKt2+E15oVkbPnvi9CoEAkVWC2gsPXrdwy5TaXskaero+dIwfo1KjXeaApqr82PEEkuBulV2Gy8m6wD2rx4wz7oc988QwEC4CPCZ8iGmin2Jsik9RO+6LnlA==',key_name='tempest-keypair-935892022',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fd25d9a8d6af45bb97e0555101d61489',ramdisk_id='',reservation_id='r-vh5l1bk0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-215528111',owner_user_name='tempest-VolumesAdminNegativeTest-215528111-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T23:25:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8e1203c75e084399aa70a7da8546b122',uuid=7e92ab9a-8ea4-4452-a458-db181d4a59b7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5bdaffe7-9bbb-4391-bd1e-406a8fb06ce8", "address": "fa:16:3e:13:a9:e5", "network": {"id": "e7c66e39-e1ba-4907-8701-33ae849858b2", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-420335537-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd25d9a8d6af45bb97e0555101d61489", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5bdaffe7-9b", "ovs_interfaceid": "5bdaffe7-9bbb-4391-bd1e-406a8fb06ce8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75045) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 23:25:12 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-0161cadb-17b4-40f1-af93-e3017f777832 tempest-VolumesAdminNegativeTest-215528111 tempest-VolumesAdminNegativeTest-215528111-project-member] Converting VIF {"id": "5bdaffe7-9bbb-4391-bd1e-406a8fb06ce8", "address": "fa:16:3e:13:a9:e5", "network": {"id": "e7c66e39-e1ba-4907-8701-33ae849858b2", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-420335537-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd25d9a8d6af45bb97e0555101d61489", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5bdaffe7-9b", "ovs_interfaceid": "5bdaffe7-9bbb-4391-bd1e-406a8fb06ce8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 23:25:12 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-0161cadb-17b4-40f1-af93-e3017f777832 tempest-VolumesAdminNegativeTest-215528111 tempest-VolumesAdminNegativeTest-215528111-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:13:a9:e5,bridge_name='br-int',has_traffic_filtering=True,id=5bdaffe7-9bbb-4391-bd1e-406a8fb06ce8,network=Network(e7c66e39-e1ba-4907-8701-33ae849858b2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5bdaffe7-9b') {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 23:25:12 user nova-compute[75045]: DEBUG nova.objects.instance [None req-0161cadb-17b4-40f1-af93-e3017f777832 tempest-VolumesAdminNegativeTest-215528111 tempest-VolumesAdminNegativeTest-215528111-project-member] Lazy-loading 'pci_devices' on Instance uuid 7e92ab9a-8ea4-4452-a458-db181d4a59b7 {{(pid=75045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 23:25:12 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-0161cadb-17b4-40f1-af93-e3017f777832 tempest-VolumesAdminNegativeTest-215528111 tempest-VolumesAdminNegativeTest-215528111-project-member] [instance: 7e92ab9a-8ea4-4452-a458-db181d4a59b7] End _get_guest_xml xml=<domain type="kvm">
Nov 08 23:25:12 user nova-compute[75045]:   <uuid>7e92ab9a-8ea4-4452-a458-db181d4a59b7</uuid>
Nov 08 23:25:12 user nova-compute[75045]:   <name>instance-00000018</name>
Nov 08 23:25:12 user nova-compute[75045]:   <memory>524288</memory>
Nov 08 23:25:12 user nova-compute[75045]:   <vcpu>1</vcpu>
Nov 08 23:25:12 user nova-compute[75045]:   <metadata>
Nov 08 23:25:12 user nova-compute[75045]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 23:25:12 user nova-compute[75045]:       <nova:package version="0.0.0"/>
Nov 08 23:25:12 user nova-compute[75045]:       <nova:name>tempest-VolumesAdminNegativeTest-server-559874167</nova:name>
Nov 08 23:25:12 user nova-compute[75045]:       <nova:creationTime>2023-11-08 23:25:12</nova:creationTime>
Nov 08 23:25:12 user nova-compute[75045]:       <nova:flavor name="m1.tiny">
Nov 08 23:25:12 user nova-compute[75045]:         <nova:memory>512</nova:memory>
Nov 08 23:25:12 user nova-compute[75045]:         <nova:disk>1</nova:disk>
Nov 08 23:25:12 user nova-compute[75045]:         <nova:swap>0</nova:swap>
Nov 08 23:25:12 user nova-compute[75045]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 23:25:12 user nova-compute[75045]:         <nova:vcpus>1</nova:vcpus>
Nov 08 23:25:12 user nova-compute[75045]:       </nova:flavor>
Nov 08 23:25:12 user nova-compute[75045]:       <nova:owner>
Nov 08 23:25:12 user nova-compute[75045]:         <nova:user uuid="8e1203c75e084399aa70a7da8546b122">tempest-VolumesAdminNegativeTest-215528111-project-member</nova:user>
Nov 08 23:25:12 user nova-compute[75045]:         <nova:project uuid="fd25d9a8d6af45bb97e0555101d61489">tempest-VolumesAdminNegativeTest-215528111</nova:project>
Nov 08 23:25:12 user nova-compute[75045]:       </nova:owner>
Nov 08 23:25:12 user nova-compute[75045]:       <nova:root type="image" uuid="a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb"/>
Nov 08 23:25:12 user nova-compute[75045]:       <nova:ports>
Nov 08 23:25:12 user nova-compute[75045]:         <nova:port uuid="5bdaffe7-9bbb-4391-bd1e-406a8fb06ce8">
Nov 08 23:25:12 user nova-compute[75045]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 08 23:25:12 user nova-compute[75045]:         </nova:port>
Nov 08 23:25:12 user nova-compute[75045]:       </nova:ports>
Nov 08 23:25:12 user nova-compute[75045]:     </nova:instance>
Nov 08 23:25:12 user nova-compute[75045]:   </metadata>
Nov 08 23:25:12 user nova-compute[75045]:   <sysinfo type="smbios">
Nov 08 23:25:12 user nova-compute[75045]:     <system>
Nov 08 23:25:12 user nova-compute[75045]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 23:25:12 user nova-compute[75045]:       <entry name="product">OpenStack Nova</entry>
Nov 08 23:25:12 user nova-compute[75045]:       <entry name="version">0.0.0</entry>
Nov 08 23:25:12 user nova-compute[75045]:       <entry name="serial">7e92ab9a-8ea4-4452-a458-db181d4a59b7</entry>
Nov 08 23:25:12 user nova-compute[75045]:       <entry name="uuid">7e92ab9a-8ea4-4452-a458-db181d4a59b7</entry>
Nov 08 23:25:12 user nova-compute[75045]:       <entry name="family">Virtual Machine</entry>
Nov 08 23:25:12 user nova-compute[75045]:     </system>
Nov 08 23:25:12 user nova-compute[75045]:   </sysinfo>
Nov 08 23:25:12 user nova-compute[75045]:   <os>
Nov 08 23:25:12 user nova-compute[75045]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 23:25:12 user nova-compute[75045]:     <boot dev="hd"/>
Nov 08 23:25:12 user nova-compute[75045]:     <smbios mode="sysinfo"/>
Nov 08 23:25:12 user nova-compute[75045]:   </os>
Nov 08 23:25:12 user nova-compute[75045]:   <features>
Nov 08 23:25:12 user nova-compute[75045]:     <acpi/>
Nov 08 23:25:12 user nova-compute[75045]:     <apic/>
Nov 08 23:25:12 user nova-compute[75045]:     <vmcoreinfo/>
Nov 08 23:25:12 user nova-compute[75045]:   </features>
Nov 08 23:25:12 user nova-compute[75045]:   <clock offset="utc">
Nov 08 23:25:12 user nova-compute[75045]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 23:25:12 user nova-compute[75045]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 23:25:12 user nova-compute[75045]:     <timer name="hpet" present="no"/>
Nov 08 23:25:12 user nova-compute[75045]:   </clock>
Nov 08 23:25:12 user nova-compute[75045]:   <cpu mode="custom" match="exact">
Nov 08 23:25:12 user nova-compute[75045]:     <model>Nehalem</model>
Nov 08 23:25:12 user nova-compute[75045]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 23:25:12 user nova-compute[75045]:   </cpu>
Nov 08 23:25:12 user nova-compute[75045]:   <devices>
Nov 08 23:25:12 user nova-compute[75045]:     <disk type="file" device="disk">
Nov 08 23:25:12 user nova-compute[75045]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 23:25:12 user nova-compute[75045]:       <source file="/opt/stack/data/nova/instances/7e92ab9a-8ea4-4452-a458-db181d4a59b7/disk"/>
Nov 08 23:25:12 user nova-compute[75045]:       <target dev="vda" bus="virtio"/>
Nov 08 23:25:12 user nova-compute[75045]:     </disk>
Nov 08 23:25:12 user nova-compute[75045]:     <interface type="ethernet">
Nov 08 23:25:12 user nova-compute[75045]:       <mac address="fa:16:3e:13:a9:e5"/>
Nov 08 23:25:12 user nova-compute[75045]:       <model type="virtio"/>
Nov 08 23:25:12 user nova-compute[75045]:       <mtu size="1442"/>
Nov 08 23:25:12 user nova-compute[75045]:       <target dev="tap5bdaffe7-9b"/>
Nov 08 23:25:12 user nova-compute[75045]:     </interface>
Nov 08 23:25:12 user nova-compute[75045]:     <serial type="pty">
Nov 08 23:25:12 user nova-compute[75045]:       <log file="/opt/stack/data/nova/instances/7e92ab9a-8ea4-4452-a458-db181d4a59b7/console.log" append="off"/>
Nov 08 23:25:12 user nova-compute[75045]:     </serial>
Nov 08 23:25:12 user nova-compute[75045]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 23:25:12 user nova-compute[75045]:     <video>
Nov 08 23:25:12 user nova-compute[75045]:       <model type="virtio"/>
Nov 08 23:25:12 user nova-compute[75045]:     </video>
Nov 08 23:25:12 user nova-compute[75045]:     <rng model="virtio">
Nov 08 23:25:12 user nova-compute[75045]:       <backend model="random">/dev/urandom</backend>
Nov 08 23:25:12 user nova-compute[75045]:     </rng>
Nov 08 23:25:12 user nova-compute[75045]:     <controller type="usb" index="0" model="none"/>
Nov 08 23:25:12 user nova-compute[75045]:     <memballoon model="virtio">
Nov 08 23:25:12 user nova-compute[75045]:       <stats period="10"/>
Nov 08 23:25:12 user nova-compute[75045]:     </memballoon>
Nov 08 23:25:12 user nova-compute[75045]:   </devices>
Nov 08 23:25:12 user nova-compute[75045]: </domain>
Nov 08 23:25:12 user nova-compute[75045]:  {{(pid=75045) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 23:25:12 user nova-compute[75045]: DEBUG nova.virt.libvirt.vif [None req-0161cadb-17b4-40f1-af93-e3017f777832 tempest-VolumesAdminNegativeTest-215528111 tempest-VolumesAdminNegativeTest-215528111-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T23:25:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-559874167',display_name='tempest-VolumesAdminNegativeTest-server-559874167',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-559874167',id=24,image_ref='a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB7OPaZAfHvKt2+E15oVkbPnvi9CoEAkVWC2gsPXrdwy5TaXskaero+dIwfo1KjXeaApqr82PEEkuBulV2Gy8m6wD2rx4wz7oc988QwEC4CPCZ8iGmin2Jsik9RO+6LnlA==',key_name='tempest-keypair-935892022',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fd25d9a8d6af45bb97e0555101d61489',ramdisk_id='',reservation_id='r-vh5l1bk0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-215528111',owner_user_name='tempest-VolumesAdminNegativeTest-215528111-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T23:25:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8e1203c75e084399aa70a7da8546b122',uuid=7e92ab9a-8ea4-4452-a458-db181d4a59b7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5bdaffe7-9bbb-4391-bd1e-406a8fb06ce8", "address": "fa:16:3e:13:a9:e5", "network": {"id": "e7c66e39-e1ba-4907-8701-33ae849858b2", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-420335537-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd25d9a8d6af45bb97e0555101d61489", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5bdaffe7-9b", "ovs_interfaceid": "5bdaffe7-9bbb-4391-bd1e-406a8fb06ce8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75045) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 23:25:12 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-0161cadb-17b4-40f1-af93-e3017f777832 tempest-VolumesAdminNegativeTest-215528111 tempest-VolumesAdminNegativeTest-215528111-project-member] Converting VIF {"id": "5bdaffe7-9bbb-4391-bd1e-406a8fb06ce8", "address": "fa:16:3e:13:a9:e5", "network": {"id": "e7c66e39-e1ba-4907-8701-33ae849858b2", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-420335537-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd25d9a8d6af45bb97e0555101d61489", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5bdaffe7-9b", "ovs_interfaceid": "5bdaffe7-9bbb-4391-bd1e-406a8fb06ce8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 23:25:12 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-0161cadb-17b4-40f1-af93-e3017f777832 tempest-VolumesAdminNegativeTest-215528111 tempest-VolumesAdminNegativeTest-215528111-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:13:a9:e5,bridge_name='br-int',has_traffic_filtering=True,id=5bdaffe7-9bbb-4391-bd1e-406a8fb06ce8,network=Network(e7c66e39-e1ba-4907-8701-33ae849858b2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5bdaffe7-9b') {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 23:25:12 user nova-compute[75045]: DEBUG os_vif [None req-0161cadb-17b4-40f1-af93-e3017f777832 tempest-VolumesAdminNegativeTest-215528111 tempest-VolumesAdminNegativeTest-215528111-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:13:a9:e5,bridge_name='br-int',has_traffic_filtering=True,id=5bdaffe7-9bbb-4391-bd1e-406a8fb06ce8,network=Network(e7c66e39-e1ba-4907-8701-33ae849858b2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5bdaffe7-9b') {{(pid=75045) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 23:25:12 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:25:12 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:25:12 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 23:25:12 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:25:12 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'bf1bf62f-cfe9-5782-bd4f-b25fb66ab11a', '_type': 'linux-noop'}}, row=False) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:25:12 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:25:12 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 23:25:12 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-03a4c0ee-568a-4663-a9ca-0617ba0edb13 tempest-TestStampPattern-2120781434 tempest-TestStampPattern-2120781434-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b59f52a99fff51c56dd1edfb83892fb8f647f2f3 --force-share --output=json" returned: 0 in 0.218s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:25:12 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-03a4c0ee-568a-4663-a9ca-0617ba0edb13 tempest-TestStampPattern-2120781434 tempest-TestStampPattern-2120781434-project-member] Acquiring lock "b59f52a99fff51c56dd1edfb83892fb8f647f2f3" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:25:12 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-03a4c0ee-568a-4663-a9ca-0617ba0edb13 tempest-TestStampPattern-2120781434 tempest-TestStampPattern-2120781434-project-member] Lock "b59f52a99fff51c56dd1edfb83892fb8f647f2f3" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:25:12 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-03a4c0ee-568a-4663-a9ca-0617ba0edb13 tempest-TestStampPattern-2120781434 tempest-TestStampPattern-2120781434-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b59f52a99fff51c56dd1edfb83892fb8f647f2f3 --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:25:12 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:25:12 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5bdaffe7-9b, may_exist=True, interface_attrs={}) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:25:12 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5bdaffe7-9b, col_values=(('qos', UUID('4c9bf376-166e-4435-9269-b51063a5d683')),), if_exists=True) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:25:12 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5bdaffe7-9b, col_values=(('external_ids', {'iface-id': '5bdaffe7-9bbb-4391-bd1e-406a8fb06ce8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:13:a9:e5', 'vm-uuid': '7e92ab9a-8ea4-4452-a458-db181d4a59b7'}),), if_exists=True) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:25:12 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:25:12 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 23:25:12 user nova-compute[75045]: INFO os_vif [None req-0161cadb-17b4-40f1-af93-e3017f777832 tempest-VolumesAdminNegativeTest-215528111 tempest-VolumesAdminNegativeTest-215528111-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:13:a9:e5,bridge_name='br-int',has_traffic_filtering=True,id=5bdaffe7-9bbb-4391-bd1e-406a8fb06ce8,network=Network(e7c66e39-e1ba-4907-8701-33ae849858b2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5bdaffe7-9b')
Nov 08 23:25:12 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-03a4c0ee-568a-4663-a9ca-0617ba0edb13 tempest-TestStampPattern-2120781434 tempest-TestStampPattern-2120781434-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b59f52a99fff51c56dd1edfb83892fb8f647f2f3 --force-share --output=json" returned: 0 in 0.199s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:25:12 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-03a4c0ee-568a-4663-a9ca-0617ba0edb13 tempest-TestStampPattern-2120781434 tempest-TestStampPattern-2120781434-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b59f52a99fff51c56dd1edfb83892fb8f647f2f3,backing_fmt=raw /opt/stack/data/nova/instances/72c9d731-2b35-434c-8463-1cd6c18fbd6a/disk 1073741824 {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:25:13 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-0161cadb-17b4-40f1-af93-e3017f777832 tempest-VolumesAdminNegativeTest-215528111 tempest-VolumesAdminNegativeTest-215528111-project-member] No BDM found with device name vda, not building metadata. {{(pid=75045) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 23:25:13 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-0161cadb-17b4-40f1-af93-e3017f777832 tempest-VolumesAdminNegativeTest-215528111 tempest-VolumesAdminNegativeTest-215528111-project-member] No VIF found with MAC fa:16:3e:13:a9:e5, not building metadata {{(pid=75045) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 23:25:13 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-03a4c0ee-568a-4663-a9ca-0617ba0edb13 tempest-TestStampPattern-2120781434 tempest-TestStampPattern-2120781434-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b59f52a99fff51c56dd1edfb83892fb8f647f2f3,backing_fmt=raw /opt/stack/data/nova/instances/72c9d731-2b35-434c-8463-1cd6c18fbd6a/disk 1073741824" returned: 0 in 0.070s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:25:13 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-03a4c0ee-568a-4663-a9ca-0617ba0edb13 tempest-TestStampPattern-2120781434 tempest-TestStampPattern-2120781434-project-member] Lock "b59f52a99fff51c56dd1edfb83892fb8f647f2f3" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.272s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:25:13 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-03a4c0ee-568a-4663-a9ca-0617ba0edb13 tempest-TestStampPattern-2120781434 tempest-TestStampPattern-2120781434-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b59f52a99fff51c56dd1edfb83892fb8f647f2f3 --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:25:13 user nova-compute[75045]: DEBUG nova.network.neutron [req-e379e8b5-7d54-4ad3-ada6-4d451d4a3594 req-9d4f4eab-1354-4f71-b8d6-7a6bd2238483 service nova] [instance: 7e92ab9a-8ea4-4452-a458-db181d4a59b7] Updated VIF entry in instance network info cache for port 5bdaffe7-9bbb-4391-bd1e-406a8fb06ce8. {{(pid=75045) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 23:25:13 user nova-compute[75045]: DEBUG nova.network.neutron [req-e379e8b5-7d54-4ad3-ada6-4d451d4a3594 req-9d4f4eab-1354-4f71-b8d6-7a6bd2238483 service nova] [instance: 7e92ab9a-8ea4-4452-a458-db181d4a59b7] Updating instance_info_cache with network_info: [{"id": "5bdaffe7-9bbb-4391-bd1e-406a8fb06ce8", "address": "fa:16:3e:13:a9:e5", "network": {"id": "e7c66e39-e1ba-4907-8701-33ae849858b2", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-420335537-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd25d9a8d6af45bb97e0555101d61489", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5bdaffe7-9b", "ovs_interfaceid": "5bdaffe7-9bbb-4391-bd1e-406a8fb06ce8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75045) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 23:25:13 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-03a4c0ee-568a-4663-a9ca-0617ba0edb13 tempest-TestStampPattern-2120781434 tempest-TestStampPattern-2120781434-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b59f52a99fff51c56dd1edfb83892fb8f647f2f3 --force-share --output=json" returned: 0 in 0.195s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:25:13 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-e379e8b5-7d54-4ad3-ada6-4d451d4a3594 req-9d4f4eab-1354-4f71-b8d6-7a6bd2238483 service nova] Releasing lock "refresh_cache-7e92ab9a-8ea4-4452-a458-db181d4a59b7" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 23:25:13 user nova-compute[75045]: DEBUG nova.virt.disk.api [None req-03a4c0ee-568a-4663-a9ca-0617ba0edb13 tempest-TestStampPattern-2120781434 tempest-TestStampPattern-2120781434-project-member] Checking if we can resize image /opt/stack/data/nova/instances/72c9d731-2b35-434c-8463-1cd6c18fbd6a/disk. size=1073741824 {{(pid=75045) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 23:25:13 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-03a4c0ee-568a-4663-a9ca-0617ba0edb13 tempest-TestStampPattern-2120781434 tempest-TestStampPattern-2120781434-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72c9d731-2b35-434c-8463-1cd6c18fbd6a/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:25:13 user nova-compute[75045]: DEBUG nova.network.neutron [None req-03a4c0ee-568a-4663-a9ca-0617ba0edb13 tempest-TestStampPattern-2120781434 tempest-TestStampPattern-2120781434-project-member] [instance: 72c9d731-2b35-434c-8463-1cd6c18fbd6a] Successfully created port: 996f98bd-77bf-4176-8fe3-ea98b0c070a0 {{(pid=75045) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 23:25:13 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-03a4c0ee-568a-4663-a9ca-0617ba0edb13 tempest-TestStampPattern-2120781434 tempest-TestStampPattern-2120781434-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72c9d731-2b35-434c-8463-1cd6c18fbd6a/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:25:13 user nova-compute[75045]: DEBUG nova.virt.disk.api [None req-03a4c0ee-568a-4663-a9ca-0617ba0edb13 tempest-TestStampPattern-2120781434 tempest-TestStampPattern-2120781434-project-member] Cannot resize image /opt/stack/data/nova/instances/72c9d731-2b35-434c-8463-1cd6c18fbd6a/disk to a smaller size. {{(pid=75045) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 08 23:25:13 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-03a4c0ee-568a-4663-a9ca-0617ba0edb13 tempest-TestStampPattern-2120781434 tempest-TestStampPattern-2120781434-project-member] [instance: 72c9d731-2b35-434c-8463-1cd6c18fbd6a] Created local disks {{(pid=75045) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 23:25:13 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-03a4c0ee-568a-4663-a9ca-0617ba0edb13 tempest-TestStampPattern-2120781434 tempest-TestStampPattern-2120781434-project-member] [instance: 72c9d731-2b35-434c-8463-1cd6c18fbd6a] Ensure instance console log exists: /opt/stack/data/nova/instances/72c9d731-2b35-434c-8463-1cd6c18fbd6a/console.log {{(pid=75045) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 23:25:13 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-03a4c0ee-568a-4663-a9ca-0617ba0edb13 tempest-TestStampPattern-2120781434 tempest-TestStampPattern-2120781434-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:25:13 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-03a4c0ee-568a-4663-a9ca-0617ba0edb13 tempest-TestStampPattern-2120781434 tempest-TestStampPattern-2120781434-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:25:13 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-03a4c0ee-568a-4663-a9ca-0617ba0edb13 tempest-TestStampPattern-2120781434 tempest-TestStampPattern-2120781434-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:25:13 user nova-compute[75045]: DEBUG nova.network.neutron [None req-03a4c0ee-568a-4663-a9ca-0617ba0edb13 tempest-TestStampPattern-2120781434 tempest-TestStampPattern-2120781434-project-member] [instance: 72c9d731-2b35-434c-8463-1cd6c18fbd6a] Successfully updated port: 996f98bd-77bf-4176-8fe3-ea98b0c070a0 {{(pid=75045) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 23:25:13 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-03a4c0ee-568a-4663-a9ca-0617ba0edb13 tempest-TestStampPattern-2120781434 tempest-TestStampPattern-2120781434-project-member] Acquiring lock "refresh_cache-72c9d731-2b35-434c-8463-1cd6c18fbd6a" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 23:25:13 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-03a4c0ee-568a-4663-a9ca-0617ba0edb13 tempest-TestStampPattern-2120781434 tempest-TestStampPattern-2120781434-project-member] Acquired lock "refresh_cache-72c9d731-2b35-434c-8463-1cd6c18fbd6a" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 23:25:13 user nova-compute[75045]: DEBUG nova.network.neutron [None req-03a4c0ee-568a-4663-a9ca-0617ba0edb13 tempest-TestStampPattern-2120781434 tempest-TestStampPattern-2120781434-project-member] [instance: 72c9d731-2b35-434c-8463-1cd6c18fbd6a] Building network info cache for instance {{(pid=75045) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 23:25:13 user nova-compute[75045]: DEBUG nova.compute.manager [req-b6a50dd4-bbc0-4a8f-9773-c16135dc00a4 req-ed0f1a92-f591-4689-a985-e25387a7ff4e service nova] [instance: 72c9d731-2b35-434c-8463-1cd6c18fbd6a] Received event network-changed-996f98bd-77bf-4176-8fe3-ea98b0c070a0 {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:25:13 user nova-compute[75045]: DEBUG nova.compute.manager [req-b6a50dd4-bbc0-4a8f-9773-c16135dc00a4 req-ed0f1a92-f591-4689-a985-e25387a7ff4e service nova] [instance: 72c9d731-2b35-434c-8463-1cd6c18fbd6a] Refreshing instance network info cache due to event network-changed-996f98bd-77bf-4176-8fe3-ea98b0c070a0. {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 23:25:13 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-b6a50dd4-bbc0-4a8f-9773-c16135dc00a4 req-ed0f1a92-f591-4689-a985-e25387a7ff4e service nova] Acquiring lock "refresh_cache-72c9d731-2b35-434c-8463-1cd6c18fbd6a" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 23:25:14 user nova-compute[75045]: DEBUG nova.network.neutron [None req-03a4c0ee-568a-4663-a9ca-0617ba0edb13 tempest-TestStampPattern-2120781434 tempest-TestStampPattern-2120781434-project-member] [instance: 72c9d731-2b35-434c-8463-1cd6c18fbd6a] Instance cache missing network info. {{(pid=75045) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 23:25:14 user nova-compute[75045]: DEBUG nova.network.neutron [None req-03a4c0ee-568a-4663-a9ca-0617ba0edb13 tempest-TestStampPattern-2120781434 tempest-TestStampPattern-2120781434-project-member] [instance: 72c9d731-2b35-434c-8463-1cd6c18fbd6a] Updating instance_info_cache with network_info: [{"id": "996f98bd-77bf-4176-8fe3-ea98b0c070a0", "address": "fa:16:3e:bb:6f:51", "network": {"id": "94c5462e-c9fd-44e6-b02b-9d46156ca7d9", "bridge": "br-int", "label": "tempest-TestStampPattern-1038298369-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "824ed65954dd4eccbe68827aa92fd99f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap996f98bd-77", "ovs_interfaceid": "996f98bd-77bf-4176-8fe3-ea98b0c070a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75045) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 23:25:14 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-03a4c0ee-568a-4663-a9ca-0617ba0edb13 tempest-TestStampPattern-2120781434 tempest-TestStampPattern-2120781434-project-member] Releasing lock "refresh_cache-72c9d731-2b35-434c-8463-1cd6c18fbd6a" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 23:25:14 user nova-compute[75045]: DEBUG nova.compute.manager [None req-03a4c0ee-568a-4663-a9ca-0617ba0edb13 tempest-TestStampPattern-2120781434 tempest-TestStampPattern-2120781434-project-member] [instance: 72c9d731-2b35-434c-8463-1cd6c18fbd6a] Instance network_info: |[{"id": "996f98bd-77bf-4176-8fe3-ea98b0c070a0", "address": "fa:16:3e:bb:6f:51", "network": {"id": "94c5462e-c9fd-44e6-b02b-9d46156ca7d9", "bridge": "br-int", "label": "tempest-TestStampPattern-1038298369-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "824ed65954dd4eccbe68827aa92fd99f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap996f98bd-77", "ovs_interfaceid": "996f98bd-77bf-4176-8fe3-ea98b0c070a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75045) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 23:25:14 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-b6a50dd4-bbc0-4a8f-9773-c16135dc00a4 req-ed0f1a92-f591-4689-a985-e25387a7ff4e service nova] Acquired lock "refresh_cache-72c9d731-2b35-434c-8463-1cd6c18fbd6a" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 23:25:14 user nova-compute[75045]: DEBUG nova.network.neutron [req-b6a50dd4-bbc0-4a8f-9773-c16135dc00a4 req-ed0f1a92-f591-4689-a985-e25387a7ff4e service nova] [instance: 72c9d731-2b35-434c-8463-1cd6c18fbd6a] Refreshing network info cache for port 996f98bd-77bf-4176-8fe3-ea98b0c070a0 {{(pid=75045) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 23:25:14 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-03a4c0ee-568a-4663-a9ca-0617ba0edb13 tempest-TestStampPattern-2120781434 tempest-TestStampPattern-2120781434-project-member] [instance: 72c9d731-2b35-434c-8463-1cd6c18fbd6a] Start _get_guest_xml network_info=[{"id": "996f98bd-77bf-4176-8fe3-ea98b0c070a0", "address": "fa:16:3e:bb:6f:51", "network": {"id": "94c5462e-c9fd-44e6-b02b-9d46156ca7d9", "bridge": "br-int", "label": "tempest-TestStampPattern-1038298369-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "824ed65954dd4eccbe68827aa92fd99f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap996f98bd-77", "ovs_interfaceid": "996f98bd-77bf-4176-8fe3-ea98b0c070a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T23:11:54Z,direct_url=<?>,disk_format='qcow2',id=a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b1beba2cc4e7465ea249e2225fb494dc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T23:11:56Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'disk_bus': 'virtio', 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': 'a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75045) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 23:25:14 user nova-compute[75045]: WARNING nova.virt.libvirt.driver [None req-03a4c0ee-568a-4663-a9ca-0617ba0edb13 tempest-TestStampPattern-2120781434 tempest-TestStampPattern-2120781434-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 23:25:14 user nova-compute[75045]: WARNING nova.virt.libvirt.driver [None req-03a4c0ee-568a-4663-a9ca-0617ba0edb13 tempest-TestStampPattern-2120781434 tempest-TestStampPattern-2120781434-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 23:25:14 user nova-compute[75045]: DEBUG nova.virt.libvirt.host [None req-03a4c0ee-568a-4663-a9ca-0617ba0edb13 tempest-TestStampPattern-2120781434 tempest-TestStampPattern-2120781434-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75045) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 23:25:14 user nova-compute[75045]: DEBUG nova.virt.libvirt.host [None req-03a4c0ee-568a-4663-a9ca-0617ba0edb13 tempest-TestStampPattern-2120781434 tempest-TestStampPattern-2120781434-project-member] CPU controller missing on host. {{(pid=75045) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 23:25:14 user nova-compute[75045]: DEBUG nova.virt.libvirt.host [None req-03a4c0ee-568a-4663-a9ca-0617ba0edb13 tempest-TestStampPattern-2120781434 tempest-TestStampPattern-2120781434-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75045) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 23:25:14 user nova-compute[75045]: DEBUG nova.virt.libvirt.host [None req-03a4c0ee-568a-4663-a9ca-0617ba0edb13 tempest-TestStampPattern-2120781434 tempest-TestStampPattern-2120781434-project-member] CPU controller found on host. {{(pid=75045) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 23:25:14 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-03a4c0ee-568a-4663-a9ca-0617ba0edb13 tempest-TestStampPattern-2120781434 tempest-TestStampPattern-2120781434-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75045) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 23:25:14 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-03a4c0ee-568a-4663-a9ca-0617ba0edb13 tempest-TestStampPattern-2120781434 tempest-TestStampPattern-2120781434-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T23:11:41Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T23:11:54Z,direct_url=<?>,disk_format='qcow2',id=a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b1beba2cc4e7465ea249e2225fb494dc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T23:11:56Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75045) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 23:25:14 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-03a4c0ee-568a-4663-a9ca-0617ba0edb13 tempest-TestStampPattern-2120781434 tempest-TestStampPattern-2120781434-project-member] Flavor limits 0:0:0 {{(pid=75045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 23:25:14 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-03a4c0ee-568a-4663-a9ca-0617ba0edb13 tempest-TestStampPattern-2120781434 tempest-TestStampPattern-2120781434-project-member] Image limits 0:0:0 {{(pid=75045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 23:25:14 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-03a4c0ee-568a-4663-a9ca-0617ba0edb13 tempest-TestStampPattern-2120781434 tempest-TestStampPattern-2120781434-project-member] Flavor pref 0:0:0 {{(pid=75045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 23:25:14 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-03a4c0ee-568a-4663-a9ca-0617ba0edb13 tempest-TestStampPattern-2120781434 tempest-TestStampPattern-2120781434-project-member] Image pref 0:0:0 {{(pid=75045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 23:25:14 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-03a4c0ee-568a-4663-a9ca-0617ba0edb13 tempest-TestStampPattern-2120781434 tempest-TestStampPattern-2120781434-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 23:25:14 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-03a4c0ee-568a-4663-a9ca-0617ba0edb13 tempest-TestStampPattern-2120781434 tempest-TestStampPattern-2120781434-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75045) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 23:25:14 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-03a4c0ee-568a-4663-a9ca-0617ba0edb13 tempest-TestStampPattern-2120781434 tempest-TestStampPattern-2120781434-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75045) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 23:25:14 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-03a4c0ee-568a-4663-a9ca-0617ba0edb13 tempest-TestStampPattern-2120781434 tempest-TestStampPattern-2120781434-project-member] Got 1 possible topologies {{(pid=75045) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 23:25:14 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-03a4c0ee-568a-4663-a9ca-0617ba0edb13 tempest-TestStampPattern-2120781434 tempest-TestStampPattern-2120781434-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75045) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 23:25:14 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-03a4c0ee-568a-4663-a9ca-0617ba0edb13 tempest-TestStampPattern-2120781434 tempest-TestStampPattern-2120781434-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75045) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 23:25:14 user nova-compute[75045]: DEBUG nova.virt.libvirt.vif [None req-03a4c0ee-568a-4663-a9ca-0617ba0edb13 tempest-TestStampPattern-2120781434 tempest-TestStampPattern-2120781434-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T23:25:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-107227434',display_name='tempest-TestStampPattern-server-107227434',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-107227434',id=25,image_ref='a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEtB72lJ3QT0CbDqyUaMKflPueQqHWlBr/SKULenQ3hS/jygD0NlusOQCbd9nWih3JtFTCaVE0qH0L8SGPLvq+HuEpKiKftv45ffcKHaW5G6qCsZvzG9WD6hpehyxZCg9w==',key_name='tempest-TestStampPattern-276203308',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='824ed65954dd4eccbe68827aa92fd99f',ramdisk_id='',reservation_id='r-t957pnu1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-2120781434',owner_user_name='tempest-TestStampPattern-2120781434-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T23:25:12Z,user_data=None,user_id='5aea9d6528d3454eaf0f8b2cc9df7c46',uuid=72c9d731-2b35-434c-8463-1cd6c18fbd6a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "996f98bd-77bf-4176-8fe3-ea98b0c070a0", "address": "fa:16:3e:bb:6f:51", "network": {"id": "94c5462e-c9fd-44e6-b02b-9d46156ca7d9", "bridge": "br-int", "label": "tempest-TestStampPattern-1038298369-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "824ed65954dd4eccbe68827aa92fd99f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap996f98bd-77", "ovs_interfaceid": "996f98bd-77bf-4176-8fe3-ea98b0c070a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75045) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 23:25:14 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-03a4c0ee-568a-4663-a9ca-0617ba0edb13 tempest-TestStampPattern-2120781434 tempest-TestStampPattern-2120781434-project-member] Converting VIF {"id": "996f98bd-77bf-4176-8fe3-ea98b0c070a0", "address": "fa:16:3e:bb:6f:51", "network": {"id": "94c5462e-c9fd-44e6-b02b-9d46156ca7d9", "bridge": "br-int", "label": "tempest-TestStampPattern-1038298369-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "824ed65954dd4eccbe68827aa92fd99f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap996f98bd-77", "ovs_interfaceid": "996f98bd-77bf-4176-8fe3-ea98b0c070a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 23:25:14 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-03a4c0ee-568a-4663-a9ca-0617ba0edb13 tempest-TestStampPattern-2120781434 tempest-TestStampPattern-2120781434-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bb:6f:51,bridge_name='br-int',has_traffic_filtering=True,id=996f98bd-77bf-4176-8fe3-ea98b0c070a0,network=Network(94c5462e-c9fd-44e6-b02b-9d46156ca7d9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap996f98bd-77') {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 23:25:14 user nova-compute[75045]: DEBUG nova.objects.instance [None req-03a4c0ee-568a-4663-a9ca-0617ba0edb13 tempest-TestStampPattern-2120781434 tempest-TestStampPattern-2120781434-project-member] Lazy-loading 'pci_devices' on Instance uuid 72c9d731-2b35-434c-8463-1cd6c18fbd6a {{(pid=75045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 23:25:14 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:25:14 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-03a4c0ee-568a-4663-a9ca-0617ba0edb13 tempest-TestStampPattern-2120781434 tempest-TestStampPattern-2120781434-project-member] [instance: 72c9d731-2b35-434c-8463-1cd6c18fbd6a] End _get_guest_xml xml=<domain type="kvm">
Nov 08 23:25:14 user nova-compute[75045]:   <uuid>72c9d731-2b35-434c-8463-1cd6c18fbd6a</uuid>
Nov 08 23:25:14 user nova-compute[75045]:   <name>instance-00000019</name>
Nov 08 23:25:14 user nova-compute[75045]:   <memory>524288</memory>
Nov 08 23:25:14 user nova-compute[75045]:   <vcpu>1</vcpu>
Nov 08 23:25:14 user nova-compute[75045]:   <metadata>
Nov 08 23:25:14 user nova-compute[75045]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 23:25:14 user nova-compute[75045]:       <nova:package version="0.0.0"/>
Nov 08 23:25:14 user nova-compute[75045]:       <nova:name>tempest-TestStampPattern-server-107227434</nova:name>
Nov 08 23:25:14 user nova-compute[75045]:       <nova:creationTime>2023-11-08 23:25:14</nova:creationTime>
Nov 08 23:25:14 user nova-compute[75045]:       <nova:flavor name="m1.tiny">
Nov 08 23:25:14 user nova-compute[75045]:         <nova:memory>512</nova:memory>
Nov 08 23:25:14 user nova-compute[75045]:         <nova:disk>1</nova:disk>
Nov 08 23:25:14 user nova-compute[75045]:         <nova:swap>0</nova:swap>
Nov 08 23:25:14 user nova-compute[75045]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 23:25:14 user nova-compute[75045]:         <nova:vcpus>1</nova:vcpus>
Nov 08 23:25:14 user nova-compute[75045]:       </nova:flavor>
Nov 08 23:25:14 user nova-compute[75045]:       <nova:owner>
Nov 08 23:25:14 user nova-compute[75045]:         <nova:user uuid="5aea9d6528d3454eaf0f8b2cc9df7c46">tempest-TestStampPattern-2120781434-project-member</nova:user>
Nov 08 23:25:14 user nova-compute[75045]:         <nova:project uuid="824ed65954dd4eccbe68827aa92fd99f">tempest-TestStampPattern-2120781434</nova:project>
Nov 08 23:25:14 user nova-compute[75045]:       </nova:owner>
Nov 08 23:25:14 user nova-compute[75045]:       <nova:root type="image" uuid="a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb"/>
Nov 08 23:25:14 user nova-compute[75045]:       <nova:ports>
Nov 08 23:25:14 user nova-compute[75045]:         <nova:port uuid="996f98bd-77bf-4176-8fe3-ea98b0c070a0">
Nov 08 23:25:14 user nova-compute[75045]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 08 23:25:14 user nova-compute[75045]:         </nova:port>
Nov 08 23:25:14 user nova-compute[75045]:       </nova:ports>
Nov 08 23:25:14 user nova-compute[75045]:     </nova:instance>
Nov 08 23:25:14 user nova-compute[75045]:   </metadata>
Nov 08 23:25:14 user nova-compute[75045]:   <sysinfo type="smbios">
Nov 08 23:25:14 user nova-compute[75045]:     <system>
Nov 08 23:25:14 user nova-compute[75045]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 23:25:14 user nova-compute[75045]:       <entry name="product">OpenStack Nova</entry>
Nov 08 23:25:14 user nova-compute[75045]:       <entry name="version">0.0.0</entry>
Nov 08 23:25:14 user nova-compute[75045]:       <entry name="serial">72c9d731-2b35-434c-8463-1cd6c18fbd6a</entry>
Nov 08 23:25:14 user nova-compute[75045]:       <entry name="uuid">72c9d731-2b35-434c-8463-1cd6c18fbd6a</entry>
Nov 08 23:25:14 user nova-compute[75045]:       <entry name="family">Virtual Machine</entry>
Nov 08 23:25:14 user nova-compute[75045]:     </system>
Nov 08 23:25:14 user nova-compute[75045]:   </sysinfo>
Nov 08 23:25:14 user nova-compute[75045]:   <os>
Nov 08 23:25:14 user nova-compute[75045]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 23:25:14 user nova-compute[75045]:     <boot dev="hd"/>
Nov 08 23:25:14 user nova-compute[75045]:     <smbios mode="sysinfo"/>
Nov 08 23:25:14 user nova-compute[75045]:   </os>
Nov 08 23:25:14 user nova-compute[75045]:   <features>
Nov 08 23:25:14 user nova-compute[75045]:     <acpi/>
Nov 08 23:25:14 user nova-compute[75045]:     <apic/>
Nov 08 23:25:14 user nova-compute[75045]:     <vmcoreinfo/>
Nov 08 23:25:14 user nova-compute[75045]:   </features>
Nov 08 23:25:14 user nova-compute[75045]:   <clock offset="utc">
Nov 08 23:25:14 user nova-compute[75045]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 23:25:14 user nova-compute[75045]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 23:25:14 user nova-compute[75045]:     <timer name="hpet" present="no"/>
Nov 08 23:25:14 user nova-compute[75045]:   </clock>
Nov 08 23:25:14 user nova-compute[75045]:   <cpu mode="custom" match="exact">
Nov 08 23:25:14 user nova-compute[75045]:     <model>Nehalem</model>
Nov 08 23:25:14 user nova-compute[75045]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 23:25:14 user nova-compute[75045]:   </cpu>
Nov 08 23:25:14 user nova-compute[75045]:   <devices>
Nov 08 23:25:14 user nova-compute[75045]:     <disk type="file" device="disk">
Nov 08 23:25:14 user nova-compute[75045]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 23:25:14 user nova-compute[75045]:       <source file="/opt/stack/data/nova/instances/72c9d731-2b35-434c-8463-1cd6c18fbd6a/disk"/>
Nov 08 23:25:14 user nova-compute[75045]:       <target dev="vda" bus="virtio"/>
Nov 08 23:25:14 user nova-compute[75045]:     </disk>
Nov 08 23:25:14 user nova-compute[75045]:     <interface type="ethernet">
Nov 08 23:25:14 user nova-compute[75045]:       <mac address="fa:16:3e:bb:6f:51"/>
Nov 08 23:25:14 user nova-compute[75045]:       <model type="virtio"/>
Nov 08 23:25:14 user nova-compute[75045]:       <mtu size="1442"/>
Nov 08 23:25:14 user nova-compute[75045]:       <target dev="tap996f98bd-77"/>
Nov 08 23:25:14 user nova-compute[75045]:     </interface>
Nov 08 23:25:14 user nova-compute[75045]:     <serial type="pty">
Nov 08 23:25:14 user nova-compute[75045]:       <log file="/opt/stack/data/nova/instances/72c9d731-2b35-434c-8463-1cd6c18fbd6a/console.log" append="off"/>
Nov 08 23:25:14 user nova-compute[75045]:     </serial>
Nov 08 23:25:14 user nova-compute[75045]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 23:25:14 user nova-compute[75045]:     <video>
Nov 08 23:25:14 user nova-compute[75045]:       <model type="virtio"/>
Nov 08 23:25:14 user nova-compute[75045]:     </video>
Nov 08 23:25:14 user nova-compute[75045]:     <rng model="virtio">
Nov 08 23:25:14 user nova-compute[75045]:       <backend model="random">/dev/urandom</backend>
Nov 08 23:25:14 user nova-compute[75045]:     </rng>
Nov 08 23:25:14 user nova-compute[75045]:     <controller type="usb" index="0" model="none"/>
Nov 08 23:25:14 user nova-compute[75045]:     <memballoon model="virtio">
Nov 08 23:25:14 user nova-compute[75045]:       <stats period="10"/>
Nov 08 23:25:14 user nova-compute[75045]:     </memballoon>
Nov 08 23:25:14 user nova-compute[75045]:   </devices>
Nov 08 23:25:14 user nova-compute[75045]: </domain>
Nov 08 23:25:14 user nova-compute[75045]:  {{(pid=75045) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 23:25:14 user nova-compute[75045]: DEBUG nova.virt.libvirt.vif [None req-03a4c0ee-568a-4663-a9ca-0617ba0edb13 tempest-TestStampPattern-2120781434 tempest-TestStampPattern-2120781434-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T23:25:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-107227434',display_name='tempest-TestStampPattern-server-107227434',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-107227434',id=25,image_ref='a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEtB72lJ3QT0CbDqyUaMKflPueQqHWlBr/SKULenQ3hS/jygD0NlusOQCbd9nWih3JtFTCaVE0qH0L8SGPLvq+HuEpKiKftv45ffcKHaW5G6qCsZvzG9WD6hpehyxZCg9w==',key_name='tempest-TestStampPattern-276203308',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='824ed65954dd4eccbe68827aa92fd99f',ramdisk_id='',reservation_id='r-t957pnu1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-2120781434',owner_user_name='tempest-TestStampPattern-2120781434-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T23:25:12Z,user_data=None,user_id='5aea9d6528d3454eaf0f8b2cc9df7c46',uuid=72c9d731-2b35-434c-8463-1cd6c18fbd6a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "996f98bd-77bf-4176-8fe3-ea98b0c070a0", "address": "fa:16:3e:bb:6f:51", "network": {"id": "94c5462e-c9fd-44e6-b02b-9d46156ca7d9", "bridge": "br-int", "label": "tempest-TestStampPattern-1038298369-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "824ed65954dd4eccbe68827aa92fd99f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap996f98bd-77", "ovs_interfaceid": "996f98bd-77bf-4176-8fe3-ea98b0c070a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75045) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 23:25:14 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-03a4c0ee-568a-4663-a9ca-0617ba0edb13 tempest-TestStampPattern-2120781434 tempest-TestStampPattern-2120781434-project-member] Converting VIF {"id": "996f98bd-77bf-4176-8fe3-ea98b0c070a0", "address": "fa:16:3e:bb:6f:51", "network": {"id": "94c5462e-c9fd-44e6-b02b-9d46156ca7d9", "bridge": "br-int", "label": "tempest-TestStampPattern-1038298369-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "824ed65954dd4eccbe68827aa92fd99f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap996f98bd-77", "ovs_interfaceid": "996f98bd-77bf-4176-8fe3-ea98b0c070a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 23:25:14 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-03a4c0ee-568a-4663-a9ca-0617ba0edb13 tempest-TestStampPattern-2120781434 tempest-TestStampPattern-2120781434-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bb:6f:51,bridge_name='br-int',has_traffic_filtering=True,id=996f98bd-77bf-4176-8fe3-ea98b0c070a0,network=Network(94c5462e-c9fd-44e6-b02b-9d46156ca7d9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap996f98bd-77') {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 23:25:14 user nova-compute[75045]: DEBUG os_vif [None req-03a4c0ee-568a-4663-a9ca-0617ba0edb13 tempest-TestStampPattern-2120781434 tempest-TestStampPattern-2120781434-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bb:6f:51,bridge_name='br-int',has_traffic_filtering=True,id=996f98bd-77bf-4176-8fe3-ea98b0c070a0,network=Network(94c5462e-c9fd-44e6-b02b-9d46156ca7d9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap996f98bd-77') {{(pid=75045) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 23:25:14 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:25:14 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:25:14 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 23:25:14 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:25:14 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:25:14 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '837c3fe5-360b-5b4c-9cb0-31cb7cb30381', '_type': 'linux-noop'}}, row=False) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:25:14 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 23:25:14 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:25:14 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap996f98bd-77, may_exist=True, interface_attrs={}) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:25:14 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap996f98bd-77, col_values=(('qos', UUID('e6796033-100a-46a1-b174-30180dcce511')),), if_exists=True) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:25:14 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap996f98bd-77, col_values=(('external_ids', {'iface-id': '996f98bd-77bf-4176-8fe3-ea98b0c070a0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:bb:6f:51', 'vm-uuid': '72c9d731-2b35-434c-8463-1cd6c18fbd6a'}),), if_exists=True) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:25:14 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:25:14 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 23:25:14 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:25:14 user nova-compute[75045]: INFO os_vif [None req-03a4c0ee-568a-4663-a9ca-0617ba0edb13 tempest-TestStampPattern-2120781434 tempest-TestStampPattern-2120781434-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bb:6f:51,bridge_name='br-int',has_traffic_filtering=True,id=996f98bd-77bf-4176-8fe3-ea98b0c070a0,network=Network(94c5462e-c9fd-44e6-b02b-9d46156ca7d9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap996f98bd-77')
Nov 08 23:25:14 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-03a4c0ee-568a-4663-a9ca-0617ba0edb13 tempest-TestStampPattern-2120781434 tempest-TestStampPattern-2120781434-project-member] No BDM found with device name vda, not building metadata. {{(pid=75045) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 23:25:14 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-03a4c0ee-568a-4663-a9ca-0617ba0edb13 tempest-TestStampPattern-2120781434 tempest-TestStampPattern-2120781434-project-member] No VIF found with MAC fa:16:3e:bb:6f:51, not building metadata {{(pid=75045) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 23:25:14 user nova-compute[75045]: DEBUG nova.compute.manager [req-e734a4b4-99a2-4ad5-b018-f9a1589574a6 req-70b1bb99-d4aa-42ae-b555-2168de85d7e9 service nova] [instance: 7e92ab9a-8ea4-4452-a458-db181d4a59b7] Received event network-vif-plugged-5bdaffe7-9bbb-4391-bd1e-406a8fb06ce8 {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:25:14 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-e734a4b4-99a2-4ad5-b018-f9a1589574a6 req-70b1bb99-d4aa-42ae-b555-2168de85d7e9 service nova] Acquiring lock "7e92ab9a-8ea4-4452-a458-db181d4a59b7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:25:14 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-e734a4b4-99a2-4ad5-b018-f9a1589574a6 req-70b1bb99-d4aa-42ae-b555-2168de85d7e9 service nova] Lock "7e92ab9a-8ea4-4452-a458-db181d4a59b7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:25:14 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-e734a4b4-99a2-4ad5-b018-f9a1589574a6 req-70b1bb99-d4aa-42ae-b555-2168de85d7e9 service nova] Lock "7e92ab9a-8ea4-4452-a458-db181d4a59b7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:25:14 user nova-compute[75045]: DEBUG nova.compute.manager [req-e734a4b4-99a2-4ad5-b018-f9a1589574a6 req-70b1bb99-d4aa-42ae-b555-2168de85d7e9 service nova] [instance: 7e92ab9a-8ea4-4452-a458-db181d4a59b7] No waiting events found dispatching network-vif-plugged-5bdaffe7-9bbb-4391-bd1e-406a8fb06ce8 {{(pid=75045) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 23:25:14 user nova-compute[75045]: WARNING nova.compute.manager [req-e734a4b4-99a2-4ad5-b018-f9a1589574a6 req-70b1bb99-d4aa-42ae-b555-2168de85d7e9 service nova] [instance: 7e92ab9a-8ea4-4452-a458-db181d4a59b7] Received unexpected event network-vif-plugged-5bdaffe7-9bbb-4391-bd1e-406a8fb06ce8 for instance with vm_state building and task_state spawning.
Nov 08 23:25:15 user nova-compute[75045]: DEBUG nova.network.neutron [req-b6a50dd4-bbc0-4a8f-9773-c16135dc00a4 req-ed0f1a92-f591-4689-a985-e25387a7ff4e service nova] [instance: 72c9d731-2b35-434c-8463-1cd6c18fbd6a] Updated VIF entry in instance network info cache for port 996f98bd-77bf-4176-8fe3-ea98b0c070a0. {{(pid=75045) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 23:25:15 user nova-compute[75045]: DEBUG nova.network.neutron [req-b6a50dd4-bbc0-4a8f-9773-c16135dc00a4 req-ed0f1a92-f591-4689-a985-e25387a7ff4e service nova] [instance: 72c9d731-2b35-434c-8463-1cd6c18fbd6a] Updating instance_info_cache with network_info: [{"id": "996f98bd-77bf-4176-8fe3-ea98b0c070a0", "address": "fa:16:3e:bb:6f:51", "network": {"id": "94c5462e-c9fd-44e6-b02b-9d46156ca7d9", "bridge": "br-int", "label": "tempest-TestStampPattern-1038298369-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "824ed65954dd4eccbe68827aa92fd99f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap996f98bd-77", "ovs_interfaceid": "996f98bd-77bf-4176-8fe3-ea98b0c070a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75045) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 23:25:15 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-b6a50dd4-bbc0-4a8f-9773-c16135dc00a4 req-ed0f1a92-f591-4689-a985-e25387a7ff4e service nova] Releasing lock "refresh_cache-72c9d731-2b35-434c-8463-1cd6c18fbd6a" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 23:25:15 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:25:15 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:25:15 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:25:15 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:25:15 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:25:16 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:25:16 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:25:16 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:25:16 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:25:16 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:25:16 user nova-compute[75045]: DEBUG nova.compute.manager [req-25fc2a40-3019-4df0-8ba2-d1b66370efbf req-7598e175-b91a-4081-9a1b-4a05d0129a2c service nova] [instance: 7e92ab9a-8ea4-4452-a458-db181d4a59b7] Received event network-vif-plugged-5bdaffe7-9bbb-4391-bd1e-406a8fb06ce8 {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:25:16 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-25fc2a40-3019-4df0-8ba2-d1b66370efbf req-7598e175-b91a-4081-9a1b-4a05d0129a2c service nova] Acquiring lock "7e92ab9a-8ea4-4452-a458-db181d4a59b7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:25:16 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-25fc2a40-3019-4df0-8ba2-d1b66370efbf req-7598e175-b91a-4081-9a1b-4a05d0129a2c service nova] Lock "7e92ab9a-8ea4-4452-a458-db181d4a59b7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:25:16 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-25fc2a40-3019-4df0-8ba2-d1b66370efbf req-7598e175-b91a-4081-9a1b-4a05d0129a2c service nova] Lock "7e92ab9a-8ea4-4452-a458-db181d4a59b7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:25:16 user nova-compute[75045]: DEBUG nova.compute.manager [req-25fc2a40-3019-4df0-8ba2-d1b66370efbf req-7598e175-b91a-4081-9a1b-4a05d0129a2c service nova] [instance: 7e92ab9a-8ea4-4452-a458-db181d4a59b7] No waiting events found dispatching network-vif-plugged-5bdaffe7-9bbb-4391-bd1e-406a8fb06ce8 {{(pid=75045) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 23:25:16 user nova-compute[75045]: WARNING nova.compute.manager [req-25fc2a40-3019-4df0-8ba2-d1b66370efbf req-7598e175-b91a-4081-9a1b-4a05d0129a2c service nova] [instance: 7e92ab9a-8ea4-4452-a458-db181d4a59b7] Received unexpected event network-vif-plugged-5bdaffe7-9bbb-4391-bd1e-406a8fb06ce8 for instance with vm_state building and task_state spawning.
Nov 08 23:25:16 user nova-compute[75045]: DEBUG nova.compute.manager [req-25fc2a40-3019-4df0-8ba2-d1b66370efbf req-7598e175-b91a-4081-9a1b-4a05d0129a2c service nova] [instance: 72c9d731-2b35-434c-8463-1cd6c18fbd6a] Received event network-vif-plugged-996f98bd-77bf-4176-8fe3-ea98b0c070a0 {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:25:16 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-25fc2a40-3019-4df0-8ba2-d1b66370efbf req-7598e175-b91a-4081-9a1b-4a05d0129a2c service nova] Acquiring lock "72c9d731-2b35-434c-8463-1cd6c18fbd6a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:25:16 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-25fc2a40-3019-4df0-8ba2-d1b66370efbf req-7598e175-b91a-4081-9a1b-4a05d0129a2c service nova] Lock "72c9d731-2b35-434c-8463-1cd6c18fbd6a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:25:16 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-25fc2a40-3019-4df0-8ba2-d1b66370efbf req-7598e175-b91a-4081-9a1b-4a05d0129a2c service nova] Lock "72c9d731-2b35-434c-8463-1cd6c18fbd6a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:25:16 user nova-compute[75045]: DEBUG nova.compute.manager [req-25fc2a40-3019-4df0-8ba2-d1b66370efbf req-7598e175-b91a-4081-9a1b-4a05d0129a2c service nova] [instance: 72c9d731-2b35-434c-8463-1cd6c18fbd6a] No waiting events found dispatching network-vif-plugged-996f98bd-77bf-4176-8fe3-ea98b0c070a0 {{(pid=75045) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 23:25:16 user nova-compute[75045]: WARNING nova.compute.manager [req-25fc2a40-3019-4df0-8ba2-d1b66370efbf req-7598e175-b91a-4081-9a1b-4a05d0129a2c service nova] [instance: 72c9d731-2b35-434c-8463-1cd6c18fbd6a] Received unexpected event network-vif-plugged-996f98bd-77bf-4176-8fe3-ea98b0c070a0 for instance with vm_state building and task_state spawning.
Nov 08 23:25:17 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:25:17 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:25:17 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:25:18 user nova-compute[75045]: DEBUG nova.compute.manager [None req-0161cadb-17b4-40f1-af93-e3017f777832 tempest-VolumesAdminNegativeTest-215528111 tempest-VolumesAdminNegativeTest-215528111-project-member] [instance: 7e92ab9a-8ea4-4452-a458-db181d4a59b7] Instance event wait completed in 0 seconds for  {{(pid=75045) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 23:25:18 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-0161cadb-17b4-40f1-af93-e3017f777832 tempest-VolumesAdminNegativeTest-215528111 tempest-VolumesAdminNegativeTest-215528111-project-member] [instance: 7e92ab9a-8ea4-4452-a458-db181d4a59b7] Guest created on hypervisor {{(pid=75045) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 23:25:18 user nova-compute[75045]: INFO nova.virt.libvirt.driver [-] [instance: 7e92ab9a-8ea4-4452-a458-db181d4a59b7] Instance spawned successfully.
Nov 08 23:25:18 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-0161cadb-17b4-40f1-af93-e3017f777832 tempest-VolumesAdminNegativeTest-215528111 tempest-VolumesAdminNegativeTest-215528111-project-member] [instance: 7e92ab9a-8ea4-4452-a458-db181d4a59b7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75045) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 23:25:18 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-0161cadb-17b4-40f1-af93-e3017f777832 tempest-VolumesAdminNegativeTest-215528111 tempest-VolumesAdminNegativeTest-215528111-project-member] [instance: 7e92ab9a-8ea4-4452-a458-db181d4a59b7] Found default for hw_cdrom_bus of ide {{(pid=75045) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 23:25:18 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-0161cadb-17b4-40f1-af93-e3017f777832 tempest-VolumesAdminNegativeTest-215528111 tempest-VolumesAdminNegativeTest-215528111-project-member] [instance: 7e92ab9a-8ea4-4452-a458-db181d4a59b7] Found default for hw_disk_bus of virtio {{(pid=75045) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 23:25:18 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-0161cadb-17b4-40f1-af93-e3017f777832 tempest-VolumesAdminNegativeTest-215528111 tempest-VolumesAdminNegativeTest-215528111-project-member] [instance: 7e92ab9a-8ea4-4452-a458-db181d4a59b7] Found default for hw_input_bus of None {{(pid=75045) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 23:25:18 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-0161cadb-17b4-40f1-af93-e3017f777832 tempest-VolumesAdminNegativeTest-215528111 tempest-VolumesAdminNegativeTest-215528111-project-member] [instance: 7e92ab9a-8ea4-4452-a458-db181d4a59b7] Found default for hw_pointer_model of None {{(pid=75045) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 23:25:18 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-0161cadb-17b4-40f1-af93-e3017f777832 tempest-VolumesAdminNegativeTest-215528111 tempest-VolumesAdminNegativeTest-215528111-project-member] [instance: 7e92ab9a-8ea4-4452-a458-db181d4a59b7] Found default for hw_video_model of virtio {{(pid=75045) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 23:25:18 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-0161cadb-17b4-40f1-af93-e3017f777832 tempest-VolumesAdminNegativeTest-215528111 tempest-VolumesAdminNegativeTest-215528111-project-member] [instance: 7e92ab9a-8ea4-4452-a458-db181d4a59b7] Found default for hw_vif_model of virtio {{(pid=75045) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 23:25:18 user nova-compute[75045]: INFO nova.compute.manager [None req-0161cadb-17b4-40f1-af93-e3017f777832 tempest-VolumesAdminNegativeTest-215528111 tempest-VolumesAdminNegativeTest-215528111-project-member] [instance: 7e92ab9a-8ea4-4452-a458-db181d4a59b7] Took 8.49 seconds to spawn the instance on the hypervisor.
Nov 08 23:25:18 user nova-compute[75045]: DEBUG nova.compute.manager [None req-0161cadb-17b4-40f1-af93-e3017f777832 tempest-VolumesAdminNegativeTest-215528111 tempest-VolumesAdminNegativeTest-215528111-project-member] [instance: 7e92ab9a-8ea4-4452-a458-db181d4a59b7] Checking state {{(pid=75045) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 23:25:18 user nova-compute[75045]: INFO nova.compute.manager [None req-0161cadb-17b4-40f1-af93-e3017f777832 tempest-VolumesAdminNegativeTest-215528111 tempest-VolumesAdminNegativeTest-215528111-project-member] [instance: 7e92ab9a-8ea4-4452-a458-db181d4a59b7] Took 9.65 seconds to build instance.
Nov 08 23:25:18 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-0161cadb-17b4-40f1-af93-e3017f777832 tempest-VolumesAdminNegativeTest-215528111 tempest-VolumesAdminNegativeTest-215528111-project-member] Lock "7e92ab9a-8ea4-4452-a458-db181d4a59b7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.825s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:25:18 user nova-compute[75045]: DEBUG nova.compute.manager [req-bd3f3037-e934-4711-b0e8-1f3f4f6ed760 req-fd6f3f27-8e39-4805-a87e-63de973f26fe service nova] [instance: 72c9d731-2b35-434c-8463-1cd6c18fbd6a] Received event network-vif-plugged-996f98bd-77bf-4176-8fe3-ea98b0c070a0 {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:25:18 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-bd3f3037-e934-4711-b0e8-1f3f4f6ed760 req-fd6f3f27-8e39-4805-a87e-63de973f26fe service nova] Acquiring lock "72c9d731-2b35-434c-8463-1cd6c18fbd6a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:25:18 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-bd3f3037-e934-4711-b0e8-1f3f4f6ed760 req-fd6f3f27-8e39-4805-a87e-63de973f26fe service nova] Lock "72c9d731-2b35-434c-8463-1cd6c18fbd6a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:25:18 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-bd3f3037-e934-4711-b0e8-1f3f4f6ed760 req-fd6f3f27-8e39-4805-a87e-63de973f26fe service nova] Lock "72c9d731-2b35-434c-8463-1cd6c18fbd6a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:25:18 user nova-compute[75045]: DEBUG nova.compute.manager [req-bd3f3037-e934-4711-b0e8-1f3f4f6ed760 req-fd6f3f27-8e39-4805-a87e-63de973f26fe service nova] [instance: 72c9d731-2b35-434c-8463-1cd6c18fbd6a] No waiting events found dispatching network-vif-plugged-996f98bd-77bf-4176-8fe3-ea98b0c070a0 {{(pid=75045) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 23:25:18 user nova-compute[75045]: WARNING nova.compute.manager [req-bd3f3037-e934-4711-b0e8-1f3f4f6ed760 req-fd6f3f27-8e39-4805-a87e-63de973f26fe service nova] [instance: 72c9d731-2b35-434c-8463-1cd6c18fbd6a] Received unexpected event network-vif-plugged-996f98bd-77bf-4176-8fe3-ea98b0c070a0 for instance with vm_state building and task_state spawning.
Nov 08 23:25:19 user nova-compute[75045]: WARNING nova.virt.libvirt.driver [None req-df41c91c-fcc0-4833-b993-ae7015bf0db7 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 032e20aa-8887-4215-808e-68299a0d8d0b is timed out.
Nov 08 23:25:19 user nova-compute[75045]: INFO nova.virt.libvirt.driver [None req-df41c91c-fcc0-4833-b993-ae7015bf0db7 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Successfully detached device vdb from instance 032e20aa-8887-4215-808e-68299a0d8d0b from the live domain config.
Nov 08 23:25:19 user nova-compute[75045]: DEBUG nova.virt.libvirt.volume.iscsi [None req-df41c91c-fcc0-4833-b993-ae7015bf0db7 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] [instance: 032e20aa-8887-4215-808e-68299a0d8d0b] calling os-brick to detach iSCSI Volume {{(pid=75045) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 23:25:19 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-df41c91c-fcc0-4833-b993-ae7015bf0db7 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1b68210460>, {'target_iqn': 'iqn.2010-10.org.openstack:45f1b635-c8a3-4727-a4c7-c2ac441388ff', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SPlwFCBD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75045) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 23:25:19 user nova-compute[75045]: WARNING os_brick.initiator.connectors.base [None req-df41c91c-fcc0-4833-b993-ae7015bf0db7 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 23:25:19 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-df41c91c-fcc0-4833-b993-ae7015bf0db7 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 23:25:19 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-df41c91c-fcc0-4833-b993-ae7015bf0db7 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 23:25:19 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:25:19 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:25:19 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5db2bb1-8c7e-464f-a5cb-1d39731dfd5a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:cd1b2206-989e-409d-84c6-49b37ac252d8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:661e7726-e16e-47a2-a649-dd3b77ccf9d8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:04d02c98-d058-49d8-a350-ab9e63003d6e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9c37da13-9531-458a-87cb-1e86e6b84f3a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:45f1b635-c8a3-4727-a4c7-c2ac441388ff\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:25:19 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-df41c91c-fcc0-4833-b993-ae7015bf0db7 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 23:25:19 user nova-compute[75045]: No targets found.
Nov 08 23:25:19 user nova-compute[75045]: iSNS:
Nov 08 23:25:19 user nova-compute[75045]: No targets found.
Nov 08 23:25:19 user nova-compute[75045]: STATIC:
Nov 08 23:25:19 user nova-compute[75045]: Target: iqn.2010-10.org.openstack:cd1b2206-989e-409d-84c6-49b37ac252d8
Nov 08 23:25:19 user nova-compute[75045]:         Portal: 172.16.0.220:3260,-1
Nov 08 23:25:19 user nova-compute[75045]:                 Iface Name: default
Nov 08 23:25:19 user nova-compute[75045]: Target: iqn.2010-10.org.openstack:661e7726-e16e-47a2-a649-dd3b77ccf9d8
Nov 08 23:25:19 user nova-compute[75045]:         Portal: 172.16.0.220:3260,-1
Nov 08 23:25:19 user nova-compute[75045]:                 Iface Name: default
Nov 08 23:25:19 user nova-compute[75045]: Target: iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab
Nov 08 23:25:19 user nova-compute[75045]:         Portal: 172.16.0.220:3260,-1
Nov 08 23:25:19 user nova-compute[75045]:                 Iface Name: default
Nov 08 23:25:19 user nova-compute[75045]: Target: iqn.2010-10.org.openstack:04d02c98-d058-49d8-a350-ab9e63003d6e
Nov 08 23:25:19 user nova-compute[75045]:         Portal: 172.16.0.220:3260,-1
Nov 08 23:25:19 user nova-compute[75045]:                 Iface Name: default
Nov 08 23:25:19 user nova-compute[75045]: Target: iqn.2010-10.org.openstack:9c37da13-9531-458a-87cb-1e86e6b84f3a
Nov 08 23:25:19 user nova-compute[75045]:         Portal: 172.16.0.220:3260,-1
Nov 08 23:25:19 user nova-compute[75045]:                 Iface Name: default
Nov 08 23:25:19 user nova-compute[75045]: Target: iqn.2010-10.org.openstack:45f1b635-c8a3-4727-a4c7-c2ac441388ff
Nov 08 23:25:19 user nova-compute[75045]:         Portal: 172.16.0.220:3260,-1
Nov 08 23:25:19 user nova-compute[75045]:                 Iface Name: default
Nov 08 23:25:19 user nova-compute[75045]: FIRMWARE:
Nov 08 23:25:19 user nova-compute[75045]: No targets found.
Nov 08 23:25:19 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 23:25:19 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-df41c91c-fcc0-4833-b993-ae7015bf0db7 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 23:25:19 user nova-compute[75045]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 23:25:19 user nova-compute[75045]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75045) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 23:25:19 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-df41c91c-fcc0-4833-b993-ae7015bf0db7 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:45f1b635-c8a3-4727-a4c7-c2ac441388ff', 0)] {{(pid=75045) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 23:25:19 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:25:19 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:25:19 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[93a20e48-b7db-488b-aab6-3871658893c3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:04d02c98-d058-49d8-a350-ab9e63003d6e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:45f1b635-c8a3-4727-a4c7-c2ac441388ff\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:661e7726-e16e-47a2-a649-dd3b77ccf9d8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9c37da13-9531-458a-87cb-1e86e6b84f3a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cd1b2206-989e-409d-84c6-49b37ac252d8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:25:19 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:25:19 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:25:19 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[e805811b-cf05-464c-ab65-f24fdd346ddd]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45f1b635-c8a3-4727-a4c7-c2ac441388ff (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd1b2206-989e-409d-84c6-49b37ac252d8 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04d02c98-d058-49d8-a350-ab9e63003d6e (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c37da13-9531-458a-87cb-1e86e6b84f3a (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:661e7726-e16e-47a2-a649-dd3b77ccf9d8 (non-flash)\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:25:19 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-df41c91c-fcc0-4833-b993-ae7015bf0db7 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab (non-flash)
Nov 08 23:25:19 user nova-compute[75045]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45f1b635-c8a3-4727-a4c7-c2ac441388ff (non-flash)
Nov 08 23:25:19 user nova-compute[75045]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd1b2206-989e-409d-84c6-49b37ac252d8 (non-flash)
Nov 08 23:25:19 user nova-compute[75045]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04d02c98-d058-49d8-a350-ab9e63003d6e (non-flash)
Nov 08 23:25:19 user nova-compute[75045]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c37da13-9531-458a-87cb-1e86e6b84f3a (non-flash)
Nov 08 23:25:19 user nova-compute[75045]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:661e7726-e16e-47a2-a649-dd3b77ccf9d8 (non-flash)
Nov 08 23:25:19 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 23:25:19 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-df41c91c-fcc0-4833-b993-ae7015bf0db7 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab (non-flash)
Nov 08 23:25:19 user nova-compute[75045]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45f1b635-c8a3-4727-a4c7-c2ac441388ff (non-flash)
Nov 08 23:25:19 user nova-compute[75045]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd1b2206-989e-409d-84c6-49b37ac252d8 (non-flash)
Nov 08 23:25:19 user nova-compute[75045]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04d02c98-d058-49d8-a350-ab9e63003d6e (non-flash)
Nov 08 23:25:19 user nova-compute[75045]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c37da13-9531-458a-87cb-1e86e6b84f3a (non-flash)
Nov 08 23:25:19 user nova-compute[75045]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:661e7726-e16e-47a2-a649-dd3b77ccf9d8 (non-flash)
Nov 08 23:25:19 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 23:25:19 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-df41c91c-fcc0-4833-b993-ae7015bf0db7 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1b683f30a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:45f1b635-c8a3-4727-a4c7-c2ac441388ff'): ({'sdc'}, set())}) {{(pid=75045) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 23:25:19 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-df41c91c-fcc0-4833-b993-ae7015bf0db7 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Removing single pathed devices sdc {{(pid=75045) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 23:25:19 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:25:19 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.027s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:25:19 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ddb3083-324b-47a5-b6f3-22f2484619cc]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:25:19 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:25:19 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:25:19 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[ace2c7a3-2967-4b2b-b9a7-b562b27a7262]: (4, ('ok\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:25:19 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-df41c91c-fcc0-4833-b993-ae7015bf0db7 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Flushing IO for device /dev/sdc {{(pid=75045) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 23:25:19 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:25:19 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.017s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:25:19 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[27ad8e09-4e82-4892-b19c-cbdc4f02dd68]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:25:19 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-df41c91c-fcc0-4833-b993-ae7015bf0db7 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75045) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 23:25:19 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:25:19 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.040s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:25:19 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca13ade4-f47a-4ecb-8e88-c9591e79a71b]: (4, ('1', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:25:19 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-df41c91c-fcc0-4833-b993-ae7015bf0db7 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75045) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 23:25:19 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-df41c91c-fcc0-4833-b993-ae7015bf0db7 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] SCSI volumes sdc have been removed. {{(pid=75045) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 23:25:19 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-df41c91c-fcc0-4833-b993-ae7015bf0db7 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:45f1b635-c8a3-4727-a4c7-c2ac441388ff')] {{(pid=75045) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 23:25:19 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45f1b635-c8a3-4727-a4c7-c2ac441388ff -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:25:19 user nova-compute[75045]: DEBUG nova.compute.manager [None req-03a4c0ee-568a-4663-a9ca-0617ba0edb13 tempest-TestStampPattern-2120781434 tempest-TestStampPattern-2120781434-project-member] [instance: 72c9d731-2b35-434c-8463-1cd6c18fbd6a] Instance event wait completed in 0 seconds for  {{(pid=75045) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 23:25:19 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-03a4c0ee-568a-4663-a9ca-0617ba0edb13 tempest-TestStampPattern-2120781434 tempest-TestStampPattern-2120781434-project-member] [instance: 72c9d731-2b35-434c-8463-1cd6c18fbd6a] Guest created on hypervisor {{(pid=75045) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 23:25:19 user nova-compute[75045]: INFO nova.virt.libvirt.driver [-] [instance: 72c9d731-2b35-434c-8463-1cd6c18fbd6a] Instance spawned successfully.
Nov 08 23:25:19 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-03a4c0ee-568a-4663-a9ca-0617ba0edb13 tempest-TestStampPattern-2120781434 tempest-TestStampPattern-2120781434-project-member] [instance: 72c9d731-2b35-434c-8463-1cd6c18fbd6a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75045) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 23:25:19 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-03a4c0ee-568a-4663-a9ca-0617ba0edb13 tempest-TestStampPattern-2120781434 tempest-TestStampPattern-2120781434-project-member] [instance: 72c9d731-2b35-434c-8463-1cd6c18fbd6a] Found default for hw_cdrom_bus of ide {{(pid=75045) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 23:25:19 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-03a4c0ee-568a-4663-a9ca-0617ba0edb13 tempest-TestStampPattern-2120781434 tempest-TestStampPattern-2120781434-project-member] [instance: 72c9d731-2b35-434c-8463-1cd6c18fbd6a] Found default for hw_disk_bus of virtio {{(pid=75045) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 23:25:19 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-03a4c0ee-568a-4663-a9ca-0617ba0edb13 tempest-TestStampPattern-2120781434 tempest-TestStampPattern-2120781434-project-member] [instance: 72c9d731-2b35-434c-8463-1cd6c18fbd6a] Found default for hw_input_bus of None {{(pid=75045) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 23:25:19 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-03a4c0ee-568a-4663-a9ca-0617ba0edb13 tempest-TestStampPattern-2120781434 tempest-TestStampPattern-2120781434-project-member] [instance: 72c9d731-2b35-434c-8463-1cd6c18fbd6a] Found default for hw_pointer_model of None {{(pid=75045) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 23:25:19 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-03a4c0ee-568a-4663-a9ca-0617ba0edb13 tempest-TestStampPattern-2120781434 tempest-TestStampPattern-2120781434-project-member] [instance: 72c9d731-2b35-434c-8463-1cd6c18fbd6a] Found default for hw_video_model of virtio {{(pid=75045) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 23:25:19 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-03a4c0ee-568a-4663-a9ca-0617ba0edb13 tempest-TestStampPattern-2120781434 tempest-TestStampPattern-2120781434-project-member] [instance: 72c9d731-2b35-434c-8463-1cd6c18fbd6a] Found default for hw_vif_model of virtio {{(pid=75045) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 23:25:19 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45f1b635-c8a3-4727-a4c7-c2ac441388ff -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.032s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:25:19 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c942b48-55b0-4ce2-a9ad-e5add795bd72]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:25:19 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-df41c91c-fcc0-4833-b993-ae7015bf0db7 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:25:19 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45f1b635-c8a3-4727-a4c7-c2ac441388ff -p 172.16.0.220:3260 --logout {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:25:19 user nova-compute[75045]: INFO nova.compute.manager [None req-03a4c0ee-568a-4663-a9ca-0617ba0edb13 tempest-TestStampPattern-2120781434 tempest-TestStampPattern-2120781434-project-member] [instance: 72c9d731-2b35-434c-8463-1cd6c18fbd6a] Took 6.89 seconds to spawn the instance on the hypervisor.
Nov 08 23:25:19 user nova-compute[75045]: DEBUG nova.compute.manager [None req-03a4c0ee-568a-4663-a9ca-0617ba0edb13 tempest-TestStampPattern-2120781434 tempest-TestStampPattern-2120781434-project-member] [instance: 72c9d731-2b35-434c-8463-1cd6c18fbd6a] Checking state {{(pid=75045) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 23:25:19 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45f1b635-c8a3-4727-a4c7-c2ac441388ff -p 172.16.0.220:3260 --logout" returned: 0 in 0.076s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:25:19 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[f959fe93-119f-457e-9503-7ff78f4d5d94]: (4, ('Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:45f1b635-c8a3-4727-a4c7-c2ac441388ff, portal: 172.16.0.220,3260]\nLogout of [sid: 16, target: iqn.2010-10.org.openstack:45f1b635-c8a3-4727-a4c7-c2ac441388ff, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:25:19 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-df41c91c-fcc0-4833-b993-ae7015bf0db7 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:45f1b635-c8a3-4727-a4c7-c2ac441388ff, portal: 172.16.0.220,3260]
Nov 08 23:25:19 user nova-compute[75045]: Logout of [sid: 16, target: iqn.2010-10.org.openstack:45f1b635-c8a3-4727-a4c7-c2ac441388ff, portal: 172.16.0.220,3260] successful.
Nov 08 23:25:19 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:25:19 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45f1b635-c8a3-4727-a4c7-c2ac441388ff -p 172.16.0.220:3260 --op delete {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:25:19 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-4579f742-2339-4237-857a-f7d4a5f3f37c tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] Acquiring lock "83d225e0-e39e-4500-b7ae-52dfbd8b8588" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:25:19 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-4579f742-2339-4237-857a-f7d4a5f3f37c tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] Lock "83d225e0-e39e-4500-b7ae-52dfbd8b8588" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:25:19 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:25:19 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45f1b635-c8a3-4727-a4c7-c2ac441388ff -p 172.16.0.220:3260 --op delete" returned: 0 in 0.038s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:25:19 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[84cf3db4-bcdf-4201-adfd-bd0e012c9928]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:25:19 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-df41c91c-fcc0-4833-b993-ae7015bf0db7 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:25:19 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-df41c91c-fcc0-4833-b993-ae7015bf0db7 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.423s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 23:25:19 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-df41c91c-fcc0-4833-b993-ae7015bf0db7 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] <== disconnect_volume: return (426ms) None {{(pid=75045) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 23:25:19 user nova-compute[75045]: DEBUG nova.virt.libvirt.volume.iscsi [None req-df41c91c-fcc0-4833-b993-ae7015bf0db7 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] [instance: 032e20aa-8887-4215-808e-68299a0d8d0b] Disconnected iSCSI Volume {{(pid=75045) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 23:25:19 user nova-compute[75045]: DEBUG nova.objects.instance [None req-4579f742-2339-4237-857a-f7d4a5f3f37c tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] Lazy-loading 'flavor' on Instance uuid 83d225e0-e39e-4500-b7ae-52dfbd8b8588 {{(pid=75045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 23:25:19 user nova-compute[75045]: INFO nova.compute.manager [None req-03a4c0ee-568a-4663-a9ca-0617ba0edb13 tempest-TestStampPattern-2120781434 tempest-TestStampPattern-2120781434-project-member] [instance: 72c9d731-2b35-434c-8463-1cd6c18fbd6a] Took 8.24 seconds to build instance.
Nov 08 23:25:19 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-4579f742-2339-4237-857a-f7d4a5f3f37c tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] Lock "83d225e0-e39e-4500-b7ae-52dfbd8b8588" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.146s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:25:19 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-03a4c0ee-568a-4663-a9ca-0617ba0edb13 tempest-TestStampPattern-2120781434 tempest-TestStampPattern-2120781434-project-member] Lock "72c9d731-2b35-434c-8463-1cd6c18fbd6a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.383s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:25:19 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-4579f742-2339-4237-857a-f7d4a5f3f37c tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] Acquiring lock "83d225e0-e39e-4500-b7ae-52dfbd8b8588" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:25:19 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-4579f742-2339-4237-857a-f7d4a5f3f37c tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] Lock "83d225e0-e39e-4500-b7ae-52dfbd8b8588" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:25:19 user nova-compute[75045]: INFO nova.compute.manager [None req-4579f742-2339-4237-857a-f7d4a5f3f37c tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] [instance: 83d225e0-e39e-4500-b7ae-52dfbd8b8588] Attaching volume d2e734fa-1dcb-4510-a50e-064e29c2985e to /dev/vdb
Nov 08 23:25:20 user nova-compute[75045]: DEBUG os_brick.utils [None req-4579f742-2339-4237-857a-f7d4a5f3f37c tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75045) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 23:25:20 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:25:20 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:25:20 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[da159f46-743f-4da1-ac5f-c5db9efe5305]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6217bd6e884\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:25:20 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:25:20 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:25:20 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1a3b1a0-01bd-4d50-8058-6d9bde34768d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:25:20 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:25:20 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:25:20 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcd676cd-d172-429f-ac82-5797f5d10b5e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:25:20 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b7d176a-755a-49a0-ab08-63244c9700e4]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:25:20 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-4579f742-2339-4237-857a-f7d4a5f3f37c tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] Running cmd (subprocess): nvme version {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:25:20 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-4579f742-2339-4237-857a-f7d4a5f3f37c tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] 'nvme version' failed. Not Retrying. {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 23:25:20 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4579f742-2339-4237-857a-f7d4a5f3f37c tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] nvme not present on system {{(pid=75045) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 23:25:20 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:25:20 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 23:25:20 user nova-compute[75045]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 23:25:20 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[38e1e3f1-4c0d-4011-8931-1d0fb9ab7c90]: (4, '') {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:25:20 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.lightos [None req-4579f742-2339-4237-857a-f7d4a5f3f37c tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75045) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 23:25:20 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.lightos [None req-4579f742-2339-4237-857a-f7d4a5f3f37c tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75045) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 23:25:20 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.lightos [None req-4579f742-2339-4237-857a-f7d4a5f3f37c tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] LIGHTOS: no hostnqn found. {{(pid=75045) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 23:25:20 user nova-compute[75045]: DEBUG os_brick.utils [None req-4579f742-2339-4237-857a-f7d4a5f3f37c tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] <== get_connector_properties: return (337ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6217bd6e884', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75045) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 23:25:20 user nova-compute[75045]: DEBUG nova.virt.block_device [None req-4579f742-2339-4237-857a-f7d4a5f3f37c tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] [instance: 83d225e0-e39e-4500-b7ae-52dfbd8b8588] Updating existing volume attachment record: 4be6f73b-fd79-4ea7-97ec-250668ea9dd8 {{(pid=75045) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 23:25:20 user nova-compute[75045]: DEBUG nova.objects.instance [None req-df41c91c-fcc0-4833-b993-ae7015bf0db7 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Lazy-loading 'flavor' on Instance uuid 032e20aa-8887-4215-808e-68299a0d8d0b {{(pid=75045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 23:25:20 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-df41c91c-fcc0-4833-b993-ae7015bf0db7 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Lock "032e20aa-8887-4215-808e-68299a0d8d0b" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.733s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:25:21 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:25:21 user nova-compute[75045]: ERROR nova.volume.cinder [None req-60ff8c3d-8198-436e-bbc1-77adec44e5d5 tempest-TestServerVolumeAttachmentScenario-1899063447 tempest-TestServerVolumeAttachmentScenario-1899063447-project-member] Update attachment failed for attachment 884b7ee9-00aa-4d1c-bb13-63834fcdb8b9. Error: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-ab3af262-d8fd-47b4-b167-d338a3bbffae) Code: 500: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-ab3af262-d8fd-47b4-b167-d338a3bbffae)
Nov 08 23:25:21 user nova-compute[75045]: ERROR nova.compute.manager [None req-60ff8c3d-8198-436e-bbc1-77adec44e5d5 tempest-TestServerVolumeAttachmentScenario-1899063447 tempest-TestServerVolumeAttachmentScenario-1899063447-project-member] [instance: 25cd59d1-6884-471a-813e-52e97c2e1208] Failed to attach 0a781e02-49d7-49fb-a2ca-b4c985ab9a23 at /dev/vdc: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-ab3af262-d8fd-47b4-b167-d338a3bbffae)
Nov 08 23:25:21 user nova-compute[75045]: ERROR nova.compute.manager [instance: 25cd59d1-6884-471a-813e-52e97c2e1208] Traceback (most recent call last):
Nov 08 23:25:21 user nova-compute[75045]: ERROR nova.compute.manager [instance: 25cd59d1-6884-471a-813e-52e97c2e1208]   File "/opt/stack/nova/nova/compute/manager.py", line 7567, in _attach_volume
Nov 08 23:25:21 user nova-compute[75045]: ERROR nova.compute.manager [instance: 25cd59d1-6884-471a-813e-52e97c2e1208]     bdm.attach(context, instance, self.volume_api, self.driver,
Nov 08 23:25:21 user nova-compute[75045]: ERROR nova.compute.manager [instance: 25cd59d1-6884-471a-813e-52e97c2e1208]   File "/opt/stack/nova/nova/virt/block_device.py", line 46, in wrapped
Nov 08 23:25:21 user nova-compute[75045]: ERROR nova.compute.manager [instance: 25cd59d1-6884-471a-813e-52e97c2e1208]     ret_val = method(obj, context, *args, **kwargs)
Nov 08 23:25:21 user nova-compute[75045]: ERROR nova.compute.manager [instance: 25cd59d1-6884-471a-813e-52e97c2e1208]   File "/opt/stack/nova/nova/virt/block_device.py", line 734, in attach
Nov 08 23:25:21 user nova-compute[75045]: ERROR nova.compute.manager [instance: 25cd59d1-6884-471a-813e-52e97c2e1208]     self._do_attach(context, instance, volume, volume_api,
Nov 08 23:25:21 user nova-compute[75045]: ERROR nova.compute.manager [instance: 25cd59d1-6884-471a-813e-52e97c2e1208]   File "/opt/stack/nova/nova/virt/block_device.py", line 719, in _do_attach
Nov 08 23:25:21 user nova-compute[75045]: ERROR nova.compute.manager [instance: 25cd59d1-6884-471a-813e-52e97c2e1208]     self._volume_attach(context, volume, connector, instance,
Nov 08 23:25:21 user nova-compute[75045]: ERROR nova.compute.manager [instance: 25cd59d1-6884-471a-813e-52e97c2e1208]   File "/opt/stack/nova/nova/virt/block_device.py", line 633, in _volume_attach
Nov 08 23:25:21 user nova-compute[75045]: ERROR nova.compute.manager [instance: 25cd59d1-6884-471a-813e-52e97c2e1208]     connection_info = volume_api.attachment_update(
Nov 08 23:25:21 user nova-compute[75045]: ERROR nova.compute.manager [instance: 25cd59d1-6884-471a-813e-52e97c2e1208]   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 08 23:25:21 user nova-compute[75045]: ERROR nova.compute.manager [instance: 25cd59d1-6884-471a-813e-52e97c2e1208]     res = method(self, ctx, *args, **kwargs)
Nov 08 23:25:21 user nova-compute[75045]: ERROR nova.compute.manager [instance: 25cd59d1-6884-471a-813e-52e97c2e1208]   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Nov 08 23:25:21 user nova-compute[75045]: ERROR nova.compute.manager [instance: 25cd59d1-6884-471a-813e-52e97c2e1208]     res = method(self, ctx, attachment_id, *args, **kwargs)
Nov 08 23:25:21 user nova-compute[75045]: ERROR nova.compute.manager [instance: 25cd59d1-6884-471a-813e-52e97c2e1208]   File "/opt/stack/nova/nova/volume/cinder.py", line 915, in attachment_update
Nov 08 23:25:21 user nova-compute[75045]: ERROR nova.compute.manager [instance: 25cd59d1-6884-471a-813e-52e97c2e1208]     with excutils.save_and_reraise_exception():
Nov 08 23:25:21 user nova-compute[75045]: ERROR nova.compute.manager [instance: 25cd59d1-6884-471a-813e-52e97c2e1208]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 08 23:25:21 user nova-compute[75045]: ERROR nova.compute.manager [instance: 25cd59d1-6884-471a-813e-52e97c2e1208]     self.force_reraise()
Nov 08 23:25:21 user nova-compute[75045]: ERROR nova.compute.manager [instance: 25cd59d1-6884-471a-813e-52e97c2e1208]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 08 23:25:21 user nova-compute[75045]: ERROR nova.compute.manager [instance: 25cd59d1-6884-471a-813e-52e97c2e1208]     raise self.value
Nov 08 23:25:21 user nova-compute[75045]: ERROR nova.compute.manager [instance: 25cd59d1-6884-471a-813e-52e97c2e1208]   File "/opt/stack/nova/nova/volume/cinder.py", line 909, in attachment_update
Nov 08 23:25:21 user nova-compute[75045]: ERROR nova.compute.manager [instance: 25cd59d1-6884-471a-813e-52e97c2e1208]     context, '3.44', skip_version_check=True).attachments.update(
Nov 08 23:25:21 user nova-compute[75045]: ERROR nova.compute.manager [instance: 25cd59d1-6884-471a-813e-52e97c2e1208]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Nov 08 23:25:21 user nova-compute[75045]: ERROR nova.compute.manager [instance: 25cd59d1-6884-471a-813e-52e97c2e1208]     return method.func(obj, *args, **kwargs)
Nov 08 23:25:21 user nova-compute[75045]: ERROR nova.compute.manager [instance: 25cd59d1-6884-471a-813e-52e97c2e1208]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Nov 08 23:25:21 user nova-compute[75045]: ERROR nova.compute.manager [instance: 25cd59d1-6884-471a-813e-52e97c2e1208]     resp = self._update('/attachments/%s' % id, body)
Nov 08 23:25:21 user nova-compute[75045]: ERROR nova.compute.manager [instance: 25cd59d1-6884-471a-813e-52e97c2e1208]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Nov 08 23:25:21 user nova-compute[75045]: ERROR nova.compute.manager [instance: 25cd59d1-6884-471a-813e-52e97c2e1208]     resp, body = self.api.client.put(url, body=body, **kwargs)
Nov 08 23:25:21 user nova-compute[75045]: ERROR nova.compute.manager [instance: 25cd59d1-6884-471a-813e-52e97c2e1208]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Nov 08 23:25:21 user nova-compute[75045]: ERROR nova.compute.manager [instance: 25cd59d1-6884-471a-813e-52e97c2e1208]     return self._cs_request(url, 'PUT', **kwargs)
Nov 08 23:25:21 user nova-compute[75045]: ERROR nova.compute.manager [instance: 25cd59d1-6884-471a-813e-52e97c2e1208]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 08 23:25:21 user nova-compute[75045]: ERROR nova.compute.manager [instance: 25cd59d1-6884-471a-813e-52e97c2e1208]     return self.request(url, method, **kwargs)
Nov 08 23:25:21 user nova-compute[75045]: ERROR nova.compute.manager [instance: 25cd59d1-6884-471a-813e-52e97c2e1208]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 08 23:25:21 user nova-compute[75045]: ERROR nova.compute.manager [instance: 25cd59d1-6884-471a-813e-52e97c2e1208]     raise exceptions.from_response(resp, body)
Nov 08 23:25:21 user nova-compute[75045]: ERROR nova.compute.manager [instance: 25cd59d1-6884-471a-813e-52e97c2e1208] cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-ab3af262-d8fd-47b4-b167-d338a3bbffae)
Nov 08 23:25:21 user nova-compute[75045]: ERROR nova.compute.manager [instance: 25cd59d1-6884-471a-813e-52e97c2e1208] 
Nov 08 23:25:21 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-60ff8c3d-8198-436e-bbc1-77adec44e5d5 tempest-TestServerVolumeAttachmentScenario-1899063447 tempest-TestServerVolumeAttachmentScenario-1899063447-project-member] Lock "25cd59d1-6884-471a-813e-52e97c2e1208" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 28.413s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:25:21 user nova-compute[75045]: ERROR oslo_messaging.rpc.server [None req-60ff8c3d-8198-436e-bbc1-77adec44e5d5 tempest-TestServerVolumeAttachmentScenario-1899063447 tempest-TestServerVolumeAttachmentScenario-1899063447-project-member] Exception during message handling: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-ab3af262-d8fd-47b4-b167-d338a3bbffae)
Nov 08 23:25:21 user nova-compute[75045]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 08 23:25:21 user nova-compute[75045]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Nov 08 23:25:21 user nova-compute[75045]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Nov 08 23:25:21 user nova-compute[75045]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Nov 08 23:25:21 user nova-compute[75045]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Nov 08 23:25:21 user nova-compute[75045]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Nov 08 23:25:21 user nova-compute[75045]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Nov 08 23:25:21 user nova-compute[75045]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Nov 08 23:25:21 user nova-compute[75045]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 08 23:25:21 user nova-compute[75045]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 08 23:25:21 user nova-compute[75045]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 08 23:25:21 user nova-compute[75045]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 08 23:25:21 user nova-compute[75045]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 08 23:25:21 user nova-compute[75045]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Nov 08 23:25:21 user nova-compute[75045]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Nov 08 23:25:21 user nova-compute[75045]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/utils.py", line 1439, in decorated_function
Nov 08 23:25:21 user nova-compute[75045]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Nov 08 23:25:21 user nova-compute[75045]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 213, in decorated_function
Nov 08 23:25:21 user nova-compute[75045]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 08 23:25:21 user nova-compute[75045]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 08 23:25:21 user nova-compute[75045]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 08 23:25:21 user nova-compute[75045]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 08 23:25:21 user nova-compute[75045]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 08 23:25:21 user nova-compute[75045]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 203, in decorated_function
Nov 08 23:25:21 user nova-compute[75045]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Nov 08 23:25:21 user nova-compute[75045]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7553, in attach_volume
Nov 08 23:25:21 user nova-compute[75045]: ERROR oslo_messaging.rpc.server     do_attach_volume(context, instance, driver_bdm)
Nov 08 23:25:21 user nova-compute[75045]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py", line 414, in inner
Nov 08 23:25:21 user nova-compute[75045]: ERROR oslo_messaging.rpc.server     return f(*args, **kwargs)
Nov 08 23:25:21 user nova-compute[75045]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7550, in do_attach_volume
Nov 08 23:25:21 user nova-compute[75045]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 08 23:25:21 user nova-compute[75045]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 08 23:25:21 user nova-compute[75045]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 08 23:25:21 user nova-compute[75045]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 08 23:25:21 user nova-compute[75045]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 08 23:25:21 user nova-compute[75045]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7548, in do_attach_volume
Nov 08 23:25:21 user nova-compute[75045]: ERROR oslo_messaging.rpc.server     return self._attach_volume(context, instance, driver_bdm)
Nov 08 23:25:21 user nova-compute[75045]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7570, in _attach_volume
Nov 08 23:25:21 user nova-compute[75045]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 08 23:25:21 user nova-compute[75045]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 08 23:25:21 user nova-compute[75045]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 08 23:25:21 user nova-compute[75045]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 08 23:25:21 user nova-compute[75045]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 08 23:25:21 user nova-compute[75045]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7567, in _attach_volume
Nov 08 23:25:21 user nova-compute[75045]: ERROR oslo_messaging.rpc.server     bdm.attach(context, instance, self.volume_api, self.driver,
Nov 08 23:25:21 user nova-compute[75045]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 46, in wrapped
Nov 08 23:25:21 user nova-compute[75045]: ERROR oslo_messaging.rpc.server     ret_val = method(obj, context, *args, **kwargs)
Nov 08 23:25:21 user nova-compute[75045]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 734, in attach
Nov 08 23:25:21 user nova-compute[75045]: ERROR oslo_messaging.rpc.server     self._do_attach(context, instance, volume, volume_api,
Nov 08 23:25:21 user nova-compute[75045]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 719, in _do_attach
Nov 08 23:25:21 user nova-compute[75045]: ERROR oslo_messaging.rpc.server     self._volume_attach(context, volume, connector, instance,
Nov 08 23:25:21 user nova-compute[75045]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 633, in _volume_attach
Nov 08 23:25:21 user nova-compute[75045]: ERROR oslo_messaging.rpc.server     connection_info = volume_api.attachment_update(
Nov 08 23:25:21 user nova-compute[75045]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 08 23:25:21 user nova-compute[75045]: ERROR oslo_messaging.rpc.server     res = method(self, ctx, *args, **kwargs)
Nov 08 23:25:21 user nova-compute[75045]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Nov 08 23:25:21 user nova-compute[75045]: ERROR oslo_messaging.rpc.server     res = method(self, ctx, attachment_id, *args, **kwargs)
Nov 08 23:25:21 user nova-compute[75045]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 915, in attachment_update
Nov 08 23:25:21 user nova-compute[75045]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 08 23:25:21 user nova-compute[75045]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 08 23:25:21 user nova-compute[75045]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 08 23:25:21 user nova-compute[75045]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 08 23:25:21 user nova-compute[75045]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 08 23:25:21 user nova-compute[75045]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 909, in attachment_update
Nov 08 23:25:21 user nova-compute[75045]: ERROR oslo_messaging.rpc.server     context, '3.44', skip_version_check=True).attachments.update(
Nov 08 23:25:21 user nova-compute[75045]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Nov 08 23:25:21 user nova-compute[75045]: ERROR oslo_messaging.rpc.server     return method.func(obj, *args, **kwargs)
Nov 08 23:25:21 user nova-compute[75045]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Nov 08 23:25:21 user nova-compute[75045]: ERROR oslo_messaging.rpc.server     resp = self._update('/attachments/%s' % id, body)
Nov 08 23:25:21 user nova-compute[75045]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Nov 08 23:25:21 user nova-compute[75045]: ERROR oslo_messaging.rpc.server     resp, body = self.api.client.put(url, body=body, **kwargs)
Nov 08 23:25:21 user nova-compute[75045]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Nov 08 23:25:21 user nova-compute[75045]: ERROR oslo_messaging.rpc.server     return self._cs_request(url, 'PUT', **kwargs)
Nov 08 23:25:21 user nova-compute[75045]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 08 23:25:21 user nova-compute[75045]: ERROR oslo_messaging.rpc.server     return self.request(url, method, **kwargs)
Nov 08 23:25:21 user nova-compute[75045]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 08 23:25:21 user nova-compute[75045]: ERROR oslo_messaging.rpc.server     raise exceptions.from_response(resp, body)
Nov 08 23:25:21 user nova-compute[75045]: ERROR oslo_messaging.rpc.server cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-ab3af262-d8fd-47b4-b167-d338a3bbffae)
Nov 08 23:25:21 user nova-compute[75045]: ERROR oslo_messaging.rpc.server 
Nov 08 23:25:24 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:25:26 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:25:29 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:25:31 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:25:34 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:25:36 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:25:37 user nova-compute[75045]: DEBUG nova.compute.manager [req-6dd67d9b-f3ae-4d61-a1a3-b1c2c4868013 req-bd1eb19f-8b47-40e7-96aa-de8eb6a01d66 service nova] [instance: 7ee70847-10de-49b6-9731-6d65b06532c8] Received event network-changed-d6445a4b-3c64-4aa0-b7c7-a5756db64532 {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:25:37 user nova-compute[75045]: DEBUG nova.compute.manager [req-6dd67d9b-f3ae-4d61-a1a3-b1c2c4868013 req-bd1eb19f-8b47-40e7-96aa-de8eb6a01d66 service nova] [instance: 7ee70847-10de-49b6-9731-6d65b06532c8] Refreshing instance network info cache due to event network-changed-d6445a4b-3c64-4aa0-b7c7-a5756db64532. {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 23:25:37 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-6dd67d9b-f3ae-4d61-a1a3-b1c2c4868013 req-bd1eb19f-8b47-40e7-96aa-de8eb6a01d66 service nova] Acquiring lock "refresh_cache-7ee70847-10de-49b6-9731-6d65b06532c8" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 23:25:37 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-6dd67d9b-f3ae-4d61-a1a3-b1c2c4868013 req-bd1eb19f-8b47-40e7-96aa-de8eb6a01d66 service nova] Acquired lock "refresh_cache-7ee70847-10de-49b6-9731-6d65b06532c8" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 23:25:37 user nova-compute[75045]: DEBUG nova.network.neutron [req-6dd67d9b-f3ae-4d61-a1a3-b1c2c4868013 req-bd1eb19f-8b47-40e7-96aa-de8eb6a01d66 service nova] [instance: 7ee70847-10de-49b6-9731-6d65b06532c8] Refreshing network info cache for port d6445a4b-3c64-4aa0-b7c7-a5756db64532 {{(pid=75045) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 23:25:38 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-74f54d8d-88bc-49a2-ab5e-4be5de3f614d tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Acquiring lock "7ee70847-10de-49b6-9731-6d65b06532c8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:25:38 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-74f54d8d-88bc-49a2-ab5e-4be5de3f614d tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Lock "7ee70847-10de-49b6-9731-6d65b06532c8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:25:38 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-74f54d8d-88bc-49a2-ab5e-4be5de3f614d tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Acquiring lock "7ee70847-10de-49b6-9731-6d65b06532c8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:25:38 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-74f54d8d-88bc-49a2-ab5e-4be5de3f614d tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Lock "7ee70847-10de-49b6-9731-6d65b06532c8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:25:38 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-74f54d8d-88bc-49a2-ab5e-4be5de3f614d tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Lock "7ee70847-10de-49b6-9731-6d65b06532c8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:25:38 user nova-compute[75045]: INFO nova.compute.manager [None req-74f54d8d-88bc-49a2-ab5e-4be5de3f614d tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] [instance: 7ee70847-10de-49b6-9731-6d65b06532c8] Terminating instance
Nov 08 23:25:38 user nova-compute[75045]: DEBUG nova.compute.manager [None req-74f54d8d-88bc-49a2-ab5e-4be5de3f614d tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] [instance: 7ee70847-10de-49b6-9731-6d65b06532c8] Start destroying the instance on the hypervisor. {{(pid=75045) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 23:25:38 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:25:38 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:25:38 user nova-compute[75045]: DEBUG nova.network.neutron [req-6dd67d9b-f3ae-4d61-a1a3-b1c2c4868013 req-bd1eb19f-8b47-40e7-96aa-de8eb6a01d66 service nova] [instance: 7ee70847-10de-49b6-9731-6d65b06532c8] Updated VIF entry in instance network info cache for port d6445a4b-3c64-4aa0-b7c7-a5756db64532. {{(pid=75045) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 23:25:38 user nova-compute[75045]: DEBUG nova.network.neutron [req-6dd67d9b-f3ae-4d61-a1a3-b1c2c4868013 req-bd1eb19f-8b47-40e7-96aa-de8eb6a01d66 service nova] [instance: 7ee70847-10de-49b6-9731-6d65b06532c8] Updating instance_info_cache with network_info: [{"id": "d6445a4b-3c64-4aa0-b7c7-a5756db64532", "address": "fa:16:3e:9f:ee:36", "network": {"id": "2f33d93d-98ec-4b87-a0c0-efe2d2ac8f6d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-719527911-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.37", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7eff4be777d24514be52868961bf7a25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6445a4b-3c", "ovs_interfaceid": "d6445a4b-3c64-4aa0-b7c7-a5756db64532", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75045) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 23:25:38 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-6dd67d9b-f3ae-4d61-a1a3-b1c2c4868013 req-bd1eb19f-8b47-40e7-96aa-de8eb6a01d66 service nova] Releasing lock "refresh_cache-7ee70847-10de-49b6-9731-6d65b06532c8" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 23:25:38 user nova-compute[75045]: DEBUG nova.compute.manager [req-8a7b4c37-5dba-4a7b-b811-cc7ef10c85d2 req-a2e8633b-2ccf-46d1-bf87-c7d79f7ff742 service nova] [instance: 7ee70847-10de-49b6-9731-6d65b06532c8] Received event network-vif-unplugged-d6445a4b-3c64-4aa0-b7c7-a5756db64532 {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:25:38 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-8a7b4c37-5dba-4a7b-b811-cc7ef10c85d2 req-a2e8633b-2ccf-46d1-bf87-c7d79f7ff742 service nova] Acquiring lock "7ee70847-10de-49b6-9731-6d65b06532c8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:25:38 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-8a7b4c37-5dba-4a7b-b811-cc7ef10c85d2 req-a2e8633b-2ccf-46d1-bf87-c7d79f7ff742 service nova] Lock "7ee70847-10de-49b6-9731-6d65b06532c8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:25:38 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-8a7b4c37-5dba-4a7b-b811-cc7ef10c85d2 req-a2e8633b-2ccf-46d1-bf87-c7d79f7ff742 service nova] Lock "7ee70847-10de-49b6-9731-6d65b06532c8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:25:38 user nova-compute[75045]: DEBUG nova.compute.manager [req-8a7b4c37-5dba-4a7b-b811-cc7ef10c85d2 req-a2e8633b-2ccf-46d1-bf87-c7d79f7ff742 service nova] [instance: 7ee70847-10de-49b6-9731-6d65b06532c8] No waiting events found dispatching network-vif-unplugged-d6445a4b-3c64-4aa0-b7c7-a5756db64532 {{(pid=75045) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 23:25:38 user nova-compute[75045]: DEBUG nova.compute.manager [req-8a7b4c37-5dba-4a7b-b811-cc7ef10c85d2 req-a2e8633b-2ccf-46d1-bf87-c7d79f7ff742 service nova] [instance: 7ee70847-10de-49b6-9731-6d65b06532c8] Received event network-vif-unplugged-d6445a4b-3c64-4aa0-b7c7-a5756db64532 for instance with task_state deleting. {{(pid=75045) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 23:25:38 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:25:38 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:25:39 user nova-compute[75045]: INFO nova.virt.libvirt.driver [-] [instance: 7ee70847-10de-49b6-9731-6d65b06532c8] Instance destroyed successfully.
Nov 08 23:25:39 user nova-compute[75045]: DEBUG nova.objects.instance [None req-74f54d8d-88bc-49a2-ab5e-4be5de3f614d tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Lazy-loading 'resources' on Instance uuid 7ee70847-10de-49b6-9731-6d65b06532c8 {{(pid=75045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 23:25:39 user nova-compute[75045]: DEBUG nova.virt.libvirt.vif [None req-74f54d8d-88bc-49a2-ab5e-4be5de3f614d tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T23:23:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-205119403',display_name='tempest-AttachVolumeNegativeTest-server-205119403',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-205119403',id=21,image_ref='a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF/AcMHCN1yLsphPUOJymoB8arG9AmwYlVpV2pXrg/5qqM85Y12212xIUjFveTFgUBwxO2xmPilEz4sPYEiW3rB8q4VeflZETWT76OVfLPHA9Ve/wohAW0gjaQZUpMDPuw==',key_name='tempest-keypair-1571543808',keypairs=<?>,launch_index=0,launched_at=2023-11-08T23:23:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7eff4be777d24514be52868961bf7a25',ramdisk_id='',reservation_id='r-kmwlghe3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1522456563',owner_user_name='tempest-AttachVolumeNegativeTest-1522456563-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T23:23:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4a05b178abe74b779a991e887bf135b2',uuid=7ee70847-10de-49b6-9731-6d65b06532c8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d6445a4b-3c64-4aa0-b7c7-a5756db64532", "address": "fa:16:3e:9f:ee:36", "network": {"id": "2f33d93d-98ec-4b87-a0c0-efe2d2ac8f6d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-719527911-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7eff4be777d24514be52868961bf7a25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6445a4b-3c", "ovs_interfaceid": "d6445a4b-3c64-4aa0-b7c7-a5756db64532", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75045) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 23:25:39 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-74f54d8d-88bc-49a2-ab5e-4be5de3f614d tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Converting VIF {"id": "d6445a4b-3c64-4aa0-b7c7-a5756db64532", "address": "fa:16:3e:9f:ee:36", "network": {"id": "2f33d93d-98ec-4b87-a0c0-efe2d2ac8f6d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-719527911-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7eff4be777d24514be52868961bf7a25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6445a4b-3c", "ovs_interfaceid": "d6445a4b-3c64-4aa0-b7c7-a5756db64532", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 23:25:39 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-74f54d8d-88bc-49a2-ab5e-4be5de3f614d tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9f:ee:36,bridge_name='br-int',has_traffic_filtering=True,id=d6445a4b-3c64-4aa0-b7c7-a5756db64532,network=Network(2f33d93d-98ec-4b87-a0c0-efe2d2ac8f6d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd6445a4b-3c') {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 23:25:39 user nova-compute[75045]: DEBUG os_vif [None req-74f54d8d-88bc-49a2-ab5e-4be5de3f614d tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9f:ee:36,bridge_name='br-int',has_traffic_filtering=True,id=d6445a4b-3c64-4aa0-b7c7-a5756db64532,network=Network(2f33d93d-98ec-4b87-a0c0-efe2d2ac8f6d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd6445a4b-3c') {{(pid=75045) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 23:25:39 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:25:39 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd6445a4b-3c, bridge=br-int, if_exists=True) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:25:39 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:25:39 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 23:25:39 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:25:39 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1a9696d2-eada-4909-bb52-ad0367217cd6) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:25:39 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:25:39 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:25:39 user nova-compute[75045]: INFO os_vif [None req-74f54d8d-88bc-49a2-ab5e-4be5de3f614d tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9f:ee:36,bridge_name='br-int',has_traffic_filtering=True,id=d6445a4b-3c64-4aa0-b7c7-a5756db64532,network=Network(2f33d93d-98ec-4b87-a0c0-efe2d2ac8f6d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd6445a4b-3c')
Nov 08 23:25:39 user nova-compute[75045]: INFO nova.virt.libvirt.driver [None req-74f54d8d-88bc-49a2-ab5e-4be5de3f614d tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] [instance: 7ee70847-10de-49b6-9731-6d65b06532c8] Deleting instance files /opt/stack/data/nova/instances/7ee70847-10de-49b6-9731-6d65b06532c8_del
Nov 08 23:25:39 user nova-compute[75045]: INFO nova.virt.libvirt.driver [None req-74f54d8d-88bc-49a2-ab5e-4be5de3f614d tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] [instance: 7ee70847-10de-49b6-9731-6d65b06532c8] Deletion of /opt/stack/data/nova/instances/7ee70847-10de-49b6-9731-6d65b06532c8_del complete
Nov 08 23:25:39 user nova-compute[75045]: INFO nova.compute.manager [None req-74f54d8d-88bc-49a2-ab5e-4be5de3f614d tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] [instance: 7ee70847-10de-49b6-9731-6d65b06532c8] Took 1.20 seconds to destroy the instance on the hypervisor.
Nov 08 23:25:39 user nova-compute[75045]: DEBUG oslo.service.loopingcall [None req-74f54d8d-88bc-49a2-ab5e-4be5de3f614d tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75045) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 23:25:39 user nova-compute[75045]: DEBUG nova.compute.manager [-] [instance: 7ee70847-10de-49b6-9731-6d65b06532c8] Deallocating network for instance {{(pid=75045) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 23:25:39 user nova-compute[75045]: DEBUG nova.network.neutron [-] [instance: 7ee70847-10de-49b6-9731-6d65b06532c8] deallocate_for_instance() {{(pid=75045) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 23:25:39 user nova-compute[75045]: DEBUG nova.network.neutron [-] [instance: 7ee70847-10de-49b6-9731-6d65b06532c8] Updating instance_info_cache with network_info: [] {{(pid=75045) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 23:25:40 user nova-compute[75045]: INFO nova.compute.manager [-] [instance: 7ee70847-10de-49b6-9731-6d65b06532c8] Took 0.75 seconds to deallocate network for instance.
Nov 08 23:25:40 user nova-compute[75045]: DEBUG nova.compute.manager [req-9511fcbb-70b3-4fb3-8290-333bcd86dd72 req-2133cca0-6120-4832-acd6-9f822e0050f7 service nova] [instance: 7ee70847-10de-49b6-9731-6d65b06532c8] Received event network-vif-deleted-d6445a4b-3c64-4aa0-b7c7-a5756db64532 {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:25:40 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-74f54d8d-88bc-49a2-ab5e-4be5de3f614d tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:25:40 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-74f54d8d-88bc-49a2-ab5e-4be5de3f614d tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:25:40 user nova-compute[75045]: DEBUG nova.compute.provider_tree [None req-74f54d8d-88bc-49a2-ab5e-4be5de3f614d tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Inventory has not changed in ProviderTree for provider: 62ba5f85-c74d-4b58-986e-d4197e813fd7 {{(pid=75045) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 23:25:40 user nova-compute[75045]: DEBUG nova.scheduler.client.report [None req-74f54d8d-88bc-49a2-ab5e-4be5de3f614d tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Inventory has not changed for provider 62ba5f85-c74d-4b58-986e-d4197e813fd7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75045) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 23:25:40 user nova-compute[75045]: DEBUG nova.compute.manager [req-4ae111fd-9f6c-486b-be0d-23bcbc74fe66 req-a84c9488-87db-4172-bbe3-4afb868ac691 service nova] [instance: 7ee70847-10de-49b6-9731-6d65b06532c8] Received event network-vif-plugged-d6445a4b-3c64-4aa0-b7c7-a5756db64532 {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:25:40 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-4ae111fd-9f6c-486b-be0d-23bcbc74fe66 req-a84c9488-87db-4172-bbe3-4afb868ac691 service nova] Acquiring lock "7ee70847-10de-49b6-9731-6d65b06532c8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:25:40 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-4ae111fd-9f6c-486b-be0d-23bcbc74fe66 req-a84c9488-87db-4172-bbe3-4afb868ac691 service nova] Lock "7ee70847-10de-49b6-9731-6d65b06532c8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:25:40 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-4ae111fd-9f6c-486b-be0d-23bcbc74fe66 req-a84c9488-87db-4172-bbe3-4afb868ac691 service nova] Lock "7ee70847-10de-49b6-9731-6d65b06532c8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:25:40 user nova-compute[75045]: DEBUG nova.compute.manager [req-4ae111fd-9f6c-486b-be0d-23bcbc74fe66 req-a84c9488-87db-4172-bbe3-4afb868ac691 service nova] [instance: 7ee70847-10de-49b6-9731-6d65b06532c8] No waiting events found dispatching network-vif-plugged-d6445a4b-3c64-4aa0-b7c7-a5756db64532 {{(pid=75045) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 23:25:40 user nova-compute[75045]: WARNING nova.compute.manager [req-4ae111fd-9f6c-486b-be0d-23bcbc74fe66 req-a84c9488-87db-4172-bbe3-4afb868ac691 service nova] [instance: 7ee70847-10de-49b6-9731-6d65b06532c8] Received unexpected event network-vif-plugged-d6445a4b-3c64-4aa0-b7c7-a5756db64532 for instance with vm_state deleted and task_state None.
Nov 08 23:25:40 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-74f54d8d-88bc-49a2-ab5e-4be5de3f614d tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.479s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:25:40 user nova-compute[75045]: INFO nova.scheduler.client.report [None req-74f54d8d-88bc-49a2-ab5e-4be5de3f614d tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Deleted allocations for instance 7ee70847-10de-49b6-9731-6d65b06532c8
Nov 08 23:25:40 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-74f54d8d-88bc-49a2-ab5e-4be5de3f614d tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Lock "7ee70847-10de-49b6-9731-6d65b06532c8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.692s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:25:41 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:25:44 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:25:44 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:25:44 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:25:44 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:25:44 user nova-compute[75045]: DEBUG nova.compute.manager [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Starting heal instance info cache {{(pid=75045) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 23:25:44 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Acquiring lock "refresh_cache-d2c911cf-d5f4-4c19-8335-8c7834184a7e" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 23:25:44 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Acquired lock "refresh_cache-d2c911cf-d5f4-4c19-8335-8c7834184a7e" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 23:25:44 user nova-compute[75045]: DEBUG nova.network.neutron [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] [instance: d2c911cf-d5f4-4c19-8335-8c7834184a7e] Forcefully refreshing network info cache for instance {{(pid=75045) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 23:25:45 user nova-compute[75045]: DEBUG nova.network.neutron [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] [instance: d2c911cf-d5f4-4c19-8335-8c7834184a7e] Updating instance_info_cache with network_info: [{"id": "f4321c52-b9d5-434c-820f-25cab4239ef4", "address": "fa:16:3e:49:6b:27", "network": {"id": "d4cd6998-66d1-4389-bc82-dd000c8962de", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-323966879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bfb6963a6c145d4a7b7e47c8fde7e60", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4321c52-b9", "ovs_interfaceid": "f4321c52-b9d5-434c-820f-25cab4239ef4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75045) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 23:25:45 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Releasing lock "refresh_cache-d2c911cf-d5f4-4c19-8335-8c7834184a7e" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 23:25:45 user nova-compute[75045]: DEBUG nova.compute.manager [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] [instance: d2c911cf-d5f4-4c19-8335-8c7834184a7e] Updated the network info_cache for instance {{(pid=75045) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 23:25:45 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:25:45 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:25:45 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:25:45 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:25:45 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:25:45 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:25:45 user nova-compute[75045]: DEBUG nova.compute.manager [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75045) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 23:25:45 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager.update_available_resource {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:25:45 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:25:45 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:25:45 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:25:45 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Auditing locally available compute resources for user (node: user) {{(pid=75045) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 23:25:45 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72c9d731-2b35-434c-8463-1cd6c18fbd6a/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:25:45 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72c9d731-2b35-434c-8463-1cd6c18fbd6a/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:25:45 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72c9d731-2b35-434c-8463-1cd6c18fbd6a/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:25:45 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72c9d731-2b35-434c-8463-1cd6c18fbd6a/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:25:45 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75045) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 23:25:45 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ae5ff6b-6f2c-4dfd-a4c6-da4809e2cf27/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:25:46 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ae5ff6b-6f2c-4dfd-a4c6-da4809e2cf27/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:25:46 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ae5ff6b-6f2c-4dfd-a4c6-da4809e2cf27/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:25:46 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:25:46 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ae5ff6b-6f2c-4dfd-a4c6-da4809e2cf27/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:25:46 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] skipping disk /dev/sdh (vda) as it is a volume {{(pid=75045) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 23:25:46 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/032e20aa-8887-4215-808e-68299a0d8d0b/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:25:46 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/032e20aa-8887-4215-808e-68299a0d8d0b/disk --force-share --output=json" returned: 0 in 0.315s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:25:46 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/032e20aa-8887-4215-808e-68299a0d8d0b/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:25:46 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/032e20aa-8887-4215-808e-68299a0d8d0b/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:25:46 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f21fcd3-ac5f-499e-9c34-82af806fda1d/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:25:46 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f21fcd3-ac5f-499e-9c34-82af806fda1d/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:25:46 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f21fcd3-ac5f-499e-9c34-82af806fda1d/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:25:47 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f21fcd3-ac5f-499e-9c34-82af806fda1d/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:25:47 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e92ab9a-8ea4-4452-a458-db181d4a59b7/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:25:47 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e92ab9a-8ea4-4452-a458-db181d4a59b7/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:25:47 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e92ab9a-8ea4-4452-a458-db181d4a59b7/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:25:47 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e92ab9a-8ea4-4452-a458-db181d4a59b7/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:25:47 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa67b237-f598-4111-87ba-d761aa50d95e/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:25:47 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa67b237-f598-4111-87ba-d761aa50d95e/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:25:47 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa67b237-f598-4111-87ba-d761aa50d95e/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:25:47 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa67b237-f598-4111-87ba-d761aa50d95e/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:25:47 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83d225e0-e39e-4500-b7ae-52dfbd8b8588/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:25:47 user nova-compute[75045]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4579f742-2339-4237-857a-f7d4a5f3f37c tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] [instance: 83d225e0-e39e-4500-b7ae-52dfbd8b8588] Calling os-brick to attach iSCSI Volume {{(pid=75045) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 23:25:47 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-4579f742-2339-4237-857a-f7d4a5f3f37c tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1b68210460>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d2e734fa-1dcb-4510-a50e-064e29c2985e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qCUrDkTz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75045) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 23:25:47 user nova-compute[75045]: WARNING os_brick.initiator.connectors.base [None req-4579f742-2339-4237-857a-f7d4a5f3f37c tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 23:25:47 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-4579f742-2339-4237-857a-f7d4a5f3f37c tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 23:25:47 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-4579f742-2339-4237-857a-f7d4a5f3f37c tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 23:25:47 user nova-compute[75045]: WARNING os_brick.initiator.connectors.base [None req-4579f742-2339-4237-857a-f7d4a5f3f37c tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 23:25:47 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-4579f742-2339-4237-857a-f7d4a5f3f37c tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d2e734fa-1dcb-4510-a50e-064e29c2985e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 23:25:47 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-4579f742-2339-4237-857a-f7d4a5f3f37c tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d2e734fa-1dcb-4510-a50e-064e29c2985e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 23:25:47 user nova-compute[75045]: INFO os_brick.initiator.connectors.iscsi [None req-4579f742-2339-4237-857a-f7d4a5f3f37c tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 23:25:47 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2e734fa-1dcb-4510-a50e-064e29c2985e -p 172.16.0.220:3260 {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:25:47 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2e734fa-1dcb-4510-a50e-064e29c2985e -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:25:47 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[018bee7c-76c4-46ab-b566-1c5baed08994]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:25:47 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-4579f742-2339-4237-857a-f7d4a5f3f37c tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 23:25:47 user nova-compute[75045]:  {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:25:47 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2e734fa-1dcb-4510-a50e-064e29c2985e -p 172.16.0.220:3260 --interface default --op new {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:25:48 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2e734fa-1dcb-4510-a50e-064e29c2985e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.026s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:25:48 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[0558a807-964e-4017-855f-e41b60f47e46]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d2e734fa-1dcb-4510-a50e-064e29c2985e] added\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:25:48 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-4579f742-2339-4237-857a-f7d4a5f3f37c tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d2e734fa-1dcb-4510-a50e-064e29c2985e] added
Nov 08 23:25:48 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:25:48 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2e734fa-1dcb-4510-a50e-064e29c2985e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:25:48 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2e734fa-1dcb-4510-a50e-064e29c2985e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:25:48 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb2fb8fd-325e-4179-b812-62a7802a67cb]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:25:48 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-4579f742-2339-4237-857a-f7d4a5f3f37c tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:25:48 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2e734fa-1dcb-4510-a50e-064e29c2985e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:25:48 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2e734fa-1dcb-4510-a50e-064e29c2985e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:25:48 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[84ce6822-ccf0-4b11-9f9d-34e3c39f985c]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:25:48 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-4579f742-2339-4237-857a-f7d4a5f3f37c tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:25:48 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2e734fa-1dcb-4510-a50e-064e29c2985e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qCUrDkTz {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:25:48 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2e734fa-1dcb-4510-a50e-064e29c2985e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qCUrDkTz" returned: 0 in 0.018s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:25:48 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dca422f-5698-4cd6-952b-473061c7c2ad]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:25:48 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-4579f742-2339-4237-857a-f7d4a5f3f37c tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'qCUrDkTz'): stdout= stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:25:48 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83d225e0-e39e-4500-b7ae-52dfbd8b8588/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:25:48 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83d225e0-e39e-4500-b7ae-52dfbd8b8588/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:25:48 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2e734fa-1dcb-4510-a50e-064e29c2985e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:25:48 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2e734fa-1dcb-4510-a50e-064e29c2985e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:25:48 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[958fb5c9-4ea0-4142-be6d-d631f24ba433]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:25:48 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-4579f742-2339-4237-857a-f7d4a5f3f37c tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:25:48 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:25:48 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:25:48 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f26ec36-2238-4b08-bbfc-402144cd2023]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd1b2206-989e-409d-84c6-49b37ac252d8 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04d02c98-d058-49d8-a350-ab9e63003d6e (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c37da13-9531-458a-87cb-1e86e6b84f3a (non-flash)\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:25:48 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-4579f742-2339-4237-857a-f7d4a5f3f37c tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab (non-flash)
Nov 08 23:25:48 user nova-compute[75045]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd1b2206-989e-409d-84c6-49b37ac252d8 (non-flash)
Nov 08 23:25:48 user nova-compute[75045]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04d02c98-d058-49d8-a350-ab9e63003d6e (non-flash)
Nov 08 23:25:48 user nova-compute[75045]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c37da13-9531-458a-87cb-1e86e6b84f3a (non-flash)
Nov 08 23:25:48 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 23:25:48 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-4579f742-2339-4237-857a-f7d4a5f3f37c tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab (non-flash)
Nov 08 23:25:48 user nova-compute[75045]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd1b2206-989e-409d-84c6-49b37ac252d8 (non-flash)
Nov 08 23:25:48 user nova-compute[75045]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04d02c98-d058-49d8-a350-ab9e63003d6e (non-flash)
Nov 08 23:25:48 user nova-compute[75045]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c37da13-9531-458a-87cb-1e86e6b84f3a (non-flash)
Nov 08 23:25:48 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 23:25:48 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2e734fa-1dcb-4510-a50e-064e29c2985e -p 172.16.0.220:3260 --login {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:25:48 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2e734fa-1dcb-4510-a50e-064e29c2985e -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:25:48 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[748f1b66-08d7-4355-a198-f0343f39ea53]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d2e734fa-1dcb-4510-a50e-064e29c2985e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d2e734fa-1dcb-4510-a50e-064e29c2985e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:25:48 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-4579f742-2339-4237-857a-f7d4a5f3f37c tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d2e734fa-1dcb-4510-a50e-064e29c2985e, portal: 172.16.0.220,3260]
Nov 08 23:25:48 user nova-compute[75045]: Login to [iface: default, target: iqn.2010-10.org.openstack:d2e734fa-1dcb-4510-a50e-064e29c2985e, portal: 172.16.0.220,3260] successful.
Nov 08 23:25:48 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:25:48 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2e734fa-1dcb-4510-a50e-064e29c2985e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:25:48 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2e734fa-1dcb-4510-a50e-064e29c2985e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:25:48 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[986a5145-2213-4148-90a6-c909e7237f89]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:25:48 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-4579f742-2339-4237-857a-f7d4a5f3f37c tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:25:48 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:25:48 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83d225e0-e39e-4500-b7ae-52dfbd8b8588/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:25:48 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43f31110-89ec-4b20-9842-7c9dd7df0e14/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:25:48 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:25:48 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d5c3697-aea8-4ecf-9c78-386c2428f3d9]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd1b2206-989e-409d-84c6-49b37ac252d8 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04d02c98-d058-49d8-a350-ab9e63003d6e (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c37da13-9531-458a-87cb-1e86e6b84f3a (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2e734fa-1dcb-4510-a50e-064e29c2985e (non-flash)\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:25:48 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-4579f742-2339-4237-857a-f7d4a5f3f37c tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab (non-flash)
Nov 08 23:25:48 user nova-compute[75045]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd1b2206-989e-409d-84c6-49b37ac252d8 (non-flash)
Nov 08 23:25:48 user nova-compute[75045]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04d02c98-d058-49d8-a350-ab9e63003d6e (non-flash)
Nov 08 23:25:48 user nova-compute[75045]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c37da13-9531-458a-87cb-1e86e6b84f3a (non-flash)
Nov 08 23:25:48 user nova-compute[75045]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2e734fa-1dcb-4510-a50e-064e29c2985e (non-flash)
Nov 08 23:25:48 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 23:25:48 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-4579f742-2339-4237-857a-f7d4a5f3f37c tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab (non-flash)
Nov 08 23:25:48 user nova-compute[75045]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd1b2206-989e-409d-84c6-49b37ac252d8 (non-flash)
Nov 08 23:25:48 user nova-compute[75045]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04d02c98-d058-49d8-a350-ab9e63003d6e (non-flash)
Nov 08 23:25:48 user nova-compute[75045]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c37da13-9531-458a-87cb-1e86e6b84f3a (non-flash)
Nov 08 23:25:48 user nova-compute[75045]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2e734fa-1dcb-4510-a50e-064e29c2985e (non-flash)
Nov 08 23:25:48 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 23:25:48 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-4579f742-2339-4237-857a-f7d4a5f3f37c tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d2e734fa-1dcb-4510-a50e-064e29c2985e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.354s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 23:25:48 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-4579f742-2339-4237-857a-f7d4a5f3f37c tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] Connected to 172.16.0.220:3260 {{(pid=75045) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 23:25:48 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-4579f742-2339-4237-857a-f7d4a5f3f37c tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] HCTL ('34', '-', '-', 0) found on session 21 with lun 0 {{(pid=75045) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 23:25:48 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-4579f742-2339-4237-857a-f7d4a5f3f37c tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75045) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 23:25:48 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:25:48 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.026s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:25:48 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[78aa644b-c9a1-41e7-b8de-9d52941481bb]: (4, ('- - 0', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:25:48 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-4579f742-2339-4237-857a-f7d4a5f3f37c tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] Searching for a device in session 21 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75045) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 23:25:48 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-4579f742-2339-4237-857a-f7d4a5f3f37c tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:d2e734fa-1dcb-4510-a50e-064e29c2985e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qCUrDkTz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75045) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 23:25:48 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43f31110-89ec-4b20-9842-7c9dd7df0e14/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:25:48 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43f31110-89ec-4b20-9842-7c9dd7df0e14/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:25:48 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-dd389555-c469-4e87-b335-d058f10ae62a tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Acquiring lock "032e20aa-8887-4215-808e-68299a0d8d0b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:25:48 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-dd389555-c469-4e87-b335-d058f10ae62a tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Lock "032e20aa-8887-4215-808e-68299a0d8d0b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:25:48 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-dd389555-c469-4e87-b335-d058f10ae62a tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Acquiring lock "032e20aa-8887-4215-808e-68299a0d8d0b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:25:48 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-dd389555-c469-4e87-b335-d058f10ae62a tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Lock "032e20aa-8887-4215-808e-68299a0d8d0b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:25:48 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-dd389555-c469-4e87-b335-d058f10ae62a tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Lock "032e20aa-8887-4215-808e-68299a0d8d0b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:25:48 user nova-compute[75045]: INFO nova.compute.manager [None req-dd389555-c469-4e87-b335-d058f10ae62a tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] [instance: 032e20aa-8887-4215-808e-68299a0d8d0b] Terminating instance
Nov 08 23:25:48 user nova-compute[75045]: DEBUG nova.compute.manager [None req-dd389555-c469-4e87-b335-d058f10ae62a tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] [instance: 032e20aa-8887-4215-808e-68299a0d8d0b] Start destroying the instance on the hypervisor. {{(pid=75045) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 23:25:48 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:25:48 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43f31110-89ec-4b20-9842-7c9dd7df0e14/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:25:48 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75045) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 23:25:48 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25cd59d1-6884-471a-813e-52e97c2e1208/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:25:48 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:25:48 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25cd59d1-6884-471a-813e-52e97c2e1208/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:25:48 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25cd59d1-6884-471a-813e-52e97c2e1208/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:25:48 user nova-compute[75045]: DEBUG nova.compute.manager [req-2b805234-8e2b-409c-8fc6-b6059ed75cfb req-daeca546-734b-4537-b57c-312da1507e6c service nova] [instance: 032e20aa-8887-4215-808e-68299a0d8d0b] Received event network-vif-unplugged-9cd2b9ae-f99a-4f33-8b8b-e2013d3c05e6 {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:25:48 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-2b805234-8e2b-409c-8fc6-b6059ed75cfb req-daeca546-734b-4537-b57c-312da1507e6c service nova] Acquiring lock "032e20aa-8887-4215-808e-68299a0d8d0b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:25:48 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-2b805234-8e2b-409c-8fc6-b6059ed75cfb req-daeca546-734b-4537-b57c-312da1507e6c service nova] Lock "032e20aa-8887-4215-808e-68299a0d8d0b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:25:48 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-2b805234-8e2b-409c-8fc6-b6059ed75cfb req-daeca546-734b-4537-b57c-312da1507e6c service nova] Lock "032e20aa-8887-4215-808e-68299a0d8d0b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:25:48 user nova-compute[75045]: DEBUG nova.compute.manager [req-2b805234-8e2b-409c-8fc6-b6059ed75cfb req-daeca546-734b-4537-b57c-312da1507e6c service nova] [instance: 032e20aa-8887-4215-808e-68299a0d8d0b] No waiting events found dispatching network-vif-unplugged-9cd2b9ae-f99a-4f33-8b8b-e2013d3c05e6 {{(pid=75045) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 23:25:48 user nova-compute[75045]: DEBUG nova.compute.manager [req-2b805234-8e2b-409c-8fc6-b6059ed75cfb req-daeca546-734b-4537-b57c-312da1507e6c service nova] [instance: 032e20aa-8887-4215-808e-68299a0d8d0b] Received event network-vif-unplugged-9cd2b9ae-f99a-4f33-8b8b-e2013d3c05e6 for instance with task_state deleting. {{(pid=75045) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 23:25:48 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:25:48 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:25:49 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25cd59d1-6884-471a-813e-52e97c2e1208/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:25:49 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=75045) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 23:25:49 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5fc7f02-2143-4bcf-92ac-078d5ec10747/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:25:49 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:25:49 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5fc7f02-2143-4bcf-92ac-078d5ec10747/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:25:49 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5fc7f02-2143-4bcf-92ac-078d5ec10747/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:25:49 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-4579f742-2339-4237-857a-f7d4a5f3f37c tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.403s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 23:25:49 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-4579f742-2339-4237-857a-f7d4a5f3f37c tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] <== connect_volume: return (1409ms) {'type': 'block', 'scsi_wwn': '23230663034306433', 'path': '/dev/sdc'} {{(pid=75045) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 23:25:49 user nova-compute[75045]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4579f742-2339-4237-857a-f7d4a5f3f37c tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] [instance: 83d225e0-e39e-4500-b7ae-52dfbd8b8588] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23230663034306433', 'path': '/dev/sdc'} {{(pid=75045) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 23:25:49 user nova-compute[75045]: DEBUG nova.objects.instance [None req-4579f742-2339-4237-857a-f7d4a5f3f37c tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] Lazy-loading 'flavor' on Instance uuid 83d225e0-e39e-4500-b7ae-52dfbd8b8588 {{(pid=75045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 23:25:49 user nova-compute[75045]: INFO nova.virt.libvirt.driver [-] [instance: 032e20aa-8887-4215-808e-68299a0d8d0b] Instance destroyed successfully.
Nov 08 23:25:49 user nova-compute[75045]: DEBUG nova.objects.instance [None req-dd389555-c469-4e87-b335-d058f10ae62a tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Lazy-loading 'resources' on Instance uuid 032e20aa-8887-4215-808e-68299a0d8d0b {{(pid=75045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 23:25:49 user nova-compute[75045]: DEBUG nova.virt.libvirt.vif [None req-dd389555-c469-4e87-b335-d058f10ae62a tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-08T23:19:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1752899834',display_name='tempest-ServerActionsTestOtherA-server-1825293127',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1752899834',id=14,image_ref='a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM+q2m9WsZpZxsu7IWDJqTSDAyt9zen9gZBXmCH3tBzXyeyKdTBcMPy8pYQxPGeGnPRc+jFEID8sOJopOMmrv8cAChFAOof4/DA6j4PlbpQ3YcCnU4/0PdUKZbkLWBt7Jg==',key_name='tempest-keypair-1151386852',keypairs=<?>,launch_index=0,launched_at=2023-11-08T23:22:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e63623113f11463d9035bb990de43510',ramdisk_id='',reservation_id='r-vxqzthcz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-2056815713',owner_user_name='tempest-ServerActionsTestOtherA-2056815713-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T23:22:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='75fc508f268d4a569ad78598ff019c14',uuid=032e20aa-8887-4215-808e-68299a0d8d0b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9cd2b9ae-f99a-4f33-8b8b-e2013d3c05e6", "address": "fa:16:3e:df:66:51", "network": {"id": "700b5784-d35b-45c0-a4d3-1ab8aa4c48aa", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-194469807-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.181", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e63623113f11463d9035bb990de43510", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9cd2b9ae-f9", "ovs_interfaceid": "9cd2b9ae-f99a-4f33-8b8b-e2013d3c05e6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75045) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 23:25:49 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-dd389555-c469-4e87-b335-d058f10ae62a tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Converting VIF {"id": "9cd2b9ae-f99a-4f33-8b8b-e2013d3c05e6", "address": "fa:16:3e:df:66:51", "network": {"id": "700b5784-d35b-45c0-a4d3-1ab8aa4c48aa", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-194469807-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.181", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e63623113f11463d9035bb990de43510", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9cd2b9ae-f9", "ovs_interfaceid": "9cd2b9ae-f99a-4f33-8b8b-e2013d3c05e6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 23:25:49 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-dd389555-c469-4e87-b335-d058f10ae62a tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:df:66:51,bridge_name='br-int',has_traffic_filtering=True,id=9cd2b9ae-f99a-4f33-8b8b-e2013d3c05e6,network=Network(700b5784-d35b-45c0-a4d3-1ab8aa4c48aa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9cd2b9ae-f9') {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 23:25:49 user nova-compute[75045]: DEBUG os_vif [None req-dd389555-c469-4e87-b335-d058f10ae62a tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:df:66:51,bridge_name='br-int',has_traffic_filtering=True,id=9cd2b9ae-f99a-4f33-8b8b-e2013d3c05e6,network=Network(700b5784-d35b-45c0-a4d3-1ab8aa4c48aa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9cd2b9ae-f9') {{(pid=75045) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 23:25:49 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:25:49 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9cd2b9ae-f9, bridge=br-int, if_exists=True) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:25:49 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:25:49 user nova-compute[75045]: DEBUG nova.virt.libvirt.guest [None req-4579f742-2339-4237-857a-f7d4a5f3f37c tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] attach device xml: <disk type="block" device="disk">
Nov 08 23:25:49 user nova-compute[75045]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 23:25:49 user nova-compute[75045]:   <source dev="/dev/sdc"/>
Nov 08 23:25:49 user nova-compute[75045]:   <target dev="vdb" bus="virtio"/>
Nov 08 23:25:49 user nova-compute[75045]:   <serial>d2e734fa-1dcb-4510-a50e-064e29c2985e</serial>
Nov 08 23:25:49 user nova-compute[75045]: </disk>
Nov 08 23:25:49 user nova-compute[75045]:  {{(pid=75045) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 08 23:25:49 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 23:25:49 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:25:49 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e2fac339-762c-4c34-93e2-d1f406bd302e) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:25:49 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:25:49 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:25:49 user nova-compute[75045]: INFO os_vif [None req-dd389555-c469-4e87-b335-d058f10ae62a tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:df:66:51,bridge_name='br-int',has_traffic_filtering=True,id=9cd2b9ae-f99a-4f33-8b8b-e2013d3c05e6,network=Network(700b5784-d35b-45c0-a4d3-1ab8aa4c48aa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9cd2b9ae-f9')
Nov 08 23:25:49 user nova-compute[75045]: INFO nova.virt.libvirt.driver [None req-dd389555-c469-4e87-b335-d058f10ae62a tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] [instance: 032e20aa-8887-4215-808e-68299a0d8d0b] Deleting instance files /opt/stack/data/nova/instances/032e20aa-8887-4215-808e-68299a0d8d0b_del
Nov 08 23:25:49 user nova-compute[75045]: INFO nova.virt.libvirt.driver [None req-dd389555-c469-4e87-b335-d058f10ae62a tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] [instance: 032e20aa-8887-4215-808e-68299a0d8d0b] Deletion of /opt/stack/data/nova/instances/032e20aa-8887-4215-808e-68299a0d8d0b_del complete
Nov 08 23:25:49 user nova-compute[75045]: DEBUG nova.compute.manager [req-95b9d7d7-c255-4b81-9378-c7988b35f7c6 req-79aec385-bd18-42df-8544-c11e27900b3b service nova] [instance: 667d20c3-3eda-4aa5-b799-6dcee3443833] Received event network-changed-0d5e497c-3168-46b1-9094-9bb54737cc0f {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:25:49 user nova-compute[75045]: DEBUG nova.compute.manager [req-95b9d7d7-c255-4b81-9378-c7988b35f7c6 req-79aec385-bd18-42df-8544-c11e27900b3b service nova] [instance: 667d20c3-3eda-4aa5-b799-6dcee3443833] Refreshing instance network info cache due to event network-changed-0d5e497c-3168-46b1-9094-9bb54737cc0f. {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 23:25:49 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-95b9d7d7-c255-4b81-9378-c7988b35f7c6 req-79aec385-bd18-42df-8544-c11e27900b3b service nova] Acquiring lock "refresh_cache-667d20c3-3eda-4aa5-b799-6dcee3443833" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 23:25:49 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-95b9d7d7-c255-4b81-9378-c7988b35f7c6 req-79aec385-bd18-42df-8544-c11e27900b3b service nova] Acquired lock "refresh_cache-667d20c3-3eda-4aa5-b799-6dcee3443833" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 23:25:49 user nova-compute[75045]: DEBUG nova.network.neutron [req-95b9d7d7-c255-4b81-9378-c7988b35f7c6 req-79aec385-bd18-42df-8544-c11e27900b3b service nova] [instance: 667d20c3-3eda-4aa5-b799-6dcee3443833] Refreshing network info cache for port 0d5e497c-3168-46b1-9094-9bb54737cc0f {{(pid=75045) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 23:25:49 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5fc7f02-2143-4bcf-92ac-078d5ec10747/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:25:49 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b84f2b1-01a3-4789-bcef-8b7c4334132b/disk.rescue --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:25:49 user nova-compute[75045]: INFO nova.compute.manager [None req-dd389555-c469-4e87-b335-d058f10ae62a tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] [instance: 032e20aa-8887-4215-808e-68299a0d8d0b] Took 0.98 seconds to destroy the instance on the hypervisor.
Nov 08 23:25:49 user nova-compute[75045]: DEBUG oslo.service.loopingcall [None req-dd389555-c469-4e87-b335-d058f10ae62a tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75045) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 23:25:49 user nova-compute[75045]: DEBUG nova.compute.manager [-] [instance: 032e20aa-8887-4215-808e-68299a0d8d0b] Deallocating network for instance {{(pid=75045) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 23:25:49 user nova-compute[75045]: DEBUG nova.network.neutron [-] [instance: 032e20aa-8887-4215-808e-68299a0d8d0b] deallocate_for_instance() {{(pid=75045) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 23:25:49 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b84f2b1-01a3-4789-bcef-8b7c4334132b/disk.rescue --force-share --output=json" returned: 0 in 0.183s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:25:49 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b84f2b1-01a3-4789-bcef-8b7c4334132b/disk.rescue --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:25:49 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b84f2b1-01a3-4789-bcef-8b7c4334132b/disk.rescue --force-share --output=json" returned: 0 in 0.192s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:25:49 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b84f2b1-01a3-4789-bcef-8b7c4334132b/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:25:49 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-4579f742-2339-4237-857a-f7d4a5f3f37c tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] No BDM found with device name vda, not building metadata. {{(pid=75045) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 23:25:49 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-4579f742-2339-4237-857a-f7d4a5f3f37c tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75045) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 23:25:49 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-4579f742-2339-4237-857a-f7d4a5f3f37c tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] No VIF found with MAC fa:16:3e:d9:92:a4, not building metadata {{(pid=75045) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 23:25:50 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b84f2b1-01a3-4789-bcef-8b7c4334132b/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:25:50 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b84f2b1-01a3-4789-bcef-8b7c4334132b/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:25:50 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-4579f742-2339-4237-857a-f7d4a5f3f37c tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] Lock "83d225e0-e39e-4500-b7ae-52dfbd8b8588" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 30.328s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:25:50 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b84f2b1-01a3-4789-bcef-8b7c4334132b/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:25:50 user nova-compute[75045]: DEBUG nova.network.neutron [req-95b9d7d7-c255-4b81-9378-c7988b35f7c6 req-79aec385-bd18-42df-8544-c11e27900b3b service nova] [instance: 667d20c3-3eda-4aa5-b799-6dcee3443833] Updated VIF entry in instance network info cache for port 0d5e497c-3168-46b1-9094-9bb54737cc0f. {{(pid=75045) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 23:25:50 user nova-compute[75045]: DEBUG nova.network.neutron [req-95b9d7d7-c255-4b81-9378-c7988b35f7c6 req-79aec385-bd18-42df-8544-c11e27900b3b service nova] [instance: 667d20c3-3eda-4aa5-b799-6dcee3443833] Updating instance_info_cache with network_info: [{"id": "0d5e497c-3168-46b1-9094-9bb54737cc0f", "address": "fa:16:3e:80:07:f1", "network": {"id": "22898442-b87a-4538-a8f5-fe275919f44a", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-665667609-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.146", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "89744dd7de584b14880bc42dd96933af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d5e497c-31", "ovs_interfaceid": "0d5e497c-3168-46b1-9094-9bb54737cc0f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75045) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 23:25:50 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-95b9d7d7-c255-4b81-9378-c7988b35f7c6 req-79aec385-bd18-42df-8544-c11e27900b3b service nova] Releasing lock "refresh_cache-667d20c3-3eda-4aa5-b799-6dcee3443833" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 23:25:50 user nova-compute[75045]: DEBUG nova.network.neutron [-] [instance: 032e20aa-8887-4215-808e-68299a0d8d0b] Updating instance_info_cache with network_info: [] {{(pid=75045) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 23:25:50 user nova-compute[75045]: WARNING nova.virt.libvirt.driver [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 23:25:50 user nova-compute[75045]: WARNING nova.virt.libvirt.driver [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 23:25:50 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Hypervisor/Node resource view: name=user free_ram=7056MB free_disk=25.154178619384766GB free_vcpus=-1 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75045) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 23:25:50 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:25:50 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:25:50 user nova-compute[75045]: INFO nova.compute.manager [None req-55671725-cabc-42f6-b791-699dfac90390 tempest-ServerActionsV293TestJSON-1645081958 tempest-ServerActionsV293TestJSON-1645081958-project-member] [instance: 667d20c3-3eda-4aa5-b799-6dcee3443833] Rebuilding instance
Nov 08 23:25:50 user nova-compute[75045]: INFO nova.compute.manager [-] [instance: 032e20aa-8887-4215-808e-68299a0d8d0b] Took 1.33 seconds to deallocate network for instance.
Nov 08 23:25:51 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-dd389555-c469-4e87-b335-d058f10ae62a tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:25:51 user nova-compute[75045]: DEBUG nova.compute.manager [None req-55671725-cabc-42f6-b791-699dfac90390 tempest-ServerActionsV293TestJSON-1645081958 tempest-ServerActionsV293TestJSON-1645081958-project-member] [instance: 667d20c3-3eda-4aa5-b799-6dcee3443833] Checking state {{(pid=75045) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 23:25:51 user nova-compute[75045]: DEBUG nova.compute.manager [req-15591740-6906-4e6c-b70b-96181df9525a req-79ce384c-2019-4ccb-8ca4-c61292f56d40 service nova] [instance: 032e20aa-8887-4215-808e-68299a0d8d0b] Received event network-vif-plugged-9cd2b9ae-f99a-4f33-8b8b-e2013d3c05e6 {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:25:51 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-15591740-6906-4e6c-b70b-96181df9525a req-79ce384c-2019-4ccb-8ca4-c61292f56d40 service nova] Acquiring lock "032e20aa-8887-4215-808e-68299a0d8d0b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:25:51 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-15591740-6906-4e6c-b70b-96181df9525a req-79ce384c-2019-4ccb-8ca4-c61292f56d40 service nova] Lock "032e20aa-8887-4215-808e-68299a0d8d0b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:25:51 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-15591740-6906-4e6c-b70b-96181df9525a req-79ce384c-2019-4ccb-8ca4-c61292f56d40 service nova] Lock "032e20aa-8887-4215-808e-68299a0d8d0b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:25:51 user nova-compute[75045]: DEBUG nova.compute.manager [req-15591740-6906-4e6c-b70b-96181df9525a req-79ce384c-2019-4ccb-8ca4-c61292f56d40 service nova] [instance: 032e20aa-8887-4215-808e-68299a0d8d0b] No waiting events found dispatching network-vif-plugged-9cd2b9ae-f99a-4f33-8b8b-e2013d3c05e6 {{(pid=75045) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 23:25:51 user nova-compute[75045]: WARNING nova.compute.manager [req-15591740-6906-4e6c-b70b-96181df9525a req-79ce384c-2019-4ccb-8ca4-c61292f56d40 service nova] [instance: 032e20aa-8887-4215-808e-68299a0d8d0b] Received unexpected event network-vif-plugged-9cd2b9ae-f99a-4f33-8b8b-e2013d3c05e6 for instance with vm_state deleted and task_state None.
Nov 08 23:25:51 user nova-compute[75045]: DEBUG nova.compute.manager [req-15591740-6906-4e6c-b70b-96181df9525a req-79ce384c-2019-4ccb-8ca4-c61292f56d40 service nova] [instance: 032e20aa-8887-4215-808e-68299a0d8d0b] Received event network-vif-deleted-9cd2b9ae-f99a-4f33-8b8b-e2013d3c05e6 {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:25:51 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:25:51 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Instance 4ae5ff6b-6f2c-4dfd-a4c6-da4809e2cf27 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75045) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 23:25:51 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Instance 0f21fcd3-ac5f-499e-9c34-82af806fda1d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75045) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 23:25:51 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Instance d2c911cf-d5f4-4c19-8335-8c7834184a7e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75045) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 23:25:51 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Instance 032e20aa-8887-4215-808e-68299a0d8d0b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75045) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 23:25:51 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Instance 43f31110-89ec-4b20-9842-7c9dd7df0e14 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75045) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 23:25:51 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Instance 83d225e0-e39e-4500-b7ae-52dfbd8b8588 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75045) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 23:25:51 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Instance 25cd59d1-6884-471a-813e-52e97c2e1208 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75045) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 23:25:51 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Instance b5fc7f02-2143-4bcf-92ac-078d5ec10747 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75045) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 23:25:51 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Instance 0b84f2b1-01a3-4789-bcef-8b7c4334132b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75045) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 23:25:51 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Instance 667d20c3-3eda-4aa5-b799-6dcee3443833 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75045) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 23:25:51 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Instance fa67b237-f598-4111-87ba-d761aa50d95e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75045) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 23:25:51 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Instance 7e92ab9a-8ea4-4452-a458-db181d4a59b7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75045) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 23:25:51 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Instance 72c9d731-2b35-434c-8463-1cd6c18fbd6a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75045) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 23:25:51 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=75045) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 23:25:51 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=75045) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 23:25:51 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:25:51 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:25:51 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:25:51 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:25:51 user nova-compute[75045]: DEBUG nova.compute.manager [req-6dbfe804-64cf-4e96-8673-8911637a1653 req-c24749ab-ff2d-4e07-8a1d-8a87faef8962 service nova] [instance: 667d20c3-3eda-4aa5-b799-6dcee3443833] Received event network-vif-unplugged-0d5e497c-3168-46b1-9094-9bb54737cc0f {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:25:51 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-6dbfe804-64cf-4e96-8673-8911637a1653 req-c24749ab-ff2d-4e07-8a1d-8a87faef8962 service nova] Acquiring lock "667d20c3-3eda-4aa5-b799-6dcee3443833-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:25:51 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-6dbfe804-64cf-4e96-8673-8911637a1653 req-c24749ab-ff2d-4e07-8a1d-8a87faef8962 service nova] Lock "667d20c3-3eda-4aa5-b799-6dcee3443833-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:25:51 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-6dbfe804-64cf-4e96-8673-8911637a1653 req-c24749ab-ff2d-4e07-8a1d-8a87faef8962 service nova] Lock "667d20c3-3eda-4aa5-b799-6dcee3443833-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:25:51 user nova-compute[75045]: DEBUG nova.compute.manager [req-6dbfe804-64cf-4e96-8673-8911637a1653 req-c24749ab-ff2d-4e07-8a1d-8a87faef8962 service nova] [instance: 667d20c3-3eda-4aa5-b799-6dcee3443833] No waiting events found dispatching network-vif-unplugged-0d5e497c-3168-46b1-9094-9bb54737cc0f {{(pid=75045) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 23:25:51 user nova-compute[75045]: WARNING nova.compute.manager [req-6dbfe804-64cf-4e96-8673-8911637a1653 req-c24749ab-ff2d-4e07-8a1d-8a87faef8962 service nova] [instance: 667d20c3-3eda-4aa5-b799-6dcee3443833] Received unexpected event network-vif-unplugged-0d5e497c-3168-46b1-9094-9bb54737cc0f for instance with vm_state active and task_state rebuilding.
Nov 08 23:25:51 user nova-compute[75045]: DEBUG nova.compute.provider_tree [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Inventory has not changed in ProviderTree for provider: 62ba5f85-c74d-4b58-986e-d4197e813fd7 {{(pid=75045) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 23:25:51 user nova-compute[75045]: DEBUG nova.scheduler.client.report [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Inventory has not changed for provider 62ba5f85-c74d-4b58-986e-d4197e813fd7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75045) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 23:25:51 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Compute_service record updated for user:user {{(pid=75045) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 23:25:51 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.754s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:25:51 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-dd389555-c469-4e87-b335-d058f10ae62a tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.661s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:25:51 user nova-compute[75045]: INFO nova.virt.libvirt.driver [-] [instance: 667d20c3-3eda-4aa5-b799-6dcee3443833] Instance destroyed successfully.
Nov 08 23:25:51 user nova-compute[75045]: INFO nova.virt.libvirt.driver [-] [instance: 667d20c3-3eda-4aa5-b799-6dcee3443833] Instance destroyed successfully.
Nov 08 23:25:51 user nova-compute[75045]: DEBUG nova.virt.libvirt.vif [None req-55671725-cabc-42f6-b791-699dfac90390 tempest-ServerActionsV293TestJSON-1645081958 tempest-ServerActionsV293TestJSON-1645081958-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T23:23:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-374447582',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-621912130',id=22,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBApsXoUUj600/jCowZP3//u29Ov5MwB7tYSt8EjtngLjlaZqqKZXWg1HuFDyt4rHiDuYq2TVJTqipV6mcSPV0LYib38MErT/yLzsrNv4x3AUTFC5kAU2nRDHPtRbpYSQ9w==',key_name='tempest-keypair-471552763',keypairs=<?>,launch_index=0,launched_at=2023-11-08T23:24:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='89744dd7de584b14880bc42dd96933af',ramdisk_id='',reservation_id='r-iwtkqj0a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1645081958',owner_user_name='tempest-ServerActionsV293TestJSON-1645081958-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T23:25:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fc0a769ab72a476c9ac620728d67c5b6',uuid=667d20c3-3eda-4aa5-b799-6dcee3443833,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0d5e497c-3168-46b1-9094-9bb54737cc0f", "address": "fa:16:3e:80:07:f1", "network": {"id": "22898442-b87a-4538-a8f5-fe275919f44a", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-665667609-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.146", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "89744dd7de584b14880bc42dd96933af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d5e497c-31", "ovs_interfaceid": "0d5e497c-3168-46b1-9094-9bb54737cc0f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75045) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 23:25:51 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-55671725-cabc-42f6-b791-699dfac90390 tempest-ServerActionsV293TestJSON-1645081958 tempest-ServerActionsV293TestJSON-1645081958-project-member] Converting VIF {"id": "0d5e497c-3168-46b1-9094-9bb54737cc0f", "address": "fa:16:3e:80:07:f1", "network": {"id": "22898442-b87a-4538-a8f5-fe275919f44a", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-665667609-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.146", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "89744dd7de584b14880bc42dd96933af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d5e497c-31", "ovs_interfaceid": "0d5e497c-3168-46b1-9094-9bb54737cc0f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 23:25:51 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-55671725-cabc-42f6-b791-699dfac90390 tempest-ServerActionsV293TestJSON-1645081958 tempest-ServerActionsV293TestJSON-1645081958-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:80:07:f1,bridge_name='br-int',has_traffic_filtering=True,id=0d5e497c-3168-46b1-9094-9bb54737cc0f,network=Network(22898442-b87a-4538-a8f5-fe275919f44a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0d5e497c-31') {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 23:25:51 user nova-compute[75045]: DEBUG os_vif [None req-55671725-cabc-42f6-b791-699dfac90390 tempest-ServerActionsV293TestJSON-1645081958 tempest-ServerActionsV293TestJSON-1645081958-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:80:07:f1,bridge_name='br-int',has_traffic_filtering=True,id=0d5e497c-3168-46b1-9094-9bb54737cc0f,network=Network(22898442-b87a-4538-a8f5-fe275919f44a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0d5e497c-31') {{(pid=75045) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 23:25:51 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:25:51 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0d5e497c-31, bridge=br-int, if_exists=True) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:25:51 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:25:51 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:25:51 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:25:51 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b60f6265-8afe-4f46-8024-dee296c63755) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:25:51 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:25:51 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 23:25:51 user nova-compute[75045]: INFO os_vif [None req-55671725-cabc-42f6-b791-699dfac90390 tempest-ServerActionsV293TestJSON-1645081958 tempest-ServerActionsV293TestJSON-1645081958-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:80:07:f1,bridge_name='br-int',has_traffic_filtering=True,id=0d5e497c-3168-46b1-9094-9bb54737cc0f,network=Network(22898442-b87a-4538-a8f5-fe275919f44a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0d5e497c-31')
Nov 08 23:25:51 user nova-compute[75045]: DEBUG nova.virt.libvirt.volume.iscsi [None req-55671725-cabc-42f6-b791-699dfac90390 tempest-ServerActionsV293TestJSON-1645081958 tempest-ServerActionsV293TestJSON-1645081958-project-member] [instance: 667d20c3-3eda-4aa5-b799-6dcee3443833] calling os-brick to detach iSCSI Volume {{(pid=75045) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 23:25:52 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-55671725-cabc-42f6-b791-699dfac90390 tempest-ServerActionsV293TestJSON-1645081958 tempest-ServerActionsV293TestJSON-1645081958-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1b68210460>, {'target_iqn': 'iqn.2010-10.org.openstack:04d02c98-d058-49d8-a350-ab9e63003d6e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uVoSDJjd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=75045) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 23:25:52 user nova-compute[75045]: WARNING os_brick.initiator.connectors.base [None req-55671725-cabc-42f6-b791-699dfac90390 tempest-ServerActionsV293TestJSON-1645081958 tempest-ServerActionsV293TestJSON-1645081958-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 08 23:25:52 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-55671725-cabc-42f6-b791-699dfac90390 tempest-ServerActionsV293TestJSON-1645081958 tempest-ServerActionsV293TestJSON-1645081958-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 23:25:52 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-55671725-cabc-42f6-b791-699dfac90390 tempest-ServerActionsV293TestJSON-1645081958 tempest-ServerActionsV293TestJSON-1645081958-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 23:25:52 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:25:52 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:25:52 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[404568f1-64bc-4106-82c4-ebeee8a63f34]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:cd1b2206-989e-409d-84c6-49b37ac252d8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:04d02c98-d058-49d8-a350-ab9e63003d6e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9c37da13-9531-458a-87cb-1e86e6b84f3a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d2e734fa-1dcb-4510-a50e-064e29c2985e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:25:52 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-55671725-cabc-42f6-b791-699dfac90390 tempest-ServerActionsV293TestJSON-1645081958 tempest-ServerActionsV293TestJSON-1645081958-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 23:25:52 user nova-compute[75045]: No targets found.
Nov 08 23:25:52 user nova-compute[75045]: iSNS:
Nov 08 23:25:52 user nova-compute[75045]: No targets found.
Nov 08 23:25:52 user nova-compute[75045]: STATIC:
Nov 08 23:25:52 user nova-compute[75045]: Target: iqn.2010-10.org.openstack:cd1b2206-989e-409d-84c6-49b37ac252d8
Nov 08 23:25:52 user nova-compute[75045]:         Portal: 172.16.0.220:3260,-1
Nov 08 23:25:52 user nova-compute[75045]:                 Iface Name: default
Nov 08 23:25:52 user nova-compute[75045]: Target: iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab
Nov 08 23:25:52 user nova-compute[75045]:         Portal: 172.16.0.220:3260,-1
Nov 08 23:25:52 user nova-compute[75045]:                 Iface Name: default
Nov 08 23:25:52 user nova-compute[75045]: Target: iqn.2010-10.org.openstack:04d02c98-d058-49d8-a350-ab9e63003d6e
Nov 08 23:25:52 user nova-compute[75045]:         Portal: 172.16.0.220:3260,-1
Nov 08 23:25:52 user nova-compute[75045]:                 Iface Name: default
Nov 08 23:25:52 user nova-compute[75045]: Target: iqn.2010-10.org.openstack:9c37da13-9531-458a-87cb-1e86e6b84f3a
Nov 08 23:25:52 user nova-compute[75045]:         Portal: 172.16.0.220:3260,-1
Nov 08 23:25:52 user nova-compute[75045]:                 Iface Name: default
Nov 08 23:25:52 user nova-compute[75045]: Target: iqn.2010-10.org.openstack:d2e734fa-1dcb-4510-a50e-064e29c2985e
Nov 08 23:25:52 user nova-compute[75045]:         Portal: 172.16.0.220:3260,-1
Nov 08 23:25:52 user nova-compute[75045]:                 Iface Name: default
Nov 08 23:25:52 user nova-compute[75045]: FIRMWARE:
Nov 08 23:25:52 user nova-compute[75045]: No targets found.
Nov 08 23:25:52 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 23:25:52 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-55671725-cabc-42f6-b791-699dfac90390 tempest-ServerActionsV293TestJSON-1645081958 tempest-ServerActionsV293TestJSON-1645081958-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 23:25:52 user nova-compute[75045]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 23:25:52 user nova-compute[75045]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75045) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 23:25:52 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-55671725-cabc-42f6-b791-699dfac90390 tempest-ServerActionsV293TestJSON-1645081958 tempest-ServerActionsV293TestJSON-1645081958-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:04d02c98-d058-49d8-a350-ab9e63003d6e', 0)] {{(pid=75045) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 23:25:52 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:25:52 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:25:52 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcc04f32-903c-47a8-9efb-ad7851750f08]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:04d02c98-d058-49d8-a350-ab9e63003d6e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9c37da13-9531-458a-87cb-1e86e6b84f3a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cd1b2206-989e-409d-84c6-49b37ac252d8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d2e734fa-1dcb-4510-a50e-064e29c2985e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:25:52 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:25:52 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:25:52 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[d030c1f8-7070-4383-8b43-6e6016f9389a]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd1b2206-989e-409d-84c6-49b37ac252d8 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04d02c98-d058-49d8-a350-ab9e63003d6e (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c37da13-9531-458a-87cb-1e86e6b84f3a (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2e734fa-1dcb-4510-a50e-064e29c2985e (non-flash)\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:25:52 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-55671725-cabc-42f6-b791-699dfac90390 tempest-ServerActionsV293TestJSON-1645081958 tempest-ServerActionsV293TestJSON-1645081958-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab (non-flash)
Nov 08 23:25:52 user nova-compute[75045]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd1b2206-989e-409d-84c6-49b37ac252d8 (non-flash)
Nov 08 23:25:52 user nova-compute[75045]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04d02c98-d058-49d8-a350-ab9e63003d6e (non-flash)
Nov 08 23:25:52 user nova-compute[75045]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c37da13-9531-458a-87cb-1e86e6b84f3a (non-flash)
Nov 08 23:25:52 user nova-compute[75045]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2e734fa-1dcb-4510-a50e-064e29c2985e (non-flash)
Nov 08 23:25:52 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 23:25:52 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-55671725-cabc-42f6-b791-699dfac90390 tempest-ServerActionsV293TestJSON-1645081958 tempest-ServerActionsV293TestJSON-1645081958-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab (non-flash)
Nov 08 23:25:52 user nova-compute[75045]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd1b2206-989e-409d-84c6-49b37ac252d8 (non-flash)
Nov 08 23:25:52 user nova-compute[75045]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04d02c98-d058-49d8-a350-ab9e63003d6e (non-flash)
Nov 08 23:25:52 user nova-compute[75045]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c37da13-9531-458a-87cb-1e86e6b84f3a (non-flash)
Nov 08 23:25:52 user nova-compute[75045]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2e734fa-1dcb-4510-a50e-064e29c2985e (non-flash)
Nov 08 23:25:52 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 23:25:52 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-55671725-cabc-42f6-b791-699dfac90390 tempest-ServerActionsV293TestJSON-1645081958 tempest-ServerActionsV293TestJSON-1645081958-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1b4848c3a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:04d02c98-d058-49d8-a350-ab9e63003d6e'): ({'sdd'}, set())}) {{(pid=75045) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 23:25:52 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-55671725-cabc-42f6-b791-699dfac90390 tempest-ServerActionsV293TestJSON-1645081958 tempest-ServerActionsV293TestJSON-1645081958-project-member] Removing single pathed devices sdd {{(pid=75045) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 23:25:52 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:25:52 user nova-compute[75045]: DEBUG nova.compute.provider_tree [None req-dd389555-c469-4e87-b335-d058f10ae62a tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Inventory has not changed in ProviderTree for provider: 62ba5f85-c74d-4b58-986e-d4197e813fd7 {{(pid=75045) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 23:25:52 user nova-compute[75045]: DEBUG nova.scheduler.client.report [None req-dd389555-c469-4e87-b335-d058f10ae62a tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Inventory has not changed for provider 62ba5f85-c74d-4b58-986e-d4197e813fd7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75045) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 23:25:52 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.029s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:25:52 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[e32e31bc-b6fc-4d05-b59f-ae0ba542d9fe]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:25:52 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:25:52 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.020s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:25:52 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5fed7c8-30ae-42e5-a16d-a14abc58a73c]: (4, ('ok\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:25:52 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-55671725-cabc-42f6-b791-699dfac90390 tempest-ServerActionsV293TestJSON-1645081958 tempest-ServerActionsV293TestJSON-1645081958-project-member] Flushing IO for device /dev/sdd {{(pid=75045) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 23:25:52 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:25:52 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-dd389555-c469-4e87-b335-d058f10ae62a tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.535s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:25:52 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.015s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:25:52 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb58a528-8ca7-46ec-b7ac-50dae6eee976]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:25:52 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-55671725-cabc-42f6-b791-699dfac90390 tempest-ServerActionsV293TestJSON-1645081958 tempest-ServerActionsV293TestJSON-1645081958-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75045) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 23:25:52 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:25:52 user nova-compute[75045]: INFO nova.scheduler.client.report [None req-dd389555-c469-4e87-b335-d058f10ae62a tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Deleted allocations for instance 032e20aa-8887-4215-808e-68299a0d8d0b
Nov 08 23:25:52 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.057s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:25:52 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9b22845-43ac-4c8b-8dd3-d49f538d1f81]: (4, ('1', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:25:52 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-55671725-cabc-42f6-b791-699dfac90390 tempest-ServerActionsV293TestJSON-1645081958 tempest-ServerActionsV293TestJSON-1645081958-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75045) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 23:25:52 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-55671725-cabc-42f6-b791-699dfac90390 tempest-ServerActionsV293TestJSON-1645081958 tempest-ServerActionsV293TestJSON-1645081958-project-member] SCSI volumes sdd have been removed. {{(pid=75045) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 23:25:52 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-55671725-cabc-42f6-b791-699dfac90390 tempest-ServerActionsV293TestJSON-1645081958 tempest-ServerActionsV293TestJSON-1645081958-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:04d02c98-d058-49d8-a350-ab9e63003d6e')] {{(pid=75045) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 23:25:52 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04d02c98-d058-49d8-a350-ab9e63003d6e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:25:52 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04d02c98-d058-49d8-a350-ab9e63003d6e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.029s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:25:52 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5efeea5-dfbe-4132-b0db-35098cff5b58]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:25:52 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-55671725-cabc-42f6-b791-699dfac90390 tempest-ServerActionsV293TestJSON-1645081958 tempest-ServerActionsV293TestJSON-1645081958-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:25:52 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04d02c98-d058-49d8-a350-ab9e63003d6e -p 172.16.0.220:3260 --logout {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:25:52 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-dd389555-c469-4e87-b335-d058f10ae62a tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Lock "032e20aa-8887-4215-808e-68299a0d8d0b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.778s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:25:52 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04d02c98-d058-49d8-a350-ab9e63003d6e -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:25:52 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[bafb2ab3-7aac-4e5e-9140-5f064fe4308c]: (4, ('Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:04d02c98-d058-49d8-a350-ab9e63003d6e, portal: 172.16.0.220,3260]\nLogout of [sid: 18, target: iqn.2010-10.org.openstack:04d02c98-d058-49d8-a350-ab9e63003d6e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:25:52 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-55671725-cabc-42f6-b791-699dfac90390 tempest-ServerActionsV293TestJSON-1645081958 tempest-ServerActionsV293TestJSON-1645081958-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:04d02c98-d058-49d8-a350-ab9e63003d6e, portal: 172.16.0.220,3260]
Nov 08 23:25:52 user nova-compute[75045]: Logout of [sid: 18, target: iqn.2010-10.org.openstack:04d02c98-d058-49d8-a350-ab9e63003d6e, portal: 172.16.0.220,3260] successful.
Nov 08 23:25:52 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:25:52 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04d02c98-d058-49d8-a350-ab9e63003d6e -p 172.16.0.220:3260 --op delete {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:25:52 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04d02c98-d058-49d8-a350-ab9e63003d6e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:25:52 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[a44c3d9d-9509-4049-a9e8-d84a648d5c8b]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:25:52 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-55671725-cabc-42f6-b791-699dfac90390 tempest-ServerActionsV293TestJSON-1645081958 tempest-ServerActionsV293TestJSON-1645081958-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:25:52 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-55671725-cabc-42f6-b791-699dfac90390 tempest-ServerActionsV293TestJSON-1645081958 tempest-ServerActionsV293TestJSON-1645081958-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.402s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 23:25:52 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-55671725-cabc-42f6-b791-699dfac90390 tempest-ServerActionsV293TestJSON-1645081958 tempest-ServerActionsV293TestJSON-1645081958-project-member] <== disconnect_volume: return (404ms) None {{(pid=75045) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 23:25:52 user nova-compute[75045]: DEBUG nova.virt.libvirt.volume.iscsi [None req-55671725-cabc-42f6-b791-699dfac90390 tempest-ServerActionsV293TestJSON-1645081958 tempest-ServerActionsV293TestJSON-1645081958-project-member] [instance: 667d20c3-3eda-4aa5-b799-6dcee3443833] Disconnected iSCSI Volume {{(pid=75045) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 23:25:52 user nova-compute[75045]: INFO nova.virt.libvirt.driver [None req-55671725-cabc-42f6-b791-699dfac90390 tempest-ServerActionsV293TestJSON-1645081958 tempest-ServerActionsV293TestJSON-1645081958-project-member] [instance: 667d20c3-3eda-4aa5-b799-6dcee3443833] Deleting instance files /opt/stack/data/nova/instances/667d20c3-3eda-4aa5-b799-6dcee3443833_del
Nov 08 23:25:52 user nova-compute[75045]: INFO nova.virt.libvirt.driver [None req-55671725-cabc-42f6-b791-699dfac90390 tempest-ServerActionsV293TestJSON-1645081958 tempest-ServerActionsV293TestJSON-1645081958-project-member] [instance: 667d20c3-3eda-4aa5-b799-6dcee3443833] Deletion of /opt/stack/data/nova/instances/667d20c3-3eda-4aa5-b799-6dcee3443833_del complete
Nov 08 23:25:52 user nova-compute[75045]: DEBUG nova.compute.manager [None req-76c5a4b3-e6f0-43be-b544-7c34d5d3118a tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] [instance: 83d225e0-e39e-4500-b7ae-52dfbd8b8588] Stashing vm_state: active {{(pid=75045) _prep_resize /opt/stack/nova/nova/compute/manager.py:5615}}
Nov 08 23:25:52 user nova-compute[75045]: WARNING nova.virt.libvirt.driver [None req-55671725-cabc-42f6-b791-699dfac90390 tempest-ServerActionsV293TestJSON-1645081958 tempest-ServerActionsV293TestJSON-1645081958-project-member] [instance: 667d20c3-3eda-4aa5-b799-6dcee3443833] During detach_volume, instance disappeared.: nova.exception.InstanceNotFound: Instance 667d20c3-3eda-4aa5-b799-6dcee3443833 could not be found.
Nov 08 23:25:52 user nova-compute[75045]: DEBUG nova.virt.libvirt.volume.iscsi [None req-55671725-cabc-42f6-b791-699dfac90390 tempest-ServerActionsV293TestJSON-1645081958 tempest-ServerActionsV293TestJSON-1645081958-project-member] [instance: 667d20c3-3eda-4aa5-b799-6dcee3443833] calling os-brick to detach iSCSI Volume {{(pid=75045) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 23:25:52 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-55671725-cabc-42f6-b791-699dfac90390 tempest-ServerActionsV293TestJSON-1645081958 tempest-ServerActionsV293TestJSON-1645081958-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1b68210460>, {'target_iqn': 'iqn.2010-10.org.openstack:04d02c98-d058-49d8-a350-ab9e63003d6e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uVoSDJjd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=75045) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 23:25:52 user nova-compute[75045]: WARNING os_brick.initiator.connectors.base [None req-55671725-cabc-42f6-b791-699dfac90390 tempest-ServerActionsV293TestJSON-1645081958 tempest-ServerActionsV293TestJSON-1645081958-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 08 23:25:52 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-55671725-cabc-42f6-b791-699dfac90390 tempest-ServerActionsV293TestJSON-1645081958 tempest-ServerActionsV293TestJSON-1645081958-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 23:25:52 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-55671725-cabc-42f6-b791-699dfac90390 tempest-ServerActionsV293TestJSON-1645081958 tempest-ServerActionsV293TestJSON-1645081958-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 23:25:52 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:25:52 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-76c5a4b3-e6f0-43be-b544-7c34d5d3118a tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:25:52 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-76c5a4b3-e6f0-43be-b544-7c34d5d3118a tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:25:52 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:25:52 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[db51f48d-e473-4a0f-bc7a-234a5482002a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:cd1b2206-989e-409d-84c6-49b37ac252d8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9c37da13-9531-458a-87cb-1e86e6b84f3a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d2e734fa-1dcb-4510-a50e-064e29c2985e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:25:52 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-55671725-cabc-42f6-b791-699dfac90390 tempest-ServerActionsV293TestJSON-1645081958 tempest-ServerActionsV293TestJSON-1645081958-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 23:25:52 user nova-compute[75045]: No targets found.
Nov 08 23:25:52 user nova-compute[75045]: iSNS:
Nov 08 23:25:52 user nova-compute[75045]: No targets found.
Nov 08 23:25:52 user nova-compute[75045]: STATIC:
Nov 08 23:25:52 user nova-compute[75045]: Target: iqn.2010-10.org.openstack:cd1b2206-989e-409d-84c6-49b37ac252d8
Nov 08 23:25:52 user nova-compute[75045]:         Portal: 172.16.0.220:3260,-1
Nov 08 23:25:52 user nova-compute[75045]:                 Iface Name: default
Nov 08 23:25:52 user nova-compute[75045]: Target: iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab
Nov 08 23:25:52 user nova-compute[75045]:         Portal: 172.16.0.220:3260,-1
Nov 08 23:25:52 user nova-compute[75045]:                 Iface Name: default
Nov 08 23:25:52 user nova-compute[75045]: Target: iqn.2010-10.org.openstack:9c37da13-9531-458a-87cb-1e86e6b84f3a
Nov 08 23:25:52 user nova-compute[75045]:         Portal: 172.16.0.220:3260,-1
Nov 08 23:25:52 user nova-compute[75045]:                 Iface Name: default
Nov 08 23:25:52 user nova-compute[75045]: Target: iqn.2010-10.org.openstack:d2e734fa-1dcb-4510-a50e-064e29c2985e
Nov 08 23:25:52 user nova-compute[75045]:         Portal: 172.16.0.220:3260,-1
Nov 08 23:25:52 user nova-compute[75045]:                 Iface Name: default
Nov 08 23:25:52 user nova-compute[75045]: FIRMWARE:
Nov 08 23:25:52 user nova-compute[75045]: No targets found.
Nov 08 23:25:52 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 23:25:52 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-55671725-cabc-42f6-b791-699dfac90390 tempest-ServerActionsV293TestJSON-1645081958 tempest-ServerActionsV293TestJSON-1645081958-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 23:25:52 user nova-compute[75045]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 23:25:52 user nova-compute[75045]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75045) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 23:25:52 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-55671725-cabc-42f6-b791-699dfac90390 tempest-ServerActionsV293TestJSON-1645081958 tempest-ServerActionsV293TestJSON-1645081958-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:04d02c98-d058-49d8-a350-ab9e63003d6e', 0)] {{(pid=75045) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 23:25:52 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:25:52 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-76c5a4b3-e6f0-43be-b544-7c34d5d3118a tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75045) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 23:25:52 user nova-compute[75045]: INFO nova.compute.claims [None req-76c5a4b3-e6f0-43be-b544-7c34d5d3118a tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] [instance: 83d225e0-e39e-4500-b7ae-52dfbd8b8588] Claim successful on node user
Nov 08 23:25:52 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:25:52 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6edf35b-faf9-4f46-bdc2-c5afef245233]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9c37da13-9531-458a-87cb-1e86e6b84f3a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cd1b2206-989e-409d-84c6-49b37ac252d8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d2e734fa-1dcb-4510-a50e-064e29c2985e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:25:52 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:25:52 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:25:52 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[c07a16f5-067c-4e53-b84f-29442bac159d]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd1b2206-989e-409d-84c6-49b37ac252d8 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c37da13-9531-458a-87cb-1e86e6b84f3a (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2e734fa-1dcb-4510-a50e-064e29c2985e (non-flash)\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:25:52 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-55671725-cabc-42f6-b791-699dfac90390 tempest-ServerActionsV293TestJSON-1645081958 tempest-ServerActionsV293TestJSON-1645081958-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab (non-flash)
Nov 08 23:25:52 user nova-compute[75045]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd1b2206-989e-409d-84c6-49b37ac252d8 (non-flash)
Nov 08 23:25:52 user nova-compute[75045]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c37da13-9531-458a-87cb-1e86e6b84f3a (non-flash)
Nov 08 23:25:52 user nova-compute[75045]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2e734fa-1dcb-4510-a50e-064e29c2985e (non-flash)
Nov 08 23:25:52 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 23:25:52 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-55671725-cabc-42f6-b791-699dfac90390 tempest-ServerActionsV293TestJSON-1645081958 tempest-ServerActionsV293TestJSON-1645081958-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab (non-flash)
Nov 08 23:25:52 user nova-compute[75045]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd1b2206-989e-409d-84c6-49b37ac252d8 (non-flash)
Nov 08 23:25:52 user nova-compute[75045]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c37da13-9531-458a-87cb-1e86e6b84f3a (non-flash)
Nov 08 23:25:52 user nova-compute[75045]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2e734fa-1dcb-4510-a50e-064e29c2985e (non-flash)
Nov 08 23:25:52 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 23:25:52 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-55671725-cabc-42f6-b791-699dfac90390 tempest-ServerActionsV293TestJSON-1645081958 tempest-ServerActionsV293TestJSON-1645081958-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1b48478d30>, {}) {{(pid=75045) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 23:25:52 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-55671725-cabc-42f6-b791-699dfac90390 tempest-ServerActionsV293TestJSON-1645081958 tempest-ServerActionsV293TestJSON-1645081958-project-member] Disconnecting from: [] {{(pid=75045) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 23:25:52 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-55671725-cabc-42f6-b791-699dfac90390 tempest-ServerActionsV293TestJSON-1645081958 tempest-ServerActionsV293TestJSON-1645081958-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.088s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 23:25:52 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-55671725-cabc-42f6-b791-699dfac90390 tempest-ServerActionsV293TestJSON-1645081958 tempest-ServerActionsV293TestJSON-1645081958-project-member] <== disconnect_volume: return (88ms) None {{(pid=75045) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 23:25:52 user nova-compute[75045]: DEBUG nova.virt.libvirt.volume.iscsi [None req-55671725-cabc-42f6-b791-699dfac90390 tempest-ServerActionsV293TestJSON-1645081958 tempest-ServerActionsV293TestJSON-1645081958-project-member] [instance: 667d20c3-3eda-4aa5-b799-6dcee3443833] Disconnected iSCSI Volume {{(pid=75045) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 23:25:52 user nova-compute[75045]: INFO nova.compute.resource_tracker [None req-76c5a4b3-e6f0-43be-b544-7c34d5d3118a tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] [instance: 83d225e0-e39e-4500-b7ae-52dfbd8b8588] Updating resource usage from migration a833aacc-4f39-495d-a775-0a832874ba4f
Nov 08 23:25:53 user nova-compute[75045]: DEBUG nova.compute.provider_tree [None req-76c5a4b3-e6f0-43be-b544-7c34d5d3118a tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] Inventory has not changed in ProviderTree for provider: 62ba5f85-c74d-4b58-986e-d4197e813fd7 {{(pid=75045) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 23:25:53 user nova-compute[75045]: DEBUG nova.scheduler.client.report [None req-76c5a4b3-e6f0-43be-b544-7c34d5d3118a tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] Inventory has not changed for provider 62ba5f85-c74d-4b58-986e-d4197e813fd7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75045) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 23:25:53 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-76c5a4b3-e6f0-43be-b544-7c34d5d3118a tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.571s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:25:53 user nova-compute[75045]: INFO nova.compute.manager [None req-76c5a4b3-e6f0-43be-b544-7c34d5d3118a tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] [instance: 83d225e0-e39e-4500-b7ae-52dfbd8b8588] Migrating
Nov 08 23:25:53 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-76c5a4b3-e6f0-43be-b544-7c34d5d3118a tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] Acquiring lock "compute-rpcapi-router" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 23:25:53 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-76c5a4b3-e6f0-43be-b544-7c34d5d3118a tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] Acquired lock "compute-rpcapi-router" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 23:25:53 user nova-compute[75045]: INFO nova.compute.rpcapi [None req-76c5a4b3-e6f0-43be-b544-7c34d5d3118a tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] Automatically selected compute RPC version 6.2 from minimum service version 66
Nov 08 23:25:53 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-76c5a4b3-e6f0-43be-b544-7c34d5d3118a tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] Releasing lock "compute-rpcapi-router" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 23:25:53 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-76c5a4b3-e6f0-43be-b544-7c34d5d3118a tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] Acquiring lock "refresh_cache-83d225e0-e39e-4500-b7ae-52dfbd8b8588" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 23:25:53 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-76c5a4b3-e6f0-43be-b544-7c34d5d3118a tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] Acquired lock "refresh_cache-83d225e0-e39e-4500-b7ae-52dfbd8b8588" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 23:25:53 user nova-compute[75045]: DEBUG nova.network.neutron [None req-76c5a4b3-e6f0-43be-b544-7c34d5d3118a tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] [instance: 83d225e0-e39e-4500-b7ae-52dfbd8b8588] Building network info cache for instance {{(pid=75045) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 23:25:53 user nova-compute[75045]: DEBUG nova.compute.manager [req-d5d1b52e-5f07-447c-b193-357f04eff4e0 req-f5c8322b-5683-4ae5-8f95-629cae1350b4 service nova] [instance: 667d20c3-3eda-4aa5-b799-6dcee3443833] Received event network-vif-plugged-0d5e497c-3168-46b1-9094-9bb54737cc0f {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:25:53 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-d5d1b52e-5f07-447c-b193-357f04eff4e0 req-f5c8322b-5683-4ae5-8f95-629cae1350b4 service nova] Acquiring lock "667d20c3-3eda-4aa5-b799-6dcee3443833-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:25:53 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-d5d1b52e-5f07-447c-b193-357f04eff4e0 req-f5c8322b-5683-4ae5-8f95-629cae1350b4 service nova] Lock "667d20c3-3eda-4aa5-b799-6dcee3443833-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:25:53 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-d5d1b52e-5f07-447c-b193-357f04eff4e0 req-f5c8322b-5683-4ae5-8f95-629cae1350b4 service nova] Lock "667d20c3-3eda-4aa5-b799-6dcee3443833-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:25:53 user nova-compute[75045]: DEBUG nova.compute.manager [req-d5d1b52e-5f07-447c-b193-357f04eff4e0 req-f5c8322b-5683-4ae5-8f95-629cae1350b4 service nova] [instance: 667d20c3-3eda-4aa5-b799-6dcee3443833] No waiting events found dispatching network-vif-plugged-0d5e497c-3168-46b1-9094-9bb54737cc0f {{(pid=75045) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 23:25:53 user nova-compute[75045]: WARNING nova.compute.manager [req-d5d1b52e-5f07-447c-b193-357f04eff4e0 req-f5c8322b-5683-4ae5-8f95-629cae1350b4 service nova] [instance: 667d20c3-3eda-4aa5-b799-6dcee3443833] Received unexpected event network-vif-plugged-0d5e497c-3168-46b1-9094-9bb54737cc0f for instance with vm_state active and task_state rebuilding.
Nov 08 23:25:53 user nova-compute[75045]: DEBUG nova.network.neutron [None req-76c5a4b3-e6f0-43be-b544-7c34d5d3118a tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] [instance: 83d225e0-e39e-4500-b7ae-52dfbd8b8588] Updating instance_info_cache with network_info: [{"id": "f34eef67-0428-49ea-91c3-08510ac690c8", "address": "fa:16:3e:d9:92:a4", "network": {"id": "d177c8b8-5960-4e40-bf9b-920a2f6ba4f7", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-497258569-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.31", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "467f0ecc3b93457f9fe83886b99c6285", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf34eef67-04", "ovs_interfaceid": "f34eef67-0428-49ea-91c3-08510ac690c8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75045) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 23:25:53 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-76c5a4b3-e6f0-43be-b544-7c34d5d3118a tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] Releasing lock "refresh_cache-83d225e0-e39e-4500-b7ae-52dfbd8b8588" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 23:25:53 user nova-compute[75045]: DEBUG nova.compute.manager [None req-55671725-cabc-42f6-b791-699dfac90390 tempest-ServerActionsV293TestJSON-1645081958 tempest-ServerActionsV293TestJSON-1645081958-project-member] [instance: 667d20c3-3eda-4aa5-b799-6dcee3443833] Preparing to wait for external event volume-reimaged-04d02c98-d058-49d8-a350-ab9e63003d6e {{(pid=75045) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:283}}
Nov 08 23:25:53 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-55671725-cabc-42f6-b791-699dfac90390 tempest-ServerActionsV293TestJSON-1645081958 tempest-ServerActionsV293TestJSON-1645081958-project-member] Acquiring lock "667d20c3-3eda-4aa5-b799-6dcee3443833-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:25:53 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-55671725-cabc-42f6-b791-699dfac90390 tempest-ServerActionsV293TestJSON-1645081958 tempest-ServerActionsV293TestJSON-1645081958-project-member] Lock "667d20c3-3eda-4aa5-b799-6dcee3443833-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:25:53 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-55671725-cabc-42f6-b791-699dfac90390 tempest-ServerActionsV293TestJSON-1645081958 tempest-ServerActionsV293TestJSON-1645081958-project-member] Lock "667d20c3-3eda-4aa5-b799-6dcee3443833-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:25:53 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-76c5a4b3-e6f0-43be-b544-7c34d5d3118a tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] [instance: 83d225e0-e39e-4500-b7ae-52dfbd8b8588] Starting migrate_disk_and_power_off {{(pid=75045) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Nov 08 23:25:54 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:25:54 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:25:54 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:25:54 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:25:54 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:25:54 user nova-compute[75045]: DEBUG nova.compute.manager [req-31896492-4a5c-43f6-9ca3-d014115cb930 req-92997e77-a057-451d-95b5-c5e05ffe3d8b service nova] [instance: 83d225e0-e39e-4500-b7ae-52dfbd8b8588] Received event network-vif-unplugged-f34eef67-0428-49ea-91c3-08510ac690c8 {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:25:54 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-31896492-4a5c-43f6-9ca3-d014115cb930 req-92997e77-a057-451d-95b5-c5e05ffe3d8b service nova] Acquiring lock "83d225e0-e39e-4500-b7ae-52dfbd8b8588-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:25:54 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-31896492-4a5c-43f6-9ca3-d014115cb930 req-92997e77-a057-451d-95b5-c5e05ffe3d8b service nova] Lock "83d225e0-e39e-4500-b7ae-52dfbd8b8588-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:25:54 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-31896492-4a5c-43f6-9ca3-d014115cb930 req-92997e77-a057-451d-95b5-c5e05ffe3d8b service nova] Lock "83d225e0-e39e-4500-b7ae-52dfbd8b8588-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:25:54 user nova-compute[75045]: DEBUG nova.compute.manager [req-31896492-4a5c-43f6-9ca3-d014115cb930 req-92997e77-a057-451d-95b5-c5e05ffe3d8b service nova] [instance: 83d225e0-e39e-4500-b7ae-52dfbd8b8588] No waiting events found dispatching network-vif-unplugged-f34eef67-0428-49ea-91c3-08510ac690c8 {{(pid=75045) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 23:25:54 user nova-compute[75045]: WARNING nova.compute.manager [req-31896492-4a5c-43f6-9ca3-d014115cb930 req-92997e77-a057-451d-95b5-c5e05ffe3d8b service nova] [instance: 83d225e0-e39e-4500-b7ae-52dfbd8b8588] Received unexpected event network-vif-unplugged-f34eef67-0428-49ea-91c3-08510ac690c8 for instance with vm_state active and task_state resize_migrating.
Nov 08 23:25:54 user nova-compute[75045]: INFO nova.virt.libvirt.driver [-] [instance: 83d225e0-e39e-4500-b7ae-52dfbd8b8588] Instance destroyed successfully.
Nov 08 23:25:54 user nova-compute[75045]: DEBUG nova.virt.libvirt.vif [None req-76c5a4b3-e6f0-43be-b544-7c34d5d3118a tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T23:21:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-52454361',display_name='tempest-ServerActionsTestOtherB-server-52454361',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-52454361',id=16,image_ref='a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIPmBc8a5DafKsuCJlskOYpDDhPwBioEg4bK8XJOdFwOvE3kerS9/OlDrIi5hKJ4t8vHYgazIqYE6C9fG+r7udy2il9kXgn4I4yPKUfyTlGPaqAfUG4gtg1sBgzfEDpsow==',key_name='tempest-keypair-1494902868',keypairs=<?>,launch_index=0,launched_at=2023-11-08T23:21:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='467f0ecc3b93457f9fe83886b99c6285',ramdisk_id='',reservation_id='r-mtlunwmw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-299728934',owner_user_name='tempest-ServerActionsTestOtherB-299728934-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T23:25:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='57d0c13f5a9f4c1bbb0458b93de348cb',uuid=83d225e0-e39e-4500-b7ae-52dfbd8b8588,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f34eef67-0428-49ea-91c3-08510ac690c8", "address": "fa:16:3e:d9:92:a4", "network": {"id": "d177c8b8-5960-4e40-bf9b-920a2f6ba4f7", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-497258569-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.31", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-497258569-network", "vif_mac": "fa:16:3e:d9:92:a4"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "467f0ecc3b93457f9fe83886b99c6285", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf34eef67-04", "ovs_interfaceid": "f34eef67-0428-49ea-91c3-08510ac690c8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75045) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 23:25:54 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-76c5a4b3-e6f0-43be-b544-7c34d5d3118a tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] Converting VIF {"id": "f34eef67-0428-49ea-91c3-08510ac690c8", "address": "fa:16:3e:d9:92:a4", "network": {"id": "d177c8b8-5960-4e40-bf9b-920a2f6ba4f7", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-497258569-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.31", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-497258569-network", "vif_mac": "fa:16:3e:d9:92:a4"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "467f0ecc3b93457f9fe83886b99c6285", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf34eef67-04", "ovs_interfaceid": "f34eef67-0428-49ea-91c3-08510ac690c8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 23:25:54 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-76c5a4b3-e6f0-43be-b544-7c34d5d3118a tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d9:92:a4,bridge_name='br-int',has_traffic_filtering=True,id=f34eef67-0428-49ea-91c3-08510ac690c8,network=Network(d177c8b8-5960-4e40-bf9b-920a2f6ba4f7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf34eef67-04') {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 23:25:54 user nova-compute[75045]: DEBUG os_vif [None req-76c5a4b3-e6f0-43be-b544-7c34d5d3118a tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d9:92:a4,bridge_name='br-int',has_traffic_filtering=True,id=f34eef67-0428-49ea-91c3-08510ac690c8,network=Network(d177c8b8-5960-4e40-bf9b-920a2f6ba4f7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf34eef67-04') {{(pid=75045) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 23:25:54 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:25:54 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf34eef67-04, bridge=br-int, if_exists=True) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:25:54 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:25:54 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:25:54 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:25:54 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0dba3a87-de17-4cc7-bc17-4691385bd53f) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:25:54 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:25:54 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 23:25:54 user nova-compute[75045]: INFO os_vif [None req-76c5a4b3-e6f0-43be-b544-7c34d5d3118a tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d9:92:a4,bridge_name='br-int',has_traffic_filtering=True,id=f34eef67-0428-49ea-91c3-08510ac690c8,network=Network(d177c8b8-5960-4e40-bf9b-920a2f6ba4f7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf34eef67-04')
Nov 08 23:25:54 user nova-compute[75045]: DEBUG nova.virt.libvirt.volume.iscsi [None req-76c5a4b3-e6f0-43be-b544-7c34d5d3118a tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] [instance: 83d225e0-e39e-4500-b7ae-52dfbd8b8588] calling os-brick to detach iSCSI Volume {{(pid=75045) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 23:25:54 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-76c5a4b3-e6f0-43be-b544-7c34d5d3118a tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1b68210460>, {'target_iqn': 'iqn.2010-10.org.openstack:d2e734fa-1dcb-4510-a50e-064e29c2985e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qCUrDkTz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75045) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 23:25:54 user nova-compute[75045]: WARNING os_brick.initiator.connectors.base [None req-76c5a4b3-e6f0-43be-b544-7c34d5d3118a tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 23:25:54 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-76c5a4b3-e6f0-43be-b544-7c34d5d3118a tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 23:25:54 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-76c5a4b3-e6f0-43be-b544-7c34d5d3118a tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 23:25:54 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:25:54 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:25:54 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f6c60c9-8ea2-45d0-ac66-3079473db1c9]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:cd1b2206-989e-409d-84c6-49b37ac252d8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9c37da13-9531-458a-87cb-1e86e6b84f3a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d2e734fa-1dcb-4510-a50e-064e29c2985e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:25:54 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-76c5a4b3-e6f0-43be-b544-7c34d5d3118a tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 23:25:54 user nova-compute[75045]: No targets found.
Nov 08 23:25:54 user nova-compute[75045]: iSNS:
Nov 08 23:25:54 user nova-compute[75045]: No targets found.
Nov 08 23:25:54 user nova-compute[75045]: STATIC:
Nov 08 23:25:54 user nova-compute[75045]: Target: iqn.2010-10.org.openstack:cd1b2206-989e-409d-84c6-49b37ac252d8
Nov 08 23:25:54 user nova-compute[75045]:         Portal: 172.16.0.220:3260,-1
Nov 08 23:25:54 user nova-compute[75045]:                 Iface Name: default
Nov 08 23:25:54 user nova-compute[75045]: Target: iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab
Nov 08 23:25:54 user nova-compute[75045]:         Portal: 172.16.0.220:3260,-1
Nov 08 23:25:54 user nova-compute[75045]:                 Iface Name: default
Nov 08 23:25:54 user nova-compute[75045]: Target: iqn.2010-10.org.openstack:9c37da13-9531-458a-87cb-1e86e6b84f3a
Nov 08 23:25:54 user nova-compute[75045]:         Portal: 172.16.0.220:3260,-1
Nov 08 23:25:54 user nova-compute[75045]:                 Iface Name: default
Nov 08 23:25:54 user nova-compute[75045]: Target: iqn.2010-10.org.openstack:d2e734fa-1dcb-4510-a50e-064e29c2985e
Nov 08 23:25:54 user nova-compute[75045]:         Portal: 172.16.0.220:3260,-1
Nov 08 23:25:54 user nova-compute[75045]:                 Iface Name: default
Nov 08 23:25:54 user nova-compute[75045]: FIRMWARE:
Nov 08 23:25:54 user nova-compute[75045]: No targets found.
Nov 08 23:25:54 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 23:25:54 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-76c5a4b3-e6f0-43be-b544-7c34d5d3118a tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 23:25:54 user nova-compute[75045]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 23:25:54 user nova-compute[75045]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75045) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 23:25:54 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-76c5a4b3-e6f0-43be-b544-7c34d5d3118a tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d2e734fa-1dcb-4510-a50e-064e29c2985e', 0)] {{(pid=75045) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 23:25:54 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:25:54 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:25:54 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ac76e8b-a050-4454-ae88-ac1af4972d8e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9c37da13-9531-458a-87cb-1e86e6b84f3a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cd1b2206-989e-409d-84c6-49b37ac252d8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d2e734fa-1dcb-4510-a50e-064e29c2985e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:25:54 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:25:54 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:25:54 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[01dea2d6-dd85-43c8-80ac-0e0e2be29518]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd1b2206-989e-409d-84c6-49b37ac252d8 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c37da13-9531-458a-87cb-1e86e6b84f3a (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2e734fa-1dcb-4510-a50e-064e29c2985e (non-flash)\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:25:54 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-76c5a4b3-e6f0-43be-b544-7c34d5d3118a tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab (non-flash)
Nov 08 23:25:54 user nova-compute[75045]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd1b2206-989e-409d-84c6-49b37ac252d8 (non-flash)
Nov 08 23:25:54 user nova-compute[75045]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c37da13-9531-458a-87cb-1e86e6b84f3a (non-flash)
Nov 08 23:25:54 user nova-compute[75045]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2e734fa-1dcb-4510-a50e-064e29c2985e (non-flash)
Nov 08 23:25:54 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 23:25:54 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-76c5a4b3-e6f0-43be-b544-7c34d5d3118a tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab (non-flash)
Nov 08 23:25:54 user nova-compute[75045]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd1b2206-989e-409d-84c6-49b37ac252d8 (non-flash)
Nov 08 23:25:54 user nova-compute[75045]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c37da13-9531-458a-87cb-1e86e6b84f3a (non-flash)
Nov 08 23:25:54 user nova-compute[75045]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2e734fa-1dcb-4510-a50e-064e29c2985e (non-flash)
Nov 08 23:25:54 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 23:25:54 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-76c5a4b3-e6f0-43be-b544-7c34d5d3118a tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1b485b1cf0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d2e734fa-1dcb-4510-a50e-064e29c2985e'): ({'sdc'}, set())}) {{(pid=75045) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 23:25:54 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-76c5a4b3-e6f0-43be-b544-7c34d5d3118a tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] Removing single pathed devices sdc {{(pid=75045) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 23:25:54 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:25:54 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:25:54 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d9afd8f-f3ff-45ff-b1b5-942b91e9565f]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:25:54 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:25:54 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.021s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:25:54 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[89d14a5d-0f72-4004-9e08-47939f82bd28]: (4, ('ok\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:25:54 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-76c5a4b3-e6f0-43be-b544-7c34d5d3118a tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] Flushing IO for device /dev/sdc {{(pid=75045) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 23:25:54 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:25:54 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:25:54 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[a495c6dd-2f10-4db8-83b1-6a87a3b74e6a]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:25:54 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-76c5a4b3-e6f0-43be-b544-7c34d5d3118a tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75045) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 23:25:54 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:25:54 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.041s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:25:54 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[58b6e144-f03d-4623-9e76-03c7ed23cab9]: (4, ('1', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:25:54 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-76c5a4b3-e6f0-43be-b544-7c34d5d3118a tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75045) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 23:25:54 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-76c5a4b3-e6f0-43be-b544-7c34d5d3118a tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] SCSI volumes sdc have been removed. {{(pid=75045) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 23:25:54 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-76c5a4b3-e6f0-43be-b544-7c34d5d3118a tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d2e734fa-1dcb-4510-a50e-064e29c2985e')] {{(pid=75045) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 23:25:54 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2e734fa-1dcb-4510-a50e-064e29c2985e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:25:55 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2e734fa-1dcb-4510-a50e-064e29c2985e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:25:55 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[ada4fc57-a0c8-4003-ac92-8037e5680f85]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:25:55 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-76c5a4b3-e6f0-43be-b544-7c34d5d3118a tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:25:55 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2e734fa-1dcb-4510-a50e-064e29c2985e -p 172.16.0.220:3260 --logout {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:25:55 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2e734fa-1dcb-4510-a50e-064e29c2985e -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:25:55 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[19b141ac-6847-4c06-9308-62105447f0ea]: (4, ('Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:d2e734fa-1dcb-4510-a50e-064e29c2985e, portal: 172.16.0.220,3260]\nLogout of [sid: 21, target: iqn.2010-10.org.openstack:d2e734fa-1dcb-4510-a50e-064e29c2985e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:25:55 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-76c5a4b3-e6f0-43be-b544-7c34d5d3118a tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:d2e734fa-1dcb-4510-a50e-064e29c2985e, portal: 172.16.0.220,3260]
Nov 08 23:25:55 user nova-compute[75045]: Logout of [sid: 21, target: iqn.2010-10.org.openstack:d2e734fa-1dcb-4510-a50e-064e29c2985e, portal: 172.16.0.220,3260] successful.
Nov 08 23:25:55 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:25:55 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2e734fa-1dcb-4510-a50e-064e29c2985e -p 172.16.0.220:3260 --op delete {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:25:55 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2e734fa-1dcb-4510-a50e-064e29c2985e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:25:55 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[049931e2-26f6-4cc2-9c5e-a7a3e261bc3b]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:25:55 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-76c5a4b3-e6f0-43be-b544-7c34d5d3118a tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:25:55 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-76c5a4b3-e6f0-43be-b544-7c34d5d3118a tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.332s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 23:25:55 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-76c5a4b3-e6f0-43be-b544-7c34d5d3118a tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] <== disconnect_volume: return (334ms) None {{(pid=75045) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 23:25:55 user nova-compute[75045]: DEBUG nova.virt.libvirt.volume.iscsi [None req-76c5a4b3-e6f0-43be-b544-7c34d5d3118a tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] [instance: 83d225e0-e39e-4500-b7ae-52dfbd8b8588] Disconnected iSCSI Volume {{(pid=75045) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 23:25:55 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-76c5a4b3-e6f0-43be-b544-7c34d5d3118a tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83d225e0-e39e-4500-b7ae-52dfbd8b8588/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:25:55 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-76c5a4b3-e6f0-43be-b544-7c34d5d3118a tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83d225e0-e39e-4500-b7ae-52dfbd8b8588/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:25:55 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-76c5a4b3-e6f0-43be-b544-7c34d5d3118a tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83d225e0-e39e-4500-b7ae-52dfbd8b8588/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:25:55 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-76c5a4b3-e6f0-43be-b544-7c34d5d3118a tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83d225e0-e39e-4500-b7ae-52dfbd8b8588/disk --force-share --output=json" returned: 0 in 0.258s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:25:55 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-76c5a4b3-e6f0-43be-b544-7c34d5d3118a tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75045) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 23:25:55 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-76c5a4b3-e6f0-43be-b544-7c34d5d3118a tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/83d225e0-e39e-4500-b7ae-52dfbd8b8588_resize/disk /opt/stack/data/nova/instances/83d225e0-e39e-4500-b7ae-52dfbd8b8588/disk {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:25:55 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-76c5a4b3-e6f0-43be-b544-7c34d5d3118a tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] CMD "cp -r /opt/stack/data/nova/instances/83d225e0-e39e-4500-b7ae-52dfbd8b8588_resize/disk /opt/stack/data/nova/instances/83d225e0-e39e-4500-b7ae-52dfbd8b8588/disk" returned: 0 in 0.382s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:25:55 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-76c5a4b3-e6f0-43be-b544-7c34d5d3118a tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/83d225e0-e39e-4500-b7ae-52dfbd8b8588_resize/disk.info /opt/stack/data/nova/instances/83d225e0-e39e-4500-b7ae-52dfbd8b8588/disk.info {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:25:56 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-76c5a4b3-e6f0-43be-b544-7c34d5d3118a tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] CMD "cp -r /opt/stack/data/nova/instances/83d225e0-e39e-4500-b7ae-52dfbd8b8588_resize/disk.info /opt/stack/data/nova/instances/83d225e0-e39e-4500-b7ae-52dfbd8b8588/disk.info" returned: 0 in 0.036s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:25:56 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:25:56 user nova-compute[75045]: DEBUG nova.compute.manager [req-adb55c8e-7161-4a0a-a79f-1323481ecd94 req-7f110444-6a3e-4277-8777-d3f49693641f service nova] [instance: 83d225e0-e39e-4500-b7ae-52dfbd8b8588] Received event network-vif-plugged-f34eef67-0428-49ea-91c3-08510ac690c8 {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:25:56 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-adb55c8e-7161-4a0a-a79f-1323481ecd94 req-7f110444-6a3e-4277-8777-d3f49693641f service nova] Acquiring lock "83d225e0-e39e-4500-b7ae-52dfbd8b8588-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:25:56 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-adb55c8e-7161-4a0a-a79f-1323481ecd94 req-7f110444-6a3e-4277-8777-d3f49693641f service nova] Lock "83d225e0-e39e-4500-b7ae-52dfbd8b8588-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:25:56 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-adb55c8e-7161-4a0a-a79f-1323481ecd94 req-7f110444-6a3e-4277-8777-d3f49693641f service nova] Lock "83d225e0-e39e-4500-b7ae-52dfbd8b8588-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:25:56 user nova-compute[75045]: DEBUG nova.compute.manager [req-adb55c8e-7161-4a0a-a79f-1323481ecd94 req-7f110444-6a3e-4277-8777-d3f49693641f service nova] [instance: 83d225e0-e39e-4500-b7ae-52dfbd8b8588] No waiting events found dispatching network-vif-plugged-f34eef67-0428-49ea-91c3-08510ac690c8 {{(pid=75045) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 23:25:56 user nova-compute[75045]: WARNING nova.compute.manager [req-adb55c8e-7161-4a0a-a79f-1323481ecd94 req-7f110444-6a3e-4277-8777-d3f49693641f service nova] [instance: 83d225e0-e39e-4500-b7ae-52dfbd8b8588] Received unexpected event network-vif-plugged-f34eef67-0428-49ea-91c3-08510ac690c8 for instance with vm_state active and task_state resize_migrating.
Nov 08 23:25:57 user nova-compute[75045]: DEBUG nova.network.neutron [None req-76c5a4b3-e6f0-43be-b544-7c34d5d3118a tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] [instance: 83d225e0-e39e-4500-b7ae-52dfbd8b8588] Port f34eef67-0428-49ea-91c3-08510ac690c8 binding to destination host user is already ACTIVE {{(pid=75045) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Nov 08 23:25:57 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-76c5a4b3-e6f0-43be-b544-7c34d5d3118a tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] Acquiring lock "83d225e0-e39e-4500-b7ae-52dfbd8b8588-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:25:57 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-76c5a4b3-e6f0-43be-b544-7c34d5d3118a tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] Lock "83d225e0-e39e-4500-b7ae-52dfbd8b8588-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:25:57 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-76c5a4b3-e6f0-43be-b544-7c34d5d3118a tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] Lock "83d225e0-e39e-4500-b7ae-52dfbd8b8588-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:25:57 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-76c5a4b3-e6f0-43be-b544-7c34d5d3118a tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] Acquiring lock "refresh_cache-83d225e0-e39e-4500-b7ae-52dfbd8b8588" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 23:25:57 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-76c5a4b3-e6f0-43be-b544-7c34d5d3118a tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] Acquired lock "refresh_cache-83d225e0-e39e-4500-b7ae-52dfbd8b8588" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 23:25:57 user nova-compute[75045]: DEBUG nova.network.neutron [None req-76c5a4b3-e6f0-43be-b544-7c34d5d3118a tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] [instance: 83d225e0-e39e-4500-b7ae-52dfbd8b8588] Building network info cache for instance {{(pid=75045) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 23:25:58 user nova-compute[75045]: DEBUG nova.network.neutron [None req-76c5a4b3-e6f0-43be-b544-7c34d5d3118a tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] [instance: 83d225e0-e39e-4500-b7ae-52dfbd8b8588] Updating instance_info_cache with network_info: [{"id": "f34eef67-0428-49ea-91c3-08510ac690c8", "address": "fa:16:3e:d9:92:a4", "network": {"id": "d177c8b8-5960-4e40-bf9b-920a2f6ba4f7", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-497258569-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.31", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "467f0ecc3b93457f9fe83886b99c6285", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf34eef67-04", "ovs_interfaceid": "f34eef67-0428-49ea-91c3-08510ac690c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75045) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 23:25:58 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-76c5a4b3-e6f0-43be-b544-7c34d5d3118a tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] Releasing lock "refresh_cache-83d225e0-e39e-4500-b7ae-52dfbd8b8588" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 23:25:58 user nova-compute[75045]: DEBUG os_brick.utils [None req-76c5a4b3-e6f0-43be-b544-7c34d5d3118a tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75045) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 23:25:58 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:25:58 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:25:58 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[10cf47bc-167d-4071-ae23-0bf345c5d34f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6217bd6e884\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:25:58 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:25:58 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:25:58 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[cea9520d-1dcf-4408-9994-6bac56ac38fc]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:25:58 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:25:58 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:25:58 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e90e487-a5d7-490b-bfa0-1a2e82e48594]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:25:58 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[36c14686-3cde-489e-957a-2446f4acb4c5]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:25:58 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-76c5a4b3-e6f0-43be-b544-7c34d5d3118a tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] Running cmd (subprocess): nvme version {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:25:58 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-76c5a4b3-e6f0-43be-b544-7c34d5d3118a tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] 'nvme version' failed. Not Retrying. {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 23:25:58 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.nvmeof [None req-76c5a4b3-e6f0-43be-b544-7c34d5d3118a tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] nvme not present on system {{(pid=75045) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 23:25:58 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:25:58 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 23:25:58 user nova-compute[75045]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 23:25:58 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[d469b9c0-74fc-41ff-b760-ecfe9eca8e78]: (4, '') {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:25:58 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.lightos [None req-76c5a4b3-e6f0-43be-b544-7c34d5d3118a tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75045) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 23:25:58 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.lightos [None req-76c5a4b3-e6f0-43be-b544-7c34d5d3118a tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75045) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 23:25:58 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.lightos [None req-76c5a4b3-e6f0-43be-b544-7c34d5d3118a tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] LIGHTOS: no hostnqn found. {{(pid=75045) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 23:25:58 user nova-compute[75045]: DEBUG os_brick.utils [None req-76c5a4b3-e6f0-43be-b544-7c34d5d3118a tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6217bd6e884', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75045) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 23:25:59 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:26:01 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:26:04 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:26:06 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:26:09 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:26:14 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:26:19 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 23:26:21 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:26:22 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-76c5a4b3-e6f0-43be-b544-7c34d5d3118a tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] [instance: 83d225e0-e39e-4500-b7ae-52dfbd8b8588] Starting finish_migration {{(pid=75045) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Nov 08 23:26:22 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-76c5a4b3-e6f0-43be-b544-7c34d5d3118a tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] [instance: 83d225e0-e39e-4500-b7ae-52dfbd8b8588] Instance directory exists: not creating {{(pid=75045) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 08 23:26:22 user nova-compute[75045]: INFO nova.virt.libvirt.driver [None req-76c5a4b3-e6f0-43be-b544-7c34d5d3118a tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] [instance: 83d225e0-e39e-4500-b7ae-52dfbd8b8588] Creating image(s)
Nov 08 23:26:22 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-76c5a4b3-e6f0-43be-b544-7c34d5d3118a tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b59f52a99fff51c56dd1edfb83892fb8f647f2f3 --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:26:22 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-76c5a4b3-e6f0-43be-b544-7c34d5d3118a tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b59f52a99fff51c56dd1edfb83892fb8f647f2f3 --force-share --output=json" returned: 0 in 0.195s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:26:22 user nova-compute[75045]: DEBUG nova.virt.disk.api [None req-76c5a4b3-e6f0-43be-b544-7c34d5d3118a tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] Checking if we can resize image /opt/stack/data/nova/instances/83d225e0-e39e-4500-b7ae-52dfbd8b8588/disk. size=21474836480 {{(pid=75045) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 23:26:22 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-76c5a4b3-e6f0-43be-b544-7c34d5d3118a tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83d225e0-e39e-4500-b7ae-52dfbd8b8588/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:26:22 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-76c5a4b3-e6f0-43be-b544-7c34d5d3118a tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83d225e0-e39e-4500-b7ae-52dfbd8b8588/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:26:22 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-76c5a4b3-e6f0-43be-b544-7c34d5d3118a tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] Running cmd (subprocess): qemu-img resize /opt/stack/data/nova/instances/83d225e0-e39e-4500-b7ae-52dfbd8b8588/disk 21474836480 {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:26:22 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-76c5a4b3-e6f0-43be-b544-7c34d5d3118a tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] CMD "qemu-img resize /opt/stack/data/nova/instances/83d225e0-e39e-4500-b7ae-52dfbd8b8588/disk 21474836480" returned: 0 in 0.052s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:26:23 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-76c5a4b3-e6f0-43be-b544-7c34d5d3118a tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] [instance: 83d225e0-e39e-4500-b7ae-52dfbd8b8588] Did not create local disks {{(pid=75045) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 08 23:26:23 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-76c5a4b3-e6f0-43be-b544-7c34d5d3118a tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] [instance: 83d225e0-e39e-4500-b7ae-52dfbd8b8588] Ensure instance console log exists: /opt/stack/data/nova/instances/83d225e0-e39e-4500-b7ae-52dfbd8b8588/console.log {{(pid=75045) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 23:26:23 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-76c5a4b3-e6f0-43be-b544-7c34d5d3118a tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:26:23 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-76c5a4b3-e6f0-43be-b544-7c34d5d3118a tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:26:23 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-76c5a4b3-e6f0-43be-b544-7c34d5d3118a tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:26:23 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-76c5a4b3-e6f0-43be-b544-7c34d5d3118a tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] [instance: 83d225e0-e39e-4500-b7ae-52dfbd8b8588] Start _get_guest_xml network_info=[{"id": "f34eef67-0428-49ea-91c3-08510ac690c8", "address": "fa:16:3e:d9:92:a4", "network": {"id": "d177c8b8-5960-4e40-bf9b-920a2f6ba4f7", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-497258569-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.31", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-497258569-network", "vif_mac": "fa:16:3e:d9:92:a4"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "467f0ecc3b93457f9fe83886b99c6285", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf34eef67-04", "ovs_interfaceid": "f34eef67-0428-49ea-91c3-08510ac690c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T23:11:54Z,direct_url=<?>,disk_format='qcow2',id=a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b1beba2cc4e7465ea249e2225fb494dc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T23:11:56Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'disk_bus': 'virtio', 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': 'a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb'}], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'device_type': 'disk', 'attachment_id': '670fc1cc-7ddb-4b01-93fb-59cf5d0effd8', 'guest_format': None, 'disk_bus': 'virtio', 'boot_index': None, 'mount_device': '/dev/vdb', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:d2e734fa-1dcb-4510-a50e-064e29c2985e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qCUrDkTz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '83d225e0-e39e-4500-b7ae-52dfbd8b8588', 'attached_at': '2023-11-08T23:26:22.000000', 'detached_at': '', 'volume_id': 'd2e734fa-1dcb-4510-a50e-064e29c2985e', 'serial': 'd2e734fa-1dcb-4510-a50e-064e29c2985e'}, 'volume_type': None} {{(pid=75045) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 23:26:23 user nova-compute[75045]: WARNING nova.virt.libvirt.driver [None req-76c5a4b3-e6f0-43be-b544-7c34d5d3118a tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 23:26:23 user nova-compute[75045]: WARNING nova.virt.libvirt.driver [None req-76c5a4b3-e6f0-43be-b544-7c34d5d3118a tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 23:26:23 user nova-compute[75045]: DEBUG nova.virt.libvirt.host [None req-76c5a4b3-e6f0-43be-b544-7c34d5d3118a tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75045) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 23:26:23 user nova-compute[75045]: DEBUG nova.virt.libvirt.host [None req-76c5a4b3-e6f0-43be-b544-7c34d5d3118a tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] CPU controller missing on host. {{(pid=75045) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 23:26:23 user nova-compute[75045]: DEBUG nova.virt.libvirt.host [None req-76c5a4b3-e6f0-43be-b544-7c34d5d3118a tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75045) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 23:26:23 user nova-compute[75045]: DEBUG nova.virt.libvirt.host [None req-76c5a4b3-e6f0-43be-b544-7c34d5d3118a tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] CPU controller found on host. {{(pid=75045) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 23:26:23 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-76c5a4b3-e6f0-43be-b544-7c34d5d3118a tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75045) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 23:26:23 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-76c5a4b3-e6f0-43be-b544-7c34d5d3118a tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T23:11:44Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T23:11:54Z,direct_url=<?>,disk_format='qcow2',id=a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b1beba2cc4e7465ea249e2225fb494dc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T23:11:56Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75045) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 23:26:23 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-76c5a4b3-e6f0-43be-b544-7c34d5d3118a tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] Flavor limits 0:0:0 {{(pid=75045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 23:26:23 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-76c5a4b3-e6f0-43be-b544-7c34d5d3118a tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] Image limits 0:0:0 {{(pid=75045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 23:26:23 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-76c5a4b3-e6f0-43be-b544-7c34d5d3118a tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] Flavor pref 0:0:0 {{(pid=75045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 23:26:23 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-76c5a4b3-e6f0-43be-b544-7c34d5d3118a tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] Image pref 0:0:0 {{(pid=75045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 23:26:23 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-76c5a4b3-e6f0-43be-b544-7c34d5d3118a tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 23:26:23 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-76c5a4b3-e6f0-43be-b544-7c34d5d3118a tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75045) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 23:26:23 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-76c5a4b3-e6f0-43be-b544-7c34d5d3118a tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75045) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 23:26:23 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-76c5a4b3-e6f0-43be-b544-7c34d5d3118a tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] Got 1 possible topologies {{(pid=75045) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 23:26:23 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-76c5a4b3-e6f0-43be-b544-7c34d5d3118a tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75045) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 23:26:23 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-76c5a4b3-e6f0-43be-b544-7c34d5d3118a tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75045) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 23:26:23 user nova-compute[75045]: DEBUG nova.virt.libvirt.volume.iscsi [None req-76c5a4b3-e6f0-43be-b544-7c34d5d3118a tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] [instance: 83d225e0-e39e-4500-b7ae-52dfbd8b8588] Calling os-brick to attach iSCSI Volume {{(pid=75045) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 23:26:23 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-76c5a4b3-e6f0-43be-b544-7c34d5d3118a tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1b68210460>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d2e734fa-1dcb-4510-a50e-064e29c2985e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qCUrDkTz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75045) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 23:26:23 user nova-compute[75045]: WARNING os_brick.initiator.connectors.base [None req-76c5a4b3-e6f0-43be-b544-7c34d5d3118a tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 23:26:23 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-76c5a4b3-e6f0-43be-b544-7c34d5d3118a tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 23:26:23 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-76c5a4b3-e6f0-43be-b544-7c34d5d3118a tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 23:26:23 user nova-compute[75045]: WARNING os_brick.initiator.connectors.base [None req-76c5a4b3-e6f0-43be-b544-7c34d5d3118a tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 23:26:23 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-76c5a4b3-e6f0-43be-b544-7c34d5d3118a tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d2e734fa-1dcb-4510-a50e-064e29c2985e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 23:26:23 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-76c5a4b3-e6f0-43be-b544-7c34d5d3118a tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d2e734fa-1dcb-4510-a50e-064e29c2985e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 23:26:23 user nova-compute[75045]: INFO os_brick.initiator.connectors.iscsi [None req-76c5a4b3-e6f0-43be-b544-7c34d5d3118a tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 23:26:23 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2e734fa-1dcb-4510-a50e-064e29c2985e -p 172.16.0.220:3260 {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:26:23 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2e734fa-1dcb-4510-a50e-064e29c2985e -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:26:23 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[0aa9fbe4-aa5d-417f-8fea-8d9a2e81334e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:26:23 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-76c5a4b3-e6f0-43be-b544-7c34d5d3118a tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 23:26:23 user nova-compute[75045]:  {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:26:23 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2e734fa-1dcb-4510-a50e-064e29c2985e -p 172.16.0.220:3260 --interface default --op new {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:26:23 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2e734fa-1dcb-4510-a50e-064e29c2985e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:26:23 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[37730e33-d2cd-4dca-b7a3-b2b7ae33ae02]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d2e734fa-1dcb-4510-a50e-064e29c2985e] added\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:26:23 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-76c5a4b3-e6f0-43be-b544-7c34d5d3118a tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d2e734fa-1dcb-4510-a50e-064e29c2985e] added
Nov 08 23:26:23 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:26:23 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2e734fa-1dcb-4510-a50e-064e29c2985e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:26:23 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2e734fa-1dcb-4510-a50e-064e29c2985e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:26:23 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[c22d0d83-d651-4242-a4e4-3a47c63d977a]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:26:23 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-76c5a4b3-e6f0-43be-b544-7c34d5d3118a tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:26:23 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2e734fa-1dcb-4510-a50e-064e29c2985e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:26:23 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2e734fa-1dcb-4510-a50e-064e29c2985e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.030s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:26:23 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b844836-f13e-4fc8-b9bc-d7cbac973f18]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:26:23 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-76c5a4b3-e6f0-43be-b544-7c34d5d3118a tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:26:23 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2e734fa-1dcb-4510-a50e-064e29c2985e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qCUrDkTz {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:26:23 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2e734fa-1dcb-4510-a50e-064e29c2985e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qCUrDkTz" returned: 0 in 0.026s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:26:23 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[5591a3f0-5f65-4e78-8d8f-f9144f596596]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:26:23 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-76c5a4b3-e6f0-43be-b544-7c34d5d3118a tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'qCUrDkTz'): stdout= stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:26:23 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2e734fa-1dcb-4510-a50e-064e29c2985e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:26:23 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2e734fa-1dcb-4510-a50e-064e29c2985e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:26:23 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5a63dfc-9f44-4f27-881c-b85c615e80d0]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:26:23 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-76c5a4b3-e6f0-43be-b544-7c34d5d3118a tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:26:23 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:26:23 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:26:23 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f87e463-bbc6-484c-ae41-1dc93536cbb9]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd1b2206-989e-409d-84c6-49b37ac252d8 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c37da13-9531-458a-87cb-1e86e6b84f3a (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04d02c98-d058-49d8-a350-ab9e63003d6e (non-flash)\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:26:23 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-76c5a4b3-e6f0-43be-b544-7c34d5d3118a tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab (non-flash)
Nov 08 23:26:23 user nova-compute[75045]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd1b2206-989e-409d-84c6-49b37ac252d8 (non-flash)
Nov 08 23:26:23 user nova-compute[75045]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c37da13-9531-458a-87cb-1e86e6b84f3a (non-flash)
Nov 08 23:26:23 user nova-compute[75045]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04d02c98-d058-49d8-a350-ab9e63003d6e (non-flash)
Nov 08 23:26:23 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 23:26:23 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-76c5a4b3-e6f0-43be-b544-7c34d5d3118a tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab (non-flash)
Nov 08 23:26:23 user nova-compute[75045]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd1b2206-989e-409d-84c6-49b37ac252d8 (non-flash)
Nov 08 23:26:23 user nova-compute[75045]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c37da13-9531-458a-87cb-1e86e6b84f3a (non-flash)
Nov 08 23:26:23 user nova-compute[75045]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04d02c98-d058-49d8-a350-ab9e63003d6e (non-flash)
Nov 08 23:26:23 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 23:26:23 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2e734fa-1dcb-4510-a50e-064e29c2985e -p 172.16.0.220:3260 --login {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:26:23 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2e734fa-1dcb-4510-a50e-064e29c2985e -p 172.16.0.220:3260 --login" returned: 0 in 0.075s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:26:23 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3d2b7b0-51e1-48e4-9950-95839a782180]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d2e734fa-1dcb-4510-a50e-064e29c2985e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d2e734fa-1dcb-4510-a50e-064e29c2985e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:26:23 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-76c5a4b3-e6f0-43be-b544-7c34d5d3118a tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d2e734fa-1dcb-4510-a50e-064e29c2985e, portal: 172.16.0.220,3260]
Nov 08 23:26:23 user nova-compute[75045]: Login to [iface: default, target: iqn.2010-10.org.openstack:d2e734fa-1dcb-4510-a50e-064e29c2985e, portal: 172.16.0.220,3260] successful.
Nov 08 23:26:23 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:26:23 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2e734fa-1dcb-4510-a50e-064e29c2985e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:26:23 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2e734fa-1dcb-4510-a50e-064e29c2985e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:26:23 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b76cf54-d620-48c8-94f2-8b4d52c7a923]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:26:23 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-76c5a4b3-e6f0-43be-b544-7c34d5d3118a tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:26:23 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:26:23 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:26:23 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[f85c4df7-d6f5-47e0-ace2-9c0b6d03eecc]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd1b2206-989e-409d-84c6-49b37ac252d8 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c37da13-9531-458a-87cb-1e86e6b84f3a (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04d02c98-d058-49d8-a350-ab9e63003d6e (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2e734fa-1dcb-4510-a50e-064e29c2985e (non-flash)\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:26:23 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-76c5a4b3-e6f0-43be-b544-7c34d5d3118a tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab (non-flash)
Nov 08 23:26:23 user nova-compute[75045]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd1b2206-989e-409d-84c6-49b37ac252d8 (non-flash)
Nov 08 23:26:23 user nova-compute[75045]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c37da13-9531-458a-87cb-1e86e6b84f3a (non-flash)
Nov 08 23:26:23 user nova-compute[75045]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04d02c98-d058-49d8-a350-ab9e63003d6e (non-flash)
Nov 08 23:26:23 user nova-compute[75045]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2e734fa-1dcb-4510-a50e-064e29c2985e (non-flash)
Nov 08 23:26:23 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 23:26:23 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-76c5a4b3-e6f0-43be-b544-7c34d5d3118a tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab (non-flash)
Nov 08 23:26:23 user nova-compute[75045]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd1b2206-989e-409d-84c6-49b37ac252d8 (non-flash)
Nov 08 23:26:23 user nova-compute[75045]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c37da13-9531-458a-87cb-1e86e6b84f3a (non-flash)
Nov 08 23:26:23 user nova-compute[75045]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04d02c98-d058-49d8-a350-ab9e63003d6e (non-flash)
Nov 08 23:26:23 user nova-compute[75045]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2e734fa-1dcb-4510-a50e-064e29c2985e (non-flash)
Nov 08 23:26:23 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 23:26:23 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-76c5a4b3-e6f0-43be-b544-7c34d5d3118a tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d2e734fa-1dcb-4510-a50e-064e29c2985e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.322s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 23:26:23 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-76c5a4b3-e6f0-43be-b544-7c34d5d3118a tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] Connected to 172.16.0.220:3260 {{(pid=75045) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 23:26:23 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-76c5a4b3-e6f0-43be-b544-7c34d5d3118a tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] HCTL ('35', '-', '-', 0) found on session 23 with lun 0 {{(pid=75045) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 23:26:23 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-76c5a4b3-e6f0-43be-b544-7c34d5d3118a tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75045) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 23:26:23 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:26:23 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.015s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:26:23 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[db991f91-dc6c-43d3-8280-d09b7312a07c]: (4, ('- - 0', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:26:23 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-76c5a4b3-e6f0-43be-b544-7c34d5d3118a tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] Searching for a device in session 23 and hctl ['35', '*', '*', 0] yield: None {{(pid=75045) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 23:26:24 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-76c5a4b3-e6f0-43be-b544-7c34d5d3118a tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] Searching for a device in session 23 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75045) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 23:26:24 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-76c5a4b3-e6f0-43be-b544-7c34d5d3118a tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:d2e734fa-1dcb-4510-a50e-064e29c2985e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qCUrDkTz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75045) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 23:26:24 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-76c5a4b3-e6f0-43be-b544-7c34d5d3118a tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.352s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 23:26:24 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-76c5a4b3-e6f0-43be-b544-7c34d5d3118a tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] <== connect_volume: return (1353ms) {'type': 'block', 'scsi_wwn': '23230663034306433', 'path': '/dev/sdd'} {{(pid=75045) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 23:26:24 user nova-compute[75045]: DEBUG nova.virt.libvirt.volume.iscsi [None req-76c5a4b3-e6f0-43be-b544-7c34d5d3118a tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] [instance: 83d225e0-e39e-4500-b7ae-52dfbd8b8588] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23230663034306433', 'path': '/dev/sdd'} {{(pid=75045) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 23:26:24 user nova-compute[75045]: DEBUG nova.virt.libvirt.vif [None req-76c5a4b3-e6f0-43be-b544-7c34d5d3118a tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T23:21:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-52454361',display_name='tempest-ServerActionsTestOtherB-server-52454361',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-52454361',id=16,image_ref='a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIPmBc8a5DafKsuCJlskOYpDDhPwBioEg4bK8XJOdFwOvE3kerS9/OlDrIi5hKJ4t8vHYgazIqYE6C9fG+r7udy2il9kXgn4I4yPKUfyTlGPaqAfUG4gtg1sBgzfEDpsow==',key_name='tempest-keypair-1494902868',keypairs=<?>,launch_index=0,launched_at=2023-11-08T23:21:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='467f0ecc3b93457f9fe83886b99c6285',ramdisk_id='',reservation_id='r-mtlunwmw',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-299728934',owner_user_name='tempest-ServerActionsTestOtherB-299728934-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T23:25:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='57d0c13f5a9f4c1bbb0458b93de348cb',uuid=83d225e0-e39e-4500-b7ae-52dfbd8b8588,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f34eef67-0428-49ea-91c3-08510ac690c8", "address": "fa:16:3e:d9:92:a4", "network": {"id": "d177c8b8-5960-4e40-bf9b-920a2f6ba4f7", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-497258569-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.31", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-497258569-network", "vif_mac": "fa:16:3e:d9:92:a4"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "467f0ecc3b93457f9fe83886b99c6285", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf34eef67-04", "ovs_interfaceid": "f34eef67-0428-49ea-91c3-08510ac690c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75045) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 23:26:24 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-76c5a4b3-e6f0-43be-b544-7c34d5d3118a tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] Converting VIF {"id": "f34eef67-0428-49ea-91c3-08510ac690c8", "address": "fa:16:3e:d9:92:a4", "network": {"id": "d177c8b8-5960-4e40-bf9b-920a2f6ba4f7", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-497258569-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.31", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-497258569-network", "vif_mac": "fa:16:3e:d9:92:a4"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "467f0ecc3b93457f9fe83886b99c6285", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf34eef67-04", "ovs_interfaceid": "f34eef67-0428-49ea-91c3-08510ac690c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 23:26:24 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-76c5a4b3-e6f0-43be-b544-7c34d5d3118a tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d9:92:a4,bridge_name='br-int',has_traffic_filtering=True,id=f34eef67-0428-49ea-91c3-08510ac690c8,network=Network(d177c8b8-5960-4e40-bf9b-920a2f6ba4f7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf34eef67-04') {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 23:26:24 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-76c5a4b3-e6f0-43be-b544-7c34d5d3118a tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] [instance: 83d225e0-e39e-4500-b7ae-52dfbd8b8588] End _get_guest_xml xml=<domain type="kvm">
Nov 08 23:26:24 user nova-compute[75045]:   <uuid>83d225e0-e39e-4500-b7ae-52dfbd8b8588</uuid>
Nov 08 23:26:24 user nova-compute[75045]:   <name>instance-00000010</name>
Nov 08 23:26:24 user nova-compute[75045]:   <memory>2097152</memory>
Nov 08 23:26:24 user nova-compute[75045]:   <vcpu>1</vcpu>
Nov 08 23:26:24 user nova-compute[75045]:   <metadata>
Nov 08 23:26:24 user nova-compute[75045]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 23:26:24 user nova-compute[75045]:       <nova:package version="0.0.0"/>
Nov 08 23:26:24 user nova-compute[75045]:       <nova:name>tempest-ServerActionsTestOtherB-server-52454361</nova:name>
Nov 08 23:26:24 user nova-compute[75045]:       <nova:creationTime>2023-11-08 23:26:23</nova:creationTime>
Nov 08 23:26:24 user nova-compute[75045]:       <nova:flavor name="m1.small">
Nov 08 23:26:24 user nova-compute[75045]:         <nova:memory>2048</nova:memory>
Nov 08 23:26:24 user nova-compute[75045]:         <nova:disk>20</nova:disk>
Nov 08 23:26:24 user nova-compute[75045]:         <nova:swap>0</nova:swap>
Nov 08 23:26:24 user nova-compute[75045]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 23:26:24 user nova-compute[75045]:         <nova:vcpus>1</nova:vcpus>
Nov 08 23:26:24 user nova-compute[75045]:       </nova:flavor>
Nov 08 23:26:24 user nova-compute[75045]:       <nova:owner>
Nov 08 23:26:24 user nova-compute[75045]:         <nova:user uuid="57d0c13f5a9f4c1bbb0458b93de348cb">tempest-ServerActionsTestOtherB-299728934-project-member</nova:user>
Nov 08 23:26:24 user nova-compute[75045]:         <nova:project uuid="467f0ecc3b93457f9fe83886b99c6285">tempest-ServerActionsTestOtherB-299728934</nova:project>
Nov 08 23:26:24 user nova-compute[75045]:       </nova:owner>
Nov 08 23:26:24 user nova-compute[75045]:       <nova:root type="image" uuid="a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb"/>
Nov 08 23:26:24 user nova-compute[75045]:       <nova:ports>
Nov 08 23:26:24 user nova-compute[75045]:         <nova:port uuid="f34eef67-0428-49ea-91c3-08510ac690c8">
Nov 08 23:26:24 user nova-compute[75045]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 08 23:26:24 user nova-compute[75045]:         </nova:port>
Nov 08 23:26:24 user nova-compute[75045]:       </nova:ports>
Nov 08 23:26:24 user nova-compute[75045]:     </nova:instance>
Nov 08 23:26:24 user nova-compute[75045]:   </metadata>
Nov 08 23:26:24 user nova-compute[75045]:   <sysinfo type="smbios">
Nov 08 23:26:24 user nova-compute[75045]:     <system>
Nov 08 23:26:24 user nova-compute[75045]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 23:26:24 user nova-compute[75045]:       <entry name="product">OpenStack Nova</entry>
Nov 08 23:26:24 user nova-compute[75045]:       <entry name="version">0.0.0</entry>
Nov 08 23:26:24 user nova-compute[75045]:       <entry name="serial">83d225e0-e39e-4500-b7ae-52dfbd8b8588</entry>
Nov 08 23:26:24 user nova-compute[75045]:       <entry name="uuid">83d225e0-e39e-4500-b7ae-52dfbd8b8588</entry>
Nov 08 23:26:24 user nova-compute[75045]:       <entry name="family">Virtual Machine</entry>
Nov 08 23:26:24 user nova-compute[75045]:     </system>
Nov 08 23:26:24 user nova-compute[75045]:   </sysinfo>
Nov 08 23:26:24 user nova-compute[75045]:   <os>
Nov 08 23:26:24 user nova-compute[75045]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 23:26:24 user nova-compute[75045]:     <boot dev="hd"/>
Nov 08 23:26:24 user nova-compute[75045]:     <smbios mode="sysinfo"/>
Nov 08 23:26:24 user nova-compute[75045]:   </os>
Nov 08 23:26:24 user nova-compute[75045]:   <features>
Nov 08 23:26:24 user nova-compute[75045]:     <acpi/>
Nov 08 23:26:24 user nova-compute[75045]:     <apic/>
Nov 08 23:26:24 user nova-compute[75045]:     <vmcoreinfo/>
Nov 08 23:26:24 user nova-compute[75045]:   </features>
Nov 08 23:26:24 user nova-compute[75045]:   <clock offset="utc">
Nov 08 23:26:24 user nova-compute[75045]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 23:26:24 user nova-compute[75045]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 23:26:24 user nova-compute[75045]:     <timer name="hpet" present="no"/>
Nov 08 23:26:24 user nova-compute[75045]:   </clock>
Nov 08 23:26:24 user nova-compute[75045]:   <cpu mode="custom" match="exact">
Nov 08 23:26:24 user nova-compute[75045]:     <model>Nehalem</model>
Nov 08 23:26:24 user nova-compute[75045]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 23:26:24 user nova-compute[75045]:   </cpu>
Nov 08 23:26:24 user nova-compute[75045]:   <devices>
Nov 08 23:26:24 user nova-compute[75045]:     <disk type="file" device="disk">
Nov 08 23:26:24 user nova-compute[75045]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 23:26:24 user nova-compute[75045]:       <source file="/opt/stack/data/nova/instances/83d225e0-e39e-4500-b7ae-52dfbd8b8588/disk"/>
Nov 08 23:26:24 user nova-compute[75045]:       <target dev="vda" bus="virtio"/>
Nov 08 23:26:24 user nova-compute[75045]:     </disk>
Nov 08 23:26:24 user nova-compute[75045]:     <disk type="block" device="disk">
Nov 08 23:26:24 user nova-compute[75045]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 23:26:24 user nova-compute[75045]:       <source dev="/dev/sdd"/>
Nov 08 23:26:24 user nova-compute[75045]:       <target dev="vdb" bus="virtio"/>
Nov 08 23:26:24 user nova-compute[75045]:       <serial>d2e734fa-1dcb-4510-a50e-064e29c2985e</serial>
Nov 08 23:26:24 user nova-compute[75045]:     </disk>
Nov 08 23:26:24 user nova-compute[75045]:     <interface type="ethernet">
Nov 08 23:26:24 user nova-compute[75045]:       <mac address="fa:16:3e:d9:92:a4"/>
Nov 08 23:26:24 user nova-compute[75045]:       <model type="virtio"/>
Nov 08 23:26:24 user nova-compute[75045]:       <mtu size="1442"/>
Nov 08 23:26:24 user nova-compute[75045]:       <target dev="tapf34eef67-04"/>
Nov 08 23:26:24 user nova-compute[75045]:     </interface>
Nov 08 23:26:24 user nova-compute[75045]:     <serial type="pty">
Nov 08 23:26:24 user nova-compute[75045]:       <log file="/opt/stack/data/nova/instances/83d225e0-e39e-4500-b7ae-52dfbd8b8588/console.log" append="off"/>
Nov 08 23:26:24 user nova-compute[75045]:     </serial>
Nov 08 23:26:24 user nova-compute[75045]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 23:26:24 user nova-compute[75045]:     <video>
Nov 08 23:26:24 user nova-compute[75045]:       <model type="virtio"/>
Nov 08 23:26:24 user nova-compute[75045]:     </video>
Nov 08 23:26:24 user nova-compute[75045]:     <rng model="virtio">
Nov 08 23:26:24 user nova-compute[75045]:       <backend model="random">/dev/urandom</backend>
Nov 08 23:26:24 user nova-compute[75045]:     </rng>
Nov 08 23:26:24 user nova-compute[75045]:     <controller type="usb" index="0" model="none"/>
Nov 08 23:26:24 user nova-compute[75045]:     <memballoon model="virtio">
Nov 08 23:26:24 user nova-compute[75045]:       <stats period="10"/>
Nov 08 23:26:24 user nova-compute[75045]:     </memballoon>
Nov 08 23:26:24 user nova-compute[75045]:   </devices>
Nov 08 23:26:24 user nova-compute[75045]: </domain>
Nov 08 23:26:24 user nova-compute[75045]:  {{(pid=75045) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 23:26:24 user nova-compute[75045]: DEBUG nova.virt.libvirt.vif [None req-76c5a4b3-e6f0-43be-b544-7c34d5d3118a tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T23:21:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-52454361',display_name='tempest-ServerActionsTestOtherB-server-52454361',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-52454361',id=16,image_ref='a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIPmBc8a5DafKsuCJlskOYpDDhPwBioEg4bK8XJOdFwOvE3kerS9/OlDrIi5hKJ4t8vHYgazIqYE6C9fG+r7udy2il9kXgn4I4yPKUfyTlGPaqAfUG4gtg1sBgzfEDpsow==',key_name='tempest-keypair-1494902868',keypairs=<?>,launch_index=0,launched_at=2023-11-08T23:21:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='467f0ecc3b93457f9fe83886b99c6285',ramdisk_id='',reservation_id='r-mtlunwmw',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-299728934',owner_user_name='tempest-ServerActionsTestOtherB-299728934-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T23:25:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='57d0c13f5a9f4c1bbb0458b93de348cb',uuid=83d225e0-e39e-4500-b7ae-52dfbd8b8588,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f34eef67-0428-49ea-91c3-08510ac690c8", "address": "fa:16:3e:d9:92:a4", "network": {"id": "d177c8b8-5960-4e40-bf9b-920a2f6ba4f7", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-497258569-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.31", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-497258569-network", "vif_mac": "fa:16:3e:d9:92:a4"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "467f0ecc3b93457f9fe83886b99c6285", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf34eef67-04", "ovs_interfaceid": "f34eef67-0428-49ea-91c3-08510ac690c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75045) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 23:26:24 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-76c5a4b3-e6f0-43be-b544-7c34d5d3118a tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] Converting VIF {"id": "f34eef67-0428-49ea-91c3-08510ac690c8", "address": "fa:16:3e:d9:92:a4", "network": {"id": "d177c8b8-5960-4e40-bf9b-920a2f6ba4f7", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-497258569-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.31", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-497258569-network", "vif_mac": "fa:16:3e:d9:92:a4"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "467f0ecc3b93457f9fe83886b99c6285", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf34eef67-04", "ovs_interfaceid": "f34eef67-0428-49ea-91c3-08510ac690c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 23:26:24 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-76c5a4b3-e6f0-43be-b544-7c34d5d3118a tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d9:92:a4,bridge_name='br-int',has_traffic_filtering=True,id=f34eef67-0428-49ea-91c3-08510ac690c8,network=Network(d177c8b8-5960-4e40-bf9b-920a2f6ba4f7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf34eef67-04') {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 23:26:24 user nova-compute[75045]: DEBUG os_vif [None req-76c5a4b3-e6f0-43be-b544-7c34d5d3118a tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d9:92:a4,bridge_name='br-int',has_traffic_filtering=True,id=f34eef67-0428-49ea-91c3-08510ac690c8,network=Network(d177c8b8-5960-4e40-bf9b-920a2f6ba4f7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf34eef67-04') {{(pid=75045) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 23:26:24 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:26:24 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:26:24 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 23:26:24 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:26:24 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f0cd464b-9d86-5c16-aea4-d9e38240ae43', '_type': 'linux-noop'}}, row=False) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:26:24 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:26:24 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 23:26:24 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:26:24 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf34eef67-04, may_exist=True, interface_attrs={}) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:26:24 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf34eef67-04, col_values=(('qos', UUID('731c957d-4f2f-47c4-9e1a-8c1a1aa63192')),), if_exists=True) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:26:24 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf34eef67-04, col_values=(('external_ids', {'iface-id': 'f34eef67-0428-49ea-91c3-08510ac690c8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d9:92:a4', 'vm-uuid': '83d225e0-e39e-4500-b7ae-52dfbd8b8588'}),), if_exists=True) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:26:24 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:26:24 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 23:26:24 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:26:24 user nova-compute[75045]: INFO os_vif [None req-76c5a4b3-e6f0-43be-b544-7c34d5d3118a tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d9:92:a4,bridge_name='br-int',has_traffic_filtering=True,id=f34eef67-0428-49ea-91c3-08510ac690c8,network=Network(d177c8b8-5960-4e40-bf9b-920a2f6ba4f7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf34eef67-04')
Nov 08 23:26:24 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-76c5a4b3-e6f0-43be-b544-7c34d5d3118a tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] No BDM found with device name vda, not building metadata. {{(pid=75045) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 23:26:24 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-76c5a4b3-e6f0-43be-b544-7c34d5d3118a tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75045) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 23:26:24 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-76c5a4b3-e6f0-43be-b544-7c34d5d3118a tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] No VIF found with MAC fa:16:3e:d9:92:a4, not building metadata {{(pid=75045) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 23:26:25 user nova-compute[75045]: DEBUG nova.compute.manager [req-55671725-cabc-42f6-b791-699dfac90390 req-6f99dfed-f4c4-49a5-bfec-b1acbc778f32 service nova] [instance: 667d20c3-3eda-4aa5-b799-6dcee3443833] Received event volume-reimaged-04d02c98-d058-49d8-a350-ab9e63003d6e {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:26:25 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-55671725-cabc-42f6-b791-699dfac90390 req-6f99dfed-f4c4-49a5-bfec-b1acbc778f32 service nova] Acquiring lock "667d20c3-3eda-4aa5-b799-6dcee3443833-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:26:25 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-55671725-cabc-42f6-b791-699dfac90390 req-6f99dfed-f4c4-49a5-bfec-b1acbc778f32 service nova] Lock "667d20c3-3eda-4aa5-b799-6dcee3443833-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:26:25 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-55671725-cabc-42f6-b791-699dfac90390 req-6f99dfed-f4c4-49a5-bfec-b1acbc778f32 service nova] Lock "667d20c3-3eda-4aa5-b799-6dcee3443833-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:26:25 user nova-compute[75045]: DEBUG nova.compute.manager [req-55671725-cabc-42f6-b791-699dfac90390 req-6f99dfed-f4c4-49a5-bfec-b1acbc778f32 service nova] [instance: 667d20c3-3eda-4aa5-b799-6dcee3443833] Processing event volume-reimaged-04d02c98-d058-49d8-a350-ab9e63003d6e {{(pid=75045) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10872}}
Nov 08 23:26:25 user nova-compute[75045]: DEBUG nova.compute.manager [None req-55671725-cabc-42f6-b791-699dfac90390 tempest-ServerActionsV293TestJSON-1645081958 tempest-ServerActionsV293TestJSON-1645081958-project-member] [instance: 667d20c3-3eda-4aa5-b799-6dcee3443833] Instance event wait completed in 31 seconds for volume-reimaged {{(pid=75045) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 23:26:25 user nova-compute[75045]: INFO nova.virt.block_device [None req-55671725-cabc-42f6-b791-699dfac90390 tempest-ServerActionsV293TestJSON-1645081958 tempest-ServerActionsV293TestJSON-1645081958-project-member] [instance: 667d20c3-3eda-4aa5-b799-6dcee3443833] Booting with volume 04d02c98-d058-49d8-a350-ab9e63003d6e at /dev/vda
Nov 08 23:26:25 user nova-compute[75045]: DEBUG os_brick.utils [None req-55671725-cabc-42f6-b791-699dfac90390 tempest-ServerActionsV293TestJSON-1645081958 tempest-ServerActionsV293TestJSON-1645081958-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75045) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 23:26:25 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:26:25 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:26:25 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[4816bce5-2cd0-4d06-8a5b-03627b256f5a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6217bd6e884\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:26:25 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:26:25 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:26:25 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf98ed6c-4569-4a2b-9daa-883590d77267]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:26:25 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:26:25 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:26:25 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:26:25 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b5800d2-99ab-474a-9ee0-7318b1372daa]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:26:25 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[d55351d8-2dd7-43de-bf3f-b9393e16f56a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:26:25 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-55671725-cabc-42f6-b791-699dfac90390 tempest-ServerActionsV293TestJSON-1645081958 tempest-ServerActionsV293TestJSON-1645081958-project-member] Running cmd (subprocess): nvme version {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:26:25 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-55671725-cabc-42f6-b791-699dfac90390 tempest-ServerActionsV293TestJSON-1645081958 tempest-ServerActionsV293TestJSON-1645081958-project-member] 'nvme version' failed. Not Retrying. {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 23:26:25 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:26:25 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.nvmeof [None req-55671725-cabc-42f6-b791-699dfac90390 tempest-ServerActionsV293TestJSON-1645081958 tempest-ServerActionsV293TestJSON-1645081958-project-member] nvme not present on system {{(pid=75045) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 23:26:25 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:26:25 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 23:26:25 user nova-compute[75045]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 23:26:25 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8768591-a124-4877-954e-affe060befbb]: (4, '') {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:26:25 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.lightos [None req-55671725-cabc-42f6-b791-699dfac90390 tempest-ServerActionsV293TestJSON-1645081958 tempest-ServerActionsV293TestJSON-1645081958-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75045) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 23:26:25 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.lightos [None req-55671725-cabc-42f6-b791-699dfac90390 tempest-ServerActionsV293TestJSON-1645081958 tempest-ServerActionsV293TestJSON-1645081958-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75045) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 23:26:25 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.lightos [None req-55671725-cabc-42f6-b791-699dfac90390 tempest-ServerActionsV293TestJSON-1645081958 tempest-ServerActionsV293TestJSON-1645081958-project-member] LIGHTOS: no hostnqn found. {{(pid=75045) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 23:26:25 user nova-compute[75045]: DEBUG os_brick.utils [None req-55671725-cabc-42f6-b791-699dfac90390 tempest-ServerActionsV293TestJSON-1645081958 tempest-ServerActionsV293TestJSON-1645081958-project-member] <== get_connector_properties: return (143ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6217bd6e884', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75045) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 23:26:25 user nova-compute[75045]: DEBUG nova.virt.block_device [None req-55671725-cabc-42f6-b791-699dfac90390 tempest-ServerActionsV293TestJSON-1645081958 tempest-ServerActionsV293TestJSON-1645081958-project-member] [instance: 667d20c3-3eda-4aa5-b799-6dcee3443833] Updating existing volume attachment record: b11171e1-9ecf-4ebf-a802-18158bc3d931 {{(pid=75045) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 23:26:26 user nova-compute[75045]: DEBUG nova.compute.manager [req-589b24a2-edd1-4bf3-9b42-da4eea6ebba3 req-78f8f8f4-753a-4c9b-b364-4a6413b9ec3d service nova] [instance: 83d225e0-e39e-4500-b7ae-52dfbd8b8588] Received event network-vif-plugged-f34eef67-0428-49ea-91c3-08510ac690c8 {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:26:26 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-589b24a2-edd1-4bf3-9b42-da4eea6ebba3 req-78f8f8f4-753a-4c9b-b364-4a6413b9ec3d service nova] Acquiring lock "83d225e0-e39e-4500-b7ae-52dfbd8b8588-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:26:26 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-589b24a2-edd1-4bf3-9b42-da4eea6ebba3 req-78f8f8f4-753a-4c9b-b364-4a6413b9ec3d service nova] Lock "83d225e0-e39e-4500-b7ae-52dfbd8b8588-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:26:26 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-589b24a2-edd1-4bf3-9b42-da4eea6ebba3 req-78f8f8f4-753a-4c9b-b364-4a6413b9ec3d service nova] Lock "83d225e0-e39e-4500-b7ae-52dfbd8b8588-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:26:26 user nova-compute[75045]: DEBUG nova.compute.manager [req-589b24a2-edd1-4bf3-9b42-da4eea6ebba3 req-78f8f8f4-753a-4c9b-b364-4a6413b9ec3d service nova] [instance: 83d225e0-e39e-4500-b7ae-52dfbd8b8588] No waiting events found dispatching network-vif-plugged-f34eef67-0428-49ea-91c3-08510ac690c8 {{(pid=75045) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 23:26:26 user nova-compute[75045]: WARNING nova.compute.manager [req-589b24a2-edd1-4bf3-9b42-da4eea6ebba3 req-78f8f8f4-753a-4c9b-b364-4a6413b9ec3d service nova] [instance: 83d225e0-e39e-4500-b7ae-52dfbd8b8588] Received unexpected event network-vif-plugged-f34eef67-0428-49ea-91c3-08510ac690c8 for instance with vm_state active and task_state resize_finish.
Nov 08 23:26:26 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:26:26 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:26:26 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:26:26 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:26:28 user nova-compute[75045]: DEBUG nova.compute.manager [None req-76c5a4b3-e6f0-43be-b544-7c34d5d3118a tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] [instance: 83d225e0-e39e-4500-b7ae-52dfbd8b8588] Instance event wait completed in 0 seconds for  {{(pid=75045) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 23:26:28 user nova-compute[75045]: INFO nova.virt.libvirt.driver [-] [instance: 83d225e0-e39e-4500-b7ae-52dfbd8b8588] Instance running successfully.
Nov 08 23:26:28 user nova-compute[75045]: DEBUG nova.virt.libvirt.guest [None req-76c5a4b3-e6f0-43be-b544-7c34d5d3118a tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] [instance: 83d225e0-e39e-4500-b7ae-52dfbd8b8588] Failed to set time: agent not configured {{(pid=75045) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Nov 08 23:26:28 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-76c5a4b3-e6f0-43be-b544-7c34d5d3118a tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] [instance: 83d225e0-e39e-4500-b7ae-52dfbd8b8588] finish_migration finished successfully. {{(pid=75045) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Nov 08 23:26:28 user nova-compute[75045]: DEBUG nova.compute.manager [req-67cbf697-2e25-4a20-b4c9-8b4c6746cbb3 req-d0788b4e-0a86-4c85-9289-4dba31ef5ba8 service nova] [instance: 83d225e0-e39e-4500-b7ae-52dfbd8b8588] Received event network-vif-plugged-f34eef67-0428-49ea-91c3-08510ac690c8 {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:26:28 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-67cbf697-2e25-4a20-b4c9-8b4c6746cbb3 req-d0788b4e-0a86-4c85-9289-4dba31ef5ba8 service nova] Acquiring lock "83d225e0-e39e-4500-b7ae-52dfbd8b8588-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:26:28 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-67cbf697-2e25-4a20-b4c9-8b4c6746cbb3 req-d0788b4e-0a86-4c85-9289-4dba31ef5ba8 service nova] Lock "83d225e0-e39e-4500-b7ae-52dfbd8b8588-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:26:28 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-67cbf697-2e25-4a20-b4c9-8b4c6746cbb3 req-d0788b4e-0a86-4c85-9289-4dba31ef5ba8 service nova] Lock "83d225e0-e39e-4500-b7ae-52dfbd8b8588-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:26:28 user nova-compute[75045]: DEBUG nova.compute.manager [req-67cbf697-2e25-4a20-b4c9-8b4c6746cbb3 req-d0788b4e-0a86-4c85-9289-4dba31ef5ba8 service nova] [instance: 83d225e0-e39e-4500-b7ae-52dfbd8b8588] No waiting events found dispatching network-vif-plugged-f34eef67-0428-49ea-91c3-08510ac690c8 {{(pid=75045) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 23:26:28 user nova-compute[75045]: WARNING nova.compute.manager [req-67cbf697-2e25-4a20-b4c9-8b4c6746cbb3 req-d0788b4e-0a86-4c85-9289-4dba31ef5ba8 service nova] [instance: 83d225e0-e39e-4500-b7ae-52dfbd8b8588] Received unexpected event network-vif-plugged-f34eef67-0428-49ea-91c3-08510ac690c8 for instance with vm_state active and task_state resize_finish.
Nov 08 23:26:29 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:26:30 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-69512031-f2d2-4bfb-8e15-dc20a249a093 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Acquiring lock "43f31110-89ec-4b20-9842-7c9dd7df0e14" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:26:30 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-69512031-f2d2-4bfb-8e15-dc20a249a093 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Lock "43f31110-89ec-4b20-9842-7c9dd7df0e14" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:26:30 user nova-compute[75045]: INFO nova.compute.manager [None req-69512031-f2d2-4bfb-8e15-dc20a249a093 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] [instance: 43f31110-89ec-4b20-9842-7c9dd7df0e14] Detaching volume cd1b2206-989e-409d-84c6-49b37ac252d8
Nov 08 23:26:30 user nova-compute[75045]: INFO nova.virt.block_device [None req-69512031-f2d2-4bfb-8e15-dc20a249a093 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] [instance: 43f31110-89ec-4b20-9842-7c9dd7df0e14] Attempting to driver detach volume cd1b2206-989e-409d-84c6-49b37ac252d8 from mountpoint /dev/vdb
Nov 08 23:26:30 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-69512031-f2d2-4bfb-8e15-dc20a249a093 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Attempting to detach device vdb from instance 43f31110-89ec-4b20-9842-7c9dd7df0e14 from the persistent domain config. {{(pid=75045) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 08 23:26:30 user nova-compute[75045]: DEBUG nova.virt.libvirt.guest [None req-69512031-f2d2-4bfb-8e15-dc20a249a093 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 23:26:30 user nova-compute[75045]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 23:26:30 user nova-compute[75045]:   <source dev="/dev/sdb"/>
Nov 08 23:26:30 user nova-compute[75045]:   <target dev="vdb" bus="virtio"/>
Nov 08 23:26:30 user nova-compute[75045]:   <serial>cd1b2206-989e-409d-84c6-49b37ac252d8</serial>
Nov 08 23:26:30 user nova-compute[75045]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 08 23:26:30 user nova-compute[75045]: </disk>
Nov 08 23:26:30 user nova-compute[75045]:  {{(pid=75045) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 23:26:30 user nova-compute[75045]: INFO nova.virt.libvirt.driver [None req-69512031-f2d2-4bfb-8e15-dc20a249a093 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Successfully detached device vdb from instance 43f31110-89ec-4b20-9842-7c9dd7df0e14 from the persistent domain config.
Nov 08 23:26:30 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-69512031-f2d2-4bfb-8e15-dc20a249a093 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 43f31110-89ec-4b20-9842-7c9dd7df0e14 from the live domain config. {{(pid=75045) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 08 23:26:30 user nova-compute[75045]: DEBUG nova.virt.libvirt.guest [None req-69512031-f2d2-4bfb-8e15-dc20a249a093 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 23:26:30 user nova-compute[75045]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 23:26:30 user nova-compute[75045]:   <source dev="/dev/sdb"/>
Nov 08 23:26:30 user nova-compute[75045]:   <target dev="vdb" bus="virtio"/>
Nov 08 23:26:30 user nova-compute[75045]:   <serial>cd1b2206-989e-409d-84c6-49b37ac252d8</serial>
Nov 08 23:26:30 user nova-compute[75045]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 08 23:26:30 user nova-compute[75045]: </disk>
Nov 08 23:26:30 user nova-compute[75045]:  {{(pid=75045) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 23:26:30 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-69512031-f2d2-4bfb-8e15-dc20a249a093 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 43f31110-89ec-4b20-9842-7c9dd7df0e14 {{(pid=75045) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 08 23:26:31 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:26:34 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:26:36 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:26:36 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:26:36 user nova-compute[75045]: DEBUG nova.compute.manager [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Cleaning up deleted instances with incomplete migration  {{(pid=75045) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 08 23:26:37 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:26:37 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:26:37 user nova-compute[75045]: DEBUG nova.compute.manager [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75045) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 23:26:38 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:26:38 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager.update_available_resource {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:26:39 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:26:39 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.002s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:26:39 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:26:39 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Auditing locally available compute resources for user (node: user) {{(pid=75045) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 23:26:39 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72c9d731-2b35-434c-8463-1cd6c18fbd6a/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:26:39 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72c9d731-2b35-434c-8463-1cd6c18fbd6a/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:26:39 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72c9d731-2b35-434c-8463-1cd6c18fbd6a/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:26:39 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:26:39 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72c9d731-2b35-434c-8463-1cd6c18fbd6a/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:26:39 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ae5ff6b-6f2c-4dfd-a4c6-da4809e2cf27/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:26:39 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ae5ff6b-6f2c-4dfd-a4c6-da4809e2cf27/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:26:39 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ae5ff6b-6f2c-4dfd-a4c6-da4809e2cf27/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:26:40 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ae5ff6b-6f2c-4dfd-a4c6-da4809e2cf27/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:26:40 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] skipping disk /dev/sdh (vda) as it is a volume {{(pid=75045) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 23:26:40 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f21fcd3-ac5f-499e-9c34-82af806fda1d/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:26:40 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f21fcd3-ac5f-499e-9c34-82af806fda1d/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:26:40 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f21fcd3-ac5f-499e-9c34-82af806fda1d/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:26:40 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f21fcd3-ac5f-499e-9c34-82af806fda1d/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:26:40 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e92ab9a-8ea4-4452-a458-db181d4a59b7/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:26:40 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e92ab9a-8ea4-4452-a458-db181d4a59b7/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:26:40 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e92ab9a-8ea4-4452-a458-db181d4a59b7/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:26:40 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e92ab9a-8ea4-4452-a458-db181d4a59b7/disk --force-share --output=json" returned: 0 in 0.249s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:26:40 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa67b237-f598-4111-87ba-d761aa50d95e/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:26:41 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa67b237-f598-4111-87ba-d761aa50d95e/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:26:41 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa67b237-f598-4111-87ba-d761aa50d95e/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:26:41 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa67b237-f598-4111-87ba-d761aa50d95e/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:26:41 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83d225e0-e39e-4500-b7ae-52dfbd8b8588/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:26:41 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83d225e0-e39e-4500-b7ae-52dfbd8b8588/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:26:41 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83d225e0-e39e-4500-b7ae-52dfbd8b8588/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:26:41 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83d225e0-e39e-4500-b7ae-52dfbd8b8588/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:26:41 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75045) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 23:26:41 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43f31110-89ec-4b20-9842-7c9dd7df0e14/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:26:41 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43f31110-89ec-4b20-9842-7c9dd7df0e14/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:26:41 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43f31110-89ec-4b20-9842-7c9dd7df0e14/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:26:41 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43f31110-89ec-4b20-9842-7c9dd7df0e14/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:26:42 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25cd59d1-6884-471a-813e-52e97c2e1208/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:26:42 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25cd59d1-6884-471a-813e-52e97c2e1208/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:26:42 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25cd59d1-6884-471a-813e-52e97c2e1208/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:26:42 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25cd59d1-6884-471a-813e-52e97c2e1208/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:26:42 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=75045) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 23:26:42 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5fc7f02-2143-4bcf-92ac-078d5ec10747/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:26:42 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5fc7f02-2143-4bcf-92ac-078d5ec10747/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:26:42 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5fc7f02-2143-4bcf-92ac-078d5ec10747/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:26:42 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5fc7f02-2143-4bcf-92ac-078d5ec10747/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:26:42 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b84f2b1-01a3-4789-bcef-8b7c4334132b/disk.rescue --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:26:42 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b84f2b1-01a3-4789-bcef-8b7c4334132b/disk.rescue --force-share --output=json" returned: 0 in 0.176s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:26:42 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b84f2b1-01a3-4789-bcef-8b7c4334132b/disk.rescue --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:26:43 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b84f2b1-01a3-4789-bcef-8b7c4334132b/disk.rescue --force-share --output=json" returned: 0 in 0.175s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:26:43 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b84f2b1-01a3-4789-bcef-8b7c4334132b/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:26:43 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b84f2b1-01a3-4789-bcef-8b7c4334132b/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:26:43 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b84f2b1-01a3-4789-bcef-8b7c4334132b/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:26:43 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b84f2b1-01a3-4789-bcef-8b7c4334132b/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:26:43 user nova-compute[75045]: WARNING nova.virt.libvirt.driver [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 23:26:43 user nova-compute[75045]: WARNING nova.virt.libvirt.driver [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 23:26:43 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Hypervisor/Node resource view: name=user free_ram=7404MB free_disk=25.142086029052734GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75045) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 23:26:43 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:26:43 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:26:44 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Applying migration context for instance 83d225e0-e39e-4500-b7ae-52dfbd8b8588 as it has an incoming, in-progress migration a833aacc-4f39-495d-a775-0a832874ba4f. Migration status is finished {{(pid=75045) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 08 23:26:44 user nova-compute[75045]: INFO nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] [instance: 83d225e0-e39e-4500-b7ae-52dfbd8b8588] Updating resource usage from migration a833aacc-4f39-495d-a775-0a832874ba4f
Nov 08 23:26:44 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Instance 4ae5ff6b-6f2c-4dfd-a4c6-da4809e2cf27 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75045) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 23:26:44 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Instance 0f21fcd3-ac5f-499e-9c34-82af806fda1d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75045) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 23:26:44 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Instance d2c911cf-d5f4-4c19-8335-8c7834184a7e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75045) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 23:26:44 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Instance 43f31110-89ec-4b20-9842-7c9dd7df0e14 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75045) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 23:26:44 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Instance 25cd59d1-6884-471a-813e-52e97c2e1208 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75045) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 23:26:44 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Instance b5fc7f02-2143-4bcf-92ac-078d5ec10747 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75045) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 23:26:44 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Instance 0b84f2b1-01a3-4789-bcef-8b7c4334132b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75045) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 23:26:44 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Instance 667d20c3-3eda-4aa5-b799-6dcee3443833 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75045) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 23:26:44 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Instance fa67b237-f598-4111-87ba-d761aa50d95e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75045) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 23:26:44 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Instance 7e92ab9a-8ea4-4452-a458-db181d4a59b7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75045) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 23:26:44 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Instance 72c9d731-2b35-434c-8463-1cd6c18fbd6a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75045) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 23:26:44 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Migration a833aacc-4f39-495d-a775-0a832874ba4f is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75045) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 08 23:26:44 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Instance 83d225e0-e39e-4500-b7ae-52dfbd8b8588 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75045) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 23:26:44 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=75045) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 23:26:44 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Final resource view: name=user phys_ram=16011MB used_ram=8704MB phys_disk=40GB used_disk=30GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=75045) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 23:26:44 user nova-compute[75045]: DEBUG nova.scheduler.client.report [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Refreshing inventories for resource provider 62ba5f85-c74d-4b58-986e-d4197e813fd7 {{(pid=75045) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 08 23:26:44 user nova-compute[75045]: DEBUG nova.scheduler.client.report [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Updating ProviderTree inventory for provider 62ba5f85-c74d-4b58-986e-d4197e813fd7 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75045) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 08 23:26:44 user nova-compute[75045]: DEBUG nova.compute.provider_tree [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Updating inventory in ProviderTree for provider 62ba5f85-c74d-4b58-986e-d4197e813fd7 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75045) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 08 23:26:44 user nova-compute[75045]: DEBUG nova.scheduler.client.report [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Refreshing aggregate associations for resource provider 62ba5f85-c74d-4b58-986e-d4197e813fd7, aggregates: None {{(pid=75045) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 08 23:26:44 user nova-compute[75045]: DEBUG nova.scheduler.client.report [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Refreshing trait associations for resource provider 62ba5f85-c74d-4b58-986e-d4197e813fd7, traits: COMPUTE_STORAGE_BUS_SCSI,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_TRUSTED_CERTS,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_VIRTIO,HW_CPU_X86_SSSE3,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_FDC,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_RESCUE_BFV,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSE2,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN {{(pid=75045) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 08 23:26:44 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:26:44 user nova-compute[75045]: DEBUG nova.compute.provider_tree [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Inventory has not changed in ProviderTree for provider: 62ba5f85-c74d-4b58-986e-d4197e813fd7 {{(pid=75045) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 23:26:44 user nova-compute[75045]: DEBUG nova.scheduler.client.report [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Inventory has not changed for provider 62ba5f85-c74d-4b58-986e-d4197e813fd7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75045) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 23:26:44 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Compute_service record updated for user:user {{(pid=75045) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 23:26:44 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.834s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:26:44 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:26:46 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:26:46 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:26:46 user nova-compute[75045]: DEBUG nova.compute.manager [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Starting heal instance info cache {{(pid=75045) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 23:26:46 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Acquiring lock "refresh_cache-43f31110-89ec-4b20-9842-7c9dd7df0e14" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 23:26:46 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Acquired lock "refresh_cache-43f31110-89ec-4b20-9842-7c9dd7df0e14" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 23:26:46 user nova-compute[75045]: DEBUG nova.network.neutron [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] [instance: 43f31110-89ec-4b20-9842-7c9dd7df0e14] Forcefully refreshing network info cache for instance {{(pid=75045) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 23:26:47 user nova-compute[75045]: DEBUG nova.network.neutron [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] [instance: 43f31110-89ec-4b20-9842-7c9dd7df0e14] Updating instance_info_cache with network_info: [{"id": "509a96ec-b573-4408-bf93-87bccca95836", "address": "fa:16:3e:db:57:7b", "network": {"id": "2f33d93d-98ec-4b87-a0c0-efe2d2ac8f6d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-719527911-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.162", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7eff4be777d24514be52868961bf7a25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap509a96ec-b5", "ovs_interfaceid": "509a96ec-b573-4408-bf93-87bccca95836", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75045) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 23:26:47 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Releasing lock "refresh_cache-43f31110-89ec-4b20-9842-7c9dd7df0e14" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 23:26:47 user nova-compute[75045]: DEBUG nova.compute.manager [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] [instance: 43f31110-89ec-4b20-9842-7c9dd7df0e14] Updated the network info_cache for instance {{(pid=75045) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 23:26:47 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:26:47 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:26:47 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:26:48 user nova-compute[75045]: DEBUG nova.compute.manager [None req-983f54e4-af2a-426c-b077-2982885c924e tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] [instance: fa67b237-f598-4111-87ba-d761aa50d95e] Checking state {{(pid=75045) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 23:26:48 user nova-compute[75045]: INFO nova.compute.manager [None req-983f54e4-af2a-426c-b077-2982885c924e tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] [instance: fa67b237-f598-4111-87ba-d761aa50d95e] instance snapshotting
Nov 08 23:26:48 user nova-compute[75045]: INFO nova.virt.libvirt.driver [None req-983f54e4-af2a-426c-b077-2982885c924e tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] [instance: fa67b237-f598-4111-87ba-d761aa50d95e] Beginning live snapshot process
Nov 08 23:26:48 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-983f54e4-af2a-426c-b077-2982885c924e tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa67b237-f598-4111-87ba-d761aa50d95e/disk --force-share --output=json -f qcow2 {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:26:49 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-983f54e4-af2a-426c-b077-2982885c924e tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa67b237-f598-4111-87ba-d761aa50d95e/disk --force-share --output=json -f qcow2" returned: 0 in 0.184s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:26:49 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-983f54e4-af2a-426c-b077-2982885c924e tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa67b237-f598-4111-87ba-d761aa50d95e/disk --force-share --output=json -f qcow2 {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:26:49 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-983f54e4-af2a-426c-b077-2982885c924e tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa67b237-f598-4111-87ba-d761aa50d95e/disk --force-share --output=json -f qcow2" returned: 0 in 0.175s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:26:49 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-983f54e4-af2a-426c-b077-2982885c924e tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b59f52a99fff51c56dd1edfb83892fb8f647f2f3 --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:26:49 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-983f54e4-af2a-426c-b077-2982885c924e tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b59f52a99fff51c56dd1edfb83892fb8f647f2f3 --force-share --output=json" returned: 0 in 0.176s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:26:49 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-983f54e4-af2a-426c-b077-2982885c924e tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b59f52a99fff51c56dd1edfb83892fb8f647f2f3,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpr871lu_l/6840a3b7f764473693d9b4d5ac86c990.delta 1073741824 {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:26:49 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:26:49 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-983f54e4-af2a-426c-b077-2982885c924e tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b59f52a99fff51c56dd1edfb83892fb8f647f2f3,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpr871lu_l/6840a3b7f764473693d9b4d5ac86c990.delta 1073741824" returned: 0 in 0.049s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:26:49 user nova-compute[75045]: INFO nova.virt.libvirt.driver [None req-983f54e4-af2a-426c-b077-2982885c924e tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] [instance: fa67b237-f598-4111-87ba-d761aa50d95e] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 08 23:26:50 user nova-compute[75045]: DEBUG nova.virt.libvirt.guest [None req-983f54e4-af2a-426c-b077-2982885c924e tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=75045) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 08 23:26:50 user nova-compute[75045]: WARNING nova.virt.libvirt.driver [None req-69512031-f2d2-4bfb-8e15-dc20a249a093 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 43f31110-89ec-4b20-9842-7c9dd7df0e14 is timed out.
Nov 08 23:26:50 user nova-compute[75045]: INFO nova.virt.libvirt.driver [None req-69512031-f2d2-4bfb-8e15-dc20a249a093 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Successfully detached device vdb from instance 43f31110-89ec-4b20-9842-7c9dd7df0e14 from the live domain config.
Nov 08 23:26:50 user nova-compute[75045]: DEBUG nova.virt.libvirt.volume.iscsi [None req-69512031-f2d2-4bfb-8e15-dc20a249a093 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] [instance: 43f31110-89ec-4b20-9842-7c9dd7df0e14] calling os-brick to detach iSCSI Volume {{(pid=75045) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 23:26:50 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-69512031-f2d2-4bfb-8e15-dc20a249a093 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1b68210460>, {'target_iqn': 'iqn.2010-10.org.openstack:cd1b2206-989e-409d-84c6-49b37ac252d8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pHMZXvYa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75045) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 23:26:50 user nova-compute[75045]: WARNING os_brick.initiator.connectors.base [None req-69512031-f2d2-4bfb-8e15-dc20a249a093 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 23:26:50 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-69512031-f2d2-4bfb-8e15-dc20a249a093 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 23:26:50 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-69512031-f2d2-4bfb-8e15-dc20a249a093 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 23:26:50 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:26:50 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:26:50 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[14392f7b-0c5c-4258-a07c-3b9fea3074e4]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:cd1b2206-989e-409d-84c6-49b37ac252d8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9c37da13-9531-458a-87cb-1e86e6b84f3a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d2e734fa-1dcb-4510-a50e-064e29c2985e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:26:50 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-69512031-f2d2-4bfb-8e15-dc20a249a093 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 23:26:50 user nova-compute[75045]: No targets found.
Nov 08 23:26:50 user nova-compute[75045]: iSNS:
Nov 08 23:26:50 user nova-compute[75045]: No targets found.
Nov 08 23:26:50 user nova-compute[75045]: STATIC:
Nov 08 23:26:50 user nova-compute[75045]: Target: iqn.2010-10.org.openstack:cd1b2206-989e-409d-84c6-49b37ac252d8
Nov 08 23:26:50 user nova-compute[75045]:         Portal: 172.16.0.220:3260,-1
Nov 08 23:26:50 user nova-compute[75045]:                 Iface Name: default
Nov 08 23:26:50 user nova-compute[75045]: Target: iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab
Nov 08 23:26:50 user nova-compute[75045]:         Portal: 172.16.0.220:3260,-1
Nov 08 23:26:50 user nova-compute[75045]:                 Iface Name: default
Nov 08 23:26:50 user nova-compute[75045]: Target: iqn.2010-10.org.openstack:9c37da13-9531-458a-87cb-1e86e6b84f3a
Nov 08 23:26:50 user nova-compute[75045]:         Portal: 172.16.0.220:3260,-1
Nov 08 23:26:50 user nova-compute[75045]:                 Iface Name: default
Nov 08 23:26:50 user nova-compute[75045]: Target: iqn.2010-10.org.openstack:d2e734fa-1dcb-4510-a50e-064e29c2985e
Nov 08 23:26:50 user nova-compute[75045]:         Portal: 172.16.0.220:3260,-1
Nov 08 23:26:50 user nova-compute[75045]:                 Iface Name: default
Nov 08 23:26:50 user nova-compute[75045]: FIRMWARE:
Nov 08 23:26:50 user nova-compute[75045]: No targets found.
Nov 08 23:26:50 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 23:26:50 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-69512031-f2d2-4bfb-8e15-dc20a249a093 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 23:26:50 user nova-compute[75045]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 23:26:50 user nova-compute[75045]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75045) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 23:26:50 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-69512031-f2d2-4bfb-8e15-dc20a249a093 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cd1b2206-989e-409d-84c6-49b37ac252d8', 0)] {{(pid=75045) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 23:26:50 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:26:50 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:26:50 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0ea1dee-b5c1-4aa3-abbf-715542c05e4f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9c37da13-9531-458a-87cb-1e86e6b84f3a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cd1b2206-989e-409d-84c6-49b37ac252d8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d2e734fa-1dcb-4510-a50e-064e29c2985e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:26:50 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:26:50 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:26:50 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fe88766-873a-485f-91ee-66a2c9da24a3]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd1b2206-989e-409d-84c6-49b37ac252d8 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c37da13-9531-458a-87cb-1e86e6b84f3a (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2e734fa-1dcb-4510-a50e-064e29c2985e (non-flash)\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:26:50 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-69512031-f2d2-4bfb-8e15-dc20a249a093 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab (non-flash)
Nov 08 23:26:50 user nova-compute[75045]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd1b2206-989e-409d-84c6-49b37ac252d8 (non-flash)
Nov 08 23:26:50 user nova-compute[75045]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c37da13-9531-458a-87cb-1e86e6b84f3a (non-flash)
Nov 08 23:26:50 user nova-compute[75045]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2e734fa-1dcb-4510-a50e-064e29c2985e (non-flash)
Nov 08 23:26:50 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 23:26:50 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-69512031-f2d2-4bfb-8e15-dc20a249a093 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab (non-flash)
Nov 08 23:26:50 user nova-compute[75045]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd1b2206-989e-409d-84c6-49b37ac252d8 (non-flash)
Nov 08 23:26:50 user nova-compute[75045]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c37da13-9531-458a-87cb-1e86e6b84f3a (non-flash)
Nov 08 23:26:50 user nova-compute[75045]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2e734fa-1dcb-4510-a50e-064e29c2985e (non-flash)
Nov 08 23:26:50 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 23:26:50 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-69512031-f2d2-4bfb-8e15-dc20a249a093 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1b4848c160>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cd1b2206-989e-409d-84c6-49b37ac252d8'): ({'sdb'}, set())}) {{(pid=75045) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 23:26:50 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-69512031-f2d2-4bfb-8e15-dc20a249a093 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Removing single pathed devices sdb {{(pid=75045) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 23:26:50 user nova-compute[75045]: DEBUG nova.virt.libvirt.guest [None req-983f54e4-af2a-426c-b077-2982885c924e tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=75045) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 08 23:26:50 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:26:50 user nova-compute[75045]: INFO nova.virt.libvirt.driver [None req-983f54e4-af2a-426c-b077-2982885c924e tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] [instance: fa67b237-f598-4111-87ba-d761aa50d95e] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 08 23:26:50 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:26:50 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[0902721d-6980-411d-ba8a-f0b7b99fec6f]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:26:50 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:26:50 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:26:50 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[2aa791e1-ff9e-43a7-9c5b-dbe9e562d11c]: (4, ('ok\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:26:50 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-69512031-f2d2-4bfb-8e15-dc20a249a093 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Flushing IO for device /dev/sdb {{(pid=75045) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 23:26:50 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:26:50 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:26:50 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc60b30c-bfd7-4c78-9aef-89cfd534f4aa]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:26:50 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-69512031-f2d2-4bfb-8e15-dc20a249a093 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75045) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 23:26:50 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:26:50 user nova-compute[75045]: DEBUG nova.privsep.utils [None req-983f54e4-af2a-426c-b077-2982885c924e tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75045) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 08 23:26:50 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-983f54e4-af2a-426c-b077-2982885c924e tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpr871lu_l/6840a3b7f764473693d9b4d5ac86c990.delta /opt/stack/data/nova/instances/snapshots/tmpr871lu_l/6840a3b7f764473693d9b4d5ac86c990 {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:26:50 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.044s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:26:50 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[46a39c08-652a-4320-a226-bbf9790996a2]: (4, ('1', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:26:50 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-69512031-f2d2-4bfb-8e15-dc20a249a093 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75045) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 23:26:50 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-69512031-f2d2-4bfb-8e15-dc20a249a093 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] SCSI volumes sdb have been removed. {{(pid=75045) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 23:26:50 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-69512031-f2d2-4bfb-8e15-dc20a249a093 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cd1b2206-989e-409d-84c6-49b37ac252d8')] {{(pid=75045) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 23:26:50 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cd1b2206-989e-409d-84c6-49b37ac252d8 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:26:50 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cd1b2206-989e-409d-84c6-49b37ac252d8 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:26:50 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[f766f784-43d8-4b9a-a418-98837bfac82b]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:26:50 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-69512031-f2d2-4bfb-8e15-dc20a249a093 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:26:50 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:26:50 user nova-compute[75045]: DEBUG nova.compute.manager [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Cleaning up deleted instances {{(pid=75045) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 08 23:26:50 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cd1b2206-989e-409d-84c6-49b37ac252d8 -p 172.16.0.220:3260 --logout {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:26:50 user nova-compute[75045]: DEBUG nova.compute.manager [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] There are 0 instances to clean {{(pid=75045) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 08 23:26:51 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cd1b2206-989e-409d-84c6-49b37ac252d8 -p 172.16.0.220:3260 --logout" returned: 0 in 0.077s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:26:51 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[d06a4b0e-32cb-4980-b66f-770fe66fc418]: (4, ('Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:cd1b2206-989e-409d-84c6-49b37ac252d8, portal: 172.16.0.220,3260]\nLogout of [sid: 17, target: iqn.2010-10.org.openstack:cd1b2206-989e-409d-84c6-49b37ac252d8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:26:51 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-69512031-f2d2-4bfb-8e15-dc20a249a093 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:cd1b2206-989e-409d-84c6-49b37ac252d8, portal: 172.16.0.220,3260]
Nov 08 23:26:51 user nova-compute[75045]: Logout of [sid: 17, target: iqn.2010-10.org.openstack:cd1b2206-989e-409d-84c6-49b37ac252d8, portal: 172.16.0.220,3260] successful.
Nov 08 23:26:51 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:26:51 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cd1b2206-989e-409d-84c6-49b37ac252d8 -p 172.16.0.220:3260 --op delete {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:26:51 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cd1b2206-989e-409d-84c6-49b37ac252d8 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.036s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:26:51 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[fede4311-485e-4305-aba2-7f5a257543d8]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:26:51 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-69512031-f2d2-4bfb-8e15-dc20a249a093 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:26:51 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-69512031-f2d2-4bfb-8e15-dc20a249a093 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.397s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 23:26:51 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-69512031-f2d2-4bfb-8e15-dc20a249a093 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] <== disconnect_volume: return (401ms) None {{(pid=75045) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 23:26:51 user nova-compute[75045]: DEBUG nova.virt.libvirt.volume.iscsi [None req-69512031-f2d2-4bfb-8e15-dc20a249a093 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] [instance: 43f31110-89ec-4b20-9842-7c9dd7df0e14] Disconnected iSCSI Volume {{(pid=75045) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 23:26:51 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:26:51 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-983f54e4-af2a-426c-b077-2982885c924e tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpr871lu_l/6840a3b7f764473693d9b4d5ac86c990.delta /opt/stack/data/nova/instances/snapshots/tmpr871lu_l/6840a3b7f764473693d9b4d5ac86c990" returned: 0 in 0.421s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:26:51 user nova-compute[75045]: INFO nova.virt.libvirt.driver [None req-983f54e4-af2a-426c-b077-2982885c924e tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] [instance: fa67b237-f598-4111-87ba-d761aa50d95e] Snapshot extracted, beginning image upload
Nov 08 23:26:51 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-55671725-cabc-42f6-b791-699dfac90390 tempest-ServerActionsV293TestJSON-1645081958 tempest-ServerActionsV293TestJSON-1645081958-project-member] [instance: 667d20c3-3eda-4aa5-b799-6dcee3443833] Creating instance directory {{(pid=75045) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 23:26:51 user nova-compute[75045]: INFO nova.virt.libvirt.driver [None req-55671725-cabc-42f6-b791-699dfac90390 tempest-ServerActionsV293TestJSON-1645081958 tempest-ServerActionsV293TestJSON-1645081958-project-member] [instance: 667d20c3-3eda-4aa5-b799-6dcee3443833] Creating image(s)
Nov 08 23:26:51 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-55671725-cabc-42f6-b791-699dfac90390 tempest-ServerActionsV293TestJSON-1645081958 tempest-ServerActionsV293TestJSON-1645081958-project-member] [instance: 667d20c3-3eda-4aa5-b799-6dcee3443833] Did not create local disks {{(pid=75045) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 08 23:26:51 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-55671725-cabc-42f6-b791-699dfac90390 tempest-ServerActionsV293TestJSON-1645081958 tempest-ServerActionsV293TestJSON-1645081958-project-member] [instance: 667d20c3-3eda-4aa5-b799-6dcee3443833] Ensure instance console log exists: /opt/stack/data/nova/instances/667d20c3-3eda-4aa5-b799-6dcee3443833/console.log {{(pid=75045) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 23:26:51 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-55671725-cabc-42f6-b791-699dfac90390 tempest-ServerActionsV293TestJSON-1645081958 tempest-ServerActionsV293TestJSON-1645081958-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:26:51 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-55671725-cabc-42f6-b791-699dfac90390 tempest-ServerActionsV293TestJSON-1645081958 tempest-ServerActionsV293TestJSON-1645081958-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:26:51 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-55671725-cabc-42f6-b791-699dfac90390 tempest-ServerActionsV293TestJSON-1645081958 tempest-ServerActionsV293TestJSON-1645081958-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:26:51 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-55671725-cabc-42f6-b791-699dfac90390 tempest-ServerActionsV293TestJSON-1645081958 tempest-ServerActionsV293TestJSON-1645081958-project-member] [instance: 667d20c3-3eda-4aa5-b799-6dcee3443833] Start _get_guest_xml network_info=[{"id": "0d5e497c-3168-46b1-9094-9bb54737cc0f", "address": "fa:16:3e:80:07:f1", "network": {"id": "22898442-b87a-4538-a8f5-fe275919f44a", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-665667609-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.146", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "89744dd7de584b14880bc42dd96933af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d5e497c-31", "ovs_interfaceid": "0d5e497c-3168-46b1-9094-9bb54737cc0f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T23:11:54Z,direct_url=<?>,disk_format='qcow2',id=a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b1beba2cc4e7465ea249e2225fb494dc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T23:11:56Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': True, 'device_type': 'disk', 'attachment_id': 'b11171e1-9ecf-4ebf-a802-18158bc3d931', 'guest_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:04d02c98-d058-49d8-a350-ab9e63003d6e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uVoSDJjd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '667d20c3-3eda-4aa5-b799-6dcee3443833', 'attached_at': '', 'detached_at': '', 'volume_id': '04d02c98-d058-49d8-a350-ab9e63003d6e', 'serial': '04d02c98-d058-49d8-a350-ab9e63003d6e'}, 'volume_type': None} {{(pid=75045) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 23:26:51 user nova-compute[75045]: WARNING nova.virt.libvirt.driver [None req-55671725-cabc-42f6-b791-699dfac90390 tempest-ServerActionsV293TestJSON-1645081958 tempest-ServerActionsV293TestJSON-1645081958-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 08 23:26:51 user nova-compute[75045]: WARNING nova.virt.libvirt.driver [None req-55671725-cabc-42f6-b791-699dfac90390 tempest-ServerActionsV293TestJSON-1645081958 tempest-ServerActionsV293TestJSON-1645081958-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 08 23:26:51 user nova-compute[75045]: DEBUG nova.virt.libvirt.host [None req-55671725-cabc-42f6-b791-699dfac90390 tempest-ServerActionsV293TestJSON-1645081958 tempest-ServerActionsV293TestJSON-1645081958-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75045) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 23:26:51 user nova-compute[75045]: DEBUG nova.virt.libvirt.host [None req-55671725-cabc-42f6-b791-699dfac90390 tempest-ServerActionsV293TestJSON-1645081958 tempest-ServerActionsV293TestJSON-1645081958-project-member] CPU controller missing on host. {{(pid=75045) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 23:26:51 user nova-compute[75045]: DEBUG nova.virt.libvirt.host [None req-55671725-cabc-42f6-b791-699dfac90390 tempest-ServerActionsV293TestJSON-1645081958 tempest-ServerActionsV293TestJSON-1645081958-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75045) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 23:26:51 user nova-compute[75045]: DEBUG nova.virt.libvirt.host [None req-55671725-cabc-42f6-b791-699dfac90390 tempest-ServerActionsV293TestJSON-1645081958 tempest-ServerActionsV293TestJSON-1645081958-project-member] CPU controller found on host. {{(pid=75045) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 23:26:51 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-55671725-cabc-42f6-b791-699dfac90390 tempest-ServerActionsV293TestJSON-1645081958 tempest-ServerActionsV293TestJSON-1645081958-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75045) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 23:26:51 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-55671725-cabc-42f6-b791-699dfac90390 tempest-ServerActionsV293TestJSON-1645081958 tempest-ServerActionsV293TestJSON-1645081958-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T23:11:41Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T23:11:54Z,direct_url=<?>,disk_format='qcow2',id=a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b1beba2cc4e7465ea249e2225fb494dc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T23:11:56Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75045) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 23:26:51 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-55671725-cabc-42f6-b791-699dfac90390 tempest-ServerActionsV293TestJSON-1645081958 tempest-ServerActionsV293TestJSON-1645081958-project-member] Flavor limits 0:0:0 {{(pid=75045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 23:26:51 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-55671725-cabc-42f6-b791-699dfac90390 tempest-ServerActionsV293TestJSON-1645081958 tempest-ServerActionsV293TestJSON-1645081958-project-member] Image limits 0:0:0 {{(pid=75045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 23:26:51 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-55671725-cabc-42f6-b791-699dfac90390 tempest-ServerActionsV293TestJSON-1645081958 tempest-ServerActionsV293TestJSON-1645081958-project-member] Flavor pref 0:0:0 {{(pid=75045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 23:26:51 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-55671725-cabc-42f6-b791-699dfac90390 tempest-ServerActionsV293TestJSON-1645081958 tempest-ServerActionsV293TestJSON-1645081958-project-member] Image pref 0:0:0 {{(pid=75045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 23:26:51 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-55671725-cabc-42f6-b791-699dfac90390 tempest-ServerActionsV293TestJSON-1645081958 tempest-ServerActionsV293TestJSON-1645081958-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 23:26:51 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-55671725-cabc-42f6-b791-699dfac90390 tempest-ServerActionsV293TestJSON-1645081958 tempest-ServerActionsV293TestJSON-1645081958-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75045) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 23:26:51 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-55671725-cabc-42f6-b791-699dfac90390 tempest-ServerActionsV293TestJSON-1645081958 tempest-ServerActionsV293TestJSON-1645081958-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75045) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 23:26:51 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-55671725-cabc-42f6-b791-699dfac90390 tempest-ServerActionsV293TestJSON-1645081958 tempest-ServerActionsV293TestJSON-1645081958-project-member] Got 1 possible topologies {{(pid=75045) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 23:26:51 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-55671725-cabc-42f6-b791-699dfac90390 tempest-ServerActionsV293TestJSON-1645081958 tempest-ServerActionsV293TestJSON-1645081958-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75045) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 23:26:51 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-55671725-cabc-42f6-b791-699dfac90390 tempest-ServerActionsV293TestJSON-1645081958 tempest-ServerActionsV293TestJSON-1645081958-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75045) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 23:26:51 user nova-compute[75045]: DEBUG nova.objects.instance [None req-55671725-cabc-42f6-b791-699dfac90390 tempest-ServerActionsV293TestJSON-1645081958 tempest-ServerActionsV293TestJSON-1645081958-project-member] Lazy-loading 'vcpu_model' on Instance uuid 667d20c3-3eda-4aa5-b799-6dcee3443833 {{(pid=75045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 23:26:51 user nova-compute[75045]: DEBUG nova.virt.libvirt.volume.iscsi [None req-55671725-cabc-42f6-b791-699dfac90390 tempest-ServerActionsV293TestJSON-1645081958 tempest-ServerActionsV293TestJSON-1645081958-project-member] [instance: 667d20c3-3eda-4aa5-b799-6dcee3443833] Calling os-brick to attach iSCSI Volume {{(pid=75045) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 23:26:51 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-55671725-cabc-42f6-b791-699dfac90390 tempest-ServerActionsV293TestJSON-1645081958 tempest-ServerActionsV293TestJSON-1645081958-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1b68210460>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:04d02c98-d058-49d8-a350-ab9e63003d6e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uVoSDJjd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75045) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 23:26:51 user nova-compute[75045]: WARNING os_brick.initiator.connectors.base [None req-55671725-cabc-42f6-b791-699dfac90390 tempest-ServerActionsV293TestJSON-1645081958 tempest-ServerActionsV293TestJSON-1645081958-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 08 23:26:51 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-55671725-cabc-42f6-b791-699dfac90390 tempest-ServerActionsV293TestJSON-1645081958 tempest-ServerActionsV293TestJSON-1645081958-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 23:26:51 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-55671725-cabc-42f6-b791-699dfac90390 tempest-ServerActionsV293TestJSON-1645081958 tempest-ServerActionsV293TestJSON-1645081958-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 23:26:51 user nova-compute[75045]: WARNING os_brick.initiator.connectors.base [None req-55671725-cabc-42f6-b791-699dfac90390 tempest-ServerActionsV293TestJSON-1645081958 tempest-ServerActionsV293TestJSON-1645081958-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 08 23:26:51 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-55671725-cabc-42f6-b791-699dfac90390 tempest-ServerActionsV293TestJSON-1645081958 tempest-ServerActionsV293TestJSON-1645081958-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:04d02c98-d058-49d8-a350-ab9e63003d6e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 23:26:51 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-55671725-cabc-42f6-b791-699dfac90390 tempest-ServerActionsV293TestJSON-1645081958 tempest-ServerActionsV293TestJSON-1645081958-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:04d02c98-d058-49d8-a350-ab9e63003d6e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 23:26:51 user nova-compute[75045]: INFO os_brick.initiator.connectors.iscsi [None req-55671725-cabc-42f6-b791-699dfac90390 tempest-ServerActionsV293TestJSON-1645081958 tempest-ServerActionsV293TestJSON-1645081958-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 23:26:51 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04d02c98-d058-49d8-a350-ab9e63003d6e -p 172.16.0.220:3260 {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:26:51 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04d02c98-d058-49d8-a350-ab9e63003d6e -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:26:51 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[085ddbe3-3f79-47c4-ac5a-e5bef04d9902]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:26:51 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-55671725-cabc-42f6-b791-699dfac90390 tempest-ServerActionsV293TestJSON-1645081958 tempest-ServerActionsV293TestJSON-1645081958-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 23:26:51 user nova-compute[75045]:  {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:26:51 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04d02c98-d058-49d8-a350-ab9e63003d6e -p 172.16.0.220:3260 --interface default --op new {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:26:51 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04d02c98-d058-49d8-a350-ab9e63003d6e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:26:51 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[88367e36-6450-4f6b-bbc4-e8790a46c962]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:04d02c98-d058-49d8-a350-ab9e63003d6e] added\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:26:51 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-55671725-cabc-42f6-b791-699dfac90390 tempest-ServerActionsV293TestJSON-1645081958 tempest-ServerActionsV293TestJSON-1645081958-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:04d02c98-d058-49d8-a350-ab9e63003d6e] added
Nov 08 23:26:51 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:26:51 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04d02c98-d058-49d8-a350-ab9e63003d6e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:26:51 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04d02c98-d058-49d8-a350-ab9e63003d6e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:26:51 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[44e98d8e-5900-4b01-a8f6-d02ae9a44f65]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:26:51 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-55671725-cabc-42f6-b791-699dfac90390 tempest-ServerActionsV293TestJSON-1645081958 tempest-ServerActionsV293TestJSON-1645081958-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:26:51 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04d02c98-d058-49d8-a350-ab9e63003d6e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:26:51 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04d02c98-d058-49d8-a350-ab9e63003d6e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:26:51 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cf87155-23c7-4c8b-a05f-b7d9ffa25c47]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:26:51 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-55671725-cabc-42f6-b791-699dfac90390 tempest-ServerActionsV293TestJSON-1645081958 tempest-ServerActionsV293TestJSON-1645081958-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:26:51 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04d02c98-d058-49d8-a350-ab9e63003d6e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uVoSDJjd {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:26:51 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04d02c98-d058-49d8-a350-ab9e63003d6e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uVoSDJjd" returned: 0 in 0.018s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:26:51 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[4609a7e6-741c-48d8-8a01-540fb71fa6f2]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:26:51 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-55671725-cabc-42f6-b791-699dfac90390 tempest-ServerActionsV293TestJSON-1645081958 tempest-ServerActionsV293TestJSON-1645081958-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'uVoSDJjd'): stdout= stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:26:51 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04d02c98-d058-49d8-a350-ab9e63003d6e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:26:51 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04d02c98-d058-49d8-a350-ab9e63003d6e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:26:51 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[db69fc9a-8fe4-46d1-a391-035872631188]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:26:51 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-55671725-cabc-42f6-b791-699dfac90390 tempest-ServerActionsV293TestJSON-1645081958 tempest-ServerActionsV293TestJSON-1645081958-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:26:51 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:26:51 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:26:51 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d4d1989-7d47-4b3c-bd6a-3d72d97b21c3]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c37da13-9531-458a-87cb-1e86e6b84f3a (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2e734fa-1dcb-4510-a50e-064e29c2985e (non-flash)\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:26:51 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-55671725-cabc-42f6-b791-699dfac90390 tempest-ServerActionsV293TestJSON-1645081958 tempest-ServerActionsV293TestJSON-1645081958-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab (non-flash)
Nov 08 23:26:51 user nova-compute[75045]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c37da13-9531-458a-87cb-1e86e6b84f3a (non-flash)
Nov 08 23:26:51 user nova-compute[75045]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2e734fa-1dcb-4510-a50e-064e29c2985e (non-flash)
Nov 08 23:26:51 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 23:26:51 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-55671725-cabc-42f6-b791-699dfac90390 tempest-ServerActionsV293TestJSON-1645081958 tempest-ServerActionsV293TestJSON-1645081958-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab (non-flash)
Nov 08 23:26:51 user nova-compute[75045]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c37da13-9531-458a-87cb-1e86e6b84f3a (non-flash)
Nov 08 23:26:51 user nova-compute[75045]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2e734fa-1dcb-4510-a50e-064e29c2985e (non-flash)
Nov 08 23:26:51 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 23:26:51 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04d02c98-d058-49d8-a350-ab9e63003d6e -p 172.16.0.220:3260 --login {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:26:51 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04d02c98-d058-49d8-a350-ab9e63003d6e -p 172.16.0.220:3260 --login" returned: 0 in 0.070s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:26:51 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[10fd986d-c943-4739-b277-522e806ca469]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:04d02c98-d058-49d8-a350-ab9e63003d6e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:04d02c98-d058-49d8-a350-ab9e63003d6e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:26:51 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-55671725-cabc-42f6-b791-699dfac90390 tempest-ServerActionsV293TestJSON-1645081958 tempest-ServerActionsV293TestJSON-1645081958-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:04d02c98-d058-49d8-a350-ab9e63003d6e, portal: 172.16.0.220,3260]
Nov 08 23:26:51 user nova-compute[75045]: Login to [iface: default, target: iqn.2010-10.org.openstack:04d02c98-d058-49d8-a350-ab9e63003d6e, portal: 172.16.0.220,3260] successful.
Nov 08 23:26:51 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:26:51 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04d02c98-d058-49d8-a350-ab9e63003d6e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:26:52 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04d02c98-d058-49d8-a350-ab9e63003d6e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.027s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:26:52 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0e294af-7859-4b98-bcbf-0965ac09c824]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:26:52 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-55671725-cabc-42f6-b791-699dfac90390 tempest-ServerActionsV293TestJSON-1645081958 tempest-ServerActionsV293TestJSON-1645081958-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:26:52 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:26:52 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:26:52 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e91f898-07be-4da9-8aa3-2bc016002e96]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c37da13-9531-458a-87cb-1e86e6b84f3a (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2e734fa-1dcb-4510-a50e-064e29c2985e (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04d02c98-d058-49d8-a350-ab9e63003d6e (non-flash)\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:26:52 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-55671725-cabc-42f6-b791-699dfac90390 tempest-ServerActionsV293TestJSON-1645081958 tempest-ServerActionsV293TestJSON-1645081958-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab (non-flash)
Nov 08 23:26:52 user nova-compute[75045]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c37da13-9531-458a-87cb-1e86e6b84f3a (non-flash)
Nov 08 23:26:52 user nova-compute[75045]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2e734fa-1dcb-4510-a50e-064e29c2985e (non-flash)
Nov 08 23:26:52 user nova-compute[75045]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04d02c98-d058-49d8-a350-ab9e63003d6e (non-flash)
Nov 08 23:26:52 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 23:26:52 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-55671725-cabc-42f6-b791-699dfac90390 tempest-ServerActionsV293TestJSON-1645081958 tempest-ServerActionsV293TestJSON-1645081958-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab (non-flash)
Nov 08 23:26:52 user nova-compute[75045]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c37da13-9531-458a-87cb-1e86e6b84f3a (non-flash)
Nov 08 23:26:52 user nova-compute[75045]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2e734fa-1dcb-4510-a50e-064e29c2985e (non-flash)
Nov 08 23:26:52 user nova-compute[75045]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04d02c98-d058-49d8-a350-ab9e63003d6e (non-flash)
Nov 08 23:26:52 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 23:26:52 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-55671725-cabc-42f6-b791-699dfac90390 tempest-ServerActionsV293TestJSON-1645081958 tempest-ServerActionsV293TestJSON-1645081958-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:04d02c98-d058-49d8-a350-ab9e63003d6e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.299s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 23:26:52 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-55671725-cabc-42f6-b791-699dfac90390 tempest-ServerActionsV293TestJSON-1645081958 tempest-ServerActionsV293TestJSON-1645081958-project-member] Connected to 172.16.0.220:3260 {{(pid=75045) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 23:26:52 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-55671725-cabc-42f6-b791-699dfac90390 tempest-ServerActionsV293TestJSON-1645081958 tempest-ServerActionsV293TestJSON-1645081958-project-member] HCTL ('33', '-', '-', 0) found on session 24 with lun 0 {{(pid=75045) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 23:26:52 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-55671725-cabc-42f6-b791-699dfac90390 tempest-ServerActionsV293TestJSON-1645081958 tempest-ServerActionsV293TestJSON-1645081958-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75045) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 23:26:52 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:26:52 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.022s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:26:52 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb4411d9-dd32-4d64-9f4b-6791275d9558]: (4, ('- - 0', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:26:52 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-55671725-cabc-42f6-b791-699dfac90390 tempest-ServerActionsV293TestJSON-1645081958 tempest-ServerActionsV293TestJSON-1645081958-project-member] Searching for a device in session 24 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75045) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 23:26:52 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-55671725-cabc-42f6-b791-699dfac90390 tempest-ServerActionsV293TestJSON-1645081958 tempest-ServerActionsV293TestJSON-1645081958-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:04d02c98-d058-49d8-a350-ab9e63003d6e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uVoSDJjd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75045) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 23:26:52 user nova-compute[75045]: DEBUG nova.objects.instance [None req-69512031-f2d2-4bfb-8e15-dc20a249a093 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Lazy-loading 'flavor' on Instance uuid 43f31110-89ec-4b20-9842-7c9dd7df0e14 {{(pid=75045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 23:26:52 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-69512031-f2d2-4bfb-8e15-dc20a249a093 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Lock "43f31110-89ec-4b20-9842-7c9dd7df0e14" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.140s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:26:53 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-55671725-cabc-42f6-b791-699dfac90390 tempest-ServerActionsV293TestJSON-1645081958 tempest-ServerActionsV293TestJSON-1645081958-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.343s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 23:26:53 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-55671725-cabc-42f6-b791-699dfac90390 tempest-ServerActionsV293TestJSON-1645081958 tempest-ServerActionsV293TestJSON-1645081958-project-member] <== connect_volume: return (1345ms) {'type': 'block', 'scsi_wwn': '26530623965343832', 'path': '/dev/sdb'} {{(pid=75045) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 23:26:53 user nova-compute[75045]: DEBUG nova.virt.libvirt.volume.iscsi [None req-55671725-cabc-42f6-b791-699dfac90390 tempest-ServerActionsV293TestJSON-1645081958 tempest-ServerActionsV293TestJSON-1645081958-project-member] [instance: 667d20c3-3eda-4aa5-b799-6dcee3443833] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26530623965343832', 'path': '/dev/sdb'} {{(pid=75045) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 23:26:53 user nova-compute[75045]: DEBUG nova.virt.libvirt.vif [None req-55671725-cabc-42f6-b791-699dfac90390 tempest-ServerActionsV293TestJSON-1645081958 tempest-ServerActionsV293TestJSON-1645081958-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-08T23:23:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-374447582',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-621912130',id=22,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBApsXoUUj600/jCowZP3//u29Ov5MwB7tYSt8EjtngLjlaZqqKZXWg1HuFDyt4rHiDuYq2TVJTqipV6mcSPV0LYib38MErT/yLzsrNv4x3AUTFC5kAU2nRDHPtRbpYSQ9w==',key_name='tempest-keypair-471552763',keypairs=<?>,launch_index=0,launched_at=2023-11-08T23:24:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='89744dd7de584b14880bc42dd96933af',ramdisk_id='',reservation_id='r-iwtkqj0a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1645081958',owner_user_name='tempest-ServerActionsV293TestJSON-1645081958-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T23:26:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fc0a769ab72a476c9ac620728d67c5b6',uuid=667d20c3-3eda-4aa5-b799-6dcee3443833,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0d5e497c-3168-46b1-9094-9bb54737cc0f", "address": "fa:16:3e:80:07:f1", "network": {"id": "22898442-b87a-4538-a8f5-fe275919f44a", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-665667609-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.146", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "89744dd7de584b14880bc42dd96933af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d5e497c-31", "ovs_interfaceid": "0d5e497c-3168-46b1-9094-9bb54737cc0f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75045) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 23:26:53 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-55671725-cabc-42f6-b791-699dfac90390 tempest-ServerActionsV293TestJSON-1645081958 tempest-ServerActionsV293TestJSON-1645081958-project-member] Converting VIF {"id": "0d5e497c-3168-46b1-9094-9bb54737cc0f", "address": "fa:16:3e:80:07:f1", "network": {"id": "22898442-b87a-4538-a8f5-fe275919f44a", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-665667609-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.146", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "89744dd7de584b14880bc42dd96933af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d5e497c-31", "ovs_interfaceid": "0d5e497c-3168-46b1-9094-9bb54737cc0f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 23:26:53 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-55671725-cabc-42f6-b791-699dfac90390 tempest-ServerActionsV293TestJSON-1645081958 tempest-ServerActionsV293TestJSON-1645081958-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:80:07:f1,bridge_name='br-int',has_traffic_filtering=True,id=0d5e497c-3168-46b1-9094-9bb54737cc0f,network=Network(22898442-b87a-4538-a8f5-fe275919f44a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0d5e497c-31') {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 23:26:53 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-55671725-cabc-42f6-b791-699dfac90390 tempest-ServerActionsV293TestJSON-1645081958 tempest-ServerActionsV293TestJSON-1645081958-project-member] [instance: 667d20c3-3eda-4aa5-b799-6dcee3443833] End _get_guest_xml xml=<domain type="kvm">
Nov 08 23:26:53 user nova-compute[75045]:   <uuid>667d20c3-3eda-4aa5-b799-6dcee3443833</uuid>
Nov 08 23:26:53 user nova-compute[75045]:   <name>instance-00000016</name>
Nov 08 23:26:53 user nova-compute[75045]:   <memory>524288</memory>
Nov 08 23:26:53 user nova-compute[75045]:   <vcpu>1</vcpu>
Nov 08 23:26:53 user nova-compute[75045]:   <metadata>
Nov 08 23:26:53 user nova-compute[75045]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 23:26:53 user nova-compute[75045]:       <nova:package version="0.0.0"/>
Nov 08 23:26:53 user nova-compute[75045]:       <nova:name>tempest-ServerActionsV293TestJSON-server-374447582</nova:name>
Nov 08 23:26:53 user nova-compute[75045]:       <nova:creationTime>2023-11-08 23:26:51</nova:creationTime>
Nov 08 23:26:53 user nova-compute[75045]:       <nova:flavor name="m1.tiny">
Nov 08 23:26:53 user nova-compute[75045]:         <nova:memory>512</nova:memory>
Nov 08 23:26:53 user nova-compute[75045]:         <nova:disk>1</nova:disk>
Nov 08 23:26:53 user nova-compute[75045]:         <nova:swap>0</nova:swap>
Nov 08 23:26:53 user nova-compute[75045]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 23:26:53 user nova-compute[75045]:         <nova:vcpus>1</nova:vcpus>
Nov 08 23:26:53 user nova-compute[75045]:       </nova:flavor>
Nov 08 23:26:53 user nova-compute[75045]:       <nova:owner>
Nov 08 23:26:53 user nova-compute[75045]:         <nova:user uuid="fc0a769ab72a476c9ac620728d67c5b6">tempest-ServerActionsV293TestJSON-1645081958-project-member</nova:user>
Nov 08 23:26:53 user nova-compute[75045]:         <nova:project uuid="89744dd7de584b14880bc42dd96933af">tempest-ServerActionsV293TestJSON-1645081958</nova:project>
Nov 08 23:26:53 user nova-compute[75045]:       </nova:owner>
Nov 08 23:26:53 user nova-compute[75045]:       <nova:ports>
Nov 08 23:26:53 user nova-compute[75045]:         <nova:port uuid="0d5e497c-3168-46b1-9094-9bb54737cc0f">
Nov 08 23:26:53 user nova-compute[75045]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 08 23:26:53 user nova-compute[75045]:         </nova:port>
Nov 08 23:26:53 user nova-compute[75045]:       </nova:ports>
Nov 08 23:26:53 user nova-compute[75045]:     </nova:instance>
Nov 08 23:26:53 user nova-compute[75045]:   </metadata>
Nov 08 23:26:53 user nova-compute[75045]:   <sysinfo type="smbios">
Nov 08 23:26:53 user nova-compute[75045]:     <system>
Nov 08 23:26:53 user nova-compute[75045]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 23:26:53 user nova-compute[75045]:       <entry name="product">OpenStack Nova</entry>
Nov 08 23:26:53 user nova-compute[75045]:       <entry name="version">0.0.0</entry>
Nov 08 23:26:53 user nova-compute[75045]:       <entry name="serial">667d20c3-3eda-4aa5-b799-6dcee3443833</entry>
Nov 08 23:26:53 user nova-compute[75045]:       <entry name="uuid">667d20c3-3eda-4aa5-b799-6dcee3443833</entry>
Nov 08 23:26:53 user nova-compute[75045]:       <entry name="family">Virtual Machine</entry>
Nov 08 23:26:53 user nova-compute[75045]:     </system>
Nov 08 23:26:53 user nova-compute[75045]:   </sysinfo>
Nov 08 23:26:53 user nova-compute[75045]:   <os>
Nov 08 23:26:53 user nova-compute[75045]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 23:26:53 user nova-compute[75045]:     <boot dev="hd"/>
Nov 08 23:26:53 user nova-compute[75045]:     <smbios mode="sysinfo"/>
Nov 08 23:26:53 user nova-compute[75045]:   </os>
Nov 08 23:26:53 user nova-compute[75045]:   <features>
Nov 08 23:26:53 user nova-compute[75045]:     <acpi/>
Nov 08 23:26:53 user nova-compute[75045]:     <apic/>
Nov 08 23:26:53 user nova-compute[75045]:     <vmcoreinfo/>
Nov 08 23:26:53 user nova-compute[75045]:   </features>
Nov 08 23:26:53 user nova-compute[75045]:   <clock offset="utc">
Nov 08 23:26:53 user nova-compute[75045]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 23:26:53 user nova-compute[75045]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 23:26:53 user nova-compute[75045]:     <timer name="hpet" present="no"/>
Nov 08 23:26:53 user nova-compute[75045]:   </clock>
Nov 08 23:26:53 user nova-compute[75045]:   <cpu mode="custom" match="exact">
Nov 08 23:26:53 user nova-compute[75045]:     <model>Nehalem</model>
Nov 08 23:26:53 user nova-compute[75045]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 23:26:53 user nova-compute[75045]:   </cpu>
Nov 08 23:26:53 user nova-compute[75045]:   <devices>
Nov 08 23:26:53 user nova-compute[75045]:     <disk type="block" device="disk">
Nov 08 23:26:53 user nova-compute[75045]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 23:26:53 user nova-compute[75045]:       <source dev="/dev/sdb"/>
Nov 08 23:26:53 user nova-compute[75045]:       <target dev="vda" bus="virtio"/>
Nov 08 23:26:53 user nova-compute[75045]:       <serial>04d02c98-d058-49d8-a350-ab9e63003d6e</serial>
Nov 08 23:26:53 user nova-compute[75045]:     </disk>
Nov 08 23:26:53 user nova-compute[75045]:     <interface type="ethernet">
Nov 08 23:26:53 user nova-compute[75045]:       <mac address="fa:16:3e:80:07:f1"/>
Nov 08 23:26:53 user nova-compute[75045]:       <model type="virtio"/>
Nov 08 23:26:53 user nova-compute[75045]:       <mtu size="1442"/>
Nov 08 23:26:53 user nova-compute[75045]:       <target dev="tap0d5e497c-31"/>
Nov 08 23:26:53 user nova-compute[75045]:     </interface>
Nov 08 23:26:53 user nova-compute[75045]:     <serial type="pty">
Nov 08 23:26:53 user nova-compute[75045]:       <log file="/opt/stack/data/nova/instances/667d20c3-3eda-4aa5-b799-6dcee3443833/console.log" append="off"/>
Nov 08 23:26:53 user nova-compute[75045]:     </serial>
Nov 08 23:26:53 user nova-compute[75045]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 23:26:53 user nova-compute[75045]:     <video>
Nov 08 23:26:53 user nova-compute[75045]:       <model type="virtio"/>
Nov 08 23:26:53 user nova-compute[75045]:     </video>
Nov 08 23:26:53 user nova-compute[75045]:     <rng model="virtio">
Nov 08 23:26:53 user nova-compute[75045]:       <backend model="random">/dev/urandom</backend>
Nov 08 23:26:53 user nova-compute[75045]:     </rng>
Nov 08 23:26:53 user nova-compute[75045]:     <controller type="usb" index="0" model="none"/>
Nov 08 23:26:53 user nova-compute[75045]:     <memballoon model="virtio">
Nov 08 23:26:53 user nova-compute[75045]:       <stats period="10"/>
Nov 08 23:26:53 user nova-compute[75045]:     </memballoon>
Nov 08 23:26:53 user nova-compute[75045]:   </devices>
Nov 08 23:26:53 user nova-compute[75045]: </domain>
Nov 08 23:26:53 user nova-compute[75045]:  {{(pid=75045) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 23:26:53 user nova-compute[75045]: DEBUG nova.virt.libvirt.vif [None req-55671725-cabc-42f6-b791-699dfac90390 tempest-ServerActionsV293TestJSON-1645081958 tempest-ServerActionsV293TestJSON-1645081958-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-08T23:23:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-374447582',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-621912130',id=22,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBApsXoUUj600/jCowZP3//u29Ov5MwB7tYSt8EjtngLjlaZqqKZXWg1HuFDyt4rHiDuYq2TVJTqipV6mcSPV0LYib38MErT/yLzsrNv4x3AUTFC5kAU2nRDHPtRbpYSQ9w==',key_name='tempest-keypair-471552763',keypairs=<?>,launch_index=0,launched_at=2023-11-08T23:24:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='89744dd7de584b14880bc42dd96933af',ramdisk_id='',reservation_id='r-iwtkqj0a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1645081958',owner_user_name='tempest-ServerActionsV293TestJSON-1645081958-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T23:26:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fc0a769ab72a476c9ac620728d67c5b6',uuid=667d20c3-3eda-4aa5-b799-6dcee3443833,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0d5e497c-3168-46b1-9094-9bb54737cc0f", "address": "fa:16:3e:80:07:f1", "network": {"id": "22898442-b87a-4538-a8f5-fe275919f44a", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-665667609-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.146", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "89744dd7de584b14880bc42dd96933af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d5e497c-31", "ovs_interfaceid": "0d5e497c-3168-46b1-9094-9bb54737cc0f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75045) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 23:26:53 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-55671725-cabc-42f6-b791-699dfac90390 tempest-ServerActionsV293TestJSON-1645081958 tempest-ServerActionsV293TestJSON-1645081958-project-member] Converting VIF {"id": "0d5e497c-3168-46b1-9094-9bb54737cc0f", "address": "fa:16:3e:80:07:f1", "network": {"id": "22898442-b87a-4538-a8f5-fe275919f44a", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-665667609-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.146", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "89744dd7de584b14880bc42dd96933af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d5e497c-31", "ovs_interfaceid": "0d5e497c-3168-46b1-9094-9bb54737cc0f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 23:26:53 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-55671725-cabc-42f6-b791-699dfac90390 tempest-ServerActionsV293TestJSON-1645081958 tempest-ServerActionsV293TestJSON-1645081958-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:80:07:f1,bridge_name='br-int',has_traffic_filtering=True,id=0d5e497c-3168-46b1-9094-9bb54737cc0f,network=Network(22898442-b87a-4538-a8f5-fe275919f44a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0d5e497c-31') {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 23:26:53 user nova-compute[75045]: DEBUG os_vif [None req-55671725-cabc-42f6-b791-699dfac90390 tempest-ServerActionsV293TestJSON-1645081958 tempest-ServerActionsV293TestJSON-1645081958-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:80:07:f1,bridge_name='br-int',has_traffic_filtering=True,id=0d5e497c-3168-46b1-9094-9bb54737cc0f,network=Network(22898442-b87a-4538-a8f5-fe275919f44a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0d5e497c-31') {{(pid=75045) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 23:26:53 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:26:53 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:26:53 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 23:26:53 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:26:53 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c7652d4b-7f5e-5129-bf9f-d9342d4511e8', '_type': 'linux-noop'}}, row=False) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:26:53 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:26:53 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:26:53 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:26:53 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0d5e497c-31, may_exist=True, interface_attrs={}) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:26:53 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0d5e497c-31, col_values=(('qos', UUID('8db3014b-9284-494b-a50b-efc82f4184b0')),), if_exists=True) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:26:53 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0d5e497c-31, col_values=(('external_ids', {'iface-id': '0d5e497c-3168-46b1-9094-9bb54737cc0f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:80:07:f1', 'vm-uuid': '667d20c3-3eda-4aa5-b799-6dcee3443833'}),), if_exists=True) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:26:53 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:26:53 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 23:26:53 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:26:53 user nova-compute[75045]: INFO os_vif [None req-55671725-cabc-42f6-b791-699dfac90390 tempest-ServerActionsV293TestJSON-1645081958 tempest-ServerActionsV293TestJSON-1645081958-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:80:07:f1,bridge_name='br-int',has_traffic_filtering=True,id=0d5e497c-3168-46b1-9094-9bb54737cc0f,network=Network(22898442-b87a-4538-a8f5-fe275919f44a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0d5e497c-31')
Nov 08 23:26:53 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-55671725-cabc-42f6-b791-699dfac90390 tempest-ServerActionsV293TestJSON-1645081958 tempest-ServerActionsV293TestJSON-1645081958-project-member] No BDM found with device name vda, not building metadata. {{(pid=75045) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 23:26:53 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-55671725-cabc-42f6-b791-699dfac90390 tempest-ServerActionsV293TestJSON-1645081958 tempest-ServerActionsV293TestJSON-1645081958-project-member] No VIF found with MAC fa:16:3e:80:07:f1, not building metadata {{(pid=75045) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 23:26:53 user nova-compute[75045]: INFO nova.virt.libvirt.driver [None req-983f54e4-af2a-426c-b077-2982885c924e tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] [instance: fa67b237-f598-4111-87ba-d761aa50d95e] Snapshot image upload complete
Nov 08 23:26:53 user nova-compute[75045]: INFO nova.compute.manager [None req-983f54e4-af2a-426c-b077-2982885c924e tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] [instance: fa67b237-f598-4111-87ba-d761aa50d95e] Took 5.23 seconds to snapshot the instance on the hypervisor.
Nov 08 23:26:54 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:26:54 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:26:54 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:26:54 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:26:54 user nova-compute[75045]: DEBUG nova.compute.manager [req-5c6500dd-4dcc-41ae-81ac-49630708cdee req-05e1891d-192b-4677-81e9-a42ab396374e service nova] [instance: 667d20c3-3eda-4aa5-b799-6dcee3443833] Received event network-vif-plugged-0d5e497c-3168-46b1-9094-9bb54737cc0f {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:26:54 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-5c6500dd-4dcc-41ae-81ac-49630708cdee req-05e1891d-192b-4677-81e9-a42ab396374e service nova] Acquiring lock "667d20c3-3eda-4aa5-b799-6dcee3443833-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:26:54 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-5c6500dd-4dcc-41ae-81ac-49630708cdee req-05e1891d-192b-4677-81e9-a42ab396374e service nova] Lock "667d20c3-3eda-4aa5-b799-6dcee3443833-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:26:54 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-5c6500dd-4dcc-41ae-81ac-49630708cdee req-05e1891d-192b-4677-81e9-a42ab396374e service nova] Lock "667d20c3-3eda-4aa5-b799-6dcee3443833-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:26:54 user nova-compute[75045]: DEBUG nova.compute.manager [req-5c6500dd-4dcc-41ae-81ac-49630708cdee req-05e1891d-192b-4677-81e9-a42ab396374e service nova] [instance: 667d20c3-3eda-4aa5-b799-6dcee3443833] No waiting events found dispatching network-vif-plugged-0d5e497c-3168-46b1-9094-9bb54737cc0f {{(pid=75045) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 23:26:54 user nova-compute[75045]: WARNING nova.compute.manager [req-5c6500dd-4dcc-41ae-81ac-49630708cdee req-05e1891d-192b-4677-81e9-a42ab396374e service nova] [instance: 667d20c3-3eda-4aa5-b799-6dcee3443833] Received unexpected event network-vif-plugged-0d5e497c-3168-46b1-9094-9bb54737cc0f for instance with vm_state active and task_state rebuild_spawning.
Nov 08 23:26:55 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:26:55 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:26:55 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:26:56 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:26:56 user nova-compute[75045]: DEBUG nova.compute.manager [req-f907bdc8-efe9-4c08-8046-65fb3ea7446a req-3183ebff-44fa-45ee-92e7-0c7cee5e6740 service nova] [instance: 667d20c3-3eda-4aa5-b799-6dcee3443833] Received event network-vif-plugged-0d5e497c-3168-46b1-9094-9bb54737cc0f {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:26:56 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-f907bdc8-efe9-4c08-8046-65fb3ea7446a req-3183ebff-44fa-45ee-92e7-0c7cee5e6740 service nova] Acquiring lock "667d20c3-3eda-4aa5-b799-6dcee3443833-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:26:56 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-f907bdc8-efe9-4c08-8046-65fb3ea7446a req-3183ebff-44fa-45ee-92e7-0c7cee5e6740 service nova] Lock "667d20c3-3eda-4aa5-b799-6dcee3443833-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:26:56 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-f907bdc8-efe9-4c08-8046-65fb3ea7446a req-3183ebff-44fa-45ee-92e7-0c7cee5e6740 service nova] Lock "667d20c3-3eda-4aa5-b799-6dcee3443833-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:26:56 user nova-compute[75045]: DEBUG nova.compute.manager [req-f907bdc8-efe9-4c08-8046-65fb3ea7446a req-3183ebff-44fa-45ee-92e7-0c7cee5e6740 service nova] [instance: 667d20c3-3eda-4aa5-b799-6dcee3443833] No waiting events found dispatching network-vif-plugged-0d5e497c-3168-46b1-9094-9bb54737cc0f {{(pid=75045) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 23:26:56 user nova-compute[75045]: WARNING nova.compute.manager [req-f907bdc8-efe9-4c08-8046-65fb3ea7446a req-3183ebff-44fa-45ee-92e7-0c7cee5e6740 service nova] [instance: 667d20c3-3eda-4aa5-b799-6dcee3443833] Received unexpected event network-vif-plugged-0d5e497c-3168-46b1-9094-9bb54737cc0f for instance with vm_state active and task_state rebuild_spawning.
Nov 08 23:26:56 user nova-compute[75045]: DEBUG nova.compute.manager [None req-55671725-cabc-42f6-b791-699dfac90390 tempest-ServerActionsV293TestJSON-1645081958 tempest-ServerActionsV293TestJSON-1645081958-project-member] [instance: 667d20c3-3eda-4aa5-b799-6dcee3443833] Instance event wait completed in 0 seconds for  {{(pid=75045) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 23:26:56 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-55671725-cabc-42f6-b791-699dfac90390 tempest-ServerActionsV293TestJSON-1645081958 tempest-ServerActionsV293TestJSON-1645081958-project-member] [instance: 667d20c3-3eda-4aa5-b799-6dcee3443833] Guest created on hypervisor {{(pid=75045) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 23:26:56 user nova-compute[75045]: INFO nova.virt.libvirt.driver [-] [instance: 667d20c3-3eda-4aa5-b799-6dcee3443833] Instance spawned successfully.
Nov 08 23:26:56 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-55671725-cabc-42f6-b791-699dfac90390 tempest-ServerActionsV293TestJSON-1645081958 tempest-ServerActionsV293TestJSON-1645081958-project-member] [instance: 667d20c3-3eda-4aa5-b799-6dcee3443833] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75045) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 23:26:56 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-55671725-cabc-42f6-b791-699dfac90390 tempest-ServerActionsV293TestJSON-1645081958 tempest-ServerActionsV293TestJSON-1645081958-project-member] [instance: 667d20c3-3eda-4aa5-b799-6dcee3443833] Found default for hw_cdrom_bus of ide {{(pid=75045) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 23:26:56 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-55671725-cabc-42f6-b791-699dfac90390 tempest-ServerActionsV293TestJSON-1645081958 tempest-ServerActionsV293TestJSON-1645081958-project-member] [instance: 667d20c3-3eda-4aa5-b799-6dcee3443833] Found default for hw_disk_bus of virtio {{(pid=75045) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 23:26:56 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-55671725-cabc-42f6-b791-699dfac90390 tempest-ServerActionsV293TestJSON-1645081958 tempest-ServerActionsV293TestJSON-1645081958-project-member] [instance: 667d20c3-3eda-4aa5-b799-6dcee3443833] Found default for hw_input_bus of None {{(pid=75045) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 23:26:56 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-55671725-cabc-42f6-b791-699dfac90390 tempest-ServerActionsV293TestJSON-1645081958 tempest-ServerActionsV293TestJSON-1645081958-project-member] [instance: 667d20c3-3eda-4aa5-b799-6dcee3443833] Found default for hw_pointer_model of None {{(pid=75045) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 23:26:56 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-55671725-cabc-42f6-b791-699dfac90390 tempest-ServerActionsV293TestJSON-1645081958 tempest-ServerActionsV293TestJSON-1645081958-project-member] [instance: 667d20c3-3eda-4aa5-b799-6dcee3443833] Found default for hw_video_model of virtio {{(pid=75045) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 23:26:56 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-55671725-cabc-42f6-b791-699dfac90390 tempest-ServerActionsV293TestJSON-1645081958 tempest-ServerActionsV293TestJSON-1645081958-project-member] [instance: 667d20c3-3eda-4aa5-b799-6dcee3443833] Found default for hw_vif_model of virtio {{(pid=75045) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 23:26:57 user nova-compute[75045]: DEBUG nova.compute.manager [None req-55671725-cabc-42f6-b791-699dfac90390 tempest-ServerActionsV293TestJSON-1645081958 tempest-ServerActionsV293TestJSON-1645081958-project-member] [instance: 667d20c3-3eda-4aa5-b799-6dcee3443833] Checking state {{(pid=75045) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 23:26:57 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-55671725-cabc-42f6-b791-699dfac90390 tempest-ServerActionsV293TestJSON-1645081958 tempest-ServerActionsV293TestJSON-1645081958-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:26:57 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-55671725-cabc-42f6-b791-699dfac90390 tempest-ServerActionsV293TestJSON-1645081958 tempest-ServerActionsV293TestJSON-1645081958-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:26:57 user nova-compute[75045]: DEBUG nova.objects.instance [None req-55671725-cabc-42f6-b791-699dfac90390 tempest-ServerActionsV293TestJSON-1645081958 tempest-ServerActionsV293TestJSON-1645081958-project-member] [instance: 667d20c3-3eda-4aa5-b799-6dcee3443833] Trying to apply a migration context that does not seem to be set for this instance {{(pid=75045) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Nov 08 23:26:57 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-55671725-cabc-42f6-b791-699dfac90390 tempest-ServerActionsV293TestJSON-1645081958 tempest-ServerActionsV293TestJSON-1645081958-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.073s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:26:58 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:26:59 user nova-compute[75045]: DEBUG nova.compute.manager [req-8120ef2a-e099-4441-872f-8abf868e67fe req-4eec4a98-ba2a-4b48-aad0-5848c79e7f76 service nova] [instance: 7e92ab9a-8ea4-4452-a458-db181d4a59b7] Received event network-changed-5bdaffe7-9bbb-4391-bd1e-406a8fb06ce8 {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:26:59 user nova-compute[75045]: DEBUG nova.compute.manager [req-8120ef2a-e099-4441-872f-8abf868e67fe req-4eec4a98-ba2a-4b48-aad0-5848c79e7f76 service nova] [instance: 7e92ab9a-8ea4-4452-a458-db181d4a59b7] Refreshing instance network info cache due to event network-changed-5bdaffe7-9bbb-4391-bd1e-406a8fb06ce8. {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 23:26:59 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-8120ef2a-e099-4441-872f-8abf868e67fe req-4eec4a98-ba2a-4b48-aad0-5848c79e7f76 service nova] Acquiring lock "refresh_cache-7e92ab9a-8ea4-4452-a458-db181d4a59b7" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 23:26:59 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-8120ef2a-e099-4441-872f-8abf868e67fe req-4eec4a98-ba2a-4b48-aad0-5848c79e7f76 service nova] Acquired lock "refresh_cache-7e92ab9a-8ea4-4452-a458-db181d4a59b7" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 23:26:59 user nova-compute[75045]: DEBUG nova.network.neutron [req-8120ef2a-e099-4441-872f-8abf868e67fe req-4eec4a98-ba2a-4b48-aad0-5848c79e7f76 service nova] [instance: 7e92ab9a-8ea4-4452-a458-db181d4a59b7] Refreshing network info cache for port 5bdaffe7-9bbb-4391-bd1e-406a8fb06ce8 {{(pid=75045) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 23:27:00 user nova-compute[75045]: DEBUG nova.network.neutron [req-8120ef2a-e099-4441-872f-8abf868e67fe req-4eec4a98-ba2a-4b48-aad0-5848c79e7f76 service nova] [instance: 7e92ab9a-8ea4-4452-a458-db181d4a59b7] Updated VIF entry in instance network info cache for port 5bdaffe7-9bbb-4391-bd1e-406a8fb06ce8. {{(pid=75045) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 23:27:00 user nova-compute[75045]: DEBUG nova.network.neutron [req-8120ef2a-e099-4441-872f-8abf868e67fe req-4eec4a98-ba2a-4b48-aad0-5848c79e7f76 service nova] [instance: 7e92ab9a-8ea4-4452-a458-db181d4a59b7] Updating instance_info_cache with network_info: [{"id": "5bdaffe7-9bbb-4391-bd1e-406a8fb06ce8", "address": "fa:16:3e:13:a9:e5", "network": {"id": "e7c66e39-e1ba-4907-8701-33ae849858b2", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-420335537-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.48", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd25d9a8d6af45bb97e0555101d61489", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5bdaffe7-9b", "ovs_interfaceid": "5bdaffe7-9bbb-4391-bd1e-406a8fb06ce8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75045) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 23:27:00 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-8120ef2a-e099-4441-872f-8abf868e67fe req-4eec4a98-ba2a-4b48-aad0-5848c79e7f76 service nova] Releasing lock "refresh_cache-7e92ab9a-8ea4-4452-a458-db181d4a59b7" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 23:27:01 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:27:03 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:27:03 user nova-compute[75045]: DEBUG nova.compute.manager [req-be75672e-b478-4979-8e31-4927d1002438 req-7a3d1c30-3479-41e7-9dcd-3a1666f003cd service nova] [instance: 72c9d731-2b35-434c-8463-1cd6c18fbd6a] Received event network-changed-996f98bd-77bf-4176-8fe3-ea98b0c070a0 {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:27:03 user nova-compute[75045]: DEBUG nova.compute.manager [req-be75672e-b478-4979-8e31-4927d1002438 req-7a3d1c30-3479-41e7-9dcd-3a1666f003cd service nova] [instance: 72c9d731-2b35-434c-8463-1cd6c18fbd6a] Refreshing instance network info cache due to event network-changed-996f98bd-77bf-4176-8fe3-ea98b0c070a0. {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 23:27:03 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-be75672e-b478-4979-8e31-4927d1002438 req-7a3d1c30-3479-41e7-9dcd-3a1666f003cd service nova] Acquiring lock "refresh_cache-72c9d731-2b35-434c-8463-1cd6c18fbd6a" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 23:27:03 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-be75672e-b478-4979-8e31-4927d1002438 req-7a3d1c30-3479-41e7-9dcd-3a1666f003cd service nova] Acquired lock "refresh_cache-72c9d731-2b35-434c-8463-1cd6c18fbd6a" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 23:27:03 user nova-compute[75045]: DEBUG nova.network.neutron [req-be75672e-b478-4979-8e31-4927d1002438 req-7a3d1c30-3479-41e7-9dcd-3a1666f003cd service nova] [instance: 72c9d731-2b35-434c-8463-1cd6c18fbd6a] Refreshing network info cache for port 996f98bd-77bf-4176-8fe3-ea98b0c070a0 {{(pid=75045) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 23:27:04 user nova-compute[75045]: DEBUG nova.network.neutron [req-be75672e-b478-4979-8e31-4927d1002438 req-7a3d1c30-3479-41e7-9dcd-3a1666f003cd service nova] [instance: 72c9d731-2b35-434c-8463-1cd6c18fbd6a] Updated VIF entry in instance network info cache for port 996f98bd-77bf-4176-8fe3-ea98b0c070a0. {{(pid=75045) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 23:27:04 user nova-compute[75045]: DEBUG nova.network.neutron [req-be75672e-b478-4979-8e31-4927d1002438 req-7a3d1c30-3479-41e7-9dcd-3a1666f003cd service nova] [instance: 72c9d731-2b35-434c-8463-1cd6c18fbd6a] Updating instance_info_cache with network_info: [{"id": "996f98bd-77bf-4176-8fe3-ea98b0c070a0", "address": "fa:16:3e:bb:6f:51", "network": {"id": "94c5462e-c9fd-44e6-b02b-9d46156ca7d9", "bridge": "br-int", "label": "tempest-TestStampPattern-1038298369-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.150", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "824ed65954dd4eccbe68827aa92fd99f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap996f98bd-77", "ovs_interfaceid": "996f98bd-77bf-4176-8fe3-ea98b0c070a0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75045) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 23:27:04 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-be75672e-b478-4979-8e31-4927d1002438 req-7a3d1c30-3479-41e7-9dcd-3a1666f003cd service nova] Releasing lock "refresh_cache-72c9d731-2b35-434c-8463-1cd6c18fbd6a" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 23:27:05 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-66ff41ca-8af0-4363-9fd2-c5d348eae26c tempest-TestStampPattern-2120781434 tempest-TestStampPattern-2120781434-project-member] Acquiring lock "72c9d731-2b35-434c-8463-1cd6c18fbd6a" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:27:05 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-66ff41ca-8af0-4363-9fd2-c5d348eae26c tempest-TestStampPattern-2120781434 tempest-TestStampPattern-2120781434-project-member] Lock "72c9d731-2b35-434c-8463-1cd6c18fbd6a" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:27:05 user nova-compute[75045]: DEBUG nova.objects.instance [None req-66ff41ca-8af0-4363-9fd2-c5d348eae26c tempest-TestStampPattern-2120781434 tempest-TestStampPattern-2120781434-project-member] Lazy-loading 'flavor' on Instance uuid 72c9d731-2b35-434c-8463-1cd6c18fbd6a {{(pid=75045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 23:27:05 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-66ff41ca-8af0-4363-9fd2-c5d348eae26c tempest-TestStampPattern-2120781434 tempest-TestStampPattern-2120781434-project-member] Lock "72c9d731-2b35-434c-8463-1cd6c18fbd6a" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.065s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:27:05 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-582e3901-6c35-4c79-9f00-4ccf6779a065 tempest-VolumesAdminNegativeTest-215528111 tempest-VolumesAdminNegativeTest-215528111-project-member] Acquiring lock "7e92ab9a-8ea4-4452-a458-db181d4a59b7" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:27:05 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-582e3901-6c35-4c79-9f00-4ccf6779a065 tempest-VolumesAdminNegativeTest-215528111 tempest-VolumesAdminNegativeTest-215528111-project-member] Lock "7e92ab9a-8ea4-4452-a458-db181d4a59b7" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:27:05 user nova-compute[75045]: DEBUG nova.objects.instance [None req-582e3901-6c35-4c79-9f00-4ccf6779a065 tempest-VolumesAdminNegativeTest-215528111 tempest-VolumesAdminNegativeTest-215528111-project-member] Lazy-loading 'flavor' on Instance uuid 7e92ab9a-8ea4-4452-a458-db181d4a59b7 {{(pid=75045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 23:27:05 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-66ff41ca-8af0-4363-9fd2-c5d348eae26c tempest-TestStampPattern-2120781434 tempest-TestStampPattern-2120781434-project-member] Acquiring lock "72c9d731-2b35-434c-8463-1cd6c18fbd6a" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:27:05 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-66ff41ca-8af0-4363-9fd2-c5d348eae26c tempest-TestStampPattern-2120781434 tempest-TestStampPattern-2120781434-project-member] Lock "72c9d731-2b35-434c-8463-1cd6c18fbd6a" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:27:05 user nova-compute[75045]: INFO nova.compute.manager [None req-66ff41ca-8af0-4363-9fd2-c5d348eae26c tempest-TestStampPattern-2120781434 tempest-TestStampPattern-2120781434-project-member] [instance: 72c9d731-2b35-434c-8463-1cd6c18fbd6a] Attaching volume a42d9799-d775-4120-8af0-bc81a6278ea7 to /dev/vdb
Nov 08 23:27:05 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-582e3901-6c35-4c79-9f00-4ccf6779a065 tempest-VolumesAdminNegativeTest-215528111 tempest-VolumesAdminNegativeTest-215528111-project-member] Lock "7e92ab9a-8ea4-4452-a458-db181d4a59b7" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.076s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:27:05 user nova-compute[75045]: DEBUG os_brick.utils [None req-66ff41ca-8af0-4363-9fd2-c5d348eae26c tempest-TestStampPattern-2120781434 tempest-TestStampPattern-2120781434-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75045) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 23:27:05 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:27:05 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.021s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:27:05 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cb4282d-f9cb-4cd2-9c4b-ac435c46a322]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6217bd6e884\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:27:05 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:27:05 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.028s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:27:05 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fc61e37-8e64-4e17-9ef4-5a19a0ab2c20]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:27:05 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:27:05 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:27:05 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c362cab-90c7-4198-9b11-73986fad3f79]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:27:05 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4dc9052-6fdf-497c-aeff-1b4265d12c00]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:27:05 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-66ff41ca-8af0-4363-9fd2-c5d348eae26c tempest-TestStampPattern-2120781434 tempest-TestStampPattern-2120781434-project-member] Running cmd (subprocess): nvme version {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:27:05 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-66ff41ca-8af0-4363-9fd2-c5d348eae26c tempest-TestStampPattern-2120781434 tempest-TestStampPattern-2120781434-project-member] 'nvme version' failed. Not Retrying. {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 23:27:05 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.nvmeof [None req-66ff41ca-8af0-4363-9fd2-c5d348eae26c tempest-TestStampPattern-2120781434 tempest-TestStampPattern-2120781434-project-member] nvme not present on system {{(pid=75045) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 23:27:05 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-582e3901-6c35-4c79-9f00-4ccf6779a065 tempest-VolumesAdminNegativeTest-215528111 tempest-VolumesAdminNegativeTest-215528111-project-member] Acquiring lock "7e92ab9a-8ea4-4452-a458-db181d4a59b7" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:27:05 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-582e3901-6c35-4c79-9f00-4ccf6779a065 tempest-VolumesAdminNegativeTest-215528111 tempest-VolumesAdminNegativeTest-215528111-project-member] Lock "7e92ab9a-8ea4-4452-a458-db181d4a59b7" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:27:05 user nova-compute[75045]: INFO nova.compute.manager [None req-582e3901-6c35-4c79-9f00-4ccf6779a065 tempest-VolumesAdminNegativeTest-215528111 tempest-VolumesAdminNegativeTest-215528111-project-member] [instance: 7e92ab9a-8ea4-4452-a458-db181d4a59b7] Attaching volume 9037467e-0ff2-4d03-925e-8997a3759542 to /dev/vdb
Nov 08 23:27:05 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:27:05 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 23:27:05 user nova-compute[75045]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 23:27:05 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6ebe64f-e6f9-4362-90c7-c639a7f2593c]: (4, '') {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:27:05 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.lightos [None req-66ff41ca-8af0-4363-9fd2-c5d348eae26c tempest-TestStampPattern-2120781434 tempest-TestStampPattern-2120781434-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75045) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 23:27:05 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.lightos [None req-66ff41ca-8af0-4363-9fd2-c5d348eae26c tempest-TestStampPattern-2120781434 tempest-TestStampPattern-2120781434-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75045) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 23:27:05 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.lightos [None req-66ff41ca-8af0-4363-9fd2-c5d348eae26c tempest-TestStampPattern-2120781434 tempest-TestStampPattern-2120781434-project-member] LIGHTOS: no hostnqn found. {{(pid=75045) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 23:27:05 user nova-compute[75045]: DEBUG os_brick.utils [None req-66ff41ca-8af0-4363-9fd2-c5d348eae26c tempest-TestStampPattern-2120781434 tempest-TestStampPattern-2120781434-project-member] <== get_connector_properties: return (185ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6217bd6e884', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75045) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 23:27:05 user nova-compute[75045]: DEBUG nova.virt.block_device [None req-66ff41ca-8af0-4363-9fd2-c5d348eae26c tempest-TestStampPattern-2120781434 tempest-TestStampPattern-2120781434-project-member] [instance: 72c9d731-2b35-434c-8463-1cd6c18fbd6a] Updating existing volume attachment record: 37f78a49-bf03-4597-94b3-0d598c7f39cd {{(pid=75045) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 23:27:05 user nova-compute[75045]: DEBUG os_brick.utils [None req-582e3901-6c35-4c79-9f00-4ccf6779a065 tempest-VolumesAdminNegativeTest-215528111 tempest-VolumesAdminNegativeTest-215528111-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75045) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 23:27:05 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:27:06 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:27:06 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c702785-0ce2-4651-a741-2f1310b7f9a4]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6217bd6e884\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:27:06 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:27:06 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:27:06 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[809feba5-f613-4b3d-97c2-d5b56f57995d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:27:06 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:27:06 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:27:06 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c4c391f-74b2-4a53-85c8-10c366af203e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:27:06 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[230107e1-0a70-4588-a46e-27172f4b0f13]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:27:06 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-582e3901-6c35-4c79-9f00-4ccf6779a065 tempest-VolumesAdminNegativeTest-215528111 tempest-VolumesAdminNegativeTest-215528111-project-member] Running cmd (subprocess): nvme version {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:27:06 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-582e3901-6c35-4c79-9f00-4ccf6779a065 tempest-VolumesAdminNegativeTest-215528111 tempest-VolumesAdminNegativeTest-215528111-project-member] 'nvme version' failed. Not Retrying. {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 23:27:06 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.nvmeof [None req-582e3901-6c35-4c79-9f00-4ccf6779a065 tempest-VolumesAdminNegativeTest-215528111 tempest-VolumesAdminNegativeTest-215528111-project-member] nvme not present on system {{(pid=75045) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 23:27:06 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:27:06 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 23:27:06 user nova-compute[75045]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 23:27:06 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc89f09d-27f2-49e1-903a-5f4062eacf61]: (4, '') {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:27:06 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.lightos [None req-582e3901-6c35-4c79-9f00-4ccf6779a065 tempest-VolumesAdminNegativeTest-215528111 tempest-VolumesAdminNegativeTest-215528111-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75045) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 23:27:06 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.lightos [None req-582e3901-6c35-4c79-9f00-4ccf6779a065 tempest-VolumesAdminNegativeTest-215528111 tempest-VolumesAdminNegativeTest-215528111-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75045) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 23:27:06 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.lightos [None req-582e3901-6c35-4c79-9f00-4ccf6779a065 tempest-VolumesAdminNegativeTest-215528111 tempest-VolumesAdminNegativeTest-215528111-project-member] LIGHTOS: no hostnqn found. {{(pid=75045) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 23:27:06 user nova-compute[75045]: DEBUG os_brick.utils [None req-582e3901-6c35-4c79-9f00-4ccf6779a065 tempest-VolumesAdminNegativeTest-215528111 tempest-VolumesAdminNegativeTest-215528111-project-member] <== get_connector_properties: return (133ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6217bd6e884', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75045) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 23:27:06 user nova-compute[75045]: DEBUG nova.virt.block_device [None req-582e3901-6c35-4c79-9f00-4ccf6779a065 tempest-VolumesAdminNegativeTest-215528111 tempest-VolumesAdminNegativeTest-215528111-project-member] [instance: 7e92ab9a-8ea4-4452-a458-db181d4a59b7] Updating existing volume attachment record: 86092aae-66fe-4a78-a8e9-046d91fb6942 {{(pid=75045) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 23:27:06 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:27:08 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:27:11 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:27:13 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:27:16 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:27:18 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:27:20 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-d5186187-b349-4240-8a6f-3c8da2a6879f tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Acquiring lock "43f31110-89ec-4b20-9842-7c9dd7df0e14" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:27:20 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-d5186187-b349-4240-8a6f-3c8da2a6879f tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Lock "43f31110-89ec-4b20-9842-7c9dd7df0e14" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:27:20 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-d5186187-b349-4240-8a6f-3c8da2a6879f tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Acquiring lock "43f31110-89ec-4b20-9842-7c9dd7df0e14-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:27:20 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-d5186187-b349-4240-8a6f-3c8da2a6879f tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Lock "43f31110-89ec-4b20-9842-7c9dd7df0e14-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:27:20 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-d5186187-b349-4240-8a6f-3c8da2a6879f tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Lock "43f31110-89ec-4b20-9842-7c9dd7df0e14-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:27:20 user nova-compute[75045]: INFO nova.compute.manager [None req-d5186187-b349-4240-8a6f-3c8da2a6879f tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] [instance: 43f31110-89ec-4b20-9842-7c9dd7df0e14] Terminating instance
Nov 08 23:27:20 user nova-compute[75045]: DEBUG nova.compute.manager [None req-d5186187-b349-4240-8a6f-3c8da2a6879f tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] [instance: 43f31110-89ec-4b20-9842-7c9dd7df0e14] Start destroying the instance on the hypervisor. {{(pid=75045) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 23:27:20 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:27:20 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:27:20 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:27:20 user nova-compute[75045]: DEBUG nova.compute.manager [req-7bbee65a-472d-4916-a69a-65389c1afd6b req-f93f8343-1087-481d-b962-60e0175a89ed service nova] [instance: 43f31110-89ec-4b20-9842-7c9dd7df0e14] Received event network-vif-unplugged-509a96ec-b573-4408-bf93-87bccca95836 {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:27:20 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-7bbee65a-472d-4916-a69a-65389c1afd6b req-f93f8343-1087-481d-b962-60e0175a89ed service nova] Acquiring lock "43f31110-89ec-4b20-9842-7c9dd7df0e14-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:27:20 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-7bbee65a-472d-4916-a69a-65389c1afd6b req-f93f8343-1087-481d-b962-60e0175a89ed service nova] Lock "43f31110-89ec-4b20-9842-7c9dd7df0e14-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:27:20 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-7bbee65a-472d-4916-a69a-65389c1afd6b req-f93f8343-1087-481d-b962-60e0175a89ed service nova] Lock "43f31110-89ec-4b20-9842-7c9dd7df0e14-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:27:20 user nova-compute[75045]: DEBUG nova.compute.manager [req-7bbee65a-472d-4916-a69a-65389c1afd6b req-f93f8343-1087-481d-b962-60e0175a89ed service nova] [instance: 43f31110-89ec-4b20-9842-7c9dd7df0e14] No waiting events found dispatching network-vif-unplugged-509a96ec-b573-4408-bf93-87bccca95836 {{(pid=75045) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 23:27:20 user nova-compute[75045]: DEBUG nova.compute.manager [req-7bbee65a-472d-4916-a69a-65389c1afd6b req-f93f8343-1087-481d-b962-60e0175a89ed service nova] [instance: 43f31110-89ec-4b20-9842-7c9dd7df0e14] Received event network-vif-unplugged-509a96ec-b573-4408-bf93-87bccca95836 for instance with task_state deleting. {{(pid=75045) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 23:27:21 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:27:21 user nova-compute[75045]: INFO nova.virt.libvirt.driver [-] [instance: 43f31110-89ec-4b20-9842-7c9dd7df0e14] Instance destroyed successfully.
Nov 08 23:27:21 user nova-compute[75045]: DEBUG nova.objects.instance [None req-d5186187-b349-4240-8a6f-3c8da2a6879f tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Lazy-loading 'resources' on Instance uuid 43f31110-89ec-4b20-9842-7c9dd7df0e14 {{(pid=75045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 23:27:21 user nova-compute[75045]: DEBUG nova.virt.libvirt.vif [None req-d5186187-b349-4240-8a6f-3c8da2a6879f tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T23:21:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-783057773',display_name='tempest-AttachVolumeNegativeTest-server-783057773',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-783057773',id=15,image_ref='a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIweSQytcBQHNyjBYp3RpOdxAOvFr8UkfBLh3g9yswv90eIjFmeErVHAiDu2rmOkHQ5M+KoQ37TqrcX8GUX8vKPmJPj26oGSiSDAr3sTIs8x/z9rJp6ocR3khkX9KB9SEA==',key_name='tempest-keypair-205969788',keypairs=<?>,launch_index=0,launched_at=2023-11-08T23:21:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7eff4be777d24514be52868961bf7a25',ramdisk_id='',reservation_id='r-j1j7y1ap',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1522456563',owner_user_name='tempest-AttachVolumeNegativeTest-1522456563-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T23:21:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4a05b178abe74b779a991e887bf135b2',uuid=43f31110-89ec-4b20-9842-7c9dd7df0e14,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "509a96ec-b573-4408-bf93-87bccca95836", "address": "fa:16:3e:db:57:7b", "network": {"id": "2f33d93d-98ec-4b87-a0c0-efe2d2ac8f6d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-719527911-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.162", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7eff4be777d24514be52868961bf7a25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap509a96ec-b5", "ovs_interfaceid": "509a96ec-b573-4408-bf93-87bccca95836", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75045) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 23:27:21 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-d5186187-b349-4240-8a6f-3c8da2a6879f tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Converting VIF {"id": "509a96ec-b573-4408-bf93-87bccca95836", "address": "fa:16:3e:db:57:7b", "network": {"id": "2f33d93d-98ec-4b87-a0c0-efe2d2ac8f6d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-719527911-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.162", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7eff4be777d24514be52868961bf7a25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap509a96ec-b5", "ovs_interfaceid": "509a96ec-b573-4408-bf93-87bccca95836", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 23:27:21 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-d5186187-b349-4240-8a6f-3c8da2a6879f tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:db:57:7b,bridge_name='br-int',has_traffic_filtering=True,id=509a96ec-b573-4408-bf93-87bccca95836,network=Network(2f33d93d-98ec-4b87-a0c0-efe2d2ac8f6d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap509a96ec-b5') {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 23:27:21 user nova-compute[75045]: DEBUG os_vif [None req-d5186187-b349-4240-8a6f-3c8da2a6879f tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:db:57:7b,bridge_name='br-int',has_traffic_filtering=True,id=509a96ec-b573-4408-bf93-87bccca95836,network=Network(2f33d93d-98ec-4b87-a0c0-efe2d2ac8f6d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap509a96ec-b5') {{(pid=75045) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 23:27:21 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:27:21 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap509a96ec-b5, bridge=br-int, if_exists=True) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:27:21 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 23:27:21 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:27:21 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=874c1cbc-a930-4238-85dd-6660303118a0) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:27:21 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 23:27:21 user nova-compute[75045]: INFO os_vif [None req-d5186187-b349-4240-8a6f-3c8da2a6879f tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:db:57:7b,bridge_name='br-int',has_traffic_filtering=True,id=509a96ec-b573-4408-bf93-87bccca95836,network=Network(2f33d93d-98ec-4b87-a0c0-efe2d2ac8f6d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap509a96ec-b5')
Nov 08 23:27:21 user nova-compute[75045]: INFO nova.virt.libvirt.driver [None req-d5186187-b349-4240-8a6f-3c8da2a6879f tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] [instance: 43f31110-89ec-4b20-9842-7c9dd7df0e14] Deleting instance files /opt/stack/data/nova/instances/43f31110-89ec-4b20-9842-7c9dd7df0e14_del
Nov 08 23:27:21 user nova-compute[75045]: INFO nova.virt.libvirt.driver [None req-d5186187-b349-4240-8a6f-3c8da2a6879f tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] [instance: 43f31110-89ec-4b20-9842-7c9dd7df0e14] Deletion of /opt/stack/data/nova/instances/43f31110-89ec-4b20-9842-7c9dd7df0e14_del complete
Nov 08 23:27:21 user nova-compute[75045]: INFO nova.compute.manager [None req-d5186187-b349-4240-8a6f-3c8da2a6879f tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] [instance: 43f31110-89ec-4b20-9842-7c9dd7df0e14] Took 0.94 seconds to destroy the instance on the hypervisor.
Nov 08 23:27:21 user nova-compute[75045]: DEBUG oslo.service.loopingcall [None req-d5186187-b349-4240-8a6f-3c8da2a6879f tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75045) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 23:27:21 user nova-compute[75045]: DEBUG nova.compute.manager [-] [instance: 43f31110-89ec-4b20-9842-7c9dd7df0e14] Deallocating network for instance {{(pid=75045) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 23:27:21 user nova-compute[75045]: DEBUG nova.network.neutron [-] [instance: 43f31110-89ec-4b20-9842-7c9dd7df0e14] deallocate_for_instance() {{(pid=75045) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 23:27:22 user nova-compute[75045]: DEBUG nova.network.neutron [-] [instance: 43f31110-89ec-4b20-9842-7c9dd7df0e14] Updating instance_info_cache with network_info: [] {{(pid=75045) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 23:27:22 user nova-compute[75045]: INFO nova.compute.manager [-] [instance: 43f31110-89ec-4b20-9842-7c9dd7df0e14] Took 0.93 seconds to deallocate network for instance.
Nov 08 23:27:22 user nova-compute[75045]: DEBUG nova.compute.manager [req-6d5de7b3-daf0-4e99-8be5-0582b6e40ccd req-4a57ff02-787d-4284-9520-693a40330329 service nova] [instance: 43f31110-89ec-4b20-9842-7c9dd7df0e14] Received event network-vif-deleted-509a96ec-b573-4408-bf93-87bccca95836 {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:27:22 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-d5186187-b349-4240-8a6f-3c8da2a6879f tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:27:22 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-d5186187-b349-4240-8a6f-3c8da2a6879f tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:27:22 user nova-compute[75045]: DEBUG nova.compute.provider_tree [None req-d5186187-b349-4240-8a6f-3c8da2a6879f tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Inventory has not changed in ProviderTree for provider: 62ba5f85-c74d-4b58-986e-d4197e813fd7 {{(pid=75045) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 23:27:22 user nova-compute[75045]: DEBUG nova.scheduler.client.report [None req-d5186187-b349-4240-8a6f-3c8da2a6879f tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Inventory has not changed for provider 62ba5f85-c74d-4b58-986e-d4197e813fd7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75045) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 23:27:22 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-d5186187-b349-4240-8a6f-3c8da2a6879f tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.405s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:27:22 user nova-compute[75045]: INFO nova.scheduler.client.report [None req-d5186187-b349-4240-8a6f-3c8da2a6879f tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Deleted allocations for instance 43f31110-89ec-4b20-9842-7c9dd7df0e14
Nov 08 23:27:22 user nova-compute[75045]: DEBUG nova.compute.manager [req-4d849d67-ac5e-4a51-9a4d-ac977a3ffe0b req-70378782-026d-4089-b97c-3520e7c5dc3d service nova] [instance: 43f31110-89ec-4b20-9842-7c9dd7df0e14] Received event network-vif-plugged-509a96ec-b573-4408-bf93-87bccca95836 {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:27:22 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-4d849d67-ac5e-4a51-9a4d-ac977a3ffe0b req-70378782-026d-4089-b97c-3520e7c5dc3d service nova] Acquiring lock "43f31110-89ec-4b20-9842-7c9dd7df0e14-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:27:22 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-4d849d67-ac5e-4a51-9a4d-ac977a3ffe0b req-70378782-026d-4089-b97c-3520e7c5dc3d service nova] Lock "43f31110-89ec-4b20-9842-7c9dd7df0e14-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:27:22 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-4d849d67-ac5e-4a51-9a4d-ac977a3ffe0b req-70378782-026d-4089-b97c-3520e7c5dc3d service nova] Lock "43f31110-89ec-4b20-9842-7c9dd7df0e14-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:27:22 user nova-compute[75045]: DEBUG nova.compute.manager [req-4d849d67-ac5e-4a51-9a4d-ac977a3ffe0b req-70378782-026d-4089-b97c-3520e7c5dc3d service nova] [instance: 43f31110-89ec-4b20-9842-7c9dd7df0e14] No waiting events found dispatching network-vif-plugged-509a96ec-b573-4408-bf93-87bccca95836 {{(pid=75045) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 23:27:22 user nova-compute[75045]: WARNING nova.compute.manager [req-4d849d67-ac5e-4a51-9a4d-ac977a3ffe0b req-70378782-026d-4089-b97c-3520e7c5dc3d service nova] [instance: 43f31110-89ec-4b20-9842-7c9dd7df0e14] Received unexpected event network-vif-plugged-509a96ec-b573-4408-bf93-87bccca95836 for instance with vm_state deleted and task_state None.
Nov 08 23:27:22 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-d5186187-b349-4240-8a6f-3c8da2a6879f tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Lock "43f31110-89ec-4b20-9842-7c9dd7df0e14" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.536s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:27:26 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:27:26 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:27:31 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:27:31 user nova-compute[75045]: INFO nova.compute.manager [None req-af0b6bfd-6b19-452d-9d5b-6b346a83263e tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] [instance: b5fc7f02-2143-4bcf-92ac-078d5ec10747] Rescuing
Nov 08 23:27:31 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-af0b6bfd-6b19-452d-9d5b-6b346a83263e tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] Acquiring lock "refresh_cache-b5fc7f02-2143-4bcf-92ac-078d5ec10747" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 23:27:31 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-af0b6bfd-6b19-452d-9d5b-6b346a83263e tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] Acquired lock "refresh_cache-b5fc7f02-2143-4bcf-92ac-078d5ec10747" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 23:27:31 user nova-compute[75045]: DEBUG nova.network.neutron [None req-af0b6bfd-6b19-452d-9d5b-6b346a83263e tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] [instance: b5fc7f02-2143-4bcf-92ac-078d5ec10747] Building network info cache for instance {{(pid=75045) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 23:27:31 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:27:31 user nova-compute[75045]: DEBUG nova.virt.libvirt.volume.iscsi [None req-582e3901-6c35-4c79-9f00-4ccf6779a065 tempest-VolumesAdminNegativeTest-215528111 tempest-VolumesAdminNegativeTest-215528111-project-member] [instance: 7e92ab9a-8ea4-4452-a458-db181d4a59b7] Calling os-brick to attach iSCSI Volume {{(pid=75045) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 23:27:31 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-582e3901-6c35-4c79-9f00-4ccf6779a065 tempest-VolumesAdminNegativeTest-215528111 tempest-VolumesAdminNegativeTest-215528111-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1b68210460>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9037467e-0ff2-4d03-925e-8997a3759542', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'THZbgsEa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75045) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 23:27:31 user nova-compute[75045]: WARNING os_brick.initiator.connectors.base [None req-582e3901-6c35-4c79-9f00-4ccf6779a065 tempest-VolumesAdminNegativeTest-215528111 tempest-VolumesAdminNegativeTest-215528111-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 23:27:31 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-582e3901-6c35-4c79-9f00-4ccf6779a065 tempest-VolumesAdminNegativeTest-215528111 tempest-VolumesAdminNegativeTest-215528111-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 23:27:31 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-582e3901-6c35-4c79-9f00-4ccf6779a065 tempest-VolumesAdminNegativeTest-215528111 tempest-VolumesAdminNegativeTest-215528111-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 23:27:31 user nova-compute[75045]: WARNING os_brick.initiator.connectors.base [None req-582e3901-6c35-4c79-9f00-4ccf6779a065 tempest-VolumesAdminNegativeTest-215528111 tempest-VolumesAdminNegativeTest-215528111-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 23:27:31 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-582e3901-6c35-4c79-9f00-4ccf6779a065 tempest-VolumesAdminNegativeTest-215528111 tempest-VolumesAdminNegativeTest-215528111-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9037467e-0ff2-4d03-925e-8997a3759542" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 23:27:31 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-582e3901-6c35-4c79-9f00-4ccf6779a065 tempest-VolumesAdminNegativeTest-215528111 tempest-VolumesAdminNegativeTest-215528111-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9037467e-0ff2-4d03-925e-8997a3759542" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 23:27:31 user nova-compute[75045]: INFO os_brick.initiator.connectors.iscsi [None req-582e3901-6c35-4c79-9f00-4ccf6779a065 tempest-VolumesAdminNegativeTest-215528111 tempest-VolumesAdminNegativeTest-215528111-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 23:27:31 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9037467e-0ff2-4d03-925e-8997a3759542 -p 172.16.0.220:3260 {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:27:31 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9037467e-0ff2-4d03-925e-8997a3759542 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:27:31 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bb6581c-ba7e-4c88-86f3-ce709f2e1039]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:27:31 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-582e3901-6c35-4c79-9f00-4ccf6779a065 tempest-VolumesAdminNegativeTest-215528111 tempest-VolumesAdminNegativeTest-215528111-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 23:27:31 user nova-compute[75045]:  {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:27:31 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9037467e-0ff2-4d03-925e-8997a3759542 -p 172.16.0.220:3260 --interface default --op new {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:27:31 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9037467e-0ff2-4d03-925e-8997a3759542 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:27:31 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[44feef1d-fd1d-4768-b824-0609ec25d4cb]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9037467e-0ff2-4d03-925e-8997a3759542] added\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:27:31 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-582e3901-6c35-4c79-9f00-4ccf6779a065 tempest-VolumesAdminNegativeTest-215528111 tempest-VolumesAdminNegativeTest-215528111-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9037467e-0ff2-4d03-925e-8997a3759542] added
Nov 08 23:27:31 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:27:31 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9037467e-0ff2-4d03-925e-8997a3759542 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:27:31 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9037467e-0ff2-4d03-925e-8997a3759542 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:27:31 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[1266a3a9-bb56-4e89-a851-e68ce39257c5]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:27:31 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-582e3901-6c35-4c79-9f00-4ccf6779a065 tempest-VolumesAdminNegativeTest-215528111 tempest-VolumesAdminNegativeTest-215528111-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:27:31 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9037467e-0ff2-4d03-925e-8997a3759542 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:27:31 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9037467e-0ff2-4d03-925e-8997a3759542 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:27:31 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[11349637-7eba-4f77-aa21-22faf852b561]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:27:31 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-582e3901-6c35-4c79-9f00-4ccf6779a065 tempest-VolumesAdminNegativeTest-215528111 tempest-VolumesAdminNegativeTest-215528111-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:27:31 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9037467e-0ff2-4d03-925e-8997a3759542 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v THZbgsEa {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:27:31 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9037467e-0ff2-4d03-925e-8997a3759542 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v THZbgsEa" returned: 0 in 0.022s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:27:31 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[90bc58b2-3500-437c-8e7f-b195d5882c28]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:27:31 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-582e3901-6c35-4c79-9f00-4ccf6779a065 tempest-VolumesAdminNegativeTest-215528111 tempest-VolumesAdminNegativeTest-215528111-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'THZbgsEa'): stdout= stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:27:31 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9037467e-0ff2-4d03-925e-8997a3759542 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:27:31 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9037467e-0ff2-4d03-925e-8997a3759542 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.027s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:27:31 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[2eed1a20-c78d-4e0f-969a-cebbddb5c9b8]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:27:31 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-582e3901-6c35-4c79-9f00-4ccf6779a065 tempest-VolumesAdminNegativeTest-215528111 tempest-VolumesAdminNegativeTest-215528111-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:27:31 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:27:31 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:27:31 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[fba7aaec-1809-44fa-bcac-7d8d3a056dd5]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c37da13-9531-458a-87cb-1e86e6b84f3a (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2e734fa-1dcb-4510-a50e-064e29c2985e (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04d02c98-d058-49d8-a350-ab9e63003d6e (non-flash)\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:27:31 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-582e3901-6c35-4c79-9f00-4ccf6779a065 tempest-VolumesAdminNegativeTest-215528111 tempest-VolumesAdminNegativeTest-215528111-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab (non-flash)
Nov 08 23:27:31 user nova-compute[75045]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c37da13-9531-458a-87cb-1e86e6b84f3a (non-flash)
Nov 08 23:27:31 user nova-compute[75045]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2e734fa-1dcb-4510-a50e-064e29c2985e (non-flash)
Nov 08 23:27:31 user nova-compute[75045]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04d02c98-d058-49d8-a350-ab9e63003d6e (non-flash)
Nov 08 23:27:31 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 23:27:31 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-582e3901-6c35-4c79-9f00-4ccf6779a065 tempest-VolumesAdminNegativeTest-215528111 tempest-VolumesAdminNegativeTest-215528111-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab (non-flash)
Nov 08 23:27:31 user nova-compute[75045]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c37da13-9531-458a-87cb-1e86e6b84f3a (non-flash)
Nov 08 23:27:31 user nova-compute[75045]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2e734fa-1dcb-4510-a50e-064e29c2985e (non-flash)
Nov 08 23:27:31 user nova-compute[75045]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04d02c98-d058-49d8-a350-ab9e63003d6e (non-flash)
Nov 08 23:27:31 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 23:27:31 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9037467e-0ff2-4d03-925e-8997a3759542 -p 172.16.0.220:3260 --login {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:27:31 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9037467e-0ff2-4d03-925e-8997a3759542 -p 172.16.0.220:3260 --login" returned: 0 in 0.072s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:27:31 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7400bda-c622-438a-8e56-7589f17d7a6b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9037467e-0ff2-4d03-925e-8997a3759542, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9037467e-0ff2-4d03-925e-8997a3759542, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:27:31 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-582e3901-6c35-4c79-9f00-4ccf6779a065 tempest-VolumesAdminNegativeTest-215528111 tempest-VolumesAdminNegativeTest-215528111-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9037467e-0ff2-4d03-925e-8997a3759542, portal: 172.16.0.220,3260]
Nov 08 23:27:31 user nova-compute[75045]: Login to [iface: default, target: iqn.2010-10.org.openstack:9037467e-0ff2-4d03-925e-8997a3759542, portal: 172.16.0.220,3260] successful.
Nov 08 23:27:31 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:27:31 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9037467e-0ff2-4d03-925e-8997a3759542 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:27:31 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9037467e-0ff2-4d03-925e-8997a3759542 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:27:31 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[82d35c67-a9e8-4a1b-90d2-726445a12949]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:27:31 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-582e3901-6c35-4c79-9f00-4ccf6779a065 tempest-VolumesAdminNegativeTest-215528111 tempest-VolumesAdminNegativeTest-215528111-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:27:31 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:27:31 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:27:31 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[b44cccc4-19b0-4820-bbe8-0f40cf071f37]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c37da13-9531-458a-87cb-1e86e6b84f3a (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2e734fa-1dcb-4510-a50e-064e29c2985e (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04d02c98-d058-49d8-a350-ab9e63003d6e (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9037467e-0ff2-4d03-925e-8997a3759542 (non-flash)\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:27:31 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-582e3901-6c35-4c79-9f00-4ccf6779a065 tempest-VolumesAdminNegativeTest-215528111 tempest-VolumesAdminNegativeTest-215528111-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab (non-flash)
Nov 08 23:27:31 user nova-compute[75045]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c37da13-9531-458a-87cb-1e86e6b84f3a (non-flash)
Nov 08 23:27:31 user nova-compute[75045]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2e734fa-1dcb-4510-a50e-064e29c2985e (non-flash)
Nov 08 23:27:31 user nova-compute[75045]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04d02c98-d058-49d8-a350-ab9e63003d6e (non-flash)
Nov 08 23:27:31 user nova-compute[75045]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9037467e-0ff2-4d03-925e-8997a3759542 (non-flash)
Nov 08 23:27:31 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 23:27:31 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-582e3901-6c35-4c79-9f00-4ccf6779a065 tempest-VolumesAdminNegativeTest-215528111 tempest-VolumesAdminNegativeTest-215528111-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab (non-flash)
Nov 08 23:27:31 user nova-compute[75045]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c37da13-9531-458a-87cb-1e86e6b84f3a (non-flash)
Nov 08 23:27:31 user nova-compute[75045]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2e734fa-1dcb-4510-a50e-064e29c2985e (non-flash)
Nov 08 23:27:31 user nova-compute[75045]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04d02c98-d058-49d8-a350-ab9e63003d6e (non-flash)
Nov 08 23:27:31 user nova-compute[75045]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9037467e-0ff2-4d03-925e-8997a3759542 (non-flash)
Nov 08 23:27:31 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 23:27:31 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-582e3901-6c35-4c79-9f00-4ccf6779a065 tempest-VolumesAdminNegativeTest-215528111 tempest-VolumesAdminNegativeTest-215528111-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9037467e-0ff2-4d03-925e-8997a3759542" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.344s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 23:27:31 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-582e3901-6c35-4c79-9f00-4ccf6779a065 tempest-VolumesAdminNegativeTest-215528111 tempest-VolumesAdminNegativeTest-215528111-project-member] Connected to 172.16.0.220:3260 {{(pid=75045) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 23:27:31 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-582e3901-6c35-4c79-9f00-4ccf6779a065 tempest-VolumesAdminNegativeTest-215528111 tempest-VolumesAdminNegativeTest-215528111-project-member] HCTL ('34', '-', '-', 0) found on session 25 with lun 0 {{(pid=75045) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 23:27:31 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-582e3901-6c35-4c79-9f00-4ccf6779a065 tempest-VolumesAdminNegativeTest-215528111 tempest-VolumesAdminNegativeTest-215528111-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75045) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 23:27:31 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:27:31 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:27:31 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5742c45-2ac3-4dd1-943a-6eb93847c4ae]: (4, ('- - 0', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:27:31 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-582e3901-6c35-4c79-9f00-4ccf6779a065 tempest-VolumesAdminNegativeTest-215528111 tempest-VolumesAdminNegativeTest-215528111-project-member] Searching for a device in session 25 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75045) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 23:27:31 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-582e3901-6c35-4c79-9f00-4ccf6779a065 tempest-VolumesAdminNegativeTest-215528111 tempest-VolumesAdminNegativeTest-215528111-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:9037467e-0ff2-4d03-925e-8997a3759542', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'THZbgsEa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75045) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 23:27:32 user nova-compute[75045]: DEBUG nova.network.neutron [None req-af0b6bfd-6b19-452d-9d5b-6b346a83263e tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] [instance: b5fc7f02-2143-4bcf-92ac-078d5ec10747] Updating instance_info_cache with network_info: [{"id": "cde7cd95-3b8b-4980-8abc-be5c221a40ff", "address": "fa:16:3e:2d:09:a7", "network": {"id": "08d1669a-f667-4c79-8e49-0ad183f57046", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1863648032-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bbb640407ef94f568aea892f1834d6d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcde7cd95-3b", "ovs_interfaceid": "cde7cd95-3b8b-4980-8abc-be5c221a40ff", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75045) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 23:27:32 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-af0b6bfd-6b19-452d-9d5b-6b346a83263e tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] Releasing lock "refresh_cache-b5fc7f02-2143-4bcf-92ac-078d5ec10747" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 23:27:32 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:27:32 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:27:32 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-582e3901-6c35-4c79-9f00-4ccf6779a065 tempest-VolumesAdminNegativeTest-215528111 tempest-VolumesAdminNegativeTest-215528111-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.383s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 23:27:32 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-582e3901-6c35-4c79-9f00-4ccf6779a065 tempest-VolumesAdminNegativeTest-215528111 tempest-VolumesAdminNegativeTest-215528111-project-member] <== connect_volume: return (1386ms) {'type': 'block', 'scsi_wwn': '26331643663613962', 'path': '/dev/sdc'} {{(pid=75045) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 23:27:32 user nova-compute[75045]: DEBUG nova.virt.libvirt.volume.iscsi [None req-582e3901-6c35-4c79-9f00-4ccf6779a065 tempest-VolumesAdminNegativeTest-215528111 tempest-VolumesAdminNegativeTest-215528111-project-member] [instance: 7e92ab9a-8ea4-4452-a458-db181d4a59b7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26331643663613962', 'path': '/dev/sdc'} {{(pid=75045) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 23:27:32 user nova-compute[75045]: DEBUG nova.objects.instance [None req-582e3901-6c35-4c79-9f00-4ccf6779a065 tempest-VolumesAdminNegativeTest-215528111 tempest-VolumesAdminNegativeTest-215528111-project-member] Lazy-loading 'flavor' on Instance uuid 7e92ab9a-8ea4-4452-a458-db181d4a59b7 {{(pid=75045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 23:27:32 user nova-compute[75045]: DEBUG nova.virt.libvirt.guest [None req-582e3901-6c35-4c79-9f00-4ccf6779a065 tempest-VolumesAdminNegativeTest-215528111 tempest-VolumesAdminNegativeTest-215528111-project-member] attach device xml: <disk type="block" device="disk">
Nov 08 23:27:32 user nova-compute[75045]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 23:27:32 user nova-compute[75045]:   <source dev="/dev/sdc"/>
Nov 08 23:27:32 user nova-compute[75045]:   <target dev="vdb" bus="virtio"/>
Nov 08 23:27:32 user nova-compute[75045]:   <serial>9037467e-0ff2-4d03-925e-8997a3759542</serial>
Nov 08 23:27:32 user nova-compute[75045]: </disk>
Nov 08 23:27:32 user nova-compute[75045]:  {{(pid=75045) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 08 23:27:32 user nova-compute[75045]: DEBUG nova.compute.manager [req-c4f09b71-8b54-44ab-a79c-7e1ffd8b7658 req-5920146f-8758-49f0-b209-95816750ea0e service nova] [instance: b5fc7f02-2143-4bcf-92ac-078d5ec10747] Received event network-vif-unplugged-cde7cd95-3b8b-4980-8abc-be5c221a40ff {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:27:32 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-c4f09b71-8b54-44ab-a79c-7e1ffd8b7658 req-5920146f-8758-49f0-b209-95816750ea0e service nova] Acquiring lock "b5fc7f02-2143-4bcf-92ac-078d5ec10747-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:27:32 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-c4f09b71-8b54-44ab-a79c-7e1ffd8b7658 req-5920146f-8758-49f0-b209-95816750ea0e service nova] Lock "b5fc7f02-2143-4bcf-92ac-078d5ec10747-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:27:32 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-c4f09b71-8b54-44ab-a79c-7e1ffd8b7658 req-5920146f-8758-49f0-b209-95816750ea0e service nova] Lock "b5fc7f02-2143-4bcf-92ac-078d5ec10747-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:27:32 user nova-compute[75045]: DEBUG nova.compute.manager [req-c4f09b71-8b54-44ab-a79c-7e1ffd8b7658 req-5920146f-8758-49f0-b209-95816750ea0e service nova] [instance: b5fc7f02-2143-4bcf-92ac-078d5ec10747] No waiting events found dispatching network-vif-unplugged-cde7cd95-3b8b-4980-8abc-be5c221a40ff {{(pid=75045) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 23:27:32 user nova-compute[75045]: WARNING nova.compute.manager [req-c4f09b71-8b54-44ab-a79c-7e1ffd8b7658 req-5920146f-8758-49f0-b209-95816750ea0e service nova] [instance: b5fc7f02-2143-4bcf-92ac-078d5ec10747] Received unexpected event network-vif-unplugged-cde7cd95-3b8b-4980-8abc-be5c221a40ff for instance with vm_state active and task_state rescuing.
Nov 08 23:27:33 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:27:33 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:27:33 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-582e3901-6c35-4c79-9f00-4ccf6779a065 tempest-VolumesAdminNegativeTest-215528111 tempest-VolumesAdminNegativeTest-215528111-project-member] No BDM found with device name vda, not building metadata. {{(pid=75045) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 23:27:33 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-582e3901-6c35-4c79-9f00-4ccf6779a065 tempest-VolumesAdminNegativeTest-215528111 tempest-VolumesAdminNegativeTest-215528111-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75045) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 23:27:33 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-582e3901-6c35-4c79-9f00-4ccf6779a065 tempest-VolumesAdminNegativeTest-215528111 tempest-VolumesAdminNegativeTest-215528111-project-member] No VIF found with MAC fa:16:3e:13:a9:e5, not building metadata {{(pid=75045) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 23:27:33 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-582e3901-6c35-4c79-9f00-4ccf6779a065 tempest-VolumesAdminNegativeTest-215528111 tempest-VolumesAdminNegativeTest-215528111-project-member] Lock "7e92ab9a-8ea4-4452-a458-db181d4a59b7" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 27.669s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:27:33 user nova-compute[75045]: INFO nova.virt.libvirt.driver [-] [instance: b5fc7f02-2143-4bcf-92ac-078d5ec10747] Instance destroyed successfully.
Nov 08 23:27:33 user nova-compute[75045]: INFO nova.virt.libvirt.driver [None req-af0b6bfd-6b19-452d-9d5b-6b346a83263e tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] [instance: b5fc7f02-2143-4bcf-92ac-078d5ec10747] Attempting rescue
Nov 08 23:27:33 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-af0b6bfd-6b19-452d-9d5b-6b346a83263e tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75045) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 08 23:27:33 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-af0b6bfd-6b19-452d-9d5b-6b346a83263e tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] [instance: b5fc7f02-2143-4bcf-92ac-078d5ec10747] Instance directory exists: not creating {{(pid=75045) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 08 23:27:33 user nova-compute[75045]: INFO nova.virt.libvirt.driver [None req-af0b6bfd-6b19-452d-9d5b-6b346a83263e tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] [instance: b5fc7f02-2143-4bcf-92ac-078d5ec10747] Creating image(s)
Nov 08 23:27:33 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-af0b6bfd-6b19-452d-9d5b-6b346a83263e tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] Acquiring lock "/opt/stack/data/nova/instances/b5fc7f02-2143-4bcf-92ac-078d5ec10747/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:27:33 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-af0b6bfd-6b19-452d-9d5b-6b346a83263e tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] Lock "/opt/stack/data/nova/instances/b5fc7f02-2143-4bcf-92ac-078d5ec10747/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:27:33 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-af0b6bfd-6b19-452d-9d5b-6b346a83263e tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] Lock "/opt/stack/data/nova/instances/b5fc7f02-2143-4bcf-92ac-078d5ec10747/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:27:33 user nova-compute[75045]: DEBUG nova.objects.instance [None req-af0b6bfd-6b19-452d-9d5b-6b346a83263e tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] Lazy-loading 'trusted_certs' on Instance uuid b5fc7f02-2143-4bcf-92ac-078d5ec10747 {{(pid=75045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 23:27:33 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-af0b6bfd-6b19-452d-9d5b-6b346a83263e tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] Acquiring lock "b59f52a99fff51c56dd1edfb83892fb8f647f2f3" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:27:33 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-af0b6bfd-6b19-452d-9d5b-6b346a83263e tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] Lock "b59f52a99fff51c56dd1edfb83892fb8f647f2f3" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:27:33 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-af0b6bfd-6b19-452d-9d5b-6b346a83263e tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b59f52a99fff51c56dd1edfb83892fb8f647f2f3 --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:27:33 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-af0b6bfd-6b19-452d-9d5b-6b346a83263e tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b59f52a99fff51c56dd1edfb83892fb8f647f2f3 --force-share --output=json" returned: 0 in 0.184s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:27:33 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-af0b6bfd-6b19-452d-9d5b-6b346a83263e tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b59f52a99fff51c56dd1edfb83892fb8f647f2f3,backing_fmt=raw /opt/stack/data/nova/instances/b5fc7f02-2143-4bcf-92ac-078d5ec10747/disk.rescue {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:27:33 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-af0b6bfd-6b19-452d-9d5b-6b346a83263e tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b59f52a99fff51c56dd1edfb83892fb8f647f2f3,backing_fmt=raw /opt/stack/data/nova/instances/b5fc7f02-2143-4bcf-92ac-078d5ec10747/disk.rescue" returned: 0 in 0.059s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:27:33 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-af0b6bfd-6b19-452d-9d5b-6b346a83263e tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] Lock "b59f52a99fff51c56dd1edfb83892fb8f647f2f3" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.254s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:27:33 user nova-compute[75045]: DEBUG nova.objects.instance [None req-af0b6bfd-6b19-452d-9d5b-6b346a83263e tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] Lazy-loading 'migration_context' on Instance uuid b5fc7f02-2143-4bcf-92ac-078d5ec10747 {{(pid=75045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 23:27:33 user nova-compute[75045]: DEBUG nova.objects.base [None req-af0b6bfd-6b19-452d-9d5b-6b346a83263e tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] Object Instance<b5fc7f02-2143-4bcf-92ac-078d5ec10747> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75045) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 23:27:33 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-af0b6bfd-6b19-452d-9d5b-6b346a83263e tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] [instance: b5fc7f02-2143-4bcf-92ac-078d5ec10747] Created local disks {{(pid=75045) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 23:27:33 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-af0b6bfd-6b19-452d-9d5b-6b346a83263e tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] [instance: b5fc7f02-2143-4bcf-92ac-078d5ec10747] Start _get_guest_xml network_info=[{"id": "cde7cd95-3b8b-4980-8abc-be5c221a40ff", "address": "fa:16:3e:2d:09:a7", "network": {"id": "08d1669a-f667-4c79-8e49-0ad183f57046", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1863648032-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1863648032-network", "vif_mac": "fa:16:3e:2d:09:a7"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bbb640407ef94f568aea892f1834d6d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcde7cd95-3b", "ovs_interfaceid": "cde7cd95-3b8b-4980-8abc-be5c221a40ff", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T23:11:54Z,direct_url=<?>,disk_format='qcow2',id=a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b1beba2cc4e7465ea249e2225fb494dc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T23:11:56Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=75045) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 23:27:33 user nova-compute[75045]: DEBUG nova.objects.instance [None req-af0b6bfd-6b19-452d-9d5b-6b346a83263e tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] Lazy-loading 'resources' on Instance uuid b5fc7f02-2143-4bcf-92ac-078d5ec10747 {{(pid=75045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 23:27:34 user nova-compute[75045]: DEBUG nova.objects.base [None req-af0b6bfd-6b19-452d-9d5b-6b346a83263e tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] Object Instance<b5fc7f02-2143-4bcf-92ac-078d5ec10747> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75045) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 23:27:34 user nova-compute[75045]: DEBUG nova.objects.instance [None req-af0b6bfd-6b19-452d-9d5b-6b346a83263e tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] Lazy-loading 'numa_topology' on Instance uuid b5fc7f02-2143-4bcf-92ac-078d5ec10747 {{(pid=75045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 23:27:34 user nova-compute[75045]: DEBUG nova.objects.base [None req-af0b6bfd-6b19-452d-9d5b-6b346a83263e tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] Object Instance<b5fc7f02-2143-4bcf-92ac-078d5ec10747> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75045) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 23:27:34 user nova-compute[75045]: WARNING nova.virt.libvirt.driver [None req-af0b6bfd-6b19-452d-9d5b-6b346a83263e tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 23:27:34 user nova-compute[75045]: WARNING nova.virt.libvirt.driver [None req-af0b6bfd-6b19-452d-9d5b-6b346a83263e tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 23:27:34 user nova-compute[75045]: DEBUG nova.virt.libvirt.host [None req-af0b6bfd-6b19-452d-9d5b-6b346a83263e tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75045) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 23:27:34 user nova-compute[75045]: DEBUG nova.virt.libvirt.host [None req-af0b6bfd-6b19-452d-9d5b-6b346a83263e tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] CPU controller missing on host. {{(pid=75045) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 23:27:34 user nova-compute[75045]: DEBUG nova.virt.libvirt.host [None req-af0b6bfd-6b19-452d-9d5b-6b346a83263e tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75045) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 23:27:34 user nova-compute[75045]: DEBUG nova.virt.libvirt.host [None req-af0b6bfd-6b19-452d-9d5b-6b346a83263e tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] CPU controller found on host. {{(pid=75045) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 23:27:34 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-af0b6bfd-6b19-452d-9d5b-6b346a83263e tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75045) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 23:27:34 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-af0b6bfd-6b19-452d-9d5b-6b346a83263e tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T23:11:41Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T23:11:54Z,direct_url=<?>,disk_format='qcow2',id=a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b1beba2cc4e7465ea249e2225fb494dc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T23:11:56Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75045) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 23:27:34 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-af0b6bfd-6b19-452d-9d5b-6b346a83263e tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] Flavor limits 0:0:0 {{(pid=75045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 23:27:34 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-af0b6bfd-6b19-452d-9d5b-6b346a83263e tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] Image limits 0:0:0 {{(pid=75045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 23:27:34 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-af0b6bfd-6b19-452d-9d5b-6b346a83263e tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] Flavor pref 0:0:0 {{(pid=75045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 23:27:34 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-af0b6bfd-6b19-452d-9d5b-6b346a83263e tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] Image pref 0:0:0 {{(pid=75045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 23:27:34 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-af0b6bfd-6b19-452d-9d5b-6b346a83263e tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 23:27:34 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-af0b6bfd-6b19-452d-9d5b-6b346a83263e tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75045) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 23:27:34 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-af0b6bfd-6b19-452d-9d5b-6b346a83263e tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75045) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 23:27:34 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-af0b6bfd-6b19-452d-9d5b-6b346a83263e tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] Got 1 possible topologies {{(pid=75045) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 23:27:34 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-af0b6bfd-6b19-452d-9d5b-6b346a83263e tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75045) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 23:27:34 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-af0b6bfd-6b19-452d-9d5b-6b346a83263e tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75045) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 23:27:34 user nova-compute[75045]: DEBUG nova.objects.instance [None req-af0b6bfd-6b19-452d-9d5b-6b346a83263e tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] Lazy-loading 'vcpu_model' on Instance uuid b5fc7f02-2143-4bcf-92ac-078d5ec10747 {{(pid=75045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 23:27:34 user nova-compute[75045]: DEBUG nova.objects.base [None req-af0b6bfd-6b19-452d-9d5b-6b346a83263e tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] Object Instance<b5fc7f02-2143-4bcf-92ac-078d5ec10747> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75045) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 23:27:34 user nova-compute[75045]: DEBUG nova.virt.libvirt.vif [None req-af0b6bfd-6b19-452d-9d5b-6b346a83263e tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T23:22:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1199401266',display_name='tempest-ServerRescueNegativeTestJSON-server-1199401266',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1199401266',id=19,image_ref='a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-08T23:22:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bbb640407ef94f568aea892f1834d6d1',ramdisk_id='',reservation_id='r-h0qi02cc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-187452128',owner_user_name='tempest-ServerRescueNegativeTestJSON-187452128-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T23:22:44Z,user_data=None,user_id='f16e465ffb49488db3de445a473fd77a',uuid=b5fc7f02-2143-4bcf-92ac-078d5ec10747,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cde7cd95-3b8b-4980-8abc-be5c221a40ff", "address": "fa:16:3e:2d:09:a7", "network": {"id": "08d1669a-f667-4c79-8e49-0ad183f57046", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1863648032-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1863648032-network", "vif_mac": "fa:16:3e:2d:09:a7"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bbb640407ef94f568aea892f1834d6d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcde7cd95-3b", "ovs_interfaceid": "cde7cd95-3b8b-4980-8abc-be5c221a40ff", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75045) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 23:27:34 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-af0b6bfd-6b19-452d-9d5b-6b346a83263e tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] Converting VIF {"id": "cde7cd95-3b8b-4980-8abc-be5c221a40ff", "address": "fa:16:3e:2d:09:a7", "network": {"id": "08d1669a-f667-4c79-8e49-0ad183f57046", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1863648032-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1863648032-network", "vif_mac": "fa:16:3e:2d:09:a7"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bbb640407ef94f568aea892f1834d6d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcde7cd95-3b", "ovs_interfaceid": "cde7cd95-3b8b-4980-8abc-be5c221a40ff", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 23:27:34 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-af0b6bfd-6b19-452d-9d5b-6b346a83263e tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2d:09:a7,bridge_name='br-int',has_traffic_filtering=True,id=cde7cd95-3b8b-4980-8abc-be5c221a40ff,network=Network(08d1669a-f667-4c79-8e49-0ad183f57046),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcde7cd95-3b') {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 23:27:34 user nova-compute[75045]: DEBUG nova.objects.instance [None req-af0b6bfd-6b19-452d-9d5b-6b346a83263e tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] Lazy-loading 'pci_devices' on Instance uuid b5fc7f02-2143-4bcf-92ac-078d5ec10747 {{(pid=75045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 23:27:34 user nova-compute[75045]: DEBUG nova.objects.base [None req-af0b6bfd-6b19-452d-9d5b-6b346a83263e tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] Object Instance<b5fc7f02-2143-4bcf-92ac-078d5ec10747> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75045) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 23:27:34 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-af0b6bfd-6b19-452d-9d5b-6b346a83263e tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] [instance: b5fc7f02-2143-4bcf-92ac-078d5ec10747] End _get_guest_xml xml=<domain type="kvm">
Nov 08 23:27:34 user nova-compute[75045]:   <uuid>b5fc7f02-2143-4bcf-92ac-078d5ec10747</uuid>
Nov 08 23:27:34 user nova-compute[75045]:   <name>instance-00000013</name>
Nov 08 23:27:34 user nova-compute[75045]:   <memory>524288</memory>
Nov 08 23:27:34 user nova-compute[75045]:   <vcpu>1</vcpu>
Nov 08 23:27:34 user nova-compute[75045]:   <metadata>
Nov 08 23:27:34 user nova-compute[75045]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 23:27:34 user nova-compute[75045]:       <nova:package version="0.0.0"/>
Nov 08 23:27:34 user nova-compute[75045]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1199401266</nova:name>
Nov 08 23:27:34 user nova-compute[75045]:       <nova:creationTime>2023-11-08 23:27:34</nova:creationTime>
Nov 08 23:27:34 user nova-compute[75045]:       <nova:flavor name="m1.tiny">
Nov 08 23:27:34 user nova-compute[75045]:         <nova:memory>512</nova:memory>
Nov 08 23:27:34 user nova-compute[75045]:         <nova:disk>1</nova:disk>
Nov 08 23:27:34 user nova-compute[75045]:         <nova:swap>0</nova:swap>
Nov 08 23:27:34 user nova-compute[75045]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 23:27:34 user nova-compute[75045]:         <nova:vcpus>1</nova:vcpus>
Nov 08 23:27:34 user nova-compute[75045]:       </nova:flavor>
Nov 08 23:27:34 user nova-compute[75045]:       <nova:owner>
Nov 08 23:27:34 user nova-compute[75045]:         <nova:user uuid="f16e465ffb49488db3de445a473fd77a">tempest-ServerRescueNegativeTestJSON-187452128-project-member</nova:user>
Nov 08 23:27:34 user nova-compute[75045]:         <nova:project uuid="bbb640407ef94f568aea892f1834d6d1">tempest-ServerRescueNegativeTestJSON-187452128</nova:project>
Nov 08 23:27:34 user nova-compute[75045]:       </nova:owner>
Nov 08 23:27:34 user nova-compute[75045]:       <nova:root type="image" uuid="a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb"/>
Nov 08 23:27:34 user nova-compute[75045]:       <nova:ports>
Nov 08 23:27:34 user nova-compute[75045]:         <nova:port uuid="cde7cd95-3b8b-4980-8abc-be5c221a40ff">
Nov 08 23:27:34 user nova-compute[75045]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 08 23:27:34 user nova-compute[75045]:         </nova:port>
Nov 08 23:27:34 user nova-compute[75045]:       </nova:ports>
Nov 08 23:27:34 user nova-compute[75045]:     </nova:instance>
Nov 08 23:27:34 user nova-compute[75045]:   </metadata>
Nov 08 23:27:34 user nova-compute[75045]:   <sysinfo type="smbios">
Nov 08 23:27:34 user nova-compute[75045]:     <system>
Nov 08 23:27:34 user nova-compute[75045]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 23:27:34 user nova-compute[75045]:       <entry name="product">OpenStack Nova</entry>
Nov 08 23:27:34 user nova-compute[75045]:       <entry name="version">0.0.0</entry>
Nov 08 23:27:34 user nova-compute[75045]:       <entry name="serial">b5fc7f02-2143-4bcf-92ac-078d5ec10747</entry>
Nov 08 23:27:34 user nova-compute[75045]:       <entry name="uuid">b5fc7f02-2143-4bcf-92ac-078d5ec10747</entry>
Nov 08 23:27:34 user nova-compute[75045]:       <entry name="family">Virtual Machine</entry>
Nov 08 23:27:34 user nova-compute[75045]:     </system>
Nov 08 23:27:34 user nova-compute[75045]:   </sysinfo>
Nov 08 23:27:34 user nova-compute[75045]:   <os>
Nov 08 23:27:34 user nova-compute[75045]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 23:27:34 user nova-compute[75045]:     <smbios mode="sysinfo"/>
Nov 08 23:27:34 user nova-compute[75045]:   </os>
Nov 08 23:27:34 user nova-compute[75045]:   <features>
Nov 08 23:27:34 user nova-compute[75045]:     <acpi/>
Nov 08 23:27:34 user nova-compute[75045]:     <apic/>
Nov 08 23:27:34 user nova-compute[75045]:     <vmcoreinfo/>
Nov 08 23:27:34 user nova-compute[75045]:   </features>
Nov 08 23:27:34 user nova-compute[75045]:   <clock offset="utc">
Nov 08 23:27:34 user nova-compute[75045]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 23:27:34 user nova-compute[75045]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 23:27:34 user nova-compute[75045]:     <timer name="hpet" present="no"/>
Nov 08 23:27:34 user nova-compute[75045]:   </clock>
Nov 08 23:27:34 user nova-compute[75045]:   <cpu mode="custom" match="exact">
Nov 08 23:27:34 user nova-compute[75045]:     <model>Nehalem</model>
Nov 08 23:27:34 user nova-compute[75045]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 23:27:34 user nova-compute[75045]:   </cpu>
Nov 08 23:27:34 user nova-compute[75045]:   <devices>
Nov 08 23:27:34 user nova-compute[75045]:     <disk type="file" device="disk">
Nov 08 23:27:34 user nova-compute[75045]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 23:27:34 user nova-compute[75045]:       <source file="/opt/stack/data/nova/instances/b5fc7f02-2143-4bcf-92ac-078d5ec10747/disk.rescue"/>
Nov 08 23:27:34 user nova-compute[75045]:       <target dev="vda" bus="virtio"/>
Nov 08 23:27:34 user nova-compute[75045]:     </disk>
Nov 08 23:27:34 user nova-compute[75045]:     <disk type="file" device="disk">
Nov 08 23:27:34 user nova-compute[75045]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 23:27:34 user nova-compute[75045]:       <source file="/opt/stack/data/nova/instances/b5fc7f02-2143-4bcf-92ac-078d5ec10747/disk"/>
Nov 08 23:27:34 user nova-compute[75045]:       <target dev="vdb" bus="virtio"/>
Nov 08 23:27:34 user nova-compute[75045]:     </disk>
Nov 08 23:27:34 user nova-compute[75045]:     <interface type="ethernet">
Nov 08 23:27:34 user nova-compute[75045]:       <mac address="fa:16:3e:2d:09:a7"/>
Nov 08 23:27:34 user nova-compute[75045]:       <model type="virtio"/>
Nov 08 23:27:34 user nova-compute[75045]:       <mtu size="1442"/>
Nov 08 23:27:34 user nova-compute[75045]:       <target dev="tapcde7cd95-3b"/>
Nov 08 23:27:34 user nova-compute[75045]:     </interface>
Nov 08 23:27:34 user nova-compute[75045]:     <serial type="pty">
Nov 08 23:27:34 user nova-compute[75045]:       <log file="/opt/stack/data/nova/instances/b5fc7f02-2143-4bcf-92ac-078d5ec10747/console.log" append="off"/>
Nov 08 23:27:34 user nova-compute[75045]:     </serial>
Nov 08 23:27:34 user nova-compute[75045]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 23:27:34 user nova-compute[75045]:     <video>
Nov 08 23:27:34 user nova-compute[75045]:       <model type="virtio"/>
Nov 08 23:27:34 user nova-compute[75045]:     </video>
Nov 08 23:27:34 user nova-compute[75045]:     <rng model="virtio">
Nov 08 23:27:34 user nova-compute[75045]:       <backend model="random">/dev/urandom</backend>
Nov 08 23:27:34 user nova-compute[75045]:     </rng>
Nov 08 23:27:34 user nova-compute[75045]:     <controller type="usb" index="0" model="none"/>
Nov 08 23:27:34 user nova-compute[75045]:     <memballoon model="virtio">
Nov 08 23:27:34 user nova-compute[75045]:       <stats period="10"/>
Nov 08 23:27:34 user nova-compute[75045]:     </memballoon>
Nov 08 23:27:34 user nova-compute[75045]:   </devices>
Nov 08 23:27:34 user nova-compute[75045]: </domain>
Nov 08 23:27:34 user nova-compute[75045]:  {{(pid=75045) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 23:27:34 user nova-compute[75045]: INFO nova.virt.libvirt.driver [-] [instance: b5fc7f02-2143-4bcf-92ac-078d5ec10747] Instance destroyed successfully.
Nov 08 23:27:34 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-af0b6bfd-6b19-452d-9d5b-6b346a83263e tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] No BDM found with device name vda, not building metadata. {{(pid=75045) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 23:27:34 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-af0b6bfd-6b19-452d-9d5b-6b346a83263e tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75045) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 23:27:34 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-af0b6bfd-6b19-452d-9d5b-6b346a83263e tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] No VIF found with MAC fa:16:3e:2d:09:a7, not building metadata {{(pid=75045) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 23:27:34 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-dd229295-ac54-4ee5-9d41-f9d012d9611b tempest-VolumesAdminNegativeTest-215528111 tempest-VolumesAdminNegativeTest-215528111-project-member] Acquiring lock "7e92ab9a-8ea4-4452-a458-db181d4a59b7" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:27:34 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-dd229295-ac54-4ee5-9d41-f9d012d9611b tempest-VolumesAdminNegativeTest-215528111 tempest-VolumesAdminNegativeTest-215528111-project-member] Lock "7e92ab9a-8ea4-4452-a458-db181d4a59b7" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:27:34 user nova-compute[75045]: INFO nova.compute.manager [None req-dd229295-ac54-4ee5-9d41-f9d012d9611b tempest-VolumesAdminNegativeTest-215528111 tempest-VolumesAdminNegativeTest-215528111-project-member] [instance: 7e92ab9a-8ea4-4452-a458-db181d4a59b7] Detaching volume 9037467e-0ff2-4d03-925e-8997a3759542
Nov 08 23:27:35 user nova-compute[75045]: INFO nova.virt.block_device [None req-dd229295-ac54-4ee5-9d41-f9d012d9611b tempest-VolumesAdminNegativeTest-215528111 tempest-VolumesAdminNegativeTest-215528111-project-member] [instance: 7e92ab9a-8ea4-4452-a458-db181d4a59b7] Attempting to driver detach volume 9037467e-0ff2-4d03-925e-8997a3759542 from mountpoint /dev/vdb
Nov 08 23:27:35 user nova-compute[75045]: DEBUG nova.compute.manager [req-af0c046d-affd-4b38-bf3f-73b0d921e03a req-e0ba0159-cb49-4e4d-8f40-746af8ca01a9 service nova] [instance: b5fc7f02-2143-4bcf-92ac-078d5ec10747] Received event network-vif-plugged-cde7cd95-3b8b-4980-8abc-be5c221a40ff {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:27:35 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-af0c046d-affd-4b38-bf3f-73b0d921e03a req-e0ba0159-cb49-4e4d-8f40-746af8ca01a9 service nova] Acquiring lock "b5fc7f02-2143-4bcf-92ac-078d5ec10747-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:27:35 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-af0c046d-affd-4b38-bf3f-73b0d921e03a req-e0ba0159-cb49-4e4d-8f40-746af8ca01a9 service nova] Lock "b5fc7f02-2143-4bcf-92ac-078d5ec10747-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:27:35 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-af0c046d-affd-4b38-bf3f-73b0d921e03a req-e0ba0159-cb49-4e4d-8f40-746af8ca01a9 service nova] Lock "b5fc7f02-2143-4bcf-92ac-078d5ec10747-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:27:35 user nova-compute[75045]: DEBUG nova.compute.manager [req-af0c046d-affd-4b38-bf3f-73b0d921e03a req-e0ba0159-cb49-4e4d-8f40-746af8ca01a9 service nova] [instance: b5fc7f02-2143-4bcf-92ac-078d5ec10747] No waiting events found dispatching network-vif-plugged-cde7cd95-3b8b-4980-8abc-be5c221a40ff {{(pid=75045) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 23:27:35 user nova-compute[75045]: WARNING nova.compute.manager [req-af0c046d-affd-4b38-bf3f-73b0d921e03a req-e0ba0159-cb49-4e4d-8f40-746af8ca01a9 service nova] [instance: b5fc7f02-2143-4bcf-92ac-078d5ec10747] Received unexpected event network-vif-plugged-cde7cd95-3b8b-4980-8abc-be5c221a40ff for instance with vm_state active and task_state rescuing.
Nov 08 23:27:35 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-dd229295-ac54-4ee5-9d41-f9d012d9611b tempest-VolumesAdminNegativeTest-215528111 tempest-VolumesAdminNegativeTest-215528111-project-member] Attempting to detach device vdb from instance 7e92ab9a-8ea4-4452-a458-db181d4a59b7 from the persistent domain config. {{(pid=75045) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 08 23:27:35 user nova-compute[75045]: DEBUG nova.virt.libvirt.guest [None req-dd229295-ac54-4ee5-9d41-f9d012d9611b tempest-VolumesAdminNegativeTest-215528111 tempest-VolumesAdminNegativeTest-215528111-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 23:27:35 user nova-compute[75045]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 23:27:35 user nova-compute[75045]:   <source dev="/dev/sdc"/>
Nov 08 23:27:35 user nova-compute[75045]:   <target dev="vdb" bus="virtio"/>
Nov 08 23:27:35 user nova-compute[75045]:   <serial>9037467e-0ff2-4d03-925e-8997a3759542</serial>
Nov 08 23:27:35 user nova-compute[75045]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 08 23:27:35 user nova-compute[75045]: </disk>
Nov 08 23:27:35 user nova-compute[75045]:  {{(pid=75045) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 23:27:35 user nova-compute[75045]: INFO nova.virt.libvirt.driver [None req-dd229295-ac54-4ee5-9d41-f9d012d9611b tempest-VolumesAdminNegativeTest-215528111 tempest-VolumesAdminNegativeTest-215528111-project-member] Successfully detached device vdb from instance 7e92ab9a-8ea4-4452-a458-db181d4a59b7 from the persistent domain config.
Nov 08 23:27:35 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-dd229295-ac54-4ee5-9d41-f9d012d9611b tempest-VolumesAdminNegativeTest-215528111 tempest-VolumesAdminNegativeTest-215528111-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 7e92ab9a-8ea4-4452-a458-db181d4a59b7 from the live domain config. {{(pid=75045) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 08 23:27:35 user nova-compute[75045]: DEBUG nova.virt.libvirt.guest [None req-dd229295-ac54-4ee5-9d41-f9d012d9611b tempest-VolumesAdminNegativeTest-215528111 tempest-VolumesAdminNegativeTest-215528111-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 23:27:35 user nova-compute[75045]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 23:27:35 user nova-compute[75045]:   <source dev="/dev/sdc"/>
Nov 08 23:27:35 user nova-compute[75045]:   <target dev="vdb" bus="virtio"/>
Nov 08 23:27:35 user nova-compute[75045]:   <serial>9037467e-0ff2-4d03-925e-8997a3759542</serial>
Nov 08 23:27:35 user nova-compute[75045]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 08 23:27:35 user nova-compute[75045]: </disk>
Nov 08 23:27:35 user nova-compute[75045]:  {{(pid=75045) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 23:27:35 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-dd229295-ac54-4ee5-9d41-f9d012d9611b tempest-VolumesAdminNegativeTest-215528111 tempest-VolumesAdminNegativeTest-215528111-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 7e92ab9a-8ea4-4452-a458-db181d4a59b7 {{(pid=75045) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 08 23:27:36 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:27:36 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:27:36 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:27:36 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:27:36 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:27:36 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:27:36 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:27:36 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:27:36 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:27:37 user nova-compute[75045]: DEBUG nova.compute.manager [req-d12f7dd8-55d9-4f0c-b839-30d1808ad34e req-fc79f394-2ce6-419a-aded-dfa55c0a0a67 service nova] [instance: b5fc7f02-2143-4bcf-92ac-078d5ec10747] Received event network-vif-plugged-cde7cd95-3b8b-4980-8abc-be5c221a40ff {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:27:37 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-d12f7dd8-55d9-4f0c-b839-30d1808ad34e req-fc79f394-2ce6-419a-aded-dfa55c0a0a67 service nova] Acquiring lock "b5fc7f02-2143-4bcf-92ac-078d5ec10747-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:27:37 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-d12f7dd8-55d9-4f0c-b839-30d1808ad34e req-fc79f394-2ce6-419a-aded-dfa55c0a0a67 service nova] Lock "b5fc7f02-2143-4bcf-92ac-078d5ec10747-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:27:37 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-d12f7dd8-55d9-4f0c-b839-30d1808ad34e req-fc79f394-2ce6-419a-aded-dfa55c0a0a67 service nova] Lock "b5fc7f02-2143-4bcf-92ac-078d5ec10747-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:27:37 user nova-compute[75045]: DEBUG nova.compute.manager [req-d12f7dd8-55d9-4f0c-b839-30d1808ad34e req-fc79f394-2ce6-419a-aded-dfa55c0a0a67 service nova] [instance: b5fc7f02-2143-4bcf-92ac-078d5ec10747] No waiting events found dispatching network-vif-plugged-cde7cd95-3b8b-4980-8abc-be5c221a40ff {{(pid=75045) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 23:27:37 user nova-compute[75045]: WARNING nova.compute.manager [req-d12f7dd8-55d9-4f0c-b839-30d1808ad34e req-fc79f394-2ce6-419a-aded-dfa55c0a0a67 service nova] [instance: b5fc7f02-2143-4bcf-92ac-078d5ec10747] Received unexpected event network-vif-plugged-cde7cd95-3b8b-4980-8abc-be5c221a40ff for instance with vm_state active and task_state rescuing.
Nov 08 23:27:37 user nova-compute[75045]: DEBUG nova.compute.manager [req-d12f7dd8-55d9-4f0c-b839-30d1808ad34e req-fc79f394-2ce6-419a-aded-dfa55c0a0a67 service nova] [instance: b5fc7f02-2143-4bcf-92ac-078d5ec10747] Received event network-vif-plugged-cde7cd95-3b8b-4980-8abc-be5c221a40ff {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:27:37 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-d12f7dd8-55d9-4f0c-b839-30d1808ad34e req-fc79f394-2ce6-419a-aded-dfa55c0a0a67 service nova] Acquiring lock "b5fc7f02-2143-4bcf-92ac-078d5ec10747-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:27:37 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-d12f7dd8-55d9-4f0c-b839-30d1808ad34e req-fc79f394-2ce6-419a-aded-dfa55c0a0a67 service nova] Lock "b5fc7f02-2143-4bcf-92ac-078d5ec10747-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:27:37 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-d12f7dd8-55d9-4f0c-b839-30d1808ad34e req-fc79f394-2ce6-419a-aded-dfa55c0a0a67 service nova] Lock "b5fc7f02-2143-4bcf-92ac-078d5ec10747-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:27:37 user nova-compute[75045]: DEBUG nova.compute.manager [req-d12f7dd8-55d9-4f0c-b839-30d1808ad34e req-fc79f394-2ce6-419a-aded-dfa55c0a0a67 service nova] [instance: b5fc7f02-2143-4bcf-92ac-078d5ec10747] No waiting events found dispatching network-vif-plugged-cde7cd95-3b8b-4980-8abc-be5c221a40ff {{(pid=75045) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 23:27:37 user nova-compute[75045]: WARNING nova.compute.manager [req-d12f7dd8-55d9-4f0c-b839-30d1808ad34e req-fc79f394-2ce6-419a-aded-dfa55c0a0a67 service nova] [instance: b5fc7f02-2143-4bcf-92ac-078d5ec10747] Received unexpected event network-vif-plugged-cde7cd95-3b8b-4980-8abc-be5c221a40ff for instance with vm_state active and task_state rescuing.
Nov 08 23:27:38 user nova-compute[75045]: DEBUG nova.compute.manager [None req-af0b6bfd-6b19-452d-9d5b-6b346a83263e tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] [instance: b5fc7f02-2143-4bcf-92ac-078d5ec10747] Checking state {{(pid=75045) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 23:27:38 user nova-compute[75045]: DEBUG nova.virt.libvirt.volume.iscsi [None req-66ff41ca-8af0-4363-9fd2-c5d348eae26c tempest-TestStampPattern-2120781434 tempest-TestStampPattern-2120781434-project-member] [instance: 72c9d731-2b35-434c-8463-1cd6c18fbd6a] Calling os-brick to attach iSCSI Volume {{(pid=75045) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 23:27:38 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-66ff41ca-8af0-4363-9fd2-c5d348eae26c tempest-TestStampPattern-2120781434 tempest-TestStampPattern-2120781434-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1b68210460>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a42d9799-d775-4120-8af0-bc81a6278ea7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rwdMtfnR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75045) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 23:27:38 user nova-compute[75045]: WARNING os_brick.initiator.connectors.base [None req-66ff41ca-8af0-4363-9fd2-c5d348eae26c tempest-TestStampPattern-2120781434 tempest-TestStampPattern-2120781434-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 23:27:38 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-66ff41ca-8af0-4363-9fd2-c5d348eae26c tempest-TestStampPattern-2120781434 tempest-TestStampPattern-2120781434-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 23:27:38 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-66ff41ca-8af0-4363-9fd2-c5d348eae26c tempest-TestStampPattern-2120781434 tempest-TestStampPattern-2120781434-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 23:27:38 user nova-compute[75045]: WARNING os_brick.initiator.connectors.base [None req-66ff41ca-8af0-4363-9fd2-c5d348eae26c tempest-TestStampPattern-2120781434 tempest-TestStampPattern-2120781434-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 23:27:38 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-66ff41ca-8af0-4363-9fd2-c5d348eae26c tempest-TestStampPattern-2120781434 tempest-TestStampPattern-2120781434-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a42d9799-d775-4120-8af0-bc81a6278ea7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 23:27:38 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-66ff41ca-8af0-4363-9fd2-c5d348eae26c tempest-TestStampPattern-2120781434 tempest-TestStampPattern-2120781434-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a42d9799-d775-4120-8af0-bc81a6278ea7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 23:27:38 user nova-compute[75045]: INFO os_brick.initiator.connectors.iscsi [None req-66ff41ca-8af0-4363-9fd2-c5d348eae26c tempest-TestStampPattern-2120781434 tempest-TestStampPattern-2120781434-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 23:27:38 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a42d9799-d775-4120-8af0-bc81a6278ea7 -p 172.16.0.220:3260 {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:27:38 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a42d9799-d775-4120-8af0-bc81a6278ea7 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:27:38 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3533f59-7766-40df-a52d-144f43e0fe21]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:27:38 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-66ff41ca-8af0-4363-9fd2-c5d348eae26c tempest-TestStampPattern-2120781434 tempest-TestStampPattern-2120781434-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 23:27:38 user nova-compute[75045]:  {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:27:38 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a42d9799-d775-4120-8af0-bc81a6278ea7 -p 172.16.0.220:3260 --interface default --op new {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:27:38 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a42d9799-d775-4120-8af0-bc81a6278ea7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:27:38 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[354b7777-6c1c-4b12-8078-8201aa8d8baa]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a42d9799-d775-4120-8af0-bc81a6278ea7] added\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:27:38 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-66ff41ca-8af0-4363-9fd2-c5d348eae26c tempest-TestStampPattern-2120781434 tempest-TestStampPattern-2120781434-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a42d9799-d775-4120-8af0-bc81a6278ea7] added
Nov 08 23:27:38 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:27:38 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a42d9799-d775-4120-8af0-bc81a6278ea7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:27:38 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a42d9799-d775-4120-8af0-bc81a6278ea7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:27:38 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[528b5aa2-8888-4d35-a6ed-2ecc407121e8]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:27:38 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-66ff41ca-8af0-4363-9fd2-c5d348eae26c tempest-TestStampPattern-2120781434 tempest-TestStampPattern-2120781434-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:27:38 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a42d9799-d775-4120-8af0-bc81a6278ea7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:27:38 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a42d9799-d775-4120-8af0-bc81a6278ea7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:27:38 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[937cf1a2-0ee4-42e2-b556-0c6ba34406c5]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:27:38 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-66ff41ca-8af0-4363-9fd2-c5d348eae26c tempest-TestStampPattern-2120781434 tempest-TestStampPattern-2120781434-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:27:38 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a42d9799-d775-4120-8af0-bc81a6278ea7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rwdMtfnR {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:27:38 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a42d9799-d775-4120-8af0-bc81a6278ea7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rwdMtfnR" returned: 0 in 0.026s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:27:38 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[71303575-6b95-4304-9cb0-bef6d27df8f0]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:27:38 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-66ff41ca-8af0-4363-9fd2-c5d348eae26c tempest-TestStampPattern-2120781434 tempest-TestStampPattern-2120781434-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'rwdMtfnR'): stdout= stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:27:38 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a42d9799-d775-4120-8af0-bc81a6278ea7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:27:38 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a42d9799-d775-4120-8af0-bc81a6278ea7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:27:38 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[7355be64-101e-4287-b595-f2dd20367883]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:27:38 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-66ff41ca-8af0-4363-9fd2-c5d348eae26c tempest-TestStampPattern-2120781434 tempest-TestStampPattern-2120781434-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:27:38 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:27:38 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:27:38 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[f262cbc1-bc4c-44a6-88ad-a29f072a31c8]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c37da13-9531-458a-87cb-1e86e6b84f3a (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2e734fa-1dcb-4510-a50e-064e29c2985e (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04d02c98-d058-49d8-a350-ab9e63003d6e (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9037467e-0ff2-4d03-925e-8997a3759542 (non-flash)\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:27:38 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-66ff41ca-8af0-4363-9fd2-c5d348eae26c tempest-TestStampPattern-2120781434 tempest-TestStampPattern-2120781434-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab (non-flash)
Nov 08 23:27:38 user nova-compute[75045]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c37da13-9531-458a-87cb-1e86e6b84f3a (non-flash)
Nov 08 23:27:38 user nova-compute[75045]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2e734fa-1dcb-4510-a50e-064e29c2985e (non-flash)
Nov 08 23:27:38 user nova-compute[75045]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04d02c98-d058-49d8-a350-ab9e63003d6e (non-flash)
Nov 08 23:27:38 user nova-compute[75045]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9037467e-0ff2-4d03-925e-8997a3759542 (non-flash)
Nov 08 23:27:38 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 23:27:38 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-66ff41ca-8af0-4363-9fd2-c5d348eae26c tempest-TestStampPattern-2120781434 tempest-TestStampPattern-2120781434-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab (non-flash)
Nov 08 23:27:38 user nova-compute[75045]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c37da13-9531-458a-87cb-1e86e6b84f3a (non-flash)
Nov 08 23:27:38 user nova-compute[75045]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2e734fa-1dcb-4510-a50e-064e29c2985e (non-flash)
Nov 08 23:27:38 user nova-compute[75045]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04d02c98-d058-49d8-a350-ab9e63003d6e (non-flash)
Nov 08 23:27:38 user nova-compute[75045]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9037467e-0ff2-4d03-925e-8997a3759542 (non-flash)
Nov 08 23:27:38 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 23:27:38 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a42d9799-d775-4120-8af0-bc81a6278ea7 -p 172.16.0.220:3260 --login {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:27:38 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:27:38 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:27:39 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a42d9799-d775-4120-8af0-bc81a6278ea7 -p 172.16.0.220:3260 --login" returned: 0 in 0.092s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:27:39 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[2782253b-d141-4ce2-86df-0aeba3dc4b33]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a42d9799-d775-4120-8af0-bc81a6278ea7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a42d9799-d775-4120-8af0-bc81a6278ea7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:27:39 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-66ff41ca-8af0-4363-9fd2-c5d348eae26c tempest-TestStampPattern-2120781434 tempest-TestStampPattern-2120781434-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a42d9799-d775-4120-8af0-bc81a6278ea7, portal: 172.16.0.220,3260]
Nov 08 23:27:39 user nova-compute[75045]: Login to [iface: default, target: iqn.2010-10.org.openstack:a42d9799-d775-4120-8af0-bc81a6278ea7, portal: 172.16.0.220,3260] successful.
Nov 08 23:27:39 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:27:39 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a42d9799-d775-4120-8af0-bc81a6278ea7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:27:39 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a42d9799-d775-4120-8af0-bc81a6278ea7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:27:39 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[665b46df-61ca-44fe-8ed1-1065e11510a6]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:27:39 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-66ff41ca-8af0-4363-9fd2-c5d348eae26c tempest-TestStampPattern-2120781434 tempest-TestStampPattern-2120781434-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:27:39 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:27:39 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:27:39 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bf311c3-0a0a-4463-8a70-6d864200e730]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c37da13-9531-458a-87cb-1e86e6b84f3a (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2e734fa-1dcb-4510-a50e-064e29c2985e (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04d02c98-d058-49d8-a350-ab9e63003d6e (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9037467e-0ff2-4d03-925e-8997a3759542 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a42d9799-d775-4120-8af0-bc81a6278ea7 (non-flash)\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:27:39 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-66ff41ca-8af0-4363-9fd2-c5d348eae26c tempest-TestStampPattern-2120781434 tempest-TestStampPattern-2120781434-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab (non-flash)
Nov 08 23:27:39 user nova-compute[75045]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c37da13-9531-458a-87cb-1e86e6b84f3a (non-flash)
Nov 08 23:27:39 user nova-compute[75045]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2e734fa-1dcb-4510-a50e-064e29c2985e (non-flash)
Nov 08 23:27:39 user nova-compute[75045]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04d02c98-d058-49d8-a350-ab9e63003d6e (non-flash)
Nov 08 23:27:39 user nova-compute[75045]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9037467e-0ff2-4d03-925e-8997a3759542 (non-flash)
Nov 08 23:27:39 user nova-compute[75045]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a42d9799-d775-4120-8af0-bc81a6278ea7 (non-flash)
Nov 08 23:27:39 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 23:27:39 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-66ff41ca-8af0-4363-9fd2-c5d348eae26c tempest-TestStampPattern-2120781434 tempest-TestStampPattern-2120781434-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab (non-flash)
Nov 08 23:27:39 user nova-compute[75045]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c37da13-9531-458a-87cb-1e86e6b84f3a (non-flash)
Nov 08 23:27:39 user nova-compute[75045]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2e734fa-1dcb-4510-a50e-064e29c2985e (non-flash)
Nov 08 23:27:39 user nova-compute[75045]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04d02c98-d058-49d8-a350-ab9e63003d6e (non-flash)
Nov 08 23:27:39 user nova-compute[75045]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9037467e-0ff2-4d03-925e-8997a3759542 (non-flash)
Nov 08 23:27:39 user nova-compute[75045]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a42d9799-d775-4120-8af0-bc81a6278ea7 (non-flash)
Nov 08 23:27:39 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 23:27:39 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-66ff41ca-8af0-4363-9fd2-c5d348eae26c tempest-TestStampPattern-2120781434 tempest-TestStampPattern-2120781434-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a42d9799-d775-4120-8af0-bc81a6278ea7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.316s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 23:27:39 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-66ff41ca-8af0-4363-9fd2-c5d348eae26c tempest-TestStampPattern-2120781434 tempest-TestStampPattern-2120781434-project-member] Connected to 172.16.0.220:3260 {{(pid=75045) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 23:27:39 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-66ff41ca-8af0-4363-9fd2-c5d348eae26c tempest-TestStampPattern-2120781434 tempest-TestStampPattern-2120781434-project-member] HCTL ('37', '-', '-', 0) found on session 26 with lun 0 {{(pid=75045) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 23:27:39 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-66ff41ca-8af0-4363-9fd2-c5d348eae26c tempest-TestStampPattern-2120781434 tempest-TestStampPattern-2120781434-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=75045) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 23:27:39 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:27:39 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.016s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:27:39 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4532419-b312-4f9b-bb1a-fac784509995]: (4, ('- - 0', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:27:39 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-66ff41ca-8af0-4363-9fd2-c5d348eae26c tempest-TestStampPattern-2120781434 tempest-TestStampPattern-2120781434-project-member] Searching for a device in session 26 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=75045) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 23:27:39 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-66ff41ca-8af0-4363-9fd2-c5d348eae26c tempest-TestStampPattern-2120781434 tempest-TestStampPattern-2120781434-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:a42d9799-d775-4120-8af0-bc81a6278ea7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rwdMtfnR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75045) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 23:27:39 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:27:39 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:27:39 user nova-compute[75045]: DEBUG nova.compute.manager [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75045) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 23:27:40 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-66ff41ca-8af0-4363-9fd2-c5d348eae26c tempest-TestStampPattern-2120781434 tempest-TestStampPattern-2120781434-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.349s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 23:27:40 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-66ff41ca-8af0-4363-9fd2-c5d348eae26c tempest-TestStampPattern-2120781434 tempest-TestStampPattern-2120781434-project-member] <== connect_volume: return (1351ms) {'type': 'block', 'scsi_wwn': '23938333362373934', 'path': '/dev/sdf'} {{(pid=75045) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 23:27:40 user nova-compute[75045]: DEBUG nova.virt.libvirt.volume.iscsi [None req-66ff41ca-8af0-4363-9fd2-c5d348eae26c tempest-TestStampPattern-2120781434 tempest-TestStampPattern-2120781434-project-member] [instance: 72c9d731-2b35-434c-8463-1cd6c18fbd6a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23938333362373934', 'path': '/dev/sdf'} {{(pid=75045) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 23:27:40 user nova-compute[75045]: DEBUG nova.objects.instance [None req-66ff41ca-8af0-4363-9fd2-c5d348eae26c tempest-TestStampPattern-2120781434 tempest-TestStampPattern-2120781434-project-member] Lazy-loading 'flavor' on Instance uuid 72c9d731-2b35-434c-8463-1cd6c18fbd6a {{(pid=75045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 23:27:40 user nova-compute[75045]: DEBUG nova.virt.libvirt.guest [None req-66ff41ca-8af0-4363-9fd2-c5d348eae26c tempest-TestStampPattern-2120781434 tempest-TestStampPattern-2120781434-project-member] attach device xml: <disk type="block" device="disk">
Nov 08 23:27:40 user nova-compute[75045]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 23:27:40 user nova-compute[75045]:   <source dev="/dev/sdf"/>
Nov 08 23:27:40 user nova-compute[75045]:   <target dev="vdb" bus="virtio"/>
Nov 08 23:27:40 user nova-compute[75045]:   <serial>a42d9799-d775-4120-8af0-bc81a6278ea7</serial>
Nov 08 23:27:40 user nova-compute[75045]: </disk>
Nov 08 23:27:40 user nova-compute[75045]:  {{(pid=75045) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 08 23:27:40 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-66ff41ca-8af0-4363-9fd2-c5d348eae26c tempest-TestStampPattern-2120781434 tempest-TestStampPattern-2120781434-project-member] No BDM found with device name vda, not building metadata. {{(pid=75045) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 23:27:40 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-66ff41ca-8af0-4363-9fd2-c5d348eae26c tempest-TestStampPattern-2120781434 tempest-TestStampPattern-2120781434-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75045) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 23:27:40 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-66ff41ca-8af0-4363-9fd2-c5d348eae26c tempest-TestStampPattern-2120781434 tempest-TestStampPattern-2120781434-project-member] No VIF found with MAC fa:16:3e:bb:6f:51, not building metadata {{(pid=75045) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 23:27:40 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-66ff41ca-8af0-4363-9fd2-c5d348eae26c tempest-TestStampPattern-2120781434 tempest-TestStampPattern-2120781434-project-member] Lock "72c9d731-2b35-434c-8463-1cd6c18fbd6a" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 35.085s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:27:40 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager.update_available_resource {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:27:41 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:27:41 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.002s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:27:41 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:27:41 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Auditing locally available compute resources for user (node: user) {{(pid=75045) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 23:27:41 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:27:41 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72c9d731-2b35-434c-8463-1cd6c18fbd6a/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:27:41 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:27:41 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72c9d731-2b35-434c-8463-1cd6c18fbd6a/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:27:41 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72c9d731-2b35-434c-8463-1cd6c18fbd6a/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:27:41 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72c9d731-2b35-434c-8463-1cd6c18fbd6a/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:27:41 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=75045) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 23:27:41 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75045) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 23:27:41 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ae5ff6b-6f2c-4dfd-a4c6-da4809e2cf27/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:27:41 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ae5ff6b-6f2c-4dfd-a4c6-da4809e2cf27/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:27:41 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ae5ff6b-6f2c-4dfd-a4c6-da4809e2cf27/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:27:42 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ae5ff6b-6f2c-4dfd-a4c6-da4809e2cf27/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:27:42 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] skipping disk /dev/sdh (vda) as it is a volume {{(pid=75045) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 23:27:42 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f21fcd3-ac5f-499e-9c34-82af806fda1d/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:27:42 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f21fcd3-ac5f-499e-9c34-82af806fda1d/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:27:42 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f21fcd3-ac5f-499e-9c34-82af806fda1d/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:27:42 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f21fcd3-ac5f-499e-9c34-82af806fda1d/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:27:42 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e92ab9a-8ea4-4452-a458-db181d4a59b7/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:27:42 user nova-compute[75045]: DEBUG nova.network.neutron [None req-31751176-347d-42ce-b2e6-ed798b738377 tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] [instance: 83d225e0-e39e-4500-b7ae-52dfbd8b8588] Port f34eef67-0428-49ea-91c3-08510ac690c8 binding to destination host user is already ACTIVE {{(pid=75045) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Nov 08 23:27:42 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-31751176-347d-42ce-b2e6-ed798b738377 tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] Acquiring lock "refresh_cache-83d225e0-e39e-4500-b7ae-52dfbd8b8588" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 23:27:42 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-31751176-347d-42ce-b2e6-ed798b738377 tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] Acquired lock "refresh_cache-83d225e0-e39e-4500-b7ae-52dfbd8b8588" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 23:27:42 user nova-compute[75045]: DEBUG nova.network.neutron [None req-31751176-347d-42ce-b2e6-ed798b738377 tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] [instance: 83d225e0-e39e-4500-b7ae-52dfbd8b8588] Building network info cache for instance {{(pid=75045) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 23:27:42 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e92ab9a-8ea4-4452-a458-db181d4a59b7/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:27:42 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e92ab9a-8ea4-4452-a458-db181d4a59b7/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:27:42 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e92ab9a-8ea4-4452-a458-db181d4a59b7/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:27:42 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa67b237-f598-4111-87ba-d761aa50d95e/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:27:43 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa67b237-f598-4111-87ba-d761aa50d95e/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:27:43 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa67b237-f598-4111-87ba-d761aa50d95e/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:27:43 user nova-compute[75045]: DEBUG nova.network.neutron [None req-31751176-347d-42ce-b2e6-ed798b738377 tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] [instance: 83d225e0-e39e-4500-b7ae-52dfbd8b8588] Updating instance_info_cache with network_info: [{"id": "f34eef67-0428-49ea-91c3-08510ac690c8", "address": "fa:16:3e:d9:92:a4", "network": {"id": "d177c8b8-5960-4e40-bf9b-920a2f6ba4f7", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-497258569-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.31", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "467f0ecc3b93457f9fe83886b99c6285", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf34eef67-04", "ovs_interfaceid": "f34eef67-0428-49ea-91c3-08510ac690c8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75045) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 23:27:43 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-31751176-347d-42ce-b2e6-ed798b738377 tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] Releasing lock "refresh_cache-83d225e0-e39e-4500-b7ae-52dfbd8b8588" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 23:27:43 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-31751176-347d-42ce-b2e6-ed798b738377 tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] [instance: 83d225e0-e39e-4500-b7ae-52dfbd8b8588] Creating tmpfile /opt/stack/data/nova/instances/83d225e0-e39e-4500-b7ae-52dfbd8b8588/tmpagf6btr1 to verify with other compute node that the instance is on the same shared storage. {{(pid=75045) check_instance_shared_storage_local /opt/stack/nova/nova/virt/libvirt/driver.py:9628}}
Nov 08 23:27:43 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa67b237-f598-4111-87ba-d761aa50d95e/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:27:43 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:27:43 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:27:43 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:27:43 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:27:43 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:27:43 user nova-compute[75045]: DEBUG nova.compute.manager [req-6ed071ce-699c-49f7-9e85-7926c2f4af05 req-ea266bdd-a359-4c4a-a362-878ffcfe42ed service nova] [instance: 83d225e0-e39e-4500-b7ae-52dfbd8b8588] Received event network-vif-unplugged-f34eef67-0428-49ea-91c3-08510ac690c8 {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:27:43 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-6ed071ce-699c-49f7-9e85-7926c2f4af05 req-ea266bdd-a359-4c4a-a362-878ffcfe42ed service nova] Acquiring lock "83d225e0-e39e-4500-b7ae-52dfbd8b8588-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:27:43 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-6ed071ce-699c-49f7-9e85-7926c2f4af05 req-ea266bdd-a359-4c4a-a362-878ffcfe42ed service nova] Lock "83d225e0-e39e-4500-b7ae-52dfbd8b8588-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:27:43 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-6ed071ce-699c-49f7-9e85-7926c2f4af05 req-ea266bdd-a359-4c4a-a362-878ffcfe42ed service nova] Lock "83d225e0-e39e-4500-b7ae-52dfbd8b8588-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:27:43 user nova-compute[75045]: DEBUG nova.compute.manager [req-6ed071ce-699c-49f7-9e85-7926c2f4af05 req-ea266bdd-a359-4c4a-a362-878ffcfe42ed service nova] [instance: 83d225e0-e39e-4500-b7ae-52dfbd8b8588] No waiting events found dispatching network-vif-unplugged-f34eef67-0428-49ea-91c3-08510ac690c8 {{(pid=75045) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 23:27:43 user nova-compute[75045]: WARNING nova.compute.manager [req-6ed071ce-699c-49f7-9e85-7926c2f4af05 req-ea266bdd-a359-4c4a-a362-878ffcfe42ed service nova] [instance: 83d225e0-e39e-4500-b7ae-52dfbd8b8588] Received unexpected event network-vif-unplugged-f34eef67-0428-49ea-91c3-08510ac690c8 for instance with vm_state resized and task_state resize_reverting.
Nov 08 23:27:43 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83d225e0-e39e-4500-b7ae-52dfbd8b8588/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:27:43 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-b99fe833-6bbd-4aa7-a030-e5c98392cb65 tempest-TestStampPattern-2120781434 tempest-TestStampPattern-2120781434-project-member] Acquiring lock "72c9d731-2b35-434c-8463-1cd6c18fbd6a" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:27:43 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-b99fe833-6bbd-4aa7-a030-e5c98392cb65 tempest-TestStampPattern-2120781434 tempest-TestStampPattern-2120781434-project-member] Lock "72c9d731-2b35-434c-8463-1cd6c18fbd6a" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:27:43 user nova-compute[75045]: INFO nova.compute.manager [None req-b99fe833-6bbd-4aa7-a030-e5c98392cb65 tempest-TestStampPattern-2120781434 tempest-TestStampPattern-2120781434-project-member] [instance: 72c9d731-2b35-434c-8463-1cd6c18fbd6a] Detaching volume a42d9799-d775-4120-8af0-bc81a6278ea7
Nov 08 23:27:43 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83d225e0-e39e-4500-b7ae-52dfbd8b8588/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:27:43 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83d225e0-e39e-4500-b7ae-52dfbd8b8588/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:27:44 user nova-compute[75045]: INFO nova.virt.block_device [None req-b99fe833-6bbd-4aa7-a030-e5c98392cb65 tempest-TestStampPattern-2120781434 tempest-TestStampPattern-2120781434-project-member] [instance: 72c9d731-2b35-434c-8463-1cd6c18fbd6a] Attempting to driver detach volume a42d9799-d775-4120-8af0-bc81a6278ea7 from mountpoint /dev/vdb
Nov 08 23:27:44 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:27:44 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-b99fe833-6bbd-4aa7-a030-e5c98392cb65 tempest-TestStampPattern-2120781434 tempest-TestStampPattern-2120781434-project-member] Attempting to detach device vdb from instance 72c9d731-2b35-434c-8463-1cd6c18fbd6a from the persistent domain config. {{(pid=75045) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 08 23:27:44 user nova-compute[75045]: DEBUG nova.virt.libvirt.guest [None req-b99fe833-6bbd-4aa7-a030-e5c98392cb65 tempest-TestStampPattern-2120781434 tempest-TestStampPattern-2120781434-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 23:27:44 user nova-compute[75045]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 23:27:44 user nova-compute[75045]:   <source dev="/dev/sdf"/>
Nov 08 23:27:44 user nova-compute[75045]:   <target dev="vdb" bus="virtio"/>
Nov 08 23:27:44 user nova-compute[75045]:   <serial>a42d9799-d775-4120-8af0-bc81a6278ea7</serial>
Nov 08 23:27:44 user nova-compute[75045]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 08 23:27:44 user nova-compute[75045]: </disk>
Nov 08 23:27:44 user nova-compute[75045]:  {{(pid=75045) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 23:27:44 user nova-compute[75045]: INFO nova.virt.libvirt.driver [None req-b99fe833-6bbd-4aa7-a030-e5c98392cb65 tempest-TestStampPattern-2120781434 tempest-TestStampPattern-2120781434-project-member] Successfully detached device vdb from instance 72c9d731-2b35-434c-8463-1cd6c18fbd6a from the persistent domain config.
Nov 08 23:27:44 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-b99fe833-6bbd-4aa7-a030-e5c98392cb65 tempest-TestStampPattern-2120781434 tempest-TestStampPattern-2120781434-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 72c9d731-2b35-434c-8463-1cd6c18fbd6a from the live domain config. {{(pid=75045) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 08 23:27:44 user nova-compute[75045]: DEBUG nova.virt.libvirt.guest [None req-b99fe833-6bbd-4aa7-a030-e5c98392cb65 tempest-TestStampPattern-2120781434 tempest-TestStampPattern-2120781434-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 23:27:44 user nova-compute[75045]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 23:27:44 user nova-compute[75045]:   <source dev="/dev/sdf"/>
Nov 08 23:27:44 user nova-compute[75045]:   <target dev="vdb" bus="virtio"/>
Nov 08 23:27:44 user nova-compute[75045]:   <serial>a42d9799-d775-4120-8af0-bc81a6278ea7</serial>
Nov 08 23:27:44 user nova-compute[75045]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 08 23:27:44 user nova-compute[75045]: </disk>
Nov 08 23:27:44 user nova-compute[75045]:  {{(pid=75045) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 23:27:44 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:27:44 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:27:44 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:27:44 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:27:44 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83d225e0-e39e-4500-b7ae-52dfbd8b8588/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:27:44 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75045) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 23:27:44 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25cd59d1-6884-471a-813e-52e97c2e1208/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:27:44 user nova-compute[75045]: INFO nova.virt.libvirt.driver [-] [instance: 83d225e0-e39e-4500-b7ae-52dfbd8b8588] Instance destroyed successfully.
Nov 08 23:27:44 user nova-compute[75045]: DEBUG nova.objects.instance [None req-31751176-347d-42ce-b2e6-ed798b738377 tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] Lazy-loading 'resources' on Instance uuid 83d225e0-e39e-4500-b7ae-52dfbd8b8588 {{(pid=75045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 23:27:44 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:27:44 user nova-compute[75045]: DEBUG nova.virt.libvirt.vif [None req-31751176-347d-42ce-b2e6-ed798b738377 tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T23:21:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-52454361',display_name='tempest-ServerActionsTestOtherB-server-52454361',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-52454361',id=16,image_ref='a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIPmBc8a5DafKsuCJlskOYpDDhPwBioEg4bK8XJOdFwOvE3kerS9/OlDrIi5hKJ4t8vHYgazIqYE6C9fG+r7udy2il9kXgn4I4yPKUfyTlGPaqAfUG4gtg1sBgzfEDpsow==',key_name='tempest-keypair-1494902868',keypairs=<?>,launch_index=0,launched_at=2023-11-08T23:26:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='467f0ecc3b93457f9fe83886b99c6285',ramdisk_id='',reservation_id='r-mtlunwmw',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-299728934',owner_user_name='tempest-ServerActionsTestOtherB-299728934-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T23:26:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='57d0c13f5a9f4c1bbb0458b93de348cb',uuid=83d225e0-e39e-4500-b7ae-52dfbd8b8588,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "f34eef67-0428-49ea-91c3-08510ac690c8", "address": "fa:16:3e:d9:92:a4", "network": {"id": "d177c8b8-5960-4e40-bf9b-920a2f6ba4f7", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-497258569-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.31", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "467f0ecc3b93457f9fe83886b99c6285", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf34eef67-04", "ovs_interfaceid": "f34eef67-0428-49ea-91c3-08510ac690c8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75045) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 23:27:44 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-31751176-347d-42ce-b2e6-ed798b738377 tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] Converting VIF {"id": "f34eef67-0428-49ea-91c3-08510ac690c8", "address": "fa:16:3e:d9:92:a4", "network": {"id": "d177c8b8-5960-4e40-bf9b-920a2f6ba4f7", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-497258569-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.31", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "467f0ecc3b93457f9fe83886b99c6285", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf34eef67-04", "ovs_interfaceid": "f34eef67-0428-49ea-91c3-08510ac690c8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 23:27:44 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-31751176-347d-42ce-b2e6-ed798b738377 tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d9:92:a4,bridge_name='br-int',has_traffic_filtering=True,id=f34eef67-0428-49ea-91c3-08510ac690c8,network=Network(d177c8b8-5960-4e40-bf9b-920a2f6ba4f7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf34eef67-04') {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 23:27:44 user nova-compute[75045]: DEBUG os_vif [None req-31751176-347d-42ce-b2e6-ed798b738377 tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d9:92:a4,bridge_name='br-int',has_traffic_filtering=True,id=f34eef67-0428-49ea-91c3-08510ac690c8,network=Network(d177c8b8-5960-4e40-bf9b-920a2f6ba4f7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf34eef67-04') {{(pid=75045) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 23:27:44 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:27:44 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf34eef67-04, bridge=br-int, if_exists=True) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:27:44 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 23:27:44 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:27:44 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:27:44 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=731c957d-4f2f-47c4-9e1a-8c1a1aa63192) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:27:44 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 23:27:44 user nova-compute[75045]: INFO os_vif [None req-31751176-347d-42ce-b2e6-ed798b738377 tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d9:92:a4,bridge_name='br-int',has_traffic_filtering=True,id=f34eef67-0428-49ea-91c3-08510ac690c8,network=Network(d177c8b8-5960-4e40-bf9b-920a2f6ba4f7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf34eef67-04')
Nov 08 23:27:44 user nova-compute[75045]: DEBUG nova.virt.libvirt.volume.iscsi [None req-31751176-347d-42ce-b2e6-ed798b738377 tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] [instance: 83d225e0-e39e-4500-b7ae-52dfbd8b8588] calling os-brick to detach iSCSI Volume {{(pid=75045) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 23:27:44 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-31751176-347d-42ce-b2e6-ed798b738377 tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1b68210460>, {'target_iqn': 'iqn.2010-10.org.openstack:d2e734fa-1dcb-4510-a50e-064e29c2985e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qCUrDkTz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=75045) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 23:27:44 user nova-compute[75045]: WARNING os_brick.initiator.connectors.base [None req-31751176-347d-42ce-b2e6-ed798b738377 tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 23:27:44 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-31751176-347d-42ce-b2e6-ed798b738377 tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 23:27:44 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-31751176-347d-42ce-b2e6-ed798b738377 tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 23:27:44 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:27:44 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:27:44 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a32b96f-e8be-43ab-a272-6599512e7df3]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9037467e-0ff2-4d03-925e-8997a3759542\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a42d9799-d775-4120-8af0-bc81a6278ea7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:04d02c98-d058-49d8-a350-ab9e63003d6e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9c37da13-9531-458a-87cb-1e86e6b84f3a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d2e734fa-1dcb-4510-a50e-064e29c2985e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:27:44 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-31751176-347d-42ce-b2e6-ed798b738377 tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 23:27:44 user nova-compute[75045]: No targets found.
Nov 08 23:27:44 user nova-compute[75045]: iSNS:
Nov 08 23:27:44 user nova-compute[75045]: No targets found.
Nov 08 23:27:44 user nova-compute[75045]: STATIC:
Nov 08 23:27:44 user nova-compute[75045]: Target: iqn.2010-10.org.openstack:9037467e-0ff2-4d03-925e-8997a3759542
Nov 08 23:27:44 user nova-compute[75045]:         Portal: 172.16.0.220:3260,-1
Nov 08 23:27:44 user nova-compute[75045]:                 Iface Name: default
Nov 08 23:27:44 user nova-compute[75045]: Target: iqn.2010-10.org.openstack:a42d9799-d775-4120-8af0-bc81a6278ea7
Nov 08 23:27:44 user nova-compute[75045]:         Portal: 172.16.0.220:3260,-1
Nov 08 23:27:44 user nova-compute[75045]:                 Iface Name: default
Nov 08 23:27:44 user nova-compute[75045]: Target: iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab
Nov 08 23:27:44 user nova-compute[75045]:         Portal: 172.16.0.220:3260,-1
Nov 08 23:27:44 user nova-compute[75045]:                 Iface Name: default
Nov 08 23:27:44 user nova-compute[75045]: Target: iqn.2010-10.org.openstack:04d02c98-d058-49d8-a350-ab9e63003d6e
Nov 08 23:27:44 user nova-compute[75045]:         Portal: 172.16.0.220:3260,-1
Nov 08 23:27:44 user nova-compute[75045]:                 Iface Name: default
Nov 08 23:27:44 user nova-compute[75045]: Target: iqn.2010-10.org.openstack:9c37da13-9531-458a-87cb-1e86e6b84f3a
Nov 08 23:27:44 user nova-compute[75045]:         Portal: 172.16.0.220:3260,-1
Nov 08 23:27:44 user nova-compute[75045]:                 Iface Name: default
Nov 08 23:27:44 user nova-compute[75045]: Target: iqn.2010-10.org.openstack:d2e734fa-1dcb-4510-a50e-064e29c2985e
Nov 08 23:27:44 user nova-compute[75045]:         Portal: 172.16.0.220:3260,-1
Nov 08 23:27:44 user nova-compute[75045]:                 Iface Name: default
Nov 08 23:27:44 user nova-compute[75045]: FIRMWARE:
Nov 08 23:27:44 user nova-compute[75045]: No targets found.
Nov 08 23:27:44 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 23:27:44 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-31751176-347d-42ce-b2e6-ed798b738377 tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 23:27:44 user nova-compute[75045]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 23:27:44 user nova-compute[75045]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75045) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 23:27:44 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-31751176-347d-42ce-b2e6-ed798b738377 tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d2e734fa-1dcb-4510-a50e-064e29c2985e', 0)] {{(pid=75045) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 23:27:44 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25cd59d1-6884-471a-813e-52e97c2e1208/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:27:44 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25cd59d1-6884-471a-813e-52e97c2e1208/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:27:44 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:27:44 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:27:44 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[14786967-4a24-4b4a-865b-ca5703f98b11]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:04d02c98-d058-49d8-a350-ab9e63003d6e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9037467e-0ff2-4d03-925e-8997a3759542\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9c37da13-9531-458a-87cb-1e86e6b84f3a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a42d9799-d775-4120-8af0-bc81a6278ea7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d2e734fa-1dcb-4510-a50e-064e29c2985e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:27:44 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:27:44 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.042s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:27:44 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[c43dd345-93a7-4717-929d-053bfdb238e1]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c37da13-9531-458a-87cb-1e86e6b84f3a (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2e734fa-1dcb-4510-a50e-064e29c2985e (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04d02c98-d058-49d8-a350-ab9e63003d6e (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9037467e-0ff2-4d03-925e-8997a3759542 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a42d9799-d775-4120-8af0-bc81a6278ea7 (non-flash)\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:27:44 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-31751176-347d-42ce-b2e6-ed798b738377 tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab (non-flash)
Nov 08 23:27:44 user nova-compute[75045]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c37da13-9531-458a-87cb-1e86e6b84f3a (non-flash)
Nov 08 23:27:44 user nova-compute[75045]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2e734fa-1dcb-4510-a50e-064e29c2985e (non-flash)
Nov 08 23:27:44 user nova-compute[75045]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04d02c98-d058-49d8-a350-ab9e63003d6e (non-flash)
Nov 08 23:27:44 user nova-compute[75045]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9037467e-0ff2-4d03-925e-8997a3759542 (non-flash)
Nov 08 23:27:44 user nova-compute[75045]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a42d9799-d775-4120-8af0-bc81a6278ea7 (non-flash)
Nov 08 23:27:44 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 23:27:44 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-31751176-347d-42ce-b2e6-ed798b738377 tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab (non-flash)
Nov 08 23:27:44 user nova-compute[75045]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c37da13-9531-458a-87cb-1e86e6b84f3a (non-flash)
Nov 08 23:27:44 user nova-compute[75045]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2e734fa-1dcb-4510-a50e-064e29c2985e (non-flash)
Nov 08 23:27:44 user nova-compute[75045]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04d02c98-d058-49d8-a350-ab9e63003d6e (non-flash)
Nov 08 23:27:44 user nova-compute[75045]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9037467e-0ff2-4d03-925e-8997a3759542 (non-flash)
Nov 08 23:27:44 user nova-compute[75045]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a42d9799-d775-4120-8af0-bc81a6278ea7 (non-flash)
Nov 08 23:27:44 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 23:27:44 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-31751176-347d-42ce-b2e6-ed798b738377 tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1b48219090>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d2e734fa-1dcb-4510-a50e-064e29c2985e'): ({'sdd'}, set())}) {{(pid=75045) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 23:27:44 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-31751176-347d-42ce-b2e6-ed798b738377 tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] Removing single pathed devices sdd {{(pid=75045) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 23:27:44 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:27:44 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:27:44 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[03531914-b28c-481a-8548-19bca12c1ced]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:27:44 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:27:44 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:27:44 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[44f400de-8ae9-4859-a4d3-f3946ef09d85]: (4, ('ok\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:27:44 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-31751176-347d-42ce-b2e6-ed798b738377 tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] Flushing IO for device /dev/sdd {{(pid=75045) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 23:27:44 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:27:44 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-b99fe833-6bbd-4aa7-a030-e5c98392cb65 tempest-TestStampPattern-2120781434 tempest-TestStampPattern-2120781434-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 72c9d731-2b35-434c-8463-1cd6c18fbd6a {{(pid=75045) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 08 23:27:44 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.016s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:27:44 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[55acc85c-d05d-44fe-9258-b2852baab79b]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:27:44 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-31751176-347d-42ce-b2e6-ed798b738377 tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75045) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 23:27:44 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:27:44 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25cd59d1-6884-471a-813e-52e97c2e1208/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:27:44 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=75045) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 23:27:44 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5fc7f02-2143-4bcf-92ac-078d5ec10747/disk.rescue --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:27:44 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.055s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:27:44 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b777066-2e68-425e-8590-5f05e773881f]: (4, ('1', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:27:44 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-31751176-347d-42ce-b2e6-ed798b738377 tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75045) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 23:27:44 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-31751176-347d-42ce-b2e6-ed798b738377 tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] SCSI volumes sdd have been removed. {{(pid=75045) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 23:27:44 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-31751176-347d-42ce-b2e6-ed798b738377 tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d2e734fa-1dcb-4510-a50e-064e29c2985e')] {{(pid=75045) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 23:27:44 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2e734fa-1dcb-4510-a50e-064e29c2985e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:27:44 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2e734fa-1dcb-4510-a50e-064e29c2985e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:27:44 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[754d93f1-062f-404c-9b09-d6ff8987385a]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:27:44 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-31751176-347d-42ce-b2e6-ed798b738377 tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:27:44 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2e734fa-1dcb-4510-a50e-064e29c2985e -p 172.16.0.220:3260 --logout {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:27:44 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2e734fa-1dcb-4510-a50e-064e29c2985e -p 172.16.0.220:3260 --logout" returned: 0 in 0.076s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:27:44 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f6da2a3-d925-4395-8a00-194646913a72]: (4, ('Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:d2e734fa-1dcb-4510-a50e-064e29c2985e, portal: 172.16.0.220,3260]\nLogout of [sid: 23, target: iqn.2010-10.org.openstack:d2e734fa-1dcb-4510-a50e-064e29c2985e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:27:44 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-31751176-347d-42ce-b2e6-ed798b738377 tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:d2e734fa-1dcb-4510-a50e-064e29c2985e, portal: 172.16.0.220,3260]
Nov 08 23:27:44 user nova-compute[75045]: Logout of [sid: 23, target: iqn.2010-10.org.openstack:d2e734fa-1dcb-4510-a50e-064e29c2985e, portal: 172.16.0.220,3260] successful.
Nov 08 23:27:44 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:27:44 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2e734fa-1dcb-4510-a50e-064e29c2985e -p 172.16.0.220:3260 --op delete {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:27:44 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2e734fa-1dcb-4510-a50e-064e29c2985e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.038s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:27:44 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf6301a1-548a-4cc9-8cd4-13ee2fea43d0]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:27:44 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-31751176-347d-42ce-b2e6-ed798b738377 tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:27:44 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-31751176-347d-42ce-b2e6-ed798b738377 tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.448s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 23:27:44 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-31751176-347d-42ce-b2e6-ed798b738377 tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] <== disconnect_volume: return (450ms) None {{(pid=75045) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 23:27:44 user nova-compute[75045]: DEBUG nova.virt.libvirt.volume.iscsi [None req-31751176-347d-42ce-b2e6-ed798b738377 tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] [instance: 83d225e0-e39e-4500-b7ae-52dfbd8b8588] Disconnected iSCSI Volume {{(pid=75045) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 23:27:44 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5fc7f02-2143-4bcf-92ac-078d5ec10747/disk.rescue --force-share --output=json" returned: 0 in 0.224s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:27:44 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5fc7f02-2143-4bcf-92ac-078d5ec10747/disk.rescue --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:27:44 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:27:44 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:27:44 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:27:45 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:27:45 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5fc7f02-2143-4bcf-92ac-078d5ec10747/disk.rescue --force-share --output=json" returned: 0 in 0.220s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:27:45 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5fc7f02-2143-4bcf-92ac-078d5ec10747/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:27:45 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5fc7f02-2143-4bcf-92ac-078d5ec10747/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:27:45 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5fc7f02-2143-4bcf-92ac-078d5ec10747/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:27:45 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5fc7f02-2143-4bcf-92ac-078d5ec10747/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:27:45 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b84f2b1-01a3-4789-bcef-8b7c4334132b/disk.rescue --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:27:45 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b84f2b1-01a3-4789-bcef-8b7c4334132b/disk.rescue --force-share --output=json" returned: 0 in 0.178s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:27:45 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b84f2b1-01a3-4789-bcef-8b7c4334132b/disk.rescue --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:27:45 user nova-compute[75045]: DEBUG nova.compute.manager [req-8d8c1652-1e0c-4702-8309-310bf4a07d9f req-1601b9c3-d9d4-45fe-b0ff-bcfea665aa51 service nova] [instance: 83d225e0-e39e-4500-b7ae-52dfbd8b8588] Received event network-vif-plugged-f34eef67-0428-49ea-91c3-08510ac690c8 {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:27:45 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-8d8c1652-1e0c-4702-8309-310bf4a07d9f req-1601b9c3-d9d4-45fe-b0ff-bcfea665aa51 service nova] Acquiring lock "83d225e0-e39e-4500-b7ae-52dfbd8b8588-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:27:45 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-8d8c1652-1e0c-4702-8309-310bf4a07d9f req-1601b9c3-d9d4-45fe-b0ff-bcfea665aa51 service nova] Lock "83d225e0-e39e-4500-b7ae-52dfbd8b8588-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:27:45 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-8d8c1652-1e0c-4702-8309-310bf4a07d9f req-1601b9c3-d9d4-45fe-b0ff-bcfea665aa51 service nova] Lock "83d225e0-e39e-4500-b7ae-52dfbd8b8588-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:27:45 user nova-compute[75045]: DEBUG nova.compute.manager [req-8d8c1652-1e0c-4702-8309-310bf4a07d9f req-1601b9c3-d9d4-45fe-b0ff-bcfea665aa51 service nova] [instance: 83d225e0-e39e-4500-b7ae-52dfbd8b8588] No waiting events found dispatching network-vif-plugged-f34eef67-0428-49ea-91c3-08510ac690c8 {{(pid=75045) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 23:27:45 user nova-compute[75045]: WARNING nova.compute.manager [req-8d8c1652-1e0c-4702-8309-310bf4a07d9f req-1601b9c3-d9d4-45fe-b0ff-bcfea665aa51 service nova] [instance: 83d225e0-e39e-4500-b7ae-52dfbd8b8588] Received unexpected event network-vif-plugged-f34eef67-0428-49ea-91c3-08510ac690c8 for instance with vm_state resized and task_state resize_reverting.
Nov 08 23:27:45 user nova-compute[75045]: DEBUG nova.compute.manager [req-8d8c1652-1e0c-4702-8309-310bf4a07d9f req-1601b9c3-d9d4-45fe-b0ff-bcfea665aa51 service nova] [instance: 83d225e0-e39e-4500-b7ae-52dfbd8b8588] Received event network-vif-plugged-f34eef67-0428-49ea-91c3-08510ac690c8 {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:27:45 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-8d8c1652-1e0c-4702-8309-310bf4a07d9f req-1601b9c3-d9d4-45fe-b0ff-bcfea665aa51 service nova] Acquiring lock "83d225e0-e39e-4500-b7ae-52dfbd8b8588-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:27:45 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-8d8c1652-1e0c-4702-8309-310bf4a07d9f req-1601b9c3-d9d4-45fe-b0ff-bcfea665aa51 service nova] Lock "83d225e0-e39e-4500-b7ae-52dfbd8b8588-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:27:45 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-8d8c1652-1e0c-4702-8309-310bf4a07d9f req-1601b9c3-d9d4-45fe-b0ff-bcfea665aa51 service nova] Lock "83d225e0-e39e-4500-b7ae-52dfbd8b8588-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:27:45 user nova-compute[75045]: DEBUG nova.compute.manager [req-8d8c1652-1e0c-4702-8309-310bf4a07d9f req-1601b9c3-d9d4-45fe-b0ff-bcfea665aa51 service nova] [instance: 83d225e0-e39e-4500-b7ae-52dfbd8b8588] No waiting events found dispatching network-vif-plugged-f34eef67-0428-49ea-91c3-08510ac690c8 {{(pid=75045) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 23:27:45 user nova-compute[75045]: WARNING nova.compute.manager [req-8d8c1652-1e0c-4702-8309-310bf4a07d9f req-1601b9c3-d9d4-45fe-b0ff-bcfea665aa51 service nova] [instance: 83d225e0-e39e-4500-b7ae-52dfbd8b8588] Received unexpected event network-vif-plugged-f34eef67-0428-49ea-91c3-08510ac690c8 for instance with vm_state resized and task_state resize_reverting.
Nov 08 23:27:45 user nova-compute[75045]: DEBUG nova.compute.manager [req-8d8c1652-1e0c-4702-8309-310bf4a07d9f req-1601b9c3-d9d4-45fe-b0ff-bcfea665aa51 service nova] [instance: 83d225e0-e39e-4500-b7ae-52dfbd8b8588] Received event network-vif-plugged-f34eef67-0428-49ea-91c3-08510ac690c8 {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:27:45 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-8d8c1652-1e0c-4702-8309-310bf4a07d9f req-1601b9c3-d9d4-45fe-b0ff-bcfea665aa51 service nova] Acquiring lock "83d225e0-e39e-4500-b7ae-52dfbd8b8588-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:27:45 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-8d8c1652-1e0c-4702-8309-310bf4a07d9f req-1601b9c3-d9d4-45fe-b0ff-bcfea665aa51 service nova] Lock "83d225e0-e39e-4500-b7ae-52dfbd8b8588-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:27:45 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-8d8c1652-1e0c-4702-8309-310bf4a07d9f req-1601b9c3-d9d4-45fe-b0ff-bcfea665aa51 service nova] Lock "83d225e0-e39e-4500-b7ae-52dfbd8b8588-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:27:45 user nova-compute[75045]: DEBUG nova.compute.manager [req-8d8c1652-1e0c-4702-8309-310bf4a07d9f req-1601b9c3-d9d4-45fe-b0ff-bcfea665aa51 service nova] [instance: 83d225e0-e39e-4500-b7ae-52dfbd8b8588] No waiting events found dispatching network-vif-plugged-f34eef67-0428-49ea-91c3-08510ac690c8 {{(pid=75045) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 23:27:45 user nova-compute[75045]: WARNING nova.compute.manager [req-8d8c1652-1e0c-4702-8309-310bf4a07d9f req-1601b9c3-d9d4-45fe-b0ff-bcfea665aa51 service nova] [instance: 83d225e0-e39e-4500-b7ae-52dfbd8b8588] Received unexpected event network-vif-plugged-f34eef67-0428-49ea-91c3-08510ac690c8 for instance with vm_state resized and task_state resize_reverting.
Nov 08 23:27:45 user nova-compute[75045]: DEBUG nova.compute.manager [req-8d8c1652-1e0c-4702-8309-310bf4a07d9f req-1601b9c3-d9d4-45fe-b0ff-bcfea665aa51 service nova] [instance: 83d225e0-e39e-4500-b7ae-52dfbd8b8588] Received event network-vif-unplugged-f34eef67-0428-49ea-91c3-08510ac690c8 {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:27:45 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-8d8c1652-1e0c-4702-8309-310bf4a07d9f req-1601b9c3-d9d4-45fe-b0ff-bcfea665aa51 service nova] Acquiring lock "83d225e0-e39e-4500-b7ae-52dfbd8b8588-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:27:45 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-8d8c1652-1e0c-4702-8309-310bf4a07d9f req-1601b9c3-d9d4-45fe-b0ff-bcfea665aa51 service nova] Lock "83d225e0-e39e-4500-b7ae-52dfbd8b8588-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:27:45 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-8d8c1652-1e0c-4702-8309-310bf4a07d9f req-1601b9c3-d9d4-45fe-b0ff-bcfea665aa51 service nova] Lock "83d225e0-e39e-4500-b7ae-52dfbd8b8588-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:27:45 user nova-compute[75045]: DEBUG nova.compute.manager [req-8d8c1652-1e0c-4702-8309-310bf4a07d9f req-1601b9c3-d9d4-45fe-b0ff-bcfea665aa51 service nova] [instance: 83d225e0-e39e-4500-b7ae-52dfbd8b8588] No waiting events found dispatching network-vif-unplugged-f34eef67-0428-49ea-91c3-08510ac690c8 {{(pid=75045) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 23:27:45 user nova-compute[75045]: WARNING nova.compute.manager [req-8d8c1652-1e0c-4702-8309-310bf4a07d9f req-1601b9c3-d9d4-45fe-b0ff-bcfea665aa51 service nova] [instance: 83d225e0-e39e-4500-b7ae-52dfbd8b8588] Received unexpected event network-vif-unplugged-f34eef67-0428-49ea-91c3-08510ac690c8 for instance with vm_state resized and task_state resize_reverting.
Nov 08 23:27:45 user nova-compute[75045]: DEBUG nova.compute.manager [req-8d8c1652-1e0c-4702-8309-310bf4a07d9f req-1601b9c3-d9d4-45fe-b0ff-bcfea665aa51 service nova] [instance: 83d225e0-e39e-4500-b7ae-52dfbd8b8588] Received event network-vif-plugged-f34eef67-0428-49ea-91c3-08510ac690c8 {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:27:45 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-8d8c1652-1e0c-4702-8309-310bf4a07d9f req-1601b9c3-d9d4-45fe-b0ff-bcfea665aa51 service nova] Acquiring lock "83d225e0-e39e-4500-b7ae-52dfbd8b8588-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:27:45 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-8d8c1652-1e0c-4702-8309-310bf4a07d9f req-1601b9c3-d9d4-45fe-b0ff-bcfea665aa51 service nova] Lock "83d225e0-e39e-4500-b7ae-52dfbd8b8588-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:27:45 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-8d8c1652-1e0c-4702-8309-310bf4a07d9f req-1601b9c3-d9d4-45fe-b0ff-bcfea665aa51 service nova] Lock "83d225e0-e39e-4500-b7ae-52dfbd8b8588-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:27:45 user nova-compute[75045]: DEBUG nova.compute.manager [req-8d8c1652-1e0c-4702-8309-310bf4a07d9f req-1601b9c3-d9d4-45fe-b0ff-bcfea665aa51 service nova] [instance: 83d225e0-e39e-4500-b7ae-52dfbd8b8588] No waiting events found dispatching network-vif-plugged-f34eef67-0428-49ea-91c3-08510ac690c8 {{(pid=75045) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 23:27:45 user nova-compute[75045]: WARNING nova.compute.manager [req-8d8c1652-1e0c-4702-8309-310bf4a07d9f req-1601b9c3-d9d4-45fe-b0ff-bcfea665aa51 service nova] [instance: 83d225e0-e39e-4500-b7ae-52dfbd8b8588] Received unexpected event network-vif-plugged-f34eef67-0428-49ea-91c3-08510ac690c8 for instance with vm_state resized and task_state resize_reverting.
Nov 08 23:27:45 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b84f2b1-01a3-4789-bcef-8b7c4334132b/disk.rescue --force-share --output=json" returned: 0 in 0.185s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:27:45 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b84f2b1-01a3-4789-bcef-8b7c4334132b/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:27:46 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b84f2b1-01a3-4789-bcef-8b7c4334132b/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:27:46 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b84f2b1-01a3-4789-bcef-8b7c4334132b/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:27:46 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-31751176-347d-42ce-b2e6-ed798b738377 tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:27:46 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-31751176-347d-42ce-b2e6-ed798b738377 tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: waited 0.003s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:27:46 user nova-compute[75045]: DEBUG nova.objects.instance [None req-31751176-347d-42ce-b2e6-ed798b738377 tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] Lazy-loading 'migration_context' on Instance uuid 83d225e0-e39e-4500-b7ae-52dfbd8b8588 {{(pid=75045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 23:27:46 user nova-compute[75045]: DEBUG nova.objects.base [None req-31751176-347d-42ce-b2e6-ed798b738377 tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] Object Instance<83d225e0-e39e-4500-b7ae-52dfbd8b8588> lazy-loaded attributes: resources,migration_context {{(pid=75045) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 23:27:46 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:27:46 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b84f2b1-01a3-4789-bcef-8b7c4334132b/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:27:46 user nova-compute[75045]: WARNING nova.virt.libvirt.driver [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 23:27:46 user nova-compute[75045]: WARNING nova.virt.libvirt.driver [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 23:27:46 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Hypervisor/Node resource view: name=user free_ram=7479MB free_disk=25.107807159423828GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75045) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 23:27:46 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:27:46 user nova-compute[75045]: DEBUG nova.compute.provider_tree [None req-31751176-347d-42ce-b2e6-ed798b738377 tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] Inventory has not changed in ProviderTree for provider: 62ba5f85-c74d-4b58-986e-d4197e813fd7 {{(pid=75045) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 23:27:46 user nova-compute[75045]: DEBUG nova.scheduler.client.report [None req-31751176-347d-42ce-b2e6-ed798b738377 tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] Inventory has not changed for provider 62ba5f85-c74d-4b58-986e-d4197e813fd7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75045) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 23:27:46 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-31751176-347d-42ce-b2e6-ed798b738377 tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: held 0.908s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:27:46 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.326s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:27:47 user nova-compute[75045]: INFO nova.compute.manager [None req-31751176-347d-42ce-b2e6-ed798b738377 tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] [instance: 83d225e0-e39e-4500-b7ae-52dfbd8b8588] Swapping old allocation on dict_keys(['62ba5f85-c74d-4b58-986e-d4197e813fd7']) held by migration a833aacc-4f39-495d-a775-0a832874ba4f for instance
Nov 08 23:27:47 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Instance 4ae5ff6b-6f2c-4dfd-a4c6-da4809e2cf27 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75045) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 23:27:47 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Instance 0f21fcd3-ac5f-499e-9c34-82af806fda1d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75045) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 23:27:47 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Instance d2c911cf-d5f4-4c19-8335-8c7834184a7e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75045) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 23:27:47 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Instance 25cd59d1-6884-471a-813e-52e97c2e1208 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75045) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 23:27:47 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Instance b5fc7f02-2143-4bcf-92ac-078d5ec10747 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75045) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 23:27:47 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Instance 0b84f2b1-01a3-4789-bcef-8b7c4334132b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75045) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 23:27:47 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Instance 667d20c3-3eda-4aa5-b799-6dcee3443833 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75045) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 23:27:47 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Instance fa67b237-f598-4111-87ba-d761aa50d95e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75045) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 23:27:47 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Instance 7e92ab9a-8ea4-4452-a458-db181d4a59b7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75045) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 23:27:47 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Instance 72c9d731-2b35-434c-8463-1cd6c18fbd6a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75045) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 23:27:47 user nova-compute[75045]: INFO nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Instance a833aacc-4f39-495d-a775-0a832874ba4f has allocations against this compute host but is not found in the database.
Nov 08 23:27:47 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Instance 83d225e0-e39e-4500-b7ae-52dfbd8b8588 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75045) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 23:27:47 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=75045) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 23:27:47 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Final resource view: name=user phys_ram=16011MB used_ram=7680MB phys_disk=40GB used_disk=28GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=75045) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 23:27:47 user nova-compute[75045]: DEBUG nova.scheduler.client.report [None req-31751176-347d-42ce-b2e6-ed798b738377 tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] Overwriting current allocation {'allocations': {'62ba5f85-c74d-4b58-986e-d4197e813fd7': {'resources': {'VCPU': 1, 'MEMORY_MB': 2048, 'DISK_GB': 20}, 'generation': 30}}, 'project_id': '467f0ecc3b93457f9fe83886b99c6285', 'user_id': '57d0c13f5a9f4c1bbb0458b93de348cb', 'consumer_generation': 1} on consumer 83d225e0-e39e-4500-b7ae-52dfbd8b8588 {{(pid=75045) move_allocations /opt/stack/nova/nova/scheduler/client/report.py:2018}}
Nov 08 23:27:47 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-31751176-347d-42ce-b2e6-ed798b738377 tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] Acquiring lock "refresh_cache-83d225e0-e39e-4500-b7ae-52dfbd8b8588" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 23:27:47 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-31751176-347d-42ce-b2e6-ed798b738377 tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] Acquired lock "refresh_cache-83d225e0-e39e-4500-b7ae-52dfbd8b8588" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 23:27:47 user nova-compute[75045]: DEBUG nova.network.neutron [None req-31751176-347d-42ce-b2e6-ed798b738377 tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] [instance: 83d225e0-e39e-4500-b7ae-52dfbd8b8588] Building network info cache for instance {{(pid=75045) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 23:27:47 user nova-compute[75045]: DEBUG nova.compute.provider_tree [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Inventory has not changed in ProviderTree for provider: 62ba5f85-c74d-4b58-986e-d4197e813fd7 {{(pid=75045) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 23:27:47 user nova-compute[75045]: DEBUG nova.scheduler.client.report [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Inventory has not changed for provider 62ba5f85-c74d-4b58-986e-d4197e813fd7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75045) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 23:27:47 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Compute_service record updated for user:user {{(pid=75045) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 23:27:47 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.653s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:27:47 user nova-compute[75045]: DEBUG nova.network.neutron [None req-31751176-347d-42ce-b2e6-ed798b738377 tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] [instance: 83d225e0-e39e-4500-b7ae-52dfbd8b8588] Updating instance_info_cache with network_info: [{"id": "f34eef67-0428-49ea-91c3-08510ac690c8", "address": "fa:16:3e:d9:92:a4", "network": {"id": "d177c8b8-5960-4e40-bf9b-920a2f6ba4f7", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-497258569-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.31", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "467f0ecc3b93457f9fe83886b99c6285", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf34eef67-04", "ovs_interfaceid": "f34eef67-0428-49ea-91c3-08510ac690c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75045) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 23:27:47 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-31751176-347d-42ce-b2e6-ed798b738377 tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] Releasing lock "refresh_cache-83d225e0-e39e-4500-b7ae-52dfbd8b8588" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 23:27:47 user nova-compute[75045]: DEBUG os_brick.utils [None req-31751176-347d-42ce-b2e6-ed798b738377 tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75045) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 23:27:47 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:27:47 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:27:47 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cb31180-c633-489b-9798-7a2459cac35d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6217bd6e884\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:27:47 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:27:47 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:27:47 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[76b0781e-33d5-4300-baaa-c6b40909eddb]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:27:47 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:27:47 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:27:47 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[d07b7e4a-8dc2-424e-bc33-295b15ce5d7c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:27:47 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[53f504d3-7aad-4fe6-b2d2-6d72742bbc68]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:27:47 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-31751176-347d-42ce-b2e6-ed798b738377 tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] Running cmd (subprocess): nvme version {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:27:47 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-31751176-347d-42ce-b2e6-ed798b738377 tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] 'nvme version' failed. Not Retrying. {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 23:27:47 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.nvmeof [None req-31751176-347d-42ce-b2e6-ed798b738377 tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] nvme not present on system {{(pid=75045) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 23:27:47 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:27:47 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 23:27:47 user nova-compute[75045]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 23:27:47 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[afcc0348-0d0e-4256-89a4-91242aff0849]: (4, '') {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:27:47 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.lightos [None req-31751176-347d-42ce-b2e6-ed798b738377 tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75045) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 23:27:47 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.lightos [None req-31751176-347d-42ce-b2e6-ed798b738377 tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75045) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 23:27:47 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.lightos [None req-31751176-347d-42ce-b2e6-ed798b738377 tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] LIGHTOS: no hostnqn found. {{(pid=75045) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 23:27:47 user nova-compute[75045]: DEBUG os_brick.utils [None req-31751176-347d-42ce-b2e6-ed798b738377 tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] <== get_connector_properties: return (133ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6217bd6e884', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75045) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 23:27:48 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:27:48 user nova-compute[75045]: DEBUG nova.compute.manager [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Starting heal instance info cache {{(pid=75045) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 23:27:48 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Acquiring lock "refresh_cache-83d225e0-e39e-4500-b7ae-52dfbd8b8588" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 23:27:48 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Acquired lock "refresh_cache-83d225e0-e39e-4500-b7ae-52dfbd8b8588" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 23:27:48 user nova-compute[75045]: DEBUG nova.network.neutron [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] [instance: 83d225e0-e39e-4500-b7ae-52dfbd8b8588] Forcefully refreshing network info cache for instance {{(pid=75045) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 23:27:49 user nova-compute[75045]: DEBUG nova.network.neutron [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] [instance: 83d225e0-e39e-4500-b7ae-52dfbd8b8588] Updating instance_info_cache with network_info: [{"id": "f34eef67-0428-49ea-91c3-08510ac690c8", "address": "fa:16:3e:d9:92:a4", "network": {"id": "d177c8b8-5960-4e40-bf9b-920a2f6ba4f7", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-497258569-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.31", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "467f0ecc3b93457f9fe83886b99c6285", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf34eef67-04", "ovs_interfaceid": "f34eef67-0428-49ea-91c3-08510ac690c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75045) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 23:27:49 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Releasing lock "refresh_cache-83d225e0-e39e-4500-b7ae-52dfbd8b8588" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 23:27:49 user nova-compute[75045]: DEBUG nova.compute.manager [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] [instance: 83d225e0-e39e-4500-b7ae-52dfbd8b8588] Updated the network info_cache for instance {{(pid=75045) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 23:27:49 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:27:49 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:27:49 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:27:49 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:27:54 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 23:27:54 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:27:54 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75045) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 23:27:54 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75045) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 23:27:54 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75045) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 23:27:54 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:27:55 user nova-compute[75045]: WARNING nova.virt.libvirt.driver [None req-dd229295-ac54-4ee5-9d41-f9d012d9611b tempest-VolumesAdminNegativeTest-215528111 tempest-VolumesAdminNegativeTest-215528111-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 7e92ab9a-8ea4-4452-a458-db181d4a59b7 is timed out.
Nov 08 23:27:55 user nova-compute[75045]: INFO nova.virt.libvirt.driver [None req-dd229295-ac54-4ee5-9d41-f9d012d9611b tempest-VolumesAdminNegativeTest-215528111 tempest-VolumesAdminNegativeTest-215528111-project-member] Successfully detached device vdb from instance 7e92ab9a-8ea4-4452-a458-db181d4a59b7 from the live domain config.
Nov 08 23:27:55 user nova-compute[75045]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dd229295-ac54-4ee5-9d41-f9d012d9611b tempest-VolumesAdminNegativeTest-215528111 tempest-VolumesAdminNegativeTest-215528111-project-member] [instance: 7e92ab9a-8ea4-4452-a458-db181d4a59b7] calling os-brick to detach iSCSI Volume {{(pid=75045) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 23:27:55 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd229295-ac54-4ee5-9d41-f9d012d9611b tempest-VolumesAdminNegativeTest-215528111 tempest-VolumesAdminNegativeTest-215528111-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1b68210460>, {'target_iqn': 'iqn.2010-10.org.openstack:9037467e-0ff2-4d03-925e-8997a3759542', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'THZbgsEa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75045) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 23:27:55 user nova-compute[75045]: WARNING os_brick.initiator.connectors.base [None req-dd229295-ac54-4ee5-9d41-f9d012d9611b tempest-VolumesAdminNegativeTest-215528111 tempest-VolumesAdminNegativeTest-215528111-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 23:27:55 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-dd229295-ac54-4ee5-9d41-f9d012d9611b tempest-VolumesAdminNegativeTest-215528111 tempest-VolumesAdminNegativeTest-215528111-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 23:27:55 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-dd229295-ac54-4ee5-9d41-f9d012d9611b tempest-VolumesAdminNegativeTest-215528111 tempest-VolumesAdminNegativeTest-215528111-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 23:27:55 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:27:55 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:27:55 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[c106bee9-d9ea-4457-9971-7755cb6c9d5f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9037467e-0ff2-4d03-925e-8997a3759542\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a42d9799-d775-4120-8af0-bc81a6278ea7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:04d02c98-d058-49d8-a350-ab9e63003d6e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9c37da13-9531-458a-87cb-1e86e6b84f3a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:27:55 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd229295-ac54-4ee5-9d41-f9d012d9611b tempest-VolumesAdminNegativeTest-215528111 tempest-VolumesAdminNegativeTest-215528111-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 23:27:55 user nova-compute[75045]: No targets found.
Nov 08 23:27:55 user nova-compute[75045]: iSNS:
Nov 08 23:27:55 user nova-compute[75045]: No targets found.
Nov 08 23:27:55 user nova-compute[75045]: STATIC:
Nov 08 23:27:55 user nova-compute[75045]: Target: iqn.2010-10.org.openstack:9037467e-0ff2-4d03-925e-8997a3759542
Nov 08 23:27:55 user nova-compute[75045]:         Portal: 172.16.0.220:3260,-1
Nov 08 23:27:55 user nova-compute[75045]:                 Iface Name: default
Nov 08 23:27:55 user nova-compute[75045]: Target: iqn.2010-10.org.openstack:a42d9799-d775-4120-8af0-bc81a6278ea7
Nov 08 23:27:55 user nova-compute[75045]:         Portal: 172.16.0.220:3260,-1
Nov 08 23:27:55 user nova-compute[75045]:                 Iface Name: default
Nov 08 23:27:55 user nova-compute[75045]: Target: iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab
Nov 08 23:27:55 user nova-compute[75045]:         Portal: 172.16.0.220:3260,-1
Nov 08 23:27:55 user nova-compute[75045]:                 Iface Name: default
Nov 08 23:27:55 user nova-compute[75045]: Target: iqn.2010-10.org.openstack:04d02c98-d058-49d8-a350-ab9e63003d6e
Nov 08 23:27:55 user nova-compute[75045]:         Portal: 172.16.0.220:3260,-1
Nov 08 23:27:55 user nova-compute[75045]:                 Iface Name: default
Nov 08 23:27:55 user nova-compute[75045]: Target: iqn.2010-10.org.openstack:9c37da13-9531-458a-87cb-1e86e6b84f3a
Nov 08 23:27:55 user nova-compute[75045]:         Portal: 172.16.0.220:3260,-1
Nov 08 23:27:55 user nova-compute[75045]:                 Iface Name: default
Nov 08 23:27:55 user nova-compute[75045]: FIRMWARE:
Nov 08 23:27:55 user nova-compute[75045]: No targets found.
Nov 08 23:27:55 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 23:27:55 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd229295-ac54-4ee5-9d41-f9d012d9611b tempest-VolumesAdminNegativeTest-215528111 tempest-VolumesAdminNegativeTest-215528111-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 23:27:55 user nova-compute[75045]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 23:27:55 user nova-compute[75045]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75045) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 23:27:55 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd229295-ac54-4ee5-9d41-f9d012d9611b tempest-VolumesAdminNegativeTest-215528111 tempest-VolumesAdminNegativeTest-215528111-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9037467e-0ff2-4d03-925e-8997a3759542', 0)] {{(pid=75045) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 23:27:55 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:27:55 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:27:55 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bf30d4a-3231-4c03-b97f-48999b7924bf]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:04d02c98-d058-49d8-a350-ab9e63003d6e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9037467e-0ff2-4d03-925e-8997a3759542\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9c37da13-9531-458a-87cb-1e86e6b84f3a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a42d9799-d775-4120-8af0-bc81a6278ea7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:27:55 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:27:55 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:27:55 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[2530c3d5-5a70-4df7-bcf3-a32432c4b8ec]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c37da13-9531-458a-87cb-1e86e6b84f3a (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04d02c98-d058-49d8-a350-ab9e63003d6e (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9037467e-0ff2-4d03-925e-8997a3759542 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a42d9799-d775-4120-8af0-bc81a6278ea7 (non-flash)\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:27:55 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd229295-ac54-4ee5-9d41-f9d012d9611b tempest-VolumesAdminNegativeTest-215528111 tempest-VolumesAdminNegativeTest-215528111-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab (non-flash)
Nov 08 23:27:55 user nova-compute[75045]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c37da13-9531-458a-87cb-1e86e6b84f3a (non-flash)
Nov 08 23:27:55 user nova-compute[75045]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04d02c98-d058-49d8-a350-ab9e63003d6e (non-flash)
Nov 08 23:27:55 user nova-compute[75045]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9037467e-0ff2-4d03-925e-8997a3759542 (non-flash)
Nov 08 23:27:55 user nova-compute[75045]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a42d9799-d775-4120-8af0-bc81a6278ea7 (non-flash)
Nov 08 23:27:55 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 23:27:55 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd229295-ac54-4ee5-9d41-f9d012d9611b tempest-VolumesAdminNegativeTest-215528111 tempest-VolumesAdminNegativeTest-215528111-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab (non-flash)
Nov 08 23:27:55 user nova-compute[75045]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c37da13-9531-458a-87cb-1e86e6b84f3a (non-flash)
Nov 08 23:27:55 user nova-compute[75045]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04d02c98-d058-49d8-a350-ab9e63003d6e (non-flash)
Nov 08 23:27:55 user nova-compute[75045]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9037467e-0ff2-4d03-925e-8997a3759542 (non-flash)
Nov 08 23:27:55 user nova-compute[75045]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a42d9799-d775-4120-8af0-bc81a6278ea7 (non-flash)
Nov 08 23:27:55 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 23:27:55 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd229295-ac54-4ee5-9d41-f9d012d9611b tempest-VolumesAdminNegativeTest-215528111 tempest-VolumesAdminNegativeTest-215528111-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1b48479e10>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9037467e-0ff2-4d03-925e-8997a3759542'): ({'sdc'}, set())}) {{(pid=75045) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 23:27:55 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-dd229295-ac54-4ee5-9d41-f9d012d9611b tempest-VolumesAdminNegativeTest-215528111 tempest-VolumesAdminNegativeTest-215528111-project-member] Removing single pathed devices sdc {{(pid=75045) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 23:27:55 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:27:55 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:27:55 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[54d7133a-6d5b-4386-9b07-f2e00163a7ab]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:27:55 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:27:55 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.027s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:27:55 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[50c47459-3c5d-4804-b0fe-b2b13adc6fac]: (4, ('ok\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:27:55 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-dd229295-ac54-4ee5-9d41-f9d012d9611b tempest-VolumesAdminNegativeTest-215528111 tempest-VolumesAdminNegativeTest-215528111-project-member] Flushing IO for device /dev/sdc {{(pid=75045) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 23:27:55 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:27:55 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:27:55 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddf33550-ad15-4e40-a0d9-e4b289959e28]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:27:55 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-dd229295-ac54-4ee5-9d41-f9d012d9611b tempest-VolumesAdminNegativeTest-215528111 tempest-VolumesAdminNegativeTest-215528111-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75045) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 23:27:55 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:27:55 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.066s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:27:55 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[8300f817-0864-4673-bda4-7e44af046596]: (4, ('1', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:27:55 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-dd229295-ac54-4ee5-9d41-f9d012d9611b tempest-VolumesAdminNegativeTest-215528111 tempest-VolumesAdminNegativeTest-215528111-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75045) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 23:27:55 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-dd229295-ac54-4ee5-9d41-f9d012d9611b tempest-VolumesAdminNegativeTest-215528111 tempest-VolumesAdminNegativeTest-215528111-project-member] SCSI volumes sdc have been removed. {{(pid=75045) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 23:27:55 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd229295-ac54-4ee5-9d41-f9d012d9611b tempest-VolumesAdminNegativeTest-215528111 tempest-VolumesAdminNegativeTest-215528111-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9037467e-0ff2-4d03-925e-8997a3759542')] {{(pid=75045) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 23:27:55 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9037467e-0ff2-4d03-925e-8997a3759542 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:27:55 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9037467e-0ff2-4d03-925e-8997a3759542 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:27:55 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4f91fc2-53d8-463c-a8a0-c19290c295af]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:27:55 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd229295-ac54-4ee5-9d41-f9d012d9611b tempest-VolumesAdminNegativeTest-215528111 tempest-VolumesAdminNegativeTest-215528111-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:27:55 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9037467e-0ff2-4d03-925e-8997a3759542 -p 172.16.0.220:3260 --logout {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:27:55 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9037467e-0ff2-4d03-925e-8997a3759542 -p 172.16.0.220:3260 --logout" returned: 0 in 0.071s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:27:55 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[588a3cca-2cb0-470f-8156-44fb9950609b]: (4, ('Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:9037467e-0ff2-4d03-925e-8997a3759542, portal: 172.16.0.220,3260]\nLogout of [sid: 25, target: iqn.2010-10.org.openstack:9037467e-0ff2-4d03-925e-8997a3759542, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:27:55 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd229295-ac54-4ee5-9d41-f9d012d9611b tempest-VolumesAdminNegativeTest-215528111 tempest-VolumesAdminNegativeTest-215528111-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:9037467e-0ff2-4d03-925e-8997a3759542, portal: 172.16.0.220,3260]
Nov 08 23:27:55 user nova-compute[75045]: Logout of [sid: 25, target: iqn.2010-10.org.openstack:9037467e-0ff2-4d03-925e-8997a3759542, portal: 172.16.0.220,3260] successful.
Nov 08 23:27:55 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:27:56 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9037467e-0ff2-4d03-925e-8997a3759542 -p 172.16.0.220:3260 --op delete {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:27:56 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9037467e-0ff2-4d03-925e-8997a3759542 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.037s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:27:56 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[71118c08-3472-450d-b08d-127ece6b978b]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:27:56 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd229295-ac54-4ee5-9d41-f9d012d9611b tempest-VolumesAdminNegativeTest-215528111 tempest-VolumesAdminNegativeTest-215528111-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:27:56 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-dd229295-ac54-4ee5-9d41-f9d012d9611b tempest-VolumesAdminNegativeTest-215528111 tempest-VolumesAdminNegativeTest-215528111-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.403s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 23:27:56 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd229295-ac54-4ee5-9d41-f9d012d9611b tempest-VolumesAdminNegativeTest-215528111 tempest-VolumesAdminNegativeTest-215528111-project-member] <== disconnect_volume: return (406ms) None {{(pid=75045) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 23:27:56 user nova-compute[75045]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dd229295-ac54-4ee5-9d41-f9d012d9611b tempest-VolumesAdminNegativeTest-215528111 tempest-VolumesAdminNegativeTest-215528111-project-member] [instance: 7e92ab9a-8ea4-4452-a458-db181d4a59b7] Disconnected iSCSI Volume {{(pid=75045) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 23:27:56 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:27:57 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-8f4d4c6c-cec0-4708-b180-7b306fe35c42 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Acquiring lock "438082fc-a83f-4305-ada6-41a8e1d645a8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:27:57 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-8f4d4c6c-cec0-4708-b180-7b306fe35c42 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Lock "438082fc-a83f-4305-ada6-41a8e1d645a8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:27:57 user nova-compute[75045]: DEBUG nova.compute.manager [None req-8f4d4c6c-cec0-4708-b180-7b306fe35c42 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] [instance: 438082fc-a83f-4305-ada6-41a8e1d645a8] Starting instance... {{(pid=75045) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 23:27:57 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-8f4d4c6c-cec0-4708-b180-7b306fe35c42 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:27:57 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-8f4d4c6c-cec0-4708-b180-7b306fe35c42 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:27:57 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-8f4d4c6c-cec0-4708-b180-7b306fe35c42 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75045) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 23:27:57 user nova-compute[75045]: INFO nova.compute.claims [None req-8f4d4c6c-cec0-4708-b180-7b306fe35c42 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] [instance: 438082fc-a83f-4305-ada6-41a8e1d645a8] Claim successful on node user
Nov 08 23:27:57 user nova-compute[75045]: DEBUG nova.compute.provider_tree [None req-8f4d4c6c-cec0-4708-b180-7b306fe35c42 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Inventory has not changed in ProviderTree for provider: 62ba5f85-c74d-4b58-986e-d4197e813fd7 {{(pid=75045) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 23:27:57 user nova-compute[75045]: DEBUG nova.scheduler.client.report [None req-8f4d4c6c-cec0-4708-b180-7b306fe35c42 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Inventory has not changed for provider 62ba5f85-c74d-4b58-986e-d4197e813fd7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75045) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 23:27:57 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-8f4d4c6c-cec0-4708-b180-7b306fe35c42 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.552s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:27:57 user nova-compute[75045]: DEBUG nova.compute.manager [None req-8f4d4c6c-cec0-4708-b180-7b306fe35c42 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] [instance: 438082fc-a83f-4305-ada6-41a8e1d645a8] Start building networks asynchronously for instance. {{(pid=75045) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 23:27:57 user nova-compute[75045]: DEBUG nova.compute.manager [None req-8f4d4c6c-cec0-4708-b180-7b306fe35c42 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] [instance: 438082fc-a83f-4305-ada6-41a8e1d645a8] Allocating IP information in the background. {{(pid=75045) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 23:27:57 user nova-compute[75045]: DEBUG nova.network.neutron [None req-8f4d4c6c-cec0-4708-b180-7b306fe35c42 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] [instance: 438082fc-a83f-4305-ada6-41a8e1d645a8] allocate_for_instance() {{(pid=75045) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 23:27:57 user nova-compute[75045]: INFO nova.virt.libvirt.driver [None req-8f4d4c6c-cec0-4708-b180-7b306fe35c42 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] [instance: 438082fc-a83f-4305-ada6-41a8e1d645a8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 23:27:58 user nova-compute[75045]: DEBUG nova.compute.manager [None req-8f4d4c6c-cec0-4708-b180-7b306fe35c42 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] [instance: 438082fc-a83f-4305-ada6-41a8e1d645a8] Start building block device mappings for instance. {{(pid=75045) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 23:27:58 user nova-compute[75045]: INFO nova.virt.block_device [None req-8f4d4c6c-cec0-4708-b180-7b306fe35c42 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] [instance: 438082fc-a83f-4305-ada6-41a8e1d645a8] Booting with volume-backed-image a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb at /dev/vda
Nov 08 23:27:58 user nova-compute[75045]: DEBUG nova.policy [None req-8f4d4c6c-cec0-4708-b180-7b306fe35c42 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '04bb3135250f4465a9947b47f9cde485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bfb6963a6c145d4a7b7e47c8fde7e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75045) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 23:27:58 user nova-compute[75045]: DEBUG nova.network.neutron [None req-8f4d4c6c-cec0-4708-b180-7b306fe35c42 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] [instance: 438082fc-a83f-4305-ada6-41a8e1d645a8] Successfully created port: 669f0f7f-7c58-42b9-948b-ad3704fb1ab3 {{(pid=75045) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 23:27:59 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:27:59 user nova-compute[75045]: DEBUG nova.network.neutron [None req-8f4d4c6c-cec0-4708-b180-7b306fe35c42 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] [instance: 438082fc-a83f-4305-ada6-41a8e1d645a8] Successfully updated port: 669f0f7f-7c58-42b9-948b-ad3704fb1ab3 {{(pid=75045) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 23:27:59 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-8f4d4c6c-cec0-4708-b180-7b306fe35c42 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Acquiring lock "refresh_cache-438082fc-a83f-4305-ada6-41a8e1d645a8" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 23:27:59 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-8f4d4c6c-cec0-4708-b180-7b306fe35c42 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Acquired lock "refresh_cache-438082fc-a83f-4305-ada6-41a8e1d645a8" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 23:27:59 user nova-compute[75045]: DEBUG nova.network.neutron [None req-8f4d4c6c-cec0-4708-b180-7b306fe35c42 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] [instance: 438082fc-a83f-4305-ada6-41a8e1d645a8] Building network info cache for instance {{(pid=75045) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 23:27:59 user nova-compute[75045]: DEBUG nova.compute.manager [req-4a72a658-1bb8-456d-a1ae-f16d76aaea07 req-7da031c0-9e47-4324-881e-30fcc4e903ca service nova] [instance: 438082fc-a83f-4305-ada6-41a8e1d645a8] Received event network-changed-669f0f7f-7c58-42b9-948b-ad3704fb1ab3 {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:27:59 user nova-compute[75045]: DEBUG nova.compute.manager [req-4a72a658-1bb8-456d-a1ae-f16d76aaea07 req-7da031c0-9e47-4324-881e-30fcc4e903ca service nova] [instance: 438082fc-a83f-4305-ada6-41a8e1d645a8] Refreshing instance network info cache due to event network-changed-669f0f7f-7c58-42b9-948b-ad3704fb1ab3. {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 23:27:59 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-4a72a658-1bb8-456d-a1ae-f16d76aaea07 req-7da031c0-9e47-4324-881e-30fcc4e903ca service nova] Acquiring lock "refresh_cache-438082fc-a83f-4305-ada6-41a8e1d645a8" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 23:27:59 user nova-compute[75045]: DEBUG nova.network.neutron [None req-8f4d4c6c-cec0-4708-b180-7b306fe35c42 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] [instance: 438082fc-a83f-4305-ada6-41a8e1d645a8] Instance cache missing network info. {{(pid=75045) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 23:27:59 user nova-compute[75045]: DEBUG nova.network.neutron [None req-8f4d4c6c-cec0-4708-b180-7b306fe35c42 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] [instance: 438082fc-a83f-4305-ada6-41a8e1d645a8] Updating instance_info_cache with network_info: [{"id": "669f0f7f-7c58-42b9-948b-ad3704fb1ab3", "address": "fa:16:3e:57:c2:f9", "network": {"id": "d4cd6998-66d1-4389-bc82-dd000c8962de", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-323966879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bfb6963a6c145d4a7b7e47c8fde7e60", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap669f0f7f-7c", "ovs_interfaceid": "669f0f7f-7c58-42b9-948b-ad3704fb1ab3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75045) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 23:27:59 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-8f4d4c6c-cec0-4708-b180-7b306fe35c42 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Releasing lock "refresh_cache-438082fc-a83f-4305-ada6-41a8e1d645a8" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 23:27:59 user nova-compute[75045]: DEBUG nova.compute.manager [None req-8f4d4c6c-cec0-4708-b180-7b306fe35c42 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] [instance: 438082fc-a83f-4305-ada6-41a8e1d645a8] Instance network_info: |[{"id": "669f0f7f-7c58-42b9-948b-ad3704fb1ab3", "address": "fa:16:3e:57:c2:f9", "network": {"id": "d4cd6998-66d1-4389-bc82-dd000c8962de", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-323966879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bfb6963a6c145d4a7b7e47c8fde7e60", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap669f0f7f-7c", "ovs_interfaceid": "669f0f7f-7c58-42b9-948b-ad3704fb1ab3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75045) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 23:27:59 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-4a72a658-1bb8-456d-a1ae-f16d76aaea07 req-7da031c0-9e47-4324-881e-30fcc4e903ca service nova] Acquired lock "refresh_cache-438082fc-a83f-4305-ada6-41a8e1d645a8" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 23:27:59 user nova-compute[75045]: DEBUG nova.network.neutron [req-4a72a658-1bb8-456d-a1ae-f16d76aaea07 req-7da031c0-9e47-4324-881e-30fcc4e903ca service nova] [instance: 438082fc-a83f-4305-ada6-41a8e1d645a8] Refreshing network info cache for port 669f0f7f-7c58-42b9-948b-ad3704fb1ab3 {{(pid=75045) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 23:28:00 user nova-compute[75045]: DEBUG nova.network.neutron [req-4a72a658-1bb8-456d-a1ae-f16d76aaea07 req-7da031c0-9e47-4324-881e-30fcc4e903ca service nova] [instance: 438082fc-a83f-4305-ada6-41a8e1d645a8] Updated VIF entry in instance network info cache for port 669f0f7f-7c58-42b9-948b-ad3704fb1ab3. {{(pid=75045) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 23:28:00 user nova-compute[75045]: DEBUG nova.network.neutron [req-4a72a658-1bb8-456d-a1ae-f16d76aaea07 req-7da031c0-9e47-4324-881e-30fcc4e903ca service nova] [instance: 438082fc-a83f-4305-ada6-41a8e1d645a8] Updating instance_info_cache with network_info: [{"id": "669f0f7f-7c58-42b9-948b-ad3704fb1ab3", "address": "fa:16:3e:57:c2:f9", "network": {"id": "d4cd6998-66d1-4389-bc82-dd000c8962de", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-323966879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bfb6963a6c145d4a7b7e47c8fde7e60", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap669f0f7f-7c", "ovs_interfaceid": "669f0f7f-7c58-42b9-948b-ad3704fb1ab3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75045) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 23:28:00 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-4a72a658-1bb8-456d-a1ae-f16d76aaea07 req-7da031c0-9e47-4324-881e-30fcc4e903ca service nova] Releasing lock "refresh_cache-438082fc-a83f-4305-ada6-41a8e1d645a8" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 23:28:01 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:28:01 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-ca9ec2ee-9154-4e3f-925c-fa499ff66d33 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Acquiring lock "04169f59-e9a6-4b50-9ad7-7f8c105a376a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:28:01 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-ca9ec2ee-9154-4e3f-925c-fa499ff66d33 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Lock "04169f59-e9a6-4b50-9ad7-7f8c105a376a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:28:01 user nova-compute[75045]: DEBUG nova.compute.manager [None req-ca9ec2ee-9154-4e3f-925c-fa499ff66d33 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] [instance: 04169f59-e9a6-4b50-9ad7-7f8c105a376a] Starting instance... {{(pid=75045) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 23:28:01 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-ca9ec2ee-9154-4e3f-925c-fa499ff66d33 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:28:01 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-ca9ec2ee-9154-4e3f-925c-fa499ff66d33 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:28:01 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-ca9ec2ee-9154-4e3f-925c-fa499ff66d33 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75045) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 23:28:01 user nova-compute[75045]: INFO nova.compute.claims [None req-ca9ec2ee-9154-4e3f-925c-fa499ff66d33 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] [instance: 04169f59-e9a6-4b50-9ad7-7f8c105a376a] Claim successful on node user
Nov 08 23:28:01 user nova-compute[75045]: DEBUG nova.compute.provider_tree [None req-ca9ec2ee-9154-4e3f-925c-fa499ff66d33 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Inventory has not changed in ProviderTree for provider: 62ba5f85-c74d-4b58-986e-d4197e813fd7 {{(pid=75045) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 23:28:01 user nova-compute[75045]: DEBUG nova.scheduler.client.report [None req-ca9ec2ee-9154-4e3f-925c-fa499ff66d33 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Inventory has not changed for provider 62ba5f85-c74d-4b58-986e-d4197e813fd7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75045) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 23:28:01 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-ca9ec2ee-9154-4e3f-925c-fa499ff66d33 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.568s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:28:01 user nova-compute[75045]: DEBUG nova.compute.manager [None req-ca9ec2ee-9154-4e3f-925c-fa499ff66d33 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] [instance: 04169f59-e9a6-4b50-9ad7-7f8c105a376a] Start building networks asynchronously for instance. {{(pid=75045) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 23:28:02 user nova-compute[75045]: DEBUG nova.compute.manager [None req-ca9ec2ee-9154-4e3f-925c-fa499ff66d33 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] [instance: 04169f59-e9a6-4b50-9ad7-7f8c105a376a] Allocating IP information in the background. {{(pid=75045) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 23:28:02 user nova-compute[75045]: DEBUG nova.network.neutron [None req-ca9ec2ee-9154-4e3f-925c-fa499ff66d33 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] [instance: 04169f59-e9a6-4b50-9ad7-7f8c105a376a] allocate_for_instance() {{(pid=75045) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 23:28:02 user nova-compute[75045]: INFO nova.virt.libvirt.driver [None req-ca9ec2ee-9154-4e3f-925c-fa499ff66d33 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] [instance: 04169f59-e9a6-4b50-9ad7-7f8c105a376a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 23:28:02 user nova-compute[75045]: DEBUG nova.compute.manager [None req-ca9ec2ee-9154-4e3f-925c-fa499ff66d33 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] [instance: 04169f59-e9a6-4b50-9ad7-7f8c105a376a] Start building block device mappings for instance. {{(pid=75045) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 23:28:02 user nova-compute[75045]: DEBUG nova.policy [None req-ca9ec2ee-9154-4e3f-925c-fa499ff66d33 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '75fc508f268d4a569ad78598ff019c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e63623113f11463d9035bb990de43510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75045) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 23:28:02 user nova-compute[75045]: INFO nova.virt.block_device [None req-ca9ec2ee-9154-4e3f-925c-fa499ff66d33 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] [instance: 04169f59-e9a6-4b50-9ad7-7f8c105a376a] Booting with volume e9c3ac6d-d72a-41c8-9c18-15131250e323 at /dev/vda
Nov 08 23:28:02 user nova-compute[75045]: DEBUG os_brick.utils [None req-ca9ec2ee-9154-4e3f-925c-fa499ff66d33 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75045) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 23:28:02 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:28:02 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:28:02 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[68480bcb-a9b5-40c9-83e5-baec123408a4]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6217bd6e884\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:28:02 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:28:02 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:28:02 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[447fac8b-01c0-42a9-9762-b369f51de3ef]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:28:02 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:28:02 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:28:02 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ab47102-7319-4069-8afa-6693e6d94f76]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:28:02 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9d951eb-68ed-42a6-818d-d6af095ad0d1]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:28:02 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-ca9ec2ee-9154-4e3f-925c-fa499ff66d33 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Running cmd (subprocess): nvme version {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:28:02 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-ca9ec2ee-9154-4e3f-925c-fa499ff66d33 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] 'nvme version' failed. Not Retrying. {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 23:28:02 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ca9ec2ee-9154-4e3f-925c-fa499ff66d33 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] nvme not present on system {{(pid=75045) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 23:28:02 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:28:02 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 23:28:02 user nova-compute[75045]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 23:28:02 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[c07a74e1-918a-4800-9a68-8c4787844a9c]: (4, '') {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:28:02 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.lightos [None req-ca9ec2ee-9154-4e3f-925c-fa499ff66d33 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75045) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 23:28:02 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.lightos [None req-ca9ec2ee-9154-4e3f-925c-fa499ff66d33 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75045) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 23:28:02 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.lightos [None req-ca9ec2ee-9154-4e3f-925c-fa499ff66d33 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] LIGHTOS: no hostnqn found. {{(pid=75045) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 23:28:02 user nova-compute[75045]: DEBUG os_brick.utils [None req-ca9ec2ee-9154-4e3f-925c-fa499ff66d33 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] <== get_connector_properties: return (131ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6217bd6e884', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75045) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 23:28:02 user nova-compute[75045]: DEBUG nova.virt.block_device [None req-ca9ec2ee-9154-4e3f-925c-fa499ff66d33 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] [instance: 04169f59-e9a6-4b50-9ad7-7f8c105a376a] Updating existing volume attachment record: 3f368314-b029-4aa5-8982-e02bb1def64e {{(pid=75045) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 23:28:02 user nova-compute[75045]: DEBUG nova.network.neutron [None req-ca9ec2ee-9154-4e3f-925c-fa499ff66d33 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] [instance: 04169f59-e9a6-4b50-9ad7-7f8c105a376a] Successfully created port: 96af9673-bb3c-4173-8439-0be6d2b922cf {{(pid=75045) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 23:28:03 user nova-compute[75045]: DEBUG nova.network.neutron [None req-ca9ec2ee-9154-4e3f-925c-fa499ff66d33 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] [instance: 04169f59-e9a6-4b50-9ad7-7f8c105a376a] Successfully updated port: 96af9673-bb3c-4173-8439-0be6d2b922cf {{(pid=75045) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 23:28:03 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-ca9ec2ee-9154-4e3f-925c-fa499ff66d33 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Acquiring lock "refresh_cache-04169f59-e9a6-4b50-9ad7-7f8c105a376a" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 23:28:03 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-ca9ec2ee-9154-4e3f-925c-fa499ff66d33 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Acquired lock "refresh_cache-04169f59-e9a6-4b50-9ad7-7f8c105a376a" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 23:28:03 user nova-compute[75045]: DEBUG nova.network.neutron [None req-ca9ec2ee-9154-4e3f-925c-fa499ff66d33 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] [instance: 04169f59-e9a6-4b50-9ad7-7f8c105a376a] Building network info cache for instance {{(pid=75045) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 23:28:04 user nova-compute[75045]: DEBUG nova.compute.manager [req-93516c57-3a9c-4b87-81f4-bca636754062 req-3f46341a-e59a-4552-893b-eb4bde458fba service nova] [instance: 04169f59-e9a6-4b50-9ad7-7f8c105a376a] Received event network-changed-96af9673-bb3c-4173-8439-0be6d2b922cf {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:28:04 user nova-compute[75045]: DEBUG nova.compute.manager [req-93516c57-3a9c-4b87-81f4-bca636754062 req-3f46341a-e59a-4552-893b-eb4bde458fba service nova] [instance: 04169f59-e9a6-4b50-9ad7-7f8c105a376a] Refreshing instance network info cache due to event network-changed-96af9673-bb3c-4173-8439-0be6d2b922cf. {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 23:28:04 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-93516c57-3a9c-4b87-81f4-bca636754062 req-3f46341a-e59a-4552-893b-eb4bde458fba service nova] Acquiring lock "refresh_cache-04169f59-e9a6-4b50-9ad7-7f8c105a376a" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 23:28:04 user nova-compute[75045]: DEBUG nova.network.neutron [None req-ca9ec2ee-9154-4e3f-925c-fa499ff66d33 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] [instance: 04169f59-e9a6-4b50-9ad7-7f8c105a376a] Instance cache missing network info. {{(pid=75045) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 23:28:04 user nova-compute[75045]: DEBUG nova.network.neutron [None req-ca9ec2ee-9154-4e3f-925c-fa499ff66d33 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] [instance: 04169f59-e9a6-4b50-9ad7-7f8c105a376a] Updating instance_info_cache with network_info: [{"id": "96af9673-bb3c-4173-8439-0be6d2b922cf", "address": "fa:16:3e:a5:6d:8b", "network": {"id": "700b5784-d35b-45c0-a4d3-1ab8aa4c48aa", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-194469807-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e63623113f11463d9035bb990de43510", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96af9673-bb", "ovs_interfaceid": "96af9673-bb3c-4173-8439-0be6d2b922cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75045) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 23:28:04 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-ca9ec2ee-9154-4e3f-925c-fa499ff66d33 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Releasing lock "refresh_cache-04169f59-e9a6-4b50-9ad7-7f8c105a376a" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 23:28:04 user nova-compute[75045]: DEBUG nova.compute.manager [None req-ca9ec2ee-9154-4e3f-925c-fa499ff66d33 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] [instance: 04169f59-e9a6-4b50-9ad7-7f8c105a376a] Instance network_info: |[{"id": "96af9673-bb3c-4173-8439-0be6d2b922cf", "address": "fa:16:3e:a5:6d:8b", "network": {"id": "700b5784-d35b-45c0-a4d3-1ab8aa4c48aa", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-194469807-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e63623113f11463d9035bb990de43510", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96af9673-bb", "ovs_interfaceid": "96af9673-bb3c-4173-8439-0be6d2b922cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75045) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 23:28:04 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-93516c57-3a9c-4b87-81f4-bca636754062 req-3f46341a-e59a-4552-893b-eb4bde458fba service nova] Acquired lock "refresh_cache-04169f59-e9a6-4b50-9ad7-7f8c105a376a" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 23:28:04 user nova-compute[75045]: DEBUG nova.network.neutron [req-93516c57-3a9c-4b87-81f4-bca636754062 req-3f46341a-e59a-4552-893b-eb4bde458fba service nova] [instance: 04169f59-e9a6-4b50-9ad7-7f8c105a376a] Refreshing network info cache for port 96af9673-bb3c-4173-8439-0be6d2b922cf {{(pid=75045) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 23:28:04 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:28:04 user nova-compute[75045]: WARNING nova.virt.libvirt.driver [None req-b99fe833-6bbd-4aa7-a030-e5c98392cb65 tempest-TestStampPattern-2120781434 tempest-TestStampPattern-2120781434-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 72c9d731-2b35-434c-8463-1cd6c18fbd6a is timed out.
Nov 08 23:28:04 user nova-compute[75045]: INFO nova.virt.libvirt.driver [None req-b99fe833-6bbd-4aa7-a030-e5c98392cb65 tempest-TestStampPattern-2120781434 tempest-TestStampPattern-2120781434-project-member] Successfully detached device vdb from instance 72c9d731-2b35-434c-8463-1cd6c18fbd6a from the live domain config.
Nov 08 23:28:04 user nova-compute[75045]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b99fe833-6bbd-4aa7-a030-e5c98392cb65 tempest-TestStampPattern-2120781434 tempest-TestStampPattern-2120781434-project-member] [instance: 72c9d731-2b35-434c-8463-1cd6c18fbd6a] calling os-brick to detach iSCSI Volume {{(pid=75045) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 23:28:04 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-b99fe833-6bbd-4aa7-a030-e5c98392cb65 tempest-TestStampPattern-2120781434 tempest-TestStampPattern-2120781434-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1b68210460>, {'target_iqn': 'iqn.2010-10.org.openstack:a42d9799-d775-4120-8af0-bc81a6278ea7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rwdMtfnR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=75045) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 23:28:04 user nova-compute[75045]: WARNING os_brick.initiator.connectors.base [None req-b99fe833-6bbd-4aa7-a030-e5c98392cb65 tempest-TestStampPattern-2120781434 tempest-TestStampPattern-2120781434-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 23:28:04 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-b99fe833-6bbd-4aa7-a030-e5c98392cb65 tempest-TestStampPattern-2120781434 tempest-TestStampPattern-2120781434-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 23:28:04 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-b99fe833-6bbd-4aa7-a030-e5c98392cb65 tempest-TestStampPattern-2120781434 tempest-TestStampPattern-2120781434-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 23:28:04 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:28:04 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:28:04 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[54028897-1b04-470d-8f84-ddfae13b83d7]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a42d9799-d775-4120-8af0-bc81a6278ea7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:04d02c98-d058-49d8-a350-ab9e63003d6e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9c37da13-9531-458a-87cb-1e86e6b84f3a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:28:04 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-b99fe833-6bbd-4aa7-a030-e5c98392cb65 tempest-TestStampPattern-2120781434 tempest-TestStampPattern-2120781434-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 23:28:04 user nova-compute[75045]: No targets found.
Nov 08 23:28:04 user nova-compute[75045]: iSNS:
Nov 08 23:28:04 user nova-compute[75045]: No targets found.
Nov 08 23:28:04 user nova-compute[75045]: STATIC:
Nov 08 23:28:04 user nova-compute[75045]: Target: iqn.2010-10.org.openstack:a42d9799-d775-4120-8af0-bc81a6278ea7
Nov 08 23:28:04 user nova-compute[75045]:         Portal: 172.16.0.220:3260,-1
Nov 08 23:28:04 user nova-compute[75045]:                 Iface Name: default
Nov 08 23:28:04 user nova-compute[75045]: Target: iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab
Nov 08 23:28:04 user nova-compute[75045]:         Portal: 172.16.0.220:3260,-1
Nov 08 23:28:04 user nova-compute[75045]:                 Iface Name: default
Nov 08 23:28:04 user nova-compute[75045]: Target: iqn.2010-10.org.openstack:04d02c98-d058-49d8-a350-ab9e63003d6e
Nov 08 23:28:04 user nova-compute[75045]:         Portal: 172.16.0.220:3260,-1
Nov 08 23:28:04 user nova-compute[75045]:                 Iface Name: default
Nov 08 23:28:04 user nova-compute[75045]: Target: iqn.2010-10.org.openstack:9c37da13-9531-458a-87cb-1e86e6b84f3a
Nov 08 23:28:04 user nova-compute[75045]:         Portal: 172.16.0.220:3260,-1
Nov 08 23:28:04 user nova-compute[75045]:                 Iface Name: default
Nov 08 23:28:04 user nova-compute[75045]: FIRMWARE:
Nov 08 23:28:04 user nova-compute[75045]: No targets found.
Nov 08 23:28:04 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 23:28:04 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-b99fe833-6bbd-4aa7-a030-e5c98392cb65 tempest-TestStampPattern-2120781434 tempest-TestStampPattern-2120781434-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 23:28:04 user nova-compute[75045]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 23:28:04 user nova-compute[75045]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75045) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 23:28:04 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-b99fe833-6bbd-4aa7-a030-e5c98392cb65 tempest-TestStampPattern-2120781434 tempest-TestStampPattern-2120781434-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a42d9799-d775-4120-8af0-bc81a6278ea7', 0)] {{(pid=75045) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 23:28:04 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:28:04 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:28:04 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[52e26802-1de4-44b5-9d2a-c516c3af9433]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:04d02c98-d058-49d8-a350-ab9e63003d6e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9c37da13-9531-458a-87cb-1e86e6b84f3a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a42d9799-d775-4120-8af0-bc81a6278ea7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:28:04 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:28:04 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:28:04 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[31b854e3-3db3-46b6-a818-d6f0d85651fe]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c37da13-9531-458a-87cb-1e86e6b84f3a (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04d02c98-d058-49d8-a350-ab9e63003d6e (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a42d9799-d775-4120-8af0-bc81a6278ea7 (non-flash)\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:28:04 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-b99fe833-6bbd-4aa7-a030-e5c98392cb65 tempest-TestStampPattern-2120781434 tempest-TestStampPattern-2120781434-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab (non-flash)
Nov 08 23:28:04 user nova-compute[75045]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c37da13-9531-458a-87cb-1e86e6b84f3a (non-flash)
Nov 08 23:28:04 user nova-compute[75045]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04d02c98-d058-49d8-a350-ab9e63003d6e (non-flash)
Nov 08 23:28:04 user nova-compute[75045]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a42d9799-d775-4120-8af0-bc81a6278ea7 (non-flash)
Nov 08 23:28:04 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 23:28:04 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-b99fe833-6bbd-4aa7-a030-e5c98392cb65 tempest-TestStampPattern-2120781434 tempest-TestStampPattern-2120781434-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab (non-flash)
Nov 08 23:28:04 user nova-compute[75045]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c37da13-9531-458a-87cb-1e86e6b84f3a (non-flash)
Nov 08 23:28:04 user nova-compute[75045]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04d02c98-d058-49d8-a350-ab9e63003d6e (non-flash)
Nov 08 23:28:04 user nova-compute[75045]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a42d9799-d775-4120-8af0-bc81a6278ea7 (non-flash)
Nov 08 23:28:04 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 23:28:04 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-b99fe833-6bbd-4aa7-a030-e5c98392cb65 tempest-TestStampPattern-2120781434 tempest-TestStampPattern-2120781434-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1b48238160>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a42d9799-d775-4120-8af0-bc81a6278ea7'): ({'sdf'}, set())}) {{(pid=75045) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 23:28:04 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-b99fe833-6bbd-4aa7-a030-e5c98392cb65 tempest-TestStampPattern-2120781434 tempest-TestStampPattern-2120781434-project-member] Removing single pathed devices sdf {{(pid=75045) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 23:28:04 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:28:04 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:28:04 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d125f19-17b3-4fab-8eac-ef3f8a612e8e]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:28:04 user nova-compute[75045]: DEBUG nova.network.neutron [req-93516c57-3a9c-4b87-81f4-bca636754062 req-3f46341a-e59a-4552-893b-eb4bde458fba service nova] [instance: 04169f59-e9a6-4b50-9ad7-7f8c105a376a] Updated VIF entry in instance network info cache for port 96af9673-bb3c-4173-8439-0be6d2b922cf. {{(pid=75045) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 23:28:04 user nova-compute[75045]: DEBUG nova.network.neutron [req-93516c57-3a9c-4b87-81f4-bca636754062 req-3f46341a-e59a-4552-893b-eb4bde458fba service nova] [instance: 04169f59-e9a6-4b50-9ad7-7f8c105a376a] Updating instance_info_cache with network_info: [{"id": "96af9673-bb3c-4173-8439-0be6d2b922cf", "address": "fa:16:3e:a5:6d:8b", "network": {"id": "700b5784-d35b-45c0-a4d3-1ab8aa4c48aa", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-194469807-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e63623113f11463d9035bb990de43510", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96af9673-bb", "ovs_interfaceid": "96af9673-bb3c-4173-8439-0be6d2b922cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75045) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 23:28:04 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:28:04 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-93516c57-3a9c-4b87-81f4-bca636754062 req-3f46341a-e59a-4552-893b-eb4bde458fba service nova] Releasing lock "refresh_cache-04169f59-e9a6-4b50-9ad7-7f8c105a376a" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 23:28:04 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.025s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:28:04 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[92179473-3e92-4733-867f-913fb36f96b7]: (4, ('ok\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:28:04 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-b99fe833-6bbd-4aa7-a030-e5c98392cb65 tempest-TestStampPattern-2120781434 tempest-TestStampPattern-2120781434-project-member] Flushing IO for device /dev/sdf {{(pid=75045) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 23:28:04 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:28:04 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.013s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:28:04 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c7fd523-b65e-4c70-9584-a73245cf1438]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:28:04 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-b99fe833-6bbd-4aa7-a030-e5c98392cb65 tempest-TestStampPattern-2120781434 tempest-TestStampPattern-2120781434-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=75045) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 23:28:04 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:28:04 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.034s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:28:04 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[644621e9-af07-44dc-ac85-4c2734da2091]: (4, ('1', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:28:04 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-b99fe833-6bbd-4aa7-a030-e5c98392cb65 tempest-TestStampPattern-2120781434 tempest-TestStampPattern-2120781434-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=75045) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 23:28:04 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-b99fe833-6bbd-4aa7-a030-e5c98392cb65 tempest-TestStampPattern-2120781434 tempest-TestStampPattern-2120781434-project-member] SCSI volumes sdf have been removed. {{(pid=75045) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 23:28:04 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-b99fe833-6bbd-4aa7-a030-e5c98392cb65 tempest-TestStampPattern-2120781434 tempest-TestStampPattern-2120781434-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a42d9799-d775-4120-8af0-bc81a6278ea7')] {{(pid=75045) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 23:28:04 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a42d9799-d775-4120-8af0-bc81a6278ea7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:28:04 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a42d9799-d775-4120-8af0-bc81a6278ea7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:28:04 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ca37964-1c47-401c-9c9b-e0a9064db475]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:28:04 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-b99fe833-6bbd-4aa7-a030-e5c98392cb65 tempest-TestStampPattern-2120781434 tempest-TestStampPattern-2120781434-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:28:04 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a42d9799-d775-4120-8af0-bc81a6278ea7 -p 172.16.0.220:3260 --logout {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:28:04 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a42d9799-d775-4120-8af0-bc81a6278ea7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:28:04 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[3886534e-de85-49a1-b435-c6127490f824]: (4, ('Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:a42d9799-d775-4120-8af0-bc81a6278ea7, portal: 172.16.0.220,3260]\nLogout of [sid: 26, target: iqn.2010-10.org.openstack:a42d9799-d775-4120-8af0-bc81a6278ea7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:28:04 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-b99fe833-6bbd-4aa7-a030-e5c98392cb65 tempest-TestStampPattern-2120781434 tempest-TestStampPattern-2120781434-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:a42d9799-d775-4120-8af0-bc81a6278ea7, portal: 172.16.0.220,3260]
Nov 08 23:28:04 user nova-compute[75045]: Logout of [sid: 26, target: iqn.2010-10.org.openstack:a42d9799-d775-4120-8af0-bc81a6278ea7, portal: 172.16.0.220,3260] successful.
Nov 08 23:28:04 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:28:04 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a42d9799-d775-4120-8af0-bc81a6278ea7 -p 172.16.0.220:3260 --op delete {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:28:04 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a42d9799-d775-4120-8af0-bc81a6278ea7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:28:04 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bdfcbd9-af7a-4f89-8c2b-d57c73b5b250]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:28:04 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-b99fe833-6bbd-4aa7-a030-e5c98392cb65 tempest-TestStampPattern-2120781434 tempest-TestStampPattern-2120781434-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:28:04 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-b99fe833-6bbd-4aa7-a030-e5c98392cb65 tempest-TestStampPattern-2120781434 tempest-TestStampPattern-2120781434-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.309s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 23:28:04 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-b99fe833-6bbd-4aa7-a030-e5c98392cb65 tempest-TestStampPattern-2120781434 tempest-TestStampPattern-2120781434-project-member] <== disconnect_volume: return (310ms) None {{(pid=75045) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 23:28:04 user nova-compute[75045]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b99fe833-6bbd-4aa7-a030-e5c98392cb65 tempest-TestStampPattern-2120781434 tempest-TestStampPattern-2120781434-project-member] [instance: 72c9d731-2b35-434c-8463-1cd6c18fbd6a] Disconnected iSCSI Volume {{(pid=75045) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 23:28:06 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:28:09 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:28:11 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:28:14 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-e9261792-a27e-4cfb-a8c1-98c3381324a0 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Acquiring lock "1a3c21c4-2db3-44e1-8a23-336ca9f8374d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:28:14 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-e9261792-a27e-4cfb-a8c1-98c3381324a0 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Lock "1a3c21c4-2db3-44e1-8a23-336ca9f8374d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:28:14 user nova-compute[75045]: DEBUG nova.compute.manager [None req-e9261792-a27e-4cfb-a8c1-98c3381324a0 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] [instance: 1a3c21c4-2db3-44e1-8a23-336ca9f8374d] Starting instance... {{(pid=75045) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 23:28:14 user nova-compute[75045]: DEBUG nova.objects.instance [None req-dd229295-ac54-4ee5-9d41-f9d012d9611b tempest-VolumesAdminNegativeTest-215528111 tempest-VolumesAdminNegativeTest-215528111-project-member] Lazy-loading 'flavor' on Instance uuid 7e92ab9a-8ea4-4452-a458-db181d4a59b7 {{(pid=75045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 23:28:14 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-e9261792-a27e-4cfb-a8c1-98c3381324a0 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:28:14 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-e9261792-a27e-4cfb-a8c1-98c3381324a0 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:28:14 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-dd229295-ac54-4ee5-9d41-f9d012d9611b tempest-VolumesAdminNegativeTest-215528111 tempest-VolumesAdminNegativeTest-215528111-project-member] Lock "7e92ab9a-8ea4-4452-a458-db181d4a59b7" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 39.306s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:28:14 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-e9261792-a27e-4cfb-a8c1-98c3381324a0 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75045) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 23:28:14 user nova-compute[75045]: INFO nova.compute.claims [None req-e9261792-a27e-4cfb-a8c1-98c3381324a0 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] [instance: 1a3c21c4-2db3-44e1-8a23-336ca9f8374d] Claim successful on node user
Nov 08 23:28:14 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:28:14 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-31751176-347d-42ce-b2e6-ed798b738377 tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] [instance: 83d225e0-e39e-4500-b7ae-52dfbd8b8588] Starting finish_revert_migration {{(pid=75045) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11819}}
Nov 08 23:28:14 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-31751176-347d-42ce-b2e6-ed798b738377 tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] [instance: 83d225e0-e39e-4500-b7ae-52dfbd8b8588] Start _get_guest_xml network_info=[{"id": "f34eef67-0428-49ea-91c3-08510ac690c8", "address": "fa:16:3e:d9:92:a4", "network": {"id": "d177c8b8-5960-4e40-bf9b-920a2f6ba4f7", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-497258569-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.31", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "467f0ecc3b93457f9fe83886b99c6285", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf34eef67-04", "ovs_interfaceid": "f34eef67-0428-49ea-91c3-08510ac690c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'disk_bus': 'virtio', 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': 'a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb'}], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'device_type': 'disk', 'attachment_id': '9320a7b1-69d7-4f3f-8cf6-0430a4904f84', 'guest_format': None, 'disk_bus': 'virtio', 'boot_index': None, 'mount_device': '/dev/vdb', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:d2e734fa-1dcb-4510-a50e-064e29c2985e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qCUrDkTz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '83d225e0-e39e-4500-b7ae-52dfbd8b8588', 'attached_at': '2023-11-08T23:28:14.000000', 'detached_at': '', 'volume_id': 'd2e734fa-1dcb-4510-a50e-064e29c2985e', 'serial': 'd2e734fa-1dcb-4510-a50e-064e29c2985e'}, 'volume_type': None} {{(pid=75045) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 23:28:14 user nova-compute[75045]: WARNING nova.virt.libvirt.driver [None req-31751176-347d-42ce-b2e6-ed798b738377 tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 23:28:14 user nova-compute[75045]: WARNING nova.virt.libvirt.driver [None req-31751176-347d-42ce-b2e6-ed798b738377 tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 23:28:14 user nova-compute[75045]: DEBUG nova.virt.libvirt.host [None req-31751176-347d-42ce-b2e6-ed798b738377 tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75045) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 23:28:14 user nova-compute[75045]: DEBUG nova.virt.libvirt.host [None req-31751176-347d-42ce-b2e6-ed798b738377 tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] CPU controller missing on host. {{(pid=75045) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 23:28:14 user nova-compute[75045]: DEBUG nova.virt.libvirt.host [None req-31751176-347d-42ce-b2e6-ed798b738377 tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75045) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 23:28:14 user nova-compute[75045]: DEBUG nova.virt.libvirt.host [None req-31751176-347d-42ce-b2e6-ed798b738377 tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] CPU controller found on host. {{(pid=75045) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 23:28:14 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-31751176-347d-42ce-b2e6-ed798b738377 tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75045) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 23:28:14 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-31751176-347d-42ce-b2e6-ed798b738377 tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T23:11:41Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75045) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 23:28:14 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-31751176-347d-42ce-b2e6-ed798b738377 tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] Flavor limits 0:0:0 {{(pid=75045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 23:28:14 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-31751176-347d-42ce-b2e6-ed798b738377 tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] Image limits 0:0:0 {{(pid=75045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 23:28:14 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-31751176-347d-42ce-b2e6-ed798b738377 tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] Flavor pref 0:0:0 {{(pid=75045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 23:28:14 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-31751176-347d-42ce-b2e6-ed798b738377 tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] Image pref 0:0:0 {{(pid=75045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 23:28:14 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-31751176-347d-42ce-b2e6-ed798b738377 tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 23:28:14 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-31751176-347d-42ce-b2e6-ed798b738377 tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75045) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 23:28:14 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-31751176-347d-42ce-b2e6-ed798b738377 tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75045) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 23:28:14 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-31751176-347d-42ce-b2e6-ed798b738377 tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] Got 1 possible topologies {{(pid=75045) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 23:28:14 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-31751176-347d-42ce-b2e6-ed798b738377 tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75045) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 23:28:14 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-31751176-347d-42ce-b2e6-ed798b738377 tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75045) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 23:28:14 user nova-compute[75045]: DEBUG nova.objects.instance [None req-31751176-347d-42ce-b2e6-ed798b738377 tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] Lazy-loading 'vcpu_model' on Instance uuid 83d225e0-e39e-4500-b7ae-52dfbd8b8588 {{(pid=75045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 23:28:14 user nova-compute[75045]: DEBUG nova.virt.libvirt.volume.iscsi [None req-31751176-347d-42ce-b2e6-ed798b738377 tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] [instance: 83d225e0-e39e-4500-b7ae-52dfbd8b8588] Calling os-brick to attach iSCSI Volume {{(pid=75045) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 23:28:14 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-31751176-347d-42ce-b2e6-ed798b738377 tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1b68210460>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d2e734fa-1dcb-4510-a50e-064e29c2985e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qCUrDkTz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75045) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 23:28:14 user nova-compute[75045]: WARNING os_brick.initiator.connectors.base [None req-31751176-347d-42ce-b2e6-ed798b738377 tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 23:28:14 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-31751176-347d-42ce-b2e6-ed798b738377 tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 23:28:14 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-31751176-347d-42ce-b2e6-ed798b738377 tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 23:28:14 user nova-compute[75045]: WARNING os_brick.initiator.connectors.base [None req-31751176-347d-42ce-b2e6-ed798b738377 tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 23:28:14 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-31751176-347d-42ce-b2e6-ed798b738377 tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d2e734fa-1dcb-4510-a50e-064e29c2985e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 23:28:14 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-31751176-347d-42ce-b2e6-ed798b738377 tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d2e734fa-1dcb-4510-a50e-064e29c2985e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 23:28:14 user nova-compute[75045]: INFO os_brick.initiator.connectors.iscsi [None req-31751176-347d-42ce-b2e6-ed798b738377 tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 23:28:14 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2e734fa-1dcb-4510-a50e-064e29c2985e -p 172.16.0.220:3260 {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:28:14 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2e734fa-1dcb-4510-a50e-064e29c2985e -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:28:14 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[f110949b-73ec-48d3-a8f9-82c3408e1d90]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:28:14 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-31751176-347d-42ce-b2e6-ed798b738377 tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 23:28:14 user nova-compute[75045]:  {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:28:14 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2e734fa-1dcb-4510-a50e-064e29c2985e -p 172.16.0.220:3260 --interface default --op new {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:28:14 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2e734fa-1dcb-4510-a50e-064e29c2985e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:28:14 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[73298de9-d5b9-4074-a066-3720c553aa72]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d2e734fa-1dcb-4510-a50e-064e29c2985e] added\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:28:14 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-31751176-347d-42ce-b2e6-ed798b738377 tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d2e734fa-1dcb-4510-a50e-064e29c2985e] added
Nov 08 23:28:14 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:28:14 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2e734fa-1dcb-4510-a50e-064e29c2985e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:28:14 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2e734fa-1dcb-4510-a50e-064e29c2985e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:28:14 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b1a2331-6cef-431c-8376-770704dd9650]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:28:14 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-31751176-347d-42ce-b2e6-ed798b738377 tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:28:14 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2e734fa-1dcb-4510-a50e-064e29c2985e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:28:14 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2e734fa-1dcb-4510-a50e-064e29c2985e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:28:14 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc431a0f-8ac7-46a4-a14a-75dd1507e5f3]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:28:14 user nova-compute[75045]: DEBUG nova.compute.provider_tree [None req-e9261792-a27e-4cfb-a8c1-98c3381324a0 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Inventory has not changed in ProviderTree for provider: 62ba5f85-c74d-4b58-986e-d4197e813fd7 {{(pid=75045) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 23:28:14 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-31751176-347d-42ce-b2e6-ed798b738377 tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:28:14 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2e734fa-1dcb-4510-a50e-064e29c2985e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qCUrDkTz {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:28:14 user nova-compute[75045]: DEBUG nova.scheduler.client.report [None req-e9261792-a27e-4cfb-a8c1-98c3381324a0 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Inventory has not changed for provider 62ba5f85-c74d-4b58-986e-d4197e813fd7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75045) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 23:28:14 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2e734fa-1dcb-4510-a50e-064e29c2985e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qCUrDkTz" returned: 0 in 0.020s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:28:14 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fea5be9-c999-46a7-91ec-58aec136ba32]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:28:14 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-31751176-347d-42ce-b2e6-ed798b738377 tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'qCUrDkTz'): stdout= stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:28:14 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2e734fa-1dcb-4510-a50e-064e29c2985e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:28:14 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-e9261792-a27e-4cfb-a8c1-98c3381324a0 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.562s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:28:14 user nova-compute[75045]: DEBUG nova.compute.manager [None req-e9261792-a27e-4cfb-a8c1-98c3381324a0 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] [instance: 1a3c21c4-2db3-44e1-8a23-336ca9f8374d] Start building networks asynchronously for instance. {{(pid=75045) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 23:28:14 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2e734fa-1dcb-4510-a50e-064e29c2985e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:28:14 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8fd2be5-56aa-4277-b18a-306abe18039a]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:28:14 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-31751176-347d-42ce-b2e6-ed798b738377 tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:28:14 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:28:14 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-80d06f34-1d7e-42da-8cd4-bda5cb20127b tempest-TestServerVolumeAttachmentScenario-1899063447 tempest-TestServerVolumeAttachmentScenario-1899063447-project-member] Acquiring lock "25cd59d1-6884-471a-813e-52e97c2e1208" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:28:14 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-80d06f34-1d7e-42da-8cd4-bda5cb20127b tempest-TestServerVolumeAttachmentScenario-1899063447 tempest-TestServerVolumeAttachmentScenario-1899063447-project-member] Lock "25cd59d1-6884-471a-813e-52e97c2e1208" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:28:14 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:28:14 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[20d0d987-7b83-457c-baa7-27eee0df7dc7]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c37da13-9531-458a-87cb-1e86e6b84f3a (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04d02c98-d058-49d8-a350-ab9e63003d6e (non-flash)\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:28:14 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-31751176-347d-42ce-b2e6-ed798b738377 tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab (non-flash)
Nov 08 23:28:14 user nova-compute[75045]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c37da13-9531-458a-87cb-1e86e6b84f3a (non-flash)
Nov 08 23:28:14 user nova-compute[75045]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04d02c98-d058-49d8-a350-ab9e63003d6e (non-flash)
Nov 08 23:28:14 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 23:28:14 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-31751176-347d-42ce-b2e6-ed798b738377 tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab (non-flash)
Nov 08 23:28:14 user nova-compute[75045]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c37da13-9531-458a-87cb-1e86e6b84f3a (non-flash)
Nov 08 23:28:14 user nova-compute[75045]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04d02c98-d058-49d8-a350-ab9e63003d6e (non-flash)
Nov 08 23:28:14 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 23:28:14 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2e734fa-1dcb-4510-a50e-064e29c2985e -p 172.16.0.220:3260 --login {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:28:14 user nova-compute[75045]: INFO nova.compute.manager [None req-80d06f34-1d7e-42da-8cd4-bda5cb20127b tempest-TestServerVolumeAttachmentScenario-1899063447 tempest-TestServerVolumeAttachmentScenario-1899063447-project-member] [instance: 25cd59d1-6884-471a-813e-52e97c2e1208] Detaching volume 9c37da13-9531-458a-87cb-1e86e6b84f3a
Nov 08 23:28:14 user nova-compute[75045]: DEBUG nova.compute.manager [None req-e9261792-a27e-4cfb-a8c1-98c3381324a0 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] [instance: 1a3c21c4-2db3-44e1-8a23-336ca9f8374d] Allocating IP information in the background. {{(pid=75045) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 23:28:14 user nova-compute[75045]: DEBUG nova.network.neutron [None req-e9261792-a27e-4cfb-a8c1-98c3381324a0 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] [instance: 1a3c21c4-2db3-44e1-8a23-336ca9f8374d] allocate_for_instance() {{(pid=75045) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 23:28:14 user nova-compute[75045]: INFO nova.virt.libvirt.driver [None req-e9261792-a27e-4cfb-a8c1-98c3381324a0 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] [instance: 1a3c21c4-2db3-44e1-8a23-336ca9f8374d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 23:28:14 user nova-compute[75045]: INFO nova.virt.block_device [None req-80d06f34-1d7e-42da-8cd4-bda5cb20127b tempest-TestServerVolumeAttachmentScenario-1899063447 tempest-TestServerVolumeAttachmentScenario-1899063447-project-member] [instance: 25cd59d1-6884-471a-813e-52e97c2e1208] Attempting to driver detach volume 9c37da13-9531-458a-87cb-1e86e6b84f3a from mountpoint /dev/vdb
Nov 08 23:28:14 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2e734fa-1dcb-4510-a50e-064e29c2985e -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:28:14 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[67f232cc-e26c-40fb-8c12-289d0cb4c1df]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d2e734fa-1dcb-4510-a50e-064e29c2985e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d2e734fa-1dcb-4510-a50e-064e29c2985e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:28:14 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-31751176-347d-42ce-b2e6-ed798b738377 tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d2e734fa-1dcb-4510-a50e-064e29c2985e, portal: 172.16.0.220,3260]
Nov 08 23:28:14 user nova-compute[75045]: Login to [iface: default, target: iqn.2010-10.org.openstack:d2e734fa-1dcb-4510-a50e-064e29c2985e, portal: 172.16.0.220,3260] successful.
Nov 08 23:28:14 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:28:14 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2e734fa-1dcb-4510-a50e-064e29c2985e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:28:14 user nova-compute[75045]: DEBUG nova.compute.manager [None req-e9261792-a27e-4cfb-a8c1-98c3381324a0 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] [instance: 1a3c21c4-2db3-44e1-8a23-336ca9f8374d] Start building block device mappings for instance. {{(pid=75045) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 23:28:14 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-80d06f34-1d7e-42da-8cd4-bda5cb20127b tempest-TestServerVolumeAttachmentScenario-1899063447 tempest-TestServerVolumeAttachmentScenario-1899063447-project-member] Attempting to detach device vdb from instance 25cd59d1-6884-471a-813e-52e97c2e1208 from the persistent domain config. {{(pid=75045) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 08 23:28:14 user nova-compute[75045]: DEBUG nova.virt.libvirt.guest [None req-80d06f34-1d7e-42da-8cd4-bda5cb20127b tempest-TestServerVolumeAttachmentScenario-1899063447 tempest-TestServerVolumeAttachmentScenario-1899063447-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 23:28:14 user nova-compute[75045]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 23:28:14 user nova-compute[75045]:   <source dev="/dev/sde"/>
Nov 08 23:28:14 user nova-compute[75045]:   <target dev="vdb" bus="virtio"/>
Nov 08 23:28:14 user nova-compute[75045]:   <serial>9c37da13-9531-458a-87cb-1e86e6b84f3a</serial>
Nov 08 23:28:14 user nova-compute[75045]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 08 23:28:14 user nova-compute[75045]: </disk>
Nov 08 23:28:14 user nova-compute[75045]:  {{(pid=75045) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 23:28:14 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2e734fa-1dcb-4510-a50e-064e29c2985e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:28:14 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8bd31be-e02f-47d3-9817-2764b467534c]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:28:14 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-31751176-347d-42ce-b2e6-ed798b738377 tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:28:14 user nova-compute[75045]: INFO nova.virt.libvirt.driver [None req-80d06f34-1d7e-42da-8cd4-bda5cb20127b tempest-TestServerVolumeAttachmentScenario-1899063447 tempest-TestServerVolumeAttachmentScenario-1899063447-project-member] Successfully detached device vdb from instance 25cd59d1-6884-471a-813e-52e97c2e1208 from the persistent domain config.
Nov 08 23:28:14 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-80d06f34-1d7e-42da-8cd4-bda5cb20127b tempest-TestServerVolumeAttachmentScenario-1899063447 tempest-TestServerVolumeAttachmentScenario-1899063447-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 25cd59d1-6884-471a-813e-52e97c2e1208 from the live domain config. {{(pid=75045) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 08 23:28:14 user nova-compute[75045]: DEBUG nova.virt.libvirt.guest [None req-80d06f34-1d7e-42da-8cd4-bda5cb20127b tempest-TestServerVolumeAttachmentScenario-1899063447 tempest-TestServerVolumeAttachmentScenario-1899063447-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 23:28:14 user nova-compute[75045]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 23:28:14 user nova-compute[75045]:   <source dev="/dev/sde"/>
Nov 08 23:28:14 user nova-compute[75045]:   <target dev="vdb" bus="virtio"/>
Nov 08 23:28:14 user nova-compute[75045]:   <serial>9c37da13-9531-458a-87cb-1e86e6b84f3a</serial>
Nov 08 23:28:14 user nova-compute[75045]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 08 23:28:14 user nova-compute[75045]: </disk>
Nov 08 23:28:14 user nova-compute[75045]:  {{(pid=75045) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 23:28:14 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:28:15 user nova-compute[75045]: DEBUG nova.policy [None req-e9261792-a27e-4cfb-a8c1-98c3381324a0 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4a05b178abe74b779a991e887bf135b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eff4be777d24514be52868961bf7a25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75045) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 23:28:15 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:28:15 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[67cbd783-2521-409f-9824-54e7382e67bb]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c37da13-9531-458a-87cb-1e86e6b84f3a (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04d02c98-d058-49d8-a350-ab9e63003d6e (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2e734fa-1dcb-4510-a50e-064e29c2985e (non-flash)\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:28:15 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-31751176-347d-42ce-b2e6-ed798b738377 tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab (non-flash)
Nov 08 23:28:15 user nova-compute[75045]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c37da13-9531-458a-87cb-1e86e6b84f3a (non-flash)
Nov 08 23:28:15 user nova-compute[75045]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04d02c98-d058-49d8-a350-ab9e63003d6e (non-flash)
Nov 08 23:28:15 user nova-compute[75045]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2e734fa-1dcb-4510-a50e-064e29c2985e (non-flash)
Nov 08 23:28:15 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 23:28:15 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-31751176-347d-42ce-b2e6-ed798b738377 tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab (non-flash)
Nov 08 23:28:15 user nova-compute[75045]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c37da13-9531-458a-87cb-1e86e6b84f3a (non-flash)
Nov 08 23:28:15 user nova-compute[75045]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04d02c98-d058-49d8-a350-ab9e63003d6e (non-flash)
Nov 08 23:28:15 user nova-compute[75045]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2e734fa-1dcb-4510-a50e-064e29c2985e (non-flash)
Nov 08 23:28:15 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 23:28:15 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-31751176-347d-42ce-b2e6-ed798b738377 tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d2e734fa-1dcb-4510-a50e-064e29c2985e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.334s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 23:28:15 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-31751176-347d-42ce-b2e6-ed798b738377 tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] Connected to 172.16.0.220:3260 {{(pid=75045) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 23:28:15 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-31751176-347d-42ce-b2e6-ed798b738377 tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] HCTL ('34', '-', '-', 0) found on session 27 with lun 0 {{(pid=75045) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 23:28:15 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-31751176-347d-42ce-b2e6-ed798b738377 tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75045) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 23:28:15 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:28:15 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.023s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:28:15 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[057c72e6-d189-4093-a43b-e5ef050a35ce]: (4, ('- - 0', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:28:15 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-31751176-347d-42ce-b2e6-ed798b738377 tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] Searching for a device in session 27 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75045) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 23:28:15 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-31751176-347d-42ce-b2e6-ed798b738377 tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:d2e734fa-1dcb-4510-a50e-064e29c2985e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qCUrDkTz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75045) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 23:28:15 user nova-compute[75045]: DEBUG nova.compute.manager [None req-e9261792-a27e-4cfb-a8c1-98c3381324a0 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] [instance: 1a3c21c4-2db3-44e1-8a23-336ca9f8374d] Start spawning the instance on the hypervisor. {{(pid=75045) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 23:28:15 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-e9261792-a27e-4cfb-a8c1-98c3381324a0 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] [instance: 1a3c21c4-2db3-44e1-8a23-336ca9f8374d] Creating instance directory {{(pid=75045) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 23:28:15 user nova-compute[75045]: INFO nova.virt.libvirt.driver [None req-e9261792-a27e-4cfb-a8c1-98c3381324a0 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] [instance: 1a3c21c4-2db3-44e1-8a23-336ca9f8374d] Creating image(s)
Nov 08 23:28:15 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-e9261792-a27e-4cfb-a8c1-98c3381324a0 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Acquiring lock "/opt/stack/data/nova/instances/1a3c21c4-2db3-44e1-8a23-336ca9f8374d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:28:15 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-e9261792-a27e-4cfb-a8c1-98c3381324a0 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Lock "/opt/stack/data/nova/instances/1a3c21c4-2db3-44e1-8a23-336ca9f8374d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:28:15 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-e9261792-a27e-4cfb-a8c1-98c3381324a0 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Lock "/opt/stack/data/nova/instances/1a3c21c4-2db3-44e1-8a23-336ca9f8374d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:28:15 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-e9261792-a27e-4cfb-a8c1-98c3381324a0 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b59f52a99fff51c56dd1edfb83892fb8f647f2f3 --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:28:15 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-e9261792-a27e-4cfb-a8c1-98c3381324a0 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b59f52a99fff51c56dd1edfb83892fb8f647f2f3 --force-share --output=json" returned: 0 in 0.207s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:28:15 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-e9261792-a27e-4cfb-a8c1-98c3381324a0 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Acquiring lock "b59f52a99fff51c56dd1edfb83892fb8f647f2f3" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:28:15 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-e9261792-a27e-4cfb-a8c1-98c3381324a0 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Lock "b59f52a99fff51c56dd1edfb83892fb8f647f2f3" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:28:15 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-e9261792-a27e-4cfb-a8c1-98c3381324a0 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b59f52a99fff51c56dd1edfb83892fb8f647f2f3 --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:28:15 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-80d06f34-1d7e-42da-8cd4-bda5cb20127b tempest-TestServerVolumeAttachmentScenario-1899063447 tempest-TestServerVolumeAttachmentScenario-1899063447-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 25cd59d1-6884-471a-813e-52e97c2e1208 {{(pid=75045) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 08 23:28:15 user nova-compute[75045]: DEBUG nova.objects.instance [None req-b99fe833-6bbd-4aa7-a030-e5c98392cb65 tempest-TestStampPattern-2120781434 tempest-TestStampPattern-2120781434-project-member] Lazy-loading 'flavor' on Instance uuid 72c9d731-2b35-434c-8463-1cd6c18fbd6a {{(pid=75045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 23:28:15 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-b99fe833-6bbd-4aa7-a030-e5c98392cb65 tempest-TestStampPattern-2120781434 tempest-TestStampPattern-2120781434-project-member] Lock "72c9d731-2b35-434c-8463-1cd6c18fbd6a" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 31.682s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:28:15 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-e9261792-a27e-4cfb-a8c1-98c3381324a0 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b59f52a99fff51c56dd1edfb83892fb8f647f2f3 --force-share --output=json" returned: 0 in 0.186s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:28:15 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-e9261792-a27e-4cfb-a8c1-98c3381324a0 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b59f52a99fff51c56dd1edfb83892fb8f647f2f3,backing_fmt=raw /opt/stack/data/nova/instances/1a3c21c4-2db3-44e1-8a23-336ca9f8374d/disk 1073741824 {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:28:15 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-e9261792-a27e-4cfb-a8c1-98c3381324a0 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b59f52a99fff51c56dd1edfb83892fb8f647f2f3,backing_fmt=raw /opt/stack/data/nova/instances/1a3c21c4-2db3-44e1-8a23-336ca9f8374d/disk 1073741824" returned: 0 in 0.055s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:28:15 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-e9261792-a27e-4cfb-a8c1-98c3381324a0 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Lock "b59f52a99fff51c56dd1edfb83892fb8f647f2f3" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.246s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:28:15 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-e9261792-a27e-4cfb-a8c1-98c3381324a0 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b59f52a99fff51c56dd1edfb83892fb8f647f2f3 --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:28:15 user nova-compute[75045]: DEBUG nova.network.neutron [None req-e9261792-a27e-4cfb-a8c1-98c3381324a0 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] [instance: 1a3c21c4-2db3-44e1-8a23-336ca9f8374d] Successfully created port: f3fb74c0-e5f6-4a65-8d50-b33da34c4fcb {{(pid=75045) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 23:28:15 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-e9261792-a27e-4cfb-a8c1-98c3381324a0 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b59f52a99fff51c56dd1edfb83892fb8f647f2f3 --force-share --output=json" returned: 0 in 0.216s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:28:15 user nova-compute[75045]: DEBUG nova.virt.disk.api [None req-e9261792-a27e-4cfb-a8c1-98c3381324a0 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1a3c21c4-2db3-44e1-8a23-336ca9f8374d/disk. size=1073741824 {{(pid=75045) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 23:28:15 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-e9261792-a27e-4cfb-a8c1-98c3381324a0 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a3c21c4-2db3-44e1-8a23-336ca9f8374d/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:28:16 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-e9261792-a27e-4cfb-a8c1-98c3381324a0 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a3c21c4-2db3-44e1-8a23-336ca9f8374d/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:28:16 user nova-compute[75045]: DEBUG nova.virt.disk.api [None req-e9261792-a27e-4cfb-a8c1-98c3381324a0 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Cannot resize image /opt/stack/data/nova/instances/1a3c21c4-2db3-44e1-8a23-336ca9f8374d/disk to a smaller size. {{(pid=75045) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 08 23:28:16 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-e9261792-a27e-4cfb-a8c1-98c3381324a0 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] [instance: 1a3c21c4-2db3-44e1-8a23-336ca9f8374d] Created local disks {{(pid=75045) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 23:28:16 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-e9261792-a27e-4cfb-a8c1-98c3381324a0 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] [instance: 1a3c21c4-2db3-44e1-8a23-336ca9f8374d] Ensure instance console log exists: /opt/stack/data/nova/instances/1a3c21c4-2db3-44e1-8a23-336ca9f8374d/console.log {{(pid=75045) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 23:28:16 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-e9261792-a27e-4cfb-a8c1-98c3381324a0 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:28:16 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-e9261792-a27e-4cfb-a8c1-98c3381324a0 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:28:16 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-e9261792-a27e-4cfb-a8c1-98c3381324a0 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:28:16 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-31751176-347d-42ce-b2e6-ed798b738377 tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.376s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 23:28:16 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-31751176-347d-42ce-b2e6-ed798b738377 tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] <== connect_volume: return (1378ms) {'type': 'block', 'scsi_wwn': '23230663034306433', 'path': '/dev/sdc'} {{(pid=75045) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 23:28:16 user nova-compute[75045]: DEBUG nova.virt.libvirt.volume.iscsi [None req-31751176-347d-42ce-b2e6-ed798b738377 tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] [instance: 83d225e0-e39e-4500-b7ae-52dfbd8b8588] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23230663034306433', 'path': '/dev/sdc'} {{(pid=75045) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 23:28:16 user nova-compute[75045]: DEBUG nova.virt.libvirt.vif [None req-31751176-347d-42ce-b2e6-ed798b738377 tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T23:21:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-52454361',display_name='tempest-ServerActionsTestOtherB-server-52454361',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-52454361',id=16,image_ref='a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIPmBc8a5DafKsuCJlskOYpDDhPwBioEg4bK8XJOdFwOvE3kerS9/OlDrIi5hKJ4t8vHYgazIqYE6C9fG+r7udy2il9kXgn4I4yPKUfyTlGPaqAfUG4gtg1sBgzfEDpsow==',key_name='tempest-keypair-1494902868',keypairs=<?>,launch_index=0,launched_at=2023-11-08T23:26:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='467f0ecc3b93457f9fe83886b99c6285',ramdisk_id='',reservation_id='r-mtlunwmw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-299728934',owner_user_name='tempest-ServerActionsTestOtherB-299728934-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T23:27:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='57d0c13f5a9f4c1bbb0458b93de348cb',uuid=83d225e0-e39e-4500-b7ae-52dfbd8b8588,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "f34eef67-0428-49ea-91c3-08510ac690c8", "address": "fa:16:3e:d9:92:a4", "network": {"id": "d177c8b8-5960-4e40-bf9b-920a2f6ba4f7", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-497258569-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.31", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "467f0ecc3b93457f9fe83886b99c6285", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf34eef67-04", "ovs_interfaceid": "f34eef67-0428-49ea-91c3-08510ac690c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75045) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 23:28:16 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-31751176-347d-42ce-b2e6-ed798b738377 tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] Converting VIF {"id": "f34eef67-0428-49ea-91c3-08510ac690c8", "address": "fa:16:3e:d9:92:a4", "network": {"id": "d177c8b8-5960-4e40-bf9b-920a2f6ba4f7", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-497258569-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.31", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "467f0ecc3b93457f9fe83886b99c6285", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf34eef67-04", "ovs_interfaceid": "f34eef67-0428-49ea-91c3-08510ac690c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 23:28:16 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-31751176-347d-42ce-b2e6-ed798b738377 tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d9:92:a4,bridge_name='br-int',has_traffic_filtering=True,id=f34eef67-0428-49ea-91c3-08510ac690c8,network=Network(d177c8b8-5960-4e40-bf9b-920a2f6ba4f7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf34eef67-04') {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 23:28:16 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-31751176-347d-42ce-b2e6-ed798b738377 tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] [instance: 83d225e0-e39e-4500-b7ae-52dfbd8b8588] End _get_guest_xml xml=<domain type="kvm">
Nov 08 23:28:16 user nova-compute[75045]:   <uuid>83d225e0-e39e-4500-b7ae-52dfbd8b8588</uuid>
Nov 08 23:28:16 user nova-compute[75045]:   <name>instance-00000010</name>
Nov 08 23:28:16 user nova-compute[75045]:   <memory>524288</memory>
Nov 08 23:28:16 user nova-compute[75045]:   <vcpu>1</vcpu>
Nov 08 23:28:16 user nova-compute[75045]:   <metadata>
Nov 08 23:28:16 user nova-compute[75045]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 23:28:16 user nova-compute[75045]:       <nova:package version="0.0.0"/>
Nov 08 23:28:16 user nova-compute[75045]:       <nova:name>tempest-ServerActionsTestOtherB-server-52454361</nova:name>
Nov 08 23:28:16 user nova-compute[75045]:       <nova:creationTime>2023-11-08 23:28:14</nova:creationTime>
Nov 08 23:28:16 user nova-compute[75045]:       <nova:flavor name="m1.tiny">
Nov 08 23:28:16 user nova-compute[75045]:         <nova:memory>512</nova:memory>
Nov 08 23:28:16 user nova-compute[75045]:         <nova:disk>1</nova:disk>
Nov 08 23:28:16 user nova-compute[75045]:         <nova:swap>0</nova:swap>
Nov 08 23:28:16 user nova-compute[75045]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 23:28:16 user nova-compute[75045]:         <nova:vcpus>1</nova:vcpus>
Nov 08 23:28:16 user nova-compute[75045]:       </nova:flavor>
Nov 08 23:28:16 user nova-compute[75045]:       <nova:owner>
Nov 08 23:28:16 user nova-compute[75045]:         <nova:user uuid="57d0c13f5a9f4c1bbb0458b93de348cb">tempest-ServerActionsTestOtherB-299728934-project-member</nova:user>
Nov 08 23:28:16 user nova-compute[75045]:         <nova:project uuid="467f0ecc3b93457f9fe83886b99c6285">tempest-ServerActionsTestOtherB-299728934</nova:project>
Nov 08 23:28:16 user nova-compute[75045]:       </nova:owner>
Nov 08 23:28:16 user nova-compute[75045]:       <nova:root type="image" uuid="a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb"/>
Nov 08 23:28:16 user nova-compute[75045]:       <nova:ports>
Nov 08 23:28:16 user nova-compute[75045]:         <nova:port uuid="f34eef67-0428-49ea-91c3-08510ac690c8">
Nov 08 23:28:16 user nova-compute[75045]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 08 23:28:16 user nova-compute[75045]:         </nova:port>
Nov 08 23:28:16 user nova-compute[75045]:       </nova:ports>
Nov 08 23:28:16 user nova-compute[75045]:     </nova:instance>
Nov 08 23:28:16 user nova-compute[75045]:   </metadata>
Nov 08 23:28:16 user nova-compute[75045]:   <sysinfo type="smbios">
Nov 08 23:28:16 user nova-compute[75045]:     <system>
Nov 08 23:28:16 user nova-compute[75045]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 23:28:16 user nova-compute[75045]:       <entry name="product">OpenStack Nova</entry>
Nov 08 23:28:16 user nova-compute[75045]:       <entry name="version">0.0.0</entry>
Nov 08 23:28:16 user nova-compute[75045]:       <entry name="serial">83d225e0-e39e-4500-b7ae-52dfbd8b8588</entry>
Nov 08 23:28:16 user nova-compute[75045]:       <entry name="uuid">83d225e0-e39e-4500-b7ae-52dfbd8b8588</entry>
Nov 08 23:28:16 user nova-compute[75045]:       <entry name="family">Virtual Machine</entry>
Nov 08 23:28:16 user nova-compute[75045]:     </system>
Nov 08 23:28:16 user nova-compute[75045]:   </sysinfo>
Nov 08 23:28:16 user nova-compute[75045]:   <os>
Nov 08 23:28:16 user nova-compute[75045]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 23:28:16 user nova-compute[75045]:     <boot dev="hd"/>
Nov 08 23:28:16 user nova-compute[75045]:     <smbios mode="sysinfo"/>
Nov 08 23:28:16 user nova-compute[75045]:   </os>
Nov 08 23:28:16 user nova-compute[75045]:   <features>
Nov 08 23:28:16 user nova-compute[75045]:     <acpi/>
Nov 08 23:28:16 user nova-compute[75045]:     <apic/>
Nov 08 23:28:16 user nova-compute[75045]:     <vmcoreinfo/>
Nov 08 23:28:16 user nova-compute[75045]:   </features>
Nov 08 23:28:16 user nova-compute[75045]:   <clock offset="utc">
Nov 08 23:28:16 user nova-compute[75045]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 23:28:16 user nova-compute[75045]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 23:28:16 user nova-compute[75045]:     <timer name="hpet" present="no"/>
Nov 08 23:28:16 user nova-compute[75045]:   </clock>
Nov 08 23:28:16 user nova-compute[75045]:   <cpu mode="custom" match="exact">
Nov 08 23:28:16 user nova-compute[75045]:     <model>Nehalem</model>
Nov 08 23:28:16 user nova-compute[75045]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 23:28:16 user nova-compute[75045]:   </cpu>
Nov 08 23:28:16 user nova-compute[75045]:   <devices>
Nov 08 23:28:16 user nova-compute[75045]:     <disk type="file" device="disk">
Nov 08 23:28:16 user nova-compute[75045]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 23:28:16 user nova-compute[75045]:       <source file="/opt/stack/data/nova/instances/83d225e0-e39e-4500-b7ae-52dfbd8b8588/disk"/>
Nov 08 23:28:16 user nova-compute[75045]:       <target dev="vda" bus="virtio"/>
Nov 08 23:28:16 user nova-compute[75045]:     </disk>
Nov 08 23:28:16 user nova-compute[75045]:     <disk type="block" device="disk">
Nov 08 23:28:16 user nova-compute[75045]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 23:28:16 user nova-compute[75045]:       <source dev="/dev/sdc"/>
Nov 08 23:28:16 user nova-compute[75045]:       <target dev="vdb" bus="virtio"/>
Nov 08 23:28:16 user nova-compute[75045]:       <serial>d2e734fa-1dcb-4510-a50e-064e29c2985e</serial>
Nov 08 23:28:16 user nova-compute[75045]:     </disk>
Nov 08 23:28:16 user nova-compute[75045]:     <interface type="ethernet">
Nov 08 23:28:16 user nova-compute[75045]:       <mac address="fa:16:3e:d9:92:a4"/>
Nov 08 23:28:16 user nova-compute[75045]:       <model type="virtio"/>
Nov 08 23:28:16 user nova-compute[75045]:       <mtu size="1442"/>
Nov 08 23:28:16 user nova-compute[75045]:       <target dev="tapf34eef67-04"/>
Nov 08 23:28:16 user nova-compute[75045]:     </interface>
Nov 08 23:28:16 user nova-compute[75045]:     <serial type="pty">
Nov 08 23:28:16 user nova-compute[75045]:       <log file="/opt/stack/data/nova/instances/83d225e0-e39e-4500-b7ae-52dfbd8b8588/console.log" append="off"/>
Nov 08 23:28:16 user nova-compute[75045]:     </serial>
Nov 08 23:28:16 user nova-compute[75045]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 23:28:16 user nova-compute[75045]:     <video>
Nov 08 23:28:16 user nova-compute[75045]:       <model type="virtio"/>
Nov 08 23:28:16 user nova-compute[75045]:     </video>
Nov 08 23:28:16 user nova-compute[75045]:     <rng model="virtio">
Nov 08 23:28:16 user nova-compute[75045]:       <backend model="random">/dev/urandom</backend>
Nov 08 23:28:16 user nova-compute[75045]:     </rng>
Nov 08 23:28:16 user nova-compute[75045]:     <controller type="usb" index="0" model="none"/>
Nov 08 23:28:16 user nova-compute[75045]:     <memballoon model="virtio">
Nov 08 23:28:16 user nova-compute[75045]:       <stats period="10"/>
Nov 08 23:28:16 user nova-compute[75045]:     </memballoon>
Nov 08 23:28:16 user nova-compute[75045]:   </devices>
Nov 08 23:28:16 user nova-compute[75045]: </domain>
Nov 08 23:28:16 user nova-compute[75045]:  {{(pid=75045) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 23:28:16 user nova-compute[75045]: DEBUG nova.virt.libvirt.vif [None req-31751176-347d-42ce-b2e6-ed798b738377 tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T23:21:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-52454361',display_name='tempest-ServerActionsTestOtherB-server-52454361',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-52454361',id=16,image_ref='a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIPmBc8a5DafKsuCJlskOYpDDhPwBioEg4bK8XJOdFwOvE3kerS9/OlDrIi5hKJ4t8vHYgazIqYE6C9fG+r7udy2il9kXgn4I4yPKUfyTlGPaqAfUG4gtg1sBgzfEDpsow==',key_name='tempest-keypair-1494902868',keypairs=<?>,launch_index=0,launched_at=2023-11-08T23:26:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='467f0ecc3b93457f9fe83886b99c6285',ramdisk_id='',reservation_id='r-mtlunwmw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-299728934',owner_user_name='tempest-ServerActionsTestOtherB-299728934-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T23:27:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='57d0c13f5a9f4c1bbb0458b93de348cb',uuid=83d225e0-e39e-4500-b7ae-52dfbd8b8588,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "f34eef67-0428-49ea-91c3-08510ac690c8", "address": "fa:16:3e:d9:92:a4", "network": {"id": "d177c8b8-5960-4e40-bf9b-920a2f6ba4f7", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-497258569-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.31", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "467f0ecc3b93457f9fe83886b99c6285", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf34eef67-04", "ovs_interfaceid": "f34eef67-0428-49ea-91c3-08510ac690c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75045) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 23:28:16 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-31751176-347d-42ce-b2e6-ed798b738377 tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] Converting VIF {"id": "f34eef67-0428-49ea-91c3-08510ac690c8", "address": "fa:16:3e:d9:92:a4", "network": {"id": "d177c8b8-5960-4e40-bf9b-920a2f6ba4f7", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-497258569-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.31", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "467f0ecc3b93457f9fe83886b99c6285", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf34eef67-04", "ovs_interfaceid": "f34eef67-0428-49ea-91c3-08510ac690c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 23:28:16 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-31751176-347d-42ce-b2e6-ed798b738377 tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d9:92:a4,bridge_name='br-int',has_traffic_filtering=True,id=f34eef67-0428-49ea-91c3-08510ac690c8,network=Network(d177c8b8-5960-4e40-bf9b-920a2f6ba4f7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf34eef67-04') {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 23:28:16 user nova-compute[75045]: DEBUG os_vif [None req-31751176-347d-42ce-b2e6-ed798b738377 tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d9:92:a4,bridge_name='br-int',has_traffic_filtering=True,id=f34eef67-0428-49ea-91c3-08510ac690c8,network=Network(d177c8b8-5960-4e40-bf9b-920a2f6ba4f7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf34eef67-04') {{(pid=75045) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 23:28:16 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:28:16 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:28:16 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 23:28:16 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:28:16 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f0cd464b-9d86-5c16-aea4-d9e38240ae43', '_type': 'linux-noop'}}, row=False) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:28:16 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:28:16 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:28:16 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:28:16 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf34eef67-04, may_exist=True, interface_attrs={}) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:28:16 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf34eef67-04, col_values=(('qos', UUID('88434b2d-da31-41c6-ad07-09b9fd2e57de')),), if_exists=True) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:28:16 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf34eef67-04, col_values=(('external_ids', {'iface-id': 'f34eef67-0428-49ea-91c3-08510ac690c8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d9:92:a4', 'vm-uuid': '83d225e0-e39e-4500-b7ae-52dfbd8b8588'}),), if_exists=True) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:28:16 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:28:16 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 23:28:16 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:28:16 user nova-compute[75045]: INFO os_vif [None req-31751176-347d-42ce-b2e6-ed798b738377 tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d9:92:a4,bridge_name='br-int',has_traffic_filtering=True,id=f34eef67-0428-49ea-91c3-08510ac690c8,network=Network(d177c8b8-5960-4e40-bf9b-920a2f6ba4f7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf34eef67-04')
Nov 08 23:28:16 user nova-compute[75045]: DEBUG nova.network.neutron [None req-e9261792-a27e-4cfb-a8c1-98c3381324a0 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] [instance: 1a3c21c4-2db3-44e1-8a23-336ca9f8374d] Successfully updated port: f3fb74c0-e5f6-4a65-8d50-b33da34c4fcb {{(pid=75045) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 23:28:16 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-e9261792-a27e-4cfb-a8c1-98c3381324a0 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Acquiring lock "refresh_cache-1a3c21c4-2db3-44e1-8a23-336ca9f8374d" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 23:28:16 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-e9261792-a27e-4cfb-a8c1-98c3381324a0 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Acquired lock "refresh_cache-1a3c21c4-2db3-44e1-8a23-336ca9f8374d" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 23:28:16 user nova-compute[75045]: DEBUG nova.network.neutron [None req-e9261792-a27e-4cfb-a8c1-98c3381324a0 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] [instance: 1a3c21c4-2db3-44e1-8a23-336ca9f8374d] Building network info cache for instance {{(pid=75045) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 23:28:16 user nova-compute[75045]: DEBUG nova.compute.manager [req-d000b264-2809-4846-8d74-558391125a13 req-113ebb33-576a-4eb8-a354-95203ba42644 service nova] [instance: 1a3c21c4-2db3-44e1-8a23-336ca9f8374d] Received event network-changed-f3fb74c0-e5f6-4a65-8d50-b33da34c4fcb {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:28:16 user nova-compute[75045]: DEBUG nova.compute.manager [req-d000b264-2809-4846-8d74-558391125a13 req-113ebb33-576a-4eb8-a354-95203ba42644 service nova] [instance: 1a3c21c4-2db3-44e1-8a23-336ca9f8374d] Refreshing instance network info cache due to event network-changed-f3fb74c0-e5f6-4a65-8d50-b33da34c4fcb. {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 23:28:16 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-d000b264-2809-4846-8d74-558391125a13 req-113ebb33-576a-4eb8-a354-95203ba42644 service nova] Acquiring lock "refresh_cache-1a3c21c4-2db3-44e1-8a23-336ca9f8374d" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 23:28:16 user nova-compute[75045]: DEBUG nova.network.neutron [None req-e9261792-a27e-4cfb-a8c1-98c3381324a0 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] [instance: 1a3c21c4-2db3-44e1-8a23-336ca9f8374d] Instance cache missing network info. {{(pid=75045) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 23:28:16 user nova-compute[75045]: DEBUG nova.network.neutron [None req-e9261792-a27e-4cfb-a8c1-98c3381324a0 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] [instance: 1a3c21c4-2db3-44e1-8a23-336ca9f8374d] Updating instance_info_cache with network_info: [{"id": "f3fb74c0-e5f6-4a65-8d50-b33da34c4fcb", "address": "fa:16:3e:57:5d:d2", "network": {"id": "2f33d93d-98ec-4b87-a0c0-efe2d2ac8f6d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-719527911-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7eff4be777d24514be52868961bf7a25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3fb74c0-e5", "ovs_interfaceid": "f3fb74c0-e5f6-4a65-8d50-b33da34c4fcb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75045) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 23:28:16 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-e9261792-a27e-4cfb-a8c1-98c3381324a0 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Releasing lock "refresh_cache-1a3c21c4-2db3-44e1-8a23-336ca9f8374d" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 23:28:16 user nova-compute[75045]: DEBUG nova.compute.manager [None req-e9261792-a27e-4cfb-a8c1-98c3381324a0 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] [instance: 1a3c21c4-2db3-44e1-8a23-336ca9f8374d] Instance network_info: |[{"id": "f3fb74c0-e5f6-4a65-8d50-b33da34c4fcb", "address": "fa:16:3e:57:5d:d2", "network": {"id": "2f33d93d-98ec-4b87-a0c0-efe2d2ac8f6d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-719527911-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7eff4be777d24514be52868961bf7a25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3fb74c0-e5", "ovs_interfaceid": "f3fb74c0-e5f6-4a65-8d50-b33da34c4fcb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75045) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 23:28:16 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-d000b264-2809-4846-8d74-558391125a13 req-113ebb33-576a-4eb8-a354-95203ba42644 service nova] Acquired lock "refresh_cache-1a3c21c4-2db3-44e1-8a23-336ca9f8374d" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 23:28:16 user nova-compute[75045]: DEBUG nova.network.neutron [req-d000b264-2809-4846-8d74-558391125a13 req-113ebb33-576a-4eb8-a354-95203ba42644 service nova] [instance: 1a3c21c4-2db3-44e1-8a23-336ca9f8374d] Refreshing network info cache for port f3fb74c0-e5f6-4a65-8d50-b33da34c4fcb {{(pid=75045) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 23:28:16 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-e9261792-a27e-4cfb-a8c1-98c3381324a0 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] [instance: 1a3c21c4-2db3-44e1-8a23-336ca9f8374d] Start _get_guest_xml network_info=[{"id": "f3fb74c0-e5f6-4a65-8d50-b33da34c4fcb", "address": "fa:16:3e:57:5d:d2", "network": {"id": "2f33d93d-98ec-4b87-a0c0-efe2d2ac8f6d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-719527911-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7eff4be777d24514be52868961bf7a25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3fb74c0-e5", "ovs_interfaceid": "f3fb74c0-e5f6-4a65-8d50-b33da34c4fcb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T23:11:54Z,direct_url=<?>,disk_format='qcow2',id=a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b1beba2cc4e7465ea249e2225fb494dc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T23:11:56Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'disk_bus': 'virtio', 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': 'a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75045) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 23:28:16 user nova-compute[75045]: WARNING nova.virt.libvirt.driver [None req-e9261792-a27e-4cfb-a8c1-98c3381324a0 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 23:28:16 user nova-compute[75045]: WARNING nova.virt.libvirt.driver [None req-e9261792-a27e-4cfb-a8c1-98c3381324a0 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 23:28:16 user nova-compute[75045]: DEBUG nova.virt.libvirt.host [None req-e9261792-a27e-4cfb-a8c1-98c3381324a0 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75045) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 23:28:16 user nova-compute[75045]: DEBUG nova.virt.libvirt.host [None req-e9261792-a27e-4cfb-a8c1-98c3381324a0 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] CPU controller missing on host. {{(pid=75045) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 23:28:16 user nova-compute[75045]: DEBUG nova.virt.libvirt.host [None req-e9261792-a27e-4cfb-a8c1-98c3381324a0 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75045) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 23:28:16 user nova-compute[75045]: DEBUG nova.virt.libvirt.host [None req-e9261792-a27e-4cfb-a8c1-98c3381324a0 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] CPU controller found on host. {{(pid=75045) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 23:28:16 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-e9261792-a27e-4cfb-a8c1-98c3381324a0 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75045) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 23:28:16 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-e9261792-a27e-4cfb-a8c1-98c3381324a0 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T23:11:41Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T23:11:54Z,direct_url=<?>,disk_format='qcow2',id=a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b1beba2cc4e7465ea249e2225fb494dc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T23:11:56Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75045) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 23:28:16 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-e9261792-a27e-4cfb-a8c1-98c3381324a0 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Flavor limits 0:0:0 {{(pid=75045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 23:28:16 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-e9261792-a27e-4cfb-a8c1-98c3381324a0 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Image limits 0:0:0 {{(pid=75045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 23:28:16 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-e9261792-a27e-4cfb-a8c1-98c3381324a0 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Flavor pref 0:0:0 {{(pid=75045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 23:28:16 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-e9261792-a27e-4cfb-a8c1-98c3381324a0 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Image pref 0:0:0 {{(pid=75045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 23:28:16 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-e9261792-a27e-4cfb-a8c1-98c3381324a0 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 23:28:16 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-e9261792-a27e-4cfb-a8c1-98c3381324a0 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75045) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 23:28:16 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-e9261792-a27e-4cfb-a8c1-98c3381324a0 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75045) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 23:28:16 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-e9261792-a27e-4cfb-a8c1-98c3381324a0 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Got 1 possible topologies {{(pid=75045) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 23:28:16 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-e9261792-a27e-4cfb-a8c1-98c3381324a0 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75045) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 23:28:16 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-e9261792-a27e-4cfb-a8c1-98c3381324a0 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75045) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 23:28:16 user nova-compute[75045]: DEBUG nova.virt.libvirt.vif [None req-e9261792-a27e-4cfb-a8c1-98c3381324a0 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T23:28:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1675585016',display_name='tempest-AttachVolumeNegativeTest-server-1675585016',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1675585016',id=28,image_ref='a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOSEVtbs5drLNhMiJi78DfCAYQDpA0IgNhhWU1d/fAienGpzbXpzNi6NWrezJb1HKzcbVkcgH6wwtFAiR1ajmmGHq2EOamIImHyrNRVH60eF8efqzPOoK+zv3yxhqTdckw==',key_name='tempest-keypair-762847075',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7eff4be777d24514be52868961bf7a25',ramdisk_id='',reservation_id='r-0wybollb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1522456563',owner_user_name='tempest-AttachVolumeNegativeTest-1522456563-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T23:28:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4a05b178abe74b779a991e887bf135b2',uuid=1a3c21c4-2db3-44e1-8a23-336ca9f8374d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f3fb74c0-e5f6-4a65-8d50-b33da34c4fcb", "address": "fa:16:3e:57:5d:d2", "network": {"id": "2f33d93d-98ec-4b87-a0c0-efe2d2ac8f6d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-719527911-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7eff4be777d24514be52868961bf7a25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3fb74c0-e5", "ovs_interfaceid": "f3fb74c0-e5f6-4a65-8d50-b33da34c4fcb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75045) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 23:28:16 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-e9261792-a27e-4cfb-a8c1-98c3381324a0 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Converting VIF {"id": "f3fb74c0-e5f6-4a65-8d50-b33da34c4fcb", "address": "fa:16:3e:57:5d:d2", "network": {"id": "2f33d93d-98ec-4b87-a0c0-efe2d2ac8f6d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-719527911-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7eff4be777d24514be52868961bf7a25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3fb74c0-e5", "ovs_interfaceid": "f3fb74c0-e5f6-4a65-8d50-b33da34c4fcb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 23:28:16 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-e9261792-a27e-4cfb-a8c1-98c3381324a0 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:57:5d:d2,bridge_name='br-int',has_traffic_filtering=True,id=f3fb74c0-e5f6-4a65-8d50-b33da34c4fcb,network=Network(2f33d93d-98ec-4b87-a0c0-efe2d2ac8f6d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf3fb74c0-e5') {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 23:28:16 user nova-compute[75045]: DEBUG nova.objects.instance [None req-e9261792-a27e-4cfb-a8c1-98c3381324a0 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Lazy-loading 'pci_devices' on Instance uuid 1a3c21c4-2db3-44e1-8a23-336ca9f8374d {{(pid=75045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 23:28:16 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-e9261792-a27e-4cfb-a8c1-98c3381324a0 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] [instance: 1a3c21c4-2db3-44e1-8a23-336ca9f8374d] End _get_guest_xml xml=<domain type="kvm">
Nov 08 23:28:16 user nova-compute[75045]:   <uuid>1a3c21c4-2db3-44e1-8a23-336ca9f8374d</uuid>
Nov 08 23:28:16 user nova-compute[75045]:   <name>instance-0000001c</name>
Nov 08 23:28:16 user nova-compute[75045]:   <memory>524288</memory>
Nov 08 23:28:16 user nova-compute[75045]:   <vcpu>1</vcpu>
Nov 08 23:28:16 user nova-compute[75045]:   <metadata>
Nov 08 23:28:16 user nova-compute[75045]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 23:28:16 user nova-compute[75045]:       <nova:package version="0.0.0"/>
Nov 08 23:28:16 user nova-compute[75045]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1675585016</nova:name>
Nov 08 23:28:16 user nova-compute[75045]:       <nova:creationTime>2023-11-08 23:28:16</nova:creationTime>
Nov 08 23:28:16 user nova-compute[75045]:       <nova:flavor name="m1.tiny">
Nov 08 23:28:16 user nova-compute[75045]:         <nova:memory>512</nova:memory>
Nov 08 23:28:16 user nova-compute[75045]:         <nova:disk>1</nova:disk>
Nov 08 23:28:16 user nova-compute[75045]:         <nova:swap>0</nova:swap>
Nov 08 23:28:16 user nova-compute[75045]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 23:28:16 user nova-compute[75045]:         <nova:vcpus>1</nova:vcpus>
Nov 08 23:28:16 user nova-compute[75045]:       </nova:flavor>
Nov 08 23:28:16 user nova-compute[75045]:       <nova:owner>
Nov 08 23:28:16 user nova-compute[75045]:         <nova:user uuid="4a05b178abe74b779a991e887bf135b2">tempest-AttachVolumeNegativeTest-1522456563-project-member</nova:user>
Nov 08 23:28:16 user nova-compute[75045]:         <nova:project uuid="7eff4be777d24514be52868961bf7a25">tempest-AttachVolumeNegativeTest-1522456563</nova:project>
Nov 08 23:28:16 user nova-compute[75045]:       </nova:owner>
Nov 08 23:28:16 user nova-compute[75045]:       <nova:root type="image" uuid="a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb"/>
Nov 08 23:28:16 user nova-compute[75045]:       <nova:ports>
Nov 08 23:28:16 user nova-compute[75045]:         <nova:port uuid="f3fb74c0-e5f6-4a65-8d50-b33da34c4fcb">
Nov 08 23:28:16 user nova-compute[75045]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 08 23:28:16 user nova-compute[75045]:         </nova:port>
Nov 08 23:28:16 user nova-compute[75045]:       </nova:ports>
Nov 08 23:28:16 user nova-compute[75045]:     </nova:instance>
Nov 08 23:28:16 user nova-compute[75045]:   </metadata>
Nov 08 23:28:16 user nova-compute[75045]:   <sysinfo type="smbios">
Nov 08 23:28:16 user nova-compute[75045]:     <system>
Nov 08 23:28:16 user nova-compute[75045]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 23:28:16 user nova-compute[75045]:       <entry name="product">OpenStack Nova</entry>
Nov 08 23:28:16 user nova-compute[75045]:       <entry name="version">0.0.0</entry>
Nov 08 23:28:16 user nova-compute[75045]:       <entry name="serial">1a3c21c4-2db3-44e1-8a23-336ca9f8374d</entry>
Nov 08 23:28:16 user nova-compute[75045]:       <entry name="uuid">1a3c21c4-2db3-44e1-8a23-336ca9f8374d</entry>
Nov 08 23:28:16 user nova-compute[75045]:       <entry name="family">Virtual Machine</entry>
Nov 08 23:28:16 user nova-compute[75045]:     </system>
Nov 08 23:28:16 user nova-compute[75045]:   </sysinfo>
Nov 08 23:28:16 user nova-compute[75045]:   <os>
Nov 08 23:28:16 user nova-compute[75045]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 23:28:16 user nova-compute[75045]:     <boot dev="hd"/>
Nov 08 23:28:16 user nova-compute[75045]:     <smbios mode="sysinfo"/>
Nov 08 23:28:16 user nova-compute[75045]:   </os>
Nov 08 23:28:16 user nova-compute[75045]:   <features>
Nov 08 23:28:16 user nova-compute[75045]:     <acpi/>
Nov 08 23:28:16 user nova-compute[75045]:     <apic/>
Nov 08 23:28:16 user nova-compute[75045]:     <vmcoreinfo/>
Nov 08 23:28:16 user nova-compute[75045]:   </features>
Nov 08 23:28:16 user nova-compute[75045]:   <clock offset="utc">
Nov 08 23:28:16 user nova-compute[75045]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 23:28:16 user nova-compute[75045]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 23:28:16 user nova-compute[75045]:     <timer name="hpet" present="no"/>
Nov 08 23:28:16 user nova-compute[75045]:   </clock>
Nov 08 23:28:16 user nova-compute[75045]:   <cpu mode="custom" match="exact">
Nov 08 23:28:16 user nova-compute[75045]:     <model>Nehalem</model>
Nov 08 23:28:16 user nova-compute[75045]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 23:28:16 user nova-compute[75045]:   </cpu>
Nov 08 23:28:16 user nova-compute[75045]:   <devices>
Nov 08 23:28:16 user nova-compute[75045]:     <disk type="file" device="disk">
Nov 08 23:28:16 user nova-compute[75045]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 23:28:16 user nova-compute[75045]:       <source file="/opt/stack/data/nova/instances/1a3c21c4-2db3-44e1-8a23-336ca9f8374d/disk"/>
Nov 08 23:28:16 user nova-compute[75045]:       <target dev="vda" bus="virtio"/>
Nov 08 23:28:16 user nova-compute[75045]:     </disk>
Nov 08 23:28:16 user nova-compute[75045]:     <interface type="ethernet">
Nov 08 23:28:16 user nova-compute[75045]:       <mac address="fa:16:3e:57:5d:d2"/>
Nov 08 23:28:16 user nova-compute[75045]:       <model type="virtio"/>
Nov 08 23:28:16 user nova-compute[75045]:       <mtu size="1442"/>
Nov 08 23:28:16 user nova-compute[75045]:       <target dev="tapf3fb74c0-e5"/>
Nov 08 23:28:16 user nova-compute[75045]:     </interface>
Nov 08 23:28:16 user nova-compute[75045]:     <serial type="pty">
Nov 08 23:28:16 user nova-compute[75045]:       <log file="/opt/stack/data/nova/instances/1a3c21c4-2db3-44e1-8a23-336ca9f8374d/console.log" append="off"/>
Nov 08 23:28:16 user nova-compute[75045]:     </serial>
Nov 08 23:28:16 user nova-compute[75045]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 23:28:16 user nova-compute[75045]:     <video>
Nov 08 23:28:16 user nova-compute[75045]:       <model type="virtio"/>
Nov 08 23:28:16 user nova-compute[75045]:     </video>
Nov 08 23:28:16 user nova-compute[75045]:     <rng model="virtio">
Nov 08 23:28:16 user nova-compute[75045]:       <backend model="random">/dev/urandom</backend>
Nov 08 23:28:16 user nova-compute[75045]:     </rng>
Nov 08 23:28:16 user nova-compute[75045]:     <controller type="usb" index="0" model="none"/>
Nov 08 23:28:16 user nova-compute[75045]:     <memballoon model="virtio">
Nov 08 23:28:16 user nova-compute[75045]:       <stats period="10"/>
Nov 08 23:28:16 user nova-compute[75045]:     </memballoon>
Nov 08 23:28:16 user nova-compute[75045]:   </devices>
Nov 08 23:28:16 user nova-compute[75045]: </domain>
Nov 08 23:28:16 user nova-compute[75045]:  {{(pid=75045) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 23:28:16 user nova-compute[75045]: DEBUG nova.virt.libvirt.vif [None req-e9261792-a27e-4cfb-a8c1-98c3381324a0 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T23:28:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1675585016',display_name='tempest-AttachVolumeNegativeTest-server-1675585016',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1675585016',id=28,image_ref='a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOSEVtbs5drLNhMiJi78DfCAYQDpA0IgNhhWU1d/fAienGpzbXpzNi6NWrezJb1HKzcbVkcgH6wwtFAiR1ajmmGHq2EOamIImHyrNRVH60eF8efqzPOoK+zv3yxhqTdckw==',key_name='tempest-keypair-762847075',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7eff4be777d24514be52868961bf7a25',ramdisk_id='',reservation_id='r-0wybollb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1522456563',owner_user_name='tempest-AttachVolumeNegativeTest-1522456563-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T23:28:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4a05b178abe74b779a991e887bf135b2',uuid=1a3c21c4-2db3-44e1-8a23-336ca9f8374d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f3fb74c0-e5f6-4a65-8d50-b33da34c4fcb", "address": "fa:16:3e:57:5d:d2", "network": {"id": "2f33d93d-98ec-4b87-a0c0-efe2d2ac8f6d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-719527911-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7eff4be777d24514be52868961bf7a25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3fb74c0-e5", "ovs_interfaceid": "f3fb74c0-e5f6-4a65-8d50-b33da34c4fcb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75045) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 23:28:16 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-e9261792-a27e-4cfb-a8c1-98c3381324a0 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Converting VIF {"id": "f3fb74c0-e5f6-4a65-8d50-b33da34c4fcb", "address": "fa:16:3e:57:5d:d2", "network": {"id": "2f33d93d-98ec-4b87-a0c0-efe2d2ac8f6d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-719527911-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7eff4be777d24514be52868961bf7a25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3fb74c0-e5", "ovs_interfaceid": "f3fb74c0-e5f6-4a65-8d50-b33da34c4fcb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 23:28:16 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-e9261792-a27e-4cfb-a8c1-98c3381324a0 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:57:5d:d2,bridge_name='br-int',has_traffic_filtering=True,id=f3fb74c0-e5f6-4a65-8d50-b33da34c4fcb,network=Network(2f33d93d-98ec-4b87-a0c0-efe2d2ac8f6d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf3fb74c0-e5') {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 23:28:16 user nova-compute[75045]: DEBUG os_vif [None req-e9261792-a27e-4cfb-a8c1-98c3381324a0 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:57:5d:d2,bridge_name='br-int',has_traffic_filtering=True,id=f3fb74c0-e5f6-4a65-8d50-b33da34c4fcb,network=Network(2f33d93d-98ec-4b87-a0c0-efe2d2ac8f6d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf3fb74c0-e5') {{(pid=75045) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 23:28:16 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:28:16 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:28:16 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 23:28:16 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:28:16 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ffac935e-556e-59c1-b021-a477ad6f4c86', '_type': 'linux-noop'}}, row=False) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:28:16 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:28:16 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 23:28:16 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:28:16 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:28:16 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf3fb74c0-e5, may_exist=True, interface_attrs={}) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:28:16 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf3fb74c0-e5, col_values=(('qos', UUID('0c4cffac-5bb1-40c7-ae62-f35a27252a7a')),), if_exists=True) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:28:16 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf3fb74c0-e5, col_values=(('external_ids', {'iface-id': 'f3fb74c0-e5f6-4a65-8d50-b33da34c4fcb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:57:5d:d2', 'vm-uuid': '1a3c21c4-2db3-44e1-8a23-336ca9f8374d'}),), if_exists=True) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:28:16 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:28:16 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 23:28:16 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:28:16 user nova-compute[75045]: INFO os_vif [None req-e9261792-a27e-4cfb-a8c1-98c3381324a0 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:57:5d:d2,bridge_name='br-int',has_traffic_filtering=True,id=f3fb74c0-e5f6-4a65-8d50-b33da34c4fcb,network=Network(2f33d93d-98ec-4b87-a0c0-efe2d2ac8f6d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf3fb74c0-e5')
Nov 08 23:28:17 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-e9261792-a27e-4cfb-a8c1-98c3381324a0 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] No BDM found with device name vda, not building metadata. {{(pid=75045) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 23:28:17 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-e9261792-a27e-4cfb-a8c1-98c3381324a0 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] No VIF found with MAC fa:16:3e:57:5d:d2, not building metadata {{(pid=75045) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 23:28:17 user nova-compute[75045]: DEBUG nova.network.neutron [req-d000b264-2809-4846-8d74-558391125a13 req-113ebb33-576a-4eb8-a354-95203ba42644 service nova] [instance: 1a3c21c4-2db3-44e1-8a23-336ca9f8374d] Updated VIF entry in instance network info cache for port f3fb74c0-e5f6-4a65-8d50-b33da34c4fcb. {{(pid=75045) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 23:28:17 user nova-compute[75045]: DEBUG nova.network.neutron [req-d000b264-2809-4846-8d74-558391125a13 req-113ebb33-576a-4eb8-a354-95203ba42644 service nova] [instance: 1a3c21c4-2db3-44e1-8a23-336ca9f8374d] Updating instance_info_cache with network_info: [{"id": "f3fb74c0-e5f6-4a65-8d50-b33da34c4fcb", "address": "fa:16:3e:57:5d:d2", "network": {"id": "2f33d93d-98ec-4b87-a0c0-efe2d2ac8f6d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-719527911-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7eff4be777d24514be52868961bf7a25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3fb74c0-e5", "ovs_interfaceid": "f3fb74c0-e5f6-4a65-8d50-b33da34c4fcb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75045) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 23:28:17 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-d000b264-2809-4846-8d74-558391125a13 req-113ebb33-576a-4eb8-a354-95203ba42644 service nova] Releasing lock "refresh_cache-1a3c21c4-2db3-44e1-8a23-336ca9f8374d" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 23:28:17 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:28:17 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:28:17 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:28:17 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:28:18 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:28:18 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:28:18 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:28:18 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:28:18 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:28:18 user nova-compute[75045]: DEBUG nova.compute.manager [req-3ec1e138-89c6-4de2-b827-83e062c5f09e req-709b7adb-5f1b-491f-9897-01203603e043 service nova] [instance: 83d225e0-e39e-4500-b7ae-52dfbd8b8588] Received event network-vif-plugged-f34eef67-0428-49ea-91c3-08510ac690c8 {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:28:18 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-3ec1e138-89c6-4de2-b827-83e062c5f09e req-709b7adb-5f1b-491f-9897-01203603e043 service nova] Acquiring lock "83d225e0-e39e-4500-b7ae-52dfbd8b8588-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:28:18 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-3ec1e138-89c6-4de2-b827-83e062c5f09e req-709b7adb-5f1b-491f-9897-01203603e043 service nova] Lock "83d225e0-e39e-4500-b7ae-52dfbd8b8588-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:28:18 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-3ec1e138-89c6-4de2-b827-83e062c5f09e req-709b7adb-5f1b-491f-9897-01203603e043 service nova] Lock "83d225e0-e39e-4500-b7ae-52dfbd8b8588-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:28:18 user nova-compute[75045]: DEBUG nova.compute.manager [req-3ec1e138-89c6-4de2-b827-83e062c5f09e req-709b7adb-5f1b-491f-9897-01203603e043 service nova] [instance: 83d225e0-e39e-4500-b7ae-52dfbd8b8588] No waiting events found dispatching network-vif-plugged-f34eef67-0428-49ea-91c3-08510ac690c8 {{(pid=75045) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 23:28:18 user nova-compute[75045]: WARNING nova.compute.manager [req-3ec1e138-89c6-4de2-b827-83e062c5f09e req-709b7adb-5f1b-491f-9897-01203603e043 service nova] [instance: 83d225e0-e39e-4500-b7ae-52dfbd8b8588] Received unexpected event network-vif-plugged-f34eef67-0428-49ea-91c3-08510ac690c8 for instance with vm_state resized and task_state resize_reverting.
Nov 08 23:28:18 user nova-compute[75045]: DEBUG nova.compute.manager [req-3ec1e138-89c6-4de2-b827-83e062c5f09e req-709b7adb-5f1b-491f-9897-01203603e043 service nova] [instance: 83d225e0-e39e-4500-b7ae-52dfbd8b8588] Received event network-vif-plugged-f34eef67-0428-49ea-91c3-08510ac690c8 {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:28:18 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-3ec1e138-89c6-4de2-b827-83e062c5f09e req-709b7adb-5f1b-491f-9897-01203603e043 service nova] Acquiring lock "83d225e0-e39e-4500-b7ae-52dfbd8b8588-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:28:18 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-3ec1e138-89c6-4de2-b827-83e062c5f09e req-709b7adb-5f1b-491f-9897-01203603e043 service nova] Lock "83d225e0-e39e-4500-b7ae-52dfbd8b8588-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:28:18 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-3ec1e138-89c6-4de2-b827-83e062c5f09e req-709b7adb-5f1b-491f-9897-01203603e043 service nova] Lock "83d225e0-e39e-4500-b7ae-52dfbd8b8588-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:28:18 user nova-compute[75045]: DEBUG nova.compute.manager [req-3ec1e138-89c6-4de2-b827-83e062c5f09e req-709b7adb-5f1b-491f-9897-01203603e043 service nova] [instance: 83d225e0-e39e-4500-b7ae-52dfbd8b8588] No waiting events found dispatching network-vif-plugged-f34eef67-0428-49ea-91c3-08510ac690c8 {{(pid=75045) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 23:28:18 user nova-compute[75045]: WARNING nova.compute.manager [req-3ec1e138-89c6-4de2-b827-83e062c5f09e req-709b7adb-5f1b-491f-9897-01203603e043 service nova] [instance: 83d225e0-e39e-4500-b7ae-52dfbd8b8588] Received unexpected event network-vif-plugged-f34eef67-0428-49ea-91c3-08510ac690c8 for instance with vm_state resized and task_state resize_reverting.
Nov 08 23:28:19 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:28:19 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:28:19 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:28:19 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:28:19 user nova-compute[75045]: DEBUG os_brick.utils [None req-8f4d4c6c-cec0-4708-b180-7b306fe35c42 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75045) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 23:28:19 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:28:19 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:28:19 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[efcbd2fb-80bf-47e0-8f09-58b399dcca6b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6217bd6e884\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:28:19 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:28:19 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:28:19 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ce8794e-2b74-484e-8a2f-d7f3587bf400]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:28:19 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:28:19 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:28:19 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[77315283-b6c7-4d4a-987f-8f2ece5d2c66]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:28:19 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ee2e391-8f79-497a-8593-25bb06011304]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:28:19 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-8f4d4c6c-cec0-4708-b180-7b306fe35c42 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Running cmd (subprocess): nvme version {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:28:19 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-8f4d4c6c-cec0-4708-b180-7b306fe35c42 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] 'nvme version' failed. Not Retrying. {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 23:28:19 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8f4d4c6c-cec0-4708-b180-7b306fe35c42 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] nvme not present on system {{(pid=75045) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 23:28:19 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:28:19 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 23:28:19 user nova-compute[75045]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 23:28:19 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[546ea27a-84f0-42d7-ac26-f350a33dedb3]: (4, '') {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:28:19 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.lightos [None req-8f4d4c6c-cec0-4708-b180-7b306fe35c42 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75045) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 23:28:19 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.lightos [None req-8f4d4c6c-cec0-4708-b180-7b306fe35c42 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75045) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 23:28:19 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.lightos [None req-8f4d4c6c-cec0-4708-b180-7b306fe35c42 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] LIGHTOS: no hostnqn found. {{(pid=75045) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 23:28:19 user nova-compute[75045]: DEBUG os_brick.utils [None req-8f4d4c6c-cec0-4708-b180-7b306fe35c42 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] <== get_connector_properties: return (133ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6217bd6e884', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75045) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 23:28:19 user nova-compute[75045]: DEBUG nova.virt.block_device [None req-8f4d4c6c-cec0-4708-b180-7b306fe35c42 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] [instance: 438082fc-a83f-4305-ada6-41a8e1d645a8] Updating existing volume attachment record: d0f2e4d2-44f8-466b-b6a1-9be7c176e2df {{(pid=75045) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 23:28:19 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:28:19 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:28:19 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:28:20 user nova-compute[75045]: DEBUG nova.compute.manager [req-fad444f3-293f-4708-9b4a-947f0c22f811 req-92cfd5dd-1813-4b24-a579-885120678218 service nova] [instance: 1a3c21c4-2db3-44e1-8a23-336ca9f8374d] Received event network-vif-plugged-f3fb74c0-e5f6-4a65-8d50-b33da34c4fcb {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:28:20 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-fad444f3-293f-4708-9b4a-947f0c22f811 req-92cfd5dd-1813-4b24-a579-885120678218 service nova] Acquiring lock "1a3c21c4-2db3-44e1-8a23-336ca9f8374d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:28:20 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-fad444f3-293f-4708-9b4a-947f0c22f811 req-92cfd5dd-1813-4b24-a579-885120678218 service nova] Lock "1a3c21c4-2db3-44e1-8a23-336ca9f8374d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:28:20 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-fad444f3-293f-4708-9b4a-947f0c22f811 req-92cfd5dd-1813-4b24-a579-885120678218 service nova] Lock "1a3c21c4-2db3-44e1-8a23-336ca9f8374d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:28:20 user nova-compute[75045]: DEBUG nova.compute.manager [req-fad444f3-293f-4708-9b4a-947f0c22f811 req-92cfd5dd-1813-4b24-a579-885120678218 service nova] [instance: 1a3c21c4-2db3-44e1-8a23-336ca9f8374d] No waiting events found dispatching network-vif-plugged-f3fb74c0-e5f6-4a65-8d50-b33da34c4fcb {{(pid=75045) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 23:28:20 user nova-compute[75045]: WARNING nova.compute.manager [req-fad444f3-293f-4708-9b4a-947f0c22f811 req-92cfd5dd-1813-4b24-a579-885120678218 service nova] [instance: 1a3c21c4-2db3-44e1-8a23-336ca9f8374d] Received unexpected event network-vif-plugged-f3fb74c0-e5f6-4a65-8d50-b33da34c4fcb for instance with vm_state building and task_state spawning.
Nov 08 23:28:20 user nova-compute[75045]: DEBUG nova.compute.manager [req-fad444f3-293f-4708-9b4a-947f0c22f811 req-92cfd5dd-1813-4b24-a579-885120678218 service nova] [instance: 1a3c21c4-2db3-44e1-8a23-336ca9f8374d] Received event network-vif-plugged-f3fb74c0-e5f6-4a65-8d50-b33da34c4fcb {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:28:20 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-fad444f3-293f-4708-9b4a-947f0c22f811 req-92cfd5dd-1813-4b24-a579-885120678218 service nova] Acquiring lock "1a3c21c4-2db3-44e1-8a23-336ca9f8374d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:28:20 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-fad444f3-293f-4708-9b4a-947f0c22f811 req-92cfd5dd-1813-4b24-a579-885120678218 service nova] Lock "1a3c21c4-2db3-44e1-8a23-336ca9f8374d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:28:20 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-fad444f3-293f-4708-9b4a-947f0c22f811 req-92cfd5dd-1813-4b24-a579-885120678218 service nova] Lock "1a3c21c4-2db3-44e1-8a23-336ca9f8374d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:28:20 user nova-compute[75045]: DEBUG nova.compute.manager [req-fad444f3-293f-4708-9b4a-947f0c22f811 req-92cfd5dd-1813-4b24-a579-885120678218 service nova] [instance: 1a3c21c4-2db3-44e1-8a23-336ca9f8374d] No waiting events found dispatching network-vif-plugged-f3fb74c0-e5f6-4a65-8d50-b33da34c4fcb {{(pid=75045) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 23:28:20 user nova-compute[75045]: WARNING nova.compute.manager [req-fad444f3-293f-4708-9b4a-947f0c22f811 req-92cfd5dd-1813-4b24-a579-885120678218 service nova] [instance: 1a3c21c4-2db3-44e1-8a23-336ca9f8374d] Received unexpected event network-vif-plugged-f3fb74c0-e5f6-4a65-8d50-b33da34c4fcb for instance with vm_state building and task_state spawning.
Nov 08 23:28:21 user nova-compute[75045]: DEBUG nova.compute.manager [None req-31751176-347d-42ce-b2e6-ed798b738377 tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] [instance: 83d225e0-e39e-4500-b7ae-52dfbd8b8588] Instance event wait completed in 0 seconds for  {{(pid=75045) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 23:28:21 user nova-compute[75045]: INFO nova.virt.libvirt.driver [-] [instance: 83d225e0-e39e-4500-b7ae-52dfbd8b8588] Instance running successfully.
Nov 08 23:28:21 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-31751176-347d-42ce-b2e6-ed798b738377 tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] [instance: 83d225e0-e39e-4500-b7ae-52dfbd8b8588] finish_revert_migration finished successfully. {{(pid=75045) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11863}}
Nov 08 23:28:21 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:28:21 user nova-compute[75045]: DEBUG nova.compute.manager [None req-e9261792-a27e-4cfb-a8c1-98c3381324a0 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] [instance: 1a3c21c4-2db3-44e1-8a23-336ca9f8374d] Instance event wait completed in 0 seconds for  {{(pid=75045) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 23:28:21 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-e9261792-a27e-4cfb-a8c1-98c3381324a0 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] [instance: 1a3c21c4-2db3-44e1-8a23-336ca9f8374d] Guest created on hypervisor {{(pid=75045) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 23:28:21 user nova-compute[75045]: INFO nova.virt.libvirt.driver [-] [instance: 1a3c21c4-2db3-44e1-8a23-336ca9f8374d] Instance spawned successfully.
Nov 08 23:28:21 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-e9261792-a27e-4cfb-a8c1-98c3381324a0 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] [instance: 1a3c21c4-2db3-44e1-8a23-336ca9f8374d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75045) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 23:28:21 user nova-compute[75045]: INFO nova.compute.manager [None req-31751176-347d-42ce-b2e6-ed798b738377 tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] [instance: 83d225e0-e39e-4500-b7ae-52dfbd8b8588] Updating instance to original state: 'active'
Nov 08 23:28:21 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-e9261792-a27e-4cfb-a8c1-98c3381324a0 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] [instance: 1a3c21c4-2db3-44e1-8a23-336ca9f8374d] Found default for hw_cdrom_bus of ide {{(pid=75045) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 23:28:21 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-e9261792-a27e-4cfb-a8c1-98c3381324a0 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] [instance: 1a3c21c4-2db3-44e1-8a23-336ca9f8374d] Found default for hw_disk_bus of virtio {{(pid=75045) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 23:28:21 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-e9261792-a27e-4cfb-a8c1-98c3381324a0 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] [instance: 1a3c21c4-2db3-44e1-8a23-336ca9f8374d] Found default for hw_input_bus of None {{(pid=75045) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 23:28:21 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-e9261792-a27e-4cfb-a8c1-98c3381324a0 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] [instance: 1a3c21c4-2db3-44e1-8a23-336ca9f8374d] Found default for hw_pointer_model of None {{(pid=75045) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 23:28:21 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-e9261792-a27e-4cfb-a8c1-98c3381324a0 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] [instance: 1a3c21c4-2db3-44e1-8a23-336ca9f8374d] Found default for hw_video_model of virtio {{(pid=75045) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 23:28:21 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-e9261792-a27e-4cfb-a8c1-98c3381324a0 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] [instance: 1a3c21c4-2db3-44e1-8a23-336ca9f8374d] Found default for hw_vif_model of virtio {{(pid=75045) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 23:28:21 user nova-compute[75045]: INFO nova.compute.manager [None req-e9261792-a27e-4cfb-a8c1-98c3381324a0 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] [instance: 1a3c21c4-2db3-44e1-8a23-336ca9f8374d] Took 6.32 seconds to spawn the instance on the hypervisor.
Nov 08 23:28:21 user nova-compute[75045]: DEBUG nova.compute.manager [None req-e9261792-a27e-4cfb-a8c1-98c3381324a0 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] [instance: 1a3c21c4-2db3-44e1-8a23-336ca9f8374d] Checking state {{(pid=75045) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 23:28:21 user nova-compute[75045]: INFO nova.compute.manager [None req-e9261792-a27e-4cfb-a8c1-98c3381324a0 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] [instance: 1a3c21c4-2db3-44e1-8a23-336ca9f8374d] Took 7.30 seconds to build instance.
Nov 08 23:28:21 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-e9261792-a27e-4cfb-a8c1-98c3381324a0 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Lock "1a3c21c4-2db3-44e1-8a23-336ca9f8374d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.401s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:28:21 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:28:26 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:28:26 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-e890b869-9ff2-499b-90b9-13b14f66f2d5 tempest-VolumesAdminNegativeTest-215528111 tempest-VolumesAdminNegativeTest-215528111-project-member] Acquiring lock "e480a3c8-a7bc-4eea-b45f-d51f5b68ac0c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:28:26 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-e890b869-9ff2-499b-90b9-13b14f66f2d5 tempest-VolumesAdminNegativeTest-215528111 tempest-VolumesAdminNegativeTest-215528111-project-member] Lock "e480a3c8-a7bc-4eea-b45f-d51f5b68ac0c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:28:26 user nova-compute[75045]: DEBUG nova.compute.manager [None req-e890b869-9ff2-499b-90b9-13b14f66f2d5 tempest-VolumesAdminNegativeTest-215528111 tempest-VolumesAdminNegativeTest-215528111-project-member] [instance: e480a3c8-a7bc-4eea-b45f-d51f5b68ac0c] Starting instance... {{(pid=75045) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 23:28:26 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:28:27 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-e890b869-9ff2-499b-90b9-13b14f66f2d5 tempest-VolumesAdminNegativeTest-215528111 tempest-VolumesAdminNegativeTest-215528111-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:28:27 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-e890b869-9ff2-499b-90b9-13b14f66f2d5 tempest-VolumesAdminNegativeTest-215528111 tempest-VolumesAdminNegativeTest-215528111-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:28:27 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-e890b869-9ff2-499b-90b9-13b14f66f2d5 tempest-VolumesAdminNegativeTest-215528111 tempest-VolumesAdminNegativeTest-215528111-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75045) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 23:28:27 user nova-compute[75045]: INFO nova.compute.claims [None req-e890b869-9ff2-499b-90b9-13b14f66f2d5 tempest-VolumesAdminNegativeTest-215528111 tempest-VolumesAdminNegativeTest-215528111-project-member] [instance: e480a3c8-a7bc-4eea-b45f-d51f5b68ac0c] Claim successful on node user
Nov 08 23:28:27 user nova-compute[75045]: DEBUG nova.compute.provider_tree [None req-e890b869-9ff2-499b-90b9-13b14f66f2d5 tempest-VolumesAdminNegativeTest-215528111 tempest-VolumesAdminNegativeTest-215528111-project-member] Inventory has not changed in ProviderTree for provider: 62ba5f85-c74d-4b58-986e-d4197e813fd7 {{(pid=75045) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 23:28:27 user nova-compute[75045]: DEBUG nova.scheduler.client.report [None req-e890b869-9ff2-499b-90b9-13b14f66f2d5 tempest-VolumesAdminNegativeTest-215528111 tempest-VolumesAdminNegativeTest-215528111-project-member] Inventory has not changed for provider 62ba5f85-c74d-4b58-986e-d4197e813fd7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75045) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 23:28:27 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-e890b869-9ff2-499b-90b9-13b14f66f2d5 tempest-VolumesAdminNegativeTest-215528111 tempest-VolumesAdminNegativeTest-215528111-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.779s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:28:27 user nova-compute[75045]: DEBUG nova.compute.manager [None req-e890b869-9ff2-499b-90b9-13b14f66f2d5 tempest-VolumesAdminNegativeTest-215528111 tempest-VolumesAdminNegativeTest-215528111-project-member] [instance: e480a3c8-a7bc-4eea-b45f-d51f5b68ac0c] Start building networks asynchronously for instance. {{(pid=75045) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 23:28:27 user nova-compute[75045]: DEBUG nova.compute.manager [None req-e890b869-9ff2-499b-90b9-13b14f66f2d5 tempest-VolumesAdminNegativeTest-215528111 tempest-VolumesAdminNegativeTest-215528111-project-member] [instance: e480a3c8-a7bc-4eea-b45f-d51f5b68ac0c] Allocating IP information in the background. {{(pid=75045) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 23:28:27 user nova-compute[75045]: DEBUG nova.network.neutron [None req-e890b869-9ff2-499b-90b9-13b14f66f2d5 tempest-VolumesAdminNegativeTest-215528111 tempest-VolumesAdminNegativeTest-215528111-project-member] [instance: e480a3c8-a7bc-4eea-b45f-d51f5b68ac0c] allocate_for_instance() {{(pid=75045) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 23:28:27 user nova-compute[75045]: INFO nova.virt.libvirt.driver [None req-e890b869-9ff2-499b-90b9-13b14f66f2d5 tempest-VolumesAdminNegativeTest-215528111 tempest-VolumesAdminNegativeTest-215528111-project-member] [instance: e480a3c8-a7bc-4eea-b45f-d51f5b68ac0c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 23:28:28 user nova-compute[75045]: DEBUG nova.compute.manager [None req-e890b869-9ff2-499b-90b9-13b14f66f2d5 tempest-VolumesAdminNegativeTest-215528111 tempest-VolumesAdminNegativeTest-215528111-project-member] [instance: e480a3c8-a7bc-4eea-b45f-d51f5b68ac0c] Start building block device mappings for instance. {{(pid=75045) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 23:28:28 user nova-compute[75045]: DEBUG nova.policy [None req-e890b869-9ff2-499b-90b9-13b14f66f2d5 tempest-VolumesAdminNegativeTest-215528111 tempest-VolumesAdminNegativeTest-215528111-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8e1203c75e084399aa70a7da8546b122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd25d9a8d6af45bb97e0555101d61489', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75045) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 23:28:28 user nova-compute[75045]: DEBUG nova.compute.manager [None req-e890b869-9ff2-499b-90b9-13b14f66f2d5 tempest-VolumesAdminNegativeTest-215528111 tempest-VolumesAdminNegativeTest-215528111-project-member] [instance: e480a3c8-a7bc-4eea-b45f-d51f5b68ac0c] Start spawning the instance on the hypervisor. {{(pid=75045) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 23:28:28 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-e890b869-9ff2-499b-90b9-13b14f66f2d5 tempest-VolumesAdminNegativeTest-215528111 tempest-VolumesAdminNegativeTest-215528111-project-member] [instance: e480a3c8-a7bc-4eea-b45f-d51f5b68ac0c] Creating instance directory {{(pid=75045) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 23:28:28 user nova-compute[75045]: INFO nova.virt.libvirt.driver [None req-e890b869-9ff2-499b-90b9-13b14f66f2d5 tempest-VolumesAdminNegativeTest-215528111 tempest-VolumesAdminNegativeTest-215528111-project-member] [instance: e480a3c8-a7bc-4eea-b45f-d51f5b68ac0c] Creating image(s)
Nov 08 23:28:28 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-e890b869-9ff2-499b-90b9-13b14f66f2d5 tempest-VolumesAdminNegativeTest-215528111 tempest-VolumesAdminNegativeTest-215528111-project-member] Acquiring lock "/opt/stack/data/nova/instances/e480a3c8-a7bc-4eea-b45f-d51f5b68ac0c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:28:28 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-e890b869-9ff2-499b-90b9-13b14f66f2d5 tempest-VolumesAdminNegativeTest-215528111 tempest-VolumesAdminNegativeTest-215528111-project-member] Lock "/opt/stack/data/nova/instances/e480a3c8-a7bc-4eea-b45f-d51f5b68ac0c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:28:28 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-e890b869-9ff2-499b-90b9-13b14f66f2d5 tempest-VolumesAdminNegativeTest-215528111 tempest-VolumesAdminNegativeTest-215528111-project-member] Lock "/opt/stack/data/nova/instances/e480a3c8-a7bc-4eea-b45f-d51f5b68ac0c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:28:28 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-e890b869-9ff2-499b-90b9-13b14f66f2d5 tempest-VolumesAdminNegativeTest-215528111 tempest-VolumesAdminNegativeTest-215528111-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b59f52a99fff51c56dd1edfb83892fb8f647f2f3 --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:28:28 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-e890b869-9ff2-499b-90b9-13b14f66f2d5 tempest-VolumesAdminNegativeTest-215528111 tempest-VolumesAdminNegativeTest-215528111-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b59f52a99fff51c56dd1edfb83892fb8f647f2f3 --force-share --output=json" returned: 0 in 0.213s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:28:28 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-e890b869-9ff2-499b-90b9-13b14f66f2d5 tempest-VolumesAdminNegativeTest-215528111 tempest-VolumesAdminNegativeTest-215528111-project-member] Acquiring lock "b59f52a99fff51c56dd1edfb83892fb8f647f2f3" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:28:28 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-e890b869-9ff2-499b-90b9-13b14f66f2d5 tempest-VolumesAdminNegativeTest-215528111 tempest-VolumesAdminNegativeTest-215528111-project-member] Lock "b59f52a99fff51c56dd1edfb83892fb8f647f2f3" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:28:28 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-e890b869-9ff2-499b-90b9-13b14f66f2d5 tempest-VolumesAdminNegativeTest-215528111 tempest-VolumesAdminNegativeTest-215528111-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b59f52a99fff51c56dd1edfb83892fb8f647f2f3 --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:28:28 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-e890b869-9ff2-499b-90b9-13b14f66f2d5 tempest-VolumesAdminNegativeTest-215528111 tempest-VolumesAdminNegativeTest-215528111-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b59f52a99fff51c56dd1edfb83892fb8f647f2f3 --force-share --output=json" returned: 0 in 0.211s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:28:28 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-e890b869-9ff2-499b-90b9-13b14f66f2d5 tempest-VolumesAdminNegativeTest-215528111 tempest-VolumesAdminNegativeTest-215528111-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b59f52a99fff51c56dd1edfb83892fb8f647f2f3,backing_fmt=raw /opt/stack/data/nova/instances/e480a3c8-a7bc-4eea-b45f-d51f5b68ac0c/disk 1073741824 {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:28:28 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-e890b869-9ff2-499b-90b9-13b14f66f2d5 tempest-VolumesAdminNegativeTest-215528111 tempest-VolumesAdminNegativeTest-215528111-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b59f52a99fff51c56dd1edfb83892fb8f647f2f3,backing_fmt=raw /opt/stack/data/nova/instances/e480a3c8-a7bc-4eea-b45f-d51f5b68ac0c/disk 1073741824" returned: 0 in 0.121s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:28:28 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-e890b869-9ff2-499b-90b9-13b14f66f2d5 tempest-VolumesAdminNegativeTest-215528111 tempest-VolumesAdminNegativeTest-215528111-project-member] Lock "b59f52a99fff51c56dd1edfb83892fb8f647f2f3" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.342s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:28:28 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-e890b869-9ff2-499b-90b9-13b14f66f2d5 tempest-VolumesAdminNegativeTest-215528111 tempest-VolumesAdminNegativeTest-215528111-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b59f52a99fff51c56dd1edfb83892fb8f647f2f3 --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:28:28 user nova-compute[75045]: DEBUG nova.network.neutron [None req-e890b869-9ff2-499b-90b9-13b14f66f2d5 tempest-VolumesAdminNegativeTest-215528111 tempest-VolumesAdminNegativeTest-215528111-project-member] [instance: e480a3c8-a7bc-4eea-b45f-d51f5b68ac0c] Successfully created port: 4e478658-1101-428c-b08a-cc4de5d107d0 {{(pid=75045) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 23:28:28 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-e890b869-9ff2-499b-90b9-13b14f66f2d5 tempest-VolumesAdminNegativeTest-215528111 tempest-VolumesAdminNegativeTest-215528111-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b59f52a99fff51c56dd1edfb83892fb8f647f2f3 --force-share --output=json" returned: 0 in 0.203s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:28:28 user nova-compute[75045]: DEBUG nova.virt.disk.api [None req-e890b869-9ff2-499b-90b9-13b14f66f2d5 tempest-VolumesAdminNegativeTest-215528111 tempest-VolumesAdminNegativeTest-215528111-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e480a3c8-a7bc-4eea-b45f-d51f5b68ac0c/disk. size=1073741824 {{(pid=75045) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 23:28:28 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-e890b869-9ff2-499b-90b9-13b14f66f2d5 tempest-VolumesAdminNegativeTest-215528111 tempest-VolumesAdminNegativeTest-215528111-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e480a3c8-a7bc-4eea-b45f-d51f5b68ac0c/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:28:29 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-e890b869-9ff2-499b-90b9-13b14f66f2d5 tempest-VolumesAdminNegativeTest-215528111 tempest-VolumesAdminNegativeTest-215528111-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e480a3c8-a7bc-4eea-b45f-d51f5b68ac0c/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:28:29 user nova-compute[75045]: DEBUG nova.virt.disk.api [None req-e890b869-9ff2-499b-90b9-13b14f66f2d5 tempest-VolumesAdminNegativeTest-215528111 tempest-VolumesAdminNegativeTest-215528111-project-member] Cannot resize image /opt/stack/data/nova/instances/e480a3c8-a7bc-4eea-b45f-d51f5b68ac0c/disk to a smaller size. {{(pid=75045) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 08 23:28:29 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-e890b869-9ff2-499b-90b9-13b14f66f2d5 tempest-VolumesAdminNegativeTest-215528111 tempest-VolumesAdminNegativeTest-215528111-project-member] [instance: e480a3c8-a7bc-4eea-b45f-d51f5b68ac0c] Created local disks {{(pid=75045) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 23:28:29 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-e890b869-9ff2-499b-90b9-13b14f66f2d5 tempest-VolumesAdminNegativeTest-215528111 tempest-VolumesAdminNegativeTest-215528111-project-member] [instance: e480a3c8-a7bc-4eea-b45f-d51f5b68ac0c] Ensure instance console log exists: /opt/stack/data/nova/instances/e480a3c8-a7bc-4eea-b45f-d51f5b68ac0c/console.log {{(pid=75045) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 23:28:29 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-e890b869-9ff2-499b-90b9-13b14f66f2d5 tempest-VolumesAdminNegativeTest-215528111 tempest-VolumesAdminNegativeTest-215528111-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:28:29 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-e890b869-9ff2-499b-90b9-13b14f66f2d5 tempest-VolumesAdminNegativeTest-215528111 tempest-VolumesAdminNegativeTest-215528111-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:28:29 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-e890b869-9ff2-499b-90b9-13b14f66f2d5 tempest-VolumesAdminNegativeTest-215528111 tempest-VolumesAdminNegativeTest-215528111-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:28:29 user nova-compute[75045]: DEBUG nova.network.neutron [None req-e890b869-9ff2-499b-90b9-13b14f66f2d5 tempest-VolumesAdminNegativeTest-215528111 tempest-VolumesAdminNegativeTest-215528111-project-member] [instance: e480a3c8-a7bc-4eea-b45f-d51f5b68ac0c] Successfully updated port: 4e478658-1101-428c-b08a-cc4de5d107d0 {{(pid=75045) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 23:28:29 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-e890b869-9ff2-499b-90b9-13b14f66f2d5 tempest-VolumesAdminNegativeTest-215528111 tempest-VolumesAdminNegativeTest-215528111-project-member] Acquiring lock "refresh_cache-e480a3c8-a7bc-4eea-b45f-d51f5b68ac0c" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 23:28:29 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-e890b869-9ff2-499b-90b9-13b14f66f2d5 tempest-VolumesAdminNegativeTest-215528111 tempest-VolumesAdminNegativeTest-215528111-project-member] Acquired lock "refresh_cache-e480a3c8-a7bc-4eea-b45f-d51f5b68ac0c" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 23:28:29 user nova-compute[75045]: DEBUG nova.network.neutron [None req-e890b869-9ff2-499b-90b9-13b14f66f2d5 tempest-VolumesAdminNegativeTest-215528111 tempest-VolumesAdminNegativeTest-215528111-project-member] [instance: e480a3c8-a7bc-4eea-b45f-d51f5b68ac0c] Building network info cache for instance {{(pid=75045) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 23:28:29 user nova-compute[75045]: DEBUG nova.compute.manager [req-280b7936-d296-451c-a051-440a892d8023 req-f0c986ac-b495-4bc9-a7d1-5bae2596ec43 service nova] [instance: e480a3c8-a7bc-4eea-b45f-d51f5b68ac0c] Received event network-changed-4e478658-1101-428c-b08a-cc4de5d107d0 {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:28:29 user nova-compute[75045]: DEBUG nova.compute.manager [req-280b7936-d296-451c-a051-440a892d8023 req-f0c986ac-b495-4bc9-a7d1-5bae2596ec43 service nova] [instance: e480a3c8-a7bc-4eea-b45f-d51f5b68ac0c] Refreshing instance network info cache due to event network-changed-4e478658-1101-428c-b08a-cc4de5d107d0. {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 23:28:29 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-280b7936-d296-451c-a051-440a892d8023 req-f0c986ac-b495-4bc9-a7d1-5bae2596ec43 service nova] Acquiring lock "refresh_cache-e480a3c8-a7bc-4eea-b45f-d51f5b68ac0c" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 23:28:29 user nova-compute[75045]: DEBUG nova.network.neutron [None req-e890b869-9ff2-499b-90b9-13b14f66f2d5 tempest-VolumesAdminNegativeTest-215528111 tempest-VolumesAdminNegativeTest-215528111-project-member] [instance: e480a3c8-a7bc-4eea-b45f-d51f5b68ac0c] Instance cache missing network info. {{(pid=75045) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 23:28:30 user nova-compute[75045]: DEBUG nova.network.neutron [None req-e890b869-9ff2-499b-90b9-13b14f66f2d5 tempest-VolumesAdminNegativeTest-215528111 tempest-VolumesAdminNegativeTest-215528111-project-member] [instance: e480a3c8-a7bc-4eea-b45f-d51f5b68ac0c] Updating instance_info_cache with network_info: [{"id": "4e478658-1101-428c-b08a-cc4de5d107d0", "address": "fa:16:3e:14:7d:ea", "network": {"id": "e7c66e39-e1ba-4907-8701-33ae849858b2", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-420335537-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd25d9a8d6af45bb97e0555101d61489", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e478658-11", "ovs_interfaceid": "4e478658-1101-428c-b08a-cc4de5d107d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75045) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 23:28:30 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-e890b869-9ff2-499b-90b9-13b14f66f2d5 tempest-VolumesAdminNegativeTest-215528111 tempest-VolumesAdminNegativeTest-215528111-project-member] Releasing lock "refresh_cache-e480a3c8-a7bc-4eea-b45f-d51f5b68ac0c" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 23:28:30 user nova-compute[75045]: DEBUG nova.compute.manager [None req-e890b869-9ff2-499b-90b9-13b14f66f2d5 tempest-VolumesAdminNegativeTest-215528111 tempest-VolumesAdminNegativeTest-215528111-project-member] [instance: e480a3c8-a7bc-4eea-b45f-d51f5b68ac0c] Instance network_info: |[{"id": "4e478658-1101-428c-b08a-cc4de5d107d0", "address": "fa:16:3e:14:7d:ea", "network": {"id": "e7c66e39-e1ba-4907-8701-33ae849858b2", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-420335537-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd25d9a8d6af45bb97e0555101d61489", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e478658-11", "ovs_interfaceid": "4e478658-1101-428c-b08a-cc4de5d107d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75045) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 23:28:30 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-280b7936-d296-451c-a051-440a892d8023 req-f0c986ac-b495-4bc9-a7d1-5bae2596ec43 service nova] Acquired lock "refresh_cache-e480a3c8-a7bc-4eea-b45f-d51f5b68ac0c" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 23:28:30 user nova-compute[75045]: DEBUG nova.network.neutron [req-280b7936-d296-451c-a051-440a892d8023 req-f0c986ac-b495-4bc9-a7d1-5bae2596ec43 service nova] [instance: e480a3c8-a7bc-4eea-b45f-d51f5b68ac0c] Refreshing network info cache for port 4e478658-1101-428c-b08a-cc4de5d107d0 {{(pid=75045) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 23:28:30 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-e890b869-9ff2-499b-90b9-13b14f66f2d5 tempest-VolumesAdminNegativeTest-215528111 tempest-VolumesAdminNegativeTest-215528111-project-member] [instance: e480a3c8-a7bc-4eea-b45f-d51f5b68ac0c] Start _get_guest_xml network_info=[{"id": "4e478658-1101-428c-b08a-cc4de5d107d0", "address": "fa:16:3e:14:7d:ea", "network": {"id": "e7c66e39-e1ba-4907-8701-33ae849858b2", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-420335537-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd25d9a8d6af45bb97e0555101d61489", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e478658-11", "ovs_interfaceid": "4e478658-1101-428c-b08a-cc4de5d107d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T23:11:54Z,direct_url=<?>,disk_format='qcow2',id=a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b1beba2cc4e7465ea249e2225fb494dc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T23:11:56Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'disk_bus': 'virtio', 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': 'a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75045) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 23:28:30 user nova-compute[75045]: WARNING nova.virt.libvirt.driver [None req-e890b869-9ff2-499b-90b9-13b14f66f2d5 tempest-VolumesAdminNegativeTest-215528111 tempest-VolumesAdminNegativeTest-215528111-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 23:28:30 user nova-compute[75045]: WARNING nova.virt.libvirt.driver [None req-e890b869-9ff2-499b-90b9-13b14f66f2d5 tempest-VolumesAdminNegativeTest-215528111 tempest-VolumesAdminNegativeTest-215528111-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 23:28:30 user nova-compute[75045]: DEBUG nova.virt.libvirt.host [None req-e890b869-9ff2-499b-90b9-13b14f66f2d5 tempest-VolumesAdminNegativeTest-215528111 tempest-VolumesAdminNegativeTest-215528111-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75045) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 23:28:30 user nova-compute[75045]: DEBUG nova.virt.libvirt.host [None req-e890b869-9ff2-499b-90b9-13b14f66f2d5 tempest-VolumesAdminNegativeTest-215528111 tempest-VolumesAdminNegativeTest-215528111-project-member] CPU controller missing on host. {{(pid=75045) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 23:28:30 user nova-compute[75045]: DEBUG nova.virt.libvirt.host [None req-e890b869-9ff2-499b-90b9-13b14f66f2d5 tempest-VolumesAdminNegativeTest-215528111 tempest-VolumesAdminNegativeTest-215528111-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75045) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 23:28:30 user nova-compute[75045]: DEBUG nova.virt.libvirt.host [None req-e890b869-9ff2-499b-90b9-13b14f66f2d5 tempest-VolumesAdminNegativeTest-215528111 tempest-VolumesAdminNegativeTest-215528111-project-member] CPU controller found on host. {{(pid=75045) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 23:28:30 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-e890b869-9ff2-499b-90b9-13b14f66f2d5 tempest-VolumesAdminNegativeTest-215528111 tempest-VolumesAdminNegativeTest-215528111-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75045) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 23:28:30 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-e890b869-9ff2-499b-90b9-13b14f66f2d5 tempest-VolumesAdminNegativeTest-215528111 tempest-VolumesAdminNegativeTest-215528111-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T23:11:41Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T23:11:54Z,direct_url=<?>,disk_format='qcow2',id=a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b1beba2cc4e7465ea249e2225fb494dc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T23:11:56Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75045) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 23:28:30 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-e890b869-9ff2-499b-90b9-13b14f66f2d5 tempest-VolumesAdminNegativeTest-215528111 tempest-VolumesAdminNegativeTest-215528111-project-member] Flavor limits 0:0:0 {{(pid=75045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 23:28:30 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-e890b869-9ff2-499b-90b9-13b14f66f2d5 tempest-VolumesAdminNegativeTest-215528111 tempest-VolumesAdminNegativeTest-215528111-project-member] Image limits 0:0:0 {{(pid=75045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 23:28:30 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-e890b869-9ff2-499b-90b9-13b14f66f2d5 tempest-VolumesAdminNegativeTest-215528111 tempest-VolumesAdminNegativeTest-215528111-project-member] Flavor pref 0:0:0 {{(pid=75045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 23:28:30 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-e890b869-9ff2-499b-90b9-13b14f66f2d5 tempest-VolumesAdminNegativeTest-215528111 tempest-VolumesAdminNegativeTest-215528111-project-member] Image pref 0:0:0 {{(pid=75045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 23:28:30 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-e890b869-9ff2-499b-90b9-13b14f66f2d5 tempest-VolumesAdminNegativeTest-215528111 tempest-VolumesAdminNegativeTest-215528111-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 23:28:30 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-e890b869-9ff2-499b-90b9-13b14f66f2d5 tempest-VolumesAdminNegativeTest-215528111 tempest-VolumesAdminNegativeTest-215528111-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75045) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 23:28:30 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-e890b869-9ff2-499b-90b9-13b14f66f2d5 tempest-VolumesAdminNegativeTest-215528111 tempest-VolumesAdminNegativeTest-215528111-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75045) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 23:28:30 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-e890b869-9ff2-499b-90b9-13b14f66f2d5 tempest-VolumesAdminNegativeTest-215528111 tempest-VolumesAdminNegativeTest-215528111-project-member] Got 1 possible topologies {{(pid=75045) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 23:28:30 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-e890b869-9ff2-499b-90b9-13b14f66f2d5 tempest-VolumesAdminNegativeTest-215528111 tempest-VolumesAdminNegativeTest-215528111-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75045) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 23:28:30 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-e890b869-9ff2-499b-90b9-13b14f66f2d5 tempest-VolumesAdminNegativeTest-215528111 tempest-VolumesAdminNegativeTest-215528111-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75045) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 23:28:30 user nova-compute[75045]: DEBUG nova.virt.libvirt.vif [None req-e890b869-9ff2-499b-90b9-13b14f66f2d5 tempest-VolumesAdminNegativeTest-215528111 tempest-VolumesAdminNegativeTest-215528111-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T23:28:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1288858055',display_name='tempest-VolumesAdminNegativeTest-server-1288858055',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1288858055',id=29,image_ref='a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fd25d9a8d6af45bb97e0555101d61489',ramdisk_id='',reservation_id='r-a40op7uo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-215528111',owner_user_name='tempest-VolumesAdminNegativeTest-215528111-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T23:28:28Z,user_data=None,user_id='8e1203c75e084399aa70a7da8546b122',uuid=e480a3c8-a7bc-4eea-b45f-d51f5b68ac0c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4e478658-1101-428c-b08a-cc4de5d107d0", "address": "fa:16:3e:14:7d:ea", "network": {"id": "e7c66e39-e1ba-4907-8701-33ae849858b2", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-420335537-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd25d9a8d6af45bb97e0555101d61489", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e478658-11", "ovs_interfaceid": "4e478658-1101-428c-b08a-cc4de5d107d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75045) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 23:28:30 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-e890b869-9ff2-499b-90b9-13b14f66f2d5 tempest-VolumesAdminNegativeTest-215528111 tempest-VolumesAdminNegativeTest-215528111-project-member] Converting VIF {"id": "4e478658-1101-428c-b08a-cc4de5d107d0", "address": "fa:16:3e:14:7d:ea", "network": {"id": "e7c66e39-e1ba-4907-8701-33ae849858b2", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-420335537-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd25d9a8d6af45bb97e0555101d61489", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e478658-11", "ovs_interfaceid": "4e478658-1101-428c-b08a-cc4de5d107d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 23:28:30 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-e890b869-9ff2-499b-90b9-13b14f66f2d5 tempest-VolumesAdminNegativeTest-215528111 tempest-VolumesAdminNegativeTest-215528111-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:14:7d:ea,bridge_name='br-int',has_traffic_filtering=True,id=4e478658-1101-428c-b08a-cc4de5d107d0,network=Network(e7c66e39-e1ba-4907-8701-33ae849858b2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4e478658-11') {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 23:28:30 user nova-compute[75045]: DEBUG nova.objects.instance [None req-e890b869-9ff2-499b-90b9-13b14f66f2d5 tempest-VolumesAdminNegativeTest-215528111 tempest-VolumesAdminNegativeTest-215528111-project-member] Lazy-loading 'pci_devices' on Instance uuid e480a3c8-a7bc-4eea-b45f-d51f5b68ac0c {{(pid=75045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 23:28:30 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-e890b869-9ff2-499b-90b9-13b14f66f2d5 tempest-VolumesAdminNegativeTest-215528111 tempest-VolumesAdminNegativeTest-215528111-project-member] [instance: e480a3c8-a7bc-4eea-b45f-d51f5b68ac0c] End _get_guest_xml xml=<domain type="kvm">
Nov 08 23:28:30 user nova-compute[75045]:   <uuid>e480a3c8-a7bc-4eea-b45f-d51f5b68ac0c</uuid>
Nov 08 23:28:30 user nova-compute[75045]:   <name>instance-0000001d</name>
Nov 08 23:28:30 user nova-compute[75045]:   <memory>524288</memory>
Nov 08 23:28:30 user nova-compute[75045]:   <vcpu>1</vcpu>
Nov 08 23:28:30 user nova-compute[75045]:   <metadata>
Nov 08 23:28:30 user nova-compute[75045]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 23:28:30 user nova-compute[75045]:       <nova:package version="0.0.0"/>
Nov 08 23:28:30 user nova-compute[75045]:       <nova:name>tempest-VolumesAdminNegativeTest-server-1288858055</nova:name>
Nov 08 23:28:30 user nova-compute[75045]:       <nova:creationTime>2023-11-08 23:28:30</nova:creationTime>
Nov 08 23:28:30 user nova-compute[75045]:       <nova:flavor name="m1.tiny">
Nov 08 23:28:30 user nova-compute[75045]:         <nova:memory>512</nova:memory>
Nov 08 23:28:30 user nova-compute[75045]:         <nova:disk>1</nova:disk>
Nov 08 23:28:30 user nova-compute[75045]:         <nova:swap>0</nova:swap>
Nov 08 23:28:30 user nova-compute[75045]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 23:28:30 user nova-compute[75045]:         <nova:vcpus>1</nova:vcpus>
Nov 08 23:28:30 user nova-compute[75045]:       </nova:flavor>
Nov 08 23:28:30 user nova-compute[75045]:       <nova:owner>
Nov 08 23:28:30 user nova-compute[75045]:         <nova:user uuid="8e1203c75e084399aa70a7da8546b122">tempest-VolumesAdminNegativeTest-215528111-project-member</nova:user>
Nov 08 23:28:30 user nova-compute[75045]:         <nova:project uuid="fd25d9a8d6af45bb97e0555101d61489">tempest-VolumesAdminNegativeTest-215528111</nova:project>
Nov 08 23:28:30 user nova-compute[75045]:       </nova:owner>
Nov 08 23:28:30 user nova-compute[75045]:       <nova:root type="image" uuid="a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb"/>
Nov 08 23:28:30 user nova-compute[75045]:       <nova:ports>
Nov 08 23:28:30 user nova-compute[75045]:         <nova:port uuid="4e478658-1101-428c-b08a-cc4de5d107d0">
Nov 08 23:28:30 user nova-compute[75045]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 08 23:28:30 user nova-compute[75045]:         </nova:port>
Nov 08 23:28:30 user nova-compute[75045]:       </nova:ports>
Nov 08 23:28:30 user nova-compute[75045]:     </nova:instance>
Nov 08 23:28:30 user nova-compute[75045]:   </metadata>
Nov 08 23:28:30 user nova-compute[75045]:   <sysinfo type="smbios">
Nov 08 23:28:30 user nova-compute[75045]:     <system>
Nov 08 23:28:30 user nova-compute[75045]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 23:28:30 user nova-compute[75045]:       <entry name="product">OpenStack Nova</entry>
Nov 08 23:28:30 user nova-compute[75045]:       <entry name="version">0.0.0</entry>
Nov 08 23:28:30 user nova-compute[75045]:       <entry name="serial">e480a3c8-a7bc-4eea-b45f-d51f5b68ac0c</entry>
Nov 08 23:28:30 user nova-compute[75045]:       <entry name="uuid">e480a3c8-a7bc-4eea-b45f-d51f5b68ac0c</entry>
Nov 08 23:28:30 user nova-compute[75045]:       <entry name="family">Virtual Machine</entry>
Nov 08 23:28:30 user nova-compute[75045]:     </system>
Nov 08 23:28:30 user nova-compute[75045]:   </sysinfo>
Nov 08 23:28:30 user nova-compute[75045]:   <os>
Nov 08 23:28:30 user nova-compute[75045]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 23:28:30 user nova-compute[75045]:     <boot dev="hd"/>
Nov 08 23:28:30 user nova-compute[75045]:     <smbios mode="sysinfo"/>
Nov 08 23:28:30 user nova-compute[75045]:   </os>
Nov 08 23:28:30 user nova-compute[75045]:   <features>
Nov 08 23:28:30 user nova-compute[75045]:     <acpi/>
Nov 08 23:28:30 user nova-compute[75045]:     <apic/>
Nov 08 23:28:30 user nova-compute[75045]:     <vmcoreinfo/>
Nov 08 23:28:30 user nova-compute[75045]:   </features>
Nov 08 23:28:30 user nova-compute[75045]:   <clock offset="utc">
Nov 08 23:28:30 user nova-compute[75045]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 23:28:30 user nova-compute[75045]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 23:28:30 user nova-compute[75045]:     <timer name="hpet" present="no"/>
Nov 08 23:28:30 user nova-compute[75045]:   </clock>
Nov 08 23:28:30 user nova-compute[75045]:   <cpu mode="custom" match="exact">
Nov 08 23:28:30 user nova-compute[75045]:     <model>Nehalem</model>
Nov 08 23:28:30 user nova-compute[75045]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 23:28:30 user nova-compute[75045]:   </cpu>
Nov 08 23:28:30 user nova-compute[75045]:   <devices>
Nov 08 23:28:30 user nova-compute[75045]:     <disk type="file" device="disk">
Nov 08 23:28:30 user nova-compute[75045]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 23:28:30 user nova-compute[75045]:       <source file="/opt/stack/data/nova/instances/e480a3c8-a7bc-4eea-b45f-d51f5b68ac0c/disk"/>
Nov 08 23:28:30 user nova-compute[75045]:       <target dev="vda" bus="virtio"/>
Nov 08 23:28:30 user nova-compute[75045]:     </disk>
Nov 08 23:28:30 user nova-compute[75045]:     <interface type="ethernet">
Nov 08 23:28:30 user nova-compute[75045]:       <mac address="fa:16:3e:14:7d:ea"/>
Nov 08 23:28:30 user nova-compute[75045]:       <model type="virtio"/>
Nov 08 23:28:30 user nova-compute[75045]:       <mtu size="1442"/>
Nov 08 23:28:30 user nova-compute[75045]:       <target dev="tap4e478658-11"/>
Nov 08 23:28:30 user nova-compute[75045]:     </interface>
Nov 08 23:28:30 user nova-compute[75045]:     <serial type="pty">
Nov 08 23:28:30 user nova-compute[75045]:       <log file="/opt/stack/data/nova/instances/e480a3c8-a7bc-4eea-b45f-d51f5b68ac0c/console.log" append="off"/>
Nov 08 23:28:30 user nova-compute[75045]:     </serial>
Nov 08 23:28:30 user nova-compute[75045]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 23:28:30 user nova-compute[75045]:     <video>
Nov 08 23:28:30 user nova-compute[75045]:       <model type="virtio"/>
Nov 08 23:28:30 user nova-compute[75045]:     </video>
Nov 08 23:28:30 user nova-compute[75045]:     <rng model="virtio">
Nov 08 23:28:30 user nova-compute[75045]:       <backend model="random">/dev/urandom</backend>
Nov 08 23:28:30 user nova-compute[75045]:     </rng>
Nov 08 23:28:30 user nova-compute[75045]:     <controller type="usb" index="0" model="none"/>
Nov 08 23:28:30 user nova-compute[75045]:     <memballoon model="virtio">
Nov 08 23:28:30 user nova-compute[75045]:       <stats period="10"/>
Nov 08 23:28:30 user nova-compute[75045]:     </memballoon>
Nov 08 23:28:30 user nova-compute[75045]:   </devices>
Nov 08 23:28:30 user nova-compute[75045]: </domain>
Nov 08 23:28:30 user nova-compute[75045]:  {{(pid=75045) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 23:28:30 user nova-compute[75045]: DEBUG nova.virt.libvirt.vif [None req-e890b869-9ff2-499b-90b9-13b14f66f2d5 tempest-VolumesAdminNegativeTest-215528111 tempest-VolumesAdminNegativeTest-215528111-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T23:28:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1288858055',display_name='tempest-VolumesAdminNegativeTest-server-1288858055',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1288858055',id=29,image_ref='a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fd25d9a8d6af45bb97e0555101d61489',ramdisk_id='',reservation_id='r-a40op7uo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-215528111',owner_user_name='tempest-VolumesAdminNegativeTest-215528111-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T23:28:28Z,user_data=None,user_id='8e1203c75e084399aa70a7da8546b122',uuid=e480a3c8-a7bc-4eea-b45f-d51f5b68ac0c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4e478658-1101-428c-b08a-cc4de5d107d0", "address": "fa:16:3e:14:7d:ea", "network": {"id": "e7c66e39-e1ba-4907-8701-33ae849858b2", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-420335537-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd25d9a8d6af45bb97e0555101d61489", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e478658-11", "ovs_interfaceid": "4e478658-1101-428c-b08a-cc4de5d107d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75045) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 23:28:30 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-e890b869-9ff2-499b-90b9-13b14f66f2d5 tempest-VolumesAdminNegativeTest-215528111 tempest-VolumesAdminNegativeTest-215528111-project-member] Converting VIF {"id": "4e478658-1101-428c-b08a-cc4de5d107d0", "address": "fa:16:3e:14:7d:ea", "network": {"id": "e7c66e39-e1ba-4907-8701-33ae849858b2", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-420335537-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd25d9a8d6af45bb97e0555101d61489", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e478658-11", "ovs_interfaceid": "4e478658-1101-428c-b08a-cc4de5d107d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 23:28:30 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-e890b869-9ff2-499b-90b9-13b14f66f2d5 tempest-VolumesAdminNegativeTest-215528111 tempest-VolumesAdminNegativeTest-215528111-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:14:7d:ea,bridge_name='br-int',has_traffic_filtering=True,id=4e478658-1101-428c-b08a-cc4de5d107d0,network=Network(e7c66e39-e1ba-4907-8701-33ae849858b2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4e478658-11') {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 23:28:30 user nova-compute[75045]: DEBUG os_vif [None req-e890b869-9ff2-499b-90b9-13b14f66f2d5 tempest-VolumesAdminNegativeTest-215528111 tempest-VolumesAdminNegativeTest-215528111-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:14:7d:ea,bridge_name='br-int',has_traffic_filtering=True,id=4e478658-1101-428c-b08a-cc4de5d107d0,network=Network(e7c66e39-e1ba-4907-8701-33ae849858b2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4e478658-11') {{(pid=75045) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 23:28:30 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:28:30 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:28:30 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 23:28:30 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:28:30 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '035119f2-c3c2-5477-b01b-c5de5ddfc25a', '_type': 'linux-noop'}}, row=False) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:28:30 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:28:30 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:28:30 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4e478658-11, may_exist=True, interface_attrs={}) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:28:30 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4e478658-11, col_values=(('qos', UUID('9a7a466b-8e09-44ae-bc6f-cdd619b29b7c')),), if_exists=True) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:28:30 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4e478658-11, col_values=(('external_ids', {'iface-id': '4e478658-1101-428c-b08a-cc4de5d107d0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:14:7d:ea', 'vm-uuid': 'e480a3c8-a7bc-4eea-b45f-d51f5b68ac0c'}),), if_exists=True) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:28:30 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 23:28:30 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:28:30 user nova-compute[75045]: INFO os_vif [None req-e890b869-9ff2-499b-90b9-13b14f66f2d5 tempest-VolumesAdminNegativeTest-215528111 tempest-VolumesAdminNegativeTest-215528111-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:14:7d:ea,bridge_name='br-int',has_traffic_filtering=True,id=4e478658-1101-428c-b08a-cc4de5d107d0,network=Network(e7c66e39-e1ba-4907-8701-33ae849858b2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4e478658-11')
Nov 08 23:28:30 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-e890b869-9ff2-499b-90b9-13b14f66f2d5 tempest-VolumesAdminNegativeTest-215528111 tempest-VolumesAdminNegativeTest-215528111-project-member] No BDM found with device name vda, not building metadata. {{(pid=75045) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 23:28:30 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-e890b869-9ff2-499b-90b9-13b14f66f2d5 tempest-VolumesAdminNegativeTest-215528111 tempest-VolumesAdminNegativeTest-215528111-project-member] No VIF found with MAC fa:16:3e:14:7d:ea, not building metadata {{(pid=75045) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 23:28:30 user nova-compute[75045]: DEBUG nova.network.neutron [req-280b7936-d296-451c-a051-440a892d8023 req-f0c986ac-b495-4bc9-a7d1-5bae2596ec43 service nova] [instance: e480a3c8-a7bc-4eea-b45f-d51f5b68ac0c] Updated VIF entry in instance network info cache for port 4e478658-1101-428c-b08a-cc4de5d107d0. {{(pid=75045) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 23:28:30 user nova-compute[75045]: DEBUG nova.network.neutron [req-280b7936-d296-451c-a051-440a892d8023 req-f0c986ac-b495-4bc9-a7d1-5bae2596ec43 service nova] [instance: e480a3c8-a7bc-4eea-b45f-d51f5b68ac0c] Updating instance_info_cache with network_info: [{"id": "4e478658-1101-428c-b08a-cc4de5d107d0", "address": "fa:16:3e:14:7d:ea", "network": {"id": "e7c66e39-e1ba-4907-8701-33ae849858b2", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-420335537-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd25d9a8d6af45bb97e0555101d61489", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e478658-11", "ovs_interfaceid": "4e478658-1101-428c-b08a-cc4de5d107d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75045) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 23:28:30 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-280b7936-d296-451c-a051-440a892d8023 req-f0c986ac-b495-4bc9-a7d1-5bae2596ec43 service nova] Releasing lock "refresh_cache-e480a3c8-a7bc-4eea-b45f-d51f5b68ac0c" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 23:28:31 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:28:31 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:28:31 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:28:31 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:28:31 user nova-compute[75045]: DEBUG nova.compute.manager [req-5e703990-5ed3-4ce6-8ab9-0a9d19a9e098 req-19baa2f6-be5b-4562-b3c8-8dccb06c72f7 service nova] [instance: e480a3c8-a7bc-4eea-b45f-d51f5b68ac0c] Received event network-vif-plugged-4e478658-1101-428c-b08a-cc4de5d107d0 {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:28:31 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-5e703990-5ed3-4ce6-8ab9-0a9d19a9e098 req-19baa2f6-be5b-4562-b3c8-8dccb06c72f7 service nova] Acquiring lock "e480a3c8-a7bc-4eea-b45f-d51f5b68ac0c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:28:31 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-5e703990-5ed3-4ce6-8ab9-0a9d19a9e098 req-19baa2f6-be5b-4562-b3c8-8dccb06c72f7 service nova] Lock "e480a3c8-a7bc-4eea-b45f-d51f5b68ac0c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:28:31 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-5e703990-5ed3-4ce6-8ab9-0a9d19a9e098 req-19baa2f6-be5b-4562-b3c8-8dccb06c72f7 service nova] Lock "e480a3c8-a7bc-4eea-b45f-d51f5b68ac0c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:28:31 user nova-compute[75045]: DEBUG nova.compute.manager [req-5e703990-5ed3-4ce6-8ab9-0a9d19a9e098 req-19baa2f6-be5b-4562-b3c8-8dccb06c72f7 service nova] [instance: e480a3c8-a7bc-4eea-b45f-d51f5b68ac0c] No waiting events found dispatching network-vif-plugged-4e478658-1101-428c-b08a-cc4de5d107d0 {{(pid=75045) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 23:28:31 user nova-compute[75045]: WARNING nova.compute.manager [req-5e703990-5ed3-4ce6-8ab9-0a9d19a9e098 req-19baa2f6-be5b-4562-b3c8-8dccb06c72f7 service nova] [instance: e480a3c8-a7bc-4eea-b45f-d51f5b68ac0c] Received unexpected event network-vif-plugged-4e478658-1101-428c-b08a-cc4de5d107d0 for instance with vm_state building and task_state spawning.
Nov 08 23:28:32 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:28:32 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:28:32 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-5469a735-96f8-4ac3-82ad-21ec2f69759f tempest-ServerActionsV293TestJSON-1645081958 tempest-ServerActionsV293TestJSON-1645081958-project-member] Acquiring lock "667d20c3-3eda-4aa5-b799-6dcee3443833" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:28:32 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-5469a735-96f8-4ac3-82ad-21ec2f69759f tempest-ServerActionsV293TestJSON-1645081958 tempest-ServerActionsV293TestJSON-1645081958-project-member] Lock "667d20c3-3eda-4aa5-b799-6dcee3443833" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:28:32 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-5469a735-96f8-4ac3-82ad-21ec2f69759f tempest-ServerActionsV293TestJSON-1645081958 tempest-ServerActionsV293TestJSON-1645081958-project-member] Acquiring lock "667d20c3-3eda-4aa5-b799-6dcee3443833-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:28:32 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-5469a735-96f8-4ac3-82ad-21ec2f69759f tempest-ServerActionsV293TestJSON-1645081958 tempest-ServerActionsV293TestJSON-1645081958-project-member] Lock "667d20c3-3eda-4aa5-b799-6dcee3443833-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:28:32 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-5469a735-96f8-4ac3-82ad-21ec2f69759f tempest-ServerActionsV293TestJSON-1645081958 tempest-ServerActionsV293TestJSON-1645081958-project-member] Lock "667d20c3-3eda-4aa5-b799-6dcee3443833-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:28:32 user nova-compute[75045]: INFO nova.compute.manager [None req-5469a735-96f8-4ac3-82ad-21ec2f69759f tempest-ServerActionsV293TestJSON-1645081958 tempest-ServerActionsV293TestJSON-1645081958-project-member] [instance: 667d20c3-3eda-4aa5-b799-6dcee3443833] Terminating instance
Nov 08 23:28:32 user nova-compute[75045]: DEBUG nova.compute.manager [None req-5469a735-96f8-4ac3-82ad-21ec2f69759f tempest-ServerActionsV293TestJSON-1645081958 tempest-ServerActionsV293TestJSON-1645081958-project-member] [instance: 667d20c3-3eda-4aa5-b799-6dcee3443833] Start destroying the instance on the hypervisor. {{(pid=75045) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 23:28:33 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:28:33 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:28:33 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:28:33 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:28:33 user nova-compute[75045]: DEBUG nova.compute.manager [req-954b1df4-3d4c-4ae1-8d65-4b16e94c304d req-da695045-c03c-4d52-b552-d239cba610fc service nova] [instance: 667d20c3-3eda-4aa5-b799-6dcee3443833] Received event network-vif-unplugged-0d5e497c-3168-46b1-9094-9bb54737cc0f {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:28:33 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-954b1df4-3d4c-4ae1-8d65-4b16e94c304d req-da695045-c03c-4d52-b552-d239cba610fc service nova] Acquiring lock "667d20c3-3eda-4aa5-b799-6dcee3443833-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:28:33 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-954b1df4-3d4c-4ae1-8d65-4b16e94c304d req-da695045-c03c-4d52-b552-d239cba610fc service nova] Lock "667d20c3-3eda-4aa5-b799-6dcee3443833-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:28:33 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-954b1df4-3d4c-4ae1-8d65-4b16e94c304d req-da695045-c03c-4d52-b552-d239cba610fc service nova] Lock "667d20c3-3eda-4aa5-b799-6dcee3443833-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:28:33 user nova-compute[75045]: DEBUG nova.compute.manager [req-954b1df4-3d4c-4ae1-8d65-4b16e94c304d req-da695045-c03c-4d52-b552-d239cba610fc service nova] [instance: 667d20c3-3eda-4aa5-b799-6dcee3443833] No waiting events found dispatching network-vif-unplugged-0d5e497c-3168-46b1-9094-9bb54737cc0f {{(pid=75045) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 23:28:33 user nova-compute[75045]: DEBUG nova.compute.manager [req-954b1df4-3d4c-4ae1-8d65-4b16e94c304d req-da695045-c03c-4d52-b552-d239cba610fc service nova] [instance: 667d20c3-3eda-4aa5-b799-6dcee3443833] Received event network-vif-unplugged-0d5e497c-3168-46b1-9094-9bb54737cc0f for instance with task_state deleting. {{(pid=75045) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 23:28:33 user nova-compute[75045]: INFO nova.virt.libvirt.driver [-] [instance: 667d20c3-3eda-4aa5-b799-6dcee3443833] Instance destroyed successfully.
Nov 08 23:28:33 user nova-compute[75045]: DEBUG nova.objects.instance [None req-5469a735-96f8-4ac3-82ad-21ec2f69759f tempest-ServerActionsV293TestJSON-1645081958 tempest-ServerActionsV293TestJSON-1645081958-project-member] Lazy-loading 'resources' on Instance uuid 667d20c3-3eda-4aa5-b799-6dcee3443833 {{(pid=75045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 23:28:33 user nova-compute[75045]: DEBUG nova.virt.libvirt.vif [None req-5469a735-96f8-4ac3-82ad-21ec2f69759f tempest-ServerActionsV293TestJSON-1645081958 tempest-ServerActionsV293TestJSON-1645081958-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-08T23:23:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-374447582',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-621912130',id=22,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBApsXoUUj600/jCowZP3//u29Ov5MwB7tYSt8EjtngLjlaZqqKZXWg1HuFDyt4rHiDuYq2TVJTqipV6mcSPV0LYib38MErT/yLzsrNv4x3AUTFC5kAU2nRDHPtRbpYSQ9w==',key_name='tempest-keypair-471552763',keypairs=<?>,launch_index=0,launched_at=2023-11-08T23:26:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='89744dd7de584b14880bc42dd96933af',ramdisk_id='',reservation_id='r-iwtkqj0a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1645081958',owner_user_name='tempest-ServerActionsV293TestJSON-1645081958-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T23:26:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fc0a769ab72a476c9ac620728d67c5b6',uuid=667d20c3-3eda-4aa5-b799-6dcee3443833,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0d5e497c-3168-46b1-9094-9bb54737cc0f", "address": "fa:16:3e:80:07:f1", "network": {"id": "22898442-b87a-4538-a8f5-fe275919f44a", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-665667609-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.146", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "89744dd7de584b14880bc42dd96933af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d5e497c-31", "ovs_interfaceid": "0d5e497c-3168-46b1-9094-9bb54737cc0f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75045) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 23:28:33 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-5469a735-96f8-4ac3-82ad-21ec2f69759f tempest-ServerActionsV293TestJSON-1645081958 tempest-ServerActionsV293TestJSON-1645081958-project-member] Converting VIF {"id": "0d5e497c-3168-46b1-9094-9bb54737cc0f", "address": "fa:16:3e:80:07:f1", "network": {"id": "22898442-b87a-4538-a8f5-fe275919f44a", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-665667609-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.146", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "89744dd7de584b14880bc42dd96933af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d5e497c-31", "ovs_interfaceid": "0d5e497c-3168-46b1-9094-9bb54737cc0f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 23:28:33 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-5469a735-96f8-4ac3-82ad-21ec2f69759f tempest-ServerActionsV293TestJSON-1645081958 tempest-ServerActionsV293TestJSON-1645081958-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:80:07:f1,bridge_name='br-int',has_traffic_filtering=True,id=0d5e497c-3168-46b1-9094-9bb54737cc0f,network=Network(22898442-b87a-4538-a8f5-fe275919f44a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0d5e497c-31') {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 23:28:33 user nova-compute[75045]: DEBUG os_vif [None req-5469a735-96f8-4ac3-82ad-21ec2f69759f tempest-ServerActionsV293TestJSON-1645081958 tempest-ServerActionsV293TestJSON-1645081958-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:80:07:f1,bridge_name='br-int',has_traffic_filtering=True,id=0d5e497c-3168-46b1-9094-9bb54737cc0f,network=Network(22898442-b87a-4538-a8f5-fe275919f44a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0d5e497c-31') {{(pid=75045) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 23:28:33 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:28:33 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0d5e497c-31, bridge=br-int, if_exists=True) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:28:33 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:28:33 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:28:33 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:28:33 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8db3014b-9284-494b-a50b-efc82f4184b0) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:28:33 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:28:33 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:28:33 user nova-compute[75045]: INFO os_vif [None req-5469a735-96f8-4ac3-82ad-21ec2f69759f tempest-ServerActionsV293TestJSON-1645081958 tempest-ServerActionsV293TestJSON-1645081958-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:80:07:f1,bridge_name='br-int',has_traffic_filtering=True,id=0d5e497c-3168-46b1-9094-9bb54737cc0f,network=Network(22898442-b87a-4538-a8f5-fe275919f44a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0d5e497c-31')
Nov 08 23:28:33 user nova-compute[75045]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5469a735-96f8-4ac3-82ad-21ec2f69759f tempest-ServerActionsV293TestJSON-1645081958 tempest-ServerActionsV293TestJSON-1645081958-project-member] [instance: 667d20c3-3eda-4aa5-b799-6dcee3443833] calling os-brick to detach iSCSI Volume {{(pid=75045) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 23:28:33 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-5469a735-96f8-4ac3-82ad-21ec2f69759f tempest-ServerActionsV293TestJSON-1645081958 tempest-ServerActionsV293TestJSON-1645081958-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1b68210460>, {'target_iqn': 'iqn.2010-10.org.openstack:04d02c98-d058-49d8-a350-ab9e63003d6e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uVoSDJjd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75045) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 23:28:33 user nova-compute[75045]: WARNING os_brick.initiator.connectors.base [None req-5469a735-96f8-4ac3-82ad-21ec2f69759f tempest-ServerActionsV293TestJSON-1645081958 tempest-ServerActionsV293TestJSON-1645081958-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 23:28:33 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-5469a735-96f8-4ac3-82ad-21ec2f69759f tempest-ServerActionsV293TestJSON-1645081958 tempest-ServerActionsV293TestJSON-1645081958-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 23:28:33 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-5469a735-96f8-4ac3-82ad-21ec2f69759f tempest-ServerActionsV293TestJSON-1645081958 tempest-ServerActionsV293TestJSON-1645081958-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 23:28:33 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:28:33 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:28:33 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[90b9eac8-421f-4802-a9bf-b73058cda881]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:04d02c98-d058-49d8-a350-ab9e63003d6e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9c37da13-9531-458a-87cb-1e86e6b84f3a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d2e734fa-1dcb-4510-a50e-064e29c2985e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:28:33 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-5469a735-96f8-4ac3-82ad-21ec2f69759f tempest-ServerActionsV293TestJSON-1645081958 tempest-ServerActionsV293TestJSON-1645081958-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 23:28:33 user nova-compute[75045]: No targets found.
Nov 08 23:28:33 user nova-compute[75045]: iSNS:
Nov 08 23:28:33 user nova-compute[75045]: No targets found.
Nov 08 23:28:33 user nova-compute[75045]: STATIC:
Nov 08 23:28:33 user nova-compute[75045]: Target: iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab
Nov 08 23:28:33 user nova-compute[75045]:         Portal: 172.16.0.220:3260,-1
Nov 08 23:28:33 user nova-compute[75045]:                 Iface Name: default
Nov 08 23:28:33 user nova-compute[75045]: Target: iqn.2010-10.org.openstack:04d02c98-d058-49d8-a350-ab9e63003d6e
Nov 08 23:28:33 user nova-compute[75045]:         Portal: 172.16.0.220:3260,-1
Nov 08 23:28:33 user nova-compute[75045]:                 Iface Name: default
Nov 08 23:28:33 user nova-compute[75045]: Target: iqn.2010-10.org.openstack:9c37da13-9531-458a-87cb-1e86e6b84f3a
Nov 08 23:28:33 user nova-compute[75045]:         Portal: 172.16.0.220:3260,-1
Nov 08 23:28:33 user nova-compute[75045]:                 Iface Name: default
Nov 08 23:28:33 user nova-compute[75045]: Target: iqn.2010-10.org.openstack:d2e734fa-1dcb-4510-a50e-064e29c2985e
Nov 08 23:28:33 user nova-compute[75045]:         Portal: 172.16.0.220:3260,-1
Nov 08 23:28:33 user nova-compute[75045]:                 Iface Name: default
Nov 08 23:28:33 user nova-compute[75045]: FIRMWARE:
Nov 08 23:28:33 user nova-compute[75045]: No targets found.
Nov 08 23:28:33 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 23:28:33 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-5469a735-96f8-4ac3-82ad-21ec2f69759f tempest-ServerActionsV293TestJSON-1645081958 tempest-ServerActionsV293TestJSON-1645081958-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 23:28:33 user nova-compute[75045]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 23:28:33 user nova-compute[75045]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75045) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 23:28:33 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-5469a735-96f8-4ac3-82ad-21ec2f69759f tempest-ServerActionsV293TestJSON-1645081958 tempest-ServerActionsV293TestJSON-1645081958-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:04d02c98-d058-49d8-a350-ab9e63003d6e', 0)] {{(pid=75045) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 23:28:33 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:28:33 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.027s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:28:33 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d0df84f-6b58-439f-a0f0-9fc8b845c0ca]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:04d02c98-d058-49d8-a350-ab9e63003d6e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9c37da13-9531-458a-87cb-1e86e6b84f3a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d2e734fa-1dcb-4510-a50e-064e29c2985e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:28:33 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:28:33 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.047s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:28:33 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4b6add9-ef10-4593-8439-a01f11becf3f]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c37da13-9531-458a-87cb-1e86e6b84f3a (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04d02c98-d058-49d8-a350-ab9e63003d6e (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2e734fa-1dcb-4510-a50e-064e29c2985e (non-flash)\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:28:33 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-5469a735-96f8-4ac3-82ad-21ec2f69759f tempest-ServerActionsV293TestJSON-1645081958 tempest-ServerActionsV293TestJSON-1645081958-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab (non-flash)
Nov 08 23:28:33 user nova-compute[75045]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c37da13-9531-458a-87cb-1e86e6b84f3a (non-flash)
Nov 08 23:28:33 user nova-compute[75045]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04d02c98-d058-49d8-a350-ab9e63003d6e (non-flash)
Nov 08 23:28:33 user nova-compute[75045]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2e734fa-1dcb-4510-a50e-064e29c2985e (non-flash)
Nov 08 23:28:33 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 23:28:33 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-5469a735-96f8-4ac3-82ad-21ec2f69759f tempest-ServerActionsV293TestJSON-1645081958 tempest-ServerActionsV293TestJSON-1645081958-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab (non-flash)
Nov 08 23:28:33 user nova-compute[75045]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c37da13-9531-458a-87cb-1e86e6b84f3a (non-flash)
Nov 08 23:28:33 user nova-compute[75045]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04d02c98-d058-49d8-a350-ab9e63003d6e (non-flash)
Nov 08 23:28:33 user nova-compute[75045]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2e734fa-1dcb-4510-a50e-064e29c2985e (non-flash)
Nov 08 23:28:33 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 23:28:33 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-5469a735-96f8-4ac3-82ad-21ec2f69759f tempest-ServerActionsV293TestJSON-1645081958 tempest-ServerActionsV293TestJSON-1645081958-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1b482388b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:04d02c98-d058-49d8-a350-ab9e63003d6e'): ({'sdb'}, set())}) {{(pid=75045) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 23:28:33 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-5469a735-96f8-4ac3-82ad-21ec2f69759f tempest-ServerActionsV293TestJSON-1645081958 tempest-ServerActionsV293TestJSON-1645081958-project-member] Removing single pathed devices sdb {{(pid=75045) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 23:28:33 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:28:34 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:28:34 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[db9dd0c6-7e0f-4d4a-8158-7c44b06da94e]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:28:34 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:28:34 user nova-compute[75045]: DEBUG nova.compute.manager [req-a9136f1d-ba0c-4493-90bf-e81cf86a6b40 req-575791de-1253-4bbf-aace-5e27ac7f4b6c service nova] [instance: e480a3c8-a7bc-4eea-b45f-d51f5b68ac0c] Received event network-vif-plugged-4e478658-1101-428c-b08a-cc4de5d107d0 {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:28:34 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-a9136f1d-ba0c-4493-90bf-e81cf86a6b40 req-575791de-1253-4bbf-aace-5e27ac7f4b6c service nova] Acquiring lock "e480a3c8-a7bc-4eea-b45f-d51f5b68ac0c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:28:34 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-a9136f1d-ba0c-4493-90bf-e81cf86a6b40 req-575791de-1253-4bbf-aace-5e27ac7f4b6c service nova] Lock "e480a3c8-a7bc-4eea-b45f-d51f5b68ac0c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:28:34 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-a9136f1d-ba0c-4493-90bf-e81cf86a6b40 req-575791de-1253-4bbf-aace-5e27ac7f4b6c service nova] Lock "e480a3c8-a7bc-4eea-b45f-d51f5b68ac0c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:28:34 user nova-compute[75045]: DEBUG nova.compute.manager [req-a9136f1d-ba0c-4493-90bf-e81cf86a6b40 req-575791de-1253-4bbf-aace-5e27ac7f4b6c service nova] [instance: e480a3c8-a7bc-4eea-b45f-d51f5b68ac0c] No waiting events found dispatching network-vif-plugged-4e478658-1101-428c-b08a-cc4de5d107d0 {{(pid=75045) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 23:28:34 user nova-compute[75045]: WARNING nova.compute.manager [req-a9136f1d-ba0c-4493-90bf-e81cf86a6b40 req-575791de-1253-4bbf-aace-5e27ac7f4b6c service nova] [instance: e480a3c8-a7bc-4eea-b45f-d51f5b68ac0c] Received unexpected event network-vif-plugged-4e478658-1101-428c-b08a-cc4de5d107d0 for instance with vm_state building and task_state spawning.
Nov 08 23:28:34 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:28:34 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d30b729-6e27-4c81-aab5-2a60f9c87fd0]: (4, ('ok\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:28:34 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-5469a735-96f8-4ac3-82ad-21ec2f69759f tempest-ServerActionsV293TestJSON-1645081958 tempest-ServerActionsV293TestJSON-1645081958-project-member] Flushing IO for device /dev/sdb {{(pid=75045) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 23:28:34 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:28:34 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.020s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:28:34 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c69cace-36f6-4336-bcd6-eb6def655443]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:28:34 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-5469a735-96f8-4ac3-82ad-21ec2f69759f tempest-ServerActionsV293TestJSON-1645081958 tempest-ServerActionsV293TestJSON-1645081958-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75045) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 23:28:34 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:28:34 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.041s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:28:34 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[e90ad150-f074-44a7-afb3-702846955e6c]: (4, ('1', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:28:34 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-5469a735-96f8-4ac3-82ad-21ec2f69759f tempest-ServerActionsV293TestJSON-1645081958 tempest-ServerActionsV293TestJSON-1645081958-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75045) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 23:28:34 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-5469a735-96f8-4ac3-82ad-21ec2f69759f tempest-ServerActionsV293TestJSON-1645081958 tempest-ServerActionsV293TestJSON-1645081958-project-member] SCSI volumes sdb have been removed. {{(pid=75045) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 23:28:34 user nova-compute[75045]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-26530623965343832', '/dev/disk/by-id/scsi-1SCST_BIO3ab59215-e0b9e4827de70d2f', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_3ab59215') {{(pid=86132) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 08 23:28:34 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcc341c5-5a58-45ed-bed9-4787151a42b7]: (4, None) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:28:34 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-5469a735-96f8-4ac3-82ad-21ec2f69759f tempest-ServerActionsV293TestJSON-1645081958 tempest-ServerActionsV293TestJSON-1645081958-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:04d02c98-d058-49d8-a350-ab9e63003d6e')] {{(pid=75045) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 23:28:34 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04d02c98-d058-49d8-a350-ab9e63003d6e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:28:34 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04d02c98-d058-49d8-a350-ab9e63003d6e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.028s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:28:34 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[f883237d-f6e3-4789-8056-cb32a3896c45]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:28:34 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-5469a735-96f8-4ac3-82ad-21ec2f69759f tempest-ServerActionsV293TestJSON-1645081958 tempest-ServerActionsV293TestJSON-1645081958-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:28:34 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04d02c98-d058-49d8-a350-ab9e63003d6e -p 172.16.0.220:3260 --logout {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:28:34 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04d02c98-d058-49d8-a350-ab9e63003d6e -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:28:34 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[7674defd-281a-4d94-8fd1-5a182d27ebf3]: (4, ('Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:04d02c98-d058-49d8-a350-ab9e63003d6e, portal: 172.16.0.220,3260]\nLogout of [sid: 24, target: iqn.2010-10.org.openstack:04d02c98-d058-49d8-a350-ab9e63003d6e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:28:34 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-5469a735-96f8-4ac3-82ad-21ec2f69759f tempest-ServerActionsV293TestJSON-1645081958 tempest-ServerActionsV293TestJSON-1645081958-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:04d02c98-d058-49d8-a350-ab9e63003d6e, portal: 172.16.0.220,3260]
Nov 08 23:28:34 user nova-compute[75045]: Logout of [sid: 24, target: iqn.2010-10.org.openstack:04d02c98-d058-49d8-a350-ab9e63003d6e, portal: 172.16.0.220,3260] successful.
Nov 08 23:28:34 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:28:34 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04d02c98-d058-49d8-a350-ab9e63003d6e -p 172.16.0.220:3260 --op delete {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:28:34 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04d02c98-d058-49d8-a350-ab9e63003d6e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:28:34 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c31a048-06c5-4cea-8ce0-e73ec8995f72]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:28:34 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-5469a735-96f8-4ac3-82ad-21ec2f69759f tempest-ServerActionsV293TestJSON-1645081958 tempest-ServerActionsV293TestJSON-1645081958-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:28:34 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-5469a735-96f8-4ac3-82ad-21ec2f69759f tempest-ServerActionsV293TestJSON-1645081958 tempest-ServerActionsV293TestJSON-1645081958-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.392s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 23:28:34 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-5469a735-96f8-4ac3-82ad-21ec2f69759f tempest-ServerActionsV293TestJSON-1645081958 tempest-ServerActionsV293TestJSON-1645081958-project-member] <== disconnect_volume: return (393ms) None {{(pid=75045) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 23:28:34 user nova-compute[75045]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5469a735-96f8-4ac3-82ad-21ec2f69759f tempest-ServerActionsV293TestJSON-1645081958 tempest-ServerActionsV293TestJSON-1645081958-project-member] [instance: 667d20c3-3eda-4aa5-b799-6dcee3443833] Disconnected iSCSI Volume {{(pid=75045) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 23:28:34 user nova-compute[75045]: INFO nova.virt.libvirt.driver [None req-5469a735-96f8-4ac3-82ad-21ec2f69759f tempest-ServerActionsV293TestJSON-1645081958 tempest-ServerActionsV293TestJSON-1645081958-project-member] [instance: 667d20c3-3eda-4aa5-b799-6dcee3443833] Deleting instance files /opt/stack/data/nova/instances/667d20c3-3eda-4aa5-b799-6dcee3443833_del
Nov 08 23:28:34 user nova-compute[75045]: INFO nova.virt.libvirt.driver [None req-5469a735-96f8-4ac3-82ad-21ec2f69759f tempest-ServerActionsV293TestJSON-1645081958 tempest-ServerActionsV293TestJSON-1645081958-project-member] [instance: 667d20c3-3eda-4aa5-b799-6dcee3443833] Deletion of /opt/stack/data/nova/instances/667d20c3-3eda-4aa5-b799-6dcee3443833_del complete
Nov 08 23:28:34 user nova-compute[75045]: INFO nova.compute.manager [None req-5469a735-96f8-4ac3-82ad-21ec2f69759f tempest-ServerActionsV293TestJSON-1645081958 tempest-ServerActionsV293TestJSON-1645081958-project-member] [instance: 667d20c3-3eda-4aa5-b799-6dcee3443833] Took 1.43 seconds to destroy the instance on the hypervisor.
Nov 08 23:28:34 user nova-compute[75045]: DEBUG oslo.service.loopingcall [None req-5469a735-96f8-4ac3-82ad-21ec2f69759f tempest-ServerActionsV293TestJSON-1645081958 tempest-ServerActionsV293TestJSON-1645081958-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75045) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 23:28:34 user nova-compute[75045]: DEBUG nova.compute.manager [-] [instance: 667d20c3-3eda-4aa5-b799-6dcee3443833] Deallocating network for instance {{(pid=75045) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 23:28:34 user nova-compute[75045]: DEBUG nova.network.neutron [-] [instance: 667d20c3-3eda-4aa5-b799-6dcee3443833] deallocate_for_instance() {{(pid=75045) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 23:28:34 user nova-compute[75045]: DEBUG nova.compute.manager [None req-e890b869-9ff2-499b-90b9-13b14f66f2d5 tempest-VolumesAdminNegativeTest-215528111 tempest-VolumesAdminNegativeTest-215528111-project-member] [instance: e480a3c8-a7bc-4eea-b45f-d51f5b68ac0c] Instance event wait completed in 0 seconds for  {{(pid=75045) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 23:28:34 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-e890b869-9ff2-499b-90b9-13b14f66f2d5 tempest-VolumesAdminNegativeTest-215528111 tempest-VolumesAdminNegativeTest-215528111-project-member] [instance: e480a3c8-a7bc-4eea-b45f-d51f5b68ac0c] Guest created on hypervisor {{(pid=75045) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 23:28:34 user nova-compute[75045]: INFO nova.virt.libvirt.driver [-] [instance: e480a3c8-a7bc-4eea-b45f-d51f5b68ac0c] Instance spawned successfully.
Nov 08 23:28:34 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-e890b869-9ff2-499b-90b9-13b14f66f2d5 tempest-VolumesAdminNegativeTest-215528111 tempest-VolumesAdminNegativeTest-215528111-project-member] [instance: e480a3c8-a7bc-4eea-b45f-d51f5b68ac0c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75045) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 23:28:34 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-e890b869-9ff2-499b-90b9-13b14f66f2d5 tempest-VolumesAdminNegativeTest-215528111 tempest-VolumesAdminNegativeTest-215528111-project-member] [instance: e480a3c8-a7bc-4eea-b45f-d51f5b68ac0c] Found default for hw_cdrom_bus of ide {{(pid=75045) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 23:28:34 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-e890b869-9ff2-499b-90b9-13b14f66f2d5 tempest-VolumesAdminNegativeTest-215528111 tempest-VolumesAdminNegativeTest-215528111-project-member] [instance: e480a3c8-a7bc-4eea-b45f-d51f5b68ac0c] Found default for hw_disk_bus of virtio {{(pid=75045) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 23:28:34 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-e890b869-9ff2-499b-90b9-13b14f66f2d5 tempest-VolumesAdminNegativeTest-215528111 tempest-VolumesAdminNegativeTest-215528111-project-member] [instance: e480a3c8-a7bc-4eea-b45f-d51f5b68ac0c] Found default for hw_input_bus of None {{(pid=75045) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 23:28:34 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-e890b869-9ff2-499b-90b9-13b14f66f2d5 tempest-VolumesAdminNegativeTest-215528111 tempest-VolumesAdminNegativeTest-215528111-project-member] [instance: e480a3c8-a7bc-4eea-b45f-d51f5b68ac0c] Found default for hw_pointer_model of None {{(pid=75045) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 23:28:34 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-e890b869-9ff2-499b-90b9-13b14f66f2d5 tempest-VolumesAdminNegativeTest-215528111 tempest-VolumesAdminNegativeTest-215528111-project-member] [instance: e480a3c8-a7bc-4eea-b45f-d51f5b68ac0c] Found default for hw_video_model of virtio {{(pid=75045) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 23:28:34 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-e890b869-9ff2-499b-90b9-13b14f66f2d5 tempest-VolumesAdminNegativeTest-215528111 tempest-VolumesAdminNegativeTest-215528111-project-member] [instance: e480a3c8-a7bc-4eea-b45f-d51f5b68ac0c] Found default for hw_vif_model of virtio {{(pid=75045) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 23:28:34 user nova-compute[75045]: INFO nova.compute.manager [None req-e890b869-9ff2-499b-90b9-13b14f66f2d5 tempest-VolumesAdminNegativeTest-215528111 tempest-VolumesAdminNegativeTest-215528111-project-member] [instance: e480a3c8-a7bc-4eea-b45f-d51f5b68ac0c] Took 6.46 seconds to spawn the instance on the hypervisor.
Nov 08 23:28:34 user nova-compute[75045]: DEBUG nova.compute.manager [None req-e890b869-9ff2-499b-90b9-13b14f66f2d5 tempest-VolumesAdminNegativeTest-215528111 tempest-VolumesAdminNegativeTest-215528111-project-member] [instance: e480a3c8-a7bc-4eea-b45f-d51f5b68ac0c] Checking state {{(pid=75045) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 23:28:34 user nova-compute[75045]: INFO nova.compute.manager [None req-e890b869-9ff2-499b-90b9-13b14f66f2d5 tempest-VolumesAdminNegativeTest-215528111 tempest-VolumesAdminNegativeTest-215528111-project-member] [instance: e480a3c8-a7bc-4eea-b45f-d51f5b68ac0c] Took 7.67 seconds to build instance.
Nov 08 23:28:34 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-e890b869-9ff2-499b-90b9-13b14f66f2d5 tempest-VolumesAdminNegativeTest-215528111 tempest-VolumesAdminNegativeTest-215528111-project-member] Lock "e480a3c8-a7bc-4eea-b45f-d51f5b68ac0c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.854s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:28:35 user nova-compute[75045]: WARNING nova.virt.libvirt.driver [None req-80d06f34-1d7e-42da-8cd4-bda5cb20127b tempest-TestServerVolumeAttachmentScenario-1899063447 tempest-TestServerVolumeAttachmentScenario-1899063447-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 25cd59d1-6884-471a-813e-52e97c2e1208 is timed out.
Nov 08 23:28:35 user nova-compute[75045]: INFO nova.virt.libvirt.driver [None req-80d06f34-1d7e-42da-8cd4-bda5cb20127b tempest-TestServerVolumeAttachmentScenario-1899063447 tempest-TestServerVolumeAttachmentScenario-1899063447-project-member] Successfully detached device vdb from instance 25cd59d1-6884-471a-813e-52e97c2e1208 from the live domain config.
Nov 08 23:28:35 user nova-compute[75045]: DEBUG nova.virt.libvirt.volume.iscsi [None req-80d06f34-1d7e-42da-8cd4-bda5cb20127b tempest-TestServerVolumeAttachmentScenario-1899063447 tempest-TestServerVolumeAttachmentScenario-1899063447-project-member] [instance: 25cd59d1-6884-471a-813e-52e97c2e1208] calling os-brick to detach iSCSI Volume {{(pid=75045) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 23:28:35 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-80d06f34-1d7e-42da-8cd4-bda5cb20127b tempest-TestServerVolumeAttachmentScenario-1899063447 tempest-TestServerVolumeAttachmentScenario-1899063447-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1b68210460>, {'target_iqn': 'iqn.2010-10.org.openstack:9c37da13-9531-458a-87cb-1e86e6b84f3a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aWFTIYZz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=75045) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 23:28:35 user nova-compute[75045]: WARNING os_brick.initiator.connectors.base [None req-80d06f34-1d7e-42da-8cd4-bda5cb20127b tempest-TestServerVolumeAttachmentScenario-1899063447 tempest-TestServerVolumeAttachmentScenario-1899063447-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 23:28:35 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-80d06f34-1d7e-42da-8cd4-bda5cb20127b tempest-TestServerVolumeAttachmentScenario-1899063447 tempest-TestServerVolumeAttachmentScenario-1899063447-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 23:28:35 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-80d06f34-1d7e-42da-8cd4-bda5cb20127b tempest-TestServerVolumeAttachmentScenario-1899063447 tempest-TestServerVolumeAttachmentScenario-1899063447-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 23:28:35 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:28:35 user nova-compute[75045]: DEBUG nova.compute.manager [req-7a252f7f-a12b-4373-83cc-ece3baafc32d req-31a85c2c-f08a-48fc-83d6-7f22ee903761 service nova] [instance: 667d20c3-3eda-4aa5-b799-6dcee3443833] Received event network-vif-plugged-0d5e497c-3168-46b1-9094-9bb54737cc0f {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:28:35 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-7a252f7f-a12b-4373-83cc-ece3baafc32d req-31a85c2c-f08a-48fc-83d6-7f22ee903761 service nova] Acquiring lock "667d20c3-3eda-4aa5-b799-6dcee3443833-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:28:35 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-7a252f7f-a12b-4373-83cc-ece3baafc32d req-31a85c2c-f08a-48fc-83d6-7f22ee903761 service nova] Lock "667d20c3-3eda-4aa5-b799-6dcee3443833-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:28:35 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-7a252f7f-a12b-4373-83cc-ece3baafc32d req-31a85c2c-f08a-48fc-83d6-7f22ee903761 service nova] Lock "667d20c3-3eda-4aa5-b799-6dcee3443833-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:28:35 user nova-compute[75045]: DEBUG nova.compute.manager [req-7a252f7f-a12b-4373-83cc-ece3baafc32d req-31a85c2c-f08a-48fc-83d6-7f22ee903761 service nova] [instance: 667d20c3-3eda-4aa5-b799-6dcee3443833] No waiting events found dispatching network-vif-plugged-0d5e497c-3168-46b1-9094-9bb54737cc0f {{(pid=75045) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 23:28:35 user nova-compute[75045]: WARNING nova.compute.manager [req-7a252f7f-a12b-4373-83cc-ece3baafc32d req-31a85c2c-f08a-48fc-83d6-7f22ee903761 service nova] [instance: 667d20c3-3eda-4aa5-b799-6dcee3443833] Received unexpected event network-vif-plugged-0d5e497c-3168-46b1-9094-9bb54737cc0f for instance with vm_state active and task_state deleting.
Nov 08 23:28:35 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.042s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:28:35 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdd2a865-18a5-4296-ac25-be271893162b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9c37da13-9531-458a-87cb-1e86e6b84f3a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d2e734fa-1dcb-4510-a50e-064e29c2985e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:28:35 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-80d06f34-1d7e-42da-8cd4-bda5cb20127b tempest-TestServerVolumeAttachmentScenario-1899063447 tempest-TestServerVolumeAttachmentScenario-1899063447-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 23:28:35 user nova-compute[75045]: No targets found.
Nov 08 23:28:35 user nova-compute[75045]: iSNS:
Nov 08 23:28:35 user nova-compute[75045]: No targets found.
Nov 08 23:28:35 user nova-compute[75045]: STATIC:
Nov 08 23:28:35 user nova-compute[75045]: Target: iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab
Nov 08 23:28:35 user nova-compute[75045]:         Portal: 172.16.0.220:3260,-1
Nov 08 23:28:35 user nova-compute[75045]:                 Iface Name: default
Nov 08 23:28:35 user nova-compute[75045]: Target: iqn.2010-10.org.openstack:9c37da13-9531-458a-87cb-1e86e6b84f3a
Nov 08 23:28:35 user nova-compute[75045]:         Portal: 172.16.0.220:3260,-1
Nov 08 23:28:35 user nova-compute[75045]:                 Iface Name: default
Nov 08 23:28:35 user nova-compute[75045]: Target: iqn.2010-10.org.openstack:d2e734fa-1dcb-4510-a50e-064e29c2985e
Nov 08 23:28:35 user nova-compute[75045]:         Portal: 172.16.0.220:3260,-1
Nov 08 23:28:35 user nova-compute[75045]:                 Iface Name: default
Nov 08 23:28:35 user nova-compute[75045]: FIRMWARE:
Nov 08 23:28:35 user nova-compute[75045]: No targets found.
Nov 08 23:28:35 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 23:28:35 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-80d06f34-1d7e-42da-8cd4-bda5cb20127b tempest-TestServerVolumeAttachmentScenario-1899063447 tempest-TestServerVolumeAttachmentScenario-1899063447-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 23:28:35 user nova-compute[75045]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 23:28:35 user nova-compute[75045]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75045) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 23:28:35 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-80d06f34-1d7e-42da-8cd4-bda5cb20127b tempest-TestServerVolumeAttachmentScenario-1899063447 tempest-TestServerVolumeAttachmentScenario-1899063447-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9c37da13-9531-458a-87cb-1e86e6b84f3a', 0)] {{(pid=75045) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 23:28:35 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:28:35 user nova-compute[75045]: DEBUG nova.network.neutron [-] [instance: 667d20c3-3eda-4aa5-b799-6dcee3443833] Updating instance_info_cache with network_info: [] {{(pid=75045) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 23:28:35 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.035s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:28:35 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2194c49-90b7-4a48-83e1-7a6f09e60779]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9c37da13-9531-458a-87cb-1e86e6b84f3a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d2e734fa-1dcb-4510-a50e-064e29c2985e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:28:35 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:28:35 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:28:35 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[332f1b7b-8e89-490f-bed8-4773ce579e8b]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c37da13-9531-458a-87cb-1e86e6b84f3a (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2e734fa-1dcb-4510-a50e-064e29c2985e (non-flash)\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:28:35 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-80d06f34-1d7e-42da-8cd4-bda5cb20127b tempest-TestServerVolumeAttachmentScenario-1899063447 tempest-TestServerVolumeAttachmentScenario-1899063447-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab (non-flash)
Nov 08 23:28:35 user nova-compute[75045]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c37da13-9531-458a-87cb-1e86e6b84f3a (non-flash)
Nov 08 23:28:35 user nova-compute[75045]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2e734fa-1dcb-4510-a50e-064e29c2985e (non-flash)
Nov 08 23:28:35 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 23:28:35 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-80d06f34-1d7e-42da-8cd4-bda5cb20127b tempest-TestServerVolumeAttachmentScenario-1899063447 tempest-TestServerVolumeAttachmentScenario-1899063447-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab (non-flash)
Nov 08 23:28:35 user nova-compute[75045]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c37da13-9531-458a-87cb-1e86e6b84f3a (non-flash)
Nov 08 23:28:35 user nova-compute[75045]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2e734fa-1dcb-4510-a50e-064e29c2985e (non-flash)
Nov 08 23:28:35 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 23:28:35 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-80d06f34-1d7e-42da-8cd4-bda5cb20127b tempest-TestServerVolumeAttachmentScenario-1899063447 tempest-TestServerVolumeAttachmentScenario-1899063447-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1b484789d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9c37da13-9531-458a-87cb-1e86e6b84f3a'): ({'sde'}, set())}) {{(pid=75045) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 23:28:35 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-80d06f34-1d7e-42da-8cd4-bda5cb20127b tempest-TestServerVolumeAttachmentScenario-1899063447 tempest-TestServerVolumeAttachmentScenario-1899063447-project-member] Removing single pathed devices sde {{(pid=75045) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 23:28:35 user nova-compute[75045]: INFO nova.compute.manager [-] [instance: 667d20c3-3eda-4aa5-b799-6dcee3443833] Took 1.22 seconds to deallocate network for instance.
Nov 08 23:28:35 user nova-compute[75045]: DEBUG nova.compute.manager [req-22394581-13cb-460d-bc8d-e855e2349047 req-3ef9b685-d449-4b6f-9c0d-e44f4411ce23 service nova] [instance: 667d20c3-3eda-4aa5-b799-6dcee3443833] Received event network-vif-deleted-0d5e497c-3168-46b1-9094-9bb54737cc0f {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:28:35 user nova-compute[75045]: INFO nova.compute.manager [req-22394581-13cb-460d-bc8d-e855e2349047 req-3ef9b685-d449-4b6f-9c0d-e44f4411ce23 service nova] [instance: 667d20c3-3eda-4aa5-b799-6dcee3443833] Neutron deleted interface 0d5e497c-3168-46b1-9094-9bb54737cc0f; detaching it from the instance and deleting it from the info cache
Nov 08 23:28:35 user nova-compute[75045]: DEBUG nova.network.neutron [req-22394581-13cb-460d-bc8d-e855e2349047 req-3ef9b685-d449-4b6f-9c0d-e44f4411ce23 service nova] [instance: 667d20c3-3eda-4aa5-b799-6dcee3443833] Updating instance_info_cache with network_info: [] {{(pid=75045) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 23:28:35 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:28:35 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:28:35 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f09e4fb-e289-4f8b-94c7-5fcd4f38a19f]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:28:35 user nova-compute[75045]: DEBUG nova.compute.manager [req-22394581-13cb-460d-bc8d-e855e2349047 req-3ef9b685-d449-4b6f-9c0d-e44f4411ce23 service nova] [instance: 667d20c3-3eda-4aa5-b799-6dcee3443833] Detach interface failed, port_id=0d5e497c-3168-46b1-9094-9bb54737cc0f, reason: Instance 667d20c3-3eda-4aa5-b799-6dcee3443833 could not be found. {{(pid=75045) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 08 23:28:35 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:28:35 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.026s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:28:35 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[79de8a60-65a8-4e68-9599-7be28c57162a]: (4, ('ok\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:28:35 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-80d06f34-1d7e-42da-8cd4-bda5cb20127b tempest-TestServerVolumeAttachmentScenario-1899063447 tempest-TestServerVolumeAttachmentScenario-1899063447-project-member] Flushing IO for device /dev/sde {{(pid=75045) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 23:28:35 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:28:35 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.020s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:28:35 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[0baa3780-1dc0-420c-9b2e-5f24b7d3859e]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:28:35 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-80d06f34-1d7e-42da-8cd4-bda5cb20127b tempest-TestServerVolumeAttachmentScenario-1899063447 tempest-TestServerVolumeAttachmentScenario-1899063447-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75045) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 23:28:35 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:28:35 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.048s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:28:35 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3453b79-97e0-495e-ae9f-ab566e00dd0c]: (4, ('1', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:28:35 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-80d06f34-1d7e-42da-8cd4-bda5cb20127b tempest-TestServerVolumeAttachmentScenario-1899063447 tempest-TestServerVolumeAttachmentScenario-1899063447-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75045) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 23:28:35 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-80d06f34-1d7e-42da-8cd4-bda5cb20127b tempest-TestServerVolumeAttachmentScenario-1899063447 tempest-TestServerVolumeAttachmentScenario-1899063447-project-member] SCSI volumes sde have been removed. {{(pid=75045) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 23:28:35 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-80d06f34-1d7e-42da-8cd4-bda5cb20127b tempest-TestServerVolumeAttachmentScenario-1899063447 tempest-TestServerVolumeAttachmentScenario-1899063447-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9c37da13-9531-458a-87cb-1e86e6b84f3a')] {{(pid=75045) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 23:28:35 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c37da13-9531-458a-87cb-1e86e6b84f3a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:28:35 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c37da13-9531-458a-87cb-1e86e6b84f3a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:28:35 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[678a923b-aa6f-459c-a6fd-36aee114f11a]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:28:35 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-80d06f34-1d7e-42da-8cd4-bda5cb20127b tempest-TestServerVolumeAttachmentScenario-1899063447 tempest-TestServerVolumeAttachmentScenario-1899063447-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:28:35 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c37da13-9531-458a-87cb-1e86e6b84f3a -p 172.16.0.220:3260 --logout {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:28:35 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c37da13-9531-458a-87cb-1e86e6b84f3a -p 172.16.0.220:3260 --logout" returned: 0 in 0.071s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:28:35 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad279a78-91aa-4267-b710-20d8ac692bd1]: (4, ('Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:9c37da13-9531-458a-87cb-1e86e6b84f3a, portal: 172.16.0.220,3260]\nLogout of [sid: 19, target: iqn.2010-10.org.openstack:9c37da13-9531-458a-87cb-1e86e6b84f3a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:28:35 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-80d06f34-1d7e-42da-8cd4-bda5cb20127b tempest-TestServerVolumeAttachmentScenario-1899063447 tempest-TestServerVolumeAttachmentScenario-1899063447-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:9c37da13-9531-458a-87cb-1e86e6b84f3a, portal: 172.16.0.220,3260]
Nov 08 23:28:35 user nova-compute[75045]: Logout of [sid: 19, target: iqn.2010-10.org.openstack:9c37da13-9531-458a-87cb-1e86e6b84f3a, portal: 172.16.0.220,3260] successful.
Nov 08 23:28:35 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:28:35 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c37da13-9531-458a-87cb-1e86e6b84f3a -p 172.16.0.220:3260 --op delete {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:28:35 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c37da13-9531-458a-87cb-1e86e6b84f3a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:28:35 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[81c80d3b-cb8b-46f0-bcbc-5bde4dc585bd]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:28:35 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-80d06f34-1d7e-42da-8cd4-bda5cb20127b tempest-TestServerVolumeAttachmentScenario-1899063447 tempest-TestServerVolumeAttachmentScenario-1899063447-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:28:35 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-80d06f34-1d7e-42da-8cd4-bda5cb20127b tempest-TestServerVolumeAttachmentScenario-1899063447 tempest-TestServerVolumeAttachmentScenario-1899063447-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.441s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 23:28:35 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-80d06f34-1d7e-42da-8cd4-bda5cb20127b tempest-TestServerVolumeAttachmentScenario-1899063447 tempest-TestServerVolumeAttachmentScenario-1899063447-project-member] <== disconnect_volume: return (444ms) None {{(pid=75045) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 23:28:35 user nova-compute[75045]: DEBUG nova.virt.libvirt.volume.iscsi [None req-80d06f34-1d7e-42da-8cd4-bda5cb20127b tempest-TestServerVolumeAttachmentScenario-1899063447 tempest-TestServerVolumeAttachmentScenario-1899063447-project-member] [instance: 25cd59d1-6884-471a-813e-52e97c2e1208] Disconnected iSCSI Volume {{(pid=75045) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 23:28:36 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:28:37 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:28:38 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:28:40 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:28:40 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:28:40 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:28:40 user nova-compute[75045]: DEBUG nova.compute.manager [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75045) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 23:28:41 user nova-compute[75045]: INFO nova.compute.manager [None req-5469a735-96f8-4ac3-82ad-21ec2f69759f tempest-ServerActionsV293TestJSON-1645081958 tempest-ServerActionsV293TestJSON-1645081958-project-member] [instance: 667d20c3-3eda-4aa5-b799-6dcee3443833] Took 5.58 seconds to detach 1 volumes for instance.
Nov 08 23:28:41 user nova-compute[75045]: DEBUG nova.compute.manager [None req-5469a735-96f8-4ac3-82ad-21ec2f69759f tempest-ServerActionsV293TestJSON-1645081958 tempest-ServerActionsV293TestJSON-1645081958-project-member] [instance: 667d20c3-3eda-4aa5-b799-6dcee3443833] Deleting volume: 04d02c98-d058-49d8-a350-ab9e63003d6e {{(pid=75045) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 08 23:28:41 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:28:42 user nova-compute[75045]: DEBUG nova.objects.instance [None req-80d06f34-1d7e-42da-8cd4-bda5cb20127b tempest-TestServerVolumeAttachmentScenario-1899063447 tempest-TestServerVolumeAttachmentScenario-1899063447-project-member] Lazy-loading 'flavor' on Instance uuid 25cd59d1-6884-471a-813e-52e97c2e1208 {{(pid=75045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 23:28:42 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-80d06f34-1d7e-42da-8cd4-bda5cb20127b tempest-TestServerVolumeAttachmentScenario-1899063447 tempest-TestServerVolumeAttachmentScenario-1899063447-project-member] Lock "25cd59d1-6884-471a-813e-52e97c2e1208" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 27.285s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:28:42 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-5469a735-96f8-4ac3-82ad-21ec2f69759f tempest-ServerActionsV293TestJSON-1645081958 tempest-ServerActionsV293TestJSON-1645081958-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:28:42 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-5469a735-96f8-4ac3-82ad-21ec2f69759f tempest-ServerActionsV293TestJSON-1645081958 tempest-ServerActionsV293TestJSON-1645081958-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:28:42 user nova-compute[75045]: DEBUG nova.compute.provider_tree [None req-5469a735-96f8-4ac3-82ad-21ec2f69759f tempest-ServerActionsV293TestJSON-1645081958 tempest-ServerActionsV293TestJSON-1645081958-project-member] Inventory has not changed in ProviderTree for provider: 62ba5f85-c74d-4b58-986e-d4197e813fd7 {{(pid=75045) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 23:28:42 user nova-compute[75045]: DEBUG nova.scheduler.client.report [None req-5469a735-96f8-4ac3-82ad-21ec2f69759f tempest-ServerActionsV293TestJSON-1645081958 tempest-ServerActionsV293TestJSON-1645081958-project-member] Inventory has not changed for provider 62ba5f85-c74d-4b58-986e-d4197e813fd7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75045) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 23:28:42 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-5469a735-96f8-4ac3-82ad-21ec2f69759f tempest-ServerActionsV293TestJSON-1645081958 tempest-ServerActionsV293TestJSON-1645081958-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.508s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:28:42 user nova-compute[75045]: INFO nova.scheduler.client.report [None req-5469a735-96f8-4ac3-82ad-21ec2f69759f tempest-ServerActionsV293TestJSON-1645081958 tempest-ServerActionsV293TestJSON-1645081958-project-member] Deleted allocations for instance 667d20c3-3eda-4aa5-b799-6dcee3443833
Nov 08 23:28:42 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:28:42 user nova-compute[75045]: DEBUG nova.compute.manager [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Starting heal instance info cache {{(pid=75045) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 23:28:43 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-5469a735-96f8-4ac3-82ad-21ec2f69759f tempest-ServerActionsV293TestJSON-1645081958 tempest-ServerActionsV293TestJSON-1645081958-project-member] Lock "667d20c3-3eda-4aa5-b799-6dcee3443833" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 10.124s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:28:43 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Acquiring lock "refresh_cache-25cd59d1-6884-471a-813e-52e97c2e1208" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 23:28:43 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Acquired lock "refresh_cache-25cd59d1-6884-471a-813e-52e97c2e1208" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 23:28:43 user nova-compute[75045]: DEBUG nova.network.neutron [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] [instance: 25cd59d1-6884-471a-813e-52e97c2e1208] Forcefully refreshing network info cache for instance {{(pid=75045) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 23:28:43 user nova-compute[75045]: DEBUG nova.network.neutron [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] [instance: 25cd59d1-6884-471a-813e-52e97c2e1208] Updating instance_info_cache with network_info: [{"id": "43fa5cbb-d817-41af-8e03-3be477de48c8", "address": "fa:16:3e:bd:cb:ae", "network": {"id": "b584f5a8-5791-4f2f-9846-8f4929b1f061", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1436131566-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.220", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ea775ad7c664da7ab23a480d913dda4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43fa5cbb-d8", "ovs_interfaceid": "43fa5cbb-d817-41af-8e03-3be477de48c8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75045) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 23:28:43 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Releasing lock "refresh_cache-25cd59d1-6884-471a-813e-52e97c2e1208" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 23:28:43 user nova-compute[75045]: DEBUG nova.compute.manager [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] [instance: 25cd59d1-6884-471a-813e-52e97c2e1208] Updated the network info_cache for instance {{(pid=75045) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 23:28:43 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager.update_available_resource {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:28:43 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:28:43 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:28:43 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:28:43 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Auditing locally available compute resources for user (node: user) {{(pid=75045) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 23:28:44 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:28:44 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72c9d731-2b35-434c-8463-1cd6c18fbd6a/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:28:44 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72c9d731-2b35-434c-8463-1cd6c18fbd6a/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:28:44 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72c9d731-2b35-434c-8463-1cd6c18fbd6a/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:28:44 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72c9d731-2b35-434c-8463-1cd6c18fbd6a/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:28:44 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ae5ff6b-6f2c-4dfd-a4c6-da4809e2cf27/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:28:44 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ae5ff6b-6f2c-4dfd-a4c6-da4809e2cf27/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:28:44 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ae5ff6b-6f2c-4dfd-a4c6-da4809e2cf27/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:28:45 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ae5ff6b-6f2c-4dfd-a4c6-da4809e2cf27/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:28:45 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] skipping disk /dev/sdh (vda) as it is a volume {{(pid=75045) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 23:28:45 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e480a3c8-a7bc-4eea-b45f-d51f5b68ac0c/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:28:45 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e480a3c8-a7bc-4eea-b45f-d51f5b68ac0c/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:28:45 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e480a3c8-a7bc-4eea-b45f-d51f5b68ac0c/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:28:45 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e480a3c8-a7bc-4eea-b45f-d51f5b68ac0c/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:28:45 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f21fcd3-ac5f-499e-9c34-82af806fda1d/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:28:45 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f21fcd3-ac5f-499e-9c34-82af806fda1d/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:28:45 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f21fcd3-ac5f-499e-9c34-82af806fda1d/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:28:45 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f21fcd3-ac5f-499e-9c34-82af806fda1d/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:28:46 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e92ab9a-8ea4-4452-a458-db181d4a59b7/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:28:46 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:28:46 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e92ab9a-8ea4-4452-a458-db181d4a59b7/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:28:46 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e92ab9a-8ea4-4452-a458-db181d4a59b7/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:28:46 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e92ab9a-8ea4-4452-a458-db181d4a59b7/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:28:46 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa67b237-f598-4111-87ba-d761aa50d95e/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:28:46 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa67b237-f598-4111-87ba-d761aa50d95e/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:28:46 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa67b237-f598-4111-87ba-d761aa50d95e/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:28:46 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa67b237-f598-4111-87ba-d761aa50d95e/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:28:46 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83d225e0-e39e-4500-b7ae-52dfbd8b8588/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:28:47 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83d225e0-e39e-4500-b7ae-52dfbd8b8588/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:28:47 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83d225e0-e39e-4500-b7ae-52dfbd8b8588/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:28:47 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83d225e0-e39e-4500-b7ae-52dfbd8b8588/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:28:47 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75045) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 23:28:47 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a3c21c4-2db3-44e1-8a23-336ca9f8374d/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:28:47 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a3c21c4-2db3-44e1-8a23-336ca9f8374d/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:28:47 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a3c21c4-2db3-44e1-8a23-336ca9f8374d/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:28:47 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a3c21c4-2db3-44e1-8a23-336ca9f8374d/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:28:47 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25cd59d1-6884-471a-813e-52e97c2e1208/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:28:47 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25cd59d1-6884-471a-813e-52e97c2e1208/disk --force-share --output=json" returned: 0 in 0.244s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:28:47 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25cd59d1-6884-471a-813e-52e97c2e1208/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:28:48 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25cd59d1-6884-471a-813e-52e97c2e1208/disk --force-share --output=json" returned: 0 in 0.239s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:28:48 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5fc7f02-2143-4bcf-92ac-078d5ec10747/disk.rescue --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:28:48 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5fc7f02-2143-4bcf-92ac-078d5ec10747/disk.rescue --force-share --output=json" returned: 0 in 0.175s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:28:48 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5fc7f02-2143-4bcf-92ac-078d5ec10747/disk.rescue --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:28:48 user nova-compute[75045]: DEBUG nova.compute.manager [None req-56f51077-3ee4-4ac3-9c15-de316f2b5518 tempest-TestStampPattern-2120781434 tempest-TestStampPattern-2120781434-project-member] [instance: 72c9d731-2b35-434c-8463-1cd6c18fbd6a] Checking state {{(pid=75045) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 23:28:48 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5fc7f02-2143-4bcf-92ac-078d5ec10747/disk.rescue --force-share --output=json" returned: 0 in 0.182s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:28:48 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5fc7f02-2143-4bcf-92ac-078d5ec10747/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:28:48 user nova-compute[75045]: INFO nova.compute.manager [None req-56f51077-3ee4-4ac3-9c15-de316f2b5518 tempest-TestStampPattern-2120781434 tempest-TestStampPattern-2120781434-project-member] [instance: 72c9d731-2b35-434c-8463-1cd6c18fbd6a] instance snapshotting
Nov 08 23:28:48 user nova-compute[75045]: INFO nova.virt.libvirt.driver [None req-56f51077-3ee4-4ac3-9c15-de316f2b5518 tempest-TestStampPattern-2120781434 tempest-TestStampPattern-2120781434-project-member] [instance: 72c9d731-2b35-434c-8463-1cd6c18fbd6a] Beginning live snapshot process
Nov 08 23:28:48 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5fc7f02-2143-4bcf-92ac-078d5ec10747/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:28:48 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5fc7f02-2143-4bcf-92ac-078d5ec10747/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:28:48 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5fc7f02-2143-4bcf-92ac-078d5ec10747/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:28:48 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b84f2b1-01a3-4789-bcef-8b7c4334132b/disk.rescue --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:28:48 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-56f51077-3ee4-4ac3-9c15-de316f2b5518 tempest-TestStampPattern-2120781434 tempest-TestStampPattern-2120781434-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72c9d731-2b35-434c-8463-1cd6c18fbd6a/disk --force-share --output=json -f qcow2 {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:28:49 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b84f2b1-01a3-4789-bcef-8b7c4334132b/disk.rescue --force-share --output=json" returned: 0 in 0.212s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:28:49 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b84f2b1-01a3-4789-bcef-8b7c4334132b/disk.rescue --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:28:49 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-56f51077-3ee4-4ac3-9c15-de316f2b5518 tempest-TestStampPattern-2120781434 tempest-TestStampPattern-2120781434-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72c9d731-2b35-434c-8463-1cd6c18fbd6a/disk --force-share --output=json -f qcow2" returned: 0 in 0.192s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:28:49 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-56f51077-3ee4-4ac3-9c15-de316f2b5518 tempest-TestStampPattern-2120781434 tempest-TestStampPattern-2120781434-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72c9d731-2b35-434c-8463-1cd6c18fbd6a/disk --force-share --output=json -f qcow2 {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:28:49 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:28:49 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b84f2b1-01a3-4789-bcef-8b7c4334132b/disk.rescue --force-share --output=json" returned: 0 in 0.188s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:28:49 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b84f2b1-01a3-4789-bcef-8b7c4334132b/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:28:49 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-56f51077-3ee4-4ac3-9c15-de316f2b5518 tempest-TestStampPattern-2120781434 tempest-TestStampPattern-2120781434-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72c9d731-2b35-434c-8463-1cd6c18fbd6a/disk --force-share --output=json -f qcow2" returned: 0 in 0.182s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:28:49 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-56f51077-3ee4-4ac3-9c15-de316f2b5518 tempest-TestStampPattern-2120781434 tempest-TestStampPattern-2120781434-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b59f52a99fff51c56dd1edfb83892fb8f647f2f3 --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:28:49 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b84f2b1-01a3-4789-bcef-8b7c4334132b/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:28:49 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b84f2b1-01a3-4789-bcef-8b7c4334132b/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:28:49 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-56f51077-3ee4-4ac3-9c15-de316f2b5518 tempest-TestStampPattern-2120781434 tempest-TestStampPattern-2120781434-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b59f52a99fff51c56dd1edfb83892fb8f647f2f3 --force-share --output=json" returned: 0 in 0.183s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:28:49 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-56f51077-3ee4-4ac3-9c15-de316f2b5518 tempest-TestStampPattern-2120781434 tempest-TestStampPattern-2120781434-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b59f52a99fff51c56dd1edfb83892fb8f647f2f3,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpzvgwxbt6/680ed76370c84fb788f75e87fcadf5ab.delta 1073741824 {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:28:49 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-56f51077-3ee4-4ac3-9c15-de316f2b5518 tempest-TestStampPattern-2120781434 tempest-TestStampPattern-2120781434-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b59f52a99fff51c56dd1edfb83892fb8f647f2f3,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpzvgwxbt6/680ed76370c84fb788f75e87fcadf5ab.delta 1073741824" returned: 0 in 0.049s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:28:49 user nova-compute[75045]: INFO nova.virt.libvirt.driver [None req-56f51077-3ee4-4ac3-9c15-de316f2b5518 tempest-TestStampPattern-2120781434 tempest-TestStampPattern-2120781434-project-member] [instance: 72c9d731-2b35-434c-8463-1cd6c18fbd6a] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 08 23:28:49 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b84f2b1-01a3-4789-bcef-8b7c4334132b/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:28:50 user nova-compute[75045]: WARNING nova.virt.libvirt.driver [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 23:28:50 user nova-compute[75045]: WARNING nova.virt.libvirt.driver [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 23:28:50 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Hypervisor/Node resource view: name=user free_ram=7289MB free_disk=25.095176696777344GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75045) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 23:28:50 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:28:50 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:28:50 user nova-compute[75045]: DEBUG nova.virt.libvirt.guest [None req-56f51077-3ee4-4ac3-9c15-de316f2b5518 tempest-TestStampPattern-2120781434 tempest-TestStampPattern-2120781434-project-member] COPY block job progress, current cursor: 65536 final cursor: 75563008 {{(pid=75045) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 08 23:28:50 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Instance 4ae5ff6b-6f2c-4dfd-a4c6-da4809e2cf27 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75045) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 23:28:50 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Instance 0f21fcd3-ac5f-499e-9c34-82af806fda1d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75045) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 23:28:50 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Instance d2c911cf-d5f4-4c19-8335-8c7834184a7e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75045) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 23:28:50 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Instance 25cd59d1-6884-471a-813e-52e97c2e1208 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75045) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 23:28:50 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Instance b5fc7f02-2143-4bcf-92ac-078d5ec10747 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75045) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 23:28:50 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Instance 0b84f2b1-01a3-4789-bcef-8b7c4334132b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75045) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 23:28:50 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Instance fa67b237-f598-4111-87ba-d761aa50d95e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75045) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 23:28:50 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Instance 7e92ab9a-8ea4-4452-a458-db181d4a59b7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75045) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 23:28:50 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Instance 72c9d731-2b35-434c-8463-1cd6c18fbd6a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75045) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 23:28:50 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Instance 83d225e0-e39e-4500-b7ae-52dfbd8b8588 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75045) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 23:28:50 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Instance 438082fc-a83f-4305-ada6-41a8e1d645a8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75045) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 23:28:50 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Instance 04169f59-e9a6-4b50-9ad7-7f8c105a376a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75045) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 23:28:50 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Instance 1a3c21c4-2db3-44e1-8a23-336ca9f8374d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75045) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 23:28:50 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Instance e480a3c8-a7bc-4eea-b45f-d51f5b68ac0c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75045) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 23:28:50 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Total usable vcpus: 12, total allocated vcpus: 14 {{(pid=75045) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 23:28:50 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Final resource view: name=user phys_ram=16011MB used_ram=7680MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=14 pci_stats=[] {{(pid=75045) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 23:28:50 user nova-compute[75045]: DEBUG nova.virt.libvirt.guest [None req-56f51077-3ee4-4ac3-9c15-de316f2b5518 tempest-TestStampPattern-2120781434 tempest-TestStampPattern-2120781434-project-member] COPY block job progress, current cursor: 75563008 final cursor: 75563008 {{(pid=75045) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 08 23:28:50 user nova-compute[75045]: INFO nova.virt.libvirt.driver [None req-56f51077-3ee4-4ac3-9c15-de316f2b5518 tempest-TestStampPattern-2120781434 tempest-TestStampPattern-2120781434-project-member] [instance: 72c9d731-2b35-434c-8463-1cd6c18fbd6a] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 08 23:28:50 user nova-compute[75045]: DEBUG nova.compute.provider_tree [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Inventory has not changed in ProviderTree for provider: 62ba5f85-c74d-4b58-986e-d4197e813fd7 {{(pid=75045) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 23:28:50 user nova-compute[75045]: DEBUG nova.scheduler.client.report [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Inventory has not changed for provider 62ba5f85-c74d-4b58-986e-d4197e813fd7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75045) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 23:28:50 user nova-compute[75045]: DEBUG nova.privsep.utils [None req-56f51077-3ee4-4ac3-9c15-de316f2b5518 tempest-TestStampPattern-2120781434 tempest-TestStampPattern-2120781434-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75045) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 08 23:28:50 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-56f51077-3ee4-4ac3-9c15-de316f2b5518 tempest-TestStampPattern-2120781434 tempest-TestStampPattern-2120781434-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpzvgwxbt6/680ed76370c84fb788f75e87fcadf5ab.delta /opt/stack/data/nova/instances/snapshots/tmpzvgwxbt6/680ed76370c84fb788f75e87fcadf5ab {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:28:50 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Compute_service record updated for user:user {{(pid=75045) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 23:28:50 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.814s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:28:51 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:28:51 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:28:51 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:28:51 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:28:51 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-56f51077-3ee4-4ac3-9c15-de316f2b5518 tempest-TestStampPattern-2120781434 tempest-TestStampPattern-2120781434-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpzvgwxbt6/680ed76370c84fb788f75e87fcadf5ab.delta /opt/stack/data/nova/instances/snapshots/tmpzvgwxbt6/680ed76370c84fb788f75e87fcadf5ab" returned: 0 in 0.428s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:28:51 user nova-compute[75045]: INFO nova.virt.libvirt.driver [None req-56f51077-3ee4-4ac3-9c15-de316f2b5518 tempest-TestStampPattern-2120781434 tempest-TestStampPattern-2120781434-project-member] [instance: 72c9d731-2b35-434c-8463-1cd6c18fbd6a] Snapshot extracted, beginning image upload
Nov 08 23:28:53 user nova-compute[75045]: INFO nova.virt.libvirt.driver [None req-56f51077-3ee4-4ac3-9c15-de316f2b5518 tempest-TestStampPattern-2120781434 tempest-TestStampPattern-2120781434-project-member] [instance: 72c9d731-2b35-434c-8463-1cd6c18fbd6a] Snapshot image upload complete
Nov 08 23:28:53 user nova-compute[75045]: INFO nova.compute.manager [None req-56f51077-3ee4-4ac3-9c15-de316f2b5518 tempest-TestStampPattern-2120781434 tempest-TestStampPattern-2120781434-project-member] [instance: 72c9d731-2b35-434c-8463-1cd6c18fbd6a] Took 5.46 seconds to snapshot the instance on the hypervisor.
Nov 08 23:28:54 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:28:56 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:28:56 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-8f8d35b3-e3a1-41ec-902e-95dc07664939 tempest-TestStampPattern-2120781434 tempest-TestStampPattern-2120781434-project-member] Acquiring lock "9fd7c34a-55e7-4d54-9c60-03a7155a2685" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:28:56 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-8f8d35b3-e3a1-41ec-902e-95dc07664939 tempest-TestStampPattern-2120781434 tempest-TestStampPattern-2120781434-project-member] Lock "9fd7c34a-55e7-4d54-9c60-03a7155a2685" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:28:56 user nova-compute[75045]: DEBUG nova.compute.manager [None req-8f8d35b3-e3a1-41ec-902e-95dc07664939 tempest-TestStampPattern-2120781434 tempest-TestStampPattern-2120781434-project-member] [instance: 9fd7c34a-55e7-4d54-9c60-03a7155a2685] Starting instance... {{(pid=75045) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 23:28:56 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-8f8d35b3-e3a1-41ec-902e-95dc07664939 tempest-TestStampPattern-2120781434 tempest-TestStampPattern-2120781434-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:28:56 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-8f8d35b3-e3a1-41ec-902e-95dc07664939 tempest-TestStampPattern-2120781434 tempest-TestStampPattern-2120781434-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:28:56 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-8f8d35b3-e3a1-41ec-902e-95dc07664939 tempest-TestStampPattern-2120781434 tempest-TestStampPattern-2120781434-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75045) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 23:28:56 user nova-compute[75045]: INFO nova.compute.claims [None req-8f8d35b3-e3a1-41ec-902e-95dc07664939 tempest-TestStampPattern-2120781434 tempest-TestStampPattern-2120781434-project-member] [instance: 9fd7c34a-55e7-4d54-9c60-03a7155a2685] Claim successful on node user
Nov 08 23:28:57 user nova-compute[75045]: DEBUG nova.compute.provider_tree [None req-8f8d35b3-e3a1-41ec-902e-95dc07664939 tempest-TestStampPattern-2120781434 tempest-TestStampPattern-2120781434-project-member] Inventory has not changed in ProviderTree for provider: 62ba5f85-c74d-4b58-986e-d4197e813fd7 {{(pid=75045) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 23:28:57 user nova-compute[75045]: DEBUG nova.scheduler.client.report [None req-8f8d35b3-e3a1-41ec-902e-95dc07664939 tempest-TestStampPattern-2120781434 tempest-TestStampPattern-2120781434-project-member] Inventory has not changed for provider 62ba5f85-c74d-4b58-986e-d4197e813fd7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75045) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 23:28:57 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-8f8d35b3-e3a1-41ec-902e-95dc07664939 tempest-TestStampPattern-2120781434 tempest-TestStampPattern-2120781434-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.882s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:28:57 user nova-compute[75045]: DEBUG nova.compute.manager [None req-8f8d35b3-e3a1-41ec-902e-95dc07664939 tempest-TestStampPattern-2120781434 tempest-TestStampPattern-2120781434-project-member] [instance: 9fd7c34a-55e7-4d54-9c60-03a7155a2685] Start building networks asynchronously for instance. {{(pid=75045) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 23:28:57 user nova-compute[75045]: DEBUG nova.compute.manager [None req-8f8d35b3-e3a1-41ec-902e-95dc07664939 tempest-TestStampPattern-2120781434 tempest-TestStampPattern-2120781434-project-member] [instance: 9fd7c34a-55e7-4d54-9c60-03a7155a2685] Allocating IP information in the background. {{(pid=75045) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 23:28:57 user nova-compute[75045]: DEBUG nova.network.neutron [None req-8f8d35b3-e3a1-41ec-902e-95dc07664939 tempest-TestStampPattern-2120781434 tempest-TestStampPattern-2120781434-project-member] [instance: 9fd7c34a-55e7-4d54-9c60-03a7155a2685] allocate_for_instance() {{(pid=75045) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 23:28:57 user nova-compute[75045]: INFO nova.virt.libvirt.driver [None req-8f8d35b3-e3a1-41ec-902e-95dc07664939 tempest-TestStampPattern-2120781434 tempest-TestStampPattern-2120781434-project-member] [instance: 9fd7c34a-55e7-4d54-9c60-03a7155a2685] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 23:28:57 user nova-compute[75045]: DEBUG nova.compute.manager [None req-8f8d35b3-e3a1-41ec-902e-95dc07664939 tempest-TestStampPattern-2120781434 tempest-TestStampPattern-2120781434-project-member] [instance: 9fd7c34a-55e7-4d54-9c60-03a7155a2685] Start building block device mappings for instance. {{(pid=75045) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 23:28:58 user nova-compute[75045]: DEBUG nova.policy [None req-8f8d35b3-e3a1-41ec-902e-95dc07664939 tempest-TestStampPattern-2120781434 tempest-TestStampPattern-2120781434-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5aea9d6528d3454eaf0f8b2cc9df7c46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824ed65954dd4eccbe68827aa92fd99f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75045) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 23:28:58 user nova-compute[75045]: DEBUG nova.compute.manager [None req-8f8d35b3-e3a1-41ec-902e-95dc07664939 tempest-TestStampPattern-2120781434 tempest-TestStampPattern-2120781434-project-member] [instance: 9fd7c34a-55e7-4d54-9c60-03a7155a2685] Start spawning the instance on the hypervisor. {{(pid=75045) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 23:28:58 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-8f8d35b3-e3a1-41ec-902e-95dc07664939 tempest-TestStampPattern-2120781434 tempest-TestStampPattern-2120781434-project-member] [instance: 9fd7c34a-55e7-4d54-9c60-03a7155a2685] Creating instance directory {{(pid=75045) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 23:28:58 user nova-compute[75045]: INFO nova.virt.libvirt.driver [None req-8f8d35b3-e3a1-41ec-902e-95dc07664939 tempest-TestStampPattern-2120781434 tempest-TestStampPattern-2120781434-project-member] [instance: 9fd7c34a-55e7-4d54-9c60-03a7155a2685] Creating image(s)
Nov 08 23:28:58 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-8f8d35b3-e3a1-41ec-902e-95dc07664939 tempest-TestStampPattern-2120781434 tempest-TestStampPattern-2120781434-project-member] Acquiring lock "/opt/stack/data/nova/instances/9fd7c34a-55e7-4d54-9c60-03a7155a2685/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:28:58 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-8f8d35b3-e3a1-41ec-902e-95dc07664939 tempest-TestStampPattern-2120781434 tempest-TestStampPattern-2120781434-project-member] Lock "/opt/stack/data/nova/instances/9fd7c34a-55e7-4d54-9c60-03a7155a2685/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:28:58 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-8f8d35b3-e3a1-41ec-902e-95dc07664939 tempest-TestStampPattern-2120781434 tempest-TestStampPattern-2120781434-project-member] Lock "/opt/stack/data/nova/instances/9fd7c34a-55e7-4d54-9c60-03a7155a2685/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:28:58 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-8f8d35b3-e3a1-41ec-902e-95dc07664939 tempest-TestStampPattern-2120781434 tempest-TestStampPattern-2120781434-project-member] Acquiring lock "b85a17781a80b384220ab457c3081a93e05fbde2" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:28:58 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-8f8d35b3-e3a1-41ec-902e-95dc07664939 tempest-TestStampPattern-2120781434 tempest-TestStampPattern-2120781434-project-member] Lock "b85a17781a80b384220ab457c3081a93e05fbde2" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:28:59 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-8f8d35b3-e3a1-41ec-902e-95dc07664939 tempest-TestStampPattern-2120781434 tempest-TestStampPattern-2120781434-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b85a17781a80b384220ab457c3081a93e05fbde2.part --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:28:59 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:28:59 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-8f8d35b3-e3a1-41ec-902e-95dc07664939 tempest-TestStampPattern-2120781434 tempest-TestStampPattern-2120781434-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b85a17781a80b384220ab457c3081a93e05fbde2.part --force-share --output=json" returned: 0 in 0.188s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:28:59 user nova-compute[75045]: DEBUG nova.virt.images [None req-8f8d35b3-e3a1-41ec-902e-95dc07664939 tempest-TestStampPattern-2120781434 tempest-TestStampPattern-2120781434-project-member] 201699ba-9f03-463e-960f-cd2e1c5324e9 was qcow2, converting to raw {{(pid=75045) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 08 23:28:59 user nova-compute[75045]: DEBUG nova.privsep.utils [None req-8f8d35b3-e3a1-41ec-902e-95dc07664939 tempest-TestStampPattern-2120781434 tempest-TestStampPattern-2120781434-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75045) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 08 23:28:59 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-8f8d35b3-e3a1-41ec-902e-95dc07664939 tempest-TestStampPattern-2120781434 tempest-TestStampPattern-2120781434-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/b85a17781a80b384220ab457c3081a93e05fbde2.part /opt/stack/data/nova/instances/_base/b85a17781a80b384220ab457c3081a93e05fbde2.converted {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:29:00 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-8f8d35b3-e3a1-41ec-902e-95dc07664939 tempest-TestStampPattern-2120781434 tempest-TestStampPattern-2120781434-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/b85a17781a80b384220ab457c3081a93e05fbde2.part /opt/stack/data/nova/instances/_base/b85a17781a80b384220ab457c3081a93e05fbde2.converted" returned: 0 in 0.515s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:29:00 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-8f8d35b3-e3a1-41ec-902e-95dc07664939 tempest-TestStampPattern-2120781434 tempest-TestStampPattern-2120781434-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b85a17781a80b384220ab457c3081a93e05fbde2.converted --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:29:00 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-8f8d35b3-e3a1-41ec-902e-95dc07664939 tempest-TestStampPattern-2120781434 tempest-TestStampPattern-2120781434-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b85a17781a80b384220ab457c3081a93e05fbde2.converted --force-share --output=json" returned: 0 in 0.178s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:29:00 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-8f8d35b3-e3a1-41ec-902e-95dc07664939 tempest-TestStampPattern-2120781434 tempest-TestStampPattern-2120781434-project-member] Lock "b85a17781a80b384220ab457c3081a93e05fbde2" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.239s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:29:00 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-8f8d35b3-e3a1-41ec-902e-95dc07664939 tempest-TestStampPattern-2120781434 tempest-TestStampPattern-2120781434-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b85a17781a80b384220ab457c3081a93e05fbde2 --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:29:00 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:29:00 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-8f8d35b3-e3a1-41ec-902e-95dc07664939 tempest-TestStampPattern-2120781434 tempest-TestStampPattern-2120781434-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b85a17781a80b384220ab457c3081a93e05fbde2 --force-share --output=json" returned: 0 in 0.191s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:29:00 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-8f8d35b3-e3a1-41ec-902e-95dc07664939 tempest-TestStampPattern-2120781434 tempest-TestStampPattern-2120781434-project-member] Acquiring lock "b85a17781a80b384220ab457c3081a93e05fbde2" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:29:00 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-8f8d35b3-e3a1-41ec-902e-95dc07664939 tempest-TestStampPattern-2120781434 tempest-TestStampPattern-2120781434-project-member] Lock "b85a17781a80b384220ab457c3081a93e05fbde2" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:29:00 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-8f8d35b3-e3a1-41ec-902e-95dc07664939 tempest-TestStampPattern-2120781434 tempest-TestStampPattern-2120781434-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b85a17781a80b384220ab457c3081a93e05fbde2 --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:29:00 user nova-compute[75045]: DEBUG nova.network.neutron [None req-8f8d35b3-e3a1-41ec-902e-95dc07664939 tempest-TestStampPattern-2120781434 tempest-TestStampPattern-2120781434-project-member] [instance: 9fd7c34a-55e7-4d54-9c60-03a7155a2685] Successfully created port: b44611d2-ca0a-4e01-b44d-cdf537474195 {{(pid=75045) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 23:29:00 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-8f8d35b3-e3a1-41ec-902e-95dc07664939 tempest-TestStampPattern-2120781434 tempest-TestStampPattern-2120781434-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b85a17781a80b384220ab457c3081a93e05fbde2 --force-share --output=json" returned: 0 in 0.209s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:29:00 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-8f8d35b3-e3a1-41ec-902e-95dc07664939 tempest-TestStampPattern-2120781434 tempest-TestStampPattern-2120781434-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b85a17781a80b384220ab457c3081a93e05fbde2,backing_fmt=raw /opt/stack/data/nova/instances/9fd7c34a-55e7-4d54-9c60-03a7155a2685/disk 1073741824 {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:29:00 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-8f8d35b3-e3a1-41ec-902e-95dc07664939 tempest-TestStampPattern-2120781434 tempest-TestStampPattern-2120781434-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b85a17781a80b384220ab457c3081a93e05fbde2,backing_fmt=raw /opt/stack/data/nova/instances/9fd7c34a-55e7-4d54-9c60-03a7155a2685/disk 1073741824" returned: 0 in 0.061s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:29:00 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-8f8d35b3-e3a1-41ec-902e-95dc07664939 tempest-TestStampPattern-2120781434 tempest-TestStampPattern-2120781434-project-member] Lock "b85a17781a80b384220ab457c3081a93e05fbde2" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.277s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:29:00 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-8f8d35b3-e3a1-41ec-902e-95dc07664939 tempest-TestStampPattern-2120781434 tempest-TestStampPattern-2120781434-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b85a17781a80b384220ab457c3081a93e05fbde2 --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:29:01 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-8f8d35b3-e3a1-41ec-902e-95dc07664939 tempest-TestStampPattern-2120781434 tempest-TestStampPattern-2120781434-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b85a17781a80b384220ab457c3081a93e05fbde2 --force-share --output=json" returned: 0 in 0.216s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:29:01 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-8f8d35b3-e3a1-41ec-902e-95dc07664939 tempest-TestStampPattern-2120781434 tempest-TestStampPattern-2120781434-project-member] [instance: 9fd7c34a-55e7-4d54-9c60-03a7155a2685] Created local disks {{(pid=75045) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 23:29:01 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-8f8d35b3-e3a1-41ec-902e-95dc07664939 tempest-TestStampPattern-2120781434 tempest-TestStampPattern-2120781434-project-member] [instance: 9fd7c34a-55e7-4d54-9c60-03a7155a2685] Ensure instance console log exists: /opt/stack/data/nova/instances/9fd7c34a-55e7-4d54-9c60-03a7155a2685/console.log {{(pid=75045) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 23:29:01 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-8f8d35b3-e3a1-41ec-902e-95dc07664939 tempest-TestStampPattern-2120781434 tempest-TestStampPattern-2120781434-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:29:01 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-8f8d35b3-e3a1-41ec-902e-95dc07664939 tempest-TestStampPattern-2120781434 tempest-TestStampPattern-2120781434-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:29:01 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-8f8d35b3-e3a1-41ec-902e-95dc07664939 tempest-TestStampPattern-2120781434 tempest-TestStampPattern-2120781434-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:29:01 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:29:01 user nova-compute[75045]: DEBUG nova.network.neutron [None req-8f8d35b3-e3a1-41ec-902e-95dc07664939 tempest-TestStampPattern-2120781434 tempest-TestStampPattern-2120781434-project-member] [instance: 9fd7c34a-55e7-4d54-9c60-03a7155a2685] Successfully updated port: b44611d2-ca0a-4e01-b44d-cdf537474195 {{(pid=75045) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 23:29:01 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-8f8d35b3-e3a1-41ec-902e-95dc07664939 tempest-TestStampPattern-2120781434 tempest-TestStampPattern-2120781434-project-member] Acquiring lock "refresh_cache-9fd7c34a-55e7-4d54-9c60-03a7155a2685" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 23:29:01 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-8f8d35b3-e3a1-41ec-902e-95dc07664939 tempest-TestStampPattern-2120781434 tempest-TestStampPattern-2120781434-project-member] Acquired lock "refresh_cache-9fd7c34a-55e7-4d54-9c60-03a7155a2685" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 23:29:01 user nova-compute[75045]: DEBUG nova.network.neutron [None req-8f8d35b3-e3a1-41ec-902e-95dc07664939 tempest-TestStampPattern-2120781434 tempest-TestStampPattern-2120781434-project-member] [instance: 9fd7c34a-55e7-4d54-9c60-03a7155a2685] Building network info cache for instance {{(pid=75045) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 23:29:01 user nova-compute[75045]: DEBUG nova.compute.manager [req-e5cee4d3-0455-4aec-bffb-cee9c977a032 req-5452e104-182e-4404-91e1-5a038dcb8d30 service nova] [instance: 9fd7c34a-55e7-4d54-9c60-03a7155a2685] Received event network-changed-b44611d2-ca0a-4e01-b44d-cdf537474195 {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:29:01 user nova-compute[75045]: DEBUG nova.compute.manager [req-e5cee4d3-0455-4aec-bffb-cee9c977a032 req-5452e104-182e-4404-91e1-5a038dcb8d30 service nova] [instance: 9fd7c34a-55e7-4d54-9c60-03a7155a2685] Refreshing instance network info cache due to event network-changed-b44611d2-ca0a-4e01-b44d-cdf537474195. {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 23:29:01 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-e5cee4d3-0455-4aec-bffb-cee9c977a032 req-5452e104-182e-4404-91e1-5a038dcb8d30 service nova] Acquiring lock "refresh_cache-9fd7c34a-55e7-4d54-9c60-03a7155a2685" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 23:29:01 user nova-compute[75045]: DEBUG nova.network.neutron [None req-8f8d35b3-e3a1-41ec-902e-95dc07664939 tempest-TestStampPattern-2120781434 tempest-TestStampPattern-2120781434-project-member] [instance: 9fd7c34a-55e7-4d54-9c60-03a7155a2685] Instance cache missing network info. {{(pid=75045) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 23:29:01 user nova-compute[75045]: DEBUG nova.network.neutron [None req-8f8d35b3-e3a1-41ec-902e-95dc07664939 tempest-TestStampPattern-2120781434 tempest-TestStampPattern-2120781434-project-member] [instance: 9fd7c34a-55e7-4d54-9c60-03a7155a2685] Updating instance_info_cache with network_info: [{"id": "b44611d2-ca0a-4e01-b44d-cdf537474195", "address": "fa:16:3e:64:cd:11", "network": {"id": "94c5462e-c9fd-44e6-b02b-9d46156ca7d9", "bridge": "br-int", "label": "tempest-TestStampPattern-1038298369-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "824ed65954dd4eccbe68827aa92fd99f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb44611d2-ca", "ovs_interfaceid": "b44611d2-ca0a-4e01-b44d-cdf537474195", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75045) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 23:29:01 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-8f8d35b3-e3a1-41ec-902e-95dc07664939 tempest-TestStampPattern-2120781434 tempest-TestStampPattern-2120781434-project-member] Releasing lock "refresh_cache-9fd7c34a-55e7-4d54-9c60-03a7155a2685" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 23:29:01 user nova-compute[75045]: DEBUG nova.compute.manager [None req-8f8d35b3-e3a1-41ec-902e-95dc07664939 tempest-TestStampPattern-2120781434 tempest-TestStampPattern-2120781434-project-member] [instance: 9fd7c34a-55e7-4d54-9c60-03a7155a2685] Instance network_info: |[{"id": "b44611d2-ca0a-4e01-b44d-cdf537474195", "address": "fa:16:3e:64:cd:11", "network": {"id": "94c5462e-c9fd-44e6-b02b-9d46156ca7d9", "bridge": "br-int", "label": "tempest-TestStampPattern-1038298369-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "824ed65954dd4eccbe68827aa92fd99f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb44611d2-ca", "ovs_interfaceid": "b44611d2-ca0a-4e01-b44d-cdf537474195", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75045) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 23:29:01 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-e5cee4d3-0455-4aec-bffb-cee9c977a032 req-5452e104-182e-4404-91e1-5a038dcb8d30 service nova] Acquired lock "refresh_cache-9fd7c34a-55e7-4d54-9c60-03a7155a2685" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 23:29:01 user nova-compute[75045]: DEBUG nova.network.neutron [req-e5cee4d3-0455-4aec-bffb-cee9c977a032 req-5452e104-182e-4404-91e1-5a038dcb8d30 service nova] [instance: 9fd7c34a-55e7-4d54-9c60-03a7155a2685] Refreshing network info cache for port b44611d2-ca0a-4e01-b44d-cdf537474195 {{(pid=75045) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 23:29:01 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-8f8d35b3-e3a1-41ec-902e-95dc07664939 tempest-TestStampPattern-2120781434 tempest-TestStampPattern-2120781434-project-member] [instance: 9fd7c34a-55e7-4d54-9c60-03a7155a2685] Start _get_guest_xml network_info=[{"id": "b44611d2-ca0a-4e01-b44d-cdf537474195", "address": "fa:16:3e:64:cd:11", "network": {"id": "94c5462e-c9fd-44e6-b02b-9d46156ca7d9", "bridge": "br-int", "label": "tempest-TestStampPattern-1038298369-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "824ed65954dd4eccbe68827aa92fd99f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb44611d2-ca", "ovs_interfaceid": "b44611d2-ca0a-4e01-b44d-cdf537474195", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='1281ac36725b04cea5045dc9ce1a3aac',container_format='bare',created_at=2023-11-08T23:28:48Z,direct_url=<?>,disk_format='qcow2',id=201699ba-9f03-463e-960f-cd2e1c5324e9,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-260706046',owner='824ed65954dd4eccbe68827aa92fd99f',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-08T23:28:54Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'disk_bus': 'virtio', 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': '201699ba-9f03-463e-960f-cd2e1c5324e9'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75045) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 23:29:01 user nova-compute[75045]: WARNING nova.virt.libvirt.driver [None req-8f8d35b3-e3a1-41ec-902e-95dc07664939 tempest-TestStampPattern-2120781434 tempest-TestStampPattern-2120781434-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 23:29:01 user nova-compute[75045]: WARNING nova.virt.libvirt.driver [None req-8f8d35b3-e3a1-41ec-902e-95dc07664939 tempest-TestStampPattern-2120781434 tempest-TestStampPattern-2120781434-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 23:29:01 user nova-compute[75045]: DEBUG nova.virt.libvirt.host [None req-8f8d35b3-e3a1-41ec-902e-95dc07664939 tempest-TestStampPattern-2120781434 tempest-TestStampPattern-2120781434-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75045) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 23:29:01 user nova-compute[75045]: DEBUG nova.virt.libvirt.host [None req-8f8d35b3-e3a1-41ec-902e-95dc07664939 tempest-TestStampPattern-2120781434 tempest-TestStampPattern-2120781434-project-member] CPU controller missing on host. {{(pid=75045) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 23:29:01 user nova-compute[75045]: DEBUG nova.virt.libvirt.host [None req-8f8d35b3-e3a1-41ec-902e-95dc07664939 tempest-TestStampPattern-2120781434 tempest-TestStampPattern-2120781434-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75045) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 23:29:01 user nova-compute[75045]: DEBUG nova.virt.libvirt.host [None req-8f8d35b3-e3a1-41ec-902e-95dc07664939 tempest-TestStampPattern-2120781434 tempest-TestStampPattern-2120781434-project-member] CPU controller found on host. {{(pid=75045) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 23:29:01 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-8f8d35b3-e3a1-41ec-902e-95dc07664939 tempest-TestStampPattern-2120781434 tempest-TestStampPattern-2120781434-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75045) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 23:29:01 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-8f8d35b3-e3a1-41ec-902e-95dc07664939 tempest-TestStampPattern-2120781434 tempest-TestStampPattern-2120781434-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T23:11:41Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='1281ac36725b04cea5045dc9ce1a3aac',container_format='bare',created_at=2023-11-08T23:28:48Z,direct_url=<?>,disk_format='qcow2',id=201699ba-9f03-463e-960f-cd2e1c5324e9,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-260706046',owner='824ed65954dd4eccbe68827aa92fd99f',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-08T23:28:54Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75045) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 23:29:01 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-8f8d35b3-e3a1-41ec-902e-95dc07664939 tempest-TestStampPattern-2120781434 tempest-TestStampPattern-2120781434-project-member] Flavor limits 0:0:0 {{(pid=75045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 23:29:01 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-8f8d35b3-e3a1-41ec-902e-95dc07664939 tempest-TestStampPattern-2120781434 tempest-TestStampPattern-2120781434-project-member] Image limits 0:0:0 {{(pid=75045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 23:29:01 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-8f8d35b3-e3a1-41ec-902e-95dc07664939 tempest-TestStampPattern-2120781434 tempest-TestStampPattern-2120781434-project-member] Flavor pref 0:0:0 {{(pid=75045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 23:29:01 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-8f8d35b3-e3a1-41ec-902e-95dc07664939 tempest-TestStampPattern-2120781434 tempest-TestStampPattern-2120781434-project-member] Image pref 0:0:0 {{(pid=75045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 23:29:01 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-8f8d35b3-e3a1-41ec-902e-95dc07664939 tempest-TestStampPattern-2120781434 tempest-TestStampPattern-2120781434-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 23:29:01 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-8f8d35b3-e3a1-41ec-902e-95dc07664939 tempest-TestStampPattern-2120781434 tempest-TestStampPattern-2120781434-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75045) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 23:29:01 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-8f8d35b3-e3a1-41ec-902e-95dc07664939 tempest-TestStampPattern-2120781434 tempest-TestStampPattern-2120781434-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75045) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 23:29:01 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-8f8d35b3-e3a1-41ec-902e-95dc07664939 tempest-TestStampPattern-2120781434 tempest-TestStampPattern-2120781434-project-member] Got 1 possible topologies {{(pid=75045) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 23:29:01 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-8f8d35b3-e3a1-41ec-902e-95dc07664939 tempest-TestStampPattern-2120781434 tempest-TestStampPattern-2120781434-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75045) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 23:29:01 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-8f8d35b3-e3a1-41ec-902e-95dc07664939 tempest-TestStampPattern-2120781434 tempest-TestStampPattern-2120781434-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75045) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 23:29:01 user nova-compute[75045]: DEBUG nova.virt.libvirt.vif [None req-8f8d35b3-e3a1-41ec-902e-95dc07664939 tempest-TestStampPattern-2120781434 tempest-TestStampPattern-2120781434-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T23:28:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-2132300179',display_name='tempest-TestStampPattern-server-2132300179',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-2132300179',id=30,image_ref='201699ba-9f03-463e-960f-cd2e1c5324e9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEtB72lJ3QT0CbDqyUaMKflPueQqHWlBr/SKULenQ3hS/jygD0NlusOQCbd9nWih3JtFTCaVE0qH0L8SGPLvq+HuEpKiKftv45ffcKHaW5G6qCsZvzG9WD6hpehyxZCg9w==',key_name='tempest-TestStampPattern-276203308',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='824ed65954dd4eccbe68827aa92fd99f',ramdisk_id='',reservation_id='r-408nr7q1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='72c9d731-2b35-434c-8463-1cd6c18fbd6a',image_min_disk='1',image_min_ram='0',image_owner_id='824ed65954dd4eccbe68827aa92fd99f',image_owner_project_name='tempest-TestStampPattern-2120781434',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-2120781434-project-member',image_user_id='5aea9d6528d3454eaf0f8b2cc9df7c46',network_allocated='True',owner_project_name='tempest-TestStampPattern-2120781434',owner_user_name='tempest-TestStampPattern-2120781434-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T23:28:58Z,user_data=None,user_id='5aea9d6528d3454eaf0f8b2cc9df7c46',uuid=9fd7c34a-55e7-4d54-9c60-03a7155a2685,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b44611d2-ca0a-4e01-b44d-cdf537474195", "address": "fa:16:3e:64:cd:11", "network": {"id": "94c5462e-c9fd-44e6-b02b-9d46156ca7d9", "bridge": "br-int", "label": "tempest-TestStampPattern-1038298369-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "824ed65954dd4eccbe68827aa92fd99f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb44611d2-ca", "ovs_interfaceid": "b44611d2-ca0a-4e01-b44d-cdf537474195", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75045) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 23:29:01 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-8f8d35b3-e3a1-41ec-902e-95dc07664939 tempest-TestStampPattern-2120781434 tempest-TestStampPattern-2120781434-project-member] Converting VIF {"id": "b44611d2-ca0a-4e01-b44d-cdf537474195", "address": "fa:16:3e:64:cd:11", "network": {"id": "94c5462e-c9fd-44e6-b02b-9d46156ca7d9", "bridge": "br-int", "label": "tempest-TestStampPattern-1038298369-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "824ed65954dd4eccbe68827aa92fd99f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb44611d2-ca", "ovs_interfaceid": "b44611d2-ca0a-4e01-b44d-cdf537474195", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 23:29:01 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-8f8d35b3-e3a1-41ec-902e-95dc07664939 tempest-TestStampPattern-2120781434 tempest-TestStampPattern-2120781434-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:64:cd:11,bridge_name='br-int',has_traffic_filtering=True,id=b44611d2-ca0a-4e01-b44d-cdf537474195,network=Network(94c5462e-c9fd-44e6-b02b-9d46156ca7d9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb44611d2-ca') {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 23:29:01 user nova-compute[75045]: DEBUG nova.objects.instance [None req-8f8d35b3-e3a1-41ec-902e-95dc07664939 tempest-TestStampPattern-2120781434 tempest-TestStampPattern-2120781434-project-member] Lazy-loading 'pci_devices' on Instance uuid 9fd7c34a-55e7-4d54-9c60-03a7155a2685 {{(pid=75045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 23:29:01 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-8f8d35b3-e3a1-41ec-902e-95dc07664939 tempest-TestStampPattern-2120781434 tempest-TestStampPattern-2120781434-project-member] [instance: 9fd7c34a-55e7-4d54-9c60-03a7155a2685] End _get_guest_xml xml=<domain type="kvm">
Nov 08 23:29:01 user nova-compute[75045]:   <uuid>9fd7c34a-55e7-4d54-9c60-03a7155a2685</uuid>
Nov 08 23:29:01 user nova-compute[75045]:   <name>instance-0000001e</name>
Nov 08 23:29:01 user nova-compute[75045]:   <memory>524288</memory>
Nov 08 23:29:01 user nova-compute[75045]:   <vcpu>1</vcpu>
Nov 08 23:29:01 user nova-compute[75045]:   <metadata>
Nov 08 23:29:01 user nova-compute[75045]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 23:29:01 user nova-compute[75045]:       <nova:package version="0.0.0"/>
Nov 08 23:29:01 user nova-compute[75045]:       <nova:name>tempest-TestStampPattern-server-2132300179</nova:name>
Nov 08 23:29:01 user nova-compute[75045]:       <nova:creationTime>2023-11-08 23:29:01</nova:creationTime>
Nov 08 23:29:01 user nova-compute[75045]:       <nova:flavor name="m1.tiny">
Nov 08 23:29:01 user nova-compute[75045]:         <nova:memory>512</nova:memory>
Nov 08 23:29:01 user nova-compute[75045]:         <nova:disk>1</nova:disk>
Nov 08 23:29:01 user nova-compute[75045]:         <nova:swap>0</nova:swap>
Nov 08 23:29:01 user nova-compute[75045]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 23:29:01 user nova-compute[75045]:         <nova:vcpus>1</nova:vcpus>
Nov 08 23:29:01 user nova-compute[75045]:       </nova:flavor>
Nov 08 23:29:01 user nova-compute[75045]:       <nova:owner>
Nov 08 23:29:01 user nova-compute[75045]:         <nova:user uuid="5aea9d6528d3454eaf0f8b2cc9df7c46">tempest-TestStampPattern-2120781434-project-member</nova:user>
Nov 08 23:29:01 user nova-compute[75045]:         <nova:project uuid="824ed65954dd4eccbe68827aa92fd99f">tempest-TestStampPattern-2120781434</nova:project>
Nov 08 23:29:01 user nova-compute[75045]:       </nova:owner>
Nov 08 23:29:01 user nova-compute[75045]:       <nova:root type="image" uuid="201699ba-9f03-463e-960f-cd2e1c5324e9"/>
Nov 08 23:29:01 user nova-compute[75045]:       <nova:ports>
Nov 08 23:29:01 user nova-compute[75045]:         <nova:port uuid="b44611d2-ca0a-4e01-b44d-cdf537474195">
Nov 08 23:29:01 user nova-compute[75045]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 08 23:29:01 user nova-compute[75045]:         </nova:port>
Nov 08 23:29:01 user nova-compute[75045]:       </nova:ports>
Nov 08 23:29:01 user nova-compute[75045]:     </nova:instance>
Nov 08 23:29:01 user nova-compute[75045]:   </metadata>
Nov 08 23:29:01 user nova-compute[75045]:   <sysinfo type="smbios">
Nov 08 23:29:01 user nova-compute[75045]:     <system>
Nov 08 23:29:01 user nova-compute[75045]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 23:29:01 user nova-compute[75045]:       <entry name="product">OpenStack Nova</entry>
Nov 08 23:29:01 user nova-compute[75045]:       <entry name="version">0.0.0</entry>
Nov 08 23:29:01 user nova-compute[75045]:       <entry name="serial">9fd7c34a-55e7-4d54-9c60-03a7155a2685</entry>
Nov 08 23:29:01 user nova-compute[75045]:       <entry name="uuid">9fd7c34a-55e7-4d54-9c60-03a7155a2685</entry>
Nov 08 23:29:01 user nova-compute[75045]:       <entry name="family">Virtual Machine</entry>
Nov 08 23:29:01 user nova-compute[75045]:     </system>
Nov 08 23:29:01 user nova-compute[75045]:   </sysinfo>
Nov 08 23:29:01 user nova-compute[75045]:   <os>
Nov 08 23:29:01 user nova-compute[75045]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 23:29:01 user nova-compute[75045]:     <boot dev="hd"/>
Nov 08 23:29:01 user nova-compute[75045]:     <smbios mode="sysinfo"/>
Nov 08 23:29:01 user nova-compute[75045]:   </os>
Nov 08 23:29:01 user nova-compute[75045]:   <features>
Nov 08 23:29:01 user nova-compute[75045]:     <acpi/>
Nov 08 23:29:01 user nova-compute[75045]:     <apic/>
Nov 08 23:29:01 user nova-compute[75045]:     <vmcoreinfo/>
Nov 08 23:29:01 user nova-compute[75045]:   </features>
Nov 08 23:29:01 user nova-compute[75045]:   <clock offset="utc">
Nov 08 23:29:01 user nova-compute[75045]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 23:29:01 user nova-compute[75045]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 23:29:01 user nova-compute[75045]:     <timer name="hpet" present="no"/>
Nov 08 23:29:01 user nova-compute[75045]:   </clock>
Nov 08 23:29:01 user nova-compute[75045]:   <cpu mode="custom" match="exact">
Nov 08 23:29:01 user nova-compute[75045]:     <model>Nehalem</model>
Nov 08 23:29:01 user nova-compute[75045]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 23:29:01 user nova-compute[75045]:   </cpu>
Nov 08 23:29:01 user nova-compute[75045]:   <devices>
Nov 08 23:29:01 user nova-compute[75045]:     <disk type="file" device="disk">
Nov 08 23:29:01 user nova-compute[75045]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 23:29:01 user nova-compute[75045]:       <source file="/opt/stack/data/nova/instances/9fd7c34a-55e7-4d54-9c60-03a7155a2685/disk"/>
Nov 08 23:29:01 user nova-compute[75045]:       <target dev="vda" bus="virtio"/>
Nov 08 23:29:01 user nova-compute[75045]:     </disk>
Nov 08 23:29:01 user nova-compute[75045]:     <interface type="ethernet">
Nov 08 23:29:01 user nova-compute[75045]:       <mac address="fa:16:3e:64:cd:11"/>
Nov 08 23:29:01 user nova-compute[75045]:       <model type="virtio"/>
Nov 08 23:29:01 user nova-compute[75045]:       <mtu size="1442"/>
Nov 08 23:29:01 user nova-compute[75045]:       <target dev="tapb44611d2-ca"/>
Nov 08 23:29:01 user nova-compute[75045]:     </interface>
Nov 08 23:29:01 user nova-compute[75045]:     <serial type="pty">
Nov 08 23:29:01 user nova-compute[75045]:       <log file="/opt/stack/data/nova/instances/9fd7c34a-55e7-4d54-9c60-03a7155a2685/console.log" append="off"/>
Nov 08 23:29:01 user nova-compute[75045]:     </serial>
Nov 08 23:29:01 user nova-compute[75045]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 23:29:01 user nova-compute[75045]:     <video>
Nov 08 23:29:01 user nova-compute[75045]:       <model type="virtio"/>
Nov 08 23:29:01 user nova-compute[75045]:     </video>
Nov 08 23:29:01 user nova-compute[75045]:     <rng model="virtio">
Nov 08 23:29:01 user nova-compute[75045]:       <backend model="random">/dev/urandom</backend>
Nov 08 23:29:01 user nova-compute[75045]:     </rng>
Nov 08 23:29:01 user nova-compute[75045]:     <controller type="usb" index="0" model="none"/>
Nov 08 23:29:01 user nova-compute[75045]:     <memballoon model="virtio">
Nov 08 23:29:01 user nova-compute[75045]:       <stats period="10"/>
Nov 08 23:29:01 user nova-compute[75045]:     </memballoon>
Nov 08 23:29:01 user nova-compute[75045]:   </devices>
Nov 08 23:29:01 user nova-compute[75045]: </domain>
Nov 08 23:29:01 user nova-compute[75045]:  {{(pid=75045) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 23:29:02 user nova-compute[75045]: DEBUG nova.virt.libvirt.vif [None req-8f8d35b3-e3a1-41ec-902e-95dc07664939 tempest-TestStampPattern-2120781434 tempest-TestStampPattern-2120781434-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T23:28:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-2132300179',display_name='tempest-TestStampPattern-server-2132300179',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-2132300179',id=30,image_ref='201699ba-9f03-463e-960f-cd2e1c5324e9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEtB72lJ3QT0CbDqyUaMKflPueQqHWlBr/SKULenQ3hS/jygD0NlusOQCbd9nWih3JtFTCaVE0qH0L8SGPLvq+HuEpKiKftv45ffcKHaW5G6qCsZvzG9WD6hpehyxZCg9w==',key_name='tempest-TestStampPattern-276203308',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='824ed65954dd4eccbe68827aa92fd99f',ramdisk_id='',reservation_id='r-408nr7q1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='72c9d731-2b35-434c-8463-1cd6c18fbd6a',image_min_disk='1',image_min_ram='0',image_owner_id='824ed65954dd4eccbe68827aa92fd99f',image_owner_project_name='tempest-TestStampPattern-2120781434',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-2120781434-project-member',image_user_id='5aea9d6528d3454eaf0f8b2cc9df7c46',network_allocated='True',owner_project_name='tempest-TestStampPattern-2120781434',owner_user_name='tempest-TestStampPattern-2120781434-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T23:28:58Z,user_data=None,user_id='5aea9d6528d3454eaf0f8b2cc9df7c46',uuid=9fd7c34a-55e7-4d54-9c60-03a7155a2685,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b44611d2-ca0a-4e01-b44d-cdf537474195", "address": "fa:16:3e:64:cd:11", "network": {"id": "94c5462e-c9fd-44e6-b02b-9d46156ca7d9", "bridge": "br-int", "label": "tempest-TestStampPattern-1038298369-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "824ed65954dd4eccbe68827aa92fd99f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb44611d2-ca", "ovs_interfaceid": "b44611d2-ca0a-4e01-b44d-cdf537474195", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75045) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 23:29:02 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-8f8d35b3-e3a1-41ec-902e-95dc07664939 tempest-TestStampPattern-2120781434 tempest-TestStampPattern-2120781434-project-member] Converting VIF {"id": "b44611d2-ca0a-4e01-b44d-cdf537474195", "address": "fa:16:3e:64:cd:11", "network": {"id": "94c5462e-c9fd-44e6-b02b-9d46156ca7d9", "bridge": "br-int", "label": "tempest-TestStampPattern-1038298369-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "824ed65954dd4eccbe68827aa92fd99f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb44611d2-ca", "ovs_interfaceid": "b44611d2-ca0a-4e01-b44d-cdf537474195", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 23:29:02 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-8f8d35b3-e3a1-41ec-902e-95dc07664939 tempest-TestStampPattern-2120781434 tempest-TestStampPattern-2120781434-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:64:cd:11,bridge_name='br-int',has_traffic_filtering=True,id=b44611d2-ca0a-4e01-b44d-cdf537474195,network=Network(94c5462e-c9fd-44e6-b02b-9d46156ca7d9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb44611d2-ca') {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 23:29:02 user nova-compute[75045]: DEBUG os_vif [None req-8f8d35b3-e3a1-41ec-902e-95dc07664939 tempest-TestStampPattern-2120781434 tempest-TestStampPattern-2120781434-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:64:cd:11,bridge_name='br-int',has_traffic_filtering=True,id=b44611d2-ca0a-4e01-b44d-cdf537474195,network=Network(94c5462e-c9fd-44e6-b02b-9d46156ca7d9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb44611d2-ca') {{(pid=75045) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 23:29:02 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:29:02 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:29:02 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 23:29:02 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:29:02 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b8e1a1b4-f8cd-5372-9e59-ccf2c260c6f6', '_type': 'linux-noop'}}, row=False) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:29:02 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:29:02 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 23:29:02 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:29:02 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb44611d2-ca, may_exist=True, interface_attrs={}) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:29:02 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb44611d2-ca, col_values=(('qos', UUID('a4e3a9bd-94f0-4f1f-a0df-aa7f9c027552')),), if_exists=True) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:29:02 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb44611d2-ca, col_values=(('external_ids', {'iface-id': 'b44611d2-ca0a-4e01-b44d-cdf537474195', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:64:cd:11', 'vm-uuid': '9fd7c34a-55e7-4d54-9c60-03a7155a2685'}),), if_exists=True) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:29:02 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:29:02 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 23:29:02 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:29:02 user nova-compute[75045]: INFO os_vif [None req-8f8d35b3-e3a1-41ec-902e-95dc07664939 tempest-TestStampPattern-2120781434 tempest-TestStampPattern-2120781434-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:64:cd:11,bridge_name='br-int',has_traffic_filtering=True,id=b44611d2-ca0a-4e01-b44d-cdf537474195,network=Network(94c5462e-c9fd-44e6-b02b-9d46156ca7d9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb44611d2-ca')
Nov 08 23:29:02 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-8f8d35b3-e3a1-41ec-902e-95dc07664939 tempest-TestStampPattern-2120781434 tempest-TestStampPattern-2120781434-project-member] No BDM found with device name vda, not building metadata. {{(pid=75045) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 23:29:02 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-8f8d35b3-e3a1-41ec-902e-95dc07664939 tempest-TestStampPattern-2120781434 tempest-TestStampPattern-2120781434-project-member] No VIF found with MAC fa:16:3e:64:cd:11, not building metadata {{(pid=75045) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 23:29:02 user nova-compute[75045]: DEBUG nova.network.neutron [req-e5cee4d3-0455-4aec-bffb-cee9c977a032 req-5452e104-182e-4404-91e1-5a038dcb8d30 service nova] [instance: 9fd7c34a-55e7-4d54-9c60-03a7155a2685] Updated VIF entry in instance network info cache for port b44611d2-ca0a-4e01-b44d-cdf537474195. {{(pid=75045) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 23:29:02 user nova-compute[75045]: DEBUG nova.network.neutron [req-e5cee4d3-0455-4aec-bffb-cee9c977a032 req-5452e104-182e-4404-91e1-5a038dcb8d30 service nova] [instance: 9fd7c34a-55e7-4d54-9c60-03a7155a2685] Updating instance_info_cache with network_info: [{"id": "b44611d2-ca0a-4e01-b44d-cdf537474195", "address": "fa:16:3e:64:cd:11", "network": {"id": "94c5462e-c9fd-44e6-b02b-9d46156ca7d9", "bridge": "br-int", "label": "tempest-TestStampPattern-1038298369-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "824ed65954dd4eccbe68827aa92fd99f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb44611d2-ca", "ovs_interfaceid": "b44611d2-ca0a-4e01-b44d-cdf537474195", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75045) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 23:29:02 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-e5cee4d3-0455-4aec-bffb-cee9c977a032 req-5452e104-182e-4404-91e1-5a038dcb8d30 service nova] Releasing lock "refresh_cache-9fd7c34a-55e7-4d54-9c60-03a7155a2685" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 23:29:03 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:29:03 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:29:03 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:29:03 user nova-compute[75045]: DEBUG nova.compute.manager [req-a6c1803a-b74b-44bc-a3f1-2b026c7ab88d req-10aacdcb-839d-4a7c-bf52-0ca17004c833 service nova] [instance: 9fd7c34a-55e7-4d54-9c60-03a7155a2685] Received event network-vif-plugged-b44611d2-ca0a-4e01-b44d-cdf537474195 {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:29:03 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-a6c1803a-b74b-44bc-a3f1-2b026c7ab88d req-10aacdcb-839d-4a7c-bf52-0ca17004c833 service nova] Acquiring lock "9fd7c34a-55e7-4d54-9c60-03a7155a2685-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:29:03 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-a6c1803a-b74b-44bc-a3f1-2b026c7ab88d req-10aacdcb-839d-4a7c-bf52-0ca17004c833 service nova] Lock "9fd7c34a-55e7-4d54-9c60-03a7155a2685-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:29:03 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-a6c1803a-b74b-44bc-a3f1-2b026c7ab88d req-10aacdcb-839d-4a7c-bf52-0ca17004c833 service nova] Lock "9fd7c34a-55e7-4d54-9c60-03a7155a2685-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:29:03 user nova-compute[75045]: DEBUG nova.compute.manager [req-a6c1803a-b74b-44bc-a3f1-2b026c7ab88d req-10aacdcb-839d-4a7c-bf52-0ca17004c833 service nova] [instance: 9fd7c34a-55e7-4d54-9c60-03a7155a2685] No waiting events found dispatching network-vif-plugged-b44611d2-ca0a-4e01-b44d-cdf537474195 {{(pid=75045) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 23:29:03 user nova-compute[75045]: WARNING nova.compute.manager [req-a6c1803a-b74b-44bc-a3f1-2b026c7ab88d req-10aacdcb-839d-4a7c-bf52-0ca17004c833 service nova] [instance: 9fd7c34a-55e7-4d54-9c60-03a7155a2685] Received unexpected event network-vif-plugged-b44611d2-ca0a-4e01-b44d-cdf537474195 for instance with vm_state building and task_state spawning.
Nov 08 23:29:03 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:29:03 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:29:05 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-e5c74659-7c05-4f14-9ea9-d4fa39458abe tempest-TestServerVolumeAttachmentScenario-1899063447 tempest-TestServerVolumeAttachmentScenario-1899063447-project-member] Acquiring lock "25cd59d1-6884-471a-813e-52e97c2e1208" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:29:05 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-e5c74659-7c05-4f14-9ea9-d4fa39458abe tempest-TestServerVolumeAttachmentScenario-1899063447 tempest-TestServerVolumeAttachmentScenario-1899063447-project-member] Lock "25cd59d1-6884-471a-813e-52e97c2e1208" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:29:05 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-e5c74659-7c05-4f14-9ea9-d4fa39458abe tempest-TestServerVolumeAttachmentScenario-1899063447 tempest-TestServerVolumeAttachmentScenario-1899063447-project-member] Acquiring lock "25cd59d1-6884-471a-813e-52e97c2e1208-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:29:05 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-e5c74659-7c05-4f14-9ea9-d4fa39458abe tempest-TestServerVolumeAttachmentScenario-1899063447 tempest-TestServerVolumeAttachmentScenario-1899063447-project-member] Lock "25cd59d1-6884-471a-813e-52e97c2e1208-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:29:05 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-e5c74659-7c05-4f14-9ea9-d4fa39458abe tempest-TestServerVolumeAttachmentScenario-1899063447 tempest-TestServerVolumeAttachmentScenario-1899063447-project-member] Lock "25cd59d1-6884-471a-813e-52e97c2e1208-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:29:05 user nova-compute[75045]: INFO nova.compute.manager [None req-e5c74659-7c05-4f14-9ea9-d4fa39458abe tempest-TestServerVolumeAttachmentScenario-1899063447 tempest-TestServerVolumeAttachmentScenario-1899063447-project-member] [instance: 25cd59d1-6884-471a-813e-52e97c2e1208] Terminating instance
Nov 08 23:29:05 user nova-compute[75045]: DEBUG nova.compute.manager [None req-e5c74659-7c05-4f14-9ea9-d4fa39458abe tempest-TestServerVolumeAttachmentScenario-1899063447 tempest-TestServerVolumeAttachmentScenario-1899063447-project-member] [instance: 25cd59d1-6884-471a-813e-52e97c2e1208] Start destroying the instance on the hypervisor. {{(pid=75045) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 23:29:05 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:29:05 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:29:05 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:29:05 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:29:05 user nova-compute[75045]: DEBUG nova.compute.manager [req-2023e4ab-c74b-4980-8841-43e260959b2d req-1f838a24-b223-4ff7-aa71-c95c85e5fecd service nova] [instance: 25cd59d1-6884-471a-813e-52e97c2e1208] Received event network-vif-unplugged-43fa5cbb-d817-41af-8e03-3be477de48c8 {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:29:05 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-2023e4ab-c74b-4980-8841-43e260959b2d req-1f838a24-b223-4ff7-aa71-c95c85e5fecd service nova] Acquiring lock "25cd59d1-6884-471a-813e-52e97c2e1208-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:29:05 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-2023e4ab-c74b-4980-8841-43e260959b2d req-1f838a24-b223-4ff7-aa71-c95c85e5fecd service nova] Lock "25cd59d1-6884-471a-813e-52e97c2e1208-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:29:05 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-2023e4ab-c74b-4980-8841-43e260959b2d req-1f838a24-b223-4ff7-aa71-c95c85e5fecd service nova] Lock "25cd59d1-6884-471a-813e-52e97c2e1208-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:29:05 user nova-compute[75045]: DEBUG nova.compute.manager [req-2023e4ab-c74b-4980-8841-43e260959b2d req-1f838a24-b223-4ff7-aa71-c95c85e5fecd service nova] [instance: 25cd59d1-6884-471a-813e-52e97c2e1208] No waiting events found dispatching network-vif-unplugged-43fa5cbb-d817-41af-8e03-3be477de48c8 {{(pid=75045) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 23:29:05 user nova-compute[75045]: DEBUG nova.compute.manager [req-2023e4ab-c74b-4980-8841-43e260959b2d req-1f838a24-b223-4ff7-aa71-c95c85e5fecd service nova] [instance: 25cd59d1-6884-471a-813e-52e97c2e1208] Received event network-vif-unplugged-43fa5cbb-d817-41af-8e03-3be477de48c8 for instance with task_state deleting. {{(pid=75045) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 23:29:05 user nova-compute[75045]: DEBUG nova.compute.manager [None req-8f8d35b3-e3a1-41ec-902e-95dc07664939 tempest-TestStampPattern-2120781434 tempest-TestStampPattern-2120781434-project-member] [instance: 9fd7c34a-55e7-4d54-9c60-03a7155a2685] Instance event wait completed in 0 seconds for  {{(pid=75045) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 23:29:05 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-8f8d35b3-e3a1-41ec-902e-95dc07664939 tempest-TestStampPattern-2120781434 tempest-TestStampPattern-2120781434-project-member] [instance: 9fd7c34a-55e7-4d54-9c60-03a7155a2685] Guest created on hypervisor {{(pid=75045) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 23:29:05 user nova-compute[75045]: DEBUG nova.compute.manager [req-eb65b232-94f3-4f36-a6d4-3c1a665cacd8 req-11cec7ad-3d79-4d76-8754-401507d971af service nova] [instance: 9fd7c34a-55e7-4d54-9c60-03a7155a2685] Received event network-vif-plugged-b44611d2-ca0a-4e01-b44d-cdf537474195 {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:29:05 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-eb65b232-94f3-4f36-a6d4-3c1a665cacd8 req-11cec7ad-3d79-4d76-8754-401507d971af service nova] Acquiring lock "9fd7c34a-55e7-4d54-9c60-03a7155a2685-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:29:05 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-eb65b232-94f3-4f36-a6d4-3c1a665cacd8 req-11cec7ad-3d79-4d76-8754-401507d971af service nova] Lock "9fd7c34a-55e7-4d54-9c60-03a7155a2685-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:29:05 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-eb65b232-94f3-4f36-a6d4-3c1a665cacd8 req-11cec7ad-3d79-4d76-8754-401507d971af service nova] Lock "9fd7c34a-55e7-4d54-9c60-03a7155a2685-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:29:05 user nova-compute[75045]: DEBUG nova.compute.manager [req-eb65b232-94f3-4f36-a6d4-3c1a665cacd8 req-11cec7ad-3d79-4d76-8754-401507d971af service nova] [instance: 9fd7c34a-55e7-4d54-9c60-03a7155a2685] No waiting events found dispatching network-vif-plugged-b44611d2-ca0a-4e01-b44d-cdf537474195 {{(pid=75045) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 23:29:05 user nova-compute[75045]: WARNING nova.compute.manager [req-eb65b232-94f3-4f36-a6d4-3c1a665cacd8 req-11cec7ad-3d79-4d76-8754-401507d971af service nova] [instance: 9fd7c34a-55e7-4d54-9c60-03a7155a2685] Received unexpected event network-vif-plugged-b44611d2-ca0a-4e01-b44d-cdf537474195 for instance with vm_state building and task_state spawning.
Nov 08 23:29:05 user nova-compute[75045]: INFO nova.virt.libvirt.driver [-] [instance: 9fd7c34a-55e7-4d54-9c60-03a7155a2685] Instance spawned successfully.
Nov 08 23:29:05 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-8f8d35b3-e3a1-41ec-902e-95dc07664939 tempest-TestStampPattern-2120781434 tempest-TestStampPattern-2120781434-project-member] [instance: 9fd7c34a-55e7-4d54-9c60-03a7155a2685] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=75045) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 23:29:05 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-8f8d35b3-e3a1-41ec-902e-95dc07664939 tempest-TestStampPattern-2120781434 tempest-TestStampPattern-2120781434-project-member] [instance: 9fd7c34a-55e7-4d54-9c60-03a7155a2685] Found default for hw_input_bus of None {{(pid=75045) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 23:29:05 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-8f8d35b3-e3a1-41ec-902e-95dc07664939 tempest-TestStampPattern-2120781434 tempest-TestStampPattern-2120781434-project-member] [instance: 9fd7c34a-55e7-4d54-9c60-03a7155a2685] Found default for hw_pointer_model of None {{(pid=75045) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 23:29:05 user nova-compute[75045]: INFO nova.compute.manager [None req-8f8d35b3-e3a1-41ec-902e-95dc07664939 tempest-TestStampPattern-2120781434 tempest-TestStampPattern-2120781434-project-member] [instance: 9fd7c34a-55e7-4d54-9c60-03a7155a2685] Took 7.71 seconds to spawn the instance on the hypervisor.
Nov 08 23:29:05 user nova-compute[75045]: DEBUG nova.compute.manager [None req-8f8d35b3-e3a1-41ec-902e-95dc07664939 tempest-TestStampPattern-2120781434 tempest-TestStampPattern-2120781434-project-member] [instance: 9fd7c34a-55e7-4d54-9c60-03a7155a2685] Checking state {{(pid=75045) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 23:29:05 user nova-compute[75045]: INFO nova.compute.manager [None req-8f8d35b3-e3a1-41ec-902e-95dc07664939 tempest-TestStampPattern-2120781434 tempest-TestStampPattern-2120781434-project-member] [instance: 9fd7c34a-55e7-4d54-9c60-03a7155a2685] Took 9.00 seconds to build instance.
Nov 08 23:29:05 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-8f8d35b3-e3a1-41ec-902e-95dc07664939 tempest-TestStampPattern-2120781434 tempest-TestStampPattern-2120781434-project-member] Lock "9fd7c34a-55e7-4d54-9c60-03a7155a2685" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.108s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:29:06 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:29:06 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:29:06 user nova-compute[75045]: INFO nova.virt.libvirt.driver [-] [instance: 25cd59d1-6884-471a-813e-52e97c2e1208] Instance destroyed successfully.
Nov 08 23:29:06 user nova-compute[75045]: DEBUG nova.objects.instance [None req-e5c74659-7c05-4f14-9ea9-d4fa39458abe tempest-TestServerVolumeAttachmentScenario-1899063447 tempest-TestServerVolumeAttachmentScenario-1899063447-project-member] Lazy-loading 'resources' on Instance uuid 25cd59d1-6884-471a-813e-52e97c2e1208 {{(pid=75045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 23:29:06 user nova-compute[75045]: DEBUG nova.virt.libvirt.vif [None req-e5c74659-7c05-4f14-9ea9-d4fa39458abe tempest-TestServerVolumeAttachmentScenario-1899063447 tempest-TestServerVolumeAttachmentScenario-1899063447-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T23:22:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-141548488',display_name='tempest-TestServerVolumeAttachmentScenario-server-141548488',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-141548488',id=18,image_ref='a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBbIVSSV3Ibe3HDw1MwmY8Snp6aQhY2JGXHgPLXQ2dpKdNAgl4CRRrCsi0/GGMBPrJk7A6or8JaT5LNTXkYg928atu8+Xt9n/HYeTddgr3sdZuMBqy0DwYu06uvjGxvjeQ==',key_name='tempest-keypair-1294221093',keypairs=<?>,launch_index=0,launched_at=2023-11-08T23:22:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0ea775ad7c664da7ab23a480d913dda4',ramdisk_id='',reservation_id='r-bcuyggc6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachmentScenario-1899063447',owner_user_name='tempest-TestServerVolumeAttachmentScenario-1899063447-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T23:22:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1826508cfeff4d5081f84e7e0bf0ff5e',uuid=25cd59d1-6884-471a-813e-52e97c2e1208,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "43fa5cbb-d817-41af-8e03-3be477de48c8", "address": "fa:16:3e:bd:cb:ae", "network": {"id": "b584f5a8-5791-4f2f-9846-8f4929b1f061", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1436131566-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.220", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ea775ad7c664da7ab23a480d913dda4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43fa5cbb-d8", "ovs_interfaceid": "43fa5cbb-d817-41af-8e03-3be477de48c8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75045) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 23:29:06 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-e5c74659-7c05-4f14-9ea9-d4fa39458abe tempest-TestServerVolumeAttachmentScenario-1899063447 tempest-TestServerVolumeAttachmentScenario-1899063447-project-member] Converting VIF {"id": "43fa5cbb-d817-41af-8e03-3be477de48c8", "address": "fa:16:3e:bd:cb:ae", "network": {"id": "b584f5a8-5791-4f2f-9846-8f4929b1f061", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1436131566-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.220", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ea775ad7c664da7ab23a480d913dda4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43fa5cbb-d8", "ovs_interfaceid": "43fa5cbb-d817-41af-8e03-3be477de48c8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 23:29:06 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-e5c74659-7c05-4f14-9ea9-d4fa39458abe tempest-TestServerVolumeAttachmentScenario-1899063447 tempest-TestServerVolumeAttachmentScenario-1899063447-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:bd:cb:ae,bridge_name='br-int',has_traffic_filtering=True,id=43fa5cbb-d817-41af-8e03-3be477de48c8,network=Network(b584f5a8-5791-4f2f-9846-8f4929b1f061),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap43fa5cbb-d8') {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 23:29:06 user nova-compute[75045]: DEBUG os_vif [None req-e5c74659-7c05-4f14-9ea9-d4fa39458abe tempest-TestServerVolumeAttachmentScenario-1899063447 tempest-TestServerVolumeAttachmentScenario-1899063447-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:bd:cb:ae,bridge_name='br-int',has_traffic_filtering=True,id=43fa5cbb-d817-41af-8e03-3be477de48c8,network=Network(b584f5a8-5791-4f2f-9846-8f4929b1f061),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap43fa5cbb-d8') {{(pid=75045) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 23:29:06 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:29:06 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap43fa5cbb-d8, bridge=br-int, if_exists=True) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:29:06 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:29:06 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 23:29:06 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:29:06 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:29:06 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ed24fb02-dad4-430e-96d3-4b4137f331fb) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:29:06 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:29:06 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:29:06 user nova-compute[75045]: INFO os_vif [None req-e5c74659-7c05-4f14-9ea9-d4fa39458abe tempest-TestServerVolumeAttachmentScenario-1899063447 tempest-TestServerVolumeAttachmentScenario-1899063447-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:bd:cb:ae,bridge_name='br-int',has_traffic_filtering=True,id=43fa5cbb-d817-41af-8e03-3be477de48c8,network=Network(b584f5a8-5791-4f2f-9846-8f4929b1f061),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap43fa5cbb-d8')
Nov 08 23:29:06 user nova-compute[75045]: INFO nova.virt.libvirt.driver [None req-e5c74659-7c05-4f14-9ea9-d4fa39458abe tempest-TestServerVolumeAttachmentScenario-1899063447 tempest-TestServerVolumeAttachmentScenario-1899063447-project-member] [instance: 25cd59d1-6884-471a-813e-52e97c2e1208] Deleting instance files /opt/stack/data/nova/instances/25cd59d1-6884-471a-813e-52e97c2e1208_del
Nov 08 23:29:06 user nova-compute[75045]: INFO nova.virt.libvirt.driver [None req-e5c74659-7c05-4f14-9ea9-d4fa39458abe tempest-TestServerVolumeAttachmentScenario-1899063447 tempest-TestServerVolumeAttachmentScenario-1899063447-project-member] [instance: 25cd59d1-6884-471a-813e-52e97c2e1208] Deletion of /opt/stack/data/nova/instances/25cd59d1-6884-471a-813e-52e97c2e1208_del complete
Nov 08 23:29:06 user nova-compute[75045]: INFO nova.compute.manager [None req-e5c74659-7c05-4f14-9ea9-d4fa39458abe tempest-TestServerVolumeAttachmentScenario-1899063447 tempest-TestServerVolumeAttachmentScenario-1899063447-project-member] [instance: 25cd59d1-6884-471a-813e-52e97c2e1208] Took 1.12 seconds to destroy the instance on the hypervisor.
Nov 08 23:29:06 user nova-compute[75045]: DEBUG oslo.service.loopingcall [None req-e5c74659-7c05-4f14-9ea9-d4fa39458abe tempest-TestServerVolumeAttachmentScenario-1899063447 tempest-TestServerVolumeAttachmentScenario-1899063447-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75045) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 23:29:06 user nova-compute[75045]: DEBUG nova.compute.manager [-] [instance: 25cd59d1-6884-471a-813e-52e97c2e1208] Deallocating network for instance {{(pid=75045) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 23:29:06 user nova-compute[75045]: DEBUG nova.network.neutron [-] [instance: 25cd59d1-6884-471a-813e-52e97c2e1208] deallocate_for_instance() {{(pid=75045) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 23:29:07 user nova-compute[75045]: DEBUG nova.network.neutron [-] [instance: 25cd59d1-6884-471a-813e-52e97c2e1208] Updating instance_info_cache with network_info: [] {{(pid=75045) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 23:29:07 user nova-compute[75045]: INFO nova.compute.manager [-] [instance: 25cd59d1-6884-471a-813e-52e97c2e1208] Took 1.02 seconds to deallocate network for instance.
Nov 08 23:29:07 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-e5c74659-7c05-4f14-9ea9-d4fa39458abe tempest-TestServerVolumeAttachmentScenario-1899063447 tempest-TestServerVolumeAttachmentScenario-1899063447-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:29:07 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-e5c74659-7c05-4f14-9ea9-d4fa39458abe tempest-TestServerVolumeAttachmentScenario-1899063447 tempest-TestServerVolumeAttachmentScenario-1899063447-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:29:07 user nova-compute[75045]: DEBUG nova.compute.manager [req-ee5d6846-bea3-4869-b2a8-8247e20aeeba req-6ddcc6aa-a014-4382-b291-12f0c5b8a167 service nova] [instance: 25cd59d1-6884-471a-813e-52e97c2e1208] Received event network-vif-plugged-43fa5cbb-d817-41af-8e03-3be477de48c8 {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:29:07 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-ee5d6846-bea3-4869-b2a8-8247e20aeeba req-6ddcc6aa-a014-4382-b291-12f0c5b8a167 service nova] Acquiring lock "25cd59d1-6884-471a-813e-52e97c2e1208-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:29:07 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-ee5d6846-bea3-4869-b2a8-8247e20aeeba req-6ddcc6aa-a014-4382-b291-12f0c5b8a167 service nova] Lock "25cd59d1-6884-471a-813e-52e97c2e1208-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:29:07 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-ee5d6846-bea3-4869-b2a8-8247e20aeeba req-6ddcc6aa-a014-4382-b291-12f0c5b8a167 service nova] Lock "25cd59d1-6884-471a-813e-52e97c2e1208-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:29:07 user nova-compute[75045]: DEBUG nova.compute.manager [req-ee5d6846-bea3-4869-b2a8-8247e20aeeba req-6ddcc6aa-a014-4382-b291-12f0c5b8a167 service nova] [instance: 25cd59d1-6884-471a-813e-52e97c2e1208] No waiting events found dispatching network-vif-plugged-43fa5cbb-d817-41af-8e03-3be477de48c8 {{(pid=75045) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 23:29:07 user nova-compute[75045]: WARNING nova.compute.manager [req-ee5d6846-bea3-4869-b2a8-8247e20aeeba req-6ddcc6aa-a014-4382-b291-12f0c5b8a167 service nova] [instance: 25cd59d1-6884-471a-813e-52e97c2e1208] Received unexpected event network-vif-plugged-43fa5cbb-d817-41af-8e03-3be477de48c8 for instance with vm_state deleted and task_state None.
Nov 08 23:29:07 user nova-compute[75045]: DEBUG nova.compute.manager [req-67b22fe0-02eb-4eda-b5bf-3afd05e57a56 req-1675bc42-4637-4ccc-974a-5d971b269df3 service nova] [instance: 25cd59d1-6884-471a-813e-52e97c2e1208] Received event network-vif-deleted-43fa5cbb-d817-41af-8e03-3be477de48c8 {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:29:07 user nova-compute[75045]: DEBUG nova.compute.provider_tree [None req-e5c74659-7c05-4f14-9ea9-d4fa39458abe tempest-TestServerVolumeAttachmentScenario-1899063447 tempest-TestServerVolumeAttachmentScenario-1899063447-project-member] Inventory has not changed in ProviderTree for provider: 62ba5f85-c74d-4b58-986e-d4197e813fd7 {{(pid=75045) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 23:29:08 user nova-compute[75045]: DEBUG nova.scheduler.client.report [None req-e5c74659-7c05-4f14-9ea9-d4fa39458abe tempest-TestServerVolumeAttachmentScenario-1899063447 tempest-TestServerVolumeAttachmentScenario-1899063447-project-member] Inventory has not changed for provider 62ba5f85-c74d-4b58-986e-d4197e813fd7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75045) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 23:29:08 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-e5c74659-7c05-4f14-9ea9-d4fa39458abe tempest-TestServerVolumeAttachmentScenario-1899063447 tempest-TestServerVolumeAttachmentScenario-1899063447-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.600s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:29:08 user nova-compute[75045]: INFO nova.scheduler.client.report [None req-e5c74659-7c05-4f14-9ea9-d4fa39458abe tempest-TestServerVolumeAttachmentScenario-1899063447 tempest-TestServerVolumeAttachmentScenario-1899063447-project-member] Deleted allocations for instance 25cd59d1-6884-471a-813e-52e97c2e1208
Nov 08 23:29:08 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-e5c74659-7c05-4f14-9ea9-d4fa39458abe tempest-TestServerVolumeAttachmentScenario-1899063447 tempest-TestServerVolumeAttachmentScenario-1899063447-project-member] Lock "25cd59d1-6884-471a-813e-52e97c2e1208" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.971s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:29:09 user nova-compute[75045]: DEBUG nova.compute.manager [None req-ca9ec2ee-9154-4e3f-925c-fa499ff66d33 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] [instance: 04169f59-e9a6-4b50-9ad7-7f8c105a376a] Start spawning the instance on the hypervisor. {{(pid=75045) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 23:29:09 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-ca9ec2ee-9154-4e3f-925c-fa499ff66d33 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] [instance: 04169f59-e9a6-4b50-9ad7-7f8c105a376a] Creating instance directory {{(pid=75045) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 23:29:09 user nova-compute[75045]: INFO nova.virt.libvirt.driver [None req-ca9ec2ee-9154-4e3f-925c-fa499ff66d33 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] [instance: 04169f59-e9a6-4b50-9ad7-7f8c105a376a] Creating image(s)
Nov 08 23:29:09 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-ca9ec2ee-9154-4e3f-925c-fa499ff66d33 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] [instance: 04169f59-e9a6-4b50-9ad7-7f8c105a376a] Did not create local disks {{(pid=75045) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 08 23:29:09 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-ca9ec2ee-9154-4e3f-925c-fa499ff66d33 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] [instance: 04169f59-e9a6-4b50-9ad7-7f8c105a376a] Ensure instance console log exists: /opt/stack/data/nova/instances/04169f59-e9a6-4b50-9ad7-7f8c105a376a/console.log {{(pid=75045) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 23:29:09 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-ca9ec2ee-9154-4e3f-925c-fa499ff66d33 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:29:09 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-ca9ec2ee-9154-4e3f-925c-fa499ff66d33 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:29:09 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-ca9ec2ee-9154-4e3f-925c-fa499ff66d33 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:29:09 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-ca9ec2ee-9154-4e3f-925c-fa499ff66d33 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] [instance: 04169f59-e9a6-4b50-9ad7-7f8c105a376a] Start _get_guest_xml network_info=[{"id": "96af9673-bb3c-4173-8439-0be6d2b922cf", "address": "fa:16:3e:a5:6d:8b", "network": {"id": "700b5784-d35b-45c0-a4d3-1ab8aa4c48aa", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-194469807-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e63623113f11463d9035bb990de43510", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96af9673-bb", "ovs_interfaceid": "96af9673-bb3c-4173-8439-0be6d2b922cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': True, 'device_type': 'disk', 'attachment_id': '3f368314-b029-4aa5-8982-e02bb1def64e', 'guest_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:e9c3ac6d-d72a-41c8-9c18-15131250e323', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WPeOlnqB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '04169f59-e9a6-4b50-9ad7-7f8c105a376a', 'attached_at': '', 'detached_at': '', 'volume_id': 'e9c3ac6d-d72a-41c8-9c18-15131250e323', 'serial': 'e9c3ac6d-d72a-41c8-9c18-15131250e323'}, 'volume_type': None} {{(pid=75045) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 23:29:09 user nova-compute[75045]: WARNING nova.virt.libvirt.driver [None req-ca9ec2ee-9154-4e3f-925c-fa499ff66d33 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 23:29:09 user nova-compute[75045]: WARNING nova.virt.libvirt.driver [None req-ca9ec2ee-9154-4e3f-925c-fa499ff66d33 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 23:29:09 user nova-compute[75045]: DEBUG nova.compute.manager [None req-8f4d4c6c-cec0-4708-b180-7b306fe35c42 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] [instance: 438082fc-a83f-4305-ada6-41a8e1d645a8] Start spawning the instance on the hypervisor. {{(pid=75045) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 23:29:09 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-8f4d4c6c-cec0-4708-b180-7b306fe35c42 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] [instance: 438082fc-a83f-4305-ada6-41a8e1d645a8] Creating instance directory {{(pid=75045) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 23:29:09 user nova-compute[75045]: INFO nova.virt.libvirt.driver [None req-8f4d4c6c-cec0-4708-b180-7b306fe35c42 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] [instance: 438082fc-a83f-4305-ada6-41a8e1d645a8] Creating image(s)
Nov 08 23:29:09 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-8f4d4c6c-cec0-4708-b180-7b306fe35c42 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] [instance: 438082fc-a83f-4305-ada6-41a8e1d645a8] Did not create local disks {{(pid=75045) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 08 23:29:09 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-8f4d4c6c-cec0-4708-b180-7b306fe35c42 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] [instance: 438082fc-a83f-4305-ada6-41a8e1d645a8] Ensure instance console log exists: /opt/stack/data/nova/instances/438082fc-a83f-4305-ada6-41a8e1d645a8/console.log {{(pid=75045) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 23:29:09 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-8f4d4c6c-cec0-4708-b180-7b306fe35c42 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:29:09 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-8f4d4c6c-cec0-4708-b180-7b306fe35c42 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:29:09 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-8f4d4c6c-cec0-4708-b180-7b306fe35c42 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:29:09 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-8f4d4c6c-cec0-4708-b180-7b306fe35c42 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] [instance: 438082fc-a83f-4305-ada6-41a8e1d645a8] Start _get_guest_xml network_info=[{"id": "669f0f7f-7c58-42b9-948b-ad3704fb1ab3", "address": "fa:16:3e:57:c2:f9", "network": {"id": "d4cd6998-66d1-4389-bc82-dd000c8962de", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-323966879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bfb6963a6c145d4a7b7e47c8fde7e60", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap669f0f7f-7c", "ovs_interfaceid": "669f0f7f-7c58-42b9-948b-ad3704fb1ab3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T23:11:54Z,direct_url=<?>,disk_format='qcow2',id=a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b1beba2cc4e7465ea249e2225fb494dc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T23:11:56Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'device_type': 'disk', 'attachment_id': 'd0f2e4d2-44f8-466b-b6a1-9be7c176e2df', 'guest_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:83187c89-e833-4efd-afa0-2cbfe05d8db1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gzFECVaq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '438082fc-a83f-4305-ada6-41a8e1d645a8', 'attached_at': '', 'detached_at': '', 'volume_id': '83187c89-e833-4efd-afa0-2cbfe05d8db1', 'serial': '83187c89-e833-4efd-afa0-2cbfe05d8db1'}, 'volume_type': None} {{(pid=75045) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 23:29:09 user nova-compute[75045]: DEBUG nova.virt.libvirt.host [None req-ca9ec2ee-9154-4e3f-925c-fa499ff66d33 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75045) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 23:29:09 user nova-compute[75045]: DEBUG nova.virt.libvirt.host [None req-ca9ec2ee-9154-4e3f-925c-fa499ff66d33 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] CPU controller missing on host. {{(pid=75045) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 23:29:09 user nova-compute[75045]: DEBUG nova.virt.libvirt.host [None req-ca9ec2ee-9154-4e3f-925c-fa499ff66d33 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75045) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 23:29:09 user nova-compute[75045]: DEBUG nova.virt.libvirt.host [None req-ca9ec2ee-9154-4e3f-925c-fa499ff66d33 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] CPU controller found on host. {{(pid=75045) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 23:29:09 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-ca9ec2ee-9154-4e3f-925c-fa499ff66d33 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75045) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 23:29:09 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-ca9ec2ee-9154-4e3f-925c-fa499ff66d33 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T23:11:41Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75045) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 23:29:09 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-ca9ec2ee-9154-4e3f-925c-fa499ff66d33 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Flavor limits 0:0:0 {{(pid=75045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 23:29:09 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-ca9ec2ee-9154-4e3f-925c-fa499ff66d33 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Image limits 0:0:0 {{(pid=75045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 23:29:09 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-ca9ec2ee-9154-4e3f-925c-fa499ff66d33 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Flavor pref 0:0:0 {{(pid=75045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 23:29:09 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-ca9ec2ee-9154-4e3f-925c-fa499ff66d33 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Image pref 0:0:0 {{(pid=75045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 23:29:09 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-ca9ec2ee-9154-4e3f-925c-fa499ff66d33 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 23:29:09 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-ca9ec2ee-9154-4e3f-925c-fa499ff66d33 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75045) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 23:29:09 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-ca9ec2ee-9154-4e3f-925c-fa499ff66d33 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75045) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 23:29:09 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-ca9ec2ee-9154-4e3f-925c-fa499ff66d33 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Got 1 possible topologies {{(pid=75045) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 23:29:09 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-ca9ec2ee-9154-4e3f-925c-fa499ff66d33 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75045) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 23:29:09 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-ca9ec2ee-9154-4e3f-925c-fa499ff66d33 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75045) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 23:29:09 user nova-compute[75045]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ca9ec2ee-9154-4e3f-925c-fa499ff66d33 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] [instance: 04169f59-e9a6-4b50-9ad7-7f8c105a376a] Calling os-brick to attach iSCSI Volume {{(pid=75045) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 23:29:09 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca9ec2ee-9154-4e3f-925c-fa499ff66d33 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1b68210460>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e9c3ac6d-d72a-41c8-9c18-15131250e323', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WPeOlnqB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75045) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 23:29:09 user nova-compute[75045]: WARNING os_brick.initiator.connectors.base [None req-ca9ec2ee-9154-4e3f-925c-fa499ff66d33 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 23:29:09 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-ca9ec2ee-9154-4e3f-925c-fa499ff66d33 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 23:29:09 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-ca9ec2ee-9154-4e3f-925c-fa499ff66d33 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 23:29:09 user nova-compute[75045]: WARNING os_brick.initiator.connectors.base [None req-ca9ec2ee-9154-4e3f-925c-fa499ff66d33 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 23:29:09 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-ca9ec2ee-9154-4e3f-925c-fa499ff66d33 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e9c3ac6d-d72a-41c8-9c18-15131250e323" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 23:29:09 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-ca9ec2ee-9154-4e3f-925c-fa499ff66d33 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e9c3ac6d-d72a-41c8-9c18-15131250e323" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 23:29:09 user nova-compute[75045]: INFO os_brick.initiator.connectors.iscsi [None req-ca9ec2ee-9154-4e3f-925c-fa499ff66d33 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 23:29:09 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e9c3ac6d-d72a-41c8-9c18-15131250e323 -p 172.16.0.220:3260 {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:29:09 user nova-compute[75045]: WARNING nova.virt.libvirt.driver [None req-8f4d4c6c-cec0-4708-b180-7b306fe35c42 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 23:29:09 user nova-compute[75045]: WARNING nova.virt.libvirt.driver [None req-8f4d4c6c-cec0-4708-b180-7b306fe35c42 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 23:29:09 user nova-compute[75045]: DEBUG nova.virt.libvirt.host [None req-8f4d4c6c-cec0-4708-b180-7b306fe35c42 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75045) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 23:29:09 user nova-compute[75045]: DEBUG nova.virt.libvirt.host [None req-8f4d4c6c-cec0-4708-b180-7b306fe35c42 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] CPU controller missing on host. {{(pid=75045) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 23:29:09 user nova-compute[75045]: DEBUG nova.virt.libvirt.host [None req-8f4d4c6c-cec0-4708-b180-7b306fe35c42 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75045) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 23:29:09 user nova-compute[75045]: DEBUG nova.virt.libvirt.host [None req-8f4d4c6c-cec0-4708-b180-7b306fe35c42 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] CPU controller found on host. {{(pid=75045) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 23:29:09 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-8f4d4c6c-cec0-4708-b180-7b306fe35c42 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75045) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 23:29:09 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-8f4d4c6c-cec0-4708-b180-7b306fe35c42 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T23:11:41Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T23:11:54Z,direct_url=<?>,disk_format='qcow2',id=a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b1beba2cc4e7465ea249e2225fb494dc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T23:11:56Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75045) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 23:29:09 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-8f4d4c6c-cec0-4708-b180-7b306fe35c42 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Flavor limits 0:0:0 {{(pid=75045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 23:29:09 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-8f4d4c6c-cec0-4708-b180-7b306fe35c42 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Image limits 0:0:0 {{(pid=75045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 23:29:09 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-8f4d4c6c-cec0-4708-b180-7b306fe35c42 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Flavor pref 0:0:0 {{(pid=75045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 23:29:09 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-8f4d4c6c-cec0-4708-b180-7b306fe35c42 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Image pref 0:0:0 {{(pid=75045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 23:29:09 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-8f4d4c6c-cec0-4708-b180-7b306fe35c42 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 23:29:09 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-8f4d4c6c-cec0-4708-b180-7b306fe35c42 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75045) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 23:29:09 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-8f4d4c6c-cec0-4708-b180-7b306fe35c42 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75045) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 23:29:09 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-8f4d4c6c-cec0-4708-b180-7b306fe35c42 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Got 1 possible topologies {{(pid=75045) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 23:29:09 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-8f4d4c6c-cec0-4708-b180-7b306fe35c42 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75045) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 23:29:09 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-8f4d4c6c-cec0-4708-b180-7b306fe35c42 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75045) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 23:29:09 user nova-compute[75045]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8f4d4c6c-cec0-4708-b180-7b306fe35c42 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] [instance: 438082fc-a83f-4305-ada6-41a8e1d645a8] Calling os-brick to attach iSCSI Volume {{(pid=75045) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 23:29:09 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f4d4c6c-cec0-4708-b180-7b306fe35c42 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1b68210460>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:83187c89-e833-4efd-afa0-2cbfe05d8db1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gzFECVaq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75045) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 23:29:09 user nova-compute[75045]: WARNING os_brick.initiator.connectors.base [None req-8f4d4c6c-cec0-4708-b180-7b306fe35c42 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 23:29:09 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-8f4d4c6c-cec0-4708-b180-7b306fe35c42 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 23:29:09 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e9c3ac6d-d72a-41c8-9c18-15131250e323 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:29:09 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dfc82df-8d49-4cbf-a129-422bc9838ca5]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:29:09 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca9ec2ee-9154-4e3f-925c-fa499ff66d33 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 23:29:09 user nova-compute[75045]:  {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:29:09 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e9c3ac6d-d72a-41c8-9c18-15131250e323 -p 172.16.0.220:3260 --interface default --op new {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:29:09 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e9c3ac6d-d72a-41c8-9c18-15131250e323 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:29:09 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[839b2783-7fc3-48a0-975f-9ff70d40de01]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e9c3ac6d-d72a-41c8-9c18-15131250e323] added\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:29:09 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca9ec2ee-9154-4e3f-925c-fa499ff66d33 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e9c3ac6d-d72a-41c8-9c18-15131250e323] added
Nov 08 23:29:09 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:29:09 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e9c3ac6d-d72a-41c8-9c18-15131250e323 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:29:09 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e9c3ac6d-d72a-41c8-9c18-15131250e323 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:29:09 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[558dc9ba-d023-42f5-b158-50067027d8a8]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:29:09 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca9ec2ee-9154-4e3f-925c-fa499ff66d33 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:29:09 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e9c3ac6d-d72a-41c8-9c18-15131250e323 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:29:09 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e9c3ac6d-d72a-41c8-9c18-15131250e323 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:29:09 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[d483bd00-2ff0-455b-a87b-bb524b1eb124]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:29:09 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca9ec2ee-9154-4e3f-925c-fa499ff66d33 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:29:09 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e9c3ac6d-d72a-41c8-9c18-15131250e323 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WPeOlnqB {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:29:09 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e9c3ac6d-d72a-41c8-9c18-15131250e323 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WPeOlnqB" returned: 0 in 0.021s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:29:09 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2e3261d-4a8b-49d6-b5c3-8a64e3fc8dd5]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:29:09 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca9ec2ee-9154-4e3f-925c-fa499ff66d33 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'WPeOlnqB'): stdout= stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:29:09 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e9c3ac6d-d72a-41c8-9c18-15131250e323 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:29:09 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e9c3ac6d-d72a-41c8-9c18-15131250e323 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.027s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:29:09 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[26719f46-42a0-4c28-b375-440da852ce9d]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:29:09 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca9ec2ee-9154-4e3f-925c-fa499ff66d33 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:29:09 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:29:09 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:29:09 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[dec9bebd-6815-4ffc-8a9f-7a5dbebca28e]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2e734fa-1dcb-4510-a50e-064e29c2985e (non-flash)\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:29:09 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca9ec2ee-9154-4e3f-925c-fa499ff66d33 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab (non-flash)
Nov 08 23:29:09 user nova-compute[75045]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2e734fa-1dcb-4510-a50e-064e29c2985e (non-flash)
Nov 08 23:29:09 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 23:29:09 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca9ec2ee-9154-4e3f-925c-fa499ff66d33 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab (non-flash)
Nov 08 23:29:09 user nova-compute[75045]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2e734fa-1dcb-4510-a50e-064e29c2985e (non-flash)
Nov 08 23:29:09 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 23:29:09 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e9c3ac6d-d72a-41c8-9c18-15131250e323 -p 172.16.0.220:3260 --login {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:29:09 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e9c3ac6d-d72a-41c8-9c18-15131250e323 -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:29:09 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[4da42bc3-cfc8-415d-8eba-eeeecf6ccda1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e9c3ac6d-d72a-41c8-9c18-15131250e323, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e9c3ac6d-d72a-41c8-9c18-15131250e323, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:29:09 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca9ec2ee-9154-4e3f-925c-fa499ff66d33 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e9c3ac6d-d72a-41c8-9c18-15131250e323, portal: 172.16.0.220,3260]
Nov 08 23:29:09 user nova-compute[75045]: Login to [iface: default, target: iqn.2010-10.org.openstack:e9c3ac6d-d72a-41c8-9c18-15131250e323, portal: 172.16.0.220,3260] successful.
Nov 08 23:29:09 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:29:09 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e9c3ac6d-d72a-41c8-9c18-15131250e323 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:29:09 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e9c3ac6d-d72a-41c8-9c18-15131250e323 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:29:09 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[43dbed7e-fc18-45ec-8ca3-83d085886a3a]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:29:09 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca9ec2ee-9154-4e3f-925c-fa499ff66d33 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:29:09 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:29:09 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:29:09 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5d10bd9-53d0-4379-b7ca-10cc710af995]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2e734fa-1dcb-4510-a50e-064e29c2985e (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9c3ac6d-d72a-41c8-9c18-15131250e323 (non-flash)\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:29:09 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca9ec2ee-9154-4e3f-925c-fa499ff66d33 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab (non-flash)
Nov 08 23:29:09 user nova-compute[75045]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2e734fa-1dcb-4510-a50e-064e29c2985e (non-flash)
Nov 08 23:29:09 user nova-compute[75045]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9c3ac6d-d72a-41c8-9c18-15131250e323 (non-flash)
Nov 08 23:29:09 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 23:29:09 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca9ec2ee-9154-4e3f-925c-fa499ff66d33 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab (non-flash)
Nov 08 23:29:09 user nova-compute[75045]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2e734fa-1dcb-4510-a50e-064e29c2985e (non-flash)
Nov 08 23:29:09 user nova-compute[75045]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9c3ac6d-d72a-41c8-9c18-15131250e323 (non-flash)
Nov 08 23:29:09 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 23:29:09 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-ca9ec2ee-9154-4e3f-925c-fa499ff66d33 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e9c3ac6d-d72a-41c8-9c18-15131250e323" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.327s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 23:29:09 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca9ec2ee-9154-4e3f-925c-fa499ff66d33 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Connected to 172.16.0.220:3260 {{(pid=75045) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 23:29:09 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-ca9ec2ee-9154-4e3f-925c-fa499ff66d33 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] HCTL ('33', '-', '-', 0) found on session 28 with lun 0 {{(pid=75045) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 23:29:09 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-ca9ec2ee-9154-4e3f-925c-fa499ff66d33 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75045) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 23:29:09 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:29:09 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:29:09 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[78fe7abc-3341-490a-8038-6904f9b8c5bf]: (4, ('- - 0', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:29:09 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-ca9ec2ee-9154-4e3f-925c-fa499ff66d33 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Searching for a device in session 28 and hctl ['33', '*', '*', 0] yield: None {{(pid=75045) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 23:29:10 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-ca9ec2ee-9154-4e3f-925c-fa499ff66d33 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Searching for a device in session 28 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75045) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 23:29:10 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca9ec2ee-9154-4e3f-925c-fa499ff66d33 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:e9c3ac6d-d72a-41c8-9c18-15131250e323', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WPeOlnqB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75045) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 23:29:10 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-ca9ec2ee-9154-4e3f-925c-fa499ff66d33 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.362s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 23:29:10 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca9ec2ee-9154-4e3f-925c-fa499ff66d33 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] <== connect_volume: return (1363ms) {'type': 'block', 'scsi_wwn': '23833353965313638', 'path': '/dev/sdb'} {{(pid=75045) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 23:29:10 user nova-compute[75045]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ca9ec2ee-9154-4e3f-925c-fa499ff66d33 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] [instance: 04169f59-e9a6-4b50-9ad7-7f8c105a376a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23833353965313638', 'path': '/dev/sdb'} {{(pid=75045) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 23:29:10 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-8f4d4c6c-cec0-4708-b180-7b306fe35c42 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.318s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 23:29:10 user nova-compute[75045]: WARNING os_brick.initiator.connectors.base [None req-8f4d4c6c-cec0-4708-b180-7b306fe35c42 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 23:29:10 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-8f4d4c6c-cec0-4708-b180-7b306fe35c42 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:83187c89-e833-4efd-afa0-2cbfe05d8db1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 23:29:10 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-8f4d4c6c-cec0-4708-b180-7b306fe35c42 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:83187c89-e833-4efd-afa0-2cbfe05d8db1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 23:29:10 user nova-compute[75045]: INFO os_brick.initiator.connectors.iscsi [None req-8f4d4c6c-cec0-4708-b180-7b306fe35c42 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 23:29:10 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83187c89-e833-4efd-afa0-2cbfe05d8db1 -p 172.16.0.220:3260 {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:29:10 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83187c89-e833-4efd-afa0-2cbfe05d8db1 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:29:10 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4b2cdb9-2bae-4182-9c08-a873391aeaac]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:29:10 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f4d4c6c-cec0-4708-b180-7b306fe35c42 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 23:29:10 user nova-compute[75045]:  {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:29:10 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83187c89-e833-4efd-afa0-2cbfe05d8db1 -p 172.16.0.220:3260 --interface default --op new {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:29:10 user nova-compute[75045]: DEBUG nova.virt.libvirt.vif [None req-ca9ec2ee-9154-4e3f-925c-fa499ff66d33 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T23:28:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1540084668',display_name='tempest-ServerActionsTestOtherA-server-1540084668',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1540084668',id=27,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDODl/KmGTsZ/iebmo5xmCcXvI602I8HkxrrHYOCSHtu28wqdqp4sqz8GjX6RCkUTvwm3o1RrGN7CPAGp6yuNsTNNdTZNeJLiXbNPx6WnByfZzN9Q7qtNxToi4a9/5pZlg==',key_name='tempest-keypair-679582766',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e63623113f11463d9035bb990de43510',ramdisk_id='',reservation_id='r-tx09g4z0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-2056815713',owner_user_name='tempest-ServerActionsTestOtherA-2056815713-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T23:28:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='75fc508f268d4a569ad78598ff019c14',uuid=04169f59-e9a6-4b50-9ad7-7f8c105a376a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "96af9673-bb3c-4173-8439-0be6d2b922cf", "address": "fa:16:3e:a5:6d:8b", "network": {"id": "700b5784-d35b-45c0-a4d3-1ab8aa4c48aa", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-194469807-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e63623113f11463d9035bb990de43510", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96af9673-bb", "ovs_interfaceid": "96af9673-bb3c-4173-8439-0be6d2b922cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75045) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 23:29:10 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-ca9ec2ee-9154-4e3f-925c-fa499ff66d33 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Converting VIF {"id": "96af9673-bb3c-4173-8439-0be6d2b922cf", "address": "fa:16:3e:a5:6d:8b", "network": {"id": "700b5784-d35b-45c0-a4d3-1ab8aa4c48aa", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-194469807-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e63623113f11463d9035bb990de43510", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96af9673-bb", "ovs_interfaceid": "96af9673-bb3c-4173-8439-0be6d2b922cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 23:29:10 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-ca9ec2ee-9154-4e3f-925c-fa499ff66d33 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a5:6d:8b,bridge_name='br-int',has_traffic_filtering=True,id=96af9673-bb3c-4173-8439-0be6d2b922cf,network=Network(700b5784-d35b-45c0-a4d3-1ab8aa4c48aa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96af9673-bb') {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 23:29:10 user nova-compute[75045]: DEBUG nova.objects.instance [None req-ca9ec2ee-9154-4e3f-925c-fa499ff66d33 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Lazy-loading 'pci_devices' on Instance uuid 04169f59-e9a6-4b50-9ad7-7f8c105a376a {{(pid=75045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 23:29:10 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83187c89-e833-4efd-afa0-2cbfe05d8db1 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:29:10 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[70c8eecb-915f-47f9-81e8-de1a8bbda71a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:83187c89-e833-4efd-afa0-2cbfe05d8db1] added\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:29:10 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f4d4c6c-cec0-4708-b180-7b306fe35c42 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:83187c89-e833-4efd-afa0-2cbfe05d8db1] added
Nov 08 23:29:10 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:29:10 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83187c89-e833-4efd-afa0-2cbfe05d8db1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:29:10 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-ca9ec2ee-9154-4e3f-925c-fa499ff66d33 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] [instance: 04169f59-e9a6-4b50-9ad7-7f8c105a376a] End _get_guest_xml xml=<domain type="kvm">
Nov 08 23:29:10 user nova-compute[75045]:   <uuid>04169f59-e9a6-4b50-9ad7-7f8c105a376a</uuid>
Nov 08 23:29:10 user nova-compute[75045]:   <name>instance-0000001b</name>
Nov 08 23:29:10 user nova-compute[75045]:   <memory>524288</memory>
Nov 08 23:29:10 user nova-compute[75045]:   <vcpu>1</vcpu>
Nov 08 23:29:10 user nova-compute[75045]:   <metadata>
Nov 08 23:29:10 user nova-compute[75045]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 23:29:10 user nova-compute[75045]:       <nova:package version="0.0.0"/>
Nov 08 23:29:10 user nova-compute[75045]:       <nova:name>tempest-ServerActionsTestOtherA-server-1540084668</nova:name>
Nov 08 23:29:10 user nova-compute[75045]:       <nova:creationTime>2023-11-08 23:29:09</nova:creationTime>
Nov 08 23:29:10 user nova-compute[75045]:       <nova:flavor name="m1.tiny">
Nov 08 23:29:10 user nova-compute[75045]:         <nova:memory>512</nova:memory>
Nov 08 23:29:10 user nova-compute[75045]:         <nova:disk>1</nova:disk>
Nov 08 23:29:10 user nova-compute[75045]:         <nova:swap>0</nova:swap>
Nov 08 23:29:10 user nova-compute[75045]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 23:29:10 user nova-compute[75045]:         <nova:vcpus>1</nova:vcpus>
Nov 08 23:29:10 user nova-compute[75045]:       </nova:flavor>
Nov 08 23:29:10 user nova-compute[75045]:       <nova:owner>
Nov 08 23:29:10 user nova-compute[75045]:         <nova:user uuid="75fc508f268d4a569ad78598ff019c14">tempest-ServerActionsTestOtherA-2056815713-project-member</nova:user>
Nov 08 23:29:10 user nova-compute[75045]:         <nova:project uuid="e63623113f11463d9035bb990de43510">tempest-ServerActionsTestOtherA-2056815713</nova:project>
Nov 08 23:29:10 user nova-compute[75045]:       </nova:owner>
Nov 08 23:29:10 user nova-compute[75045]:       <nova:ports>
Nov 08 23:29:10 user nova-compute[75045]:         <nova:port uuid="96af9673-bb3c-4173-8439-0be6d2b922cf">
Nov 08 23:29:10 user nova-compute[75045]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 08 23:29:10 user nova-compute[75045]:         </nova:port>
Nov 08 23:29:10 user nova-compute[75045]:       </nova:ports>
Nov 08 23:29:10 user nova-compute[75045]:     </nova:instance>
Nov 08 23:29:10 user nova-compute[75045]:   </metadata>
Nov 08 23:29:10 user nova-compute[75045]:   <sysinfo type="smbios">
Nov 08 23:29:10 user nova-compute[75045]:     <system>
Nov 08 23:29:10 user nova-compute[75045]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 23:29:10 user nova-compute[75045]:       <entry name="product">OpenStack Nova</entry>
Nov 08 23:29:10 user nova-compute[75045]:       <entry name="version">0.0.0</entry>
Nov 08 23:29:10 user nova-compute[75045]:       <entry name="serial">04169f59-e9a6-4b50-9ad7-7f8c105a376a</entry>
Nov 08 23:29:10 user nova-compute[75045]:       <entry name="uuid">04169f59-e9a6-4b50-9ad7-7f8c105a376a</entry>
Nov 08 23:29:10 user nova-compute[75045]:       <entry name="family">Virtual Machine</entry>
Nov 08 23:29:10 user nova-compute[75045]:     </system>
Nov 08 23:29:10 user nova-compute[75045]:   </sysinfo>
Nov 08 23:29:10 user nova-compute[75045]:   <os>
Nov 08 23:29:10 user nova-compute[75045]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 23:29:10 user nova-compute[75045]:     <boot dev="hd"/>
Nov 08 23:29:10 user nova-compute[75045]:     <smbios mode="sysinfo"/>
Nov 08 23:29:10 user nova-compute[75045]:   </os>
Nov 08 23:29:10 user nova-compute[75045]:   <features>
Nov 08 23:29:10 user nova-compute[75045]:     <acpi/>
Nov 08 23:29:10 user nova-compute[75045]:     <apic/>
Nov 08 23:29:10 user nova-compute[75045]:     <vmcoreinfo/>
Nov 08 23:29:10 user nova-compute[75045]:   </features>
Nov 08 23:29:10 user nova-compute[75045]:   <clock offset="utc">
Nov 08 23:29:10 user nova-compute[75045]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 23:29:10 user nova-compute[75045]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 23:29:10 user nova-compute[75045]:     <timer name="hpet" present="no"/>
Nov 08 23:29:10 user nova-compute[75045]:   </clock>
Nov 08 23:29:10 user nova-compute[75045]:   <cpu mode="custom" match="exact">
Nov 08 23:29:10 user nova-compute[75045]:     <model>Nehalem</model>
Nov 08 23:29:10 user nova-compute[75045]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 23:29:10 user nova-compute[75045]:   </cpu>
Nov 08 23:29:10 user nova-compute[75045]:   <devices>
Nov 08 23:29:10 user nova-compute[75045]:     <disk type="block" device="disk">
Nov 08 23:29:10 user nova-compute[75045]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 23:29:10 user nova-compute[75045]:       <source dev="/dev/sdb"/>
Nov 08 23:29:10 user nova-compute[75045]:       <target dev="vda" bus="virtio"/>
Nov 08 23:29:10 user nova-compute[75045]:       <serial>e9c3ac6d-d72a-41c8-9c18-15131250e323</serial>
Nov 08 23:29:10 user nova-compute[75045]:     </disk>
Nov 08 23:29:10 user nova-compute[75045]:     <interface type="ethernet">
Nov 08 23:29:10 user nova-compute[75045]:       <mac address="fa:16:3e:a5:6d:8b"/>
Nov 08 23:29:10 user nova-compute[75045]:       <model type="virtio"/>
Nov 08 23:29:10 user nova-compute[75045]:       <mtu size="1442"/>
Nov 08 23:29:10 user nova-compute[75045]:       <target dev="tap96af9673-bb"/>
Nov 08 23:29:10 user nova-compute[75045]:     </interface>
Nov 08 23:29:10 user nova-compute[75045]:     <serial type="pty">
Nov 08 23:29:10 user nova-compute[75045]:       <log file="/opt/stack/data/nova/instances/04169f59-e9a6-4b50-9ad7-7f8c105a376a/console.log" append="off"/>
Nov 08 23:29:10 user nova-compute[75045]:     </serial>
Nov 08 23:29:10 user nova-compute[75045]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 23:29:10 user nova-compute[75045]:     <video>
Nov 08 23:29:10 user nova-compute[75045]:       <model type="virtio"/>
Nov 08 23:29:10 user nova-compute[75045]:     </video>
Nov 08 23:29:10 user nova-compute[75045]:     <rng model="virtio">
Nov 08 23:29:10 user nova-compute[75045]:       <backend model="random">/dev/urandom</backend>
Nov 08 23:29:10 user nova-compute[75045]:     </rng>
Nov 08 23:29:10 user nova-compute[75045]:     <controller type="usb" index="0" model="none"/>
Nov 08 23:29:10 user nova-compute[75045]:     <memballoon model="virtio">
Nov 08 23:29:10 user nova-compute[75045]:       <stats period="10"/>
Nov 08 23:29:10 user nova-compute[75045]:     </memballoon>
Nov 08 23:29:10 user nova-compute[75045]:   </devices>
Nov 08 23:29:10 user nova-compute[75045]: </domain>
Nov 08 23:29:10 user nova-compute[75045]:  {{(pid=75045) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 23:29:10 user nova-compute[75045]: DEBUG nova.virt.libvirt.vif [None req-ca9ec2ee-9154-4e3f-925c-fa499ff66d33 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T23:28:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1540084668',display_name='tempest-ServerActionsTestOtherA-server-1540084668',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1540084668',id=27,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDODl/KmGTsZ/iebmo5xmCcXvI602I8HkxrrHYOCSHtu28wqdqp4sqz8GjX6RCkUTvwm3o1RrGN7CPAGp6yuNsTNNdTZNeJLiXbNPx6WnByfZzN9Q7qtNxToi4a9/5pZlg==',key_name='tempest-keypair-679582766',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e63623113f11463d9035bb990de43510',ramdisk_id='',reservation_id='r-tx09g4z0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-2056815713',owner_user_name='tempest-ServerActionsTestOtherA-2056815713-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T23:28:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='75fc508f268d4a569ad78598ff019c14',uuid=04169f59-e9a6-4b50-9ad7-7f8c105a376a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "96af9673-bb3c-4173-8439-0be6d2b922cf", "address": "fa:16:3e:a5:6d:8b", "network": {"id": "700b5784-d35b-45c0-a4d3-1ab8aa4c48aa", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-194469807-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e63623113f11463d9035bb990de43510", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96af9673-bb", "ovs_interfaceid": "96af9673-bb3c-4173-8439-0be6d2b922cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75045) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 23:29:10 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-ca9ec2ee-9154-4e3f-925c-fa499ff66d33 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Converting VIF {"id": "96af9673-bb3c-4173-8439-0be6d2b922cf", "address": "fa:16:3e:a5:6d:8b", "network": {"id": "700b5784-d35b-45c0-a4d3-1ab8aa4c48aa", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-194469807-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e63623113f11463d9035bb990de43510", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96af9673-bb", "ovs_interfaceid": "96af9673-bb3c-4173-8439-0be6d2b922cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 23:29:10 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-ca9ec2ee-9154-4e3f-925c-fa499ff66d33 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a5:6d:8b,bridge_name='br-int',has_traffic_filtering=True,id=96af9673-bb3c-4173-8439-0be6d2b922cf,network=Network(700b5784-d35b-45c0-a4d3-1ab8aa4c48aa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96af9673-bb') {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 23:29:10 user nova-compute[75045]: DEBUG os_vif [None req-ca9ec2ee-9154-4e3f-925c-fa499ff66d33 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a5:6d:8b,bridge_name='br-int',has_traffic_filtering=True,id=96af9673-bb3c-4173-8439-0be6d2b922cf,network=Network(700b5784-d35b-45c0-a4d3-1ab8aa4c48aa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96af9673-bb') {{(pid=75045) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 23:29:10 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:29:10 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:29:10 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 23:29:10 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:29:10 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '761649fd-8edc-59e0-85df-1e270aad8726', '_type': 'linux-noop'}}, row=False) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:29:10 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:29:10 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:29:10 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83187c89-e833-4efd-afa0-2cbfe05d8db1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:29:10 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee31bcf8-eb13-47d4-b07e-0328a669c879]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:29:10 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f4d4c6c-cec0-4708-b180-7b306fe35c42 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:29:10 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:29:10 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap96af9673-bb, may_exist=True, interface_attrs={}) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:29:10 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap96af9673-bb, col_values=(('qos', UUID('e668005f-2347-47c1-a5cb-9fe3b5690f25')),), if_exists=True) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:29:10 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap96af9673-bb, col_values=(('external_ids', {'iface-id': '96af9673-bb3c-4173-8439-0be6d2b922cf', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a5:6d:8b', 'vm-uuid': '04169f59-e9a6-4b50-9ad7-7f8c105a376a'}),), if_exists=True) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:29:10 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83187c89-e833-4efd-afa0-2cbfe05d8db1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:29:10 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:29:10 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 23:29:10 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:29:10 user nova-compute[75045]: INFO os_vif [None req-ca9ec2ee-9154-4e3f-925c-fa499ff66d33 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a5:6d:8b,bridge_name='br-int',has_traffic_filtering=True,id=96af9673-bb3c-4173-8439-0be6d2b922cf,network=Network(700b5784-d35b-45c0-a4d3-1ab8aa4c48aa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96af9673-bb')
Nov 08 23:29:10 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83187c89-e833-4efd-afa0-2cbfe05d8db1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.030s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:29:10 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[5265f0b9-1eb3-4ed9-a6a1-8101089a4b29]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:29:10 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f4d4c6c-cec0-4708-b180-7b306fe35c42 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:29:10 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83187c89-e833-4efd-afa0-2cbfe05d8db1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gzFECVaq {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:29:10 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83187c89-e833-4efd-afa0-2cbfe05d8db1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gzFECVaq" returned: 0 in 0.018s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:29:10 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[f55fb629-6ebb-49c8-a233-b3a31d197f08]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:29:10 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f4d4c6c-cec0-4708-b180-7b306fe35c42 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'gzFECVaq'): stdout= stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:29:10 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83187c89-e833-4efd-afa0-2cbfe05d8db1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:29:10 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83187c89-e833-4efd-afa0-2cbfe05d8db1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:29:10 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4df071a-373c-498b-acd7-82cf87f7af30]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:29:10 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f4d4c6c-cec0-4708-b180-7b306fe35c42 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:29:10 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:29:10 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-ca9ec2ee-9154-4e3f-925c-fa499ff66d33 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] No BDM found with device name vda, not building metadata. {{(pid=75045) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 23:29:10 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-ca9ec2ee-9154-4e3f-925c-fa499ff66d33 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] No VIF found with MAC fa:16:3e:a5:6d:8b, not building metadata {{(pid=75045) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 23:29:10 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:29:10 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef1340af-5302-41da-a9a7-0cd40add60ab]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2e734fa-1dcb-4510-a50e-064e29c2985e (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9c3ac6d-d72a-41c8-9c18-15131250e323 (non-flash)\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:29:10 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f4d4c6c-cec0-4708-b180-7b306fe35c42 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab (non-flash)
Nov 08 23:29:10 user nova-compute[75045]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2e734fa-1dcb-4510-a50e-064e29c2985e (non-flash)
Nov 08 23:29:10 user nova-compute[75045]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9c3ac6d-d72a-41c8-9c18-15131250e323 (non-flash)
Nov 08 23:29:10 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 23:29:10 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f4d4c6c-cec0-4708-b180-7b306fe35c42 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab (non-flash)
Nov 08 23:29:10 user nova-compute[75045]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2e734fa-1dcb-4510-a50e-064e29c2985e (non-flash)
Nov 08 23:29:10 user nova-compute[75045]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9c3ac6d-d72a-41c8-9c18-15131250e323 (non-flash)
Nov 08 23:29:10 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 23:29:10 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83187c89-e833-4efd-afa0-2cbfe05d8db1 -p 172.16.0.220:3260 --login {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:29:10 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83187c89-e833-4efd-afa0-2cbfe05d8db1 -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:29:10 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c778847-9519-46c5-8a86-945fc29d5fd8]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:83187c89-e833-4efd-afa0-2cbfe05d8db1, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:83187c89-e833-4efd-afa0-2cbfe05d8db1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:29:10 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f4d4c6c-cec0-4708-b180-7b306fe35c42 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:83187c89-e833-4efd-afa0-2cbfe05d8db1, portal: 172.16.0.220,3260]
Nov 08 23:29:10 user nova-compute[75045]: Login to [iface: default, target: iqn.2010-10.org.openstack:83187c89-e833-4efd-afa0-2cbfe05d8db1, portal: 172.16.0.220,3260] successful.
Nov 08 23:29:10 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:29:10 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83187c89-e833-4efd-afa0-2cbfe05d8db1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:29:10 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83187c89-e833-4efd-afa0-2cbfe05d8db1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:29:10 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[4611ed42-2a7e-4a81-8606-2e48395f6897]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:29:10 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f4d4c6c-cec0-4708-b180-7b306fe35c42 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:29:10 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:29:11 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:29:11 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[c49cfb76-4fb3-40a9-aae5-84cf619db860]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2e734fa-1dcb-4510-a50e-064e29c2985e (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9c3ac6d-d72a-41c8-9c18-15131250e323 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83187c89-e833-4efd-afa0-2cbfe05d8db1 (non-flash)\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:29:11 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f4d4c6c-cec0-4708-b180-7b306fe35c42 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab (non-flash)
Nov 08 23:29:11 user nova-compute[75045]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2e734fa-1dcb-4510-a50e-064e29c2985e (non-flash)
Nov 08 23:29:11 user nova-compute[75045]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9c3ac6d-d72a-41c8-9c18-15131250e323 (non-flash)
Nov 08 23:29:11 user nova-compute[75045]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83187c89-e833-4efd-afa0-2cbfe05d8db1 (non-flash)
Nov 08 23:29:11 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 23:29:11 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f4d4c6c-cec0-4708-b180-7b306fe35c42 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab (non-flash)
Nov 08 23:29:11 user nova-compute[75045]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2e734fa-1dcb-4510-a50e-064e29c2985e (non-flash)
Nov 08 23:29:11 user nova-compute[75045]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9c3ac6d-d72a-41c8-9c18-15131250e323 (non-flash)
Nov 08 23:29:11 user nova-compute[75045]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83187c89-e833-4efd-afa0-2cbfe05d8db1 (non-flash)
Nov 08 23:29:11 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 23:29:11 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-8f4d4c6c-cec0-4708-b180-7b306fe35c42 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:83187c89-e833-4efd-afa0-2cbfe05d8db1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.291s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 23:29:11 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f4d4c6c-cec0-4708-b180-7b306fe35c42 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Connected to 172.16.0.220:3260 {{(pid=75045) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 23:29:11 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-8f4d4c6c-cec0-4708-b180-7b306fe35c42 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] HCTL ('35', '-', '-', 0) found on session 29 with lun 0 {{(pid=75045) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 23:29:11 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-8f4d4c6c-cec0-4708-b180-7b306fe35c42 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75045) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 23:29:11 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:29:11 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:29:11 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d1cb984-f62b-4525-81a4-208f7dcbc4ea]: (4, ('- - 0', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:29:11 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-8f4d4c6c-cec0-4708-b180-7b306fe35c42 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Searching for a device in session 29 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75045) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 23:29:11 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f4d4c6c-cec0-4708-b180-7b306fe35c42 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:83187c89-e833-4efd-afa0-2cbfe05d8db1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gzFECVaq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75045) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 23:29:11 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:29:12 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-8f4d4c6c-cec0-4708-b180-7b306fe35c42 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.323s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 23:29:12 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f4d4c6c-cec0-4708-b180-7b306fe35c42 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] <== connect_volume: return (2648ms) {'type': 'block', 'scsi_wwn': '26137346239616433', 'path': '/dev/sdd'} {{(pid=75045) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 23:29:12 user nova-compute[75045]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8f4d4c6c-cec0-4708-b180-7b306fe35c42 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] [instance: 438082fc-a83f-4305-ada6-41a8e1d645a8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26137346239616433', 'path': '/dev/sdd'} {{(pid=75045) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 23:29:12 user nova-compute[75045]: DEBUG nova.virt.libvirt.vif [None req-8f4d4c6c-cec0-4708-b180-7b306fe35c42 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T23:27:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-761970552',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-761970552',id=26,image_ref='a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6bfb6963a6c145d4a7b7e47c8fde7e60',ramdisk_id='',reservation_id='r-lkcobnbl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-474110917',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T23:27:58Z,user_data=None,user_id='04bb3135250f4465a9947b47f9cde485',uuid=438082fc-a83f-4305-ada6-41a8e1d645a8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "669f0f7f-7c58-42b9-948b-ad3704fb1ab3", "address": "fa:16:3e:57:c2:f9", "network": {"id": "d4cd6998-66d1-4389-bc82-dd000c8962de", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-323966879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bfb6963a6c145d4a7b7e47c8fde7e60", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap669f0f7f-7c", "ovs_interfaceid": "669f0f7f-7c58-42b9-948b-ad3704fb1ab3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75045) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 23:29:12 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-8f4d4c6c-cec0-4708-b180-7b306fe35c42 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Converting VIF {"id": "669f0f7f-7c58-42b9-948b-ad3704fb1ab3", "address": "fa:16:3e:57:c2:f9", "network": {"id": "d4cd6998-66d1-4389-bc82-dd000c8962de", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-323966879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bfb6963a6c145d4a7b7e47c8fde7e60", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap669f0f7f-7c", "ovs_interfaceid": "669f0f7f-7c58-42b9-948b-ad3704fb1ab3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 23:29:12 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-8f4d4c6c-cec0-4708-b180-7b306fe35c42 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:57:c2:f9,bridge_name='br-int',has_traffic_filtering=True,id=669f0f7f-7c58-42b9-948b-ad3704fb1ab3,network=Network(d4cd6998-66d1-4389-bc82-dd000c8962de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap669f0f7f-7c') {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 23:29:12 user nova-compute[75045]: DEBUG nova.objects.instance [None req-8f4d4c6c-cec0-4708-b180-7b306fe35c42 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Lazy-loading 'pci_devices' on Instance uuid 438082fc-a83f-4305-ada6-41a8e1d645a8 {{(pid=75045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 23:29:12 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-8f4d4c6c-cec0-4708-b180-7b306fe35c42 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] [instance: 438082fc-a83f-4305-ada6-41a8e1d645a8] End _get_guest_xml xml=<domain type="kvm">
Nov 08 23:29:12 user nova-compute[75045]:   <uuid>438082fc-a83f-4305-ada6-41a8e1d645a8</uuid>
Nov 08 23:29:12 user nova-compute[75045]:   <name>instance-0000001a</name>
Nov 08 23:29:12 user nova-compute[75045]:   <memory>524288</memory>
Nov 08 23:29:12 user nova-compute[75045]:   <vcpu>1</vcpu>
Nov 08 23:29:12 user nova-compute[75045]:   <metadata>
Nov 08 23:29:12 user nova-compute[75045]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 23:29:12 user nova-compute[75045]:       <nova:package version="0.0.0"/>
Nov 08 23:29:12 user nova-compute[75045]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-761970552</nova:name>
Nov 08 23:29:12 user nova-compute[75045]:       <nova:creationTime>2023-11-08 23:29:09</nova:creationTime>
Nov 08 23:29:12 user nova-compute[75045]:       <nova:flavor name="m1.tiny">
Nov 08 23:29:12 user nova-compute[75045]:         <nova:memory>512</nova:memory>
Nov 08 23:29:12 user nova-compute[75045]:         <nova:disk>1</nova:disk>
Nov 08 23:29:12 user nova-compute[75045]:         <nova:swap>0</nova:swap>
Nov 08 23:29:12 user nova-compute[75045]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 23:29:12 user nova-compute[75045]:         <nova:vcpus>1</nova:vcpus>
Nov 08 23:29:12 user nova-compute[75045]:       </nova:flavor>
Nov 08 23:29:12 user nova-compute[75045]:       <nova:owner>
Nov 08 23:29:12 user nova-compute[75045]:         <nova:user uuid="04bb3135250f4465a9947b47f9cde485">tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member</nova:user>
Nov 08 23:29:12 user nova-compute[75045]:         <nova:project uuid="6bfb6963a6c145d4a7b7e47c8fde7e60">tempest-ServerBootFromVolumeStableRescueTest-474110917</nova:project>
Nov 08 23:29:12 user nova-compute[75045]:       </nova:owner>
Nov 08 23:29:12 user nova-compute[75045]:       <nova:root type="image" uuid="a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb"/>
Nov 08 23:29:12 user nova-compute[75045]:       <nova:ports>
Nov 08 23:29:12 user nova-compute[75045]:         <nova:port uuid="669f0f7f-7c58-42b9-948b-ad3704fb1ab3">
Nov 08 23:29:12 user nova-compute[75045]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 08 23:29:12 user nova-compute[75045]:         </nova:port>
Nov 08 23:29:12 user nova-compute[75045]:       </nova:ports>
Nov 08 23:29:12 user nova-compute[75045]:     </nova:instance>
Nov 08 23:29:12 user nova-compute[75045]:   </metadata>
Nov 08 23:29:12 user nova-compute[75045]:   <sysinfo type="smbios">
Nov 08 23:29:12 user nova-compute[75045]:     <system>
Nov 08 23:29:12 user nova-compute[75045]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 23:29:12 user nova-compute[75045]:       <entry name="product">OpenStack Nova</entry>
Nov 08 23:29:12 user nova-compute[75045]:       <entry name="version">0.0.0</entry>
Nov 08 23:29:12 user nova-compute[75045]:       <entry name="serial">438082fc-a83f-4305-ada6-41a8e1d645a8</entry>
Nov 08 23:29:12 user nova-compute[75045]:       <entry name="uuid">438082fc-a83f-4305-ada6-41a8e1d645a8</entry>
Nov 08 23:29:12 user nova-compute[75045]:       <entry name="family">Virtual Machine</entry>
Nov 08 23:29:12 user nova-compute[75045]:     </system>
Nov 08 23:29:12 user nova-compute[75045]:   </sysinfo>
Nov 08 23:29:12 user nova-compute[75045]:   <os>
Nov 08 23:29:12 user nova-compute[75045]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 23:29:12 user nova-compute[75045]:     <boot dev="hd"/>
Nov 08 23:29:12 user nova-compute[75045]:     <smbios mode="sysinfo"/>
Nov 08 23:29:12 user nova-compute[75045]:   </os>
Nov 08 23:29:12 user nova-compute[75045]:   <features>
Nov 08 23:29:12 user nova-compute[75045]:     <acpi/>
Nov 08 23:29:12 user nova-compute[75045]:     <apic/>
Nov 08 23:29:12 user nova-compute[75045]:     <vmcoreinfo/>
Nov 08 23:29:12 user nova-compute[75045]:   </features>
Nov 08 23:29:12 user nova-compute[75045]:   <clock offset="utc">
Nov 08 23:29:12 user nova-compute[75045]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 23:29:12 user nova-compute[75045]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 23:29:12 user nova-compute[75045]:     <timer name="hpet" present="no"/>
Nov 08 23:29:12 user nova-compute[75045]:   </clock>
Nov 08 23:29:12 user nova-compute[75045]:   <cpu mode="custom" match="exact">
Nov 08 23:29:12 user nova-compute[75045]:     <model>Nehalem</model>
Nov 08 23:29:12 user nova-compute[75045]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 23:29:12 user nova-compute[75045]:   </cpu>
Nov 08 23:29:12 user nova-compute[75045]:   <devices>
Nov 08 23:29:12 user nova-compute[75045]:     <disk type="block" device="disk">
Nov 08 23:29:12 user nova-compute[75045]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 23:29:12 user nova-compute[75045]:       <source dev="/dev/sdd"/>
Nov 08 23:29:12 user nova-compute[75045]:       <target dev="vda" bus="virtio"/>
Nov 08 23:29:12 user nova-compute[75045]:       <serial>83187c89-e833-4efd-afa0-2cbfe05d8db1</serial>
Nov 08 23:29:12 user nova-compute[75045]:     </disk>
Nov 08 23:29:12 user nova-compute[75045]:     <interface type="ethernet">
Nov 08 23:29:12 user nova-compute[75045]:       <mac address="fa:16:3e:57:c2:f9"/>
Nov 08 23:29:12 user nova-compute[75045]:       <model type="virtio"/>
Nov 08 23:29:12 user nova-compute[75045]:       <mtu size="1442"/>
Nov 08 23:29:12 user nova-compute[75045]:       <target dev="tap669f0f7f-7c"/>
Nov 08 23:29:12 user nova-compute[75045]:     </interface>
Nov 08 23:29:12 user nova-compute[75045]:     <serial type="pty">
Nov 08 23:29:12 user nova-compute[75045]:       <log file="/opt/stack/data/nova/instances/438082fc-a83f-4305-ada6-41a8e1d645a8/console.log" append="off"/>
Nov 08 23:29:12 user nova-compute[75045]:     </serial>
Nov 08 23:29:12 user nova-compute[75045]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 23:29:12 user nova-compute[75045]:     <video>
Nov 08 23:29:12 user nova-compute[75045]:       <model type="virtio"/>
Nov 08 23:29:12 user nova-compute[75045]:     </video>
Nov 08 23:29:12 user nova-compute[75045]:     <rng model="virtio">
Nov 08 23:29:12 user nova-compute[75045]:       <backend model="random">/dev/urandom</backend>
Nov 08 23:29:12 user nova-compute[75045]:     </rng>
Nov 08 23:29:12 user nova-compute[75045]:     <controller type="usb" index="0" model="none"/>
Nov 08 23:29:12 user nova-compute[75045]:     <memballoon model="virtio">
Nov 08 23:29:12 user nova-compute[75045]:       <stats period="10"/>
Nov 08 23:29:12 user nova-compute[75045]:     </memballoon>
Nov 08 23:29:12 user nova-compute[75045]:   </devices>
Nov 08 23:29:12 user nova-compute[75045]: </domain>
Nov 08 23:29:12 user nova-compute[75045]:  {{(pid=75045) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 23:29:12 user nova-compute[75045]: DEBUG nova.virt.libvirt.vif [None req-8f4d4c6c-cec0-4708-b180-7b306fe35c42 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T23:27:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-761970552',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-761970552',id=26,image_ref='a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6bfb6963a6c145d4a7b7e47c8fde7e60',ramdisk_id='',reservation_id='r-lkcobnbl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-474110917',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T23:27:58Z,user_data=None,user_id='04bb3135250f4465a9947b47f9cde485',uuid=438082fc-a83f-4305-ada6-41a8e1d645a8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "669f0f7f-7c58-42b9-948b-ad3704fb1ab3", "address": "fa:16:3e:57:c2:f9", "network": {"id": "d4cd6998-66d1-4389-bc82-dd000c8962de", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-323966879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bfb6963a6c145d4a7b7e47c8fde7e60", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap669f0f7f-7c", "ovs_interfaceid": "669f0f7f-7c58-42b9-948b-ad3704fb1ab3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75045) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 23:29:12 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-8f4d4c6c-cec0-4708-b180-7b306fe35c42 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Converting VIF {"id": "669f0f7f-7c58-42b9-948b-ad3704fb1ab3", "address": "fa:16:3e:57:c2:f9", "network": {"id": "d4cd6998-66d1-4389-bc82-dd000c8962de", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-323966879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bfb6963a6c145d4a7b7e47c8fde7e60", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap669f0f7f-7c", "ovs_interfaceid": "669f0f7f-7c58-42b9-948b-ad3704fb1ab3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 23:29:12 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-8f4d4c6c-cec0-4708-b180-7b306fe35c42 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:57:c2:f9,bridge_name='br-int',has_traffic_filtering=True,id=669f0f7f-7c58-42b9-948b-ad3704fb1ab3,network=Network(d4cd6998-66d1-4389-bc82-dd000c8962de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap669f0f7f-7c') {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 23:29:12 user nova-compute[75045]: DEBUG os_vif [None req-8f4d4c6c-cec0-4708-b180-7b306fe35c42 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:57:c2:f9,bridge_name='br-int',has_traffic_filtering=True,id=669f0f7f-7c58-42b9-948b-ad3704fb1ab3,network=Network(d4cd6998-66d1-4389-bc82-dd000c8962de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap669f0f7f-7c') {{(pid=75045) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 23:29:12 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:29:12 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:29:12 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 23:29:12 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:29:12 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'db8d6939-abbb-54ad-8bda-ea8db271f873', '_type': 'linux-noop'}}, row=False) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:29:12 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:29:12 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 23:29:12 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:29:12 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:29:12 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap669f0f7f-7c, may_exist=True, interface_attrs={}) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:29:12 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap669f0f7f-7c, col_values=(('qos', UUID('cbbd4bce-4d67-4ce5-966f-56e2aea7d0ac')),), if_exists=True) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:29:12 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap669f0f7f-7c, col_values=(('external_ids', {'iface-id': '669f0f7f-7c58-42b9-948b-ad3704fb1ab3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:57:c2:f9', 'vm-uuid': '438082fc-a83f-4305-ada6-41a8e1d645a8'}),), if_exists=True) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:29:12 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:29:12 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 23:29:12 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:29:12 user nova-compute[75045]: INFO os_vif [None req-8f4d4c6c-cec0-4708-b180-7b306fe35c42 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:57:c2:f9,bridge_name='br-int',has_traffic_filtering=True,id=669f0f7f-7c58-42b9-948b-ad3704fb1ab3,network=Network(d4cd6998-66d1-4389-bc82-dd000c8962de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap669f0f7f-7c')
Nov 08 23:29:12 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:29:12 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:29:12 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:29:12 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-8f4d4c6c-cec0-4708-b180-7b306fe35c42 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] No BDM found with device name vda, not building metadata. {{(pid=75045) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 23:29:12 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-8f4d4c6c-cec0-4708-b180-7b306fe35c42 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] No VIF found with MAC fa:16:3e:57:c2:f9, not building metadata {{(pid=75045) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 23:29:12 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:29:12 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:29:13 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:29:13 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:29:13 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:29:14 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:29:14 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:29:14 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:29:14 user nova-compute[75045]: DEBUG nova.compute.manager [req-9acc4ef4-c426-4e5a-a0b7-f737e46ff245 req-6be4ec7d-bb60-4346-9d6c-20c013f9426f service nova] [instance: 04169f59-e9a6-4b50-9ad7-7f8c105a376a] Received event network-vif-plugged-96af9673-bb3c-4173-8439-0be6d2b922cf {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:29:14 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-9acc4ef4-c426-4e5a-a0b7-f737e46ff245 req-6be4ec7d-bb60-4346-9d6c-20c013f9426f service nova] Acquiring lock "04169f59-e9a6-4b50-9ad7-7f8c105a376a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:29:14 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-9acc4ef4-c426-4e5a-a0b7-f737e46ff245 req-6be4ec7d-bb60-4346-9d6c-20c013f9426f service nova] Lock "04169f59-e9a6-4b50-9ad7-7f8c105a376a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:29:14 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-9acc4ef4-c426-4e5a-a0b7-f737e46ff245 req-6be4ec7d-bb60-4346-9d6c-20c013f9426f service nova] Lock "04169f59-e9a6-4b50-9ad7-7f8c105a376a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:29:14 user nova-compute[75045]: DEBUG nova.compute.manager [req-9acc4ef4-c426-4e5a-a0b7-f737e46ff245 req-6be4ec7d-bb60-4346-9d6c-20c013f9426f service nova] [instance: 04169f59-e9a6-4b50-9ad7-7f8c105a376a] No waiting events found dispatching network-vif-plugged-96af9673-bb3c-4173-8439-0be6d2b922cf {{(pid=75045) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 23:29:14 user nova-compute[75045]: WARNING nova.compute.manager [req-9acc4ef4-c426-4e5a-a0b7-f737e46ff245 req-6be4ec7d-bb60-4346-9d6c-20c013f9426f service nova] [instance: 04169f59-e9a6-4b50-9ad7-7f8c105a376a] Received unexpected event network-vif-plugged-96af9673-bb3c-4173-8439-0be6d2b922cf for instance with vm_state building and task_state spawning.
Nov 08 23:29:15 user nova-compute[75045]: DEBUG nova.compute.manager [None req-ca9ec2ee-9154-4e3f-925c-fa499ff66d33 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] [instance: 04169f59-e9a6-4b50-9ad7-7f8c105a376a] Instance event wait completed in 0 seconds for  {{(pid=75045) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 23:29:15 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-ca9ec2ee-9154-4e3f-925c-fa499ff66d33 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] [instance: 04169f59-e9a6-4b50-9ad7-7f8c105a376a] Guest created on hypervisor {{(pid=75045) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 23:29:15 user nova-compute[75045]: INFO nova.virt.libvirt.driver [-] [instance: 04169f59-e9a6-4b50-9ad7-7f8c105a376a] Instance spawned successfully.
Nov 08 23:29:15 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-ca9ec2ee-9154-4e3f-925c-fa499ff66d33 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] [instance: 04169f59-e9a6-4b50-9ad7-7f8c105a376a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75045) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 23:29:15 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-ca9ec2ee-9154-4e3f-925c-fa499ff66d33 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] [instance: 04169f59-e9a6-4b50-9ad7-7f8c105a376a] Found default for hw_cdrom_bus of ide {{(pid=75045) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 23:29:15 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-ca9ec2ee-9154-4e3f-925c-fa499ff66d33 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] [instance: 04169f59-e9a6-4b50-9ad7-7f8c105a376a] Found default for hw_disk_bus of virtio {{(pid=75045) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 23:29:15 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-ca9ec2ee-9154-4e3f-925c-fa499ff66d33 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] [instance: 04169f59-e9a6-4b50-9ad7-7f8c105a376a] Found default for hw_input_bus of None {{(pid=75045) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 23:29:15 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-ca9ec2ee-9154-4e3f-925c-fa499ff66d33 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] [instance: 04169f59-e9a6-4b50-9ad7-7f8c105a376a] Found default for hw_pointer_model of None {{(pid=75045) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 23:29:15 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-ca9ec2ee-9154-4e3f-925c-fa499ff66d33 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] [instance: 04169f59-e9a6-4b50-9ad7-7f8c105a376a] Found default for hw_video_model of virtio {{(pid=75045) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 23:29:15 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-ca9ec2ee-9154-4e3f-925c-fa499ff66d33 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] [instance: 04169f59-e9a6-4b50-9ad7-7f8c105a376a] Found default for hw_vif_model of virtio {{(pid=75045) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 23:29:15 user nova-compute[75045]: INFO nova.compute.manager [None req-ca9ec2ee-9154-4e3f-925c-fa499ff66d33 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] [instance: 04169f59-e9a6-4b50-9ad7-7f8c105a376a] Took 6.36 seconds to spawn the instance on the hypervisor.
Nov 08 23:29:15 user nova-compute[75045]: DEBUG nova.compute.manager [None req-ca9ec2ee-9154-4e3f-925c-fa499ff66d33 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] [instance: 04169f59-e9a6-4b50-9ad7-7f8c105a376a] Checking state {{(pid=75045) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 23:29:15 user nova-compute[75045]: INFO nova.compute.manager [None req-ca9ec2ee-9154-4e3f-925c-fa499ff66d33 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] [instance: 04169f59-e9a6-4b50-9ad7-7f8c105a376a] Took 74.42 seconds to build instance.
Nov 08 23:29:15 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-ca9ec2ee-9154-4e3f-925c-fa499ff66d33 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Lock "04169f59-e9a6-4b50-9ad7-7f8c105a376a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 74.524s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:29:16 user nova-compute[75045]: DEBUG nova.compute.manager [None req-8f4d4c6c-cec0-4708-b180-7b306fe35c42 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] [instance: 438082fc-a83f-4305-ada6-41a8e1d645a8] Instance event wait completed in 0 seconds for  {{(pid=75045) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 23:29:16 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-8f4d4c6c-cec0-4708-b180-7b306fe35c42 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] [instance: 438082fc-a83f-4305-ada6-41a8e1d645a8] Guest created on hypervisor {{(pid=75045) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 23:29:16 user nova-compute[75045]: INFO nova.virt.libvirt.driver [-] [instance: 438082fc-a83f-4305-ada6-41a8e1d645a8] Instance spawned successfully.
Nov 08 23:29:16 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-8f4d4c6c-cec0-4708-b180-7b306fe35c42 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] [instance: 438082fc-a83f-4305-ada6-41a8e1d645a8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75045) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 23:29:16 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-8f4d4c6c-cec0-4708-b180-7b306fe35c42 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] [instance: 438082fc-a83f-4305-ada6-41a8e1d645a8] Found default for hw_cdrom_bus of ide {{(pid=75045) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 23:29:16 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-8f4d4c6c-cec0-4708-b180-7b306fe35c42 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] [instance: 438082fc-a83f-4305-ada6-41a8e1d645a8] Found default for hw_disk_bus of virtio {{(pid=75045) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 23:29:16 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-8f4d4c6c-cec0-4708-b180-7b306fe35c42 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] [instance: 438082fc-a83f-4305-ada6-41a8e1d645a8] Found default for hw_input_bus of None {{(pid=75045) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 23:29:16 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-8f4d4c6c-cec0-4708-b180-7b306fe35c42 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] [instance: 438082fc-a83f-4305-ada6-41a8e1d645a8] Found default for hw_pointer_model of None {{(pid=75045) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 23:29:16 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-8f4d4c6c-cec0-4708-b180-7b306fe35c42 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] [instance: 438082fc-a83f-4305-ada6-41a8e1d645a8] Found default for hw_video_model of virtio {{(pid=75045) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 23:29:16 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-8f4d4c6c-cec0-4708-b180-7b306fe35c42 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] [instance: 438082fc-a83f-4305-ada6-41a8e1d645a8] Found default for hw_vif_model of virtio {{(pid=75045) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 23:29:16 user nova-compute[75045]: INFO nova.compute.manager [None req-8f4d4c6c-cec0-4708-b180-7b306fe35c42 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] [instance: 438082fc-a83f-4305-ada6-41a8e1d645a8] Took 6.88 seconds to spawn the instance on the hypervisor.
Nov 08 23:29:16 user nova-compute[75045]: DEBUG nova.compute.manager [None req-8f4d4c6c-cec0-4708-b180-7b306fe35c42 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] [instance: 438082fc-a83f-4305-ada6-41a8e1d645a8] Checking state {{(pid=75045) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 23:29:16 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:29:16 user nova-compute[75045]: INFO nova.compute.manager [None req-8f4d4c6c-cec0-4708-b180-7b306fe35c42 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] [instance: 438082fc-a83f-4305-ada6-41a8e1d645a8] Took 79.00 seconds to build instance.
Nov 08 23:29:16 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-8f4d4c6c-cec0-4708-b180-7b306fe35c42 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Lock "438082fc-a83f-4305-ada6-41a8e1d645a8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 79.132s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:29:17 user nova-compute[75045]: DEBUG nova.compute.manager [req-f165643e-c83e-4ae5-8837-ed4a3e2eb724 req-f2030a3b-42f2-411d-806f-c78d82f2fd51 service nova] [instance: 04169f59-e9a6-4b50-9ad7-7f8c105a376a] Received event network-vif-plugged-96af9673-bb3c-4173-8439-0be6d2b922cf {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:29:17 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-f165643e-c83e-4ae5-8837-ed4a3e2eb724 req-f2030a3b-42f2-411d-806f-c78d82f2fd51 service nova] Acquiring lock "04169f59-e9a6-4b50-9ad7-7f8c105a376a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:29:17 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-f165643e-c83e-4ae5-8837-ed4a3e2eb724 req-f2030a3b-42f2-411d-806f-c78d82f2fd51 service nova] Lock "04169f59-e9a6-4b50-9ad7-7f8c105a376a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:29:17 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-f165643e-c83e-4ae5-8837-ed4a3e2eb724 req-f2030a3b-42f2-411d-806f-c78d82f2fd51 service nova] Lock "04169f59-e9a6-4b50-9ad7-7f8c105a376a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:29:17 user nova-compute[75045]: DEBUG nova.compute.manager [req-f165643e-c83e-4ae5-8837-ed4a3e2eb724 req-f2030a3b-42f2-411d-806f-c78d82f2fd51 service nova] [instance: 04169f59-e9a6-4b50-9ad7-7f8c105a376a] No waiting events found dispatching network-vif-plugged-96af9673-bb3c-4173-8439-0be6d2b922cf {{(pid=75045) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 23:29:17 user nova-compute[75045]: WARNING nova.compute.manager [req-f165643e-c83e-4ae5-8837-ed4a3e2eb724 req-f2030a3b-42f2-411d-806f-c78d82f2fd51 service nova] [instance: 04169f59-e9a6-4b50-9ad7-7f8c105a376a] Received unexpected event network-vif-plugged-96af9673-bb3c-4173-8439-0be6d2b922cf for instance with vm_state active and task_state None.
Nov 08 23:29:17 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:29:18 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:29:19 user nova-compute[75045]: DEBUG nova.compute.manager [req-63fefaae-b0ca-4158-a7dd-199383f240ad req-9798d816-31f1-48b9-9c70-ebad83fe7aea service nova] [instance: 438082fc-a83f-4305-ada6-41a8e1d645a8] Received event network-vif-plugged-669f0f7f-7c58-42b9-948b-ad3704fb1ab3 {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:29:19 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-63fefaae-b0ca-4158-a7dd-199383f240ad req-9798d816-31f1-48b9-9c70-ebad83fe7aea service nova] Acquiring lock "438082fc-a83f-4305-ada6-41a8e1d645a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:29:19 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-63fefaae-b0ca-4158-a7dd-199383f240ad req-9798d816-31f1-48b9-9c70-ebad83fe7aea service nova] Lock "438082fc-a83f-4305-ada6-41a8e1d645a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:29:19 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-63fefaae-b0ca-4158-a7dd-199383f240ad req-9798d816-31f1-48b9-9c70-ebad83fe7aea service nova] Lock "438082fc-a83f-4305-ada6-41a8e1d645a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:29:19 user nova-compute[75045]: DEBUG nova.compute.manager [req-63fefaae-b0ca-4158-a7dd-199383f240ad req-9798d816-31f1-48b9-9c70-ebad83fe7aea service nova] [instance: 438082fc-a83f-4305-ada6-41a8e1d645a8] No waiting events found dispatching network-vif-plugged-669f0f7f-7c58-42b9-948b-ad3704fb1ab3 {{(pid=75045) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 23:29:19 user nova-compute[75045]: WARNING nova.compute.manager [req-63fefaae-b0ca-4158-a7dd-199383f240ad req-9798d816-31f1-48b9-9c70-ebad83fe7aea service nova] [instance: 438082fc-a83f-4305-ada6-41a8e1d645a8] Received unexpected event network-vif-plugged-669f0f7f-7c58-42b9-948b-ad3704fb1ab3 for instance with vm_state active and task_state None.
Nov 08 23:29:20 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:29:21 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:29:21 user nova-compute[75045]: DEBUG nova.compute.manager [req-93282199-299a-4f8c-af66-67f7889362ed req-a04db33a-bf37-4f03-8d5f-a3ea85f2b2ec service nova] [instance: 438082fc-a83f-4305-ada6-41a8e1d645a8] Received event network-vif-plugged-669f0f7f-7c58-42b9-948b-ad3704fb1ab3 {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:29:21 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-93282199-299a-4f8c-af66-67f7889362ed req-a04db33a-bf37-4f03-8d5f-a3ea85f2b2ec service nova] Acquiring lock "438082fc-a83f-4305-ada6-41a8e1d645a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:29:21 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-93282199-299a-4f8c-af66-67f7889362ed req-a04db33a-bf37-4f03-8d5f-a3ea85f2b2ec service nova] Lock "438082fc-a83f-4305-ada6-41a8e1d645a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:29:21 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-93282199-299a-4f8c-af66-67f7889362ed req-a04db33a-bf37-4f03-8d5f-a3ea85f2b2ec service nova] Lock "438082fc-a83f-4305-ada6-41a8e1d645a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:29:21 user nova-compute[75045]: DEBUG nova.compute.manager [req-93282199-299a-4f8c-af66-67f7889362ed req-a04db33a-bf37-4f03-8d5f-a3ea85f2b2ec service nova] [instance: 438082fc-a83f-4305-ada6-41a8e1d645a8] No waiting events found dispatching network-vif-plugged-669f0f7f-7c58-42b9-948b-ad3704fb1ab3 {{(pid=75045) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 23:29:21 user nova-compute[75045]: WARNING nova.compute.manager [req-93282199-299a-4f8c-af66-67f7889362ed req-a04db33a-bf37-4f03-8d5f-a3ea85f2b2ec service nova] [instance: 438082fc-a83f-4305-ada6-41a8e1d645a8] Received unexpected event network-vif-plugged-669f0f7f-7c58-42b9-948b-ad3704fb1ab3 for instance with vm_state active and task_state None.
Nov 08 23:29:22 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:29:22 user nova-compute[75045]: INFO nova.compute.manager [None req-16a0c522-9087-41f1-adce-eb0645b7099f tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] [instance: b5fc7f02-2143-4bcf-92ac-078d5ec10747] Unrescuing
Nov 08 23:29:22 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-16a0c522-9087-41f1-adce-eb0645b7099f tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] Acquiring lock "refresh_cache-b5fc7f02-2143-4bcf-92ac-078d5ec10747" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 23:29:22 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-16a0c522-9087-41f1-adce-eb0645b7099f tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] Acquired lock "refresh_cache-b5fc7f02-2143-4bcf-92ac-078d5ec10747" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 23:29:22 user nova-compute[75045]: DEBUG nova.network.neutron [None req-16a0c522-9087-41f1-adce-eb0645b7099f tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] [instance: b5fc7f02-2143-4bcf-92ac-078d5ec10747] Building network info cache for instance {{(pid=75045) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 23:29:23 user nova-compute[75045]: DEBUG nova.network.neutron [None req-16a0c522-9087-41f1-adce-eb0645b7099f tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] [instance: b5fc7f02-2143-4bcf-92ac-078d5ec10747] Updating instance_info_cache with network_info: [{"id": "cde7cd95-3b8b-4980-8abc-be5c221a40ff", "address": "fa:16:3e:2d:09:a7", "network": {"id": "08d1669a-f667-4c79-8e49-0ad183f57046", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1863648032-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bbb640407ef94f568aea892f1834d6d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcde7cd95-3b", "ovs_interfaceid": "cde7cd95-3b8b-4980-8abc-be5c221a40ff", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75045) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 23:29:23 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-16a0c522-9087-41f1-adce-eb0645b7099f tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] Releasing lock "refresh_cache-b5fc7f02-2143-4bcf-92ac-078d5ec10747" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 23:29:23 user nova-compute[75045]: DEBUG nova.objects.instance [None req-16a0c522-9087-41f1-adce-eb0645b7099f tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] Lazy-loading 'flavor' on Instance uuid b5fc7f02-2143-4bcf-92ac-078d5ec10747 {{(pid=75045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 23:29:23 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:29:23 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:29:23 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:29:23 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:29:24 user nova-compute[75045]: INFO nova.virt.libvirt.driver [-] [instance: b5fc7f02-2143-4bcf-92ac-078d5ec10747] Instance destroyed successfully.
Nov 08 23:29:25 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:29:25 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:29:25 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:29:26 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-b82e5b7d-d4a7-4f9c-af9a-dc200bfebf56 tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] Acquiring lock "adcffd35-00c7-49db-a72f-d6307a90e123" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:29:26 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-b82e5b7d-d4a7-4f9c-af9a-dc200bfebf56 tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] Lock "adcffd35-00c7-49db-a72f-d6307a90e123" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:29:26 user nova-compute[75045]: DEBUG nova.compute.manager [None req-b82e5b7d-d4a7-4f9c-af9a-dc200bfebf56 tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] [instance: adcffd35-00c7-49db-a72f-d6307a90e123] Starting instance... {{(pid=75045) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 23:29:26 user nova-compute[75045]: DEBUG nova.compute.manager [req-92513641-2c25-47bf-a0e9-68f1d303a0c3 req-222c9da4-01a8-4865-a62e-b28136da0bd2 service nova] [instance: b5fc7f02-2143-4bcf-92ac-078d5ec10747] Received event network-vif-unplugged-cde7cd95-3b8b-4980-8abc-be5c221a40ff {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:29:26 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-92513641-2c25-47bf-a0e9-68f1d303a0c3 req-222c9da4-01a8-4865-a62e-b28136da0bd2 service nova] Acquiring lock "b5fc7f02-2143-4bcf-92ac-078d5ec10747-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:29:26 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-92513641-2c25-47bf-a0e9-68f1d303a0c3 req-222c9da4-01a8-4865-a62e-b28136da0bd2 service nova] Lock "b5fc7f02-2143-4bcf-92ac-078d5ec10747-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:29:26 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-92513641-2c25-47bf-a0e9-68f1d303a0c3 req-222c9da4-01a8-4865-a62e-b28136da0bd2 service nova] Lock "b5fc7f02-2143-4bcf-92ac-078d5ec10747-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:29:26 user nova-compute[75045]: DEBUG nova.compute.manager [req-92513641-2c25-47bf-a0e9-68f1d303a0c3 req-222c9da4-01a8-4865-a62e-b28136da0bd2 service nova] [instance: b5fc7f02-2143-4bcf-92ac-078d5ec10747] No waiting events found dispatching network-vif-unplugged-cde7cd95-3b8b-4980-8abc-be5c221a40ff {{(pid=75045) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 23:29:26 user nova-compute[75045]: WARNING nova.compute.manager [req-92513641-2c25-47bf-a0e9-68f1d303a0c3 req-222c9da4-01a8-4865-a62e-b28136da0bd2 service nova] [instance: b5fc7f02-2143-4bcf-92ac-078d5ec10747] Received unexpected event network-vif-unplugged-cde7cd95-3b8b-4980-8abc-be5c221a40ff for instance with vm_state rescued and task_state unrescuing.
Nov 08 23:29:26 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:29:26 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-b82e5b7d-d4a7-4f9c-af9a-dc200bfebf56 tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:29:26 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-b82e5b7d-d4a7-4f9c-af9a-dc200bfebf56 tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:29:26 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-b82e5b7d-d4a7-4f9c-af9a-dc200bfebf56 tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75045) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 23:29:26 user nova-compute[75045]: INFO nova.compute.claims [None req-b82e5b7d-d4a7-4f9c-af9a-dc200bfebf56 tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] [instance: adcffd35-00c7-49db-a72f-d6307a90e123] Claim successful on node user
Nov 08 23:29:26 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:29:26 user nova-compute[75045]: DEBUG nova.compute.provider_tree [None req-b82e5b7d-d4a7-4f9c-af9a-dc200bfebf56 tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] Inventory has not changed in ProviderTree for provider: 62ba5f85-c74d-4b58-986e-d4197e813fd7 {{(pid=75045) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 23:29:26 user nova-compute[75045]: DEBUG nova.scheduler.client.report [None req-b82e5b7d-d4a7-4f9c-af9a-dc200bfebf56 tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] Inventory has not changed for provider 62ba5f85-c74d-4b58-986e-d4197e813fd7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75045) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 23:29:27 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-b82e5b7d-d4a7-4f9c-af9a-dc200bfebf56 tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.721s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:29:27 user nova-compute[75045]: DEBUG nova.compute.manager [None req-b82e5b7d-d4a7-4f9c-af9a-dc200bfebf56 tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] [instance: adcffd35-00c7-49db-a72f-d6307a90e123] Start building networks asynchronously for instance. {{(pid=75045) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 23:29:27 user nova-compute[75045]: DEBUG nova.compute.manager [None req-b82e5b7d-d4a7-4f9c-af9a-dc200bfebf56 tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] [instance: adcffd35-00c7-49db-a72f-d6307a90e123] Allocating IP information in the background. {{(pid=75045) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 23:29:27 user nova-compute[75045]: DEBUG nova.network.neutron [None req-b82e5b7d-d4a7-4f9c-af9a-dc200bfebf56 tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] [instance: adcffd35-00c7-49db-a72f-d6307a90e123] allocate_for_instance() {{(pid=75045) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 23:29:27 user nova-compute[75045]: INFO nova.virt.libvirt.driver [None req-b82e5b7d-d4a7-4f9c-af9a-dc200bfebf56 tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] [instance: adcffd35-00c7-49db-a72f-d6307a90e123] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 23:29:27 user nova-compute[75045]: DEBUG nova.compute.manager [None req-b82e5b7d-d4a7-4f9c-af9a-dc200bfebf56 tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] [instance: adcffd35-00c7-49db-a72f-d6307a90e123] Start building block device mappings for instance. {{(pid=75045) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 23:29:27 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:29:27 user nova-compute[75045]: DEBUG nova.policy [None req-b82e5b7d-d4a7-4f9c-af9a-dc200bfebf56 tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c0292fa663704c6884ccf77fdcd6c5bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3343bcd412b54ef0bcfed8be47b0353a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75045) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 23:29:27 user nova-compute[75045]: DEBUG nova.compute.manager [None req-b82e5b7d-d4a7-4f9c-af9a-dc200bfebf56 tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] [instance: adcffd35-00c7-49db-a72f-d6307a90e123] Start spawning the instance on the hypervisor. {{(pid=75045) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 23:29:27 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-b82e5b7d-d4a7-4f9c-af9a-dc200bfebf56 tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] [instance: adcffd35-00c7-49db-a72f-d6307a90e123] Creating instance directory {{(pid=75045) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 23:29:27 user nova-compute[75045]: INFO nova.virt.libvirt.driver [None req-b82e5b7d-d4a7-4f9c-af9a-dc200bfebf56 tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] [instance: adcffd35-00c7-49db-a72f-d6307a90e123] Creating image(s)
Nov 08 23:29:27 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-b82e5b7d-d4a7-4f9c-af9a-dc200bfebf56 tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] Acquiring lock "/opt/stack/data/nova/instances/adcffd35-00c7-49db-a72f-d6307a90e123/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:29:27 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-b82e5b7d-d4a7-4f9c-af9a-dc200bfebf56 tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] Lock "/opt/stack/data/nova/instances/adcffd35-00c7-49db-a72f-d6307a90e123/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:29:27 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-b82e5b7d-d4a7-4f9c-af9a-dc200bfebf56 tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] Lock "/opt/stack/data/nova/instances/adcffd35-00c7-49db-a72f-d6307a90e123/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:29:27 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-b82e5b7d-d4a7-4f9c-af9a-dc200bfebf56 tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b59f52a99fff51c56dd1edfb83892fb8f647f2f3 --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:29:27 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:29:27 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-b82e5b7d-d4a7-4f9c-af9a-dc200bfebf56 tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b59f52a99fff51c56dd1edfb83892fb8f647f2f3 --force-share --output=json" returned: 0 in 0.216s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:29:27 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-b82e5b7d-d4a7-4f9c-af9a-dc200bfebf56 tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] Acquiring lock "b59f52a99fff51c56dd1edfb83892fb8f647f2f3" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:29:27 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-b82e5b7d-d4a7-4f9c-af9a-dc200bfebf56 tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] Lock "b59f52a99fff51c56dd1edfb83892fb8f647f2f3" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:29:27 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-b82e5b7d-d4a7-4f9c-af9a-dc200bfebf56 tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b59f52a99fff51c56dd1edfb83892fb8f647f2f3 --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:29:27 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-b82e5b7d-d4a7-4f9c-af9a-dc200bfebf56 tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b59f52a99fff51c56dd1edfb83892fb8f647f2f3 --force-share --output=json" returned: 0 in 0.173s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:29:27 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-b82e5b7d-d4a7-4f9c-af9a-dc200bfebf56 tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b59f52a99fff51c56dd1edfb83892fb8f647f2f3,backing_fmt=raw /opt/stack/data/nova/instances/adcffd35-00c7-49db-a72f-d6307a90e123/disk 1073741824 {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:29:27 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-b82e5b7d-d4a7-4f9c-af9a-dc200bfebf56 tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b59f52a99fff51c56dd1edfb83892fb8f647f2f3,backing_fmt=raw /opt/stack/data/nova/instances/adcffd35-00c7-49db-a72f-d6307a90e123/disk 1073741824" returned: 0 in 0.076s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:29:27 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-b82e5b7d-d4a7-4f9c-af9a-dc200bfebf56 tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] Lock "b59f52a99fff51c56dd1edfb83892fb8f647f2f3" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.256s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:29:27 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-b82e5b7d-d4a7-4f9c-af9a-dc200bfebf56 tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b59f52a99fff51c56dd1edfb83892fb8f647f2f3 --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:29:27 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-b82e5b7d-d4a7-4f9c-af9a-dc200bfebf56 tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b59f52a99fff51c56dd1edfb83892fb8f647f2f3 --force-share --output=json" returned: 0 in 0.209s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:29:27 user nova-compute[75045]: DEBUG nova.virt.disk.api [None req-b82e5b7d-d4a7-4f9c-af9a-dc200bfebf56 tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] Checking if we can resize image /opt/stack/data/nova/instances/adcffd35-00c7-49db-a72f-d6307a90e123/disk. size=1073741824 {{(pid=75045) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 23:29:27 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-b82e5b7d-d4a7-4f9c-af9a-dc200bfebf56 tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/adcffd35-00c7-49db-a72f-d6307a90e123/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:29:28 user nova-compute[75045]: DEBUG nova.network.neutron [None req-b82e5b7d-d4a7-4f9c-af9a-dc200bfebf56 tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] [instance: adcffd35-00c7-49db-a72f-d6307a90e123] Successfully created port: cbed987e-37ab-4cb9-b01a-ecad76d98f21 {{(pid=75045) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 23:29:28 user nova-compute[75045]: DEBUG nova.compute.manager [None req-16a0c522-9087-41f1-adce-eb0645b7099f tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] [instance: b5fc7f02-2143-4bcf-92ac-078d5ec10747] Checking state {{(pid=75045) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 23:29:28 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-b82e5b7d-d4a7-4f9c-af9a-dc200bfebf56 tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/adcffd35-00c7-49db-a72f-d6307a90e123/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:29:28 user nova-compute[75045]: DEBUG nova.virt.disk.api [None req-b82e5b7d-d4a7-4f9c-af9a-dc200bfebf56 tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] Cannot resize image /opt/stack/data/nova/instances/adcffd35-00c7-49db-a72f-d6307a90e123/disk to a smaller size. {{(pid=75045) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 08 23:29:28 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-b82e5b7d-d4a7-4f9c-af9a-dc200bfebf56 tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] [instance: adcffd35-00c7-49db-a72f-d6307a90e123] Created local disks {{(pid=75045) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 23:29:28 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-b82e5b7d-d4a7-4f9c-af9a-dc200bfebf56 tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] [instance: adcffd35-00c7-49db-a72f-d6307a90e123] Ensure instance console log exists: /opt/stack/data/nova/instances/adcffd35-00c7-49db-a72f-d6307a90e123/console.log {{(pid=75045) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 23:29:28 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-b82e5b7d-d4a7-4f9c-af9a-dc200bfebf56 tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:29:28 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-b82e5b7d-d4a7-4f9c-af9a-dc200bfebf56 tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:29:28 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-b82e5b7d-d4a7-4f9c-af9a-dc200bfebf56 tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:29:28 user nova-compute[75045]: DEBUG nova.compute.manager [req-454ee3df-d480-49fc-82b9-ac91c9a36bf8 req-02a40e0b-1920-4842-9399-be8ae9ccddd7 service nova] [instance: b5fc7f02-2143-4bcf-92ac-078d5ec10747] Received event network-vif-plugged-cde7cd95-3b8b-4980-8abc-be5c221a40ff {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:29:28 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-454ee3df-d480-49fc-82b9-ac91c9a36bf8 req-02a40e0b-1920-4842-9399-be8ae9ccddd7 service nova] Acquiring lock "b5fc7f02-2143-4bcf-92ac-078d5ec10747-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:29:28 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-454ee3df-d480-49fc-82b9-ac91c9a36bf8 req-02a40e0b-1920-4842-9399-be8ae9ccddd7 service nova] Lock "b5fc7f02-2143-4bcf-92ac-078d5ec10747-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:29:28 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-454ee3df-d480-49fc-82b9-ac91c9a36bf8 req-02a40e0b-1920-4842-9399-be8ae9ccddd7 service nova] Lock "b5fc7f02-2143-4bcf-92ac-078d5ec10747-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:29:28 user nova-compute[75045]: DEBUG nova.compute.manager [req-454ee3df-d480-49fc-82b9-ac91c9a36bf8 req-02a40e0b-1920-4842-9399-be8ae9ccddd7 service nova] [instance: b5fc7f02-2143-4bcf-92ac-078d5ec10747] No waiting events found dispatching network-vif-plugged-cde7cd95-3b8b-4980-8abc-be5c221a40ff {{(pid=75045) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 23:29:28 user nova-compute[75045]: WARNING nova.compute.manager [req-454ee3df-d480-49fc-82b9-ac91c9a36bf8 req-02a40e0b-1920-4842-9399-be8ae9ccddd7 service nova] [instance: b5fc7f02-2143-4bcf-92ac-078d5ec10747] Received unexpected event network-vif-plugged-cde7cd95-3b8b-4980-8abc-be5c221a40ff for instance with vm_state active and task_state None.
Nov 08 23:29:28 user nova-compute[75045]: DEBUG nova.compute.manager [req-454ee3df-d480-49fc-82b9-ac91c9a36bf8 req-02a40e0b-1920-4842-9399-be8ae9ccddd7 service nova] [instance: b5fc7f02-2143-4bcf-92ac-078d5ec10747] Received event network-vif-plugged-cde7cd95-3b8b-4980-8abc-be5c221a40ff {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:29:28 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-454ee3df-d480-49fc-82b9-ac91c9a36bf8 req-02a40e0b-1920-4842-9399-be8ae9ccddd7 service nova] Acquiring lock "b5fc7f02-2143-4bcf-92ac-078d5ec10747-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:29:28 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-454ee3df-d480-49fc-82b9-ac91c9a36bf8 req-02a40e0b-1920-4842-9399-be8ae9ccddd7 service nova] Lock "b5fc7f02-2143-4bcf-92ac-078d5ec10747-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:29:28 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-454ee3df-d480-49fc-82b9-ac91c9a36bf8 req-02a40e0b-1920-4842-9399-be8ae9ccddd7 service nova] Lock "b5fc7f02-2143-4bcf-92ac-078d5ec10747-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:29:28 user nova-compute[75045]: DEBUG nova.compute.manager [req-454ee3df-d480-49fc-82b9-ac91c9a36bf8 req-02a40e0b-1920-4842-9399-be8ae9ccddd7 service nova] [instance: b5fc7f02-2143-4bcf-92ac-078d5ec10747] No waiting events found dispatching network-vif-plugged-cde7cd95-3b8b-4980-8abc-be5c221a40ff {{(pid=75045) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 23:29:28 user nova-compute[75045]: WARNING nova.compute.manager [req-454ee3df-d480-49fc-82b9-ac91c9a36bf8 req-02a40e0b-1920-4842-9399-be8ae9ccddd7 service nova] [instance: b5fc7f02-2143-4bcf-92ac-078d5ec10747] Received unexpected event network-vif-plugged-cde7cd95-3b8b-4980-8abc-be5c221a40ff for instance with vm_state active and task_state None.
Nov 08 23:29:28 user nova-compute[75045]: DEBUG nova.compute.manager [req-454ee3df-d480-49fc-82b9-ac91c9a36bf8 req-02a40e0b-1920-4842-9399-be8ae9ccddd7 service nova] [instance: b5fc7f02-2143-4bcf-92ac-078d5ec10747] Received event network-vif-plugged-cde7cd95-3b8b-4980-8abc-be5c221a40ff {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:29:28 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-454ee3df-d480-49fc-82b9-ac91c9a36bf8 req-02a40e0b-1920-4842-9399-be8ae9ccddd7 service nova] Acquiring lock "b5fc7f02-2143-4bcf-92ac-078d5ec10747-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:29:28 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-454ee3df-d480-49fc-82b9-ac91c9a36bf8 req-02a40e0b-1920-4842-9399-be8ae9ccddd7 service nova] Lock "b5fc7f02-2143-4bcf-92ac-078d5ec10747-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:29:28 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-454ee3df-d480-49fc-82b9-ac91c9a36bf8 req-02a40e0b-1920-4842-9399-be8ae9ccddd7 service nova] Lock "b5fc7f02-2143-4bcf-92ac-078d5ec10747-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:29:28 user nova-compute[75045]: DEBUG nova.compute.manager [req-454ee3df-d480-49fc-82b9-ac91c9a36bf8 req-02a40e0b-1920-4842-9399-be8ae9ccddd7 service nova] [instance: b5fc7f02-2143-4bcf-92ac-078d5ec10747] No waiting events found dispatching network-vif-plugged-cde7cd95-3b8b-4980-8abc-be5c221a40ff {{(pid=75045) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 23:29:28 user nova-compute[75045]: WARNING nova.compute.manager [req-454ee3df-d480-49fc-82b9-ac91c9a36bf8 req-02a40e0b-1920-4842-9399-be8ae9ccddd7 service nova] [instance: b5fc7f02-2143-4bcf-92ac-078d5ec10747] Received unexpected event network-vif-plugged-cde7cd95-3b8b-4980-8abc-be5c221a40ff for instance with vm_state active and task_state None.
Nov 08 23:29:28 user nova-compute[75045]: DEBUG nova.network.neutron [None req-b82e5b7d-d4a7-4f9c-af9a-dc200bfebf56 tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] [instance: adcffd35-00c7-49db-a72f-d6307a90e123] Successfully updated port: cbed987e-37ab-4cb9-b01a-ecad76d98f21 {{(pid=75045) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 23:29:28 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-b82e5b7d-d4a7-4f9c-af9a-dc200bfebf56 tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] Acquiring lock "refresh_cache-adcffd35-00c7-49db-a72f-d6307a90e123" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 23:29:28 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-b82e5b7d-d4a7-4f9c-af9a-dc200bfebf56 tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] Acquired lock "refresh_cache-adcffd35-00c7-49db-a72f-d6307a90e123" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 23:29:28 user nova-compute[75045]: DEBUG nova.network.neutron [None req-b82e5b7d-d4a7-4f9c-af9a-dc200bfebf56 tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] [instance: adcffd35-00c7-49db-a72f-d6307a90e123] Building network info cache for instance {{(pid=75045) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 23:29:28 user nova-compute[75045]: DEBUG nova.compute.manager [req-d16a9a56-88c2-4417-8bc4-5c679150ffb7 req-5da055fd-1b2d-4ea4-a951-a77de90907e0 service nova] [instance: adcffd35-00c7-49db-a72f-d6307a90e123] Received event network-changed-cbed987e-37ab-4cb9-b01a-ecad76d98f21 {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:29:28 user nova-compute[75045]: DEBUG nova.compute.manager [req-d16a9a56-88c2-4417-8bc4-5c679150ffb7 req-5da055fd-1b2d-4ea4-a951-a77de90907e0 service nova] [instance: adcffd35-00c7-49db-a72f-d6307a90e123] Refreshing instance network info cache due to event network-changed-cbed987e-37ab-4cb9-b01a-ecad76d98f21. {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 23:29:28 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-d16a9a56-88c2-4417-8bc4-5c679150ffb7 req-5da055fd-1b2d-4ea4-a951-a77de90907e0 service nova] Acquiring lock "refresh_cache-adcffd35-00c7-49db-a72f-d6307a90e123" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 23:29:28 user nova-compute[75045]: DEBUG nova.network.neutron [None req-b82e5b7d-d4a7-4f9c-af9a-dc200bfebf56 tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] [instance: adcffd35-00c7-49db-a72f-d6307a90e123] Instance cache missing network info. {{(pid=75045) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 23:29:29 user nova-compute[75045]: DEBUG nova.network.neutron [None req-b82e5b7d-d4a7-4f9c-af9a-dc200bfebf56 tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] [instance: adcffd35-00c7-49db-a72f-d6307a90e123] Updating instance_info_cache with network_info: [{"id": "cbed987e-37ab-4cb9-b01a-ecad76d98f21", "address": "fa:16:3e:60:a2:7b", "network": {"id": "fe74884d-c24e-4be8-b45a-eb825b3563a3", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1344943603-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3343bcd412b54ef0bcfed8be47b0353a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbed987e-37", "ovs_interfaceid": "cbed987e-37ab-4cb9-b01a-ecad76d98f21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75045) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 23:29:29 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-b82e5b7d-d4a7-4f9c-af9a-dc200bfebf56 tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] Releasing lock "refresh_cache-adcffd35-00c7-49db-a72f-d6307a90e123" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 23:29:29 user nova-compute[75045]: DEBUG nova.compute.manager [None req-b82e5b7d-d4a7-4f9c-af9a-dc200bfebf56 tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] [instance: adcffd35-00c7-49db-a72f-d6307a90e123] Instance network_info: |[{"id": "cbed987e-37ab-4cb9-b01a-ecad76d98f21", "address": "fa:16:3e:60:a2:7b", "network": {"id": "fe74884d-c24e-4be8-b45a-eb825b3563a3", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1344943603-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3343bcd412b54ef0bcfed8be47b0353a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbed987e-37", "ovs_interfaceid": "cbed987e-37ab-4cb9-b01a-ecad76d98f21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75045) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 23:29:29 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-d16a9a56-88c2-4417-8bc4-5c679150ffb7 req-5da055fd-1b2d-4ea4-a951-a77de90907e0 service nova] Acquired lock "refresh_cache-adcffd35-00c7-49db-a72f-d6307a90e123" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 23:29:29 user nova-compute[75045]: DEBUG nova.network.neutron [req-d16a9a56-88c2-4417-8bc4-5c679150ffb7 req-5da055fd-1b2d-4ea4-a951-a77de90907e0 service nova] [instance: adcffd35-00c7-49db-a72f-d6307a90e123] Refreshing network info cache for port cbed987e-37ab-4cb9-b01a-ecad76d98f21 {{(pid=75045) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 23:29:29 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-b82e5b7d-d4a7-4f9c-af9a-dc200bfebf56 tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] [instance: adcffd35-00c7-49db-a72f-d6307a90e123] Start _get_guest_xml network_info=[{"id": "cbed987e-37ab-4cb9-b01a-ecad76d98f21", "address": "fa:16:3e:60:a2:7b", "network": {"id": "fe74884d-c24e-4be8-b45a-eb825b3563a3", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1344943603-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3343bcd412b54ef0bcfed8be47b0353a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbed987e-37", "ovs_interfaceid": "cbed987e-37ab-4cb9-b01a-ecad76d98f21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T23:11:54Z,direct_url=<?>,disk_format='qcow2',id=a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b1beba2cc4e7465ea249e2225fb494dc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T23:11:56Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'disk_bus': 'virtio', 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': 'a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75045) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 23:29:29 user nova-compute[75045]: WARNING nova.virt.libvirt.driver [None req-b82e5b7d-d4a7-4f9c-af9a-dc200bfebf56 tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 23:29:29 user nova-compute[75045]: WARNING nova.virt.libvirt.driver [None req-b82e5b7d-d4a7-4f9c-af9a-dc200bfebf56 tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 23:29:29 user nova-compute[75045]: DEBUG nova.virt.libvirt.host [None req-b82e5b7d-d4a7-4f9c-af9a-dc200bfebf56 tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75045) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 23:29:29 user nova-compute[75045]: DEBUG nova.virt.libvirt.host [None req-b82e5b7d-d4a7-4f9c-af9a-dc200bfebf56 tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] CPU controller missing on host. {{(pid=75045) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 23:29:29 user nova-compute[75045]: DEBUG nova.virt.libvirt.host [None req-b82e5b7d-d4a7-4f9c-af9a-dc200bfebf56 tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75045) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 23:29:29 user nova-compute[75045]: DEBUG nova.virt.libvirt.host [None req-b82e5b7d-d4a7-4f9c-af9a-dc200bfebf56 tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] CPU controller found on host. {{(pid=75045) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 23:29:29 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-b82e5b7d-d4a7-4f9c-af9a-dc200bfebf56 tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75045) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 23:29:29 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-b82e5b7d-d4a7-4f9c-af9a-dc200bfebf56 tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T23:11:41Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T23:11:54Z,direct_url=<?>,disk_format='qcow2',id=a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b1beba2cc4e7465ea249e2225fb494dc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T23:11:56Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75045) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 23:29:29 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-b82e5b7d-d4a7-4f9c-af9a-dc200bfebf56 tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] Flavor limits 0:0:0 {{(pid=75045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 23:29:29 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-b82e5b7d-d4a7-4f9c-af9a-dc200bfebf56 tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] Image limits 0:0:0 {{(pid=75045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 23:29:29 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-b82e5b7d-d4a7-4f9c-af9a-dc200bfebf56 tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] Flavor pref 0:0:0 {{(pid=75045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 23:29:29 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-b82e5b7d-d4a7-4f9c-af9a-dc200bfebf56 tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] Image pref 0:0:0 {{(pid=75045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 23:29:29 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-b82e5b7d-d4a7-4f9c-af9a-dc200bfebf56 tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 23:29:29 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-b82e5b7d-d4a7-4f9c-af9a-dc200bfebf56 tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75045) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 23:29:29 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-b82e5b7d-d4a7-4f9c-af9a-dc200bfebf56 tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75045) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 23:29:29 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-b82e5b7d-d4a7-4f9c-af9a-dc200bfebf56 tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] Got 1 possible topologies {{(pid=75045) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 23:29:29 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-b82e5b7d-d4a7-4f9c-af9a-dc200bfebf56 tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75045) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 23:29:29 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-b82e5b7d-d4a7-4f9c-af9a-dc200bfebf56 tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75045) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 23:29:29 user nova-compute[75045]: DEBUG nova.virt.libvirt.vif [None req-b82e5b7d-d4a7-4f9c-af9a-dc200bfebf56 tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T23:29:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-679600955',display_name='tempest-SnapshotDataIntegrityTests-server-679600955',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-679600955',id=31,image_ref='a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIQiQ5McVMUsuajSlNFyiLCOJOofQ184ZeKfgDdK3pBrjfJHke9lU+vRmmftUX5aq91DdnXslLdaxaMVCn7b2hQ0ESMX2nngBrh1EzEtdrUvWhQHat46Qybgh1ClDmffOw==',key_name='tempest-keypair-393985914',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3343bcd412b54ef0bcfed8be47b0353a',ramdisk_id='',reservation_id='r-g2ye9oyo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1590008619',owner_user_name='tempest-SnapshotDataIntegrityTests-1590008619-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T23:29:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c0292fa663704c6884ccf77fdcd6c5bc',uuid=adcffd35-00c7-49db-a72f-d6307a90e123,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cbed987e-37ab-4cb9-b01a-ecad76d98f21", "address": "fa:16:3e:60:a2:7b", "network": {"id": "fe74884d-c24e-4be8-b45a-eb825b3563a3", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1344943603-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3343bcd412b54ef0bcfed8be47b0353a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbed987e-37", "ovs_interfaceid": "cbed987e-37ab-4cb9-b01a-ecad76d98f21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75045) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 23:29:29 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-b82e5b7d-d4a7-4f9c-af9a-dc200bfebf56 tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] Converting VIF {"id": "cbed987e-37ab-4cb9-b01a-ecad76d98f21", "address": "fa:16:3e:60:a2:7b", "network": {"id": "fe74884d-c24e-4be8-b45a-eb825b3563a3", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1344943603-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3343bcd412b54ef0bcfed8be47b0353a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbed987e-37", "ovs_interfaceid": "cbed987e-37ab-4cb9-b01a-ecad76d98f21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 23:29:29 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-b82e5b7d-d4a7-4f9c-af9a-dc200bfebf56 tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:60:a2:7b,bridge_name='br-int',has_traffic_filtering=True,id=cbed987e-37ab-4cb9-b01a-ecad76d98f21,network=Network(fe74884d-c24e-4be8-b45a-eb825b3563a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcbed987e-37') {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 23:29:29 user nova-compute[75045]: DEBUG nova.objects.instance [None req-b82e5b7d-d4a7-4f9c-af9a-dc200bfebf56 tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] Lazy-loading 'pci_devices' on Instance uuid adcffd35-00c7-49db-a72f-d6307a90e123 {{(pid=75045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 23:29:29 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-b82e5b7d-d4a7-4f9c-af9a-dc200bfebf56 tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] [instance: adcffd35-00c7-49db-a72f-d6307a90e123] End _get_guest_xml xml=<domain type="kvm">
Nov 08 23:29:29 user nova-compute[75045]:   <uuid>adcffd35-00c7-49db-a72f-d6307a90e123</uuid>
Nov 08 23:29:29 user nova-compute[75045]:   <name>instance-0000001f</name>
Nov 08 23:29:29 user nova-compute[75045]:   <memory>524288</memory>
Nov 08 23:29:29 user nova-compute[75045]:   <vcpu>1</vcpu>
Nov 08 23:29:29 user nova-compute[75045]:   <metadata>
Nov 08 23:29:29 user nova-compute[75045]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 23:29:29 user nova-compute[75045]:       <nova:package version="0.0.0"/>
Nov 08 23:29:29 user nova-compute[75045]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-679600955</nova:name>
Nov 08 23:29:29 user nova-compute[75045]:       <nova:creationTime>2023-11-08 23:29:29</nova:creationTime>
Nov 08 23:29:29 user nova-compute[75045]:       <nova:flavor name="m1.tiny">
Nov 08 23:29:29 user nova-compute[75045]:         <nova:memory>512</nova:memory>
Nov 08 23:29:29 user nova-compute[75045]:         <nova:disk>1</nova:disk>
Nov 08 23:29:29 user nova-compute[75045]:         <nova:swap>0</nova:swap>
Nov 08 23:29:29 user nova-compute[75045]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 23:29:29 user nova-compute[75045]:         <nova:vcpus>1</nova:vcpus>
Nov 08 23:29:29 user nova-compute[75045]:       </nova:flavor>
Nov 08 23:29:29 user nova-compute[75045]:       <nova:owner>
Nov 08 23:29:29 user nova-compute[75045]:         <nova:user uuid="c0292fa663704c6884ccf77fdcd6c5bc">tempest-SnapshotDataIntegrityTests-1590008619-project-member</nova:user>
Nov 08 23:29:29 user nova-compute[75045]:         <nova:project uuid="3343bcd412b54ef0bcfed8be47b0353a">tempest-SnapshotDataIntegrityTests-1590008619</nova:project>
Nov 08 23:29:29 user nova-compute[75045]:       </nova:owner>
Nov 08 23:29:29 user nova-compute[75045]:       <nova:root type="image" uuid="a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb"/>
Nov 08 23:29:29 user nova-compute[75045]:       <nova:ports>
Nov 08 23:29:29 user nova-compute[75045]:         <nova:port uuid="cbed987e-37ab-4cb9-b01a-ecad76d98f21">
Nov 08 23:29:29 user nova-compute[75045]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 08 23:29:29 user nova-compute[75045]:         </nova:port>
Nov 08 23:29:29 user nova-compute[75045]:       </nova:ports>
Nov 08 23:29:29 user nova-compute[75045]:     </nova:instance>
Nov 08 23:29:29 user nova-compute[75045]:   </metadata>
Nov 08 23:29:29 user nova-compute[75045]:   <sysinfo type="smbios">
Nov 08 23:29:29 user nova-compute[75045]:     <system>
Nov 08 23:29:29 user nova-compute[75045]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 23:29:29 user nova-compute[75045]:       <entry name="product">OpenStack Nova</entry>
Nov 08 23:29:29 user nova-compute[75045]:       <entry name="version">0.0.0</entry>
Nov 08 23:29:29 user nova-compute[75045]:       <entry name="serial">adcffd35-00c7-49db-a72f-d6307a90e123</entry>
Nov 08 23:29:29 user nova-compute[75045]:       <entry name="uuid">adcffd35-00c7-49db-a72f-d6307a90e123</entry>
Nov 08 23:29:29 user nova-compute[75045]:       <entry name="family">Virtual Machine</entry>
Nov 08 23:29:29 user nova-compute[75045]:     </system>
Nov 08 23:29:29 user nova-compute[75045]:   </sysinfo>
Nov 08 23:29:29 user nova-compute[75045]:   <os>
Nov 08 23:29:29 user nova-compute[75045]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 23:29:29 user nova-compute[75045]:     <boot dev="hd"/>
Nov 08 23:29:29 user nova-compute[75045]:     <smbios mode="sysinfo"/>
Nov 08 23:29:29 user nova-compute[75045]:   </os>
Nov 08 23:29:29 user nova-compute[75045]:   <features>
Nov 08 23:29:29 user nova-compute[75045]:     <acpi/>
Nov 08 23:29:29 user nova-compute[75045]:     <apic/>
Nov 08 23:29:29 user nova-compute[75045]:     <vmcoreinfo/>
Nov 08 23:29:29 user nova-compute[75045]:   </features>
Nov 08 23:29:29 user nova-compute[75045]:   <clock offset="utc">
Nov 08 23:29:29 user nova-compute[75045]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 23:29:29 user nova-compute[75045]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 23:29:29 user nova-compute[75045]:     <timer name="hpet" present="no"/>
Nov 08 23:29:29 user nova-compute[75045]:   </clock>
Nov 08 23:29:29 user nova-compute[75045]:   <cpu mode="custom" match="exact">
Nov 08 23:29:29 user nova-compute[75045]:     <model>Nehalem</model>
Nov 08 23:29:29 user nova-compute[75045]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 23:29:29 user nova-compute[75045]:   </cpu>
Nov 08 23:29:29 user nova-compute[75045]:   <devices>
Nov 08 23:29:29 user nova-compute[75045]:     <disk type="file" device="disk">
Nov 08 23:29:29 user nova-compute[75045]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 23:29:29 user nova-compute[75045]:       <source file="/opt/stack/data/nova/instances/adcffd35-00c7-49db-a72f-d6307a90e123/disk"/>
Nov 08 23:29:29 user nova-compute[75045]:       <target dev="vda" bus="virtio"/>
Nov 08 23:29:29 user nova-compute[75045]:     </disk>
Nov 08 23:29:29 user nova-compute[75045]:     <interface type="ethernet">
Nov 08 23:29:29 user nova-compute[75045]:       <mac address="fa:16:3e:60:a2:7b"/>
Nov 08 23:29:29 user nova-compute[75045]:       <model type="virtio"/>
Nov 08 23:29:29 user nova-compute[75045]:       <mtu size="1442"/>
Nov 08 23:29:29 user nova-compute[75045]:       <target dev="tapcbed987e-37"/>
Nov 08 23:29:29 user nova-compute[75045]:     </interface>
Nov 08 23:29:29 user nova-compute[75045]:     <serial type="pty">
Nov 08 23:29:29 user nova-compute[75045]:       <log file="/opt/stack/data/nova/instances/adcffd35-00c7-49db-a72f-d6307a90e123/console.log" append="off"/>
Nov 08 23:29:29 user nova-compute[75045]:     </serial>
Nov 08 23:29:29 user nova-compute[75045]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 23:29:29 user nova-compute[75045]:     <video>
Nov 08 23:29:29 user nova-compute[75045]:       <model type="virtio"/>
Nov 08 23:29:29 user nova-compute[75045]:     </video>
Nov 08 23:29:29 user nova-compute[75045]:     <rng model="virtio">
Nov 08 23:29:29 user nova-compute[75045]:       <backend model="random">/dev/urandom</backend>
Nov 08 23:29:29 user nova-compute[75045]:     </rng>
Nov 08 23:29:29 user nova-compute[75045]:     <controller type="usb" index="0" model="none"/>
Nov 08 23:29:29 user nova-compute[75045]:     <memballoon model="virtio">
Nov 08 23:29:29 user nova-compute[75045]:       <stats period="10"/>
Nov 08 23:29:29 user nova-compute[75045]:     </memballoon>
Nov 08 23:29:29 user nova-compute[75045]:   </devices>
Nov 08 23:29:29 user nova-compute[75045]: </domain>
Nov 08 23:29:29 user nova-compute[75045]:  {{(pid=75045) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 23:29:29 user nova-compute[75045]: DEBUG nova.virt.libvirt.vif [None req-b82e5b7d-d4a7-4f9c-af9a-dc200bfebf56 tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T23:29:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-679600955',display_name='tempest-SnapshotDataIntegrityTests-server-679600955',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-679600955',id=31,image_ref='a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIQiQ5McVMUsuajSlNFyiLCOJOofQ184ZeKfgDdK3pBrjfJHke9lU+vRmmftUX5aq91DdnXslLdaxaMVCn7b2hQ0ESMX2nngBrh1EzEtdrUvWhQHat46Qybgh1ClDmffOw==',key_name='tempest-keypair-393985914',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3343bcd412b54ef0bcfed8be47b0353a',ramdisk_id='',reservation_id='r-g2ye9oyo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1590008619',owner_user_name='tempest-SnapshotDataIntegrityTests-1590008619-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T23:29:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c0292fa663704c6884ccf77fdcd6c5bc',uuid=adcffd35-00c7-49db-a72f-d6307a90e123,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cbed987e-37ab-4cb9-b01a-ecad76d98f21", "address": "fa:16:3e:60:a2:7b", "network": {"id": "fe74884d-c24e-4be8-b45a-eb825b3563a3", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1344943603-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3343bcd412b54ef0bcfed8be47b0353a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbed987e-37", "ovs_interfaceid": "cbed987e-37ab-4cb9-b01a-ecad76d98f21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75045) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 23:29:29 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-b82e5b7d-d4a7-4f9c-af9a-dc200bfebf56 tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] Converting VIF {"id": "cbed987e-37ab-4cb9-b01a-ecad76d98f21", "address": "fa:16:3e:60:a2:7b", "network": {"id": "fe74884d-c24e-4be8-b45a-eb825b3563a3", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1344943603-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3343bcd412b54ef0bcfed8be47b0353a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbed987e-37", "ovs_interfaceid": "cbed987e-37ab-4cb9-b01a-ecad76d98f21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 23:29:29 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-b82e5b7d-d4a7-4f9c-af9a-dc200bfebf56 tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:60:a2:7b,bridge_name='br-int',has_traffic_filtering=True,id=cbed987e-37ab-4cb9-b01a-ecad76d98f21,network=Network(fe74884d-c24e-4be8-b45a-eb825b3563a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcbed987e-37') {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 23:29:29 user nova-compute[75045]: DEBUG os_vif [None req-b82e5b7d-d4a7-4f9c-af9a-dc200bfebf56 tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:60:a2:7b,bridge_name='br-int',has_traffic_filtering=True,id=cbed987e-37ab-4cb9-b01a-ecad76d98f21,network=Network(fe74884d-c24e-4be8-b45a-eb825b3563a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcbed987e-37') {{(pid=75045) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 23:29:29 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:29:29 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:29:29 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 23:29:29 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:29:29 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0a1ed4d0-6dcb-5a3f-abbc-26362f5008f4', '_type': 'linux-noop'}}, row=False) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:29:29 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:29:29 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:29:29 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:29:29 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapcbed987e-37, may_exist=True, interface_attrs={}) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:29:29 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapcbed987e-37, col_values=(('qos', UUID('c34ecd12-b881-4042-999f-819bf766cb6f')),), if_exists=True) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:29:29 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapcbed987e-37, col_values=(('external_ids', {'iface-id': 'cbed987e-37ab-4cb9-b01a-ecad76d98f21', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:60:a2:7b', 'vm-uuid': 'adcffd35-00c7-49db-a72f-d6307a90e123'}),), if_exists=True) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:29:29 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:29:29 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 23:29:29 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:29:29 user nova-compute[75045]: INFO os_vif [None req-b82e5b7d-d4a7-4f9c-af9a-dc200bfebf56 tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:60:a2:7b,bridge_name='br-int',has_traffic_filtering=True,id=cbed987e-37ab-4cb9-b01a-ecad76d98f21,network=Network(fe74884d-c24e-4be8-b45a-eb825b3563a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcbed987e-37')
Nov 08 23:29:29 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-b82e5b7d-d4a7-4f9c-af9a-dc200bfebf56 tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] No BDM found with device name vda, not building metadata. {{(pid=75045) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 23:29:29 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-b82e5b7d-d4a7-4f9c-af9a-dc200bfebf56 tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] No VIF found with MAC fa:16:3e:60:a2:7b, not building metadata {{(pid=75045) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 23:29:29 user nova-compute[75045]: DEBUG nova.network.neutron [req-d16a9a56-88c2-4417-8bc4-5c679150ffb7 req-5da055fd-1b2d-4ea4-a951-a77de90907e0 service nova] [instance: adcffd35-00c7-49db-a72f-d6307a90e123] Updated VIF entry in instance network info cache for port cbed987e-37ab-4cb9-b01a-ecad76d98f21. {{(pid=75045) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 23:29:29 user nova-compute[75045]: DEBUG nova.network.neutron [req-d16a9a56-88c2-4417-8bc4-5c679150ffb7 req-5da055fd-1b2d-4ea4-a951-a77de90907e0 service nova] [instance: adcffd35-00c7-49db-a72f-d6307a90e123] Updating instance_info_cache with network_info: [{"id": "cbed987e-37ab-4cb9-b01a-ecad76d98f21", "address": "fa:16:3e:60:a2:7b", "network": {"id": "fe74884d-c24e-4be8-b45a-eb825b3563a3", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1344943603-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3343bcd412b54ef0bcfed8be47b0353a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbed987e-37", "ovs_interfaceid": "cbed987e-37ab-4cb9-b01a-ecad76d98f21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75045) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 23:29:29 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-d16a9a56-88c2-4417-8bc4-5c679150ffb7 req-5da055fd-1b2d-4ea4-a951-a77de90907e0 service nova] Releasing lock "refresh_cache-adcffd35-00c7-49db-a72f-d6307a90e123" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 23:29:30 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:29:30 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:29:30 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:29:31 user nova-compute[75045]: DEBUG nova.compute.manager [req-1382e469-3c20-4c22-b729-a7781b0d94f7 req-9e6a8861-2673-481a-9283-bb0aacb3fd58 service nova] [instance: adcffd35-00c7-49db-a72f-d6307a90e123] Received event network-vif-plugged-cbed987e-37ab-4cb9-b01a-ecad76d98f21 {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:29:31 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-1382e469-3c20-4c22-b729-a7781b0d94f7 req-9e6a8861-2673-481a-9283-bb0aacb3fd58 service nova] Acquiring lock "adcffd35-00c7-49db-a72f-d6307a90e123-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:29:31 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-1382e469-3c20-4c22-b729-a7781b0d94f7 req-9e6a8861-2673-481a-9283-bb0aacb3fd58 service nova] Lock "adcffd35-00c7-49db-a72f-d6307a90e123-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:29:31 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-1382e469-3c20-4c22-b729-a7781b0d94f7 req-9e6a8861-2673-481a-9283-bb0aacb3fd58 service nova] Lock "adcffd35-00c7-49db-a72f-d6307a90e123-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:29:31 user nova-compute[75045]: DEBUG nova.compute.manager [req-1382e469-3c20-4c22-b729-a7781b0d94f7 req-9e6a8861-2673-481a-9283-bb0aacb3fd58 service nova] [instance: adcffd35-00c7-49db-a72f-d6307a90e123] No waiting events found dispatching network-vif-plugged-cbed987e-37ab-4cb9-b01a-ecad76d98f21 {{(pid=75045) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 23:29:31 user nova-compute[75045]: WARNING nova.compute.manager [req-1382e469-3c20-4c22-b729-a7781b0d94f7 req-9e6a8861-2673-481a-9283-bb0aacb3fd58 service nova] [instance: adcffd35-00c7-49db-a72f-d6307a90e123] Received unexpected event network-vif-plugged-cbed987e-37ab-4cb9-b01a-ecad76d98f21 for instance with vm_state building and task_state spawning.
Nov 08 23:29:31 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:29:31 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:29:31 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:29:31 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:29:31 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:29:33 user nova-compute[75045]: DEBUG nova.compute.manager [req-42d93c4b-d5ac-408a-b265-a7410e51d51b req-1f5c28f3-5e4f-4e3e-9d38-9b4526edeefb service nova] [instance: adcffd35-00c7-49db-a72f-d6307a90e123] Received event network-vif-plugged-cbed987e-37ab-4cb9-b01a-ecad76d98f21 {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:29:33 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-42d93c4b-d5ac-408a-b265-a7410e51d51b req-1f5c28f3-5e4f-4e3e-9d38-9b4526edeefb service nova] Acquiring lock "adcffd35-00c7-49db-a72f-d6307a90e123-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:29:33 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-42d93c4b-d5ac-408a-b265-a7410e51d51b req-1f5c28f3-5e4f-4e3e-9d38-9b4526edeefb service nova] Lock "adcffd35-00c7-49db-a72f-d6307a90e123-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:29:33 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-42d93c4b-d5ac-408a-b265-a7410e51d51b req-1f5c28f3-5e4f-4e3e-9d38-9b4526edeefb service nova] Lock "adcffd35-00c7-49db-a72f-d6307a90e123-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:29:33 user nova-compute[75045]: DEBUG nova.compute.manager [req-42d93c4b-d5ac-408a-b265-a7410e51d51b req-1f5c28f3-5e4f-4e3e-9d38-9b4526edeefb service nova] [instance: adcffd35-00c7-49db-a72f-d6307a90e123] No waiting events found dispatching network-vif-plugged-cbed987e-37ab-4cb9-b01a-ecad76d98f21 {{(pid=75045) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 23:29:33 user nova-compute[75045]: WARNING nova.compute.manager [req-42d93c4b-d5ac-408a-b265-a7410e51d51b req-1f5c28f3-5e4f-4e3e-9d38-9b4526edeefb service nova] [instance: adcffd35-00c7-49db-a72f-d6307a90e123] Received unexpected event network-vif-plugged-cbed987e-37ab-4cb9-b01a-ecad76d98f21 for instance with vm_state building and task_state spawning.
Nov 08 23:29:33 user nova-compute[75045]: DEBUG nova.compute.manager [None req-b82e5b7d-d4a7-4f9c-af9a-dc200bfebf56 tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] [instance: adcffd35-00c7-49db-a72f-d6307a90e123] Instance event wait completed in 0 seconds for  {{(pid=75045) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 23:29:33 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-b82e5b7d-d4a7-4f9c-af9a-dc200bfebf56 tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] [instance: adcffd35-00c7-49db-a72f-d6307a90e123] Guest created on hypervisor {{(pid=75045) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 23:29:33 user nova-compute[75045]: INFO nova.virt.libvirt.driver [-] [instance: adcffd35-00c7-49db-a72f-d6307a90e123] Instance spawned successfully.
Nov 08 23:29:33 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-b82e5b7d-d4a7-4f9c-af9a-dc200bfebf56 tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] [instance: adcffd35-00c7-49db-a72f-d6307a90e123] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75045) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 23:29:33 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-b82e5b7d-d4a7-4f9c-af9a-dc200bfebf56 tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] [instance: adcffd35-00c7-49db-a72f-d6307a90e123] Found default for hw_cdrom_bus of ide {{(pid=75045) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 23:29:33 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-b82e5b7d-d4a7-4f9c-af9a-dc200bfebf56 tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] [instance: adcffd35-00c7-49db-a72f-d6307a90e123] Found default for hw_disk_bus of virtio {{(pid=75045) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 23:29:33 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-b82e5b7d-d4a7-4f9c-af9a-dc200bfebf56 tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] [instance: adcffd35-00c7-49db-a72f-d6307a90e123] Found default for hw_input_bus of None {{(pid=75045) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 23:29:33 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-b82e5b7d-d4a7-4f9c-af9a-dc200bfebf56 tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] [instance: adcffd35-00c7-49db-a72f-d6307a90e123] Found default for hw_pointer_model of None {{(pid=75045) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 23:29:33 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-b82e5b7d-d4a7-4f9c-af9a-dc200bfebf56 tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] [instance: adcffd35-00c7-49db-a72f-d6307a90e123] Found default for hw_video_model of virtio {{(pid=75045) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 23:29:33 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-b82e5b7d-d4a7-4f9c-af9a-dc200bfebf56 tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] [instance: adcffd35-00c7-49db-a72f-d6307a90e123] Found default for hw_vif_model of virtio {{(pid=75045) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 23:29:33 user nova-compute[75045]: INFO nova.compute.manager [None req-b82e5b7d-d4a7-4f9c-af9a-dc200bfebf56 tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] [instance: adcffd35-00c7-49db-a72f-d6307a90e123] Took 6.22 seconds to spawn the instance on the hypervisor.
Nov 08 23:29:33 user nova-compute[75045]: DEBUG nova.compute.manager [None req-b82e5b7d-d4a7-4f9c-af9a-dc200bfebf56 tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] [instance: adcffd35-00c7-49db-a72f-d6307a90e123] Checking state {{(pid=75045) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 23:29:33 user nova-compute[75045]: INFO nova.compute.manager [None req-b82e5b7d-d4a7-4f9c-af9a-dc200bfebf56 tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] [instance: adcffd35-00c7-49db-a72f-d6307a90e123] Took 7.32 seconds to build instance.
Nov 08 23:29:33 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-b82e5b7d-d4a7-4f9c-af9a-dc200bfebf56 tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] Lock "adcffd35-00c7-49db-a72f-d6307a90e123" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.448s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:29:34 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:29:36 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:29:38 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:29:39 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:29:39 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:29:40 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:29:40 user nova-compute[75045]: DEBUG nova.compute.manager [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75045) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 23:29:41 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:29:42 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:29:42 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:29:43 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:29:43 user nova-compute[75045]: DEBUG nova.compute.manager [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Starting heal instance info cache {{(pid=75045) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 23:29:44 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Acquiring lock "refresh_cache-b5fc7f02-2143-4bcf-92ac-078d5ec10747" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 23:29:44 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Acquired lock "refresh_cache-b5fc7f02-2143-4bcf-92ac-078d5ec10747" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 23:29:44 user nova-compute[75045]: DEBUG nova.network.neutron [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] [instance: b5fc7f02-2143-4bcf-92ac-078d5ec10747] Forcefully refreshing network info cache for instance {{(pid=75045) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 23:29:44 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:29:44 user nova-compute[75045]: DEBUG nova.network.neutron [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] [instance: b5fc7f02-2143-4bcf-92ac-078d5ec10747] Updating instance_info_cache with network_info: [{"id": "cde7cd95-3b8b-4980-8abc-be5c221a40ff", "address": "fa:16:3e:2d:09:a7", "network": {"id": "08d1669a-f667-4c79-8e49-0ad183f57046", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1863648032-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bbb640407ef94f568aea892f1834d6d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcde7cd95-3b", "ovs_interfaceid": "cde7cd95-3b8b-4980-8abc-be5c221a40ff", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75045) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 23:29:44 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Releasing lock "refresh_cache-b5fc7f02-2143-4bcf-92ac-078d5ec10747" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 23:29:44 user nova-compute[75045]: DEBUG nova.compute.manager [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] [instance: b5fc7f02-2143-4bcf-92ac-078d5ec10747] Updated the network info_cache for instance {{(pid=75045) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 23:29:44 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager.update_available_resource {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:29:44 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:29:44 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:29:44 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:29:44 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Auditing locally available compute resources for user (node: user) {{(pid=75045) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 23:29:44 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72c9d731-2b35-434c-8463-1cd6c18fbd6a/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:29:45 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72c9d731-2b35-434c-8463-1cd6c18fbd6a/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:29:45 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72c9d731-2b35-434c-8463-1cd6c18fbd6a/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:29:45 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72c9d731-2b35-434c-8463-1cd6c18fbd6a/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:29:45 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fd7c34a-55e7-4d54-9c60-03a7155a2685/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:29:45 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fd7c34a-55e7-4d54-9c60-03a7155a2685/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:29:45 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fd7c34a-55e7-4d54-9c60-03a7155a2685/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:29:45 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fd7c34a-55e7-4d54-9c60-03a7155a2685/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:29:45 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ae5ff6b-6f2c-4dfd-a4c6-da4809e2cf27/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:29:45 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ae5ff6b-6f2c-4dfd-a4c6-da4809e2cf27/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:29:45 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ae5ff6b-6f2c-4dfd-a4c6-da4809e2cf27/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:29:45 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ae5ff6b-6f2c-4dfd-a4c6-da4809e2cf27/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:29:46 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] skipping disk /dev/sdh (vda) as it is a volume {{(pid=75045) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 23:29:46 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e480a3c8-a7bc-4eea-b45f-d51f5b68ac0c/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:29:46 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e480a3c8-a7bc-4eea-b45f-d51f5b68ac0c/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:29:46 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e480a3c8-a7bc-4eea-b45f-d51f5b68ac0c/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:29:46 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:29:46 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e480a3c8-a7bc-4eea-b45f-d51f5b68ac0c/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:29:46 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f21fcd3-ac5f-499e-9c34-82af806fda1d/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:29:46 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f21fcd3-ac5f-499e-9c34-82af806fda1d/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:29:46 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f21fcd3-ac5f-499e-9c34-82af806fda1d/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:29:46 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f21fcd3-ac5f-499e-9c34-82af806fda1d/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:29:46 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75045) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 23:29:46 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e92ab9a-8ea4-4452-a458-db181d4a59b7/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:29:46 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e92ab9a-8ea4-4452-a458-db181d4a59b7/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:29:46 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e92ab9a-8ea4-4452-a458-db181d4a59b7/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:29:47 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e92ab9a-8ea4-4452-a458-db181d4a59b7/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:29:47 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa67b237-f598-4111-87ba-d761aa50d95e/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:29:47 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa67b237-f598-4111-87ba-d761aa50d95e/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:29:47 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa67b237-f598-4111-87ba-d761aa50d95e/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:29:47 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa67b237-f598-4111-87ba-d761aa50d95e/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:29:47 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83d225e0-e39e-4500-b7ae-52dfbd8b8588/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:29:47 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83d225e0-e39e-4500-b7ae-52dfbd8b8588/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:29:47 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83d225e0-e39e-4500-b7ae-52dfbd8b8588/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:29:47 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83d225e0-e39e-4500-b7ae-52dfbd8b8588/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:29:47 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75045) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 23:29:47 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a3c21c4-2db3-44e1-8a23-336ca9f8374d/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:29:48 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a3c21c4-2db3-44e1-8a23-336ca9f8374d/disk --force-share --output=json" returned: 0 in 0.240s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:29:48 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a3c21c4-2db3-44e1-8a23-336ca9f8374d/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:29:48 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a3c21c4-2db3-44e1-8a23-336ca9f8374d/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:29:48 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75045) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 23:29:48 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5fc7f02-2143-4bcf-92ac-078d5ec10747/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:29:48 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5fc7f02-2143-4bcf-92ac-078d5ec10747/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:29:48 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5fc7f02-2143-4bcf-92ac-078d5ec10747/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:29:48 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5fc7f02-2143-4bcf-92ac-078d5ec10747/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:29:48 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/adcffd35-00c7-49db-a72f-d6307a90e123/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:29:49 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/adcffd35-00c7-49db-a72f-d6307a90e123/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:29:49 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/adcffd35-00c7-49db-a72f-d6307a90e123/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:29:49 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/adcffd35-00c7-49db-a72f-d6307a90e123/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:29:49 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b84f2b1-01a3-4789-bcef-8b7c4334132b/disk.rescue --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:29:49 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:29:49 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b84f2b1-01a3-4789-bcef-8b7c4334132b/disk.rescue --force-share --output=json" returned: 0 in 0.184s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:29:49 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b84f2b1-01a3-4789-bcef-8b7c4334132b/disk.rescue --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:29:49 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b84f2b1-01a3-4789-bcef-8b7c4334132b/disk.rescue --force-share --output=json" returned: 0 in 0.183s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:29:49 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b84f2b1-01a3-4789-bcef-8b7c4334132b/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:29:49 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b84f2b1-01a3-4789-bcef-8b7c4334132b/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:29:49 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b84f2b1-01a3-4789-bcef-8b7c4334132b/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:29:50 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b84f2b1-01a3-4789-bcef-8b7c4334132b/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:29:50 user nova-compute[75045]: WARNING nova.virt.libvirt.driver [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 23:29:50 user nova-compute[75045]: WARNING nova.virt.libvirt.driver [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 23:29:50 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Hypervisor/Node resource view: name=user free_ram=6682MB free_disk=24.942607879638672GB free_vcpus=-3 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75045) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 23:29:50 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:29:50 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:29:50 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Instance 4ae5ff6b-6f2c-4dfd-a4c6-da4809e2cf27 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75045) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 23:29:50 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Instance 0f21fcd3-ac5f-499e-9c34-82af806fda1d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75045) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 23:29:50 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Instance d2c911cf-d5f4-4c19-8335-8c7834184a7e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75045) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 23:29:50 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Instance b5fc7f02-2143-4bcf-92ac-078d5ec10747 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75045) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 23:29:50 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Instance 0b84f2b1-01a3-4789-bcef-8b7c4334132b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75045) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 23:29:50 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Instance fa67b237-f598-4111-87ba-d761aa50d95e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75045) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 23:29:50 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Instance 7e92ab9a-8ea4-4452-a458-db181d4a59b7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75045) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 23:29:50 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Instance 72c9d731-2b35-434c-8463-1cd6c18fbd6a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75045) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 23:29:50 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Instance 83d225e0-e39e-4500-b7ae-52dfbd8b8588 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75045) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 23:29:50 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Instance 438082fc-a83f-4305-ada6-41a8e1d645a8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75045) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 23:29:50 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Instance 04169f59-e9a6-4b50-9ad7-7f8c105a376a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75045) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 23:29:50 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Instance 1a3c21c4-2db3-44e1-8a23-336ca9f8374d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75045) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 23:29:50 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Instance e480a3c8-a7bc-4eea-b45f-d51f5b68ac0c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75045) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 23:29:50 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Instance 9fd7c34a-55e7-4d54-9c60-03a7155a2685 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75045) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 23:29:50 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Instance adcffd35-00c7-49db-a72f-d6307a90e123 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75045) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 23:29:50 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Total usable vcpus: 12, total allocated vcpus: 15 {{(pid=75045) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 23:29:50 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Final resource view: name=user phys_ram=16011MB used_ram=8192MB phys_disk=40GB used_disk=12GB total_vcpus=12 used_vcpus=15 pci_stats=[] {{(pid=75045) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 23:29:51 user nova-compute[75045]: DEBUG nova.compute.provider_tree [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Inventory has not changed in ProviderTree for provider: 62ba5f85-c74d-4b58-986e-d4197e813fd7 {{(pid=75045) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 23:29:51 user nova-compute[75045]: DEBUG nova.scheduler.client.report [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Inventory has not changed for provider 62ba5f85-c74d-4b58-986e-d4197e813fd7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75045) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 23:29:51 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Compute_service record updated for user:user {{(pid=75045) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 23:29:51 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.611s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:29:51 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:29:51 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:29:51 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:29:51 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:29:54 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:29:56 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:29:59 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:30:01 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:30:04 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:30:05 user nova-compute[75045]: DEBUG nova.compute.manager [req-e79b020d-3067-44ef-85d9-d8338798c605 req-10893b33-455f-4834-8041-2e9172bf9e90 service nova] [instance: 1a3c21c4-2db3-44e1-8a23-336ca9f8374d] Received event network-changed-f3fb74c0-e5f6-4a65-8d50-b33da34c4fcb {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:30:05 user nova-compute[75045]: DEBUG nova.compute.manager [req-e79b020d-3067-44ef-85d9-d8338798c605 req-10893b33-455f-4834-8041-2e9172bf9e90 service nova] [instance: 1a3c21c4-2db3-44e1-8a23-336ca9f8374d] Refreshing instance network info cache due to event network-changed-f3fb74c0-e5f6-4a65-8d50-b33da34c4fcb. {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 23:30:05 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-e79b020d-3067-44ef-85d9-d8338798c605 req-10893b33-455f-4834-8041-2e9172bf9e90 service nova] Acquiring lock "refresh_cache-1a3c21c4-2db3-44e1-8a23-336ca9f8374d" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 23:30:05 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-e79b020d-3067-44ef-85d9-d8338798c605 req-10893b33-455f-4834-8041-2e9172bf9e90 service nova] Acquired lock "refresh_cache-1a3c21c4-2db3-44e1-8a23-336ca9f8374d" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 23:30:05 user nova-compute[75045]: DEBUG nova.network.neutron [req-e79b020d-3067-44ef-85d9-d8338798c605 req-10893b33-455f-4834-8041-2e9172bf9e90 service nova] [instance: 1a3c21c4-2db3-44e1-8a23-336ca9f8374d] Refreshing network info cache for port f3fb74c0-e5f6-4a65-8d50-b33da34c4fcb {{(pid=75045) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 23:30:05 user nova-compute[75045]: DEBUG nova.network.neutron [req-e79b020d-3067-44ef-85d9-d8338798c605 req-10893b33-455f-4834-8041-2e9172bf9e90 service nova] [instance: 1a3c21c4-2db3-44e1-8a23-336ca9f8374d] Updated VIF entry in instance network info cache for port f3fb74c0-e5f6-4a65-8d50-b33da34c4fcb. {{(pid=75045) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 23:30:05 user nova-compute[75045]: DEBUG nova.network.neutron [req-e79b020d-3067-44ef-85d9-d8338798c605 req-10893b33-455f-4834-8041-2e9172bf9e90 service nova] [instance: 1a3c21c4-2db3-44e1-8a23-336ca9f8374d] Updating instance_info_cache with network_info: [{"id": "f3fb74c0-e5f6-4a65-8d50-b33da34c4fcb", "address": "fa:16:3e:57:5d:d2", "network": {"id": "2f33d93d-98ec-4b87-a0c0-efe2d2ac8f6d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-719527911-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.125", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7eff4be777d24514be52868961bf7a25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3fb74c0-e5", "ovs_interfaceid": "f3fb74c0-e5f6-4a65-8d50-b33da34c4fcb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75045) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 23:30:05 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-e79b020d-3067-44ef-85d9-d8338798c605 req-10893b33-455f-4834-8041-2e9172bf9e90 service nova] Releasing lock "refresh_cache-1a3c21c4-2db3-44e1-8a23-336ca9f8374d" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 23:30:06 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:30:09 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:30:11 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:30:12 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-66ebab8b-71c6-4e39-8af3-cc6a34e3680e tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Acquiring lock "1a3c21c4-2db3-44e1-8a23-336ca9f8374d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:30:12 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-66ebab8b-71c6-4e39-8af3-cc6a34e3680e tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Lock "1a3c21c4-2db3-44e1-8a23-336ca9f8374d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:30:12 user nova-compute[75045]: DEBUG nova.objects.instance [None req-66ebab8b-71c6-4e39-8af3-cc6a34e3680e tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Lazy-loading 'flavor' on Instance uuid 1a3c21c4-2db3-44e1-8a23-336ca9f8374d {{(pid=75045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 23:30:12 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-66ebab8b-71c6-4e39-8af3-cc6a34e3680e tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Lock "1a3c21c4-2db3-44e1-8a23-336ca9f8374d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.051s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:30:12 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-66ebab8b-71c6-4e39-8af3-cc6a34e3680e tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Acquiring lock "1a3c21c4-2db3-44e1-8a23-336ca9f8374d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:30:12 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-66ebab8b-71c6-4e39-8af3-cc6a34e3680e tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Lock "1a3c21c4-2db3-44e1-8a23-336ca9f8374d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:30:12 user nova-compute[75045]: INFO nova.compute.manager [None req-66ebab8b-71c6-4e39-8af3-cc6a34e3680e tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] [instance: 1a3c21c4-2db3-44e1-8a23-336ca9f8374d] Attaching volume fa72cf0a-1134-47a3-abd2-6a51f4f20393 to /dev/vdb
Nov 08 23:30:12 user nova-compute[75045]: DEBUG os_brick.utils [None req-66ebab8b-71c6-4e39-8af3-cc6a34e3680e tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75045) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 23:30:12 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:30:12 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:30:12 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[17db390b-6dae-4806-8743-1a6daaa25105]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6217bd6e884\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:30:12 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:30:12 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:30:12 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[50810ca6-00f1-4ff2-9752-530cc1eb62f5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:30:12 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:30:12 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:30:12 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6832ef5-6d36-41e8-a13e-8b086e7d6a73]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:30:12 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e497e20-1e83-4d81-833f-6f8583091c6d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:30:12 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-66ebab8b-71c6-4e39-8af3-cc6a34e3680e tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Running cmd (subprocess): nvme version {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:30:12 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-66ebab8b-71c6-4e39-8af3-cc6a34e3680e tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] 'nvme version' failed. Not Retrying. {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 23:30:12 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.nvmeof [None req-66ebab8b-71c6-4e39-8af3-cc6a34e3680e tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] nvme not present on system {{(pid=75045) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 23:30:12 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:30:12 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 23:30:12 user nova-compute[75045]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 23:30:12 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6b9d59c-f765-4b02-9b4e-da14316616dd]: (4, '') {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:30:12 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.lightos [None req-66ebab8b-71c6-4e39-8af3-cc6a34e3680e tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75045) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 23:30:12 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.lightos [None req-66ebab8b-71c6-4e39-8af3-cc6a34e3680e tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75045) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 23:30:12 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.lightos [None req-66ebab8b-71c6-4e39-8af3-cc6a34e3680e tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] LIGHTOS: no hostnqn found. {{(pid=75045) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 23:30:12 user nova-compute[75045]: DEBUG os_brick.utils [None req-66ebab8b-71c6-4e39-8af3-cc6a34e3680e tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6217bd6e884', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75045) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 23:30:12 user nova-compute[75045]: DEBUG nova.virt.block_device [None req-66ebab8b-71c6-4e39-8af3-cc6a34e3680e tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] [instance: 1a3c21c4-2db3-44e1-8a23-336ca9f8374d] Updating existing volume attachment record: 2c0edb74-3ea2-4b83-929c-c053d84af599 {{(pid=75045) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 23:30:14 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:30:16 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:30:19 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:30:20 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:30:21 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:30:22 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:30:24 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:30:25 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:30:29 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:30:34 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-1e8839ac-e2ed-4c14-b2f6-ae1b111bd143 tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] Acquiring lock "83d225e0-e39e-4500-b7ae-52dfbd8b8588" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:30:34 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-1e8839ac-e2ed-4c14-b2f6-ae1b111bd143 tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] Lock "83d225e0-e39e-4500-b7ae-52dfbd8b8588" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:30:34 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-1e8839ac-e2ed-4c14-b2f6-ae1b111bd143 tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] Acquiring lock "83d225e0-e39e-4500-b7ae-52dfbd8b8588-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:30:34 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-1e8839ac-e2ed-4c14-b2f6-ae1b111bd143 tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] Lock "83d225e0-e39e-4500-b7ae-52dfbd8b8588-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:30:34 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-1e8839ac-e2ed-4c14-b2f6-ae1b111bd143 tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] Lock "83d225e0-e39e-4500-b7ae-52dfbd8b8588-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:30:34 user nova-compute[75045]: INFO nova.compute.manager [None req-1e8839ac-e2ed-4c14-b2f6-ae1b111bd143 tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] [instance: 83d225e0-e39e-4500-b7ae-52dfbd8b8588] Terminating instance
Nov 08 23:30:34 user nova-compute[75045]: DEBUG nova.compute.manager [None req-1e8839ac-e2ed-4c14-b2f6-ae1b111bd143 tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] [instance: 83d225e0-e39e-4500-b7ae-52dfbd8b8588] Start destroying the instance on the hypervisor. {{(pid=75045) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 23:30:34 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:30:34 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:30:34 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:30:34 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:30:34 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:30:34 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:30:34 user nova-compute[75045]: DEBUG nova.compute.manager [req-068a660c-e776-4d58-8274-a0cc29a0e034 req-7628c0de-1041-4029-8e50-abd08b95b083 service nova] [instance: 83d225e0-e39e-4500-b7ae-52dfbd8b8588] Received event network-vif-unplugged-f34eef67-0428-49ea-91c3-08510ac690c8 {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:30:34 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-068a660c-e776-4d58-8274-a0cc29a0e034 req-7628c0de-1041-4029-8e50-abd08b95b083 service nova] Acquiring lock "83d225e0-e39e-4500-b7ae-52dfbd8b8588-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:30:34 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-068a660c-e776-4d58-8274-a0cc29a0e034 req-7628c0de-1041-4029-8e50-abd08b95b083 service nova] Lock "83d225e0-e39e-4500-b7ae-52dfbd8b8588-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:30:34 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-068a660c-e776-4d58-8274-a0cc29a0e034 req-7628c0de-1041-4029-8e50-abd08b95b083 service nova] Lock "83d225e0-e39e-4500-b7ae-52dfbd8b8588-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:30:34 user nova-compute[75045]: DEBUG nova.compute.manager [req-068a660c-e776-4d58-8274-a0cc29a0e034 req-7628c0de-1041-4029-8e50-abd08b95b083 service nova] [instance: 83d225e0-e39e-4500-b7ae-52dfbd8b8588] No waiting events found dispatching network-vif-unplugged-f34eef67-0428-49ea-91c3-08510ac690c8 {{(pid=75045) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 23:30:34 user nova-compute[75045]: DEBUG nova.compute.manager [req-068a660c-e776-4d58-8274-a0cc29a0e034 req-7628c0de-1041-4029-8e50-abd08b95b083 service nova] [instance: 83d225e0-e39e-4500-b7ae-52dfbd8b8588] Received event network-vif-unplugged-f34eef67-0428-49ea-91c3-08510ac690c8 for instance with task_state deleting. {{(pid=75045) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 23:30:35 user nova-compute[75045]: INFO nova.virt.libvirt.driver [-] [instance: 83d225e0-e39e-4500-b7ae-52dfbd8b8588] Instance destroyed successfully.
Nov 08 23:30:35 user nova-compute[75045]: DEBUG nova.objects.instance [None req-1e8839ac-e2ed-4c14-b2f6-ae1b111bd143 tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] Lazy-loading 'resources' on Instance uuid 83d225e0-e39e-4500-b7ae-52dfbd8b8588 {{(pid=75045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 23:30:35 user nova-compute[75045]: DEBUG nova.virt.libvirt.vif [None req-1e8839ac-e2ed-4c14-b2f6-ae1b111bd143 tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T23:21:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-52454361',display_name='tempest-ServerActionsTestOtherB-server-52454361',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-52454361',id=16,image_ref='a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIPmBc8a5DafKsuCJlskOYpDDhPwBioEg4bK8XJOdFwOvE3kerS9/OlDrIi5hKJ4t8vHYgazIqYE6C9fG+r7udy2il9kXgn4I4yPKUfyTlGPaqAfUG4gtg1sBgzfEDpsow==',key_name='tempest-keypair-1494902868',keypairs=<?>,launch_index=0,launched_at=2023-11-08T23:28:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='467f0ecc3b93457f9fe83886b99c6285',ramdisk_id='',reservation_id='r-mtlunwmw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherB-299728934',owner_user_name='tempest-ServerActionsTestOtherB-299728934-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T23:28:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='57d0c13f5a9f4c1bbb0458b93de348cb',uuid=83d225e0-e39e-4500-b7ae-52dfbd8b8588,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f34eef67-0428-49ea-91c3-08510ac690c8", "address": "fa:16:3e:d9:92:a4", "network": {"id": "d177c8b8-5960-4e40-bf9b-920a2f6ba4f7", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-497258569-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.31", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "467f0ecc3b93457f9fe83886b99c6285", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf34eef67-04", "ovs_interfaceid": "f34eef67-0428-49ea-91c3-08510ac690c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75045) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 23:30:35 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-1e8839ac-e2ed-4c14-b2f6-ae1b111bd143 tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] Converting VIF {"id": "f34eef67-0428-49ea-91c3-08510ac690c8", "address": "fa:16:3e:d9:92:a4", "network": {"id": "d177c8b8-5960-4e40-bf9b-920a2f6ba4f7", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-497258569-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.31", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "467f0ecc3b93457f9fe83886b99c6285", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf34eef67-04", "ovs_interfaceid": "f34eef67-0428-49ea-91c3-08510ac690c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 23:30:35 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-1e8839ac-e2ed-4c14-b2f6-ae1b111bd143 tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d9:92:a4,bridge_name='br-int',has_traffic_filtering=True,id=f34eef67-0428-49ea-91c3-08510ac690c8,network=Network(d177c8b8-5960-4e40-bf9b-920a2f6ba4f7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf34eef67-04') {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 23:30:35 user nova-compute[75045]: DEBUG os_vif [None req-1e8839ac-e2ed-4c14-b2f6-ae1b111bd143 tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d9:92:a4,bridge_name='br-int',has_traffic_filtering=True,id=f34eef67-0428-49ea-91c3-08510ac690c8,network=Network(d177c8b8-5960-4e40-bf9b-920a2f6ba4f7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf34eef67-04') {{(pid=75045) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 23:30:35 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:30:35 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf34eef67-04, bridge=br-int, if_exists=True) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:30:35 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:30:35 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 23:30:35 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:30:35 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=88434b2d-da31-41c6-ad07-09b9fd2e57de) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:30:35 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:30:35 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:30:35 user nova-compute[75045]: INFO os_vif [None req-1e8839ac-e2ed-4c14-b2f6-ae1b111bd143 tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d9:92:a4,bridge_name='br-int',has_traffic_filtering=True,id=f34eef67-0428-49ea-91c3-08510ac690c8,network=Network(d177c8b8-5960-4e40-bf9b-920a2f6ba4f7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf34eef67-04')
Nov 08 23:30:35 user nova-compute[75045]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1e8839ac-e2ed-4c14-b2f6-ae1b111bd143 tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] [instance: 83d225e0-e39e-4500-b7ae-52dfbd8b8588] calling os-brick to detach iSCSI Volume {{(pid=75045) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 23:30:35 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e8839ac-e2ed-4c14-b2f6-ae1b111bd143 tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1b68210460>, {'target_iqn': 'iqn.2010-10.org.openstack:d2e734fa-1dcb-4510-a50e-064e29c2985e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qCUrDkTz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75045) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 23:30:35 user nova-compute[75045]: WARNING os_brick.initiator.connectors.base [None req-1e8839ac-e2ed-4c14-b2f6-ae1b111bd143 tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 23:30:35 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-1e8839ac-e2ed-4c14-b2f6-ae1b111bd143 tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 23:30:35 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-1e8839ac-e2ed-4c14-b2f6-ae1b111bd143 tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 23:30:35 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:30:35 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:30:35 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[274ec6d3-e33b-41a6-8701-d642adf9bf23]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:83187c89-e833-4efd-afa0-2cbfe05d8db1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e9c3ac6d-d72a-41c8-9c18-15131250e323\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d2e734fa-1dcb-4510-a50e-064e29c2985e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:30:35 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e8839ac-e2ed-4c14-b2f6-ae1b111bd143 tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 23:30:35 user nova-compute[75045]: No targets found.
Nov 08 23:30:35 user nova-compute[75045]: iSNS:
Nov 08 23:30:35 user nova-compute[75045]: No targets found.
Nov 08 23:30:35 user nova-compute[75045]: STATIC:
Nov 08 23:30:35 user nova-compute[75045]: Target: iqn.2010-10.org.openstack:83187c89-e833-4efd-afa0-2cbfe05d8db1
Nov 08 23:30:35 user nova-compute[75045]:         Portal: 172.16.0.220:3260,-1
Nov 08 23:30:35 user nova-compute[75045]:                 Iface Name: default
Nov 08 23:30:35 user nova-compute[75045]: Target: iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab
Nov 08 23:30:35 user nova-compute[75045]:         Portal: 172.16.0.220:3260,-1
Nov 08 23:30:35 user nova-compute[75045]:                 Iface Name: default
Nov 08 23:30:35 user nova-compute[75045]: Target: iqn.2010-10.org.openstack:e9c3ac6d-d72a-41c8-9c18-15131250e323
Nov 08 23:30:35 user nova-compute[75045]:         Portal: 172.16.0.220:3260,-1
Nov 08 23:30:35 user nova-compute[75045]:                 Iface Name: default
Nov 08 23:30:35 user nova-compute[75045]: Target: iqn.2010-10.org.openstack:d2e734fa-1dcb-4510-a50e-064e29c2985e
Nov 08 23:30:35 user nova-compute[75045]:         Portal: 172.16.0.220:3260,-1
Nov 08 23:30:35 user nova-compute[75045]:                 Iface Name: default
Nov 08 23:30:35 user nova-compute[75045]: FIRMWARE:
Nov 08 23:30:35 user nova-compute[75045]: No targets found.
Nov 08 23:30:35 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 23:30:35 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e8839ac-e2ed-4c14-b2f6-ae1b111bd143 tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 23:30:35 user nova-compute[75045]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 23:30:35 user nova-compute[75045]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75045) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 23:30:35 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e8839ac-e2ed-4c14-b2f6-ae1b111bd143 tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d2e734fa-1dcb-4510-a50e-064e29c2985e', 0)] {{(pid=75045) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 23:30:35 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:30:35 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:30:35 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[43cab724-3e6c-40cd-95ad-50856cea735f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:83187c89-e833-4efd-afa0-2cbfe05d8db1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d2e734fa-1dcb-4510-a50e-064e29c2985e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e9c3ac6d-d72a-41c8-9c18-15131250e323\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:30:35 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:30:35 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:30:35 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[264b2359-fdd2-4225-912f-be90084de1aa]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2e734fa-1dcb-4510-a50e-064e29c2985e (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9c3ac6d-d72a-41c8-9c18-15131250e323 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83187c89-e833-4efd-afa0-2cbfe05d8db1 (non-flash)\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:30:35 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e8839ac-e2ed-4c14-b2f6-ae1b111bd143 tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab (non-flash)
Nov 08 23:30:35 user nova-compute[75045]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2e734fa-1dcb-4510-a50e-064e29c2985e (non-flash)
Nov 08 23:30:35 user nova-compute[75045]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9c3ac6d-d72a-41c8-9c18-15131250e323 (non-flash)
Nov 08 23:30:35 user nova-compute[75045]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83187c89-e833-4efd-afa0-2cbfe05d8db1 (non-flash)
Nov 08 23:30:35 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 23:30:35 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e8839ac-e2ed-4c14-b2f6-ae1b111bd143 tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab (non-flash)
Nov 08 23:30:35 user nova-compute[75045]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2e734fa-1dcb-4510-a50e-064e29c2985e (non-flash)
Nov 08 23:30:35 user nova-compute[75045]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9c3ac6d-d72a-41c8-9c18-15131250e323 (non-flash)
Nov 08 23:30:35 user nova-compute[75045]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83187c89-e833-4efd-afa0-2cbfe05d8db1 (non-flash)
Nov 08 23:30:35 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 23:30:35 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e8839ac-e2ed-4c14-b2f6-ae1b111bd143 tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1b68268af0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d2e734fa-1dcb-4510-a50e-064e29c2985e'): ({'sdc'}, set())}) {{(pid=75045) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 23:30:35 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-1e8839ac-e2ed-4c14-b2f6-ae1b111bd143 tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] Removing single pathed devices sdc {{(pid=75045) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 23:30:35 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:30:35 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:30:35 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[34328337-1c24-4547-9052-a997b8979347]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:30:35 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:30:35 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:30:35 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[29c5e99f-6ef8-4174-805c-1bdd411446f7]: (4, ('ok\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:30:35 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-1e8839ac-e2ed-4c14-b2f6-ae1b111bd143 tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] Flushing IO for device /dev/sdc {{(pid=75045) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 23:30:35 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:30:35 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:30:35 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[11c7fca3-928f-4cf9-a125-eeb1f84d2a69]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:30:35 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-1e8839ac-e2ed-4c14-b2f6-ae1b111bd143 tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75045) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 23:30:35 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:30:35 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.048s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:30:35 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[303c9c72-e631-4e86-8e13-3dd270b8da77]: (4, ('1', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:30:35 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-1e8839ac-e2ed-4c14-b2f6-ae1b111bd143 tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75045) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 23:30:35 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-1e8839ac-e2ed-4c14-b2f6-ae1b111bd143 tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] SCSI volumes sdc have been removed. {{(pid=75045) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 23:30:35 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e8839ac-e2ed-4c14-b2f6-ae1b111bd143 tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d2e734fa-1dcb-4510-a50e-064e29c2985e')] {{(pid=75045) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 23:30:35 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2e734fa-1dcb-4510-a50e-064e29c2985e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:30:35 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2e734fa-1dcb-4510-a50e-064e29c2985e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:30:35 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[c517d7ff-ff70-4824-bee7-57555097b1fa]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:30:35 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e8839ac-e2ed-4c14-b2f6-ae1b111bd143 tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:30:35 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2e734fa-1dcb-4510-a50e-064e29c2985e -p 172.16.0.220:3260 --logout {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:30:35 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2e734fa-1dcb-4510-a50e-064e29c2985e -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:30:35 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae8ab09d-963d-4ac6-ad74-e53ca7695701]: (4, ('Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:d2e734fa-1dcb-4510-a50e-064e29c2985e, portal: 172.16.0.220,3260]\nLogout of [sid: 27, target: iqn.2010-10.org.openstack:d2e734fa-1dcb-4510-a50e-064e29c2985e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:30:35 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e8839ac-e2ed-4c14-b2f6-ae1b111bd143 tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:d2e734fa-1dcb-4510-a50e-064e29c2985e, portal: 172.16.0.220,3260]
Nov 08 23:30:35 user nova-compute[75045]: Logout of [sid: 27, target: iqn.2010-10.org.openstack:d2e734fa-1dcb-4510-a50e-064e29c2985e, portal: 172.16.0.220,3260] successful.
Nov 08 23:30:35 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:30:35 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2e734fa-1dcb-4510-a50e-064e29c2985e -p 172.16.0.220:3260 --op delete {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:30:35 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2e734fa-1dcb-4510-a50e-064e29c2985e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:30:35 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[83825081-66c7-47b4-8d14-3abdf30efcef]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:30:35 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e8839ac-e2ed-4c14-b2f6-ae1b111bd143 tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:30:35 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-1e8839ac-e2ed-4c14-b2f6-ae1b111bd143 tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.314s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 23:30:35 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e8839ac-e2ed-4c14-b2f6-ae1b111bd143 tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] <== disconnect_volume: return (315ms) None {{(pid=75045) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 23:30:35 user nova-compute[75045]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1e8839ac-e2ed-4c14-b2f6-ae1b111bd143 tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] [instance: 83d225e0-e39e-4500-b7ae-52dfbd8b8588] Disconnected iSCSI Volume {{(pid=75045) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 23:30:35 user nova-compute[75045]: INFO nova.virt.libvirt.driver [None req-1e8839ac-e2ed-4c14-b2f6-ae1b111bd143 tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] [instance: 83d225e0-e39e-4500-b7ae-52dfbd8b8588] Deleting instance files /opt/stack/data/nova/instances/83d225e0-e39e-4500-b7ae-52dfbd8b8588_del
Nov 08 23:30:35 user nova-compute[75045]: INFO nova.virt.libvirt.driver [None req-1e8839ac-e2ed-4c14-b2f6-ae1b111bd143 tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] [instance: 83d225e0-e39e-4500-b7ae-52dfbd8b8588] Deletion of /opt/stack/data/nova/instances/83d225e0-e39e-4500-b7ae-52dfbd8b8588_del complete
Nov 08 23:30:35 user nova-compute[75045]: INFO nova.compute.manager [None req-1e8839ac-e2ed-4c14-b2f6-ae1b111bd143 tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] [instance: 83d225e0-e39e-4500-b7ae-52dfbd8b8588] Took 1.29 seconds to destroy the instance on the hypervisor.
Nov 08 23:30:35 user nova-compute[75045]: DEBUG oslo.service.loopingcall [None req-1e8839ac-e2ed-4c14-b2f6-ae1b111bd143 tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75045) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 23:30:35 user nova-compute[75045]: DEBUG nova.compute.manager [-] [instance: 83d225e0-e39e-4500-b7ae-52dfbd8b8588] Deallocating network for instance {{(pid=75045) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 23:30:35 user nova-compute[75045]: DEBUG nova.network.neutron [-] [instance: 83d225e0-e39e-4500-b7ae-52dfbd8b8588] deallocate_for_instance() {{(pid=75045) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 23:30:36 user nova-compute[75045]: DEBUG nova.network.neutron [-] [instance: 83d225e0-e39e-4500-b7ae-52dfbd8b8588] Updating instance_info_cache with network_info: [] {{(pid=75045) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 23:30:36 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:30:36 user nova-compute[75045]: INFO nova.compute.manager [-] [instance: 83d225e0-e39e-4500-b7ae-52dfbd8b8588] Took 0.81 seconds to deallocate network for instance.
Nov 08 23:30:36 user nova-compute[75045]: DEBUG nova.compute.manager [req-1cdaf524-44d1-4942-a33d-393324646068 req-fb0adf01-3fb3-4dd2-93fb-50500622a71a service nova] [instance: 83d225e0-e39e-4500-b7ae-52dfbd8b8588] Received event network-vif-plugged-f34eef67-0428-49ea-91c3-08510ac690c8 {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:30:36 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-1cdaf524-44d1-4942-a33d-393324646068 req-fb0adf01-3fb3-4dd2-93fb-50500622a71a service nova] Acquiring lock "83d225e0-e39e-4500-b7ae-52dfbd8b8588-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:30:36 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-1cdaf524-44d1-4942-a33d-393324646068 req-fb0adf01-3fb3-4dd2-93fb-50500622a71a service nova] Lock "83d225e0-e39e-4500-b7ae-52dfbd8b8588-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:30:36 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-1cdaf524-44d1-4942-a33d-393324646068 req-fb0adf01-3fb3-4dd2-93fb-50500622a71a service nova] Lock "83d225e0-e39e-4500-b7ae-52dfbd8b8588-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:30:36 user nova-compute[75045]: DEBUG nova.compute.manager [req-1cdaf524-44d1-4942-a33d-393324646068 req-fb0adf01-3fb3-4dd2-93fb-50500622a71a service nova] [instance: 83d225e0-e39e-4500-b7ae-52dfbd8b8588] No waiting events found dispatching network-vif-plugged-f34eef67-0428-49ea-91c3-08510ac690c8 {{(pid=75045) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 23:30:36 user nova-compute[75045]: WARNING nova.compute.manager [req-1cdaf524-44d1-4942-a33d-393324646068 req-fb0adf01-3fb3-4dd2-93fb-50500622a71a service nova] [instance: 83d225e0-e39e-4500-b7ae-52dfbd8b8588] Received unexpected event network-vif-plugged-f34eef67-0428-49ea-91c3-08510ac690c8 for instance with vm_state active and task_state deleting.
Nov 08 23:30:36 user nova-compute[75045]: DEBUG nova.compute.manager [req-1cdaf524-44d1-4942-a33d-393324646068 req-fb0adf01-3fb3-4dd2-93fb-50500622a71a service nova] [instance: 83d225e0-e39e-4500-b7ae-52dfbd8b8588] Received event network-vif-deleted-f34eef67-0428-49ea-91c3-08510ac690c8 {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:30:37 user nova-compute[75045]: DEBUG nova.virt.libvirt.volume.iscsi [None req-66ebab8b-71c6-4e39-8af3-cc6a34e3680e tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] [instance: 1a3c21c4-2db3-44e1-8a23-336ca9f8374d] Calling os-brick to attach iSCSI Volume {{(pid=75045) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 23:30:37 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-66ebab8b-71c6-4e39-8af3-cc6a34e3680e tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1b68210460>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:fa72cf0a-1134-47a3-abd2-6a51f4f20393', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OxlVGiFe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75045) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 23:30:37 user nova-compute[75045]: WARNING os_brick.initiator.connectors.base [None req-66ebab8b-71c6-4e39-8af3-cc6a34e3680e tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 23:30:37 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-66ebab8b-71c6-4e39-8af3-cc6a34e3680e tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 23:30:37 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-66ebab8b-71c6-4e39-8af3-cc6a34e3680e tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 23:30:37 user nova-compute[75045]: WARNING os_brick.initiator.connectors.base [None req-66ebab8b-71c6-4e39-8af3-cc6a34e3680e tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 23:30:37 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-66ebab8b-71c6-4e39-8af3-cc6a34e3680e tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fa72cf0a-1134-47a3-abd2-6a51f4f20393" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 23:30:37 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-66ebab8b-71c6-4e39-8af3-cc6a34e3680e tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fa72cf0a-1134-47a3-abd2-6a51f4f20393" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 23:30:37 user nova-compute[75045]: INFO os_brick.initiator.connectors.iscsi [None req-66ebab8b-71c6-4e39-8af3-cc6a34e3680e tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 23:30:37 user nova-compute[75045]: INFO nova.compute.manager [None req-1e8839ac-e2ed-4c14-b2f6-ae1b111bd143 tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] [instance: 83d225e0-e39e-4500-b7ae-52dfbd8b8588] Took 0.97 seconds to detach 1 volumes for instance.
Nov 08 23:30:37 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa72cf0a-1134-47a3-abd2-6a51f4f20393 -p 172.16.0.220:3260 {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:30:37 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa72cf0a-1134-47a3-abd2-6a51f4f20393 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:30:37 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[235466b3-bc9a-4ba9-9f40-6600ace11123]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:30:37 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-66ebab8b-71c6-4e39-8af3-cc6a34e3680e tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 23:30:37 user nova-compute[75045]:  {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:30:37 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa72cf0a-1134-47a3-abd2-6a51f4f20393 -p 172.16.0.220:3260 --interface default --op new {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:30:37 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa72cf0a-1134-47a3-abd2-6a51f4f20393 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:30:37 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[18dfbb7d-cbed-4142-8a17-3c14e0971947]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fa72cf0a-1134-47a3-abd2-6a51f4f20393] added\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:30:37 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-66ebab8b-71c6-4e39-8af3-cc6a34e3680e tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fa72cf0a-1134-47a3-abd2-6a51f4f20393] added
Nov 08 23:30:37 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:30:37 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa72cf0a-1134-47a3-abd2-6a51f4f20393 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:30:37 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa72cf0a-1134-47a3-abd2-6a51f4f20393 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.057s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:30:37 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[0844525f-2f2b-46b0-af0b-de843a99d6db]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:30:37 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-66ebab8b-71c6-4e39-8af3-cc6a34e3680e tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:30:37 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa72cf0a-1134-47a3-abd2-6a51f4f20393 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:30:37 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-1e8839ac-e2ed-4c14-b2f6-ae1b111bd143 tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:30:37 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-1e8839ac-e2ed-4c14-b2f6-ae1b111bd143 tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:30:37 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa72cf0a-1134-47a3-abd2-6a51f4f20393 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.136s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:30:37 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[91a0c1d0-7da1-4668-a0fe-fe312c30517e]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:30:37 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-66ebab8b-71c6-4e39-8af3-cc6a34e3680e tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:30:37 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa72cf0a-1134-47a3-abd2-6a51f4f20393 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OxlVGiFe {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:30:37 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa72cf0a-1134-47a3-abd2-6a51f4f20393 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OxlVGiFe" returned: 0 in 0.026s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:30:37 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[91e7df23-ae11-4bd3-abbd-5ce76efbecf3]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:30:37 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-66ebab8b-71c6-4e39-8af3-cc6a34e3680e tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'OxlVGiFe'): stdout= stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:30:37 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa72cf0a-1134-47a3-abd2-6a51f4f20393 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:30:37 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa72cf0a-1134-47a3-abd2-6a51f4f20393 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:30:37 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[62b9b65b-5ce0-4839-86b2-945957bfb953]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:30:37 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-66ebab8b-71c6-4e39-8af3-cc6a34e3680e tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:30:37 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:30:37 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:30:37 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f993580-d312-4687-94b1-eaa98e0a2ae5]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9c3ac6d-d72a-41c8-9c18-15131250e323 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83187c89-e833-4efd-afa0-2cbfe05d8db1 (non-flash)\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:30:37 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-66ebab8b-71c6-4e39-8af3-cc6a34e3680e tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab (non-flash)
Nov 08 23:30:37 user nova-compute[75045]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9c3ac6d-d72a-41c8-9c18-15131250e323 (non-flash)
Nov 08 23:30:37 user nova-compute[75045]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83187c89-e833-4efd-afa0-2cbfe05d8db1 (non-flash)
Nov 08 23:30:37 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 23:30:37 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-66ebab8b-71c6-4e39-8af3-cc6a34e3680e tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab (non-flash)
Nov 08 23:30:37 user nova-compute[75045]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9c3ac6d-d72a-41c8-9c18-15131250e323 (non-flash)
Nov 08 23:30:37 user nova-compute[75045]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83187c89-e833-4efd-afa0-2cbfe05d8db1 (non-flash)
Nov 08 23:30:37 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 23:30:37 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa72cf0a-1134-47a3-abd2-6a51f4f20393 -p 172.16.0.220:3260 --login {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:30:37 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa72cf0a-1134-47a3-abd2-6a51f4f20393 -p 172.16.0.220:3260 --login" returned: 0 in 0.079s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:30:37 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[e38fbc49-a402-4f8b-b8ba-7930407e71a0]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:fa72cf0a-1134-47a3-abd2-6a51f4f20393, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:fa72cf0a-1134-47a3-abd2-6a51f4f20393, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:30:37 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-66ebab8b-71c6-4e39-8af3-cc6a34e3680e tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:fa72cf0a-1134-47a3-abd2-6a51f4f20393, portal: 172.16.0.220,3260]
Nov 08 23:30:37 user nova-compute[75045]: Login to [iface: default, target: iqn.2010-10.org.openstack:fa72cf0a-1134-47a3-abd2-6a51f4f20393, portal: 172.16.0.220,3260] successful.
Nov 08 23:30:37 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:30:37 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa72cf0a-1134-47a3-abd2-6a51f4f20393 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:30:37 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa72cf0a-1134-47a3-abd2-6a51f4f20393 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.055s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:30:37 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[41f60157-8daa-4f76-b9bf-4e321d4d394f]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:30:37 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-66ebab8b-71c6-4e39-8af3-cc6a34e3680e tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:30:37 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:30:37 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:30:37 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[a24e60ef-b65a-4d19-8608-1fade66a0d2c]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9c3ac6d-d72a-41c8-9c18-15131250e323 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83187c89-e833-4efd-afa0-2cbfe05d8db1 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa72cf0a-1134-47a3-abd2-6a51f4f20393 (non-flash)\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:30:37 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-66ebab8b-71c6-4e39-8af3-cc6a34e3680e tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab (non-flash)
Nov 08 23:30:37 user nova-compute[75045]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9c3ac6d-d72a-41c8-9c18-15131250e323 (non-flash)
Nov 08 23:30:37 user nova-compute[75045]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83187c89-e833-4efd-afa0-2cbfe05d8db1 (non-flash)
Nov 08 23:30:37 user nova-compute[75045]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa72cf0a-1134-47a3-abd2-6a51f4f20393 (non-flash)
Nov 08 23:30:37 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 23:30:37 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-66ebab8b-71c6-4e39-8af3-cc6a34e3680e tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab (non-flash)
Nov 08 23:30:37 user nova-compute[75045]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9c3ac6d-d72a-41c8-9c18-15131250e323 (non-flash)
Nov 08 23:30:37 user nova-compute[75045]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83187c89-e833-4efd-afa0-2cbfe05d8db1 (non-flash)
Nov 08 23:30:37 user nova-compute[75045]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa72cf0a-1134-47a3-abd2-6a51f4f20393 (non-flash)
Nov 08 23:30:37 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 23:30:37 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-66ebab8b-71c6-4e39-8af3-cc6a34e3680e tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fa72cf0a-1134-47a3-abd2-6a51f4f20393" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.529s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 23:30:37 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-66ebab8b-71c6-4e39-8af3-cc6a34e3680e tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Connected to 172.16.0.220:3260 {{(pid=75045) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 23:30:37 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-66ebab8b-71c6-4e39-8af3-cc6a34e3680e tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] HCTL ('34', '-', '-', 0) found on session 30 with lun 0 {{(pid=75045) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 23:30:37 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-66ebab8b-71c6-4e39-8af3-cc6a34e3680e tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75045) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 23:30:37 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:30:37 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.025s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:30:37 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[46f6bee7-169e-4933-8c37-4da5c2dfe7d3]: (4, ('- - 0', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:30:37 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-66ebab8b-71c6-4e39-8af3-cc6a34e3680e tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Searching for a device in session 30 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75045) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 23:30:37 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-66ebab8b-71c6-4e39-8af3-cc6a34e3680e tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:fa72cf0a-1134-47a3-abd2-6a51f4f20393', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OxlVGiFe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75045) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 23:30:38 user nova-compute[75045]: DEBUG nova.compute.provider_tree [None req-1e8839ac-e2ed-4c14-b2f6-ae1b111bd143 tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] Inventory has not changed in ProviderTree for provider: 62ba5f85-c74d-4b58-986e-d4197e813fd7 {{(pid=75045) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 23:30:38 user nova-compute[75045]: DEBUG nova.scheduler.client.report [None req-1e8839ac-e2ed-4c14-b2f6-ae1b111bd143 tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] Inventory has not changed for provider 62ba5f85-c74d-4b58-986e-d4197e813fd7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75045) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 23:30:38 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-1e8839ac-e2ed-4c14-b2f6-ae1b111bd143 tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.709s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:30:38 user nova-compute[75045]: INFO nova.scheduler.client.report [None req-1e8839ac-e2ed-4c14-b2f6-ae1b111bd143 tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] Deleted allocations for instance 83d225e0-e39e-4500-b7ae-52dfbd8b8588
Nov 08 23:30:38 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-1e8839ac-e2ed-4c14-b2f6-ae1b111bd143 tempest-ServerActionsTestOtherB-299728934 tempest-ServerActionsTestOtherB-299728934-project-member] Lock "83d225e0-e39e-4500-b7ae-52dfbd8b8588" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.056s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:30:38 user nova-compute[75045]: INFO nova.compute.manager [None req-f2488133-34ed-4c2c-acc5-4f1cd5d78b3d tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] [instance: 438082fc-a83f-4305-ada6-41a8e1d645a8] Rescuing
Nov 08 23:30:38 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-f2488133-34ed-4c2c-acc5-4f1cd5d78b3d tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Acquiring lock "refresh_cache-438082fc-a83f-4305-ada6-41a8e1d645a8" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 23:30:38 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-f2488133-34ed-4c2c-acc5-4f1cd5d78b3d tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Acquired lock "refresh_cache-438082fc-a83f-4305-ada6-41a8e1d645a8" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 23:30:38 user nova-compute[75045]: DEBUG nova.network.neutron [None req-f2488133-34ed-4c2c-acc5-4f1cd5d78b3d tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] [instance: 438082fc-a83f-4305-ada6-41a8e1d645a8] Building network info cache for instance {{(pid=75045) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 23:30:38 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-66ebab8b-71c6-4e39-8af3-cc6a34e3680e tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.587s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 23:30:38 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-66ebab8b-71c6-4e39-8af3-cc6a34e3680e tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] <== connect_volume: return (1589ms) {'type': 'block', 'scsi_wwn': '23863613437366431', 'path': '/dev/sdc'} {{(pid=75045) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 23:30:38 user nova-compute[75045]: DEBUG nova.virt.libvirt.volume.iscsi [None req-66ebab8b-71c6-4e39-8af3-cc6a34e3680e tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] [instance: 1a3c21c4-2db3-44e1-8a23-336ca9f8374d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23863613437366431', 'path': '/dev/sdc'} {{(pid=75045) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 23:30:38 user nova-compute[75045]: DEBUG nova.objects.instance [None req-66ebab8b-71c6-4e39-8af3-cc6a34e3680e tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Lazy-loading 'flavor' on Instance uuid 1a3c21c4-2db3-44e1-8a23-336ca9f8374d {{(pid=75045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 23:30:38 user nova-compute[75045]: DEBUG nova.virt.libvirt.guest [None req-66ebab8b-71c6-4e39-8af3-cc6a34e3680e tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] attach device xml: <disk type="block" device="disk">
Nov 08 23:30:38 user nova-compute[75045]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 23:30:38 user nova-compute[75045]:   <source dev="/dev/sdc"/>
Nov 08 23:30:38 user nova-compute[75045]:   <target dev="vdb" bus="virtio"/>
Nov 08 23:30:38 user nova-compute[75045]:   <serial>fa72cf0a-1134-47a3-abd2-6a51f4f20393</serial>
Nov 08 23:30:38 user nova-compute[75045]: </disk>
Nov 08 23:30:38 user nova-compute[75045]:  {{(pid=75045) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 08 23:30:39 user nova-compute[75045]: DEBUG nova.network.neutron [None req-f2488133-34ed-4c2c-acc5-4f1cd5d78b3d tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] [instance: 438082fc-a83f-4305-ada6-41a8e1d645a8] Updating instance_info_cache with network_info: [{"id": "669f0f7f-7c58-42b9-948b-ad3704fb1ab3", "address": "fa:16:3e:57:c2:f9", "network": {"id": "d4cd6998-66d1-4389-bc82-dd000c8962de", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-323966879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bfb6963a6c145d4a7b7e47c8fde7e60", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap669f0f7f-7c", "ovs_interfaceid": "669f0f7f-7c58-42b9-948b-ad3704fb1ab3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75045) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 23:30:39 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-f2488133-34ed-4c2c-acc5-4f1cd5d78b3d tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Releasing lock "refresh_cache-438082fc-a83f-4305-ada6-41a8e1d645a8" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 23:30:39 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:30:39 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:30:39 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-66ebab8b-71c6-4e39-8af3-cc6a34e3680e tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] No BDM found with device name vda, not building metadata. {{(pid=75045) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 23:30:39 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-66ebab8b-71c6-4e39-8af3-cc6a34e3680e tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75045) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 23:30:39 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-66ebab8b-71c6-4e39-8af3-cc6a34e3680e tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] No VIF found with MAC fa:16:3e:57:5d:d2, not building metadata {{(pid=75045) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 23:30:39 user nova-compute[75045]: DEBUG nova.compute.manager [req-8aa23f92-cf5b-447e-8faa-276e466331a8 req-3a973556-33bc-43a7-b468-ea3fc761eaf2 service nova] [instance: 438082fc-a83f-4305-ada6-41a8e1d645a8] Received event network-vif-unplugged-669f0f7f-7c58-42b9-948b-ad3704fb1ab3 {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:30:39 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-8aa23f92-cf5b-447e-8faa-276e466331a8 req-3a973556-33bc-43a7-b468-ea3fc761eaf2 service nova] Acquiring lock "438082fc-a83f-4305-ada6-41a8e1d645a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:30:39 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-8aa23f92-cf5b-447e-8faa-276e466331a8 req-3a973556-33bc-43a7-b468-ea3fc761eaf2 service nova] Lock "438082fc-a83f-4305-ada6-41a8e1d645a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:30:39 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-8aa23f92-cf5b-447e-8faa-276e466331a8 req-3a973556-33bc-43a7-b468-ea3fc761eaf2 service nova] Lock "438082fc-a83f-4305-ada6-41a8e1d645a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:30:39 user nova-compute[75045]: DEBUG nova.compute.manager [req-8aa23f92-cf5b-447e-8faa-276e466331a8 req-3a973556-33bc-43a7-b468-ea3fc761eaf2 service nova] [instance: 438082fc-a83f-4305-ada6-41a8e1d645a8] No waiting events found dispatching network-vif-unplugged-669f0f7f-7c58-42b9-948b-ad3704fb1ab3 {{(pid=75045) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 23:30:39 user nova-compute[75045]: WARNING nova.compute.manager [req-8aa23f92-cf5b-447e-8faa-276e466331a8 req-3a973556-33bc-43a7-b468-ea3fc761eaf2 service nova] [instance: 438082fc-a83f-4305-ada6-41a8e1d645a8] Received unexpected event network-vif-unplugged-669f0f7f-7c58-42b9-948b-ad3704fb1ab3 for instance with vm_state active and task_state rescuing.
Nov 08 23:30:39 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-66ebab8b-71c6-4e39-8af3-cc6a34e3680e tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Lock "1a3c21c4-2db3-44e1-8a23-336ca9f8374d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 27.271s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:30:39 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:30:39 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:30:39 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:30:40 user nova-compute[75045]: INFO nova.virt.libvirt.driver [-] [instance: 438082fc-a83f-4305-ada6-41a8e1d645a8] Instance destroyed successfully.
Nov 08 23:30:40 user nova-compute[75045]: INFO nova.virt.libvirt.driver [None req-f2488133-34ed-4c2c-acc5-4f1cd5d78b3d tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] [instance: 438082fc-a83f-4305-ada6-41a8e1d645a8] Attempting a stable device rescue
Nov 08 23:30:40 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:30:40 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-f2488133-34ed-4c2c-acc5-4f1cd5d78b3d tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75045) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 08 23:30:40 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-f2488133-34ed-4c2c-acc5-4f1cd5d78b3d tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] [instance: 438082fc-a83f-4305-ada6-41a8e1d645a8] Instance directory exists: not creating {{(pid=75045) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 08 23:30:40 user nova-compute[75045]: INFO nova.virt.libvirt.driver [None req-f2488133-34ed-4c2c-acc5-4f1cd5d78b3d tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] [instance: 438082fc-a83f-4305-ada6-41a8e1d645a8] Creating image(s)
Nov 08 23:30:40 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-f2488133-34ed-4c2c-acc5-4f1cd5d78b3d tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Acquiring lock "/opt/stack/data/nova/instances/438082fc-a83f-4305-ada6-41a8e1d645a8/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:30:40 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-f2488133-34ed-4c2c-acc5-4f1cd5d78b3d tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Lock "/opt/stack/data/nova/instances/438082fc-a83f-4305-ada6-41a8e1d645a8/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:30:40 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-f2488133-34ed-4c2c-acc5-4f1cd5d78b3d tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Lock "/opt/stack/data/nova/instances/438082fc-a83f-4305-ada6-41a8e1d645a8/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.021s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:30:40 user nova-compute[75045]: DEBUG nova.objects.instance [None req-f2488133-34ed-4c2c-acc5-4f1cd5d78b3d tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Lazy-loading 'trusted_certs' on Instance uuid 438082fc-a83f-4305-ada6-41a8e1d645a8 {{(pid=75045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 23:30:40 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-f2488133-34ed-4c2c-acc5-4f1cd5d78b3d tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Acquiring lock "68dfa7529f9097fc2d70f3a52153af3b645d08d0" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:30:40 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-f2488133-34ed-4c2c-acc5-4f1cd5d78b3d tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Lock "68dfa7529f9097fc2d70f3a52153af3b645d08d0" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:30:41 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-f2488133-34ed-4c2c-acc5-4f1cd5d78b3d tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/68dfa7529f9097fc2d70f3a52153af3b645d08d0.part --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:30:41 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:30:41 user nova-compute[75045]: DEBUG nova.compute.manager [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75045) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 23:30:41 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-39de6ea0-f4fc-4a63-aa48-408c72bb5b54 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Acquiring lock "1a3c21c4-2db3-44e1-8a23-336ca9f8374d" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:30:41 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-39de6ea0-f4fc-4a63-aa48-408c72bb5b54 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Lock "1a3c21c4-2db3-44e1-8a23-336ca9f8374d" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:30:41 user nova-compute[75045]: INFO nova.compute.manager [None req-39de6ea0-f4fc-4a63-aa48-408c72bb5b54 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] [instance: 1a3c21c4-2db3-44e1-8a23-336ca9f8374d] Detaching volume fa72cf0a-1134-47a3-abd2-6a51f4f20393
Nov 08 23:30:41 user nova-compute[75045]: INFO nova.virt.block_device [None req-39de6ea0-f4fc-4a63-aa48-408c72bb5b54 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] [instance: 1a3c21c4-2db3-44e1-8a23-336ca9f8374d] Attempting to driver detach volume fa72cf0a-1134-47a3-abd2-6a51f4f20393 from mountpoint /dev/vdb
Nov 08 23:30:41 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-f2488133-34ed-4c2c-acc5-4f1cd5d78b3d tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/68dfa7529f9097fc2d70f3a52153af3b645d08d0.part --force-share --output=json" returned: 0 in 0.188s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:30:41 user nova-compute[75045]: DEBUG nova.virt.images [None req-f2488133-34ed-4c2c-acc5-4f1cd5d78b3d tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] a550b846-a450-4375-80ee-5caed1267aa4 was qcow2, converting to raw {{(pid=75045) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 08 23:30:41 user nova-compute[75045]: DEBUG nova.privsep.utils [None req-f2488133-34ed-4c2c-acc5-4f1cd5d78b3d tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75045) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 08 23:30:41 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-f2488133-34ed-4c2c-acc5-4f1cd5d78b3d tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/68dfa7529f9097fc2d70f3a52153af3b645d08d0.part /opt/stack/data/nova/instances/_base/68dfa7529f9097fc2d70f3a52153af3b645d08d0.converted {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:30:41 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-39de6ea0-f4fc-4a63-aa48-408c72bb5b54 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Attempting to detach device vdb from instance 1a3c21c4-2db3-44e1-8a23-336ca9f8374d from the persistent domain config. {{(pid=75045) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 08 23:30:41 user nova-compute[75045]: DEBUG nova.virt.libvirt.guest [None req-39de6ea0-f4fc-4a63-aa48-408c72bb5b54 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 23:30:41 user nova-compute[75045]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 23:30:41 user nova-compute[75045]:   <source dev="/dev/sdc"/>
Nov 08 23:30:41 user nova-compute[75045]:   <target dev="vdb" bus="virtio"/>
Nov 08 23:30:41 user nova-compute[75045]:   <serial>fa72cf0a-1134-47a3-abd2-6a51f4f20393</serial>
Nov 08 23:30:41 user nova-compute[75045]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 08 23:30:41 user nova-compute[75045]: </disk>
Nov 08 23:30:41 user nova-compute[75045]:  {{(pid=75045) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 23:30:41 user nova-compute[75045]: INFO nova.virt.libvirt.driver [None req-39de6ea0-f4fc-4a63-aa48-408c72bb5b54 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Successfully detached device vdb from instance 1a3c21c4-2db3-44e1-8a23-336ca9f8374d from the persistent domain config.
Nov 08 23:30:41 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-39de6ea0-f4fc-4a63-aa48-408c72bb5b54 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 1a3c21c4-2db3-44e1-8a23-336ca9f8374d from the live domain config. {{(pid=75045) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 08 23:30:41 user nova-compute[75045]: DEBUG nova.virt.libvirt.guest [None req-39de6ea0-f4fc-4a63-aa48-408c72bb5b54 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 23:30:41 user nova-compute[75045]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 23:30:41 user nova-compute[75045]:   <source dev="/dev/sdc"/>
Nov 08 23:30:41 user nova-compute[75045]:   <target dev="vdb" bus="virtio"/>
Nov 08 23:30:41 user nova-compute[75045]:   <serial>fa72cf0a-1134-47a3-abd2-6a51f4f20393</serial>
Nov 08 23:30:41 user nova-compute[75045]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 08 23:30:41 user nova-compute[75045]: </disk>
Nov 08 23:30:41 user nova-compute[75045]:  {{(pid=75045) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 23:30:41 user nova-compute[75045]: DEBUG nova.compute.manager [req-584a723c-0dc9-484d-892c-42afdfc7abd5 req-b73051bc-879c-482b-979e-25241fc61508 service nova] [instance: 438082fc-a83f-4305-ada6-41a8e1d645a8] Received event network-vif-plugged-669f0f7f-7c58-42b9-948b-ad3704fb1ab3 {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:30:41 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-584a723c-0dc9-484d-892c-42afdfc7abd5 req-b73051bc-879c-482b-979e-25241fc61508 service nova] Acquiring lock "438082fc-a83f-4305-ada6-41a8e1d645a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:30:41 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-584a723c-0dc9-484d-892c-42afdfc7abd5 req-b73051bc-879c-482b-979e-25241fc61508 service nova] Lock "438082fc-a83f-4305-ada6-41a8e1d645a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:30:41 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-584a723c-0dc9-484d-892c-42afdfc7abd5 req-b73051bc-879c-482b-979e-25241fc61508 service nova] Lock "438082fc-a83f-4305-ada6-41a8e1d645a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:30:41 user nova-compute[75045]: DEBUG nova.compute.manager [req-584a723c-0dc9-484d-892c-42afdfc7abd5 req-b73051bc-879c-482b-979e-25241fc61508 service nova] [instance: 438082fc-a83f-4305-ada6-41a8e1d645a8] No waiting events found dispatching network-vif-plugged-669f0f7f-7c58-42b9-948b-ad3704fb1ab3 {{(pid=75045) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 23:30:41 user nova-compute[75045]: WARNING nova.compute.manager [req-584a723c-0dc9-484d-892c-42afdfc7abd5 req-b73051bc-879c-482b-979e-25241fc61508 service nova] [instance: 438082fc-a83f-4305-ada6-41a8e1d645a8] Received unexpected event network-vif-plugged-669f0f7f-7c58-42b9-948b-ad3704fb1ab3 for instance with vm_state active and task_state rescuing.
Nov 08 23:30:42 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-f2488133-34ed-4c2c-acc5-4f1cd5d78b3d tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/68dfa7529f9097fc2d70f3a52153af3b645d08d0.part /opt/stack/data/nova/instances/_base/68dfa7529f9097fc2d70f3a52153af3b645d08d0.converted" returned: 0 in 0.548s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:30:42 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-f2488133-34ed-4c2c-acc5-4f1cd5d78b3d tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/68dfa7529f9097fc2d70f3a52153af3b645d08d0.converted --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:30:42 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-39de6ea0-f4fc-4a63-aa48-408c72bb5b54 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 1a3c21c4-2db3-44e1-8a23-336ca9f8374d {{(pid=75045) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 08 23:30:42 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-f2488133-34ed-4c2c-acc5-4f1cd5d78b3d tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/68dfa7529f9097fc2d70f3a52153af3b645d08d0.converted --force-share --output=json" returned: 0 in 0.223s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:30:42 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-f2488133-34ed-4c2c-acc5-4f1cd5d78b3d tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Lock "68dfa7529f9097fc2d70f3a52153af3b645d08d0" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.123s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:30:42 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-f2488133-34ed-4c2c-acc5-4f1cd5d78b3d tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Acquiring lock "68dfa7529f9097fc2d70f3a52153af3b645d08d0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:30:42 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-f2488133-34ed-4c2c-acc5-4f1cd5d78b3d tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Lock "68dfa7529f9097fc2d70f3a52153af3b645d08d0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:30:42 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-f2488133-34ed-4c2c-acc5-4f1cd5d78b3d tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/68dfa7529f9097fc2d70f3a52153af3b645d08d0 --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:30:42 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-f2488133-34ed-4c2c-acc5-4f1cd5d78b3d tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/68dfa7529f9097fc2d70f3a52153af3b645d08d0 --force-share --output=json" returned: 0 in 0.185s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:30:42 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-f2488133-34ed-4c2c-acc5-4f1cd5d78b3d tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/68dfa7529f9097fc2d70f3a52153af3b645d08d0,backing_fmt=raw /opt/stack/data/nova/instances/438082fc-a83f-4305-ada6-41a8e1d645a8/disk.rescue {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:30:42 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-f2488133-34ed-4c2c-acc5-4f1cd5d78b3d tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/68dfa7529f9097fc2d70f3a52153af3b645d08d0,backing_fmt=raw /opt/stack/data/nova/instances/438082fc-a83f-4305-ada6-41a8e1d645a8/disk.rescue" returned: 0 in 0.066s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:30:42 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-f2488133-34ed-4c2c-acc5-4f1cd5d78b3d tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Lock "68dfa7529f9097fc2d70f3a52153af3b645d08d0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.263s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:30:42 user nova-compute[75045]: DEBUG nova.objects.instance [None req-f2488133-34ed-4c2c-acc5-4f1cd5d78b3d tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Lazy-loading 'migration_context' on Instance uuid 438082fc-a83f-4305-ada6-41a8e1d645a8 {{(pid=75045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 23:30:42 user nova-compute[75045]: DEBUG nova.objects.base [None req-f2488133-34ed-4c2c-acc5-4f1cd5d78b3d tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Object Instance<438082fc-a83f-4305-ada6-41a8e1d645a8> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75045) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 23:30:42 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-f2488133-34ed-4c2c-acc5-4f1cd5d78b3d tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] [instance: 438082fc-a83f-4305-ada6-41a8e1d645a8] Created local disks {{(pid=75045) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 23:30:42 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-f2488133-34ed-4c2c-acc5-4f1cd5d78b3d tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] [instance: 438082fc-a83f-4305-ada6-41a8e1d645a8] Start _get_guest_xml network_info=[{"id": "669f0f7f-7c58-42b9-948b-ad3704fb1ab3", "address": "fa:16:3e:57:c2:f9", "network": {"id": "d4cd6998-66d1-4389-bc82-dd000c8962de", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-323966879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-323966879-network", "vif_mac": "fa:16:3e:57:c2:f9"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bfb6963a6c145d4a7b7e47c8fde7e60", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap669f0f7f-7c", "ovs_interfaceid": "669f0f7f-7c58-42b9-948b-ad3704fb1ab3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T23:11:54Z,direct_url=<?>,disk_format='qcow2',id=a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b1beba2cc4e7465ea249e2225fb494dc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T23:11:56Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'a550b846-a450-4375-80ee-5caed1267aa4', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'device_type': 'disk', 'attachment_id': 'd0f2e4d2-44f8-466b-b6a1-9be7c176e2df', 'guest_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:83187c89-e833-4efd-afa0-2cbfe05d8db1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gzFECVaq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, 'status': 'reserved', 'instance': '438082fc-a83f-4305-ada6-41a8e1d645a8', 'attached_at': '', 'detached_at': '', 'volume_id': '83187c89-e833-4efd-afa0-2cbfe05d8db1', 'serial': '83187c89-e833-4efd-afa0-2cbfe05d8db1'}, 'volume_type': None} {{(pid=75045) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 23:30:42 user nova-compute[75045]: DEBUG nova.objects.instance [None req-f2488133-34ed-4c2c-acc5-4f1cd5d78b3d tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Lazy-loading 'resources' on Instance uuid 438082fc-a83f-4305-ada6-41a8e1d645a8 {{(pid=75045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 23:30:42 user nova-compute[75045]: DEBUG nova.objects.base [None req-f2488133-34ed-4c2c-acc5-4f1cd5d78b3d tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Object Instance<438082fc-a83f-4305-ada6-41a8e1d645a8> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75045) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 23:30:42 user nova-compute[75045]: DEBUG nova.objects.instance [None req-f2488133-34ed-4c2c-acc5-4f1cd5d78b3d tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Lazy-loading 'numa_topology' on Instance uuid 438082fc-a83f-4305-ada6-41a8e1d645a8 {{(pid=75045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 23:30:42 user nova-compute[75045]: DEBUG nova.objects.base [None req-f2488133-34ed-4c2c-acc5-4f1cd5d78b3d tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Object Instance<438082fc-a83f-4305-ada6-41a8e1d645a8> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75045) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 23:30:42 user nova-compute[75045]: WARNING nova.virt.libvirt.driver [None req-f2488133-34ed-4c2c-acc5-4f1cd5d78b3d tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 23:30:42 user nova-compute[75045]: WARNING nova.virt.libvirt.driver [None req-f2488133-34ed-4c2c-acc5-4f1cd5d78b3d tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 23:30:42 user nova-compute[75045]: DEBUG nova.compute.manager [req-fdf4f679-3821-48c1-a20b-344e7c80d98c req-2271f4e7-f2e0-4907-a03e-2c1810174b45 service nova] [instance: 0f21fcd3-ac5f-499e-9c34-82af806fda1d] Received event network-changed-ab02704d-73c2-409c-9d43-1a087ebf369a {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:30:42 user nova-compute[75045]: DEBUG nova.compute.manager [req-fdf4f679-3821-48c1-a20b-344e7c80d98c req-2271f4e7-f2e0-4907-a03e-2c1810174b45 service nova] [instance: 0f21fcd3-ac5f-499e-9c34-82af806fda1d] Refreshing instance network info cache due to event network-changed-ab02704d-73c2-409c-9d43-1a087ebf369a. {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 23:30:42 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-fdf4f679-3821-48c1-a20b-344e7c80d98c req-2271f4e7-f2e0-4907-a03e-2c1810174b45 service nova] Acquiring lock "refresh_cache-0f21fcd3-ac5f-499e-9c34-82af806fda1d" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 23:30:42 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-fdf4f679-3821-48c1-a20b-344e7c80d98c req-2271f4e7-f2e0-4907-a03e-2c1810174b45 service nova] Acquired lock "refresh_cache-0f21fcd3-ac5f-499e-9c34-82af806fda1d" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 23:30:42 user nova-compute[75045]: DEBUG nova.network.neutron [req-fdf4f679-3821-48c1-a20b-344e7c80d98c req-2271f4e7-f2e0-4907-a03e-2c1810174b45 service nova] [instance: 0f21fcd3-ac5f-499e-9c34-82af806fda1d] Refreshing network info cache for port ab02704d-73c2-409c-9d43-1a087ebf369a {{(pid=75045) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 23:30:42 user nova-compute[75045]: DEBUG nova.virt.libvirt.host [None req-f2488133-34ed-4c2c-acc5-4f1cd5d78b3d tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75045) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 23:30:42 user nova-compute[75045]: DEBUG nova.virt.libvirt.host [None req-f2488133-34ed-4c2c-acc5-4f1cd5d78b3d tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] CPU controller missing on host. {{(pid=75045) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 23:30:42 user nova-compute[75045]: DEBUG nova.virt.libvirt.host [None req-f2488133-34ed-4c2c-acc5-4f1cd5d78b3d tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75045) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 23:30:42 user nova-compute[75045]: DEBUG nova.virt.libvirt.host [None req-f2488133-34ed-4c2c-acc5-4f1cd5d78b3d tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] CPU controller found on host. {{(pid=75045) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 23:30:42 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-f2488133-34ed-4c2c-acc5-4f1cd5d78b3d tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75045) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 23:30:42 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-f2488133-34ed-4c2c-acc5-4f1cd5d78b3d tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T23:11:41Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T23:11:54Z,direct_url=<?>,disk_format='qcow2',id=a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b1beba2cc4e7465ea249e2225fb494dc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T23:11:56Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75045) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 23:30:42 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-f2488133-34ed-4c2c-acc5-4f1cd5d78b3d tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Flavor limits 0:0:0 {{(pid=75045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 23:30:42 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-f2488133-34ed-4c2c-acc5-4f1cd5d78b3d tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Image limits 0:0:0 {{(pid=75045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 23:30:42 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-f2488133-34ed-4c2c-acc5-4f1cd5d78b3d tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Flavor pref 0:0:0 {{(pid=75045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 23:30:42 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-f2488133-34ed-4c2c-acc5-4f1cd5d78b3d tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Image pref 0:0:0 {{(pid=75045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 23:30:42 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-f2488133-34ed-4c2c-acc5-4f1cd5d78b3d tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 23:30:42 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-f2488133-34ed-4c2c-acc5-4f1cd5d78b3d tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75045) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 23:30:42 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-f2488133-34ed-4c2c-acc5-4f1cd5d78b3d tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75045) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 23:30:42 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-f2488133-34ed-4c2c-acc5-4f1cd5d78b3d tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Got 1 possible topologies {{(pid=75045) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 23:30:42 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-f2488133-34ed-4c2c-acc5-4f1cd5d78b3d tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75045) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 23:30:42 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-f2488133-34ed-4c2c-acc5-4f1cd5d78b3d tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75045) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 23:30:42 user nova-compute[75045]: DEBUG nova.objects.instance [None req-f2488133-34ed-4c2c-acc5-4f1cd5d78b3d tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Lazy-loading 'vcpu_model' on Instance uuid 438082fc-a83f-4305-ada6-41a8e1d645a8 {{(pid=75045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 23:30:42 user nova-compute[75045]: DEBUG nova.objects.base [None req-f2488133-34ed-4c2c-acc5-4f1cd5d78b3d tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Object Instance<438082fc-a83f-4305-ada6-41a8e1d645a8> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75045) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 23:30:42 user nova-compute[75045]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f2488133-34ed-4c2c-acc5-4f1cd5d78b3d tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] [instance: 438082fc-a83f-4305-ada6-41a8e1d645a8] Calling os-brick to attach iSCSI Volume {{(pid=75045) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 23:30:42 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2488133-34ed-4c2c-acc5-4f1cd5d78b3d tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1b68210460>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:83187c89-e833-4efd-afa0-2cbfe05d8db1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gzFECVaq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75045) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 23:30:42 user nova-compute[75045]: WARNING os_brick.initiator.connectors.base [None req-f2488133-34ed-4c2c-acc5-4f1cd5d78b3d tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 23:30:42 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-f2488133-34ed-4c2c-acc5-4f1cd5d78b3d tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 23:30:42 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-f2488133-34ed-4c2c-acc5-4f1cd5d78b3d tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.004s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 23:30:42 user nova-compute[75045]: WARNING os_brick.initiator.connectors.base [None req-f2488133-34ed-4c2c-acc5-4f1cd5d78b3d tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 23:30:42 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-f2488133-34ed-4c2c-acc5-4f1cd5d78b3d tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:83187c89-e833-4efd-afa0-2cbfe05d8db1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 23:30:42 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-f2488133-34ed-4c2c-acc5-4f1cd5d78b3d tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:83187c89-e833-4efd-afa0-2cbfe05d8db1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 23:30:42 user nova-compute[75045]: INFO os_brick.initiator.connectors.iscsi [None req-f2488133-34ed-4c2c-acc5-4f1cd5d78b3d tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 23:30:42 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83187c89-e833-4efd-afa0-2cbfe05d8db1 -p 172.16.0.220:3260 {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:30:42 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83187c89-e833-4efd-afa0-2cbfe05d8db1 -p 172.16.0.220:3260" returned: 0 in 0.021s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:30:42 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a6d9d06-726e-49c5-8316-5a64524997f2]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:83187c89-e833-4efd-afa0-2cbfe05d8db1\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = gzFECVaq\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:30:42 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2488133-34ed-4c2c-acc5-4f1cd5d78b3d tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Nov 08 23:30:42 user nova-compute[75045]: node.name = iqn.2010-10.org.openstack:83187c89-e833-4efd-afa0-2cbfe05d8db1
Nov 08 23:30:42 user nova-compute[75045]: node.tpgt = -1
Nov 08 23:30:42 user nova-compute[75045]: node.startup = automatic
Nov 08 23:30:42 user nova-compute[75045]: node.leading_login = No
Nov 08 23:30:42 user nova-compute[75045]: iface.iscsi_ifacename = default
Nov 08 23:30:42 user nova-compute[75045]: iface.net_ifacename = <empty>
Nov 08 23:30:42 user nova-compute[75045]: iface.ipaddress = <empty>
Nov 08 23:30:42 user nova-compute[75045]: iface.prefix_len = 0
Nov 08 23:30:42 user nova-compute[75045]: iface.hwaddress = <empty>
Nov 08 23:30:42 user nova-compute[75045]: iface.transport_name = tcp
Nov 08 23:30:42 user nova-compute[75045]: iface.initiatorname = <empty>
Nov 08 23:30:42 user nova-compute[75045]: iface.state = <empty>
Nov 08 23:30:42 user nova-compute[75045]: iface.vlan_id = 0
Nov 08 23:30:42 user nova-compute[75045]: iface.vlan_priority = 0
Nov 08 23:30:42 user nova-compute[75045]: iface.vlan_state = <empty>
Nov 08 23:30:42 user nova-compute[75045]: iface.iface_num = 0
Nov 08 23:30:42 user nova-compute[75045]: iface.mtu = 0
Nov 08 23:30:42 user nova-compute[75045]: iface.port = 0
Nov 08 23:30:42 user nova-compute[75045]: iface.bootproto = <empty>
Nov 08 23:30:42 user nova-compute[75045]: iface.subnet_mask = <empty>
Nov 08 23:30:42 user nova-compute[75045]: iface.gateway = <empty>
Nov 08 23:30:42 user nova-compute[75045]: iface.dhcp_alt_client_id_state = <empty>
Nov 08 23:30:42 user nova-compute[75045]: iface.dhcp_alt_client_id = <empty>
Nov 08 23:30:42 user nova-compute[75045]: iface.dhcp_dns = <empty>
Nov 08 23:30:42 user nova-compute[75045]: iface.dhcp_learn_iqn = <empty>
Nov 08 23:30:42 user nova-compute[75045]: iface.dhcp_req_vendor_id_state = <empty>
Nov 08 23:30:42 user nova-compute[75045]: iface.dhcp_vendor_id_state = <empty>
Nov 08 23:30:42 user nova-compute[75045]: iface.dhcp_vendor_id = <empty>
Nov 08 23:30:42 user nova-compute[75045]: iface.dhcp_slp_da = <empty>
Nov 08 23:30:42 user nova-compute[75045]: iface.fragmentation = <empty>
Nov 08 23:30:42 user nova-compute[75045]: iface.gratuitous_arp = <empty>
Nov 08 23:30:42 user nova-compute[75045]: iface.incoming_forwarding = <empty>
Nov 08 23:30:42 user nova-compute[75045]: iface.tos_state = <empty>
Nov 08 23:30:42 user nova-compute[75045]: iface.tos = 0
Nov 08 23:30:42 user nova-compute[75045]: iface.ttl = 0
Nov 08 23:30:42 user nova-compute[75045]: iface.delayed_ack = <empty>
Nov 08 23:30:42 user nova-compute[75045]: iface.tcp_nagle = <empty>
Nov 08 23:30:42 user nova-compute[75045]: iface.tcp_wsf_state = <empty>
Nov 08 23:30:42 user nova-compute[75045]: iface.tcp_wsf = 0
Nov 08 23:30:42 user nova-compute[75045]: iface.tcp_timer_scale = 0
Nov 08 23:30:42 user nova-compute[75045]: iface.tcp_timestamp = <empty>
Nov 08 23:30:42 user nova-compute[75045]: iface.redirect = <empty>
Nov 08 23:30:42 user nova-compute[75045]: iface.def_task_mgmt_timeout = 0
Nov 08 23:30:42 user nova-compute[75045]: iface.header_digest = <empty>
Nov 08 23:30:42 user nova-compute[75045]: iface.data_digest = <empty>
Nov 08 23:30:42 user nova-compute[75045]: iface.immediate_data = <empty>
Nov 08 23:30:42 user nova-compute[75045]: iface.initial_r2t = <empty>
Nov 08 23:30:42 user nova-compute[75045]: iface.data_seq_inorder = <empty>
Nov 08 23:30:42 user nova-compute[75045]: iface.data_pdu_inorder = <empty>
Nov 08 23:30:42 user nova-compute[75045]: iface.erl = 0
Nov 08 23:30:42 user nova-compute[75045]: iface.max_receive_data_len = 0
Nov 08 23:30:42 user nova-compute[75045]: iface.first_burst_len = 0
Nov 08 23:30:42 user nova-compute[75045]: iface.max_outstanding_r2t = 0
Nov 08 23:30:42 user nova-compute[75045]: iface.max_burst_len = 0
Nov 08 23:30:42 user nova-compute[75045]: iface.chap_auth = <empty>
Nov 08 23:30:42 user nova-compute[75045]: iface.bidi_chap = <empty>
Nov 08 23:30:42 user nova-compute[75045]: iface.strict_login_compliance = <empty>
Nov 08 23:30:42 user nova-compute[75045]: iface.discovery_auth = <empty>
Nov 08 23:30:42 user nova-compute[75045]: iface.discovery_logout = <empty>
Nov 08 23:30:42 user nova-compute[75045]: node.discovery_address = <empty>
Nov 08 23:30:42 user nova-compute[75045]: node.discovery_port = 0
Nov 08 23:30:42 user nova-compute[75045]: node.discovery_type = static
Nov 08 23:30:42 user nova-compute[75045]: node.session.initial_cmdsn = 0
Nov 08 23:30:42 user nova-compute[75045]: node.session.initial_login_retry_max = 8
Nov 08 23:30:42 user nova-compute[75045]: node.session.xmit_thread_priority = -20
Nov 08 23:30:42 user nova-compute[75045]: node.session.cmds_max = 128
Nov 08 23:30:42 user nova-compute[75045]: node.session.queue_depth = 32
Nov 08 23:30:42 user nova-compute[75045]: node.session.nr_sessions = 1
Nov 08 23:30:42 user nova-compute[75045]: node.session.auth.authmethod = CHAP
Nov 08 23:30:42 user nova-compute[75045]: node.session.auth.username = gzFECVaq
Nov 08 23:30:42 user nova-compute[75045]: node.session.auth.password = ***
Nov 08 23:30:42 user nova-compute[75045]: node.session.auth.username_in = <empty>
Nov 08 23:30:42 user nova-compute[75045]: node.session.auth.password_in = <empty>
Nov 08 23:30:42 user nova-compute[75045]: node.session.auth.chap_algs = MD5
Nov 08 23:30:42 user nova-compute[75045]: node.session.timeo.replacement_timeout = 120
Nov 08 23:30:42 user nova-compute[75045]: node.session.err_timeo.abort_timeout = 15
Nov 08 23:30:42 user nova-compute[75045]: node.session.err_timeo.lu_reset_timeout = 30
Nov 08 23:30:42 user nova-compute[75045]: node.session.err_timeo.tgt_reset_timeout = 30
Nov 08 23:30:42 user nova-compute[75045]: node.session.err_timeo.host_reset_timeout = 60
Nov 08 23:30:42 user nova-compute[75045]: node.session.iscsi.FastAbort = Yes
Nov 08 23:30:42 user nova-compute[75045]: node.session.iscsi.InitialR2T = No
Nov 08 23:30:42 user nova-compute[75045]: node.session.iscsi.ImmediateData = Yes
Nov 08 23:30:42 user nova-compute[75045]: node.session.iscsi.FirstBurstLength = 262144
Nov 08 23:30:42 user nova-compute[75045]: node.session.iscsi.MaxBurstLength = 16776192
Nov 08 23:30:42 user nova-compute[75045]: node.session.iscsi.DefaultTime2Retain = 0
Nov 08 23:30:42 user nova-compute[75045]: node.session.iscsi.DefaultTime2Wait = 2
Nov 08 23:30:42 user nova-compute[75045]: node.session.iscsi.MaxConnections = 1
Nov 08 23:30:42 user nova-compute[75045]: node.session.iscsi.MaxOutstandingR2T = 1
Nov 08 23:30:42 user nova-compute[75045]: node.session.iscsi.ERL = 0
Nov 08 23:30:42 user nova-compute[75045]: node.session.scan = manual
Nov 08 23:30:42 user nova-compute[75045]: node.session.reopen_max = 0
Nov 08 23:30:42 user nova-compute[75045]: node.conn[0].address = 172.16.0.220
Nov 08 23:30:42 user nova-compute[75045]: node.conn[0].port = 3260
Nov 08 23:30:42 user nova-compute[75045]: node.conn[0].startup = manual
Nov 08 23:30:42 user nova-compute[75045]: node.conn[0].tcp.window_size = 524288
Nov 08 23:30:42 user nova-compute[75045]: node.conn[0].tcp.type_of_service = 0
Nov 08 23:30:42 user nova-compute[75045]: node.conn[0].timeo.logout_timeout = 15
Nov 08 23:30:42 user nova-compute[75045]: node.conn[0].timeo.login_timeout = 15
Nov 08 23:30:42 user nova-compute[75045]: node.conn[0].timeo.auth_timeout = 45
Nov 08 23:30:42 user nova-compute[75045]: node.conn[0].timeo.noop_out_interval = 5
Nov 08 23:30:42 user nova-compute[75045]: node.conn[0].timeo.noop_out_timeout = 5
Nov 08 23:30:42 user nova-compute[75045]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Nov 08 23:30:42 user nova-compute[75045]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Nov 08 23:30:42 user nova-compute[75045]: node.conn[0].iscsi.HeaderDigest = None
Nov 08 23:30:42 user nova-compute[75045]: node.conn[0].iscsi.DataDigest = None
Nov 08 23:30:42 user nova-compute[75045]: node.conn[0].iscsi.IFMarker = No
Nov 08 23:30:42 user nova-compute[75045]: node.conn[0].iscsi.OFMarker = No
Nov 08 23:30:42 user nova-compute[75045]: # END RECORD
Nov 08 23:30:42 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:30:42 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83187c89-e833-4efd-afa0-2cbfe05d8db1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:30:42 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83187c89-e833-4efd-afa0-2cbfe05d8db1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:30:42 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[19bb164f-796d-45e7-82e0-0a3029bcb71d]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:30:42 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2488133-34ed-4c2c-acc5-4f1cd5d78b3d tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:30:42 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83187c89-e833-4efd-afa0-2cbfe05d8db1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:30:42 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83187c89-e833-4efd-afa0-2cbfe05d8db1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:30:42 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[bca59d54-0877-463a-8b30-5296d6797e9a]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:30:42 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2488133-34ed-4c2c-acc5-4f1cd5d78b3d tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:30:42 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83187c89-e833-4efd-afa0-2cbfe05d8db1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gzFECVaq {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:30:42 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83187c89-e833-4efd-afa0-2cbfe05d8db1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gzFECVaq" returned: 0 in 0.021s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:30:42 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb4330df-0a7c-4076-b281-e7b912f098ee]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:30:42 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2488133-34ed-4c2c-acc5-4f1cd5d78b3d tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'gzFECVaq'): stdout= stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:30:42 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83187c89-e833-4efd-afa0-2cbfe05d8db1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:30:42 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83187c89-e833-4efd-afa0-2cbfe05d8db1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.029s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:30:42 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6448743-911a-4e92-adb2-0b0efc9b1a16]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:30:42 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2488133-34ed-4c2c-acc5-4f1cd5d78b3d tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:30:42 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:30:42 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:30:42 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a07841d-9d27-4ba9-8c83-1d7016d212e4]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9c3ac6d-d72a-41c8-9c18-15131250e323 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83187c89-e833-4efd-afa0-2cbfe05d8db1 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa72cf0a-1134-47a3-abd2-6a51f4f20393 (non-flash)\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:30:42 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2488133-34ed-4c2c-acc5-4f1cd5d78b3d tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab (non-flash)
Nov 08 23:30:42 user nova-compute[75045]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9c3ac6d-d72a-41c8-9c18-15131250e323 (non-flash)
Nov 08 23:30:42 user nova-compute[75045]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83187c89-e833-4efd-afa0-2cbfe05d8db1 (non-flash)
Nov 08 23:30:42 user nova-compute[75045]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa72cf0a-1134-47a3-abd2-6a51f4f20393 (non-flash)
Nov 08 23:30:42 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 23:30:42 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2488133-34ed-4c2c-acc5-4f1cd5d78b3d tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab (non-flash)
Nov 08 23:30:42 user nova-compute[75045]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9c3ac6d-d72a-41c8-9c18-15131250e323 (non-flash)
Nov 08 23:30:42 user nova-compute[75045]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83187c89-e833-4efd-afa0-2cbfe05d8db1 (non-flash)
Nov 08 23:30:42 user nova-compute[75045]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa72cf0a-1134-47a3-abd2-6a51f4f20393 (non-flash)
Nov 08 23:30:42 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 23:30:42 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-f2488133-34ed-4c2c-acc5-4f1cd5d78b3d tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:83187c89-e833-4efd-afa0-2cbfe05d8db1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.189s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 23:30:42 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2488133-34ed-4c2c-acc5-4f1cd5d78b3d tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Connected to 172.16.0.220:3260 {{(pid=75045) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 23:30:42 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-f2488133-34ed-4c2c-acc5-4f1cd5d78b3d tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] HCTL ('35', '0', '0', 0) found on session 29 with lun 0 {{(pid=75045) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 23:30:42 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-f2488133-34ed-4c2c-acc5-4f1cd5d78b3d tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Scanning host 35 c: 0, t: 0, l: 0) {{(pid=75045) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 23:30:42 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:30:42 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:30:42 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d4b05bd-01be-4620-ad68-7d45d8496b19]: (4, ('0 0 0', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:30:42 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-f2488133-34ed-4c2c-acc5-4f1cd5d78b3d tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Searching for a device in session 29 and hctl ('35', '0', '0', 0) yield: sdd {{(pid=75045) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 23:30:42 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2488133-34ed-4c2c-acc5-4f1cd5d78b3d tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:83187c89-e833-4efd-afa0-2cbfe05d8db1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gzFECVaq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75045) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 23:30:42 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-f2488133-34ed-4c2c-acc5-4f1cd5d78b3d tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.220s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 23:30:42 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2488133-34ed-4c2c-acc5-4f1cd5d78b3d tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] <== connect_volume: return (225ms) {'type': 'block', 'scsi_wwn': '26137346239616433', 'path': '/dev/sdd'} {{(pid=75045) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 23:30:42 user nova-compute[75045]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f2488133-34ed-4c2c-acc5-4f1cd5d78b3d tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] [instance: 438082fc-a83f-4305-ada6-41a8e1d645a8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26137346239616433', 'path': '/dev/sdd'} {{(pid=75045) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 23:30:42 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:30:43 user nova-compute[75045]: DEBUG nova.virt.libvirt.vif [None req-f2488133-34ed-4c2c-acc5-4f1cd5d78b3d tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T23:27:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-761970552',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-761970552',id=26,image_ref='a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-08T23:29:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6bfb6963a6c145d4a7b7e47c8fde7e60',ramdisk_id='',reservation_id='r-lkcobnbl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-474110917',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T23:29:16Z,user_data=None,user_id='04bb3135250f4465a9947b47f9cde485',uuid=438082fc-a83f-4305-ada6-41a8e1d645a8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "669f0f7f-7c58-42b9-948b-ad3704fb1ab3", "address": "fa:16:3e:57:c2:f9", "network": {"id": "d4cd6998-66d1-4389-bc82-dd000c8962de", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-323966879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-323966879-network", "vif_mac": "fa:16:3e:57:c2:f9"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bfb6963a6c145d4a7b7e47c8fde7e60", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap669f0f7f-7c", "ovs_interfaceid": "669f0f7f-7c58-42b9-948b-ad3704fb1ab3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75045) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 23:30:43 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-f2488133-34ed-4c2c-acc5-4f1cd5d78b3d tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Converting VIF {"id": "669f0f7f-7c58-42b9-948b-ad3704fb1ab3", "address": "fa:16:3e:57:c2:f9", "network": {"id": "d4cd6998-66d1-4389-bc82-dd000c8962de", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-323966879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-323966879-network", "vif_mac": "fa:16:3e:57:c2:f9"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bfb6963a6c145d4a7b7e47c8fde7e60", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap669f0f7f-7c", "ovs_interfaceid": "669f0f7f-7c58-42b9-948b-ad3704fb1ab3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 23:30:43 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-f2488133-34ed-4c2c-acc5-4f1cd5d78b3d tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:57:c2:f9,bridge_name='br-int',has_traffic_filtering=True,id=669f0f7f-7c58-42b9-948b-ad3704fb1ab3,network=Network(d4cd6998-66d1-4389-bc82-dd000c8962de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap669f0f7f-7c') {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 23:30:43 user nova-compute[75045]: DEBUG nova.objects.instance [None req-f2488133-34ed-4c2c-acc5-4f1cd5d78b3d tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Lazy-loading 'pci_devices' on Instance uuid 438082fc-a83f-4305-ada6-41a8e1d645a8 {{(pid=75045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 23:30:43 user nova-compute[75045]: DEBUG nova.objects.base [None req-f2488133-34ed-4c2c-acc5-4f1cd5d78b3d tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Object Instance<438082fc-a83f-4305-ada6-41a8e1d645a8> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75045) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 23:30:43 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-f2488133-34ed-4c2c-acc5-4f1cd5d78b3d tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] [instance: 438082fc-a83f-4305-ada6-41a8e1d645a8] End _get_guest_xml xml=<domain type="kvm">
Nov 08 23:30:43 user nova-compute[75045]:   <uuid>438082fc-a83f-4305-ada6-41a8e1d645a8</uuid>
Nov 08 23:30:43 user nova-compute[75045]:   <name>instance-0000001a</name>
Nov 08 23:30:43 user nova-compute[75045]:   <memory>524288</memory>
Nov 08 23:30:43 user nova-compute[75045]:   <vcpu>1</vcpu>
Nov 08 23:30:43 user nova-compute[75045]:   <metadata>
Nov 08 23:30:43 user nova-compute[75045]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 23:30:43 user nova-compute[75045]:       <nova:package version="0.0.0"/>
Nov 08 23:30:43 user nova-compute[75045]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-761970552</nova:name>
Nov 08 23:30:43 user nova-compute[75045]:       <nova:creationTime>2023-11-08 23:30:42</nova:creationTime>
Nov 08 23:30:43 user nova-compute[75045]:       <nova:flavor name="m1.tiny">
Nov 08 23:30:43 user nova-compute[75045]:         <nova:memory>512</nova:memory>
Nov 08 23:30:43 user nova-compute[75045]:         <nova:disk>1</nova:disk>
Nov 08 23:30:43 user nova-compute[75045]:         <nova:swap>0</nova:swap>
Nov 08 23:30:43 user nova-compute[75045]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 23:30:43 user nova-compute[75045]:         <nova:vcpus>1</nova:vcpus>
Nov 08 23:30:43 user nova-compute[75045]:       </nova:flavor>
Nov 08 23:30:43 user nova-compute[75045]:       <nova:owner>
Nov 08 23:30:43 user nova-compute[75045]:         <nova:user uuid="04bb3135250f4465a9947b47f9cde485">tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member</nova:user>
Nov 08 23:30:43 user nova-compute[75045]:         <nova:project uuid="6bfb6963a6c145d4a7b7e47c8fde7e60">tempest-ServerBootFromVolumeStableRescueTest-474110917</nova:project>
Nov 08 23:30:43 user nova-compute[75045]:       </nova:owner>
Nov 08 23:30:43 user nova-compute[75045]:       <nova:root type="image" uuid="a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb"/>
Nov 08 23:30:43 user nova-compute[75045]:       <nova:ports>
Nov 08 23:30:43 user nova-compute[75045]:         <nova:port uuid="669f0f7f-7c58-42b9-948b-ad3704fb1ab3">
Nov 08 23:30:43 user nova-compute[75045]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 08 23:30:43 user nova-compute[75045]:         </nova:port>
Nov 08 23:30:43 user nova-compute[75045]:       </nova:ports>
Nov 08 23:30:43 user nova-compute[75045]:     </nova:instance>
Nov 08 23:30:43 user nova-compute[75045]:   </metadata>
Nov 08 23:30:43 user nova-compute[75045]:   <sysinfo type="smbios">
Nov 08 23:30:43 user nova-compute[75045]:     <system>
Nov 08 23:30:43 user nova-compute[75045]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 23:30:43 user nova-compute[75045]:       <entry name="product">OpenStack Nova</entry>
Nov 08 23:30:43 user nova-compute[75045]:       <entry name="version">0.0.0</entry>
Nov 08 23:30:43 user nova-compute[75045]:       <entry name="serial">438082fc-a83f-4305-ada6-41a8e1d645a8</entry>
Nov 08 23:30:43 user nova-compute[75045]:       <entry name="uuid">438082fc-a83f-4305-ada6-41a8e1d645a8</entry>
Nov 08 23:30:43 user nova-compute[75045]:       <entry name="family">Virtual Machine</entry>
Nov 08 23:30:43 user nova-compute[75045]:     </system>
Nov 08 23:30:43 user nova-compute[75045]:   </sysinfo>
Nov 08 23:30:43 user nova-compute[75045]:   <os>
Nov 08 23:30:43 user nova-compute[75045]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 23:30:43 user nova-compute[75045]:     <smbios mode="sysinfo"/>
Nov 08 23:30:43 user nova-compute[75045]:   </os>
Nov 08 23:30:43 user nova-compute[75045]:   <features>
Nov 08 23:30:43 user nova-compute[75045]:     <acpi/>
Nov 08 23:30:43 user nova-compute[75045]:     <apic/>
Nov 08 23:30:43 user nova-compute[75045]:     <vmcoreinfo/>
Nov 08 23:30:43 user nova-compute[75045]:   </features>
Nov 08 23:30:43 user nova-compute[75045]:   <clock offset="utc">
Nov 08 23:30:43 user nova-compute[75045]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 23:30:43 user nova-compute[75045]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 23:30:43 user nova-compute[75045]:     <timer name="hpet" present="no"/>
Nov 08 23:30:43 user nova-compute[75045]:   </clock>
Nov 08 23:30:43 user nova-compute[75045]:   <cpu mode="custom" match="exact">
Nov 08 23:30:43 user nova-compute[75045]:     <model>Nehalem</model>
Nov 08 23:30:43 user nova-compute[75045]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 23:30:43 user nova-compute[75045]:   </cpu>
Nov 08 23:30:43 user nova-compute[75045]:   <devices>
Nov 08 23:30:43 user nova-compute[75045]:     <disk type="block" device="disk">
Nov 08 23:30:43 user nova-compute[75045]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 23:30:43 user nova-compute[75045]:       <source dev="/dev/sdd"/>
Nov 08 23:30:43 user nova-compute[75045]:       <target dev="vda" bus="virtio"/>
Nov 08 23:30:43 user nova-compute[75045]:       <serial>83187c89-e833-4efd-afa0-2cbfe05d8db1</serial>
Nov 08 23:30:43 user nova-compute[75045]:     </disk>
Nov 08 23:30:43 user nova-compute[75045]:     <disk type="file" device="disk">
Nov 08 23:30:43 user nova-compute[75045]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 23:30:43 user nova-compute[75045]:       <source file="/opt/stack/data/nova/instances/438082fc-a83f-4305-ada6-41a8e1d645a8/disk.rescue"/>
Nov 08 23:30:43 user nova-compute[75045]:       <target dev="vdb" bus="virtio"/>
Nov 08 23:30:43 user nova-compute[75045]:       <boot order="1"/>
Nov 08 23:30:43 user nova-compute[75045]:     </disk>
Nov 08 23:30:43 user nova-compute[75045]:     <interface type="ethernet">
Nov 08 23:30:43 user nova-compute[75045]:       <mac address="fa:16:3e:57:c2:f9"/>
Nov 08 23:30:43 user nova-compute[75045]:       <model type="virtio"/>
Nov 08 23:30:43 user nova-compute[75045]:       <mtu size="1442"/>
Nov 08 23:30:43 user nova-compute[75045]:       <target dev="tap669f0f7f-7c"/>
Nov 08 23:30:43 user nova-compute[75045]:     </interface>
Nov 08 23:30:43 user nova-compute[75045]:     <serial type="pty">
Nov 08 23:30:43 user nova-compute[75045]:       <log file="/opt/stack/data/nova/instances/438082fc-a83f-4305-ada6-41a8e1d645a8/console.log" append="off"/>
Nov 08 23:30:43 user nova-compute[75045]:     </serial>
Nov 08 23:30:43 user nova-compute[75045]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 23:30:43 user nova-compute[75045]:     <video>
Nov 08 23:30:43 user nova-compute[75045]:       <model type="virtio"/>
Nov 08 23:30:43 user nova-compute[75045]:     </video>
Nov 08 23:30:43 user nova-compute[75045]:     <rng model="virtio">
Nov 08 23:30:43 user nova-compute[75045]:       <backend model="random">/dev/urandom</backend>
Nov 08 23:30:43 user nova-compute[75045]:     </rng>
Nov 08 23:30:43 user nova-compute[75045]:     <controller type="usb" index="0" model="none"/>
Nov 08 23:30:43 user nova-compute[75045]:     <memballoon model="virtio">
Nov 08 23:30:43 user nova-compute[75045]:       <stats period="10"/>
Nov 08 23:30:43 user nova-compute[75045]:     </memballoon>
Nov 08 23:30:43 user nova-compute[75045]:   </devices>
Nov 08 23:30:43 user nova-compute[75045]: </domain>
Nov 08 23:30:43 user nova-compute[75045]:  {{(pid=75045) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 23:30:43 user nova-compute[75045]: INFO nova.virt.libvirt.driver [-] [instance: 438082fc-a83f-4305-ada6-41a8e1d645a8] Instance destroyed successfully.
Nov 08 23:30:43 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-f2488133-34ed-4c2c-acc5-4f1cd5d78b3d tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] No BDM found with device name vda, not building metadata. {{(pid=75045) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 23:30:43 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-f2488133-34ed-4c2c-acc5-4f1cd5d78b3d tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75045) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 23:30:43 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-f2488133-34ed-4c2c-acc5-4f1cd5d78b3d tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] No VIF found with MAC fa:16:3e:57:c2:f9, not building metadata {{(pid=75045) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 23:30:43 user nova-compute[75045]: DEBUG nova.network.neutron [req-fdf4f679-3821-48c1-a20b-344e7c80d98c req-2271f4e7-f2e0-4907-a03e-2c1810174b45 service nova] [instance: 0f21fcd3-ac5f-499e-9c34-82af806fda1d] Updated VIF entry in instance network info cache for port ab02704d-73c2-409c-9d43-1a087ebf369a. {{(pid=75045) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 23:30:43 user nova-compute[75045]: DEBUG nova.network.neutron [req-fdf4f679-3821-48c1-a20b-344e7c80d98c req-2271f4e7-f2e0-4907-a03e-2c1810174b45 service nova] [instance: 0f21fcd3-ac5f-499e-9c34-82af806fda1d] Updating instance_info_cache with network_info: [{"id": "ab02704d-73c2-409c-9d43-1a087ebf369a", "address": "fa:16:3e:b3:b2:47", "network": {"id": "700b5784-d35b-45c0-a4d3-1ab8aa4c48aa", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-194469807-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e63623113f11463d9035bb990de43510", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab02704d-73", "ovs_interfaceid": "ab02704d-73c2-409c-9d43-1a087ebf369a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75045) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 23:30:43 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-fdf4f679-3821-48c1-a20b-344e7c80d98c req-2271f4e7-f2e0-4907-a03e-2c1810174b45 service nova] Releasing lock "refresh_cache-0f21fcd3-ac5f-499e-9c34-82af806fda1d" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 23:30:43 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:30:43 user nova-compute[75045]: DEBUG nova.compute.manager [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Starting heal instance info cache {{(pid=75045) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 23:30:44 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Acquiring lock "refresh_cache-0b84f2b1-01a3-4789-bcef-8b7c4334132b" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 23:30:44 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Acquired lock "refresh_cache-0b84f2b1-01a3-4789-bcef-8b7c4334132b" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 23:30:44 user nova-compute[75045]: DEBUG nova.network.neutron [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] [instance: 0b84f2b1-01a3-4789-bcef-8b7c4334132b] Forcefully refreshing network info cache for instance {{(pid=75045) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 23:30:44 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:30:44 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:30:44 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:30:44 user nova-compute[75045]: DEBUG nova.compute.manager [None req-770b29ea-77d8-4656-a91a-1f6daecbd674 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] [instance: 04169f59-e9a6-4b50-9ad7-7f8c105a376a] Stashing vm_state: active {{(pid=75045) _prep_resize /opt/stack/nova/nova/compute/manager.py:5615}}
Nov 08 23:30:44 user nova-compute[75045]: DEBUG nova.network.neutron [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] [instance: 0b84f2b1-01a3-4789-bcef-8b7c4334132b] Updating instance_info_cache with network_info: [{"id": "c0a20899-be58-4d47-95e2-e129f636162c", "address": "fa:16:3e:69:a7:d0", "network": {"id": "08d1669a-f667-4c79-8e49-0ad183f57046", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1863648032-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bbb640407ef94f568aea892f1834d6d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0a20899-be", "ovs_interfaceid": "c0a20899-be58-4d47-95e2-e129f636162c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75045) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 23:30:44 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Releasing lock "refresh_cache-0b84f2b1-01a3-4789-bcef-8b7c4334132b" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 23:30:44 user nova-compute[75045]: DEBUG nova.compute.manager [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] [instance: 0b84f2b1-01a3-4789-bcef-8b7c4334132b] Updated the network info_cache for instance {{(pid=75045) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 23:30:44 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:30:44 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager.update_available_resource {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:30:44 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-770b29ea-77d8-4656-a91a-1f6daecbd674 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:30:44 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-770b29ea-77d8-4656-a91a-1f6daecbd674 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:30:44 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-770b29ea-77d8-4656-a91a-1f6daecbd674 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75045) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 23:30:44 user nova-compute[75045]: INFO nova.compute.claims [None req-770b29ea-77d8-4656-a91a-1f6daecbd674 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] [instance: 04169f59-e9a6-4b50-9ad7-7f8c105a376a] Claim successful on node user
Nov 08 23:30:44 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:30:44 user nova-compute[75045]: DEBUG nova.compute.manager [req-69144ca6-bea7-4b16-9a63-1836c0035027 req-14f6a4ea-3e30-4762-b9f8-28e1c19c9e1f service nova] [instance: 04169f59-e9a6-4b50-9ad7-7f8c105a376a] Received event network-changed-96af9673-bb3c-4173-8439-0be6d2b922cf {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:30:44 user nova-compute[75045]: DEBUG nova.compute.manager [req-69144ca6-bea7-4b16-9a63-1836c0035027 req-14f6a4ea-3e30-4762-b9f8-28e1c19c9e1f service nova] [instance: 04169f59-e9a6-4b50-9ad7-7f8c105a376a] Refreshing instance network info cache due to event network-changed-96af9673-bb3c-4173-8439-0be6d2b922cf. {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 23:30:44 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-69144ca6-bea7-4b16-9a63-1836c0035027 req-14f6a4ea-3e30-4762-b9f8-28e1c19c9e1f service nova] Acquiring lock "refresh_cache-04169f59-e9a6-4b50-9ad7-7f8c105a376a" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 23:30:44 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-69144ca6-bea7-4b16-9a63-1836c0035027 req-14f6a4ea-3e30-4762-b9f8-28e1c19c9e1f service nova] Acquired lock "refresh_cache-04169f59-e9a6-4b50-9ad7-7f8c105a376a" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 23:30:44 user nova-compute[75045]: DEBUG nova.network.neutron [req-69144ca6-bea7-4b16-9a63-1836c0035027 req-14f6a4ea-3e30-4762-b9f8-28e1c19c9e1f service nova] [instance: 04169f59-e9a6-4b50-9ad7-7f8c105a376a] Refreshing network info cache for port 96af9673-bb3c-4173-8439-0be6d2b922cf {{(pid=75045) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 23:30:44 user nova-compute[75045]: INFO nova.compute.resource_tracker [None req-770b29ea-77d8-4656-a91a-1f6daecbd674 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] [instance: 04169f59-e9a6-4b50-9ad7-7f8c105a376a] Updating resource usage from migration 70a58e7e-3b1b-4b22-87a4-7bd063b467e1
Nov 08 23:30:44 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:30:44 user nova-compute[75045]: DEBUG nova.compute.manager [req-7ba28d53-2f76-412f-af91-5882fdebfa89 req-43053e6e-28c0-486d-a255-e1f0a518f1c4 service nova] [instance: 438082fc-a83f-4305-ada6-41a8e1d645a8] Received event network-vif-plugged-669f0f7f-7c58-42b9-948b-ad3704fb1ab3 {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:30:44 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-7ba28d53-2f76-412f-af91-5882fdebfa89 req-43053e6e-28c0-486d-a255-e1f0a518f1c4 service nova] Acquiring lock "438082fc-a83f-4305-ada6-41a8e1d645a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:30:44 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-7ba28d53-2f76-412f-af91-5882fdebfa89 req-43053e6e-28c0-486d-a255-e1f0a518f1c4 service nova] Lock "438082fc-a83f-4305-ada6-41a8e1d645a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:30:44 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-7ba28d53-2f76-412f-af91-5882fdebfa89 req-43053e6e-28c0-486d-a255-e1f0a518f1c4 service nova] Lock "438082fc-a83f-4305-ada6-41a8e1d645a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:30:44 user nova-compute[75045]: DEBUG nova.compute.manager [req-7ba28d53-2f76-412f-af91-5882fdebfa89 req-43053e6e-28c0-486d-a255-e1f0a518f1c4 service nova] [instance: 438082fc-a83f-4305-ada6-41a8e1d645a8] No waiting events found dispatching network-vif-plugged-669f0f7f-7c58-42b9-948b-ad3704fb1ab3 {{(pid=75045) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 23:30:44 user nova-compute[75045]: WARNING nova.compute.manager [req-7ba28d53-2f76-412f-af91-5882fdebfa89 req-43053e6e-28c0-486d-a255-e1f0a518f1c4 service nova] [instance: 438082fc-a83f-4305-ada6-41a8e1d645a8] Received unexpected event network-vif-plugged-669f0f7f-7c58-42b9-948b-ad3704fb1ab3 for instance with vm_state active and task_state rescuing.
Nov 08 23:30:45 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:30:45 user nova-compute[75045]: DEBUG nova.compute.provider_tree [None req-770b29ea-77d8-4656-a91a-1f6daecbd674 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Inventory has not changed in ProviderTree for provider: 62ba5f85-c74d-4b58-986e-d4197e813fd7 {{(pid=75045) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 23:30:45 user nova-compute[75045]: DEBUG nova.scheduler.client.report [None req-770b29ea-77d8-4656-a91a-1f6daecbd674 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Inventory has not changed for provider 62ba5f85-c74d-4b58-986e-d4197e813fd7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75045) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 23:30:45 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-770b29ea-77d8-4656-a91a-1f6daecbd674 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.649s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:30:45 user nova-compute[75045]: INFO nova.compute.manager [None req-770b29ea-77d8-4656-a91a-1f6daecbd674 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] [instance: 04169f59-e9a6-4b50-9ad7-7f8c105a376a] Migrating
Nov 08 23:30:45 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.611s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:30:45 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:30:45 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Auditing locally available compute resources for user (node: user) {{(pid=75045) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 23:30:45 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-770b29ea-77d8-4656-a91a-1f6daecbd674 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Acquiring lock "refresh_cache-04169f59-e9a6-4b50-9ad7-7f8c105a376a" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 23:30:45 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72c9d731-2b35-434c-8463-1cd6c18fbd6a/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:30:45 user nova-compute[75045]: DEBUG nova.network.neutron [req-69144ca6-bea7-4b16-9a63-1836c0035027 req-14f6a4ea-3e30-4762-b9f8-28e1c19c9e1f service nova] [instance: 04169f59-e9a6-4b50-9ad7-7f8c105a376a] Updated VIF entry in instance network info cache for port 96af9673-bb3c-4173-8439-0be6d2b922cf. {{(pid=75045) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 23:30:45 user nova-compute[75045]: DEBUG nova.network.neutron [req-69144ca6-bea7-4b16-9a63-1836c0035027 req-14f6a4ea-3e30-4762-b9f8-28e1c19c9e1f service nova] [instance: 04169f59-e9a6-4b50-9ad7-7f8c105a376a] Updating instance_info_cache with network_info: [{"id": "96af9673-bb3c-4173-8439-0be6d2b922cf", "address": "fa:16:3e:a5:6d:8b", "network": {"id": "700b5784-d35b-45c0-a4d3-1ab8aa4c48aa", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-194469807-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.175", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e63623113f11463d9035bb990de43510", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96af9673-bb", "ovs_interfaceid": "96af9673-bb3c-4173-8439-0be6d2b922cf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75045) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 23:30:45 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-69144ca6-bea7-4b16-9a63-1836c0035027 req-14f6a4ea-3e30-4762-b9f8-28e1c19c9e1f service nova] Releasing lock "refresh_cache-04169f59-e9a6-4b50-9ad7-7f8c105a376a" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 23:30:45 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-770b29ea-77d8-4656-a91a-1f6daecbd674 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Acquired lock "refresh_cache-04169f59-e9a6-4b50-9ad7-7f8c105a376a" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 23:30:45 user nova-compute[75045]: DEBUG nova.network.neutron [None req-770b29ea-77d8-4656-a91a-1f6daecbd674 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] [instance: 04169f59-e9a6-4b50-9ad7-7f8c105a376a] Building network info cache for instance {{(pid=75045) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 23:30:45 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72c9d731-2b35-434c-8463-1cd6c18fbd6a/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:30:45 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72c9d731-2b35-434c-8463-1cd6c18fbd6a/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:30:45 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72c9d731-2b35-434c-8463-1cd6c18fbd6a/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:30:45 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fd7c34a-55e7-4d54-9c60-03a7155a2685/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:30:46 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fd7c34a-55e7-4d54-9c60-03a7155a2685/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:30:46 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fd7c34a-55e7-4d54-9c60-03a7155a2685/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:30:46 user nova-compute[75045]: DEBUG nova.network.neutron [None req-770b29ea-77d8-4656-a91a-1f6daecbd674 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] [instance: 04169f59-e9a6-4b50-9ad7-7f8c105a376a] Updating instance_info_cache with network_info: [{"id": "96af9673-bb3c-4173-8439-0be6d2b922cf", "address": "fa:16:3e:a5:6d:8b", "network": {"id": "700b5784-d35b-45c0-a4d3-1ab8aa4c48aa", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-194469807-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.175", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e63623113f11463d9035bb990de43510", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96af9673-bb", "ovs_interfaceid": "96af9673-bb3c-4173-8439-0be6d2b922cf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75045) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 23:30:46 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-770b29ea-77d8-4656-a91a-1f6daecbd674 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Releasing lock "refresh_cache-04169f59-e9a6-4b50-9ad7-7f8c105a376a" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 23:30:46 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:30:46 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fd7c34a-55e7-4d54-9c60-03a7155a2685/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:30:46 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ae5ff6b-6f2c-4dfd-a4c6-da4809e2cf27/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:30:46 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-770b29ea-77d8-4656-a91a-1f6daecbd674 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] [instance: 04169f59-e9a6-4b50-9ad7-7f8c105a376a] Starting migrate_disk_and_power_off {{(pid=75045) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Nov 08 23:30:46 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:30:46 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ae5ff6b-6f2c-4dfd-a4c6-da4809e2cf27/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:30:46 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ae5ff6b-6f2c-4dfd-a4c6-da4809e2cf27/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:30:46 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:30:46 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ae5ff6b-6f2c-4dfd-a4c6-da4809e2cf27/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:30:46 user nova-compute[75045]: DEBUG nova.compute.manager [req-37880952-84fe-414d-9d67-ab98288ca8e9 req-eef5f46d-43e5-453d-b4ed-283ad43dd3f5 service nova] [instance: 04169f59-e9a6-4b50-9ad7-7f8c105a376a] Received event network-vif-unplugged-96af9673-bb3c-4173-8439-0be6d2b922cf {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:30:46 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-37880952-84fe-414d-9d67-ab98288ca8e9 req-eef5f46d-43e5-453d-b4ed-283ad43dd3f5 service nova] Acquiring lock "04169f59-e9a6-4b50-9ad7-7f8c105a376a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:30:46 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-37880952-84fe-414d-9d67-ab98288ca8e9 req-eef5f46d-43e5-453d-b4ed-283ad43dd3f5 service nova] Lock "04169f59-e9a6-4b50-9ad7-7f8c105a376a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:30:46 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-37880952-84fe-414d-9d67-ab98288ca8e9 req-eef5f46d-43e5-453d-b4ed-283ad43dd3f5 service nova] Lock "04169f59-e9a6-4b50-9ad7-7f8c105a376a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:30:46 user nova-compute[75045]: DEBUG nova.compute.manager [req-37880952-84fe-414d-9d67-ab98288ca8e9 req-eef5f46d-43e5-453d-b4ed-283ad43dd3f5 service nova] [instance: 04169f59-e9a6-4b50-9ad7-7f8c105a376a] No waiting events found dispatching network-vif-unplugged-96af9673-bb3c-4173-8439-0be6d2b922cf {{(pid=75045) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 23:30:46 user nova-compute[75045]: WARNING nova.compute.manager [req-37880952-84fe-414d-9d67-ab98288ca8e9 req-eef5f46d-43e5-453d-b4ed-283ad43dd3f5 service nova] [instance: 04169f59-e9a6-4b50-9ad7-7f8c105a376a] Received unexpected event network-vif-unplugged-96af9673-bb3c-4173-8439-0be6d2b922cf for instance with vm_state active and task_state resize_migrating.
Nov 08 23:30:46 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] skipping disk /dev/sdh (vda) as it is a volume {{(pid=75045) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 23:30:46 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e480a3c8-a7bc-4eea-b45f-d51f5b68ac0c/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:30:46 user nova-compute[75045]: DEBUG nova.compute.manager [req-fb23d688-57f3-4007-aaa5-982967720b14 req-30f4d5a9-a28b-44f8-8b90-d38321bab5fc service nova] [instance: 438082fc-a83f-4305-ada6-41a8e1d645a8] Received event network-vif-plugged-669f0f7f-7c58-42b9-948b-ad3704fb1ab3 {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:30:46 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-fb23d688-57f3-4007-aaa5-982967720b14 req-30f4d5a9-a28b-44f8-8b90-d38321bab5fc service nova] Acquiring lock "438082fc-a83f-4305-ada6-41a8e1d645a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:30:46 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-fb23d688-57f3-4007-aaa5-982967720b14 req-30f4d5a9-a28b-44f8-8b90-d38321bab5fc service nova] Lock "438082fc-a83f-4305-ada6-41a8e1d645a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:30:46 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-fb23d688-57f3-4007-aaa5-982967720b14 req-30f4d5a9-a28b-44f8-8b90-d38321bab5fc service nova] Lock "438082fc-a83f-4305-ada6-41a8e1d645a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:30:46 user nova-compute[75045]: DEBUG nova.compute.manager [req-fb23d688-57f3-4007-aaa5-982967720b14 req-30f4d5a9-a28b-44f8-8b90-d38321bab5fc service nova] [instance: 438082fc-a83f-4305-ada6-41a8e1d645a8] No waiting events found dispatching network-vif-plugged-669f0f7f-7c58-42b9-948b-ad3704fb1ab3 {{(pid=75045) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 23:30:46 user nova-compute[75045]: WARNING nova.compute.manager [req-fb23d688-57f3-4007-aaa5-982967720b14 req-30f4d5a9-a28b-44f8-8b90-d38321bab5fc service nova] [instance: 438082fc-a83f-4305-ada6-41a8e1d645a8] Received unexpected event network-vif-plugged-669f0f7f-7c58-42b9-948b-ad3704fb1ab3 for instance with vm_state active and task_state rescuing.
Nov 08 23:30:46 user nova-compute[75045]: DEBUG nova.compute.manager [None req-f2488133-34ed-4c2c-acc5-4f1cd5d78b3d tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] [instance: 438082fc-a83f-4305-ada6-41a8e1d645a8] Checking state {{(pid=75045) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 23:30:46 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:30:47 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e480a3c8-a7bc-4eea-b45f-d51f5b68ac0c/disk --force-share --output=json" returned: 0 in 0.260s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:30:47 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e480a3c8-a7bc-4eea-b45f-d51f5b68ac0c/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:30:47 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:30:47 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:30:47 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:30:47 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:30:47 user nova-compute[75045]: INFO nova.virt.libvirt.driver [-] [instance: 04169f59-e9a6-4b50-9ad7-7f8c105a376a] Instance destroyed successfully.
Nov 08 23:30:47 user nova-compute[75045]: DEBUG nova.virt.libvirt.vif [None req-770b29ea-77d8-4656-a91a-1f6daecbd674 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T23:28:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1540084668',display_name='tempest-ServerActionsTestOtherA-server-1540084668',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1540084668',id=27,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDODl/KmGTsZ/iebmo5xmCcXvI602I8HkxrrHYOCSHtu28wqdqp4sqz8GjX6RCkUTvwm3o1RrGN7CPAGp6yuNsTNNdTZNeJLiXbNPx6WnByfZzN9Q7qtNxToi4a9/5pZlg==',key_name='tempest-keypair-679582766',keypairs=<?>,launch_index=0,launched_at=2023-11-08T23:29:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='e63623113f11463d9035bb990de43510',ramdisk_id='',reservation_id='r-tx09g4z0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-2056815713',owner_user_name='tempest-ServerActionsTestOtherA-2056815713-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T23:30:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='75fc508f268d4a569ad78598ff019c14',uuid=04169f59-e9a6-4b50-9ad7-7f8c105a376a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "96af9673-bb3c-4173-8439-0be6d2b922cf", "address": "fa:16:3e:a5:6d:8b", "network": {"id": "700b5784-d35b-45c0-a4d3-1ab8aa4c48aa", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-194469807-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.175", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-194469807-network", "vif_mac": "fa:16:3e:a5:6d:8b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e63623113f11463d9035bb990de43510", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96af9673-bb", "ovs_interfaceid": "96af9673-bb3c-4173-8439-0be6d2b922cf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75045) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 23:30:47 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-770b29ea-77d8-4656-a91a-1f6daecbd674 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Converting VIF {"id": "96af9673-bb3c-4173-8439-0be6d2b922cf", "address": "fa:16:3e:a5:6d:8b", "network": {"id": "700b5784-d35b-45c0-a4d3-1ab8aa4c48aa", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-194469807-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.175", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-194469807-network", "vif_mac": "fa:16:3e:a5:6d:8b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e63623113f11463d9035bb990de43510", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96af9673-bb", "ovs_interfaceid": "96af9673-bb3c-4173-8439-0be6d2b922cf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 23:30:47 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-770b29ea-77d8-4656-a91a-1f6daecbd674 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a5:6d:8b,bridge_name='br-int',has_traffic_filtering=True,id=96af9673-bb3c-4173-8439-0be6d2b922cf,network=Network(700b5784-d35b-45c0-a4d3-1ab8aa4c48aa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96af9673-bb') {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 23:30:47 user nova-compute[75045]: DEBUG os_vif [None req-770b29ea-77d8-4656-a91a-1f6daecbd674 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a5:6d:8b,bridge_name='br-int',has_traffic_filtering=True,id=96af9673-bb3c-4173-8439-0be6d2b922cf,network=Network(700b5784-d35b-45c0-a4d3-1ab8aa4c48aa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96af9673-bb') {{(pid=75045) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 23:30:47 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e480a3c8-a7bc-4eea-b45f-d51f5b68ac0c/disk --force-share --output=json" returned: 0 in 0.271s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:30:47 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:30:47 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap96af9673-bb, bridge=br-int, if_exists=True) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:30:47 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 23:30:47 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:30:47 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e668005f-2347-47c1-a5cb-9fe3b5690f25) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:30:47 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:30:47 user nova-compute[75045]: INFO os_vif [None req-770b29ea-77d8-4656-a91a-1f6daecbd674 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a5:6d:8b,bridge_name='br-int',has_traffic_filtering=True,id=96af9673-bb3c-4173-8439-0be6d2b922cf,network=Network(700b5784-d35b-45c0-a4d3-1ab8aa4c48aa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96af9673-bb')
Nov 08 23:30:47 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f21fcd3-ac5f-499e-9c34-82af806fda1d/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:30:47 user nova-compute[75045]: DEBUG nova.virt.libvirt.volume.iscsi [None req-770b29ea-77d8-4656-a91a-1f6daecbd674 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] [instance: 04169f59-e9a6-4b50-9ad7-7f8c105a376a] calling os-brick to detach iSCSI Volume {{(pid=75045) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 23:30:47 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-770b29ea-77d8-4656-a91a-1f6daecbd674 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1b68210460>, {'target_iqn': 'iqn.2010-10.org.openstack:e9c3ac6d-d72a-41c8-9c18-15131250e323', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WPeOlnqB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75045) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 23:30:47 user nova-compute[75045]: WARNING os_brick.initiator.connectors.base [None req-770b29ea-77d8-4656-a91a-1f6daecbd674 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 23:30:47 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-770b29ea-77d8-4656-a91a-1f6daecbd674 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 23:30:47 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-770b29ea-77d8-4656-a91a-1f6daecbd674 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 23:30:47 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:30:47 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.028s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:30:47 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbb60482-8784-4414-8745-eca8b6ea19c1]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:fa72cf0a-1134-47a3-abd2-6a51f4f20393\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:83187c89-e833-4efd-afa0-2cbfe05d8db1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e9c3ac6d-d72a-41c8-9c18-15131250e323\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:30:47 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-770b29ea-77d8-4656-a91a-1f6daecbd674 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 23:30:47 user nova-compute[75045]: No targets found.
Nov 08 23:30:47 user nova-compute[75045]: iSNS:
Nov 08 23:30:47 user nova-compute[75045]: No targets found.
Nov 08 23:30:47 user nova-compute[75045]: STATIC:
Nov 08 23:30:47 user nova-compute[75045]: Target: iqn.2010-10.org.openstack:fa72cf0a-1134-47a3-abd2-6a51f4f20393
Nov 08 23:30:47 user nova-compute[75045]:         Portal: 172.16.0.220:3260,-1
Nov 08 23:30:47 user nova-compute[75045]:                 Iface Name: default
Nov 08 23:30:47 user nova-compute[75045]: Target: iqn.2010-10.org.openstack:83187c89-e833-4efd-afa0-2cbfe05d8db1
Nov 08 23:30:47 user nova-compute[75045]:         Portal: 172.16.0.220:3260,-1
Nov 08 23:30:47 user nova-compute[75045]:                 Iface Name: default
Nov 08 23:30:47 user nova-compute[75045]: Target: iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab
Nov 08 23:30:47 user nova-compute[75045]:         Portal: 172.16.0.220:3260,-1
Nov 08 23:30:47 user nova-compute[75045]:                 Iface Name: default
Nov 08 23:30:47 user nova-compute[75045]: Target: iqn.2010-10.org.openstack:e9c3ac6d-d72a-41c8-9c18-15131250e323
Nov 08 23:30:47 user nova-compute[75045]:         Portal: 172.16.0.220:3260,-1
Nov 08 23:30:47 user nova-compute[75045]:                 Iface Name: default
Nov 08 23:30:47 user nova-compute[75045]: FIRMWARE:
Nov 08 23:30:47 user nova-compute[75045]: No targets found.
Nov 08 23:30:47 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 23:30:47 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-770b29ea-77d8-4656-a91a-1f6daecbd674 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 23:30:47 user nova-compute[75045]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 23:30:47 user nova-compute[75045]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75045) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 23:30:47 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-770b29ea-77d8-4656-a91a-1f6daecbd674 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e9c3ac6d-d72a-41c8-9c18-15131250e323', 0)] {{(pid=75045) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 23:30:47 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:30:47 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:30:47 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.046s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:30:47 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[995f66c3-8547-40fd-b636-6673e68cd0e4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:83187c89-e833-4efd-afa0-2cbfe05d8db1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e9c3ac6d-d72a-41c8-9c18-15131250e323\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fa72cf0a-1134-47a3-abd2-6a51f4f20393\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:30:47 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:30:47 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:30:47 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[85824449-b797-4ee8-b3f5-cd372f2e78e3]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9c3ac6d-d72a-41c8-9c18-15131250e323 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83187c89-e833-4efd-afa0-2cbfe05d8db1 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa72cf0a-1134-47a3-abd2-6a51f4f20393 (non-flash)\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:30:47 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-770b29ea-77d8-4656-a91a-1f6daecbd674 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab (non-flash)
Nov 08 23:30:47 user nova-compute[75045]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9c3ac6d-d72a-41c8-9c18-15131250e323 (non-flash)
Nov 08 23:30:47 user nova-compute[75045]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83187c89-e833-4efd-afa0-2cbfe05d8db1 (non-flash)
Nov 08 23:30:47 user nova-compute[75045]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa72cf0a-1134-47a3-abd2-6a51f4f20393 (non-flash)
Nov 08 23:30:47 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 23:30:47 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-770b29ea-77d8-4656-a91a-1f6daecbd674 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab (non-flash)
Nov 08 23:30:47 user nova-compute[75045]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9c3ac6d-d72a-41c8-9c18-15131250e323 (non-flash)
Nov 08 23:30:47 user nova-compute[75045]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83187c89-e833-4efd-afa0-2cbfe05d8db1 (non-flash)
Nov 08 23:30:47 user nova-compute[75045]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa72cf0a-1134-47a3-abd2-6a51f4f20393 (non-flash)
Nov 08 23:30:47 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 23:30:47 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-770b29ea-77d8-4656-a91a-1f6daecbd674 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1b48660b80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e9c3ac6d-d72a-41c8-9c18-15131250e323'): ({'sdb'}, set())}) {{(pid=75045) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 23:30:47 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-770b29ea-77d8-4656-a91a-1f6daecbd674 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Removing single pathed devices sdb {{(pid=75045) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 23:30:47 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:30:47 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.048s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:30:47 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ce4cf4d-9527-42af-9994-d18e95383009]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:30:47 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:30:47 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.039s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:30:47 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca37141c-0c3d-482a-ac80-1c464b453f44]: (4, ('ok\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:30:47 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-770b29ea-77d8-4656-a91a-1f6daecbd674 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Flushing IO for device /dev/sdb {{(pid=75045) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 23:30:47 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:30:47 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:30:47 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:30:47 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f21fcd3-ac5f-499e-9c34-82af806fda1d/disk --force-share --output=json" returned: 0 in 0.301s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:30:47 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f21fcd3-ac5f-499e-9c34-82af806fda1d/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:30:47 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.019s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:30:47 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[d49441b7-34fc-4d33-8af2-5b8c55473c1f]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:30:47 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-770b29ea-77d8-4656-a91a-1f6daecbd674 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75045) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 23:30:47 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:30:47 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.065s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:30:47 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e590b4d-1f13-41bf-8cd6-39d212c9ae1a]: (4, ('1', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:30:47 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-770b29ea-77d8-4656-a91a-1f6daecbd674 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75045) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 23:30:47 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-770b29ea-77d8-4656-a91a-1f6daecbd674 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] SCSI volumes sdb have been removed. {{(pid=75045) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 23:30:47 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-770b29ea-77d8-4656-a91a-1f6daecbd674 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e9c3ac6d-d72a-41c8-9c18-15131250e323')] {{(pid=75045) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 23:30:47 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e9c3ac6d-d72a-41c8-9c18-15131250e323 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:30:47 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e9c3ac6d-d72a-41c8-9c18-15131250e323 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.050s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:30:47 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[7767bbe9-023b-40df-9567-4188479c2525]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:30:47 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-770b29ea-77d8-4656-a91a-1f6daecbd674 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:30:47 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e9c3ac6d-d72a-41c8-9c18-15131250e323 -p 172.16.0.220:3260 --logout {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:30:48 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e9c3ac6d-d72a-41c8-9c18-15131250e323 -p 172.16.0.220:3260 --logout" returned: 0 in 0.119s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:30:48 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[db34eaf7-2903-4f1a-8610-7f82713b7850]: (4, ('Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:e9c3ac6d-d72a-41c8-9c18-15131250e323, portal: 172.16.0.220,3260]\nLogout of [sid: 28, target: iqn.2010-10.org.openstack:e9c3ac6d-d72a-41c8-9c18-15131250e323, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:30:48 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-770b29ea-77d8-4656-a91a-1f6daecbd674 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:e9c3ac6d-d72a-41c8-9c18-15131250e323, portal: 172.16.0.220,3260]
Nov 08 23:30:48 user nova-compute[75045]: Logout of [sid: 28, target: iqn.2010-10.org.openstack:e9c3ac6d-d72a-41c8-9c18-15131250e323, portal: 172.16.0.220,3260] successful.
Nov 08 23:30:48 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:30:48 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e9c3ac6d-d72a-41c8-9c18-15131250e323 -p 172.16.0.220:3260 --op delete {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:30:48 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f21fcd3-ac5f-499e-9c34-82af806fda1d/disk --force-share --output=json" returned: 0 in 0.306s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:30:48 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75045) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 23:30:48 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/438082fc-a83f-4305-ada6-41a8e1d645a8/disk.rescue --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:30:48 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e9c3ac6d-d72a-41c8-9c18-15131250e323 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.051s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:30:48 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[e743767a-ad42-439d-9504-d052465727d5]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:30:48 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-770b29ea-77d8-4656-a91a-1f6daecbd674 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:30:48 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-770b29ea-77d8-4656-a91a-1f6daecbd674 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.622s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 23:30:48 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-770b29ea-77d8-4656-a91a-1f6daecbd674 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] <== disconnect_volume: return (626ms) None {{(pid=75045) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 23:30:48 user nova-compute[75045]: DEBUG nova.virt.libvirt.volume.iscsi [None req-770b29ea-77d8-4656-a91a-1f6daecbd674 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] [instance: 04169f59-e9a6-4b50-9ad7-7f8c105a376a] Disconnected iSCSI Volume {{(pid=75045) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 23:30:48 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-770b29ea-77d8-4656-a91a-1f6daecbd674 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75045) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 23:30:48 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:30:48 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:30:48 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/438082fc-a83f-4305-ada6-41a8e1d645a8/disk.rescue --force-share --output=json" returned: 0 in 0.218s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:30:48 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/438082fc-a83f-4305-ada6-41a8e1d645a8/disk.rescue --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:30:48 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/438082fc-a83f-4305-ada6-41a8e1d645a8/disk.rescue --force-share --output=json" returned: 0 in 0.273s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:30:48 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e92ab9a-8ea4-4452-a458-db181d4a59b7/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:30:48 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e92ab9a-8ea4-4452-a458-db181d4a59b7/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:30:48 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e92ab9a-8ea4-4452-a458-db181d4a59b7/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:30:48 user nova-compute[75045]: DEBUG nova.compute.manager [req-9babe802-189d-436a-b12e-9a5ae976ac98 req-ccf6f614-1b8c-48e7-84af-a62292a06d49 service nova] [instance: 04169f59-e9a6-4b50-9ad7-7f8c105a376a] Received event network-vif-plugged-96af9673-bb3c-4173-8439-0be6d2b922cf {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:30:48 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-9babe802-189d-436a-b12e-9a5ae976ac98 req-ccf6f614-1b8c-48e7-84af-a62292a06d49 service nova] Acquiring lock "04169f59-e9a6-4b50-9ad7-7f8c105a376a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:30:48 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-9babe802-189d-436a-b12e-9a5ae976ac98 req-ccf6f614-1b8c-48e7-84af-a62292a06d49 service nova] Lock "04169f59-e9a6-4b50-9ad7-7f8c105a376a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:30:48 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-9babe802-189d-436a-b12e-9a5ae976ac98 req-ccf6f614-1b8c-48e7-84af-a62292a06d49 service nova] Lock "04169f59-e9a6-4b50-9ad7-7f8c105a376a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:30:48 user nova-compute[75045]: DEBUG nova.compute.manager [req-9babe802-189d-436a-b12e-9a5ae976ac98 req-ccf6f614-1b8c-48e7-84af-a62292a06d49 service nova] [instance: 04169f59-e9a6-4b50-9ad7-7f8c105a376a] No waiting events found dispatching network-vif-plugged-96af9673-bb3c-4173-8439-0be6d2b922cf {{(pid=75045) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 23:30:48 user nova-compute[75045]: WARNING nova.compute.manager [req-9babe802-189d-436a-b12e-9a5ae976ac98 req-ccf6f614-1b8c-48e7-84af-a62292a06d49 service nova] [instance: 04169f59-e9a6-4b50-9ad7-7f8c105a376a] Received unexpected event network-vif-plugged-96af9673-bb3c-4173-8439-0be6d2b922cf for instance with vm_state active and task_state resize_migrating.
Nov 08 23:30:48 user nova-compute[75045]: DEBUG nova.compute.manager [req-9babe802-189d-436a-b12e-9a5ae976ac98 req-ccf6f614-1b8c-48e7-84af-a62292a06d49 service nova] [instance: 04169f59-e9a6-4b50-9ad7-7f8c105a376a] Received event network-vif-plugged-96af9673-bb3c-4173-8439-0be6d2b922cf {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:30:48 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-9babe802-189d-436a-b12e-9a5ae976ac98 req-ccf6f614-1b8c-48e7-84af-a62292a06d49 service nova] Acquiring lock "04169f59-e9a6-4b50-9ad7-7f8c105a376a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:30:48 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-9babe802-189d-436a-b12e-9a5ae976ac98 req-ccf6f614-1b8c-48e7-84af-a62292a06d49 service nova] Lock "04169f59-e9a6-4b50-9ad7-7f8c105a376a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:30:48 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-9babe802-189d-436a-b12e-9a5ae976ac98 req-ccf6f614-1b8c-48e7-84af-a62292a06d49 service nova] Lock "04169f59-e9a6-4b50-9ad7-7f8c105a376a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:30:48 user nova-compute[75045]: DEBUG nova.compute.manager [req-9babe802-189d-436a-b12e-9a5ae976ac98 req-ccf6f614-1b8c-48e7-84af-a62292a06d49 service nova] [instance: 04169f59-e9a6-4b50-9ad7-7f8c105a376a] No waiting events found dispatching network-vif-plugged-96af9673-bb3c-4173-8439-0be6d2b922cf {{(pid=75045) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 23:30:48 user nova-compute[75045]: WARNING nova.compute.manager [req-9babe802-189d-436a-b12e-9a5ae976ac98 req-ccf6f614-1b8c-48e7-84af-a62292a06d49 service nova] [instance: 04169f59-e9a6-4b50-9ad7-7f8c105a376a] Received unexpected event network-vif-plugged-96af9673-bb3c-4173-8439-0be6d2b922cf for instance with vm_state active and task_state resize_migrating.
Nov 08 23:30:48 user nova-compute[75045]: DEBUG nova.compute.manager [req-9babe802-189d-436a-b12e-9a5ae976ac98 req-ccf6f614-1b8c-48e7-84af-a62292a06d49 service nova] [instance: 04169f59-e9a6-4b50-9ad7-7f8c105a376a] Received event network-vif-plugged-96af9673-bb3c-4173-8439-0be6d2b922cf {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:30:48 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-9babe802-189d-436a-b12e-9a5ae976ac98 req-ccf6f614-1b8c-48e7-84af-a62292a06d49 service nova] Acquiring lock "04169f59-e9a6-4b50-9ad7-7f8c105a376a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:30:48 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-9babe802-189d-436a-b12e-9a5ae976ac98 req-ccf6f614-1b8c-48e7-84af-a62292a06d49 service nova] Lock "04169f59-e9a6-4b50-9ad7-7f8c105a376a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:30:48 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-9babe802-189d-436a-b12e-9a5ae976ac98 req-ccf6f614-1b8c-48e7-84af-a62292a06d49 service nova] Lock "04169f59-e9a6-4b50-9ad7-7f8c105a376a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:30:48 user nova-compute[75045]: DEBUG nova.compute.manager [req-9babe802-189d-436a-b12e-9a5ae976ac98 req-ccf6f614-1b8c-48e7-84af-a62292a06d49 service nova] [instance: 04169f59-e9a6-4b50-9ad7-7f8c105a376a] No waiting events found dispatching network-vif-plugged-96af9673-bb3c-4173-8439-0be6d2b922cf {{(pid=75045) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 23:30:48 user nova-compute[75045]: WARNING nova.compute.manager [req-9babe802-189d-436a-b12e-9a5ae976ac98 req-ccf6f614-1b8c-48e7-84af-a62292a06d49 service nova] [instance: 04169f59-e9a6-4b50-9ad7-7f8c105a376a] Received unexpected event network-vif-plugged-96af9673-bb3c-4173-8439-0be6d2b922cf for instance with vm_state active and task_state resize_migrating.
Nov 08 23:30:48 user nova-compute[75045]: DEBUG nova.compute.manager [req-9babe802-189d-436a-b12e-9a5ae976ac98 req-ccf6f614-1b8c-48e7-84af-a62292a06d49 service nova] [instance: 04169f59-e9a6-4b50-9ad7-7f8c105a376a] Received event network-vif-unplugged-96af9673-bb3c-4173-8439-0be6d2b922cf {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:30:48 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-9babe802-189d-436a-b12e-9a5ae976ac98 req-ccf6f614-1b8c-48e7-84af-a62292a06d49 service nova] Acquiring lock "04169f59-e9a6-4b50-9ad7-7f8c105a376a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:30:48 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-9babe802-189d-436a-b12e-9a5ae976ac98 req-ccf6f614-1b8c-48e7-84af-a62292a06d49 service nova] Lock "04169f59-e9a6-4b50-9ad7-7f8c105a376a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:30:48 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-9babe802-189d-436a-b12e-9a5ae976ac98 req-ccf6f614-1b8c-48e7-84af-a62292a06d49 service nova] Lock "04169f59-e9a6-4b50-9ad7-7f8c105a376a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:30:48 user nova-compute[75045]: DEBUG nova.compute.manager [req-9babe802-189d-436a-b12e-9a5ae976ac98 req-ccf6f614-1b8c-48e7-84af-a62292a06d49 service nova] [instance: 04169f59-e9a6-4b50-9ad7-7f8c105a376a] No waiting events found dispatching network-vif-unplugged-96af9673-bb3c-4173-8439-0be6d2b922cf {{(pid=75045) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 23:30:48 user nova-compute[75045]: WARNING nova.compute.manager [req-9babe802-189d-436a-b12e-9a5ae976ac98 req-ccf6f614-1b8c-48e7-84af-a62292a06d49 service nova] [instance: 04169f59-e9a6-4b50-9ad7-7f8c105a376a] Received unexpected event network-vif-unplugged-96af9673-bb3c-4173-8439-0be6d2b922cf for instance with vm_state active and task_state resize_migrating.
Nov 08 23:30:48 user nova-compute[75045]: DEBUG nova.compute.manager [req-9babe802-189d-436a-b12e-9a5ae976ac98 req-ccf6f614-1b8c-48e7-84af-a62292a06d49 service nova] [instance: 04169f59-e9a6-4b50-9ad7-7f8c105a376a] Received event network-vif-plugged-96af9673-bb3c-4173-8439-0be6d2b922cf {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:30:48 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-9babe802-189d-436a-b12e-9a5ae976ac98 req-ccf6f614-1b8c-48e7-84af-a62292a06d49 service nova] Acquiring lock "04169f59-e9a6-4b50-9ad7-7f8c105a376a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:30:48 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-9babe802-189d-436a-b12e-9a5ae976ac98 req-ccf6f614-1b8c-48e7-84af-a62292a06d49 service nova] Lock "04169f59-e9a6-4b50-9ad7-7f8c105a376a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:30:48 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-9babe802-189d-436a-b12e-9a5ae976ac98 req-ccf6f614-1b8c-48e7-84af-a62292a06d49 service nova] Lock "04169f59-e9a6-4b50-9ad7-7f8c105a376a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:30:48 user nova-compute[75045]: DEBUG nova.compute.manager [req-9babe802-189d-436a-b12e-9a5ae976ac98 req-ccf6f614-1b8c-48e7-84af-a62292a06d49 service nova] [instance: 04169f59-e9a6-4b50-9ad7-7f8c105a376a] No waiting events found dispatching network-vif-plugged-96af9673-bb3c-4173-8439-0be6d2b922cf {{(pid=75045) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 23:30:48 user nova-compute[75045]: WARNING nova.compute.manager [req-9babe802-189d-436a-b12e-9a5ae976ac98 req-ccf6f614-1b8c-48e7-84af-a62292a06d49 service nova] [instance: 04169f59-e9a6-4b50-9ad7-7f8c105a376a] Received unexpected event network-vif-plugged-96af9673-bb3c-4173-8439-0be6d2b922cf for instance with vm_state active and task_state resize_migrating.
Nov 08 23:30:48 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e92ab9a-8ea4-4452-a458-db181d4a59b7/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:30:48 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa67b237-f598-4111-87ba-d761aa50d95e/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:30:49 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa67b237-f598-4111-87ba-d761aa50d95e/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:30:49 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa67b237-f598-4111-87ba-d761aa50d95e/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:30:49 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa67b237-f598-4111-87ba-d761aa50d95e/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:30:49 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a3c21c4-2db3-44e1-8a23-336ca9f8374d/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:30:49 user nova-compute[75045]: DEBUG nova.compute.manager [req-01b73555-7c80-437b-9a15-e1a9e573854b req-5b39e70c-93ef-4d06-ac10-0508683a0e58 service nova] [instance: 9fd7c34a-55e7-4d54-9c60-03a7155a2685] Received event network-changed-b44611d2-ca0a-4e01-b44d-cdf537474195 {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:30:49 user nova-compute[75045]: DEBUG nova.compute.manager [req-01b73555-7c80-437b-9a15-e1a9e573854b req-5b39e70c-93ef-4d06-ac10-0508683a0e58 service nova] [instance: 9fd7c34a-55e7-4d54-9c60-03a7155a2685] Refreshing instance network info cache due to event network-changed-b44611d2-ca0a-4e01-b44d-cdf537474195. {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 23:30:49 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-01b73555-7c80-437b-9a15-e1a9e573854b req-5b39e70c-93ef-4d06-ac10-0508683a0e58 service nova] Acquiring lock "refresh_cache-9fd7c34a-55e7-4d54-9c60-03a7155a2685" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 23:30:49 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-01b73555-7c80-437b-9a15-e1a9e573854b req-5b39e70c-93ef-4d06-ac10-0508683a0e58 service nova] Acquired lock "refresh_cache-9fd7c34a-55e7-4d54-9c60-03a7155a2685" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 23:30:49 user nova-compute[75045]: DEBUG nova.network.neutron [req-01b73555-7c80-437b-9a15-e1a9e573854b req-5b39e70c-93ef-4d06-ac10-0508683a0e58 service nova] [instance: 9fd7c34a-55e7-4d54-9c60-03a7155a2685] Refreshing network info cache for port b44611d2-ca0a-4e01-b44d-cdf537474195 {{(pid=75045) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 23:30:49 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a3c21c4-2db3-44e1-8a23-336ca9f8374d/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:30:49 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a3c21c4-2db3-44e1-8a23-336ca9f8374d/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:30:49 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a3c21c4-2db3-44e1-8a23-336ca9f8374d/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:30:49 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75045) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 23:30:49 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5fc7f02-2143-4bcf-92ac-078d5ec10747/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:30:50 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5fc7f02-2143-4bcf-92ac-078d5ec10747/disk --force-share --output=json" returned: 0 in 0.254s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:30:50 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5fc7f02-2143-4bcf-92ac-078d5ec10747/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:30:50 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-17a9f297-bd57-4f38-a282-259cebe77c57 tempest-VolumesAdminNegativeTest-215528111 tempest-VolumesAdminNegativeTest-215528111-project-member] Acquiring lock "e480a3c8-a7bc-4eea-b45f-d51f5b68ac0c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:30:50 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-17a9f297-bd57-4f38-a282-259cebe77c57 tempest-VolumesAdminNegativeTest-215528111 tempest-VolumesAdminNegativeTest-215528111-project-member] Lock "e480a3c8-a7bc-4eea-b45f-d51f5b68ac0c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.003s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:30:50 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-17a9f297-bd57-4f38-a282-259cebe77c57 tempest-VolumesAdminNegativeTest-215528111 tempest-VolumesAdminNegativeTest-215528111-project-member] Acquiring lock "e480a3c8-a7bc-4eea-b45f-d51f5b68ac0c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:30:50 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-17a9f297-bd57-4f38-a282-259cebe77c57 tempest-VolumesAdminNegativeTest-215528111 tempest-VolumesAdminNegativeTest-215528111-project-member] Lock "e480a3c8-a7bc-4eea-b45f-d51f5b68ac0c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:30:50 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-17a9f297-bd57-4f38-a282-259cebe77c57 tempest-VolumesAdminNegativeTest-215528111 tempest-VolumesAdminNegativeTest-215528111-project-member] Lock "e480a3c8-a7bc-4eea-b45f-d51f5b68ac0c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:30:50 user nova-compute[75045]: INFO nova.compute.manager [None req-17a9f297-bd57-4f38-a282-259cebe77c57 tempest-VolumesAdminNegativeTest-215528111 tempest-VolumesAdminNegativeTest-215528111-project-member] [instance: e480a3c8-a7bc-4eea-b45f-d51f5b68ac0c] Terminating instance
Nov 08 23:30:50 user nova-compute[75045]: DEBUG nova.compute.manager [None req-17a9f297-bd57-4f38-a282-259cebe77c57 tempest-VolumesAdminNegativeTest-215528111 tempest-VolumesAdminNegativeTest-215528111-project-member] [instance: e480a3c8-a7bc-4eea-b45f-d51f5b68ac0c] Start destroying the instance on the hypervisor. {{(pid=75045) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 23:30:50 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-fa21dde0-232a-4cee-ab2e-e6ab0de8d3c0 tempest-TestStampPattern-2120781434 tempest-TestStampPattern-2120781434-project-member] Acquiring lock "9fd7c34a-55e7-4d54-9c60-03a7155a2685" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:30:50 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-fa21dde0-232a-4cee-ab2e-e6ab0de8d3c0 tempest-TestStampPattern-2120781434 tempest-TestStampPattern-2120781434-project-member] Lock "9fd7c34a-55e7-4d54-9c60-03a7155a2685" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:30:50 user nova-compute[75045]: DEBUG nova.objects.instance [None req-fa21dde0-232a-4cee-ab2e-e6ab0de8d3c0 tempest-TestStampPattern-2120781434 tempest-TestStampPattern-2120781434-project-member] Lazy-loading 'flavor' on Instance uuid 9fd7c34a-55e7-4d54-9c60-03a7155a2685 {{(pid=75045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 23:30:50 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-fa21dde0-232a-4cee-ab2e-e6ab0de8d3c0 tempest-TestStampPattern-2120781434 tempest-TestStampPattern-2120781434-project-member] Lock "9fd7c34a-55e7-4d54-9c60-03a7155a2685" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.062s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:30:50 user nova-compute[75045]: DEBUG nova.network.neutron [req-01b73555-7c80-437b-9a15-e1a9e573854b req-5b39e70c-93ef-4d06-ac10-0508683a0e58 service nova] [instance: 9fd7c34a-55e7-4d54-9c60-03a7155a2685] Updated VIF entry in instance network info cache for port b44611d2-ca0a-4e01-b44d-cdf537474195. {{(pid=75045) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 23:30:50 user nova-compute[75045]: DEBUG nova.network.neutron [req-01b73555-7c80-437b-9a15-e1a9e573854b req-5b39e70c-93ef-4d06-ac10-0508683a0e58 service nova] [instance: 9fd7c34a-55e7-4d54-9c60-03a7155a2685] Updating instance_info_cache with network_info: [{"id": "b44611d2-ca0a-4e01-b44d-cdf537474195", "address": "fa:16:3e:64:cd:11", "network": {"id": "94c5462e-c9fd-44e6-b02b-9d46156ca7d9", "bridge": "br-int", "label": "tempest-TestStampPattern-1038298369-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.206", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "824ed65954dd4eccbe68827aa92fd99f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb44611d2-ca", "ovs_interfaceid": "b44611d2-ca0a-4e01-b44d-cdf537474195", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75045) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 23:30:50 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:30:50 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-01b73555-7c80-437b-9a15-e1a9e573854b req-5b39e70c-93ef-4d06-ac10-0508683a0e58 service nova] Releasing lock "refresh_cache-9fd7c34a-55e7-4d54-9c60-03a7155a2685" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 23:30:50 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5fc7f02-2143-4bcf-92ac-078d5ec10747/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:30:50 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:30:50 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/adcffd35-00c7-49db-a72f-d6307a90e123/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:30:50 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-fa21dde0-232a-4cee-ab2e-e6ab0de8d3c0 tempest-TestStampPattern-2120781434 tempest-TestStampPattern-2120781434-project-member] Acquiring lock "9fd7c34a-55e7-4d54-9c60-03a7155a2685" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:30:50 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-fa21dde0-232a-4cee-ab2e-e6ab0de8d3c0 tempest-TestStampPattern-2120781434 tempest-TestStampPattern-2120781434-project-member] Lock "9fd7c34a-55e7-4d54-9c60-03a7155a2685" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:30:50 user nova-compute[75045]: INFO nova.compute.manager [None req-fa21dde0-232a-4cee-ab2e-e6ab0de8d3c0 tempest-TestStampPattern-2120781434 tempest-TestStampPattern-2120781434-project-member] [instance: 9fd7c34a-55e7-4d54-9c60-03a7155a2685] Attaching volume 8e17f329-d05f-4dd4-aa42-c23613e96683 to /dev/vdb
Nov 08 23:30:50 user nova-compute[75045]: DEBUG os_brick.utils [None req-fa21dde0-232a-4cee-ab2e-e6ab0de8d3c0 tempest-TestStampPattern-2120781434 tempest-TestStampPattern-2120781434-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75045) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 23:30:50 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:30:50 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/adcffd35-00c7-49db-a72f-d6307a90e123/disk --force-share --output=json" returned: 0 in 0.239s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:30:50 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/adcffd35-00c7-49db-a72f-d6307a90e123/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:30:50 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:30:50 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.032s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:30:50 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[722c5c6c-2962-43bc-bd21-2547fddbf98f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6217bd6e884\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:30:50 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:30:50 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:30:50 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:30:50 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cafea3a-a603-4fc0-b128-61f645b8bcd9]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:30:50 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:30:50 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:30:50 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[f34a5ff4-83ff-41d2-9ad3-6a177668f3d5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:30:50 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f9b7967-fa43-4d71-aa83-feefdf41b5f7]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:30:50 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-fa21dde0-232a-4cee-ab2e-e6ab0de8d3c0 tempest-TestStampPattern-2120781434 tempest-TestStampPattern-2120781434-project-member] Running cmd (subprocess): nvme version {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:30:50 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-fa21dde0-232a-4cee-ab2e-e6ab0de8d3c0 tempest-TestStampPattern-2120781434 tempest-TestStampPattern-2120781434-project-member] 'nvme version' failed. Not Retrying. {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 23:30:50 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.nvmeof [None req-fa21dde0-232a-4cee-ab2e-e6ab0de8d3c0 tempest-TestStampPattern-2120781434 tempest-TestStampPattern-2120781434-project-member] nvme not present on system {{(pid=75045) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 23:30:50 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:30:50 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 23:30:50 user nova-compute[75045]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 23:30:50 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a6debe9-a03a-41df-89b3-dcf6c6963bdf]: (4, '') {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:30:50 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.lightos [None req-fa21dde0-232a-4cee-ab2e-e6ab0de8d3c0 tempest-TestStampPattern-2120781434 tempest-TestStampPattern-2120781434-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75045) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 23:30:50 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.lightos [None req-fa21dde0-232a-4cee-ab2e-e6ab0de8d3c0 tempest-TestStampPattern-2120781434 tempest-TestStampPattern-2120781434-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75045) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 23:30:50 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.lightos [None req-fa21dde0-232a-4cee-ab2e-e6ab0de8d3c0 tempest-TestStampPattern-2120781434 tempest-TestStampPattern-2120781434-project-member] LIGHTOS: no hostnqn found. {{(pid=75045) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 23:30:50 user nova-compute[75045]: DEBUG os_brick.utils [None req-fa21dde0-232a-4cee-ab2e-e6ab0de8d3c0 tempest-TestStampPattern-2120781434 tempest-TestStampPattern-2120781434-project-member] <== get_connector_properties: return (182ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6217bd6e884', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75045) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 23:30:50 user nova-compute[75045]: DEBUG nova.virt.block_device [None req-fa21dde0-232a-4cee-ab2e-e6ab0de8d3c0 tempest-TestStampPattern-2120781434 tempest-TestStampPattern-2120781434-project-member] [instance: 9fd7c34a-55e7-4d54-9c60-03a7155a2685] Updating existing volume attachment record: 04205c52-ad51-4fb6-9ea6-41c27f6588ac {{(pid=75045) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 23:30:50 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/adcffd35-00c7-49db-a72f-d6307a90e123/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:30:50 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b84f2b1-01a3-4789-bcef-8b7c4334132b/disk.rescue --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:30:50 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:30:50 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:30:50 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:30:50 user nova-compute[75045]: INFO nova.virt.libvirt.driver [-] [instance: e480a3c8-a7bc-4eea-b45f-d51f5b68ac0c] Instance destroyed successfully.
Nov 08 23:30:50 user nova-compute[75045]: DEBUG nova.objects.instance [None req-17a9f297-bd57-4f38-a282-259cebe77c57 tempest-VolumesAdminNegativeTest-215528111 tempest-VolumesAdminNegativeTest-215528111-project-member] Lazy-loading 'resources' on Instance uuid e480a3c8-a7bc-4eea-b45f-d51f5b68ac0c {{(pid=75045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 23:30:50 user nova-compute[75045]: DEBUG nova.virt.libvirt.vif [None req-17a9f297-bd57-4f38-a282-259cebe77c57 tempest-VolumesAdminNegativeTest-215528111 tempest-VolumesAdminNegativeTest-215528111-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T23:28:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1288858055',display_name='tempest-VolumesAdminNegativeTest-server-1288858055',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1288858055',id=29,image_ref='a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-08T23:28:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fd25d9a8d6af45bb97e0555101d61489',ramdisk_id='',reservation_id='r-a40op7uo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-215528111',owner_user_name='tempest-VolumesAdminNegativeTest-215528111-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T23:28:35Z,user_data=None,user_id='8e1203c75e084399aa70a7da8546b122',uuid=e480a3c8-a7bc-4eea-b45f-d51f5b68ac0c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4e478658-1101-428c-b08a-cc4de5d107d0", "address": "fa:16:3e:14:7d:ea", "network": {"id": "e7c66e39-e1ba-4907-8701-33ae849858b2", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-420335537-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd25d9a8d6af45bb97e0555101d61489", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e478658-11", "ovs_interfaceid": "4e478658-1101-428c-b08a-cc4de5d107d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75045) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 23:30:50 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-17a9f297-bd57-4f38-a282-259cebe77c57 tempest-VolumesAdminNegativeTest-215528111 tempest-VolumesAdminNegativeTest-215528111-project-member] Converting VIF {"id": "4e478658-1101-428c-b08a-cc4de5d107d0", "address": "fa:16:3e:14:7d:ea", "network": {"id": "e7c66e39-e1ba-4907-8701-33ae849858b2", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-420335537-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd25d9a8d6af45bb97e0555101d61489", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e478658-11", "ovs_interfaceid": "4e478658-1101-428c-b08a-cc4de5d107d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 23:30:50 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-17a9f297-bd57-4f38-a282-259cebe77c57 tempest-VolumesAdminNegativeTest-215528111 tempest-VolumesAdminNegativeTest-215528111-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:14:7d:ea,bridge_name='br-int',has_traffic_filtering=True,id=4e478658-1101-428c-b08a-cc4de5d107d0,network=Network(e7c66e39-e1ba-4907-8701-33ae849858b2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4e478658-11') {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 23:30:50 user nova-compute[75045]: DEBUG os_vif [None req-17a9f297-bd57-4f38-a282-259cebe77c57 tempest-VolumesAdminNegativeTest-215528111 tempest-VolumesAdminNegativeTest-215528111-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:14:7d:ea,bridge_name='br-int',has_traffic_filtering=True,id=4e478658-1101-428c-b08a-cc4de5d107d0,network=Network(e7c66e39-e1ba-4907-8701-33ae849858b2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4e478658-11') {{(pid=75045) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 23:30:51 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:30:51 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4e478658-11, bridge=br-int, if_exists=True) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:30:51 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b84f2b1-01a3-4789-bcef-8b7c4334132b/disk.rescue --force-share --output=json" returned: 0 in 0.226s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:30:51 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 23:30:51 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b84f2b1-01a3-4789-bcef-8b7c4334132b/disk.rescue --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:30:51 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:30:51 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:30:51 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9a7a466b-8e09-44ae-bc6f-cdd619b29b7c) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:30:51 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:30:51 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:30:51 user nova-compute[75045]: INFO os_vif [None req-17a9f297-bd57-4f38-a282-259cebe77c57 tempest-VolumesAdminNegativeTest-215528111 tempest-VolumesAdminNegativeTest-215528111-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:14:7d:ea,bridge_name='br-int',has_traffic_filtering=True,id=4e478658-1101-428c-b08a-cc4de5d107d0,network=Network(e7c66e39-e1ba-4907-8701-33ae849858b2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4e478658-11')
Nov 08 23:30:51 user nova-compute[75045]: INFO nova.virt.libvirt.driver [None req-17a9f297-bd57-4f38-a282-259cebe77c57 tempest-VolumesAdminNegativeTest-215528111 tempest-VolumesAdminNegativeTest-215528111-project-member] [instance: e480a3c8-a7bc-4eea-b45f-d51f5b68ac0c] Deleting instance files /opt/stack/data/nova/instances/e480a3c8-a7bc-4eea-b45f-d51f5b68ac0c_del
Nov 08 23:30:51 user nova-compute[75045]: INFO nova.virt.libvirt.driver [None req-17a9f297-bd57-4f38-a282-259cebe77c57 tempest-VolumesAdminNegativeTest-215528111 tempest-VolumesAdminNegativeTest-215528111-project-member] [instance: e480a3c8-a7bc-4eea-b45f-d51f5b68ac0c] Deletion of /opt/stack/data/nova/instances/e480a3c8-a7bc-4eea-b45f-d51f5b68ac0c_del complete
Nov 08 23:30:51 user nova-compute[75045]: INFO nova.compute.manager [None req-17a9f297-bd57-4f38-a282-259cebe77c57 tempest-VolumesAdminNegativeTest-215528111 tempest-VolumesAdminNegativeTest-215528111-project-member] [instance: e480a3c8-a7bc-4eea-b45f-d51f5b68ac0c] Took 1.02 seconds to destroy the instance on the hypervisor.
Nov 08 23:30:51 user nova-compute[75045]: DEBUG oslo.service.loopingcall [None req-17a9f297-bd57-4f38-a282-259cebe77c57 tempest-VolumesAdminNegativeTest-215528111 tempest-VolumesAdminNegativeTest-215528111-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75045) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 23:30:51 user nova-compute[75045]: DEBUG nova.compute.manager [-] [instance: e480a3c8-a7bc-4eea-b45f-d51f5b68ac0c] Deallocating network for instance {{(pid=75045) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 23:30:51 user nova-compute[75045]: DEBUG nova.network.neutron [-] [instance: e480a3c8-a7bc-4eea-b45f-d51f5b68ac0c] deallocate_for_instance() {{(pid=75045) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 23:30:51 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:30:51 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b84f2b1-01a3-4789-bcef-8b7c4334132b/disk.rescue --force-share --output=json" returned: 0 in 0.196s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:30:51 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b84f2b1-01a3-4789-bcef-8b7c4334132b/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:30:51 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:30:51 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b84f2b1-01a3-4789-bcef-8b7c4334132b/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:30:51 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b84f2b1-01a3-4789-bcef-8b7c4334132b/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:30:51 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:30:51 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b84f2b1-01a3-4789-bcef-8b7c4334132b/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:30:51 user nova-compute[75045]: DEBUG nova.compute.manager [req-898f9649-503d-44b6-af0d-5f19eb9f9fc3 req-fb346847-4ae9-4141-9f35-275bcb6a83ae service nova] [instance: e480a3c8-a7bc-4eea-b45f-d51f5b68ac0c] Received event network-vif-unplugged-4e478658-1101-428c-b08a-cc4de5d107d0 {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:30:51 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-898f9649-503d-44b6-af0d-5f19eb9f9fc3 req-fb346847-4ae9-4141-9f35-275bcb6a83ae service nova] Acquiring lock "e480a3c8-a7bc-4eea-b45f-d51f5b68ac0c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:30:51 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-898f9649-503d-44b6-af0d-5f19eb9f9fc3 req-fb346847-4ae9-4141-9f35-275bcb6a83ae service nova] Lock "e480a3c8-a7bc-4eea-b45f-d51f5b68ac0c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:30:51 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-898f9649-503d-44b6-af0d-5f19eb9f9fc3 req-fb346847-4ae9-4141-9f35-275bcb6a83ae service nova] Lock "e480a3c8-a7bc-4eea-b45f-d51f5b68ac0c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:30:51 user nova-compute[75045]: DEBUG nova.compute.manager [req-898f9649-503d-44b6-af0d-5f19eb9f9fc3 req-fb346847-4ae9-4141-9f35-275bcb6a83ae service nova] [instance: e480a3c8-a7bc-4eea-b45f-d51f5b68ac0c] No waiting events found dispatching network-vif-unplugged-4e478658-1101-428c-b08a-cc4de5d107d0 {{(pid=75045) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 23:30:51 user nova-compute[75045]: DEBUG nova.compute.manager [req-898f9649-503d-44b6-af0d-5f19eb9f9fc3 req-fb346847-4ae9-4141-9f35-275bcb6a83ae service nova] [instance: e480a3c8-a7bc-4eea-b45f-d51f5b68ac0c] Received event network-vif-unplugged-4e478658-1101-428c-b08a-cc4de5d107d0 for instance with task_state deleting. {{(pid=75045) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 23:30:51 user nova-compute[75045]: DEBUG nova.compute.manager [req-898f9649-503d-44b6-af0d-5f19eb9f9fc3 req-fb346847-4ae9-4141-9f35-275bcb6a83ae service nova] [instance: e480a3c8-a7bc-4eea-b45f-d51f5b68ac0c] Received event network-vif-plugged-4e478658-1101-428c-b08a-cc4de5d107d0 {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:30:51 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-898f9649-503d-44b6-af0d-5f19eb9f9fc3 req-fb346847-4ae9-4141-9f35-275bcb6a83ae service nova] Acquiring lock "e480a3c8-a7bc-4eea-b45f-d51f5b68ac0c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:30:51 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-898f9649-503d-44b6-af0d-5f19eb9f9fc3 req-fb346847-4ae9-4141-9f35-275bcb6a83ae service nova] Lock "e480a3c8-a7bc-4eea-b45f-d51f5b68ac0c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:30:51 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-898f9649-503d-44b6-af0d-5f19eb9f9fc3 req-fb346847-4ae9-4141-9f35-275bcb6a83ae service nova] Lock "e480a3c8-a7bc-4eea-b45f-d51f5b68ac0c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:30:51 user nova-compute[75045]: DEBUG nova.compute.manager [req-898f9649-503d-44b6-af0d-5f19eb9f9fc3 req-fb346847-4ae9-4141-9f35-275bcb6a83ae service nova] [instance: e480a3c8-a7bc-4eea-b45f-d51f5b68ac0c] No waiting events found dispatching network-vif-plugged-4e478658-1101-428c-b08a-cc4de5d107d0 {{(pid=75045) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 23:30:51 user nova-compute[75045]: WARNING nova.compute.manager [req-898f9649-503d-44b6-af0d-5f19eb9f9fc3 req-fb346847-4ae9-4141-9f35-275bcb6a83ae service nova] [instance: e480a3c8-a7bc-4eea-b45f-d51f5b68ac0c] Received unexpected event network-vif-plugged-4e478658-1101-428c-b08a-cc4de5d107d0 for instance with vm_state active and task_state deleting.
Nov 08 23:30:51 user nova-compute[75045]: DEBUG nova.compute.manager [req-898f9649-503d-44b6-af0d-5f19eb9f9fc3 req-fb346847-4ae9-4141-9f35-275bcb6a83ae service nova] [instance: e480a3c8-a7bc-4eea-b45f-d51f5b68ac0c] Received event network-vif-plugged-4e478658-1101-428c-b08a-cc4de5d107d0 {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:30:51 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-898f9649-503d-44b6-af0d-5f19eb9f9fc3 req-fb346847-4ae9-4141-9f35-275bcb6a83ae service nova] Acquiring lock "e480a3c8-a7bc-4eea-b45f-d51f5b68ac0c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:30:51 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-898f9649-503d-44b6-af0d-5f19eb9f9fc3 req-fb346847-4ae9-4141-9f35-275bcb6a83ae service nova] Lock "e480a3c8-a7bc-4eea-b45f-d51f5b68ac0c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:30:51 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-898f9649-503d-44b6-af0d-5f19eb9f9fc3 req-fb346847-4ae9-4141-9f35-275bcb6a83ae service nova] Lock "e480a3c8-a7bc-4eea-b45f-d51f5b68ac0c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:30:51 user nova-compute[75045]: DEBUG nova.compute.manager [req-898f9649-503d-44b6-af0d-5f19eb9f9fc3 req-fb346847-4ae9-4141-9f35-275bcb6a83ae service nova] [instance: e480a3c8-a7bc-4eea-b45f-d51f5b68ac0c] No waiting events found dispatching network-vif-plugged-4e478658-1101-428c-b08a-cc4de5d107d0 {{(pid=75045) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 23:30:51 user nova-compute[75045]: WARNING nova.compute.manager [req-898f9649-503d-44b6-af0d-5f19eb9f9fc3 req-fb346847-4ae9-4141-9f35-275bcb6a83ae service nova] [instance: e480a3c8-a7bc-4eea-b45f-d51f5b68ac0c] Received unexpected event network-vif-plugged-4e478658-1101-428c-b08a-cc4de5d107d0 for instance with vm_state active and task_state deleting.
Nov 08 23:30:51 user nova-compute[75045]: DEBUG nova.compute.manager [req-898f9649-503d-44b6-af0d-5f19eb9f9fc3 req-fb346847-4ae9-4141-9f35-275bcb6a83ae service nova] [instance: e480a3c8-a7bc-4eea-b45f-d51f5b68ac0c] Received event network-vif-plugged-4e478658-1101-428c-b08a-cc4de5d107d0 {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:30:51 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-898f9649-503d-44b6-af0d-5f19eb9f9fc3 req-fb346847-4ae9-4141-9f35-275bcb6a83ae service nova] Acquiring lock "e480a3c8-a7bc-4eea-b45f-d51f5b68ac0c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:30:51 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-898f9649-503d-44b6-af0d-5f19eb9f9fc3 req-fb346847-4ae9-4141-9f35-275bcb6a83ae service nova] Lock "e480a3c8-a7bc-4eea-b45f-d51f5b68ac0c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:30:51 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-898f9649-503d-44b6-af0d-5f19eb9f9fc3 req-fb346847-4ae9-4141-9f35-275bcb6a83ae service nova] Lock "e480a3c8-a7bc-4eea-b45f-d51f5b68ac0c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:30:51 user nova-compute[75045]: DEBUG nova.compute.manager [req-898f9649-503d-44b6-af0d-5f19eb9f9fc3 req-fb346847-4ae9-4141-9f35-275bcb6a83ae service nova] [instance: e480a3c8-a7bc-4eea-b45f-d51f5b68ac0c] No waiting events found dispatching network-vif-plugged-4e478658-1101-428c-b08a-cc4de5d107d0 {{(pid=75045) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 23:30:51 user nova-compute[75045]: WARNING nova.compute.manager [req-898f9649-503d-44b6-af0d-5f19eb9f9fc3 req-fb346847-4ae9-4141-9f35-275bcb6a83ae service nova] [instance: e480a3c8-a7bc-4eea-b45f-d51f5b68ac0c] Received unexpected event network-vif-plugged-4e478658-1101-428c-b08a-cc4de5d107d0 for instance with vm_state active and task_state deleting.
Nov 08 23:30:51 user nova-compute[75045]: DEBUG nova.network.neutron [-] [instance: e480a3c8-a7bc-4eea-b45f-d51f5b68ac0c] Updating instance_info_cache with network_info: [] {{(pid=75045) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 23:30:52 user nova-compute[75045]: DEBUG nova.compute.manager [req-51b04392-ec03-4592-9c4e-9889130b137a req-10b7b788-09ff-4558-8086-f340e9531f0d service nova] [instance: e480a3c8-a7bc-4eea-b45f-d51f5b68ac0c] Received event network-vif-deleted-4e478658-1101-428c-b08a-cc4de5d107d0 {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:30:52 user nova-compute[75045]: INFO nova.compute.manager [-] [instance: e480a3c8-a7bc-4eea-b45f-d51f5b68ac0c] Took 1.04 seconds to deallocate network for instance.
Nov 08 23:30:52 user nova-compute[75045]: WARNING nova.virt.libvirt.driver [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 23:30:52 user nova-compute[75045]: WARNING nova.virt.libvirt.driver [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 23:30:52 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Hypervisor/Node resource view: name=user free_ram=7084MB free_disk=24.83462142944336GB free_vcpus=-2 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75045) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 23:30:52 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:30:52 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:30:52 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-17a9f297-bd57-4f38-a282-259cebe77c57 tempest-VolumesAdminNegativeTest-215528111 tempest-VolumesAdminNegativeTest-215528111-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:30:52 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Applying migration context for instance 04169f59-e9a6-4b50-9ad7-7f8c105a376a as it has an incoming, in-progress migration 70a58e7e-3b1b-4b22-87a4-7bd063b467e1. Migration status is migrating {{(pid=75045) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 08 23:30:52 user nova-compute[75045]: INFO nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] [instance: 04169f59-e9a6-4b50-9ad7-7f8c105a376a] Updating resource usage from migration 70a58e7e-3b1b-4b22-87a4-7bd063b467e1
Nov 08 23:30:52 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Instance 4ae5ff6b-6f2c-4dfd-a4c6-da4809e2cf27 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75045) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 23:30:52 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Instance 0f21fcd3-ac5f-499e-9c34-82af806fda1d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75045) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 23:30:52 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Instance d2c911cf-d5f4-4c19-8335-8c7834184a7e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75045) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 23:30:52 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Instance b5fc7f02-2143-4bcf-92ac-078d5ec10747 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75045) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 23:30:52 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Instance 0b84f2b1-01a3-4789-bcef-8b7c4334132b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75045) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 23:30:52 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Instance fa67b237-f598-4111-87ba-d761aa50d95e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75045) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 23:30:52 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Instance 7e92ab9a-8ea4-4452-a458-db181d4a59b7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75045) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 23:30:52 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Instance 72c9d731-2b35-434c-8463-1cd6c18fbd6a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75045) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 23:30:52 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Instance 438082fc-a83f-4305-ada6-41a8e1d645a8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75045) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 23:30:52 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Instance 1a3c21c4-2db3-44e1-8a23-336ca9f8374d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75045) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 23:30:52 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Instance e480a3c8-a7bc-4eea-b45f-d51f5b68ac0c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75045) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 23:30:52 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Instance 9fd7c34a-55e7-4d54-9c60-03a7155a2685 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75045) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 23:30:52 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Instance adcffd35-00c7-49db-a72f-d6307a90e123 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75045) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 23:30:52 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Migration 70a58e7e-3b1b-4b22-87a4-7bd063b467e1 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75045) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 08 23:30:52 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Instance 04169f59-e9a6-4b50-9ad7-7f8c105a376a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75045) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 23:30:52 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Total usable vcpus: 12, total allocated vcpus: 15 {{(pid=75045) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 23:30:52 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Final resource view: name=user phys_ram=16011MB used_ram=9728MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=15 pci_stats=[] {{(pid=75045) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 23:30:52 user nova-compute[75045]: DEBUG nova.compute.provider_tree [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Inventory has not changed in ProviderTree for provider: 62ba5f85-c74d-4b58-986e-d4197e813fd7 {{(pid=75045) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 23:30:52 user nova-compute[75045]: DEBUG nova.scheduler.client.report [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Inventory has not changed for provider 62ba5f85-c74d-4b58-986e-d4197e813fd7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75045) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 23:30:52 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Compute_service record updated for user:user {{(pid=75045) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 23:30:52 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.698s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:30:52 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-17a9f297-bd57-4f38-a282-259cebe77c57 tempest-VolumesAdminNegativeTest-215528111 tempest-VolumesAdminNegativeTest-215528111-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.590s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:30:53 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:30:53 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:30:53 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:30:53 user nova-compute[75045]: DEBUG nova.compute.provider_tree [None req-17a9f297-bd57-4f38-a282-259cebe77c57 tempest-VolumesAdminNegativeTest-215528111 tempest-VolumesAdminNegativeTest-215528111-project-member] Inventory has not changed in ProviderTree for provider: 62ba5f85-c74d-4b58-986e-d4197e813fd7 {{(pid=75045) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 23:30:53 user nova-compute[75045]: DEBUG nova.scheduler.client.report [None req-17a9f297-bd57-4f38-a282-259cebe77c57 tempest-VolumesAdminNegativeTest-215528111 tempest-VolumesAdminNegativeTest-215528111-project-member] Inventory has not changed for provider 62ba5f85-c74d-4b58-986e-d4197e813fd7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75045) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 23:30:53 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-17a9f297-bd57-4f38-a282-259cebe77c57 tempest-VolumesAdminNegativeTest-215528111 tempest-VolumesAdminNegativeTest-215528111-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.587s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:30:53 user nova-compute[75045]: ERROR nova.volume.cinder [None req-fa21dde0-232a-4cee-ab2e-e6ab0de8d3c0 tempest-TestStampPattern-2120781434 tempest-TestStampPattern-2120781434-project-member] Update attachment failed for attachment 04205c52-ad51-4fb6-9ea6-41c27f6588ac. Error: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-563f890c-77c0-4eae-98f2-6362c64ec16d) Code: 500: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-563f890c-77c0-4eae-98f2-6362c64ec16d)
Nov 08 23:30:53 user nova-compute[75045]: ERROR nova.compute.manager [None req-fa21dde0-232a-4cee-ab2e-e6ab0de8d3c0 tempest-TestStampPattern-2120781434 tempest-TestStampPattern-2120781434-project-member] [instance: 9fd7c34a-55e7-4d54-9c60-03a7155a2685] Failed to attach 8e17f329-d05f-4dd4-aa42-c23613e96683 at /dev/vdb: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-563f890c-77c0-4eae-98f2-6362c64ec16d)
Nov 08 23:30:53 user nova-compute[75045]: ERROR nova.compute.manager [instance: 9fd7c34a-55e7-4d54-9c60-03a7155a2685] Traceback (most recent call last):
Nov 08 23:30:53 user nova-compute[75045]: ERROR nova.compute.manager [instance: 9fd7c34a-55e7-4d54-9c60-03a7155a2685]   File "/opt/stack/nova/nova/compute/manager.py", line 7567, in _attach_volume
Nov 08 23:30:53 user nova-compute[75045]: ERROR nova.compute.manager [instance: 9fd7c34a-55e7-4d54-9c60-03a7155a2685]     bdm.attach(context, instance, self.volume_api, self.driver,
Nov 08 23:30:53 user nova-compute[75045]: ERROR nova.compute.manager [instance: 9fd7c34a-55e7-4d54-9c60-03a7155a2685]   File "/opt/stack/nova/nova/virt/block_device.py", line 46, in wrapped
Nov 08 23:30:53 user nova-compute[75045]: ERROR nova.compute.manager [instance: 9fd7c34a-55e7-4d54-9c60-03a7155a2685]     ret_val = method(obj, context, *args, **kwargs)
Nov 08 23:30:53 user nova-compute[75045]: ERROR nova.compute.manager [instance: 9fd7c34a-55e7-4d54-9c60-03a7155a2685]   File "/opt/stack/nova/nova/virt/block_device.py", line 734, in attach
Nov 08 23:30:53 user nova-compute[75045]: ERROR nova.compute.manager [instance: 9fd7c34a-55e7-4d54-9c60-03a7155a2685]     self._do_attach(context, instance, volume, volume_api,
Nov 08 23:30:53 user nova-compute[75045]: ERROR nova.compute.manager [instance: 9fd7c34a-55e7-4d54-9c60-03a7155a2685]   File "/opt/stack/nova/nova/virt/block_device.py", line 719, in _do_attach
Nov 08 23:30:53 user nova-compute[75045]: ERROR nova.compute.manager [instance: 9fd7c34a-55e7-4d54-9c60-03a7155a2685]     self._volume_attach(context, volume, connector, instance,
Nov 08 23:30:53 user nova-compute[75045]: ERROR nova.compute.manager [instance: 9fd7c34a-55e7-4d54-9c60-03a7155a2685]   File "/opt/stack/nova/nova/virt/block_device.py", line 633, in _volume_attach
Nov 08 23:30:53 user nova-compute[75045]: ERROR nova.compute.manager [instance: 9fd7c34a-55e7-4d54-9c60-03a7155a2685]     connection_info = volume_api.attachment_update(
Nov 08 23:30:53 user nova-compute[75045]: ERROR nova.compute.manager [instance: 9fd7c34a-55e7-4d54-9c60-03a7155a2685]   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 08 23:30:53 user nova-compute[75045]: ERROR nova.compute.manager [instance: 9fd7c34a-55e7-4d54-9c60-03a7155a2685]     res = method(self, ctx, *args, **kwargs)
Nov 08 23:30:53 user nova-compute[75045]: ERROR nova.compute.manager [instance: 9fd7c34a-55e7-4d54-9c60-03a7155a2685]   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Nov 08 23:30:53 user nova-compute[75045]: ERROR nova.compute.manager [instance: 9fd7c34a-55e7-4d54-9c60-03a7155a2685]     res = method(self, ctx, attachment_id, *args, **kwargs)
Nov 08 23:30:53 user nova-compute[75045]: ERROR nova.compute.manager [instance: 9fd7c34a-55e7-4d54-9c60-03a7155a2685]   File "/opt/stack/nova/nova/volume/cinder.py", line 915, in attachment_update
Nov 08 23:30:53 user nova-compute[75045]: ERROR nova.compute.manager [instance: 9fd7c34a-55e7-4d54-9c60-03a7155a2685]     with excutils.save_and_reraise_exception():
Nov 08 23:30:53 user nova-compute[75045]: ERROR nova.compute.manager [instance: 9fd7c34a-55e7-4d54-9c60-03a7155a2685]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 08 23:30:53 user nova-compute[75045]: ERROR nova.compute.manager [instance: 9fd7c34a-55e7-4d54-9c60-03a7155a2685]     self.force_reraise()
Nov 08 23:30:53 user nova-compute[75045]: ERROR nova.compute.manager [instance: 9fd7c34a-55e7-4d54-9c60-03a7155a2685]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 08 23:30:53 user nova-compute[75045]: ERROR nova.compute.manager [instance: 9fd7c34a-55e7-4d54-9c60-03a7155a2685]     raise self.value
Nov 08 23:30:53 user nova-compute[75045]: ERROR nova.compute.manager [instance: 9fd7c34a-55e7-4d54-9c60-03a7155a2685]   File "/opt/stack/nova/nova/volume/cinder.py", line 909, in attachment_update
Nov 08 23:30:53 user nova-compute[75045]: ERROR nova.compute.manager [instance: 9fd7c34a-55e7-4d54-9c60-03a7155a2685]     context, '3.44', skip_version_check=True).attachments.update(
Nov 08 23:30:53 user nova-compute[75045]: ERROR nova.compute.manager [instance: 9fd7c34a-55e7-4d54-9c60-03a7155a2685]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Nov 08 23:30:53 user nova-compute[75045]: ERROR nova.compute.manager [instance: 9fd7c34a-55e7-4d54-9c60-03a7155a2685]     return method.func(obj, *args, **kwargs)
Nov 08 23:30:53 user nova-compute[75045]: ERROR nova.compute.manager [instance: 9fd7c34a-55e7-4d54-9c60-03a7155a2685]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Nov 08 23:30:53 user nova-compute[75045]: ERROR nova.compute.manager [instance: 9fd7c34a-55e7-4d54-9c60-03a7155a2685]     resp = self._update('/attachments/%s' % id, body)
Nov 08 23:30:53 user nova-compute[75045]: ERROR nova.compute.manager [instance: 9fd7c34a-55e7-4d54-9c60-03a7155a2685]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Nov 08 23:30:53 user nova-compute[75045]: ERROR nova.compute.manager [instance: 9fd7c34a-55e7-4d54-9c60-03a7155a2685]     resp, body = self.api.client.put(url, body=body, **kwargs)
Nov 08 23:30:53 user nova-compute[75045]: ERROR nova.compute.manager [instance: 9fd7c34a-55e7-4d54-9c60-03a7155a2685]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Nov 08 23:30:53 user nova-compute[75045]: ERROR nova.compute.manager [instance: 9fd7c34a-55e7-4d54-9c60-03a7155a2685]     return self._cs_request(url, 'PUT', **kwargs)
Nov 08 23:30:53 user nova-compute[75045]: ERROR nova.compute.manager [instance: 9fd7c34a-55e7-4d54-9c60-03a7155a2685]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 08 23:30:53 user nova-compute[75045]: ERROR nova.compute.manager [instance: 9fd7c34a-55e7-4d54-9c60-03a7155a2685]     return self.request(url, method, **kwargs)
Nov 08 23:30:53 user nova-compute[75045]: ERROR nova.compute.manager [instance: 9fd7c34a-55e7-4d54-9c60-03a7155a2685]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 08 23:30:53 user nova-compute[75045]: ERROR nova.compute.manager [instance: 9fd7c34a-55e7-4d54-9c60-03a7155a2685]     raise exceptions.from_response(resp, body)
Nov 08 23:30:53 user nova-compute[75045]: ERROR nova.compute.manager [instance: 9fd7c34a-55e7-4d54-9c60-03a7155a2685] cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-563f890c-77c0-4eae-98f2-6362c64ec16d)
Nov 08 23:30:53 user nova-compute[75045]: ERROR nova.compute.manager [instance: 9fd7c34a-55e7-4d54-9c60-03a7155a2685] 
Nov 08 23:30:53 user nova-compute[75045]: INFO nova.scheduler.client.report [None req-17a9f297-bd57-4f38-a282-259cebe77c57 tempest-VolumesAdminNegativeTest-215528111 tempest-VolumesAdminNegativeTest-215528111-project-member] Deleted allocations for instance e480a3c8-a7bc-4eea-b45f-d51f5b68ac0c
Nov 08 23:30:53 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-17a9f297-bd57-4f38-a282-259cebe77c57 tempest-VolumesAdminNegativeTest-215528111 tempest-VolumesAdminNegativeTest-215528111-project-member] Lock "e480a3c8-a7bc-4eea-b45f-d51f5b68ac0c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.553s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:30:53 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-fa21dde0-232a-4cee-ab2e-e6ab0de8d3c0 tempest-TestStampPattern-2120781434 tempest-TestStampPattern-2120781434-project-member] Lock "9fd7c34a-55e7-4d54-9c60-03a7155a2685" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 3.216s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:30:53 user nova-compute[75045]: ERROR oslo_messaging.rpc.server [None req-fa21dde0-232a-4cee-ab2e-e6ab0de8d3c0 tempest-TestStampPattern-2120781434 tempest-TestStampPattern-2120781434-project-member] Exception during message handling: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-563f890c-77c0-4eae-98f2-6362c64ec16d)
Nov 08 23:30:53 user nova-compute[75045]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 08 23:30:53 user nova-compute[75045]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Nov 08 23:30:53 user nova-compute[75045]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Nov 08 23:30:53 user nova-compute[75045]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Nov 08 23:30:53 user nova-compute[75045]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Nov 08 23:30:53 user nova-compute[75045]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Nov 08 23:30:53 user nova-compute[75045]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Nov 08 23:30:53 user nova-compute[75045]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Nov 08 23:30:53 user nova-compute[75045]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 08 23:30:53 user nova-compute[75045]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 08 23:30:53 user nova-compute[75045]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 08 23:30:53 user nova-compute[75045]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 08 23:30:53 user nova-compute[75045]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 08 23:30:53 user nova-compute[75045]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Nov 08 23:30:53 user nova-compute[75045]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Nov 08 23:30:53 user nova-compute[75045]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/utils.py", line 1439, in decorated_function
Nov 08 23:30:53 user nova-compute[75045]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Nov 08 23:30:53 user nova-compute[75045]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 213, in decorated_function
Nov 08 23:30:53 user nova-compute[75045]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 08 23:30:53 user nova-compute[75045]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 08 23:30:53 user nova-compute[75045]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 08 23:30:53 user nova-compute[75045]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 08 23:30:53 user nova-compute[75045]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 08 23:30:53 user nova-compute[75045]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 203, in decorated_function
Nov 08 23:30:53 user nova-compute[75045]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Nov 08 23:30:53 user nova-compute[75045]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7553, in attach_volume
Nov 08 23:30:53 user nova-compute[75045]: ERROR oslo_messaging.rpc.server     do_attach_volume(context, instance, driver_bdm)
Nov 08 23:30:53 user nova-compute[75045]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py", line 414, in inner
Nov 08 23:30:53 user nova-compute[75045]: ERROR oslo_messaging.rpc.server     return f(*args, **kwargs)
Nov 08 23:30:53 user nova-compute[75045]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7550, in do_attach_volume
Nov 08 23:30:53 user nova-compute[75045]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 08 23:30:53 user nova-compute[75045]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 08 23:30:53 user nova-compute[75045]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 08 23:30:53 user nova-compute[75045]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 08 23:30:53 user nova-compute[75045]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 08 23:30:53 user nova-compute[75045]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7548, in do_attach_volume
Nov 08 23:30:53 user nova-compute[75045]: ERROR oslo_messaging.rpc.server     return self._attach_volume(context, instance, driver_bdm)
Nov 08 23:30:53 user nova-compute[75045]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7570, in _attach_volume
Nov 08 23:30:53 user nova-compute[75045]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 08 23:30:53 user nova-compute[75045]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 08 23:30:53 user nova-compute[75045]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 08 23:30:53 user nova-compute[75045]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 08 23:30:53 user nova-compute[75045]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 08 23:30:53 user nova-compute[75045]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7567, in _attach_volume
Nov 08 23:30:53 user nova-compute[75045]: ERROR oslo_messaging.rpc.server     bdm.attach(context, instance, self.volume_api, self.driver,
Nov 08 23:30:53 user nova-compute[75045]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 46, in wrapped
Nov 08 23:30:53 user nova-compute[75045]: ERROR oslo_messaging.rpc.server     ret_val = method(obj, context, *args, **kwargs)
Nov 08 23:30:53 user nova-compute[75045]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 734, in attach
Nov 08 23:30:53 user nova-compute[75045]: ERROR oslo_messaging.rpc.server     self._do_attach(context, instance, volume, volume_api,
Nov 08 23:30:53 user nova-compute[75045]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 719, in _do_attach
Nov 08 23:30:53 user nova-compute[75045]: ERROR oslo_messaging.rpc.server     self._volume_attach(context, volume, connector, instance,
Nov 08 23:30:53 user nova-compute[75045]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 633, in _volume_attach
Nov 08 23:30:53 user nova-compute[75045]: ERROR oslo_messaging.rpc.server     connection_info = volume_api.attachment_update(
Nov 08 23:30:53 user nova-compute[75045]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 08 23:30:53 user nova-compute[75045]: ERROR oslo_messaging.rpc.server     res = method(self, ctx, *args, **kwargs)
Nov 08 23:30:53 user nova-compute[75045]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Nov 08 23:30:53 user nova-compute[75045]: ERROR oslo_messaging.rpc.server     res = method(self, ctx, attachment_id, *args, **kwargs)
Nov 08 23:30:53 user nova-compute[75045]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 915, in attachment_update
Nov 08 23:30:53 user nova-compute[75045]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 08 23:30:53 user nova-compute[75045]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 08 23:30:53 user nova-compute[75045]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 08 23:30:53 user nova-compute[75045]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 08 23:30:53 user nova-compute[75045]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 08 23:30:53 user nova-compute[75045]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 909, in attachment_update
Nov 08 23:30:53 user nova-compute[75045]: ERROR oslo_messaging.rpc.server     context, '3.44', skip_version_check=True).attachments.update(
Nov 08 23:30:53 user nova-compute[75045]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Nov 08 23:30:53 user nova-compute[75045]: ERROR oslo_messaging.rpc.server     return method.func(obj, *args, **kwargs)
Nov 08 23:30:53 user nova-compute[75045]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Nov 08 23:30:53 user nova-compute[75045]: ERROR oslo_messaging.rpc.server     resp = self._update('/attachments/%s' % id, body)
Nov 08 23:30:53 user nova-compute[75045]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Nov 08 23:30:53 user nova-compute[75045]: ERROR oslo_messaging.rpc.server     resp, body = self.api.client.put(url, body=body, **kwargs)
Nov 08 23:30:53 user nova-compute[75045]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Nov 08 23:30:53 user nova-compute[75045]: ERROR oslo_messaging.rpc.server     return self._cs_request(url, 'PUT', **kwargs)
Nov 08 23:30:53 user nova-compute[75045]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 08 23:30:53 user nova-compute[75045]: ERROR oslo_messaging.rpc.server     return self.request(url, method, **kwargs)
Nov 08 23:30:53 user nova-compute[75045]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 08 23:30:53 user nova-compute[75045]: ERROR oslo_messaging.rpc.server     raise exceptions.from_response(resp, body)
Nov 08 23:30:53 user nova-compute[75045]: ERROR oslo_messaging.rpc.server cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-563f890c-77c0-4eae-98f2-6362c64ec16d)
Nov 08 23:30:53 user nova-compute[75045]: ERROR oslo_messaging.rpc.server 
Nov 08 23:30:53 user nova-compute[75045]: DEBUG nova.network.neutron [None req-770b29ea-77d8-4656-a91a-1f6daecbd674 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] [instance: 04169f59-e9a6-4b50-9ad7-7f8c105a376a] Port 96af9673-bb3c-4173-8439-0be6d2b922cf binding to destination host user is already ACTIVE {{(pid=75045) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Nov 08 23:30:53 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-770b29ea-77d8-4656-a91a-1f6daecbd674 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Acquiring lock "04169f59-e9a6-4b50-9ad7-7f8c105a376a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:30:53 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-770b29ea-77d8-4656-a91a-1f6daecbd674 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Lock "04169f59-e9a6-4b50-9ad7-7f8c105a376a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:30:53 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-770b29ea-77d8-4656-a91a-1f6daecbd674 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Lock "04169f59-e9a6-4b50-9ad7-7f8c105a376a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:30:53 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-770b29ea-77d8-4656-a91a-1f6daecbd674 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Acquiring lock "refresh_cache-04169f59-e9a6-4b50-9ad7-7f8c105a376a" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 23:30:53 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-770b29ea-77d8-4656-a91a-1f6daecbd674 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Acquired lock "refresh_cache-04169f59-e9a6-4b50-9ad7-7f8c105a376a" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 23:30:53 user nova-compute[75045]: DEBUG nova.network.neutron [None req-770b29ea-77d8-4656-a91a-1f6daecbd674 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] [instance: 04169f59-e9a6-4b50-9ad7-7f8c105a376a] Building network info cache for instance {{(pid=75045) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 23:30:54 user nova-compute[75045]: DEBUG nova.network.neutron [None req-770b29ea-77d8-4656-a91a-1f6daecbd674 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] [instance: 04169f59-e9a6-4b50-9ad7-7f8c105a376a] Updating instance_info_cache with network_info: [{"id": "96af9673-bb3c-4173-8439-0be6d2b922cf", "address": "fa:16:3e:a5:6d:8b", "network": {"id": "700b5784-d35b-45c0-a4d3-1ab8aa4c48aa", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-194469807-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.175", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e63623113f11463d9035bb990de43510", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96af9673-bb", "ovs_interfaceid": "96af9673-bb3c-4173-8439-0be6d2b922cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75045) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 23:30:54 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-770b29ea-77d8-4656-a91a-1f6daecbd674 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Releasing lock "refresh_cache-04169f59-e9a6-4b50-9ad7-7f8c105a376a" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 23:30:54 user nova-compute[75045]: DEBUG os_brick.utils [None req-770b29ea-77d8-4656-a91a-1f6daecbd674 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75045) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 23:30:54 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:30:54 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:30:54 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f1713f6-1ea3-45f4-be96-e14a4595c106]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6217bd6e884\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:30:54 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:30:54 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:30:54 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[4474fa93-492a-408f-be29-e6132b59c7b3]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:30:54 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:30:54 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:30:54 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa99295c-0cf8-46b3-982a-581f091cbc2b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:30:54 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[9db12774-f8c8-45a6-a3fe-97117b058e64]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:30:54 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-770b29ea-77d8-4656-a91a-1f6daecbd674 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Running cmd (subprocess): nvme version {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:30:54 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-770b29ea-77d8-4656-a91a-1f6daecbd674 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] 'nvme version' failed. Not Retrying. {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 23:30:54 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.nvmeof [None req-770b29ea-77d8-4656-a91a-1f6daecbd674 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] nvme not present on system {{(pid=75045) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 23:30:54 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:30:54 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 23:30:54 user nova-compute[75045]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 23:30:54 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[55678ee3-e760-4252-8b51-486f42a57c56]: (4, '') {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:30:54 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.lightos [None req-770b29ea-77d8-4656-a91a-1f6daecbd674 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75045) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 23:30:54 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.lightos [None req-770b29ea-77d8-4656-a91a-1f6daecbd674 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75045) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 23:30:54 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.lightos [None req-770b29ea-77d8-4656-a91a-1f6daecbd674 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] LIGHTOS: no hostnqn found. {{(pid=75045) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 23:30:54 user nova-compute[75045]: DEBUG os_brick.utils [None req-770b29ea-77d8-4656-a91a-1f6daecbd674 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6217bd6e884', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75045) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 23:30:56 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:30:56 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:31:01 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:31:02 user nova-compute[75045]: WARNING nova.virt.libvirt.driver [None req-39de6ea0-f4fc-4a63-aa48-408c72bb5b54 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 1a3c21c4-2db3-44e1-8a23-336ca9f8374d is timed out.
Nov 08 23:31:02 user nova-compute[75045]: INFO nova.virt.libvirt.driver [None req-39de6ea0-f4fc-4a63-aa48-408c72bb5b54 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Successfully detached device vdb from instance 1a3c21c4-2db3-44e1-8a23-336ca9f8374d from the live domain config.
Nov 08 23:31:02 user nova-compute[75045]: DEBUG nova.virt.libvirt.volume.iscsi [None req-39de6ea0-f4fc-4a63-aa48-408c72bb5b54 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] [instance: 1a3c21c4-2db3-44e1-8a23-336ca9f8374d] calling os-brick to detach iSCSI Volume {{(pid=75045) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 23:31:02 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-39de6ea0-f4fc-4a63-aa48-408c72bb5b54 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1b68210460>, {'target_iqn': 'iqn.2010-10.org.openstack:fa72cf0a-1134-47a3-abd2-6a51f4f20393', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OxlVGiFe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75045) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 23:31:02 user nova-compute[75045]: WARNING os_brick.initiator.connectors.base [None req-39de6ea0-f4fc-4a63-aa48-408c72bb5b54 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 23:31:02 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-39de6ea0-f4fc-4a63-aa48-408c72bb5b54 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 23:31:02 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-39de6ea0-f4fc-4a63-aa48-408c72bb5b54 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 23:31:02 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:31:02 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:31:02 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[356042e9-a8a4-4d72-81b0-f545edb3eda9]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:fa72cf0a-1134-47a3-abd2-6a51f4f20393\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:83187c89-e833-4efd-afa0-2cbfe05d8db1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:31:02 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-39de6ea0-f4fc-4a63-aa48-408c72bb5b54 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 23:31:02 user nova-compute[75045]: No targets found.
Nov 08 23:31:02 user nova-compute[75045]: iSNS:
Nov 08 23:31:02 user nova-compute[75045]: No targets found.
Nov 08 23:31:02 user nova-compute[75045]: STATIC:
Nov 08 23:31:02 user nova-compute[75045]: Target: iqn.2010-10.org.openstack:fa72cf0a-1134-47a3-abd2-6a51f4f20393
Nov 08 23:31:02 user nova-compute[75045]:         Portal: 172.16.0.220:3260,-1
Nov 08 23:31:02 user nova-compute[75045]:                 Iface Name: default
Nov 08 23:31:02 user nova-compute[75045]: Target: iqn.2010-10.org.openstack:83187c89-e833-4efd-afa0-2cbfe05d8db1
Nov 08 23:31:02 user nova-compute[75045]:         Portal: 172.16.0.220:3260,-1
Nov 08 23:31:02 user nova-compute[75045]:                 Iface Name: default
Nov 08 23:31:02 user nova-compute[75045]: Target: iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab
Nov 08 23:31:02 user nova-compute[75045]:         Portal: 172.16.0.220:3260,-1
Nov 08 23:31:02 user nova-compute[75045]:                 Iface Name: default
Nov 08 23:31:02 user nova-compute[75045]: FIRMWARE:
Nov 08 23:31:02 user nova-compute[75045]: No targets found.
Nov 08 23:31:02 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 23:31:02 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-39de6ea0-f4fc-4a63-aa48-408c72bb5b54 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 23:31:02 user nova-compute[75045]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 23:31:02 user nova-compute[75045]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75045) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 23:31:02 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-39de6ea0-f4fc-4a63-aa48-408c72bb5b54 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fa72cf0a-1134-47a3-abd2-6a51f4f20393', 0)] {{(pid=75045) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 23:31:02 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:31:02 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:31:02 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdc92bf9-3dad-48b3-84a0-20f1fd1b9edb]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:83187c89-e833-4efd-afa0-2cbfe05d8db1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fa72cf0a-1134-47a3-abd2-6a51f4f20393\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:31:02 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:31:02 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:31:02 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[90ac39cd-248c-4da6-be90-1213be868dd3]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83187c89-e833-4efd-afa0-2cbfe05d8db1 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa72cf0a-1134-47a3-abd2-6a51f4f20393 (non-flash)\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:31:02 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-39de6ea0-f4fc-4a63-aa48-408c72bb5b54 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab (non-flash)
Nov 08 23:31:02 user nova-compute[75045]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83187c89-e833-4efd-afa0-2cbfe05d8db1 (non-flash)
Nov 08 23:31:02 user nova-compute[75045]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa72cf0a-1134-47a3-abd2-6a51f4f20393 (non-flash)
Nov 08 23:31:02 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 23:31:02 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-39de6ea0-f4fc-4a63-aa48-408c72bb5b54 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab (non-flash)
Nov 08 23:31:02 user nova-compute[75045]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83187c89-e833-4efd-afa0-2cbfe05d8db1 (non-flash)
Nov 08 23:31:02 user nova-compute[75045]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa72cf0a-1134-47a3-abd2-6a51f4f20393 (non-flash)
Nov 08 23:31:02 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 23:31:02 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-39de6ea0-f4fc-4a63-aa48-408c72bb5b54 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1b485d3250>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fa72cf0a-1134-47a3-abd2-6a51f4f20393'): ({'sdc'}, set())}) {{(pid=75045) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 23:31:02 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-39de6ea0-f4fc-4a63-aa48-408c72bb5b54 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Removing single pathed devices sdc {{(pid=75045) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 23:31:02 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:31:02 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:31:02 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf325302-76d6-4081-a9f0-a01283f77728]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:31:02 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:31:02 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:31:02 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[d57ef6f3-af05-43aa-a18a-5122ce3f5074]: (4, ('ok\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:31:02 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-39de6ea0-f4fc-4a63-aa48-408c72bb5b54 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Flushing IO for device /dev/sdc {{(pid=75045) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 23:31:02 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:31:02 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:31:02 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[24653da8-71b9-48b8-b5a2-70efa295bbde]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:31:02 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-39de6ea0-f4fc-4a63-aa48-408c72bb5b54 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75045) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 23:31:02 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:31:02 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.038s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:31:02 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f4585b3-c9e7-49b5-b136-a1f17afae3e1]: (4, ('1', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:31:02 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-39de6ea0-f4fc-4a63-aa48-408c72bb5b54 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75045) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 23:31:02 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-39de6ea0-f4fc-4a63-aa48-408c72bb5b54 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] SCSI volumes sdc have been removed. {{(pid=75045) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 23:31:02 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-39de6ea0-f4fc-4a63-aa48-408c72bb5b54 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fa72cf0a-1134-47a3-abd2-6a51f4f20393')] {{(pid=75045) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 23:31:02 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa72cf0a-1134-47a3-abd2-6a51f4f20393 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:31:02 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa72cf0a-1134-47a3-abd2-6a51f4f20393 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:31:02 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[022cf685-9831-4493-bf68-cfb95847489c]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:31:02 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-39de6ea0-f4fc-4a63-aa48-408c72bb5b54 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:31:02 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa72cf0a-1134-47a3-abd2-6a51f4f20393 -p 172.16.0.220:3260 --logout {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:31:02 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa72cf0a-1134-47a3-abd2-6a51f4f20393 -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:31:02 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c1ae6da-828a-421c-bdb7-c469f5780533]: (4, ('Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:fa72cf0a-1134-47a3-abd2-6a51f4f20393, portal: 172.16.0.220,3260]\nLogout of [sid: 30, target: iqn.2010-10.org.openstack:fa72cf0a-1134-47a3-abd2-6a51f4f20393, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:31:02 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-39de6ea0-f4fc-4a63-aa48-408c72bb5b54 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:fa72cf0a-1134-47a3-abd2-6a51f4f20393, portal: 172.16.0.220,3260]
Nov 08 23:31:02 user nova-compute[75045]: Logout of [sid: 30, target: iqn.2010-10.org.openstack:fa72cf0a-1134-47a3-abd2-6a51f4f20393, portal: 172.16.0.220,3260] successful.
Nov 08 23:31:02 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:31:02 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa72cf0a-1134-47a3-abd2-6a51f4f20393 -p 172.16.0.220:3260 --op delete {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:31:02 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa72cf0a-1134-47a3-abd2-6a51f4f20393 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:31:02 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb997dca-a6ae-4054-985a-e49c319a5a7c]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:31:02 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-39de6ea0-f4fc-4a63-aa48-408c72bb5b54 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:31:02 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-39de6ea0-f4fc-4a63-aa48-408c72bb5b54 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.309s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 23:31:02 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-39de6ea0-f4fc-4a63-aa48-408c72bb5b54 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] <== disconnect_volume: return (311ms) None {{(pid=75045) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 23:31:02 user nova-compute[75045]: DEBUG nova.virt.libvirt.volume.iscsi [None req-39de6ea0-f4fc-4a63-aa48-408c72bb5b54 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] [instance: 1a3c21c4-2db3-44e1-8a23-336ca9f8374d] Disconnected iSCSI Volume {{(pid=75045) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 23:31:06 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 23:31:06 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:31:11 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:31:11 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:31:16 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:31:16 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:31:17 user nova-compute[75045]: DEBUG nova.compute.manager [req-c184e1e7-60b0-44d0-b176-0a096b65ed2b req-72653066-b192-4d97-8520-ab2d076f3503 service nova] [instance: adcffd35-00c7-49db-a72f-d6307a90e123] Received event network-changed-cbed987e-37ab-4cb9-b01a-ecad76d98f21 {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:31:17 user nova-compute[75045]: DEBUG nova.compute.manager [req-c184e1e7-60b0-44d0-b176-0a096b65ed2b req-72653066-b192-4d97-8520-ab2d076f3503 service nova] [instance: adcffd35-00c7-49db-a72f-d6307a90e123] Refreshing instance network info cache due to event network-changed-cbed987e-37ab-4cb9-b01a-ecad76d98f21. {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 23:31:17 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-c184e1e7-60b0-44d0-b176-0a096b65ed2b req-72653066-b192-4d97-8520-ab2d076f3503 service nova] Acquiring lock "refresh_cache-adcffd35-00c7-49db-a72f-d6307a90e123" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 23:31:17 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-c184e1e7-60b0-44d0-b176-0a096b65ed2b req-72653066-b192-4d97-8520-ab2d076f3503 service nova] Acquired lock "refresh_cache-adcffd35-00c7-49db-a72f-d6307a90e123" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 23:31:17 user nova-compute[75045]: DEBUG nova.network.neutron [req-c184e1e7-60b0-44d0-b176-0a096b65ed2b req-72653066-b192-4d97-8520-ab2d076f3503 service nova] [instance: adcffd35-00c7-49db-a72f-d6307a90e123] Refreshing network info cache for port cbed987e-37ab-4cb9-b01a-ecad76d98f21 {{(pid=75045) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 23:31:18 user nova-compute[75045]: DEBUG nova.network.neutron [req-c184e1e7-60b0-44d0-b176-0a096b65ed2b req-72653066-b192-4d97-8520-ab2d076f3503 service nova] [instance: adcffd35-00c7-49db-a72f-d6307a90e123] Updated VIF entry in instance network info cache for port cbed987e-37ab-4cb9-b01a-ecad76d98f21. {{(pid=75045) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 23:31:18 user nova-compute[75045]: DEBUG nova.network.neutron [req-c184e1e7-60b0-44d0-b176-0a096b65ed2b req-72653066-b192-4d97-8520-ab2d076f3503 service nova] [instance: adcffd35-00c7-49db-a72f-d6307a90e123] Updating instance_info_cache with network_info: [{"id": "cbed987e-37ab-4cb9-b01a-ecad76d98f21", "address": "fa:16:3e:60:a2:7b", "network": {"id": "fe74884d-c24e-4be8-b45a-eb825b3563a3", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1344943603-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.6", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3343bcd412b54ef0bcfed8be47b0353a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbed987e-37", "ovs_interfaceid": "cbed987e-37ab-4cb9-b01a-ecad76d98f21", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75045) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 23:31:18 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-c184e1e7-60b0-44d0-b176-0a096b65ed2b req-72653066-b192-4d97-8520-ab2d076f3503 service nova] Releasing lock "refresh_cache-adcffd35-00c7-49db-a72f-d6307a90e123" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 23:31:18 user nova-compute[75045]: DEBUG nova.objects.instance [None req-39de6ea0-f4fc-4a63-aa48-408c72bb5b54 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Lazy-loading 'flavor' on Instance uuid 1a3c21c4-2db3-44e1-8a23-336ca9f8374d {{(pid=75045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 23:31:18 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-39de6ea0-f4fc-4a63-aa48-408c72bb5b54 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Lock "1a3c21c4-2db3-44e1-8a23-336ca9f8374d" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 37.199s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:31:19 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-770b29ea-77d8-4656-a91a-1f6daecbd674 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] [instance: 04169f59-e9a6-4b50-9ad7-7f8c105a376a] Starting finish_migration {{(pid=75045) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Nov 08 23:31:19 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-770b29ea-77d8-4656-a91a-1f6daecbd674 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] [instance: 04169f59-e9a6-4b50-9ad7-7f8c105a376a] Instance directory exists: not creating {{(pid=75045) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 08 23:31:19 user nova-compute[75045]: INFO nova.virt.libvirt.driver [None req-770b29ea-77d8-4656-a91a-1f6daecbd674 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] [instance: 04169f59-e9a6-4b50-9ad7-7f8c105a376a] Creating image(s)
Nov 08 23:31:19 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-770b29ea-77d8-4656-a91a-1f6daecbd674 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] [instance: 04169f59-e9a6-4b50-9ad7-7f8c105a376a] Did not create local disks {{(pid=75045) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 08 23:31:19 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-770b29ea-77d8-4656-a91a-1f6daecbd674 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] [instance: 04169f59-e9a6-4b50-9ad7-7f8c105a376a] Ensure instance console log exists: /opt/stack/data/nova/instances/04169f59-e9a6-4b50-9ad7-7f8c105a376a/console.log {{(pid=75045) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 23:31:19 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-770b29ea-77d8-4656-a91a-1f6daecbd674 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:31:19 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-770b29ea-77d8-4656-a91a-1f6daecbd674 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:31:19 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-770b29ea-77d8-4656-a91a-1f6daecbd674 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:31:19 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-770b29ea-77d8-4656-a91a-1f6daecbd674 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] [instance: 04169f59-e9a6-4b50-9ad7-7f8c105a376a] Start _get_guest_xml network_info=[{"id": "96af9673-bb3c-4173-8439-0be6d2b922cf", "address": "fa:16:3e:a5:6d:8b", "network": {"id": "700b5784-d35b-45c0-a4d3-1ab8aa4c48aa", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-194469807-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.175", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-194469807-network", "vif_mac": "fa:16:3e:a5:6d:8b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e63623113f11463d9035bb990de43510", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96af9673-bb", "ovs_interfaceid": "96af9673-bb3c-4173-8439-0be6d2b922cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': True, 'device_type': 'disk', 'attachment_id': '9d78852f-ba89-48ee-b981-04cb3326dd4c', 'guest_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:e9c3ac6d-d72a-41c8-9c18-15131250e323', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WPeOlnqB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '04169f59-e9a6-4b50-9ad7-7f8c105a376a', 'attached_at': '2023-11-08T23:31:19.000000', 'detached_at': '', 'volume_id': 'e9c3ac6d-d72a-41c8-9c18-15131250e323', 'serial': 'e9c3ac6d-d72a-41c8-9c18-15131250e323'}, 'volume_type': None} {{(pid=75045) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 23:31:19 user nova-compute[75045]: WARNING nova.virt.libvirt.driver [None req-770b29ea-77d8-4656-a91a-1f6daecbd674 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 23:31:19 user nova-compute[75045]: WARNING nova.virt.libvirt.driver [None req-770b29ea-77d8-4656-a91a-1f6daecbd674 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 23:31:19 user nova-compute[75045]: DEBUG nova.virt.libvirt.host [None req-770b29ea-77d8-4656-a91a-1f6daecbd674 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75045) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 23:31:19 user nova-compute[75045]: DEBUG nova.virt.libvirt.host [None req-770b29ea-77d8-4656-a91a-1f6daecbd674 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] CPU controller missing on host. {{(pid=75045) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 23:31:19 user nova-compute[75045]: DEBUG nova.virt.libvirt.host [None req-770b29ea-77d8-4656-a91a-1f6daecbd674 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75045) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 23:31:19 user nova-compute[75045]: DEBUG nova.virt.libvirt.host [None req-770b29ea-77d8-4656-a91a-1f6daecbd674 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] CPU controller found on host. {{(pid=75045) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 23:31:19 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-770b29ea-77d8-4656-a91a-1f6daecbd674 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75045) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 23:31:19 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-770b29ea-77d8-4656-a91a-1f6daecbd674 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T23:11:44Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75045) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 23:31:19 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-770b29ea-77d8-4656-a91a-1f6daecbd674 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Flavor limits 0:0:0 {{(pid=75045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 23:31:19 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-770b29ea-77d8-4656-a91a-1f6daecbd674 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Image limits 0:0:0 {{(pid=75045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 23:31:19 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-770b29ea-77d8-4656-a91a-1f6daecbd674 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Flavor pref 0:0:0 {{(pid=75045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 23:31:19 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-770b29ea-77d8-4656-a91a-1f6daecbd674 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Image pref 0:0:0 {{(pid=75045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 23:31:19 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-770b29ea-77d8-4656-a91a-1f6daecbd674 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 23:31:19 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-770b29ea-77d8-4656-a91a-1f6daecbd674 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75045) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 23:31:19 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-770b29ea-77d8-4656-a91a-1f6daecbd674 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75045) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 23:31:19 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-770b29ea-77d8-4656-a91a-1f6daecbd674 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Got 1 possible topologies {{(pid=75045) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 23:31:19 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-770b29ea-77d8-4656-a91a-1f6daecbd674 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75045) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 23:31:19 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-770b29ea-77d8-4656-a91a-1f6daecbd674 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75045) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 23:31:19 user nova-compute[75045]: DEBUG nova.virt.libvirt.volume.iscsi [None req-770b29ea-77d8-4656-a91a-1f6daecbd674 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] [instance: 04169f59-e9a6-4b50-9ad7-7f8c105a376a] Calling os-brick to attach iSCSI Volume {{(pid=75045) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 23:31:19 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-770b29ea-77d8-4656-a91a-1f6daecbd674 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1b68210460>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e9c3ac6d-d72a-41c8-9c18-15131250e323', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WPeOlnqB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75045) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 23:31:19 user nova-compute[75045]: WARNING os_brick.initiator.connectors.base [None req-770b29ea-77d8-4656-a91a-1f6daecbd674 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 23:31:19 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-770b29ea-77d8-4656-a91a-1f6daecbd674 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 23:31:19 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-770b29ea-77d8-4656-a91a-1f6daecbd674 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 23:31:19 user nova-compute[75045]: WARNING os_brick.initiator.connectors.base [None req-770b29ea-77d8-4656-a91a-1f6daecbd674 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 23:31:19 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-770b29ea-77d8-4656-a91a-1f6daecbd674 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e9c3ac6d-d72a-41c8-9c18-15131250e323" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 23:31:19 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-770b29ea-77d8-4656-a91a-1f6daecbd674 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e9c3ac6d-d72a-41c8-9c18-15131250e323" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 23:31:19 user nova-compute[75045]: INFO os_brick.initiator.connectors.iscsi [None req-770b29ea-77d8-4656-a91a-1f6daecbd674 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 23:31:19 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e9c3ac6d-d72a-41c8-9c18-15131250e323 -p 172.16.0.220:3260 {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:31:19 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e9c3ac6d-d72a-41c8-9c18-15131250e323 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:31:19 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[705d9ec5-55ef-49b4-8c7f-6bbfccb9cf14]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:31:19 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-770b29ea-77d8-4656-a91a-1f6daecbd674 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 23:31:19 user nova-compute[75045]:  {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:31:19 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e9c3ac6d-d72a-41c8-9c18-15131250e323 -p 172.16.0.220:3260 --interface default --op new {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:31:19 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e9c3ac6d-d72a-41c8-9c18-15131250e323 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:31:19 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[a330d80b-e018-4f79-84f8-fcca031c6b44]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e9c3ac6d-d72a-41c8-9c18-15131250e323] added\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:31:19 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-770b29ea-77d8-4656-a91a-1f6daecbd674 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e9c3ac6d-d72a-41c8-9c18-15131250e323] added
Nov 08 23:31:19 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:31:19 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e9c3ac6d-d72a-41c8-9c18-15131250e323 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:31:19 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e9c3ac6d-d72a-41c8-9c18-15131250e323 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:31:19 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[37f13aa8-22a5-42ea-9d06-f13021d917d2]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:31:19 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-770b29ea-77d8-4656-a91a-1f6daecbd674 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:31:19 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e9c3ac6d-d72a-41c8-9c18-15131250e323 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:31:19 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e9c3ac6d-d72a-41c8-9c18-15131250e323 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:31:19 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[e01d3d69-cc70-4936-8cbc-b383765261c6]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:31:19 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-770b29ea-77d8-4656-a91a-1f6daecbd674 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:31:19 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e9c3ac6d-d72a-41c8-9c18-15131250e323 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WPeOlnqB {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:31:19 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e9c3ac6d-d72a-41c8-9c18-15131250e323 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WPeOlnqB" returned: 0 in 0.018s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:31:19 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e036b8a-d295-4138-bce0-76cbf11cbbac]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:31:19 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-770b29ea-77d8-4656-a91a-1f6daecbd674 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'WPeOlnqB'): stdout= stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:31:19 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e9c3ac6d-d72a-41c8-9c18-15131250e323 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:31:19 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e9c3ac6d-d72a-41c8-9c18-15131250e323 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:31:19 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd699bf1-e2db-42ae-8cdd-ac1994b6ef42]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:31:19 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-770b29ea-77d8-4656-a91a-1f6daecbd674 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:31:19 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:31:19 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:31:19 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d60d0be-a295-448e-8ddc-09700d7de98c]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83187c89-e833-4efd-afa0-2cbfe05d8db1 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b7ae942-25ab-4581-ac11-216ee4cc9973 (non-flash)\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:31:19 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-770b29ea-77d8-4656-a91a-1f6daecbd674 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab (non-flash)
Nov 08 23:31:19 user nova-compute[75045]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83187c89-e833-4efd-afa0-2cbfe05d8db1 (non-flash)
Nov 08 23:31:19 user nova-compute[75045]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b7ae942-25ab-4581-ac11-216ee4cc9973 (non-flash)
Nov 08 23:31:19 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 23:31:19 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-770b29ea-77d8-4656-a91a-1f6daecbd674 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab (non-flash)
Nov 08 23:31:19 user nova-compute[75045]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83187c89-e833-4efd-afa0-2cbfe05d8db1 (non-flash)
Nov 08 23:31:19 user nova-compute[75045]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b7ae942-25ab-4581-ac11-216ee4cc9973 (non-flash)
Nov 08 23:31:19 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 23:31:19 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e9c3ac6d-d72a-41c8-9c18-15131250e323 -p 172.16.0.220:3260 --login {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:31:19 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e9c3ac6d-d72a-41c8-9c18-15131250e323 -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:31:19 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ac400c7-5140-4345-b918-d2ee0dbf6160]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e9c3ac6d-d72a-41c8-9c18-15131250e323, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e9c3ac6d-d72a-41c8-9c18-15131250e323, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:31:19 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-770b29ea-77d8-4656-a91a-1f6daecbd674 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e9c3ac6d-d72a-41c8-9c18-15131250e323, portal: 172.16.0.220,3260]
Nov 08 23:31:19 user nova-compute[75045]: Login to [iface: default, target: iqn.2010-10.org.openstack:e9c3ac6d-d72a-41c8-9c18-15131250e323, portal: 172.16.0.220,3260] successful.
Nov 08 23:31:19 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:31:19 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e9c3ac6d-d72a-41c8-9c18-15131250e323 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:31:19 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e9c3ac6d-d72a-41c8-9c18-15131250e323 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:31:19 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fb6f700-bbd8-453d-a99b-64ae1ec36d67]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:31:19 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-770b29ea-77d8-4656-a91a-1f6daecbd674 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:31:19 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:31:19 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:31:19 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[a251cae9-b59c-4f46-9d06-901aac582bb2]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83187c89-e833-4efd-afa0-2cbfe05d8db1 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b7ae942-25ab-4581-ac11-216ee4cc9973 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9c3ac6d-d72a-41c8-9c18-15131250e323 (non-flash)\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:31:19 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-770b29ea-77d8-4656-a91a-1f6daecbd674 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab (non-flash)
Nov 08 23:31:19 user nova-compute[75045]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83187c89-e833-4efd-afa0-2cbfe05d8db1 (non-flash)
Nov 08 23:31:19 user nova-compute[75045]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b7ae942-25ab-4581-ac11-216ee4cc9973 (non-flash)
Nov 08 23:31:19 user nova-compute[75045]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9c3ac6d-d72a-41c8-9c18-15131250e323 (non-flash)
Nov 08 23:31:19 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 23:31:19 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-770b29ea-77d8-4656-a91a-1f6daecbd674 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab (non-flash)
Nov 08 23:31:19 user nova-compute[75045]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83187c89-e833-4efd-afa0-2cbfe05d8db1 (non-flash)
Nov 08 23:31:19 user nova-compute[75045]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b7ae942-25ab-4581-ac11-216ee4cc9973 (non-flash)
Nov 08 23:31:19 user nova-compute[75045]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9c3ac6d-d72a-41c8-9c18-15131250e323 (non-flash)
Nov 08 23:31:19 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 23:31:19 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-770b29ea-77d8-4656-a91a-1f6daecbd674 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e9c3ac6d-d72a-41c8-9c18-15131250e323" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.304s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 23:31:19 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-770b29ea-77d8-4656-a91a-1f6daecbd674 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Connected to 172.16.0.220:3260 {{(pid=75045) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 23:31:19 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-770b29ea-77d8-4656-a91a-1f6daecbd674 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] HCTL ('34', '-', '-', 0) found on session 32 with lun 0 {{(pid=75045) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 23:31:19 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-770b29ea-77d8-4656-a91a-1f6daecbd674 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75045) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 23:31:19 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:31:19 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:31:19 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcaa7756-0b32-40d6-9896-ce58a51d9f6e]: (4, ('- - 0', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:31:19 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-770b29ea-77d8-4656-a91a-1f6daecbd674 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Searching for a device in session 32 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75045) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 23:31:19 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-770b29ea-77d8-4656-a91a-1f6daecbd674 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:e9c3ac6d-d72a-41c8-9c18-15131250e323', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WPeOlnqB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75045) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 23:31:20 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-770b29ea-77d8-4656-a91a-1f6daecbd674 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.342s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 23:31:20 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-770b29ea-77d8-4656-a91a-1f6daecbd674 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] <== connect_volume: return (1344ms) {'type': 'block', 'scsi_wwn': '23833353965313638', 'path': '/dev/sdc'} {{(pid=75045) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 23:31:20 user nova-compute[75045]: DEBUG nova.virt.libvirt.volume.iscsi [None req-770b29ea-77d8-4656-a91a-1f6daecbd674 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] [instance: 04169f59-e9a6-4b50-9ad7-7f8c105a376a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23833353965313638', 'path': '/dev/sdc'} {{(pid=75045) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 23:31:20 user nova-compute[75045]: DEBUG nova.virt.libvirt.vif [None req-770b29ea-77d8-4656-a91a-1f6daecbd674 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T23:28:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1540084668',display_name='tempest-ServerActionsTestOtherA-server-1540084668',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1540084668',id=27,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDODl/KmGTsZ/iebmo5xmCcXvI602I8HkxrrHYOCSHtu28wqdqp4sqz8GjX6RCkUTvwm3o1RrGN7CPAGp6yuNsTNNdTZNeJLiXbNPx6WnByfZzN9Q7qtNxToi4a9/5pZlg==',key_name='tempest-keypair-679582766',keypairs=<?>,launch_index=0,launched_at=2023-11-08T23:29:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='e63623113f11463d9035bb990de43510',ramdisk_id='',reservation_id='r-tx09g4z0',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-2056815713',owner_user_name='tempest-ServerActionsTestOtherA-2056815713-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T23:30:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='75fc508f268d4a569ad78598ff019c14',uuid=04169f59-e9a6-4b50-9ad7-7f8c105a376a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "96af9673-bb3c-4173-8439-0be6d2b922cf", "address": "fa:16:3e:a5:6d:8b", "network": {"id": "700b5784-d35b-45c0-a4d3-1ab8aa4c48aa", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-194469807-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.175", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-194469807-network", "vif_mac": "fa:16:3e:a5:6d:8b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e63623113f11463d9035bb990de43510", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96af9673-bb", "ovs_interfaceid": "96af9673-bb3c-4173-8439-0be6d2b922cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75045) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 23:31:20 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-770b29ea-77d8-4656-a91a-1f6daecbd674 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Converting VIF {"id": "96af9673-bb3c-4173-8439-0be6d2b922cf", "address": "fa:16:3e:a5:6d:8b", "network": {"id": "700b5784-d35b-45c0-a4d3-1ab8aa4c48aa", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-194469807-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.175", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-194469807-network", "vif_mac": "fa:16:3e:a5:6d:8b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e63623113f11463d9035bb990de43510", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96af9673-bb", "ovs_interfaceid": "96af9673-bb3c-4173-8439-0be6d2b922cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 23:31:20 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-770b29ea-77d8-4656-a91a-1f6daecbd674 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a5:6d:8b,bridge_name='br-int',has_traffic_filtering=True,id=96af9673-bb3c-4173-8439-0be6d2b922cf,network=Network(700b5784-d35b-45c0-a4d3-1ab8aa4c48aa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96af9673-bb') {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 23:31:20 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-770b29ea-77d8-4656-a91a-1f6daecbd674 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] [instance: 04169f59-e9a6-4b50-9ad7-7f8c105a376a] End _get_guest_xml xml=<domain type="kvm">
Nov 08 23:31:20 user nova-compute[75045]:   <uuid>04169f59-e9a6-4b50-9ad7-7f8c105a376a</uuid>
Nov 08 23:31:20 user nova-compute[75045]:   <name>instance-0000001b</name>
Nov 08 23:31:20 user nova-compute[75045]:   <memory>2097152</memory>
Nov 08 23:31:20 user nova-compute[75045]:   <vcpu>1</vcpu>
Nov 08 23:31:20 user nova-compute[75045]:   <metadata>
Nov 08 23:31:20 user nova-compute[75045]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 23:31:20 user nova-compute[75045]:       <nova:package version="0.0.0"/>
Nov 08 23:31:20 user nova-compute[75045]:       <nova:name>tempest-ServerActionsTestOtherA-server-1540084668</nova:name>
Nov 08 23:31:20 user nova-compute[75045]:       <nova:creationTime>2023-11-08 23:31:19</nova:creationTime>
Nov 08 23:31:20 user nova-compute[75045]:       <nova:flavor name="m1.small">
Nov 08 23:31:20 user nova-compute[75045]:         <nova:memory>2048</nova:memory>
Nov 08 23:31:20 user nova-compute[75045]:         <nova:disk>20</nova:disk>
Nov 08 23:31:20 user nova-compute[75045]:         <nova:swap>0</nova:swap>
Nov 08 23:31:20 user nova-compute[75045]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 23:31:20 user nova-compute[75045]:         <nova:vcpus>1</nova:vcpus>
Nov 08 23:31:20 user nova-compute[75045]:       </nova:flavor>
Nov 08 23:31:20 user nova-compute[75045]:       <nova:owner>
Nov 08 23:31:20 user nova-compute[75045]:         <nova:user uuid="75fc508f268d4a569ad78598ff019c14">tempest-ServerActionsTestOtherA-2056815713-project-member</nova:user>
Nov 08 23:31:20 user nova-compute[75045]:         <nova:project uuid="e63623113f11463d9035bb990de43510">tempest-ServerActionsTestOtherA-2056815713</nova:project>
Nov 08 23:31:20 user nova-compute[75045]:       </nova:owner>
Nov 08 23:31:20 user nova-compute[75045]:       <nova:ports>
Nov 08 23:31:20 user nova-compute[75045]:         <nova:port uuid="96af9673-bb3c-4173-8439-0be6d2b922cf">
Nov 08 23:31:20 user nova-compute[75045]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 08 23:31:20 user nova-compute[75045]:         </nova:port>
Nov 08 23:31:20 user nova-compute[75045]:       </nova:ports>
Nov 08 23:31:20 user nova-compute[75045]:     </nova:instance>
Nov 08 23:31:20 user nova-compute[75045]:   </metadata>
Nov 08 23:31:20 user nova-compute[75045]:   <sysinfo type="smbios">
Nov 08 23:31:20 user nova-compute[75045]:     <system>
Nov 08 23:31:20 user nova-compute[75045]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 23:31:20 user nova-compute[75045]:       <entry name="product">OpenStack Nova</entry>
Nov 08 23:31:20 user nova-compute[75045]:       <entry name="version">0.0.0</entry>
Nov 08 23:31:20 user nova-compute[75045]:       <entry name="serial">04169f59-e9a6-4b50-9ad7-7f8c105a376a</entry>
Nov 08 23:31:20 user nova-compute[75045]:       <entry name="uuid">04169f59-e9a6-4b50-9ad7-7f8c105a376a</entry>
Nov 08 23:31:20 user nova-compute[75045]:       <entry name="family">Virtual Machine</entry>
Nov 08 23:31:20 user nova-compute[75045]:     </system>
Nov 08 23:31:20 user nova-compute[75045]:   </sysinfo>
Nov 08 23:31:20 user nova-compute[75045]:   <os>
Nov 08 23:31:20 user nova-compute[75045]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 23:31:20 user nova-compute[75045]:     <boot dev="hd"/>
Nov 08 23:31:20 user nova-compute[75045]:     <smbios mode="sysinfo"/>
Nov 08 23:31:20 user nova-compute[75045]:   </os>
Nov 08 23:31:20 user nova-compute[75045]:   <features>
Nov 08 23:31:20 user nova-compute[75045]:     <acpi/>
Nov 08 23:31:20 user nova-compute[75045]:     <apic/>
Nov 08 23:31:20 user nova-compute[75045]:     <vmcoreinfo/>
Nov 08 23:31:20 user nova-compute[75045]:   </features>
Nov 08 23:31:20 user nova-compute[75045]:   <clock offset="utc">
Nov 08 23:31:20 user nova-compute[75045]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 23:31:20 user nova-compute[75045]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 23:31:20 user nova-compute[75045]:     <timer name="hpet" present="no"/>
Nov 08 23:31:20 user nova-compute[75045]:   </clock>
Nov 08 23:31:20 user nova-compute[75045]:   <cpu mode="custom" match="exact">
Nov 08 23:31:20 user nova-compute[75045]:     <model>Nehalem</model>
Nov 08 23:31:20 user nova-compute[75045]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 23:31:20 user nova-compute[75045]:   </cpu>
Nov 08 23:31:20 user nova-compute[75045]:   <devices>
Nov 08 23:31:20 user nova-compute[75045]:     <disk type="block" device="disk">
Nov 08 23:31:20 user nova-compute[75045]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 23:31:20 user nova-compute[75045]:       <source dev="/dev/sdc"/>
Nov 08 23:31:20 user nova-compute[75045]:       <target dev="vda" bus="virtio"/>
Nov 08 23:31:20 user nova-compute[75045]:       <serial>e9c3ac6d-d72a-41c8-9c18-15131250e323</serial>
Nov 08 23:31:20 user nova-compute[75045]:     </disk>
Nov 08 23:31:20 user nova-compute[75045]:     <interface type="ethernet">
Nov 08 23:31:20 user nova-compute[75045]:       <mac address="fa:16:3e:a5:6d:8b"/>
Nov 08 23:31:20 user nova-compute[75045]:       <model type="virtio"/>
Nov 08 23:31:20 user nova-compute[75045]:       <mtu size="1442"/>
Nov 08 23:31:20 user nova-compute[75045]:       <target dev="tap96af9673-bb"/>
Nov 08 23:31:20 user nova-compute[75045]:     </interface>
Nov 08 23:31:20 user nova-compute[75045]:     <serial type="pty">
Nov 08 23:31:20 user nova-compute[75045]:       <log file="/opt/stack/data/nova/instances/04169f59-e9a6-4b50-9ad7-7f8c105a376a/console.log" append="off"/>
Nov 08 23:31:20 user nova-compute[75045]:     </serial>
Nov 08 23:31:20 user nova-compute[75045]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 23:31:20 user nova-compute[75045]:     <video>
Nov 08 23:31:20 user nova-compute[75045]:       <model type="virtio"/>
Nov 08 23:31:20 user nova-compute[75045]:     </video>
Nov 08 23:31:20 user nova-compute[75045]:     <rng model="virtio">
Nov 08 23:31:20 user nova-compute[75045]:       <backend model="random">/dev/urandom</backend>
Nov 08 23:31:20 user nova-compute[75045]:     </rng>
Nov 08 23:31:20 user nova-compute[75045]:     <controller type="usb" index="0" model="none"/>
Nov 08 23:31:20 user nova-compute[75045]:     <memballoon model="virtio">
Nov 08 23:31:20 user nova-compute[75045]:       <stats period="10"/>
Nov 08 23:31:20 user nova-compute[75045]:     </memballoon>
Nov 08 23:31:20 user nova-compute[75045]:   </devices>
Nov 08 23:31:20 user nova-compute[75045]: </domain>
Nov 08 23:31:20 user nova-compute[75045]:  {{(pid=75045) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 23:31:20 user nova-compute[75045]: DEBUG nova.virt.libvirt.vif [None req-770b29ea-77d8-4656-a91a-1f6daecbd674 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T23:28:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1540084668',display_name='tempest-ServerActionsTestOtherA-server-1540084668',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1540084668',id=27,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDODl/KmGTsZ/iebmo5xmCcXvI602I8HkxrrHYOCSHtu28wqdqp4sqz8GjX6RCkUTvwm3o1RrGN7CPAGp6yuNsTNNdTZNeJLiXbNPx6WnByfZzN9Q7qtNxToi4a9/5pZlg==',key_name='tempest-keypair-679582766',keypairs=<?>,launch_index=0,launched_at=2023-11-08T23:29:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='e63623113f11463d9035bb990de43510',ramdisk_id='',reservation_id='r-tx09g4z0',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-2056815713',owner_user_name='tempest-ServerActionsTestOtherA-2056815713-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T23:30:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='75fc508f268d4a569ad78598ff019c14',uuid=04169f59-e9a6-4b50-9ad7-7f8c105a376a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "96af9673-bb3c-4173-8439-0be6d2b922cf", "address": "fa:16:3e:a5:6d:8b", "network": {"id": "700b5784-d35b-45c0-a4d3-1ab8aa4c48aa", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-194469807-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.175", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-194469807-network", "vif_mac": "fa:16:3e:a5:6d:8b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e63623113f11463d9035bb990de43510", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96af9673-bb", "ovs_interfaceid": "96af9673-bb3c-4173-8439-0be6d2b922cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75045) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 23:31:20 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-770b29ea-77d8-4656-a91a-1f6daecbd674 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Converting VIF {"id": "96af9673-bb3c-4173-8439-0be6d2b922cf", "address": "fa:16:3e:a5:6d:8b", "network": {"id": "700b5784-d35b-45c0-a4d3-1ab8aa4c48aa", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-194469807-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.175", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-194469807-network", "vif_mac": "fa:16:3e:a5:6d:8b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e63623113f11463d9035bb990de43510", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96af9673-bb", "ovs_interfaceid": "96af9673-bb3c-4173-8439-0be6d2b922cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 23:31:20 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-770b29ea-77d8-4656-a91a-1f6daecbd674 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a5:6d:8b,bridge_name='br-int',has_traffic_filtering=True,id=96af9673-bb3c-4173-8439-0be6d2b922cf,network=Network(700b5784-d35b-45c0-a4d3-1ab8aa4c48aa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96af9673-bb') {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 23:31:20 user nova-compute[75045]: DEBUG os_vif [None req-770b29ea-77d8-4656-a91a-1f6daecbd674 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a5:6d:8b,bridge_name='br-int',has_traffic_filtering=True,id=96af9673-bb3c-4173-8439-0be6d2b922cf,network=Network(700b5784-d35b-45c0-a4d3-1ab8aa4c48aa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96af9673-bb') {{(pid=75045) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 23:31:20 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:31:20 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:31:20 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 23:31:20 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:31:20 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '761649fd-8edc-59e0-85df-1e270aad8726', '_type': 'linux-noop'}}, row=False) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:31:20 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:31:20 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:31:20 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:31:20 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap96af9673-bb, may_exist=True, interface_attrs={}) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:31:20 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap96af9673-bb, col_values=(('qos', UUID('f071ae3a-31f2-4c93-b99f-dd9e04e14e02')),), if_exists=True) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:31:20 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap96af9673-bb, col_values=(('external_ids', {'iface-id': '96af9673-bb3c-4173-8439-0be6d2b922cf', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a5:6d:8b', 'vm-uuid': '04169f59-e9a6-4b50-9ad7-7f8c105a376a'}),), if_exists=True) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:31:20 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:31:20 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 23:31:20 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:31:20 user nova-compute[75045]: INFO os_vif [None req-770b29ea-77d8-4656-a91a-1f6daecbd674 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a5:6d:8b,bridge_name='br-int',has_traffic_filtering=True,id=96af9673-bb3c-4173-8439-0be6d2b922cf,network=Network(700b5784-d35b-45c0-a4d3-1ab8aa4c48aa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96af9673-bb')
Nov 08 23:31:20 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-770b29ea-77d8-4656-a91a-1f6daecbd674 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] No BDM found with device name vda, not building metadata. {{(pid=75045) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 23:31:20 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-770b29ea-77d8-4656-a91a-1f6daecbd674 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] No VIF found with MAC fa:16:3e:a5:6d:8b, not building metadata {{(pid=75045) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 23:31:21 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:31:21 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:31:21 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:31:21 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:31:21 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:31:22 user nova-compute[75045]: DEBUG nova.compute.manager [req-515af249-5777-4cb7-8143-ecefe3e427f6 req-82545aaa-9259-4b9d-b7fc-36ec338cec4c service nova] [instance: 04169f59-e9a6-4b50-9ad7-7f8c105a376a] Received event network-vif-plugged-96af9673-bb3c-4173-8439-0be6d2b922cf {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:31:22 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-515af249-5777-4cb7-8143-ecefe3e427f6 req-82545aaa-9259-4b9d-b7fc-36ec338cec4c service nova] Acquiring lock "04169f59-e9a6-4b50-9ad7-7f8c105a376a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:31:22 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-515af249-5777-4cb7-8143-ecefe3e427f6 req-82545aaa-9259-4b9d-b7fc-36ec338cec4c service nova] Lock "04169f59-e9a6-4b50-9ad7-7f8c105a376a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:31:22 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-515af249-5777-4cb7-8143-ecefe3e427f6 req-82545aaa-9259-4b9d-b7fc-36ec338cec4c service nova] Lock "04169f59-e9a6-4b50-9ad7-7f8c105a376a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:31:22 user nova-compute[75045]: DEBUG nova.compute.manager [req-515af249-5777-4cb7-8143-ecefe3e427f6 req-82545aaa-9259-4b9d-b7fc-36ec338cec4c service nova] [instance: 04169f59-e9a6-4b50-9ad7-7f8c105a376a] No waiting events found dispatching network-vif-plugged-96af9673-bb3c-4173-8439-0be6d2b922cf {{(pid=75045) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 23:31:22 user nova-compute[75045]: WARNING nova.compute.manager [req-515af249-5777-4cb7-8143-ecefe3e427f6 req-82545aaa-9259-4b9d-b7fc-36ec338cec4c service nova] [instance: 04169f59-e9a6-4b50-9ad7-7f8c105a376a] Received unexpected event network-vif-plugged-96af9673-bb3c-4173-8439-0be6d2b922cf for instance with vm_state active and task_state resize_finish.
Nov 08 23:31:22 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:31:22 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:31:22 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:31:24 user nova-compute[75045]: DEBUG nova.compute.manager [None req-770b29ea-77d8-4656-a91a-1f6daecbd674 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] [instance: 04169f59-e9a6-4b50-9ad7-7f8c105a376a] Instance event wait completed in 0 seconds for  {{(pid=75045) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 23:31:24 user nova-compute[75045]: INFO nova.virt.libvirt.driver [-] [instance: 04169f59-e9a6-4b50-9ad7-7f8c105a376a] Instance running successfully.
Nov 08 23:31:24 user nova-compute[75045]: DEBUG nova.virt.libvirt.guest [None req-770b29ea-77d8-4656-a91a-1f6daecbd674 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] [instance: 04169f59-e9a6-4b50-9ad7-7f8c105a376a] Failed to set time: agent not configured {{(pid=75045) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Nov 08 23:31:24 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-770b29ea-77d8-4656-a91a-1f6daecbd674 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] [instance: 04169f59-e9a6-4b50-9ad7-7f8c105a376a] finish_migration finished successfully. {{(pid=75045) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Nov 08 23:31:24 user nova-compute[75045]: DEBUG nova.compute.manager [req-3daff014-0d27-45f9-9aeb-31ab84ed4c25 req-4e16d286-953a-4ce3-9f2a-82789482d0cc service nova] [instance: 04169f59-e9a6-4b50-9ad7-7f8c105a376a] Received event network-vif-plugged-96af9673-bb3c-4173-8439-0be6d2b922cf {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:31:24 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-3daff014-0d27-45f9-9aeb-31ab84ed4c25 req-4e16d286-953a-4ce3-9f2a-82789482d0cc service nova] Acquiring lock "04169f59-e9a6-4b50-9ad7-7f8c105a376a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:31:24 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-3daff014-0d27-45f9-9aeb-31ab84ed4c25 req-4e16d286-953a-4ce3-9f2a-82789482d0cc service nova] Lock "04169f59-e9a6-4b50-9ad7-7f8c105a376a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:31:24 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-3daff014-0d27-45f9-9aeb-31ab84ed4c25 req-4e16d286-953a-4ce3-9f2a-82789482d0cc service nova] Lock "04169f59-e9a6-4b50-9ad7-7f8c105a376a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:31:24 user nova-compute[75045]: DEBUG nova.compute.manager [req-3daff014-0d27-45f9-9aeb-31ab84ed4c25 req-4e16d286-953a-4ce3-9f2a-82789482d0cc service nova] [instance: 04169f59-e9a6-4b50-9ad7-7f8c105a376a] No waiting events found dispatching network-vif-plugged-96af9673-bb3c-4173-8439-0be6d2b922cf {{(pid=75045) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 23:31:24 user nova-compute[75045]: WARNING nova.compute.manager [req-3daff014-0d27-45f9-9aeb-31ab84ed4c25 req-4e16d286-953a-4ce3-9f2a-82789482d0cc service nova] [instance: 04169f59-e9a6-4b50-9ad7-7f8c105a376a] Received unexpected event network-vif-plugged-96af9673-bb3c-4173-8439-0be6d2b922cf for instance with vm_state active and task_state resize_finish.
Nov 08 23:31:24 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-6acb7fce-c440-4767-b0d2-5ccc81f1f8ba tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] Acquiring lock "adcffd35-00c7-49db-a72f-d6307a90e123" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:31:24 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-6acb7fce-c440-4767-b0d2-5ccc81f1f8ba tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] Lock "adcffd35-00c7-49db-a72f-d6307a90e123" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:31:24 user nova-compute[75045]: DEBUG nova.objects.instance [None req-6acb7fce-c440-4767-b0d2-5ccc81f1f8ba tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] Lazy-loading 'flavor' on Instance uuid adcffd35-00c7-49db-a72f-d6307a90e123 {{(pid=75045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 23:31:24 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-6acb7fce-c440-4767-b0d2-5ccc81f1f8ba tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] Lock "adcffd35-00c7-49db-a72f-d6307a90e123" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.076s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:31:24 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-6acb7fce-c440-4767-b0d2-5ccc81f1f8ba tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] Acquiring lock "adcffd35-00c7-49db-a72f-d6307a90e123" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:31:24 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-6acb7fce-c440-4767-b0d2-5ccc81f1f8ba tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] Lock "adcffd35-00c7-49db-a72f-d6307a90e123" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:31:24 user nova-compute[75045]: INFO nova.compute.manager [None req-6acb7fce-c440-4767-b0d2-5ccc81f1f8ba tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] [instance: adcffd35-00c7-49db-a72f-d6307a90e123] Attaching volume 165cfb75-c15e-4b34-9324-edd8f21b6173 to /dev/vdb
Nov 08 23:31:25 user nova-compute[75045]: DEBUG os_brick.utils [None req-6acb7fce-c440-4767-b0d2-5ccc81f1f8ba tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75045) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 23:31:25 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:31:25 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:31:25 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[80d1edd2-e5b9-46d8-93eb-487de8c453a8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6217bd6e884\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:31:25 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:31:25 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:31:25 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[31ba060f-266d-4c48-94b1-82bbbee4f4c1]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:31:25 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:31:25 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:31:25 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b596b3e-535d-4a41-bc09-8e758cef1bcd]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:31:25 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a15ee86-b774-4dd2-97a7-44b0dca122b6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:31:25 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-6acb7fce-c440-4767-b0d2-5ccc81f1f8ba tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] Running cmd (subprocess): nvme version {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:31:25 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-6acb7fce-c440-4767-b0d2-5ccc81f1f8ba tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] 'nvme version' failed. Not Retrying. {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 23:31:25 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6acb7fce-c440-4767-b0d2-5ccc81f1f8ba tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] nvme not present on system {{(pid=75045) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 23:31:25 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:31:25 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 23:31:25 user nova-compute[75045]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 23:31:25 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[573be99f-a269-4170-bd54-ced4d2b341cb]: (4, '') {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:31:25 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.lightos [None req-6acb7fce-c440-4767-b0d2-5ccc81f1f8ba tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75045) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 23:31:25 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.lightos [None req-6acb7fce-c440-4767-b0d2-5ccc81f1f8ba tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75045) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 23:31:25 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.lightos [None req-6acb7fce-c440-4767-b0d2-5ccc81f1f8ba tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] LIGHTOS: no hostnqn found. {{(pid=75045) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 23:31:25 user nova-compute[75045]: DEBUG os_brick.utils [None req-6acb7fce-c440-4767-b0d2-5ccc81f1f8ba tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] <== get_connector_properties: return (135ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6217bd6e884', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75045) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 23:31:25 user nova-compute[75045]: DEBUG nova.virt.block_device [None req-6acb7fce-c440-4767-b0d2-5ccc81f1f8ba tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] [instance: adcffd35-00c7-49db-a72f-d6307a90e123] Updating existing volume attachment record: dc11b6b6-ae2e-4f3f-b59e-b1e654df37b4 {{(pid=75045) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 23:31:25 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:31:26 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:31:30 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-761e62d9-12b5-4650-9143-045055346e6e tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] Acquiring lock "9222e62a-9fd8-48b2-a125-83c9cdc589bd" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:31:30 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-761e62d9-12b5-4650-9143-045055346e6e tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] Lock "9222e62a-9fd8-48b2-a125-83c9cdc589bd" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.003s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:31:30 user nova-compute[75045]: DEBUG nova.compute.manager [None req-761e62d9-12b5-4650-9143-045055346e6e tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] [instance: 9222e62a-9fd8-48b2-a125-83c9cdc589bd] Starting instance... {{(pid=75045) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 23:31:30 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-761e62d9-12b5-4650-9143-045055346e6e tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:31:30 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-761e62d9-12b5-4650-9143-045055346e6e tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:31:30 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-761e62d9-12b5-4650-9143-045055346e6e tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75045) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 23:31:30 user nova-compute[75045]: INFO nova.compute.claims [None req-761e62d9-12b5-4650-9143-045055346e6e tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] [instance: 9222e62a-9fd8-48b2-a125-83c9cdc589bd] Claim successful on node user
Nov 08 23:31:30 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:31:30 user nova-compute[75045]: DEBUG nova.compute.provider_tree [None req-761e62d9-12b5-4650-9143-045055346e6e tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] Inventory has not changed in ProviderTree for provider: 62ba5f85-c74d-4b58-986e-d4197e813fd7 {{(pid=75045) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 23:31:30 user nova-compute[75045]: DEBUG nova.scheduler.client.report [None req-761e62d9-12b5-4650-9143-045055346e6e tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] Inventory has not changed for provider 62ba5f85-c74d-4b58-986e-d4197e813fd7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75045) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 23:31:30 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-761e62d9-12b5-4650-9143-045055346e6e tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.630s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:31:30 user nova-compute[75045]: DEBUG nova.compute.manager [None req-761e62d9-12b5-4650-9143-045055346e6e tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] [instance: 9222e62a-9fd8-48b2-a125-83c9cdc589bd] Start building networks asynchronously for instance. {{(pid=75045) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 23:31:30 user nova-compute[75045]: DEBUG nova.compute.manager [None req-761e62d9-12b5-4650-9143-045055346e6e tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] [instance: 9222e62a-9fd8-48b2-a125-83c9cdc589bd] Allocating IP information in the background. {{(pid=75045) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 23:31:30 user nova-compute[75045]: DEBUG nova.network.neutron [None req-761e62d9-12b5-4650-9143-045055346e6e tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] [instance: 9222e62a-9fd8-48b2-a125-83c9cdc589bd] allocate_for_instance() {{(pid=75045) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 23:31:31 user nova-compute[75045]: INFO nova.virt.libvirt.driver [None req-761e62d9-12b5-4650-9143-045055346e6e tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] [instance: 9222e62a-9fd8-48b2-a125-83c9cdc589bd] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 23:31:31 user nova-compute[75045]: DEBUG nova.compute.manager [None req-761e62d9-12b5-4650-9143-045055346e6e tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] [instance: 9222e62a-9fd8-48b2-a125-83c9cdc589bd] Start building block device mappings for instance. {{(pid=75045) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 23:31:31 user nova-compute[75045]: DEBUG nova.policy [None req-761e62d9-12b5-4650-9143-045055346e6e tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f16e465ffb49488db3de445a473fd77a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbb640407ef94f568aea892f1834d6d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75045) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 23:31:31 user nova-compute[75045]: DEBUG nova.compute.manager [None req-761e62d9-12b5-4650-9143-045055346e6e tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] [instance: 9222e62a-9fd8-48b2-a125-83c9cdc589bd] Start spawning the instance on the hypervisor. {{(pid=75045) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 23:31:31 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-761e62d9-12b5-4650-9143-045055346e6e tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] [instance: 9222e62a-9fd8-48b2-a125-83c9cdc589bd] Creating instance directory {{(pid=75045) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 23:31:31 user nova-compute[75045]: INFO nova.virt.libvirt.driver [None req-761e62d9-12b5-4650-9143-045055346e6e tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] [instance: 9222e62a-9fd8-48b2-a125-83c9cdc589bd] Creating image(s)
Nov 08 23:31:31 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-761e62d9-12b5-4650-9143-045055346e6e tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] Acquiring lock "/opt/stack/data/nova/instances/9222e62a-9fd8-48b2-a125-83c9cdc589bd/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:31:31 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-761e62d9-12b5-4650-9143-045055346e6e tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] Lock "/opt/stack/data/nova/instances/9222e62a-9fd8-48b2-a125-83c9cdc589bd/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:31:31 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-761e62d9-12b5-4650-9143-045055346e6e tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] Lock "/opt/stack/data/nova/instances/9222e62a-9fd8-48b2-a125-83c9cdc589bd/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:31:31 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-761e62d9-12b5-4650-9143-045055346e6e tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b59f52a99fff51c56dd1edfb83892fb8f647f2f3 --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:31:31 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:31:31 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-761e62d9-12b5-4650-9143-045055346e6e tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b59f52a99fff51c56dd1edfb83892fb8f647f2f3 --force-share --output=json" returned: 0 in 0.236s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:31:31 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-761e62d9-12b5-4650-9143-045055346e6e tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] Acquiring lock "b59f52a99fff51c56dd1edfb83892fb8f647f2f3" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:31:31 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-761e62d9-12b5-4650-9143-045055346e6e tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] Lock "b59f52a99fff51c56dd1edfb83892fb8f647f2f3" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:31:31 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-761e62d9-12b5-4650-9143-045055346e6e tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b59f52a99fff51c56dd1edfb83892fb8f647f2f3 --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:31:31 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-676de1cf-80b1-49f1-983d-c81ab095f52b tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Acquiring lock "1a3c21c4-2db3-44e1-8a23-336ca9f8374d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:31:31 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-676de1cf-80b1-49f1-983d-c81ab095f52b tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Lock "1a3c21c4-2db3-44e1-8a23-336ca9f8374d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.003s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:31:31 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-676de1cf-80b1-49f1-983d-c81ab095f52b tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Acquiring lock "1a3c21c4-2db3-44e1-8a23-336ca9f8374d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:31:31 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-676de1cf-80b1-49f1-983d-c81ab095f52b tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Lock "1a3c21c4-2db3-44e1-8a23-336ca9f8374d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:31:31 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-676de1cf-80b1-49f1-983d-c81ab095f52b tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Lock "1a3c21c4-2db3-44e1-8a23-336ca9f8374d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:31:31 user nova-compute[75045]: INFO nova.compute.manager [None req-676de1cf-80b1-49f1-983d-c81ab095f52b tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] [instance: 1a3c21c4-2db3-44e1-8a23-336ca9f8374d] Terminating instance
Nov 08 23:31:31 user nova-compute[75045]: DEBUG nova.compute.manager [None req-676de1cf-80b1-49f1-983d-c81ab095f52b tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] [instance: 1a3c21c4-2db3-44e1-8a23-336ca9f8374d] Start destroying the instance on the hypervisor. {{(pid=75045) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 23:31:31 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:31:31 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-761e62d9-12b5-4650-9143-045055346e6e tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b59f52a99fff51c56dd1edfb83892fb8f647f2f3 --force-share --output=json" returned: 0 in 0.228s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:31:31 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-761e62d9-12b5-4650-9143-045055346e6e tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b59f52a99fff51c56dd1edfb83892fb8f647f2f3,backing_fmt=raw /opt/stack/data/nova/instances/9222e62a-9fd8-48b2-a125-83c9cdc589bd/disk 1073741824 {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:31:31 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:31:31 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:31:31 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-761e62d9-12b5-4650-9143-045055346e6e tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b59f52a99fff51c56dd1edfb83892fb8f647f2f3,backing_fmt=raw /opt/stack/data/nova/instances/9222e62a-9fd8-48b2-a125-83c9cdc589bd/disk 1073741824" returned: 0 in 0.062s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:31:31 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-761e62d9-12b5-4650-9143-045055346e6e tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] Lock "b59f52a99fff51c56dd1edfb83892fb8f647f2f3" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.296s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:31:31 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-761e62d9-12b5-4650-9143-045055346e6e tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b59f52a99fff51c56dd1edfb83892fb8f647f2f3 --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:31:31 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-761e62d9-12b5-4650-9143-045055346e6e tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b59f52a99fff51c56dd1edfb83892fb8f647f2f3 --force-share --output=json" returned: 0 in 0.202s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:31:31 user nova-compute[75045]: DEBUG nova.virt.disk.api [None req-761e62d9-12b5-4650-9143-045055346e6e tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9222e62a-9fd8-48b2-a125-83c9cdc589bd/disk. size=1073741824 {{(pid=75045) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 23:31:31 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-761e62d9-12b5-4650-9143-045055346e6e tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9222e62a-9fd8-48b2-a125-83c9cdc589bd/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:31:32 user nova-compute[75045]: DEBUG nova.compute.manager [req-9c0f165c-9b49-4bab-950c-24a16563897a req-758a195d-fb2b-46cb-8bcd-74e595413e52 service nova] [instance: 1a3c21c4-2db3-44e1-8a23-336ca9f8374d] Received event network-vif-unplugged-f3fb74c0-e5f6-4a65-8d50-b33da34c4fcb {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:31:32 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-9c0f165c-9b49-4bab-950c-24a16563897a req-758a195d-fb2b-46cb-8bcd-74e595413e52 service nova] Acquiring lock "1a3c21c4-2db3-44e1-8a23-336ca9f8374d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:31:32 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-9c0f165c-9b49-4bab-950c-24a16563897a req-758a195d-fb2b-46cb-8bcd-74e595413e52 service nova] Lock "1a3c21c4-2db3-44e1-8a23-336ca9f8374d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:31:32 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-9c0f165c-9b49-4bab-950c-24a16563897a req-758a195d-fb2b-46cb-8bcd-74e595413e52 service nova] Lock "1a3c21c4-2db3-44e1-8a23-336ca9f8374d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:31:32 user nova-compute[75045]: DEBUG nova.compute.manager [req-9c0f165c-9b49-4bab-950c-24a16563897a req-758a195d-fb2b-46cb-8bcd-74e595413e52 service nova] [instance: 1a3c21c4-2db3-44e1-8a23-336ca9f8374d] No waiting events found dispatching network-vif-unplugged-f3fb74c0-e5f6-4a65-8d50-b33da34c4fcb {{(pid=75045) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 23:31:32 user nova-compute[75045]: DEBUG nova.compute.manager [req-9c0f165c-9b49-4bab-950c-24a16563897a req-758a195d-fb2b-46cb-8bcd-74e595413e52 service nova] [instance: 1a3c21c4-2db3-44e1-8a23-336ca9f8374d] Received event network-vif-unplugged-f3fb74c0-e5f6-4a65-8d50-b33da34c4fcb for instance with task_state deleting. {{(pid=75045) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 23:31:32 user nova-compute[75045]: DEBUG nova.network.neutron [None req-761e62d9-12b5-4650-9143-045055346e6e tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] [instance: 9222e62a-9fd8-48b2-a125-83c9cdc589bd] Successfully created port: 5dae7844-411c-47aa-ba3e-bc209136f0a6 {{(pid=75045) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 23:31:32 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-761e62d9-12b5-4650-9143-045055346e6e tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9222e62a-9fd8-48b2-a125-83c9cdc589bd/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:31:32 user nova-compute[75045]: DEBUG nova.virt.disk.api [None req-761e62d9-12b5-4650-9143-045055346e6e tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] Cannot resize image /opt/stack/data/nova/instances/9222e62a-9fd8-48b2-a125-83c9cdc589bd/disk to a smaller size. {{(pid=75045) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 08 23:31:32 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-761e62d9-12b5-4650-9143-045055346e6e tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] [instance: 9222e62a-9fd8-48b2-a125-83c9cdc589bd] Created local disks {{(pid=75045) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 23:31:32 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-761e62d9-12b5-4650-9143-045055346e6e tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] [instance: 9222e62a-9fd8-48b2-a125-83c9cdc589bd] Ensure instance console log exists: /opt/stack/data/nova/instances/9222e62a-9fd8-48b2-a125-83c9cdc589bd/console.log {{(pid=75045) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 23:31:32 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-761e62d9-12b5-4650-9143-045055346e6e tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:31:32 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-761e62d9-12b5-4650-9143-045055346e6e tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:31:32 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-761e62d9-12b5-4650-9143-045055346e6e tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:31:32 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:31:32 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:31:32 user nova-compute[75045]: INFO nova.virt.libvirt.driver [-] [instance: 1a3c21c4-2db3-44e1-8a23-336ca9f8374d] Instance destroyed successfully.
Nov 08 23:31:32 user nova-compute[75045]: DEBUG nova.objects.instance [None req-676de1cf-80b1-49f1-983d-c81ab095f52b tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Lazy-loading 'resources' on Instance uuid 1a3c21c4-2db3-44e1-8a23-336ca9f8374d {{(pid=75045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 23:31:32 user nova-compute[75045]: DEBUG nova.virt.libvirt.vif [None req-676de1cf-80b1-49f1-983d-c81ab095f52b tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T23:28:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1675585016',display_name='tempest-AttachVolumeNegativeTest-server-1675585016',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1675585016',id=28,image_ref='a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOSEVtbs5drLNhMiJi78DfCAYQDpA0IgNhhWU1d/fAienGpzbXpzNi6NWrezJb1HKzcbVkcgH6wwtFAiR1ajmmGHq2EOamIImHyrNRVH60eF8efqzPOoK+zv3yxhqTdckw==',key_name='tempest-keypair-762847075',keypairs=<?>,launch_index=0,launched_at=2023-11-08T23:28:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7eff4be777d24514be52868961bf7a25',ramdisk_id='',reservation_id='r-0wybollb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1522456563',owner_user_name='tempest-AttachVolumeNegativeTest-1522456563-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T23:28:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4a05b178abe74b779a991e887bf135b2',uuid=1a3c21c4-2db3-44e1-8a23-336ca9f8374d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f3fb74c0-e5f6-4a65-8d50-b33da34c4fcb", "address": "fa:16:3e:57:5d:d2", "network": {"id": "2f33d93d-98ec-4b87-a0c0-efe2d2ac8f6d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-719527911-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.125", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7eff4be777d24514be52868961bf7a25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3fb74c0-e5", "ovs_interfaceid": "f3fb74c0-e5f6-4a65-8d50-b33da34c4fcb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75045) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 23:31:32 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-676de1cf-80b1-49f1-983d-c81ab095f52b tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Converting VIF {"id": "f3fb74c0-e5f6-4a65-8d50-b33da34c4fcb", "address": "fa:16:3e:57:5d:d2", "network": {"id": "2f33d93d-98ec-4b87-a0c0-efe2d2ac8f6d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-719527911-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.125", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7eff4be777d24514be52868961bf7a25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3fb74c0-e5", "ovs_interfaceid": "f3fb74c0-e5f6-4a65-8d50-b33da34c4fcb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 23:31:32 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-676de1cf-80b1-49f1-983d-c81ab095f52b tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:57:5d:d2,bridge_name='br-int',has_traffic_filtering=True,id=f3fb74c0-e5f6-4a65-8d50-b33da34c4fcb,network=Network(2f33d93d-98ec-4b87-a0c0-efe2d2ac8f6d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf3fb74c0-e5') {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 23:31:32 user nova-compute[75045]: DEBUG os_vif [None req-676de1cf-80b1-49f1-983d-c81ab095f52b tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:57:5d:d2,bridge_name='br-int',has_traffic_filtering=True,id=f3fb74c0-e5f6-4a65-8d50-b33da34c4fcb,network=Network(2f33d93d-98ec-4b87-a0c0-efe2d2ac8f6d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf3fb74c0-e5') {{(pid=75045) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 23:31:32 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:31:32 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf3fb74c0-e5, bridge=br-int, if_exists=True) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:31:32 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:31:32 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 23:31:32 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:31:32 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0c4cffac-5bb1-40c7-ae62-f35a27252a7a) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:31:32 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:31:32 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 23:31:32 user nova-compute[75045]: INFO os_vif [None req-676de1cf-80b1-49f1-983d-c81ab095f52b tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:57:5d:d2,bridge_name='br-int',has_traffic_filtering=True,id=f3fb74c0-e5f6-4a65-8d50-b33da34c4fcb,network=Network(2f33d93d-98ec-4b87-a0c0-efe2d2ac8f6d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf3fb74c0-e5')
Nov 08 23:31:32 user nova-compute[75045]: INFO nova.virt.libvirt.driver [None req-676de1cf-80b1-49f1-983d-c81ab095f52b tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] [instance: 1a3c21c4-2db3-44e1-8a23-336ca9f8374d] Deleting instance files /opt/stack/data/nova/instances/1a3c21c4-2db3-44e1-8a23-336ca9f8374d_del
Nov 08 23:31:32 user nova-compute[75045]: INFO nova.virt.libvirt.driver [None req-676de1cf-80b1-49f1-983d-c81ab095f52b tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] [instance: 1a3c21c4-2db3-44e1-8a23-336ca9f8374d] Deletion of /opt/stack/data/nova/instances/1a3c21c4-2db3-44e1-8a23-336ca9f8374d_del complete
Nov 08 23:31:32 user nova-compute[75045]: INFO nova.compute.manager [None req-676de1cf-80b1-49f1-983d-c81ab095f52b tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] [instance: 1a3c21c4-2db3-44e1-8a23-336ca9f8374d] Took 0.95 seconds to destroy the instance on the hypervisor.
Nov 08 23:31:32 user nova-compute[75045]: DEBUG oslo.service.loopingcall [None req-676de1cf-80b1-49f1-983d-c81ab095f52b tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75045) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 23:31:32 user nova-compute[75045]: DEBUG nova.compute.manager [-] [instance: 1a3c21c4-2db3-44e1-8a23-336ca9f8374d] Deallocating network for instance {{(pid=75045) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 23:31:32 user nova-compute[75045]: DEBUG nova.network.neutron [-] [instance: 1a3c21c4-2db3-44e1-8a23-336ca9f8374d] deallocate_for_instance() {{(pid=75045) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 23:31:32 user nova-compute[75045]: DEBUG nova.network.neutron [None req-761e62d9-12b5-4650-9143-045055346e6e tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] [instance: 9222e62a-9fd8-48b2-a125-83c9cdc589bd] Successfully updated port: 5dae7844-411c-47aa-ba3e-bc209136f0a6 {{(pid=75045) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 23:31:32 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-761e62d9-12b5-4650-9143-045055346e6e tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] Acquiring lock "refresh_cache-9222e62a-9fd8-48b2-a125-83c9cdc589bd" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 23:31:32 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-761e62d9-12b5-4650-9143-045055346e6e tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] Acquired lock "refresh_cache-9222e62a-9fd8-48b2-a125-83c9cdc589bd" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 23:31:32 user nova-compute[75045]: DEBUG nova.network.neutron [None req-761e62d9-12b5-4650-9143-045055346e6e tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] [instance: 9222e62a-9fd8-48b2-a125-83c9cdc589bd] Building network info cache for instance {{(pid=75045) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 23:31:32 user nova-compute[75045]: DEBUG nova.network.neutron [None req-761e62d9-12b5-4650-9143-045055346e6e tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] [instance: 9222e62a-9fd8-48b2-a125-83c9cdc589bd] Instance cache missing network info. {{(pid=75045) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 23:31:33 user nova-compute[75045]: DEBUG nova.network.neutron [None req-761e62d9-12b5-4650-9143-045055346e6e tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] [instance: 9222e62a-9fd8-48b2-a125-83c9cdc589bd] Updating instance_info_cache with network_info: [{"id": "5dae7844-411c-47aa-ba3e-bc209136f0a6", "address": "fa:16:3e:a4:11:9a", "network": {"id": "08d1669a-f667-4c79-8e49-0ad183f57046", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1863648032-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bbb640407ef94f568aea892f1834d6d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5dae7844-41", "ovs_interfaceid": "5dae7844-411c-47aa-ba3e-bc209136f0a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75045) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 23:31:33 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-761e62d9-12b5-4650-9143-045055346e6e tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] Releasing lock "refresh_cache-9222e62a-9fd8-48b2-a125-83c9cdc589bd" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 23:31:33 user nova-compute[75045]: DEBUG nova.compute.manager [None req-761e62d9-12b5-4650-9143-045055346e6e tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] [instance: 9222e62a-9fd8-48b2-a125-83c9cdc589bd] Instance network_info: |[{"id": "5dae7844-411c-47aa-ba3e-bc209136f0a6", "address": "fa:16:3e:a4:11:9a", "network": {"id": "08d1669a-f667-4c79-8e49-0ad183f57046", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1863648032-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bbb640407ef94f568aea892f1834d6d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5dae7844-41", "ovs_interfaceid": "5dae7844-411c-47aa-ba3e-bc209136f0a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75045) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 23:31:33 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-761e62d9-12b5-4650-9143-045055346e6e tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] [instance: 9222e62a-9fd8-48b2-a125-83c9cdc589bd] Start _get_guest_xml network_info=[{"id": "5dae7844-411c-47aa-ba3e-bc209136f0a6", "address": "fa:16:3e:a4:11:9a", "network": {"id": "08d1669a-f667-4c79-8e49-0ad183f57046", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1863648032-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bbb640407ef94f568aea892f1834d6d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5dae7844-41", "ovs_interfaceid": "5dae7844-411c-47aa-ba3e-bc209136f0a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T23:11:54Z,direct_url=<?>,disk_format='qcow2',id=a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b1beba2cc4e7465ea249e2225fb494dc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T23:11:56Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'disk_bus': 'virtio', 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': 'a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75045) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 23:31:33 user nova-compute[75045]: WARNING nova.virt.libvirt.driver [None req-761e62d9-12b5-4650-9143-045055346e6e tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 23:31:33 user nova-compute[75045]: WARNING nova.virt.libvirt.driver [None req-761e62d9-12b5-4650-9143-045055346e6e tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 23:31:33 user nova-compute[75045]: DEBUG nova.virt.libvirt.host [None req-761e62d9-12b5-4650-9143-045055346e6e tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75045) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 23:31:33 user nova-compute[75045]: DEBUG nova.virt.libvirt.host [None req-761e62d9-12b5-4650-9143-045055346e6e tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] CPU controller missing on host. {{(pid=75045) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 23:31:33 user nova-compute[75045]: DEBUG nova.virt.libvirt.host [None req-761e62d9-12b5-4650-9143-045055346e6e tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75045) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 23:31:33 user nova-compute[75045]: DEBUG nova.virt.libvirt.host [None req-761e62d9-12b5-4650-9143-045055346e6e tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] CPU controller found on host. {{(pid=75045) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 23:31:33 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-761e62d9-12b5-4650-9143-045055346e6e tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75045) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 23:31:33 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-761e62d9-12b5-4650-9143-045055346e6e tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T23:11:41Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T23:11:54Z,direct_url=<?>,disk_format='qcow2',id=a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b1beba2cc4e7465ea249e2225fb494dc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T23:11:56Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75045) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 23:31:33 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-761e62d9-12b5-4650-9143-045055346e6e tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] Flavor limits 0:0:0 {{(pid=75045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 23:31:33 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-761e62d9-12b5-4650-9143-045055346e6e tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] Image limits 0:0:0 {{(pid=75045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 23:31:33 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-761e62d9-12b5-4650-9143-045055346e6e tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] Flavor pref 0:0:0 {{(pid=75045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 23:31:33 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-761e62d9-12b5-4650-9143-045055346e6e tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] Image pref 0:0:0 {{(pid=75045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 23:31:33 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-761e62d9-12b5-4650-9143-045055346e6e tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 23:31:33 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-761e62d9-12b5-4650-9143-045055346e6e tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75045) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 23:31:33 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-761e62d9-12b5-4650-9143-045055346e6e tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75045) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 23:31:33 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-761e62d9-12b5-4650-9143-045055346e6e tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] Got 1 possible topologies {{(pid=75045) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 23:31:33 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-761e62d9-12b5-4650-9143-045055346e6e tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75045) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 23:31:33 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-761e62d9-12b5-4650-9143-045055346e6e tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75045) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 23:31:33 user nova-compute[75045]: DEBUG nova.virt.libvirt.vif [None req-761e62d9-12b5-4650-9143-045055346e6e tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T23:31:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-419578876',display_name='tempest-ServerRescueNegativeTestJSON-server-419578876',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-419578876',id=32,image_ref='a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE8xPLrIBEJgewpGKZ9+DADirH1va8Jw2TK7fJYueqPBCf/b4zQxE+KZaoScWKrWN36A5mrbfEJVAf2HqeXPqc0l3rzXsv0urNXE5MLSGsJKkp23YT6dxav8ybWtbSI0/w==',key_name='tempest-keypair-175527667',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bbb640407ef94f568aea892f1834d6d1',ramdisk_id='',reservation_id='r-vju4zt3n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-187452128',owner_user_name='tempest-ServerRescueNegativeTestJSON-187452128-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T23:31:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f16e465ffb49488db3de445a473fd77a',uuid=9222e62a-9fd8-48b2-a125-83c9cdc589bd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5dae7844-411c-47aa-ba3e-bc209136f0a6", "address": "fa:16:3e:a4:11:9a", "network": {"id": "08d1669a-f667-4c79-8e49-0ad183f57046", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1863648032-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bbb640407ef94f568aea892f1834d6d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5dae7844-41", "ovs_interfaceid": "5dae7844-411c-47aa-ba3e-bc209136f0a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75045) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 23:31:33 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-761e62d9-12b5-4650-9143-045055346e6e tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] Converting VIF {"id": "5dae7844-411c-47aa-ba3e-bc209136f0a6", "address": "fa:16:3e:a4:11:9a", "network": {"id": "08d1669a-f667-4c79-8e49-0ad183f57046", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1863648032-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bbb640407ef94f568aea892f1834d6d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5dae7844-41", "ovs_interfaceid": "5dae7844-411c-47aa-ba3e-bc209136f0a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 23:31:33 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-761e62d9-12b5-4650-9143-045055346e6e tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a4:11:9a,bridge_name='br-int',has_traffic_filtering=True,id=5dae7844-411c-47aa-ba3e-bc209136f0a6,network=Network(08d1669a-f667-4c79-8e49-0ad183f57046),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5dae7844-41') {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 23:31:33 user nova-compute[75045]: DEBUG nova.objects.instance [None req-761e62d9-12b5-4650-9143-045055346e6e tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] Lazy-loading 'pci_devices' on Instance uuid 9222e62a-9fd8-48b2-a125-83c9cdc589bd {{(pid=75045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 23:31:33 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-761e62d9-12b5-4650-9143-045055346e6e tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] [instance: 9222e62a-9fd8-48b2-a125-83c9cdc589bd] End _get_guest_xml xml=<domain type="kvm">
Nov 08 23:31:33 user nova-compute[75045]:   <uuid>9222e62a-9fd8-48b2-a125-83c9cdc589bd</uuid>
Nov 08 23:31:33 user nova-compute[75045]:   <name>instance-00000020</name>
Nov 08 23:31:33 user nova-compute[75045]:   <memory>524288</memory>
Nov 08 23:31:33 user nova-compute[75045]:   <vcpu>1</vcpu>
Nov 08 23:31:33 user nova-compute[75045]:   <metadata>
Nov 08 23:31:33 user nova-compute[75045]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 23:31:33 user nova-compute[75045]:       <nova:package version="0.0.0"/>
Nov 08 23:31:33 user nova-compute[75045]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-419578876</nova:name>
Nov 08 23:31:33 user nova-compute[75045]:       <nova:creationTime>2023-11-08 23:31:33</nova:creationTime>
Nov 08 23:31:33 user nova-compute[75045]:       <nova:flavor name="m1.tiny">
Nov 08 23:31:33 user nova-compute[75045]:         <nova:memory>512</nova:memory>
Nov 08 23:31:33 user nova-compute[75045]:         <nova:disk>1</nova:disk>
Nov 08 23:31:33 user nova-compute[75045]:         <nova:swap>0</nova:swap>
Nov 08 23:31:33 user nova-compute[75045]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 23:31:33 user nova-compute[75045]:         <nova:vcpus>1</nova:vcpus>
Nov 08 23:31:33 user nova-compute[75045]:       </nova:flavor>
Nov 08 23:31:33 user nova-compute[75045]:       <nova:owner>
Nov 08 23:31:33 user nova-compute[75045]:         <nova:user uuid="f16e465ffb49488db3de445a473fd77a">tempest-ServerRescueNegativeTestJSON-187452128-project-member</nova:user>
Nov 08 23:31:33 user nova-compute[75045]:         <nova:project uuid="bbb640407ef94f568aea892f1834d6d1">tempest-ServerRescueNegativeTestJSON-187452128</nova:project>
Nov 08 23:31:33 user nova-compute[75045]:       </nova:owner>
Nov 08 23:31:33 user nova-compute[75045]:       <nova:root type="image" uuid="a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb"/>
Nov 08 23:31:33 user nova-compute[75045]:       <nova:ports>
Nov 08 23:31:33 user nova-compute[75045]:         <nova:port uuid="5dae7844-411c-47aa-ba3e-bc209136f0a6">
Nov 08 23:31:33 user nova-compute[75045]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 08 23:31:33 user nova-compute[75045]:         </nova:port>
Nov 08 23:31:33 user nova-compute[75045]:       </nova:ports>
Nov 08 23:31:33 user nova-compute[75045]:     </nova:instance>
Nov 08 23:31:33 user nova-compute[75045]:   </metadata>
Nov 08 23:31:33 user nova-compute[75045]:   <sysinfo type="smbios">
Nov 08 23:31:33 user nova-compute[75045]:     <system>
Nov 08 23:31:33 user nova-compute[75045]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 23:31:33 user nova-compute[75045]:       <entry name="product">OpenStack Nova</entry>
Nov 08 23:31:33 user nova-compute[75045]:       <entry name="version">0.0.0</entry>
Nov 08 23:31:33 user nova-compute[75045]:       <entry name="serial">9222e62a-9fd8-48b2-a125-83c9cdc589bd</entry>
Nov 08 23:31:33 user nova-compute[75045]:       <entry name="uuid">9222e62a-9fd8-48b2-a125-83c9cdc589bd</entry>
Nov 08 23:31:33 user nova-compute[75045]:       <entry name="family">Virtual Machine</entry>
Nov 08 23:31:33 user nova-compute[75045]:     </system>
Nov 08 23:31:33 user nova-compute[75045]:   </sysinfo>
Nov 08 23:31:33 user nova-compute[75045]:   <os>
Nov 08 23:31:33 user nova-compute[75045]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 23:31:33 user nova-compute[75045]:     <boot dev="hd"/>
Nov 08 23:31:33 user nova-compute[75045]:     <smbios mode="sysinfo"/>
Nov 08 23:31:33 user nova-compute[75045]:   </os>
Nov 08 23:31:33 user nova-compute[75045]:   <features>
Nov 08 23:31:33 user nova-compute[75045]:     <acpi/>
Nov 08 23:31:33 user nova-compute[75045]:     <apic/>
Nov 08 23:31:33 user nova-compute[75045]:     <vmcoreinfo/>
Nov 08 23:31:33 user nova-compute[75045]:   </features>
Nov 08 23:31:33 user nova-compute[75045]:   <clock offset="utc">
Nov 08 23:31:33 user nova-compute[75045]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 23:31:33 user nova-compute[75045]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 23:31:33 user nova-compute[75045]:     <timer name="hpet" present="no"/>
Nov 08 23:31:33 user nova-compute[75045]:   </clock>
Nov 08 23:31:33 user nova-compute[75045]:   <cpu mode="custom" match="exact">
Nov 08 23:31:33 user nova-compute[75045]:     <model>Nehalem</model>
Nov 08 23:31:33 user nova-compute[75045]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 23:31:33 user nova-compute[75045]:   </cpu>
Nov 08 23:31:33 user nova-compute[75045]:   <devices>
Nov 08 23:31:33 user nova-compute[75045]:     <disk type="file" device="disk">
Nov 08 23:31:33 user nova-compute[75045]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 23:31:33 user nova-compute[75045]:       <source file="/opt/stack/data/nova/instances/9222e62a-9fd8-48b2-a125-83c9cdc589bd/disk"/>
Nov 08 23:31:33 user nova-compute[75045]:       <target dev="vda" bus="virtio"/>
Nov 08 23:31:33 user nova-compute[75045]:     </disk>
Nov 08 23:31:33 user nova-compute[75045]:     <interface type="ethernet">
Nov 08 23:31:33 user nova-compute[75045]:       <mac address="fa:16:3e:a4:11:9a"/>
Nov 08 23:31:33 user nova-compute[75045]:       <model type="virtio"/>
Nov 08 23:31:33 user nova-compute[75045]:       <mtu size="1442"/>
Nov 08 23:31:33 user nova-compute[75045]:       <target dev="tap5dae7844-41"/>
Nov 08 23:31:33 user nova-compute[75045]:     </interface>
Nov 08 23:31:33 user nova-compute[75045]:     <serial type="pty">
Nov 08 23:31:33 user nova-compute[75045]:       <log file="/opt/stack/data/nova/instances/9222e62a-9fd8-48b2-a125-83c9cdc589bd/console.log" append="off"/>
Nov 08 23:31:33 user nova-compute[75045]:     </serial>
Nov 08 23:31:33 user nova-compute[75045]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 23:31:33 user nova-compute[75045]:     <video>
Nov 08 23:31:33 user nova-compute[75045]:       <model type="virtio"/>
Nov 08 23:31:33 user nova-compute[75045]:     </video>
Nov 08 23:31:33 user nova-compute[75045]:     <rng model="virtio">
Nov 08 23:31:33 user nova-compute[75045]:       <backend model="random">/dev/urandom</backend>
Nov 08 23:31:33 user nova-compute[75045]:     </rng>
Nov 08 23:31:33 user nova-compute[75045]:     <controller type="usb" index="0" model="none"/>
Nov 08 23:31:33 user nova-compute[75045]:     <memballoon model="virtio">
Nov 08 23:31:33 user nova-compute[75045]:       <stats period="10"/>
Nov 08 23:31:33 user nova-compute[75045]:     </memballoon>
Nov 08 23:31:33 user nova-compute[75045]:   </devices>
Nov 08 23:31:33 user nova-compute[75045]: </domain>
Nov 08 23:31:33 user nova-compute[75045]:  {{(pid=75045) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 23:31:33 user nova-compute[75045]: DEBUG nova.virt.libvirt.vif [None req-761e62d9-12b5-4650-9143-045055346e6e tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T23:31:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-419578876',display_name='tempest-ServerRescueNegativeTestJSON-server-419578876',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-419578876',id=32,image_ref='a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE8xPLrIBEJgewpGKZ9+DADirH1va8Jw2TK7fJYueqPBCf/b4zQxE+KZaoScWKrWN36A5mrbfEJVAf2HqeXPqc0l3rzXsv0urNXE5MLSGsJKkp23YT6dxav8ybWtbSI0/w==',key_name='tempest-keypair-175527667',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bbb640407ef94f568aea892f1834d6d1',ramdisk_id='',reservation_id='r-vju4zt3n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-187452128',owner_user_name='tempest-ServerRescueNegativeTestJSON-187452128-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T23:31:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f16e465ffb49488db3de445a473fd77a',uuid=9222e62a-9fd8-48b2-a125-83c9cdc589bd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5dae7844-411c-47aa-ba3e-bc209136f0a6", "address": "fa:16:3e:a4:11:9a", "network": {"id": "08d1669a-f667-4c79-8e49-0ad183f57046", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1863648032-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bbb640407ef94f568aea892f1834d6d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5dae7844-41", "ovs_interfaceid": "5dae7844-411c-47aa-ba3e-bc209136f0a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75045) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 23:31:33 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-761e62d9-12b5-4650-9143-045055346e6e tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] Converting VIF {"id": "5dae7844-411c-47aa-ba3e-bc209136f0a6", "address": "fa:16:3e:a4:11:9a", "network": {"id": "08d1669a-f667-4c79-8e49-0ad183f57046", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1863648032-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bbb640407ef94f568aea892f1834d6d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5dae7844-41", "ovs_interfaceid": "5dae7844-411c-47aa-ba3e-bc209136f0a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 23:31:33 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-761e62d9-12b5-4650-9143-045055346e6e tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a4:11:9a,bridge_name='br-int',has_traffic_filtering=True,id=5dae7844-411c-47aa-ba3e-bc209136f0a6,network=Network(08d1669a-f667-4c79-8e49-0ad183f57046),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5dae7844-41') {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 23:31:33 user nova-compute[75045]: DEBUG os_vif [None req-761e62d9-12b5-4650-9143-045055346e6e tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a4:11:9a,bridge_name='br-int',has_traffic_filtering=True,id=5dae7844-411c-47aa-ba3e-bc209136f0a6,network=Network(08d1669a-f667-4c79-8e49-0ad183f57046),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5dae7844-41') {{(pid=75045) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 23:31:33 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:31:33 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:31:33 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 23:31:33 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:31:33 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '66cc34fa-6036-5081-991d-bf92c53685ee', '_type': 'linux-noop'}}, row=False) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:31:33 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:31:33 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:31:33 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:31:33 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5dae7844-41, may_exist=True, interface_attrs={}) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:31:33 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5dae7844-41, col_values=(('qos', UUID('6d55cb72-7877-4f5d-b037-1f9700e8ba0b')),), if_exists=True) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:31:33 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5dae7844-41, col_values=(('external_ids', {'iface-id': '5dae7844-411c-47aa-ba3e-bc209136f0a6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a4:11:9a', 'vm-uuid': '9222e62a-9fd8-48b2-a125-83c9cdc589bd'}),), if_exists=True) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:31:33 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:31:33 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 23:31:33 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:31:33 user nova-compute[75045]: INFO os_vif [None req-761e62d9-12b5-4650-9143-045055346e6e tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a4:11:9a,bridge_name='br-int',has_traffic_filtering=True,id=5dae7844-411c-47aa-ba3e-bc209136f0a6,network=Network(08d1669a-f667-4c79-8e49-0ad183f57046),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5dae7844-41')
Nov 08 23:31:33 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-761e62d9-12b5-4650-9143-045055346e6e tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] No BDM found with device name vda, not building metadata. {{(pid=75045) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 23:31:33 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-761e62d9-12b5-4650-9143-045055346e6e tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] No VIF found with MAC fa:16:3e:a4:11:9a, not building metadata {{(pid=75045) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 23:31:33 user nova-compute[75045]: DEBUG nova.network.neutron [-] [instance: 1a3c21c4-2db3-44e1-8a23-336ca9f8374d] Updating instance_info_cache with network_info: [] {{(pid=75045) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 23:31:33 user nova-compute[75045]: INFO nova.compute.manager [-] [instance: 1a3c21c4-2db3-44e1-8a23-336ca9f8374d] Took 1.27 seconds to deallocate network for instance.
Nov 08 23:31:33 user nova-compute[75045]: DEBUG nova.compute.manager [req-8a732af3-9ec8-4e9a-8e00-b16c8bf58ad7 req-d15dd7ff-2ce3-43fc-a0f0-676360ad47fb service nova] [instance: 1a3c21c4-2db3-44e1-8a23-336ca9f8374d] Received event network-vif-deleted-f3fb74c0-e5f6-4a65-8d50-b33da34c4fcb {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:31:33 user nova-compute[75045]: INFO nova.compute.manager [req-8a732af3-9ec8-4e9a-8e00-b16c8bf58ad7 req-d15dd7ff-2ce3-43fc-a0f0-676360ad47fb service nova] [instance: 1a3c21c4-2db3-44e1-8a23-336ca9f8374d] Neutron deleted interface f3fb74c0-e5f6-4a65-8d50-b33da34c4fcb; detaching it from the instance and deleting it from the info cache
Nov 08 23:31:33 user nova-compute[75045]: DEBUG nova.network.neutron [req-8a732af3-9ec8-4e9a-8e00-b16c8bf58ad7 req-d15dd7ff-2ce3-43fc-a0f0-676360ad47fb service nova] [instance: 1a3c21c4-2db3-44e1-8a23-336ca9f8374d] Updating instance_info_cache with network_info: [] {{(pid=75045) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 23:31:33 user nova-compute[75045]: DEBUG nova.compute.manager [req-8a732af3-9ec8-4e9a-8e00-b16c8bf58ad7 req-d15dd7ff-2ce3-43fc-a0f0-676360ad47fb service nova] [instance: 1a3c21c4-2db3-44e1-8a23-336ca9f8374d] Detach interface failed, port_id=f3fb74c0-e5f6-4a65-8d50-b33da34c4fcb, reason: Instance 1a3c21c4-2db3-44e1-8a23-336ca9f8374d could not be found. {{(pid=75045) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 08 23:31:33 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-676de1cf-80b1-49f1-983d-c81ab095f52b tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:31:33 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-676de1cf-80b1-49f1-983d-c81ab095f52b tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:31:34 user nova-compute[75045]: DEBUG nova.compute.manager [req-6a7f5554-64de-4b7b-a47f-308f4628e937 req-e063b539-254b-4686-b3d1-7b6c9819b123 service nova] [instance: 1a3c21c4-2db3-44e1-8a23-336ca9f8374d] Received event network-vif-plugged-f3fb74c0-e5f6-4a65-8d50-b33da34c4fcb {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:31:34 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-6a7f5554-64de-4b7b-a47f-308f4628e937 req-e063b539-254b-4686-b3d1-7b6c9819b123 service nova] Acquiring lock "1a3c21c4-2db3-44e1-8a23-336ca9f8374d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:31:34 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-6a7f5554-64de-4b7b-a47f-308f4628e937 req-e063b539-254b-4686-b3d1-7b6c9819b123 service nova] Lock "1a3c21c4-2db3-44e1-8a23-336ca9f8374d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:31:34 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-6a7f5554-64de-4b7b-a47f-308f4628e937 req-e063b539-254b-4686-b3d1-7b6c9819b123 service nova] Lock "1a3c21c4-2db3-44e1-8a23-336ca9f8374d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:31:34 user nova-compute[75045]: DEBUG nova.compute.manager [req-6a7f5554-64de-4b7b-a47f-308f4628e937 req-e063b539-254b-4686-b3d1-7b6c9819b123 service nova] [instance: 1a3c21c4-2db3-44e1-8a23-336ca9f8374d] No waiting events found dispatching network-vif-plugged-f3fb74c0-e5f6-4a65-8d50-b33da34c4fcb {{(pid=75045) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 23:31:34 user nova-compute[75045]: WARNING nova.compute.manager [req-6a7f5554-64de-4b7b-a47f-308f4628e937 req-e063b539-254b-4686-b3d1-7b6c9819b123 service nova] [instance: 1a3c21c4-2db3-44e1-8a23-336ca9f8374d] Received unexpected event network-vif-plugged-f3fb74c0-e5f6-4a65-8d50-b33da34c4fcb for instance with vm_state deleted and task_state None.
Nov 08 23:31:34 user nova-compute[75045]: DEBUG nova.compute.manager [req-6a7f5554-64de-4b7b-a47f-308f4628e937 req-e063b539-254b-4686-b3d1-7b6c9819b123 service nova] [instance: 9222e62a-9fd8-48b2-a125-83c9cdc589bd] Received event network-changed-5dae7844-411c-47aa-ba3e-bc209136f0a6 {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:31:34 user nova-compute[75045]: DEBUG nova.compute.manager [req-6a7f5554-64de-4b7b-a47f-308f4628e937 req-e063b539-254b-4686-b3d1-7b6c9819b123 service nova] [instance: 9222e62a-9fd8-48b2-a125-83c9cdc589bd] Refreshing instance network info cache due to event network-changed-5dae7844-411c-47aa-ba3e-bc209136f0a6. {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 23:31:34 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-6a7f5554-64de-4b7b-a47f-308f4628e937 req-e063b539-254b-4686-b3d1-7b6c9819b123 service nova] Acquiring lock "refresh_cache-9222e62a-9fd8-48b2-a125-83c9cdc589bd" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 23:31:34 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-6a7f5554-64de-4b7b-a47f-308f4628e937 req-e063b539-254b-4686-b3d1-7b6c9819b123 service nova] Acquired lock "refresh_cache-9222e62a-9fd8-48b2-a125-83c9cdc589bd" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 23:31:34 user nova-compute[75045]: DEBUG nova.network.neutron [req-6a7f5554-64de-4b7b-a47f-308f4628e937 req-e063b539-254b-4686-b3d1-7b6c9819b123 service nova] [instance: 9222e62a-9fd8-48b2-a125-83c9cdc589bd] Refreshing network info cache for port 5dae7844-411c-47aa-ba3e-bc209136f0a6 {{(pid=75045) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 23:31:34 user nova-compute[75045]: DEBUG nova.compute.provider_tree [None req-676de1cf-80b1-49f1-983d-c81ab095f52b tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Inventory has not changed in ProviderTree for provider: 62ba5f85-c74d-4b58-986e-d4197e813fd7 {{(pid=75045) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 23:31:34 user nova-compute[75045]: DEBUG nova.scheduler.client.report [None req-676de1cf-80b1-49f1-983d-c81ab095f52b tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Inventory has not changed for provider 62ba5f85-c74d-4b58-986e-d4197e813fd7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75045) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 23:31:34 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-676de1cf-80b1-49f1-983d-c81ab095f52b tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.599s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:31:34 user nova-compute[75045]: INFO nova.scheduler.client.report [None req-676de1cf-80b1-49f1-983d-c81ab095f52b tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Deleted allocations for instance 1a3c21c4-2db3-44e1-8a23-336ca9f8374d
Nov 08 23:31:34 user nova-compute[75045]: DEBUG nova.network.neutron [req-6a7f5554-64de-4b7b-a47f-308f4628e937 req-e063b539-254b-4686-b3d1-7b6c9819b123 service nova] [instance: 9222e62a-9fd8-48b2-a125-83c9cdc589bd] Updated VIF entry in instance network info cache for port 5dae7844-411c-47aa-ba3e-bc209136f0a6. {{(pid=75045) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 23:31:34 user nova-compute[75045]: DEBUG nova.network.neutron [req-6a7f5554-64de-4b7b-a47f-308f4628e937 req-e063b539-254b-4686-b3d1-7b6c9819b123 service nova] [instance: 9222e62a-9fd8-48b2-a125-83c9cdc589bd] Updating instance_info_cache with network_info: [{"id": "5dae7844-411c-47aa-ba3e-bc209136f0a6", "address": "fa:16:3e:a4:11:9a", "network": {"id": "08d1669a-f667-4c79-8e49-0ad183f57046", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1863648032-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bbb640407ef94f568aea892f1834d6d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5dae7844-41", "ovs_interfaceid": "5dae7844-411c-47aa-ba3e-bc209136f0a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75045) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 23:31:34 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-6a7f5554-64de-4b7b-a47f-308f4628e937 req-e063b539-254b-4686-b3d1-7b6c9819b123 service nova] Releasing lock "refresh_cache-9222e62a-9fd8-48b2-a125-83c9cdc589bd" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 23:31:34 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-676de1cf-80b1-49f1-983d-c81ab095f52b tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Lock "1a3c21c4-2db3-44e1-8a23-336ca9f8374d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.117s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:31:34 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:31:35 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:31:35 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:31:35 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:31:35 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:31:35 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:31:36 user nova-compute[75045]: DEBUG nova.compute.manager [req-fc8e1ff6-8b89-4165-9705-39131c878ad0 req-3e9c40fc-71b5-4e37-b463-cadfc04d2795 service nova] [instance: 9222e62a-9fd8-48b2-a125-83c9cdc589bd] Received event network-vif-plugged-5dae7844-411c-47aa-ba3e-bc209136f0a6 {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:31:36 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-fc8e1ff6-8b89-4165-9705-39131c878ad0 req-3e9c40fc-71b5-4e37-b463-cadfc04d2795 service nova] Acquiring lock "9222e62a-9fd8-48b2-a125-83c9cdc589bd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:31:36 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-fc8e1ff6-8b89-4165-9705-39131c878ad0 req-3e9c40fc-71b5-4e37-b463-cadfc04d2795 service nova] Lock "9222e62a-9fd8-48b2-a125-83c9cdc589bd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:31:36 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-fc8e1ff6-8b89-4165-9705-39131c878ad0 req-3e9c40fc-71b5-4e37-b463-cadfc04d2795 service nova] Lock "9222e62a-9fd8-48b2-a125-83c9cdc589bd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:31:36 user nova-compute[75045]: DEBUG nova.compute.manager [req-fc8e1ff6-8b89-4165-9705-39131c878ad0 req-3e9c40fc-71b5-4e37-b463-cadfc04d2795 service nova] [instance: 9222e62a-9fd8-48b2-a125-83c9cdc589bd] No waiting events found dispatching network-vif-plugged-5dae7844-411c-47aa-ba3e-bc209136f0a6 {{(pid=75045) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 23:31:36 user nova-compute[75045]: WARNING nova.compute.manager [req-fc8e1ff6-8b89-4165-9705-39131c878ad0 req-3e9c40fc-71b5-4e37-b463-cadfc04d2795 service nova] [instance: 9222e62a-9fd8-48b2-a125-83c9cdc589bd] Received unexpected event network-vif-plugged-5dae7844-411c-47aa-ba3e-bc209136f0a6 for instance with vm_state building and task_state spawning.
Nov 08 23:31:36 user nova-compute[75045]: DEBUG nova.compute.manager [req-fc8e1ff6-8b89-4165-9705-39131c878ad0 req-3e9c40fc-71b5-4e37-b463-cadfc04d2795 service nova] [instance: 9222e62a-9fd8-48b2-a125-83c9cdc589bd] Received event network-vif-plugged-5dae7844-411c-47aa-ba3e-bc209136f0a6 {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:31:36 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-fc8e1ff6-8b89-4165-9705-39131c878ad0 req-3e9c40fc-71b5-4e37-b463-cadfc04d2795 service nova] Acquiring lock "9222e62a-9fd8-48b2-a125-83c9cdc589bd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:31:36 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-fc8e1ff6-8b89-4165-9705-39131c878ad0 req-3e9c40fc-71b5-4e37-b463-cadfc04d2795 service nova] Lock "9222e62a-9fd8-48b2-a125-83c9cdc589bd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:31:36 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-fc8e1ff6-8b89-4165-9705-39131c878ad0 req-3e9c40fc-71b5-4e37-b463-cadfc04d2795 service nova] Lock "9222e62a-9fd8-48b2-a125-83c9cdc589bd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:31:36 user nova-compute[75045]: DEBUG nova.compute.manager [req-fc8e1ff6-8b89-4165-9705-39131c878ad0 req-3e9c40fc-71b5-4e37-b463-cadfc04d2795 service nova] [instance: 9222e62a-9fd8-48b2-a125-83c9cdc589bd] No waiting events found dispatching network-vif-plugged-5dae7844-411c-47aa-ba3e-bc209136f0a6 {{(pid=75045) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 23:31:36 user nova-compute[75045]: WARNING nova.compute.manager [req-fc8e1ff6-8b89-4165-9705-39131c878ad0 req-3e9c40fc-71b5-4e37-b463-cadfc04d2795 service nova] [instance: 9222e62a-9fd8-48b2-a125-83c9cdc589bd] Received unexpected event network-vif-plugged-5dae7844-411c-47aa-ba3e-bc209136f0a6 for instance with vm_state building and task_state spawning.
Nov 08 23:31:36 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:31:37 user nova-compute[75045]: DEBUG nova.compute.manager [None req-761e62d9-12b5-4650-9143-045055346e6e tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] [instance: 9222e62a-9fd8-48b2-a125-83c9cdc589bd] Instance event wait completed in 0 seconds for  {{(pid=75045) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 23:31:37 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-761e62d9-12b5-4650-9143-045055346e6e tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] [instance: 9222e62a-9fd8-48b2-a125-83c9cdc589bd] Guest created on hypervisor {{(pid=75045) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 23:31:37 user nova-compute[75045]: INFO nova.virt.libvirt.driver [-] [instance: 9222e62a-9fd8-48b2-a125-83c9cdc589bd] Instance spawned successfully.
Nov 08 23:31:37 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-761e62d9-12b5-4650-9143-045055346e6e tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] [instance: 9222e62a-9fd8-48b2-a125-83c9cdc589bd] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75045) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 23:31:37 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-761e62d9-12b5-4650-9143-045055346e6e tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] [instance: 9222e62a-9fd8-48b2-a125-83c9cdc589bd] Found default for hw_cdrom_bus of ide {{(pid=75045) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 23:31:37 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-761e62d9-12b5-4650-9143-045055346e6e tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] [instance: 9222e62a-9fd8-48b2-a125-83c9cdc589bd] Found default for hw_disk_bus of virtio {{(pid=75045) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 23:31:37 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-761e62d9-12b5-4650-9143-045055346e6e tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] [instance: 9222e62a-9fd8-48b2-a125-83c9cdc589bd] Found default for hw_input_bus of None {{(pid=75045) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 23:31:37 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-761e62d9-12b5-4650-9143-045055346e6e tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] [instance: 9222e62a-9fd8-48b2-a125-83c9cdc589bd] Found default for hw_pointer_model of None {{(pid=75045) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 23:31:37 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-761e62d9-12b5-4650-9143-045055346e6e tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] [instance: 9222e62a-9fd8-48b2-a125-83c9cdc589bd] Found default for hw_video_model of virtio {{(pid=75045) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 23:31:37 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-761e62d9-12b5-4650-9143-045055346e6e tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] [instance: 9222e62a-9fd8-48b2-a125-83c9cdc589bd] Found default for hw_vif_model of virtio {{(pid=75045) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 23:31:37 user nova-compute[75045]: INFO nova.compute.manager [None req-761e62d9-12b5-4650-9143-045055346e6e tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] [instance: 9222e62a-9fd8-48b2-a125-83c9cdc589bd] Took 6.58 seconds to spawn the instance on the hypervisor.
Nov 08 23:31:37 user nova-compute[75045]: DEBUG nova.compute.manager [None req-761e62d9-12b5-4650-9143-045055346e6e tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] [instance: 9222e62a-9fd8-48b2-a125-83c9cdc589bd] Checking state {{(pid=75045) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 23:31:37 user nova-compute[75045]: INFO nova.compute.manager [None req-761e62d9-12b5-4650-9143-045055346e6e tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] [instance: 9222e62a-9fd8-48b2-a125-83c9cdc589bd] Took 7.64 seconds to build instance.
Nov 08 23:31:37 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-761e62d9-12b5-4650-9143-045055346e6e tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] Lock "9222e62a-9fd8-48b2-a125-83c9cdc589bd" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.780s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:31:38 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:31:41 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:31:41 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:31:41 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:31:42 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:31:42 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:31:42 user nova-compute[75045]: DEBUG nova.compute.manager [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75045) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 23:31:43 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:31:44 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:31:44 user nova-compute[75045]: DEBUG nova.compute.manager [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Starting heal instance info cache {{(pid=75045) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 23:31:44 user nova-compute[75045]: DEBUG nova.compute.manager [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Didn't find any instances for network info cache update. {{(pid=75045) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 08 23:31:44 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager.update_available_resource {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:31:45 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:31:45 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:31:45 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:31:45 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Auditing locally available compute resources for user (node: user) {{(pid=75045) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 23:31:45 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72c9d731-2b35-434c-8463-1cd6c18fbd6a/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:31:45 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72c9d731-2b35-434c-8463-1cd6c18fbd6a/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:31:45 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72c9d731-2b35-434c-8463-1cd6c18fbd6a/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:31:45 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72c9d731-2b35-434c-8463-1cd6c18fbd6a/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:31:45 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fd7c34a-55e7-4d54-9c60-03a7155a2685/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:31:45 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fd7c34a-55e7-4d54-9c60-03a7155a2685/disk --force-share --output=json" returned: 0 in 0.236s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:31:45 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fd7c34a-55e7-4d54-9c60-03a7155a2685/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:31:46 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fd7c34a-55e7-4d54-9c60-03a7155a2685/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:31:46 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ae5ff6b-6f2c-4dfd-a4c6-da4809e2cf27/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:31:46 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ae5ff6b-6f2c-4dfd-a4c6-da4809e2cf27/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:31:46 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ae5ff6b-6f2c-4dfd-a4c6-da4809e2cf27/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:31:46 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:31:46 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ae5ff6b-6f2c-4dfd-a4c6-da4809e2cf27/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:31:46 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] skipping disk /dev/sdh (vda) as it is a volume {{(pid=75045) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 23:31:46 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f21fcd3-ac5f-499e-9c34-82af806fda1d/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:31:46 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f21fcd3-ac5f-499e-9c34-82af806fda1d/disk --force-share --output=json" returned: 0 in 0.260s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:31:46 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f21fcd3-ac5f-499e-9c34-82af806fda1d/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:31:46 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f21fcd3-ac5f-499e-9c34-82af806fda1d/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:31:46 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75045) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 23:31:46 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/438082fc-a83f-4305-ada6-41a8e1d645a8/disk.rescue --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:31:47 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/438082fc-a83f-4305-ada6-41a8e1d645a8/disk.rescue --force-share --output=json" returned: 0 in 0.202s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:31:47 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/438082fc-a83f-4305-ada6-41a8e1d645a8/disk.rescue --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:31:47 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/438082fc-a83f-4305-ada6-41a8e1d645a8/disk.rescue --force-share --output=json" returned: 0 in 0.187s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:31:47 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e92ab9a-8ea4-4452-a458-db181d4a59b7/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:31:47 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e92ab9a-8ea4-4452-a458-db181d4a59b7/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:31:47 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e92ab9a-8ea4-4452-a458-db181d4a59b7/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:31:47 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e92ab9a-8ea4-4452-a458-db181d4a59b7/disk --force-share --output=json" returned: 0 in 0.257s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:31:47 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa67b237-f598-4111-87ba-d761aa50d95e/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:31:48 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa67b237-f598-4111-87ba-d761aa50d95e/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:31:48 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa67b237-f598-4111-87ba-d761aa50d95e/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:31:48 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa67b237-f598-4111-87ba-d761aa50d95e/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:31:48 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9222e62a-9fd8-48b2-a125-83c9cdc589bd/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:31:48 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:31:48 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9222e62a-9fd8-48b2-a125-83c9cdc589bd/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:31:48 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9222e62a-9fd8-48b2-a125-83c9cdc589bd/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:31:48 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9222e62a-9fd8-48b2-a125-83c9cdc589bd/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:31:48 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75045) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 23:31:48 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5fc7f02-2143-4bcf-92ac-078d5ec10747/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:31:48 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5fc7f02-2143-4bcf-92ac-078d5ec10747/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:31:48 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5fc7f02-2143-4bcf-92ac-078d5ec10747/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:31:49 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5fc7f02-2143-4bcf-92ac-078d5ec10747/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:31:49 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/adcffd35-00c7-49db-a72f-d6307a90e123/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:31:49 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/adcffd35-00c7-49db-a72f-d6307a90e123/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:31:49 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/adcffd35-00c7-49db-a72f-d6307a90e123/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:31:49 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/adcffd35-00c7-49db-a72f-d6307a90e123/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:31:49 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b84f2b1-01a3-4789-bcef-8b7c4334132b/disk.rescue --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:31:49 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b84f2b1-01a3-4789-bcef-8b7c4334132b/disk.rescue --force-share --output=json" returned: 0 in 0.196s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:31:49 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b84f2b1-01a3-4789-bcef-8b7c4334132b/disk.rescue --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:31:49 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b84f2b1-01a3-4789-bcef-8b7c4334132b/disk.rescue --force-share --output=json" returned: 0 in 0.191s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:31:49 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b84f2b1-01a3-4789-bcef-8b7c4334132b/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:31:50 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b84f2b1-01a3-4789-bcef-8b7c4334132b/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:31:50 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b84f2b1-01a3-4789-bcef-8b7c4334132b/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:31:50 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b84f2b1-01a3-4789-bcef-8b7c4334132b/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:31:50 user nova-compute[75045]: WARNING nova.virt.libvirt.driver [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 23:31:50 user nova-compute[75045]: WARNING nova.virt.libvirt.driver [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 23:31:50 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Hypervisor/Node resource view: name=user free_ram=7230MB free_disk=24.8753662109375GB free_vcpus=-1 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75045) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 23:31:50 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:31:50 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:31:51 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Applying migration context for instance 04169f59-e9a6-4b50-9ad7-7f8c105a376a as it has an incoming, in-progress migration 70a58e7e-3b1b-4b22-87a4-7bd063b467e1. Migration status is finished {{(pid=75045) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 08 23:31:51 user nova-compute[75045]: INFO nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] [instance: 04169f59-e9a6-4b50-9ad7-7f8c105a376a] Updating resource usage from migration 70a58e7e-3b1b-4b22-87a4-7bd063b467e1
Nov 08 23:31:51 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Instance 4ae5ff6b-6f2c-4dfd-a4c6-da4809e2cf27 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75045) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 23:31:51 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Instance 0f21fcd3-ac5f-499e-9c34-82af806fda1d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75045) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 23:31:51 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Instance d2c911cf-d5f4-4c19-8335-8c7834184a7e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75045) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 23:31:51 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Instance b5fc7f02-2143-4bcf-92ac-078d5ec10747 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75045) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 23:31:51 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Instance 0b84f2b1-01a3-4789-bcef-8b7c4334132b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75045) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 23:31:51 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Instance fa67b237-f598-4111-87ba-d761aa50d95e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75045) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 23:31:51 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Instance 7e92ab9a-8ea4-4452-a458-db181d4a59b7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75045) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 23:31:51 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Instance 72c9d731-2b35-434c-8463-1cd6c18fbd6a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75045) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 23:31:51 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Instance 438082fc-a83f-4305-ada6-41a8e1d645a8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75045) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 23:31:51 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Instance 9fd7c34a-55e7-4d54-9c60-03a7155a2685 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75045) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 23:31:51 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Instance adcffd35-00c7-49db-a72f-d6307a90e123 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75045) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 23:31:51 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Migration 70a58e7e-3b1b-4b22-87a4-7bd063b467e1 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75045) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 08 23:31:51 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Instance 04169f59-e9a6-4b50-9ad7-7f8c105a376a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75045) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 23:31:51 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Instance 9222e62a-9fd8-48b2-a125-83c9cdc589bd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75045) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 23:31:51 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Total usable vcpus: 12, total allocated vcpus: 14 {{(pid=75045) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 23:31:51 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Final resource view: name=user phys_ram=16011MB used_ram=9216MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=14 pci_stats=[] {{(pid=75045) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 23:31:51 user nova-compute[75045]: DEBUG nova.scheduler.client.report [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Refreshing inventories for resource provider 62ba5f85-c74d-4b58-986e-d4197e813fd7 {{(pid=75045) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 08 23:31:51 user nova-compute[75045]: DEBUG nova.scheduler.client.report [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Updating ProviderTree inventory for provider 62ba5f85-c74d-4b58-986e-d4197e813fd7 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75045) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 08 23:31:51 user nova-compute[75045]: DEBUG nova.compute.provider_tree [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Updating inventory in ProviderTree for provider 62ba5f85-c74d-4b58-986e-d4197e813fd7 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75045) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 08 23:31:51 user nova-compute[75045]: DEBUG nova.scheduler.client.report [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Refreshing aggregate associations for resource provider 62ba5f85-c74d-4b58-986e-d4197e813fd7, aggregates: None {{(pid=75045) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 08 23:31:51 user nova-compute[75045]: DEBUG nova.scheduler.client.report [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Refreshing trait associations for resource provider 62ba5f85-c74d-4b58-986e-d4197e813fd7, traits: COMPUTE_STORAGE_BUS_SCSI,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_TRUSTED_CERTS,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_VIRTIO,HW_CPU_X86_SSSE3,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_FDC,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_RESCUE_BFV,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSE2,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN {{(pid=75045) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 08 23:31:51 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:31:51 user nova-compute[75045]: DEBUG nova.compute.provider_tree [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Inventory has not changed in ProviderTree for provider: 62ba5f85-c74d-4b58-986e-d4197e813fd7 {{(pid=75045) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 23:31:51 user nova-compute[75045]: DEBUG nova.scheduler.client.report [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Inventory has not changed for provider 62ba5f85-c74d-4b58-986e-d4197e813fd7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75045) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 23:31:51 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Compute_service record updated for user:user {{(pid=75045) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 23:31:51 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.072s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:31:51 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:31:51 user nova-compute[75045]: DEBUG nova.compute.manager [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Cleaning up deleted instances {{(pid=75045) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 08 23:31:51 user nova-compute[75045]: DEBUG nova.compute.manager [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] There are 0 instances to clean {{(pid=75045) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 08 23:31:51 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:31:51 user nova-compute[75045]: DEBUG nova.compute.manager [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Cleaning up deleted instances with incomplete migration  {{(pid=75045) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 08 23:31:51 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:31:52 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:31:52 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:31:52 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:31:52 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:31:53 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:31:54 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-97c6595a-55ba-4e73-8ea8-3987337195ae tempest-VolumesAdminNegativeTest-215528111 tempest-VolumesAdminNegativeTest-215528111-project-member] Acquiring lock "7e92ab9a-8ea4-4452-a458-db181d4a59b7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:31:54 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-97c6595a-55ba-4e73-8ea8-3987337195ae tempest-VolumesAdminNegativeTest-215528111 tempest-VolumesAdminNegativeTest-215528111-project-member] Lock "7e92ab9a-8ea4-4452-a458-db181d4a59b7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:31:54 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-97c6595a-55ba-4e73-8ea8-3987337195ae tempest-VolumesAdminNegativeTest-215528111 tempest-VolumesAdminNegativeTest-215528111-project-member] Acquiring lock "7e92ab9a-8ea4-4452-a458-db181d4a59b7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:31:54 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-97c6595a-55ba-4e73-8ea8-3987337195ae tempest-VolumesAdminNegativeTest-215528111 tempest-VolumesAdminNegativeTest-215528111-project-member] Lock "7e92ab9a-8ea4-4452-a458-db181d4a59b7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:31:54 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-97c6595a-55ba-4e73-8ea8-3987337195ae tempest-VolumesAdminNegativeTest-215528111 tempest-VolumesAdminNegativeTest-215528111-project-member] Lock "7e92ab9a-8ea4-4452-a458-db181d4a59b7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:31:54 user nova-compute[75045]: INFO nova.compute.manager [None req-97c6595a-55ba-4e73-8ea8-3987337195ae tempest-VolumesAdminNegativeTest-215528111 tempest-VolumesAdminNegativeTest-215528111-project-member] [instance: 7e92ab9a-8ea4-4452-a458-db181d4a59b7] Terminating instance
Nov 08 23:31:54 user nova-compute[75045]: DEBUG nova.compute.manager [None req-97c6595a-55ba-4e73-8ea8-3987337195ae tempest-VolumesAdminNegativeTest-215528111 tempest-VolumesAdminNegativeTest-215528111-project-member] [instance: 7e92ab9a-8ea4-4452-a458-db181d4a59b7] Start destroying the instance on the hypervisor. {{(pid=75045) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 23:31:54 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:31:54 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:31:54 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:31:54 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:31:55 user nova-compute[75045]: DEBUG nova.compute.manager [req-a5eb96b3-a251-4d66-ab18-fba4b880d346 req-d1955a2c-0102-483a-a317-c741200dec66 service nova] [instance: 7e92ab9a-8ea4-4452-a458-db181d4a59b7] Received event network-vif-unplugged-5bdaffe7-9bbb-4391-bd1e-406a8fb06ce8 {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:31:55 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-a5eb96b3-a251-4d66-ab18-fba4b880d346 req-d1955a2c-0102-483a-a317-c741200dec66 service nova] Acquiring lock "7e92ab9a-8ea4-4452-a458-db181d4a59b7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:31:55 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-a5eb96b3-a251-4d66-ab18-fba4b880d346 req-d1955a2c-0102-483a-a317-c741200dec66 service nova] Lock "7e92ab9a-8ea4-4452-a458-db181d4a59b7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:31:55 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-a5eb96b3-a251-4d66-ab18-fba4b880d346 req-d1955a2c-0102-483a-a317-c741200dec66 service nova] Lock "7e92ab9a-8ea4-4452-a458-db181d4a59b7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:31:55 user nova-compute[75045]: DEBUG nova.compute.manager [req-a5eb96b3-a251-4d66-ab18-fba4b880d346 req-d1955a2c-0102-483a-a317-c741200dec66 service nova] [instance: 7e92ab9a-8ea4-4452-a458-db181d4a59b7] No waiting events found dispatching network-vif-unplugged-5bdaffe7-9bbb-4391-bd1e-406a8fb06ce8 {{(pid=75045) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 23:31:55 user nova-compute[75045]: DEBUG nova.compute.manager [req-a5eb96b3-a251-4d66-ab18-fba4b880d346 req-d1955a2c-0102-483a-a317-c741200dec66 service nova] [instance: 7e92ab9a-8ea4-4452-a458-db181d4a59b7] Received event network-vif-unplugged-5bdaffe7-9bbb-4391-bd1e-406a8fb06ce8 for instance with task_state deleting. {{(pid=75045) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 23:31:55 user nova-compute[75045]: INFO nova.virt.libvirt.driver [-] [instance: 7e92ab9a-8ea4-4452-a458-db181d4a59b7] Instance destroyed successfully.
Nov 08 23:31:55 user nova-compute[75045]: DEBUG nova.objects.instance [None req-97c6595a-55ba-4e73-8ea8-3987337195ae tempest-VolumesAdminNegativeTest-215528111 tempest-VolumesAdminNegativeTest-215528111-project-member] Lazy-loading 'resources' on Instance uuid 7e92ab9a-8ea4-4452-a458-db181d4a59b7 {{(pid=75045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 23:31:55 user nova-compute[75045]: DEBUG nova.virt.libvirt.vif [None req-97c6595a-55ba-4e73-8ea8-3987337195ae tempest-VolumesAdminNegativeTest-215528111 tempest-VolumesAdminNegativeTest-215528111-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T23:25:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-559874167',display_name='tempest-VolumesAdminNegativeTest-server-559874167',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-559874167',id=24,image_ref='a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB7OPaZAfHvKt2+E15oVkbPnvi9CoEAkVWC2gsPXrdwy5TaXskaero+dIwfo1KjXeaApqr82PEEkuBulV2Gy8m6wD2rx4wz7oc988QwEC4CPCZ8iGmin2Jsik9RO+6LnlA==',key_name='tempest-keypair-935892022',keypairs=<?>,launch_index=0,launched_at=2023-11-08T23:25:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fd25d9a8d6af45bb97e0555101d61489',ramdisk_id='',reservation_id='r-vh5l1bk0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-215528111',owner_user_name='tempest-VolumesAdminNegativeTest-215528111-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T23:25:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8e1203c75e084399aa70a7da8546b122',uuid=7e92ab9a-8ea4-4452-a458-db181d4a59b7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5bdaffe7-9bbb-4391-bd1e-406a8fb06ce8", "address": "fa:16:3e:13:a9:e5", "network": {"id": "e7c66e39-e1ba-4907-8701-33ae849858b2", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-420335537-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.48", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd25d9a8d6af45bb97e0555101d61489", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5bdaffe7-9b", "ovs_interfaceid": "5bdaffe7-9bbb-4391-bd1e-406a8fb06ce8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75045) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 23:31:55 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-97c6595a-55ba-4e73-8ea8-3987337195ae tempest-VolumesAdminNegativeTest-215528111 tempest-VolumesAdminNegativeTest-215528111-project-member] Converting VIF {"id": "5bdaffe7-9bbb-4391-bd1e-406a8fb06ce8", "address": "fa:16:3e:13:a9:e5", "network": {"id": "e7c66e39-e1ba-4907-8701-33ae849858b2", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-420335537-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.48", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd25d9a8d6af45bb97e0555101d61489", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5bdaffe7-9b", "ovs_interfaceid": "5bdaffe7-9bbb-4391-bd1e-406a8fb06ce8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 23:31:55 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-97c6595a-55ba-4e73-8ea8-3987337195ae tempest-VolumesAdminNegativeTest-215528111 tempest-VolumesAdminNegativeTest-215528111-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:13:a9:e5,bridge_name='br-int',has_traffic_filtering=True,id=5bdaffe7-9bbb-4391-bd1e-406a8fb06ce8,network=Network(e7c66e39-e1ba-4907-8701-33ae849858b2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5bdaffe7-9b') {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 23:31:55 user nova-compute[75045]: DEBUG os_vif [None req-97c6595a-55ba-4e73-8ea8-3987337195ae tempest-VolumesAdminNegativeTest-215528111 tempest-VolumesAdminNegativeTest-215528111-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:13:a9:e5,bridge_name='br-int',has_traffic_filtering=True,id=5bdaffe7-9bbb-4391-bd1e-406a8fb06ce8,network=Network(e7c66e39-e1ba-4907-8701-33ae849858b2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5bdaffe7-9b') {{(pid=75045) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 23:31:55 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:31:55 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5bdaffe7-9b, bridge=br-int, if_exists=True) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:31:55 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:31:55 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 23:31:55 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:31:55 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:31:55 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4c9bf376-166e-4435-9269-b51063a5d683) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:31:55 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:31:55 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 23:31:55 user nova-compute[75045]: INFO os_vif [None req-97c6595a-55ba-4e73-8ea8-3987337195ae tempest-VolumesAdminNegativeTest-215528111 tempest-VolumesAdminNegativeTest-215528111-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:13:a9:e5,bridge_name='br-int',has_traffic_filtering=True,id=5bdaffe7-9bbb-4391-bd1e-406a8fb06ce8,network=Network(e7c66e39-e1ba-4907-8701-33ae849858b2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5bdaffe7-9b')
Nov 08 23:31:55 user nova-compute[75045]: INFO nova.virt.libvirt.driver [None req-97c6595a-55ba-4e73-8ea8-3987337195ae tempest-VolumesAdminNegativeTest-215528111 tempest-VolumesAdminNegativeTest-215528111-project-member] [instance: 7e92ab9a-8ea4-4452-a458-db181d4a59b7] Deleting instance files /opt/stack/data/nova/instances/7e92ab9a-8ea4-4452-a458-db181d4a59b7_del
Nov 08 23:31:55 user nova-compute[75045]: INFO nova.virt.libvirt.driver [None req-97c6595a-55ba-4e73-8ea8-3987337195ae tempest-VolumesAdminNegativeTest-215528111 tempest-VolumesAdminNegativeTest-215528111-project-member] [instance: 7e92ab9a-8ea4-4452-a458-db181d4a59b7] Deletion of /opt/stack/data/nova/instances/7e92ab9a-8ea4-4452-a458-db181d4a59b7_del complete
Nov 08 23:31:55 user nova-compute[75045]: INFO nova.compute.manager [None req-97c6595a-55ba-4e73-8ea8-3987337195ae tempest-VolumesAdminNegativeTest-215528111 tempest-VolumesAdminNegativeTest-215528111-project-member] [instance: 7e92ab9a-8ea4-4452-a458-db181d4a59b7] Took 1.17 seconds to destroy the instance on the hypervisor.
Nov 08 23:31:55 user nova-compute[75045]: DEBUG oslo.service.loopingcall [None req-97c6595a-55ba-4e73-8ea8-3987337195ae tempest-VolumesAdminNegativeTest-215528111 tempest-VolumesAdminNegativeTest-215528111-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75045) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 23:31:55 user nova-compute[75045]: DEBUG nova.compute.manager [-] [instance: 7e92ab9a-8ea4-4452-a458-db181d4a59b7] Deallocating network for instance {{(pid=75045) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 23:31:55 user nova-compute[75045]: DEBUG nova.network.neutron [-] [instance: 7e92ab9a-8ea4-4452-a458-db181d4a59b7] deallocate_for_instance() {{(pid=75045) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 23:31:56 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:31:56 user nova-compute[75045]: DEBUG nova.network.neutron [-] [instance: 7e92ab9a-8ea4-4452-a458-db181d4a59b7] Updating instance_info_cache with network_info: [] {{(pid=75045) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 23:31:56 user nova-compute[75045]: INFO nova.compute.manager [-] [instance: 7e92ab9a-8ea4-4452-a458-db181d4a59b7] Took 0.95 seconds to deallocate network for instance.
Nov 08 23:31:56 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-97c6595a-55ba-4e73-8ea8-3987337195ae tempest-VolumesAdminNegativeTest-215528111 tempest-VolumesAdminNegativeTest-215528111-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:31:56 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-97c6595a-55ba-4e73-8ea8-3987337195ae tempest-VolumesAdminNegativeTest-215528111 tempest-VolumesAdminNegativeTest-215528111-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:31:57 user nova-compute[75045]: DEBUG nova.compute.manager [req-221ef1b3-93a5-459b-82b7-983abb47c2b0 req-c4424943-597a-422a-a815-d23df44eb105 service nova] [instance: 7e92ab9a-8ea4-4452-a458-db181d4a59b7] Received event network-vif-deleted-5bdaffe7-9bbb-4391-bd1e-406a8fb06ce8 {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:31:57 user nova-compute[75045]: DEBUG nova.compute.manager [req-34e44476-af77-497c-b68b-97c247dea572 req-6f4cc0a1-d775-46c8-b89b-3ca1a70d7528 service nova] [instance: 7e92ab9a-8ea4-4452-a458-db181d4a59b7] Received event network-vif-plugged-5bdaffe7-9bbb-4391-bd1e-406a8fb06ce8 {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:31:57 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-34e44476-af77-497c-b68b-97c247dea572 req-6f4cc0a1-d775-46c8-b89b-3ca1a70d7528 service nova] Acquiring lock "7e92ab9a-8ea4-4452-a458-db181d4a59b7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:31:57 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-34e44476-af77-497c-b68b-97c247dea572 req-6f4cc0a1-d775-46c8-b89b-3ca1a70d7528 service nova] Lock "7e92ab9a-8ea4-4452-a458-db181d4a59b7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:31:57 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-34e44476-af77-497c-b68b-97c247dea572 req-6f4cc0a1-d775-46c8-b89b-3ca1a70d7528 service nova] Lock "7e92ab9a-8ea4-4452-a458-db181d4a59b7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:31:57 user nova-compute[75045]: DEBUG nova.compute.manager [req-34e44476-af77-497c-b68b-97c247dea572 req-6f4cc0a1-d775-46c8-b89b-3ca1a70d7528 service nova] [instance: 7e92ab9a-8ea4-4452-a458-db181d4a59b7] No waiting events found dispatching network-vif-plugged-5bdaffe7-9bbb-4391-bd1e-406a8fb06ce8 {{(pid=75045) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 23:31:57 user nova-compute[75045]: WARNING nova.compute.manager [req-34e44476-af77-497c-b68b-97c247dea572 req-6f4cc0a1-d775-46c8-b89b-3ca1a70d7528 service nova] [instance: 7e92ab9a-8ea4-4452-a458-db181d4a59b7] Received unexpected event network-vif-plugged-5bdaffe7-9bbb-4391-bd1e-406a8fb06ce8 for instance with vm_state deleted and task_state None.
Nov 08 23:31:57 user nova-compute[75045]: DEBUG nova.compute.provider_tree [None req-97c6595a-55ba-4e73-8ea8-3987337195ae tempest-VolumesAdminNegativeTest-215528111 tempest-VolumesAdminNegativeTest-215528111-project-member] Inventory has not changed in ProviderTree for provider: 62ba5f85-c74d-4b58-986e-d4197e813fd7 {{(pid=75045) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 23:31:57 user nova-compute[75045]: DEBUG nova.scheduler.client.report [None req-97c6595a-55ba-4e73-8ea8-3987337195ae tempest-VolumesAdminNegativeTest-215528111 tempest-VolumesAdminNegativeTest-215528111-project-member] Inventory has not changed for provider 62ba5f85-c74d-4b58-986e-d4197e813fd7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75045) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 23:31:57 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-97c6595a-55ba-4e73-8ea8-3987337195ae tempest-VolumesAdminNegativeTest-215528111 tempest-VolumesAdminNegativeTest-215528111-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.522s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:31:57 user nova-compute[75045]: INFO nova.scheduler.client.report [None req-97c6595a-55ba-4e73-8ea8-3987337195ae tempest-VolumesAdminNegativeTest-215528111 tempest-VolumesAdminNegativeTest-215528111-project-member] Deleted allocations for instance 7e92ab9a-8ea4-4452-a458-db181d4a59b7
Nov 08 23:31:57 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-97c6595a-55ba-4e73-8ea8-3987337195ae tempest-VolumesAdminNegativeTest-215528111 tempest-VolumesAdminNegativeTest-215528111-project-member] Lock "7e92ab9a-8ea4-4452-a458-db181d4a59b7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.943s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:32:00 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:32:01 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:32:04 user nova-compute[75045]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6acb7fce-c440-4767-b0d2-5ccc81f1f8ba tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] [instance: adcffd35-00c7-49db-a72f-d6307a90e123] Calling os-brick to attach iSCSI Volume {{(pid=75045) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 23:32:04 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-6acb7fce-c440-4767-b0d2-5ccc81f1f8ba tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1b68210460>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:165cfb75-c15e-4b34-9324-edd8f21b6173', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ktTCIhHi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75045) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 23:32:04 user nova-compute[75045]: WARNING os_brick.initiator.connectors.base [None req-6acb7fce-c440-4767-b0d2-5ccc81f1f8ba tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 23:32:04 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-6acb7fce-c440-4767-b0d2-5ccc81f1f8ba tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 23:32:04 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-6acb7fce-c440-4767-b0d2-5ccc81f1f8ba tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 23:32:04 user nova-compute[75045]: WARNING os_brick.initiator.connectors.base [None req-6acb7fce-c440-4767-b0d2-5ccc81f1f8ba tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 23:32:04 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-6acb7fce-c440-4767-b0d2-5ccc81f1f8ba tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:165cfb75-c15e-4b34-9324-edd8f21b6173" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 23:32:04 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-6acb7fce-c440-4767-b0d2-5ccc81f1f8ba tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:165cfb75-c15e-4b34-9324-edd8f21b6173" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 23:32:04 user nova-compute[75045]: INFO os_brick.initiator.connectors.iscsi [None req-6acb7fce-c440-4767-b0d2-5ccc81f1f8ba tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 23:32:04 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:165cfb75-c15e-4b34-9324-edd8f21b6173 -p 172.16.0.220:3260 {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:32:04 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:165cfb75-c15e-4b34-9324-edd8f21b6173 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:32:04 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[c595899f-5d9a-47fd-b6e9-83013bc71c87]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:32:04 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-6acb7fce-c440-4767-b0d2-5ccc81f1f8ba tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 23:32:04 user nova-compute[75045]:  {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:32:04 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:165cfb75-c15e-4b34-9324-edd8f21b6173 -p 172.16.0.220:3260 --interface default --op new {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:32:04 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:165cfb75-c15e-4b34-9324-edd8f21b6173 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:32:04 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff24e056-1c2e-46de-a49a-8df831eefb8f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:165cfb75-c15e-4b34-9324-edd8f21b6173] added\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:32:04 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-6acb7fce-c440-4767-b0d2-5ccc81f1f8ba tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:165cfb75-c15e-4b34-9324-edd8f21b6173] added
Nov 08 23:32:04 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:32:04 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:165cfb75-c15e-4b34-9324-edd8f21b6173 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:32:04 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:165cfb75-c15e-4b34-9324-edd8f21b6173 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:32:04 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bfde6c7-53f1-4103-9308-49c7b983b88e]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:32:04 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-6acb7fce-c440-4767-b0d2-5ccc81f1f8ba tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:32:04 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:165cfb75-c15e-4b34-9324-edd8f21b6173 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:32:04 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:165cfb75-c15e-4b34-9324-edd8f21b6173 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:32:04 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[353b8ed9-5a2f-4327-87ba-2bd7b5aa02c6]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:32:04 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-6acb7fce-c440-4767-b0d2-5ccc81f1f8ba tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:32:04 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:165cfb75-c15e-4b34-9324-edd8f21b6173 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ktTCIhHi {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:32:04 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:165cfb75-c15e-4b34-9324-edd8f21b6173 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ktTCIhHi" returned: 0 in 0.018s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:32:04 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[f053c27a-1a95-4c94-a57a-03af0c416bda]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:32:04 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-6acb7fce-c440-4767-b0d2-5ccc81f1f8ba tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ktTCIhHi'): stdout= stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:32:04 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:165cfb75-c15e-4b34-9324-edd8f21b6173 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:32:04 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:165cfb75-c15e-4b34-9324-edd8f21b6173 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:32:04 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[76e65990-a376-44f9-ada6-2b4f08a66af4]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:32:04 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-6acb7fce-c440-4767-b0d2-5ccc81f1f8ba tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:32:04 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:32:04 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:32:04 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff6e201b-7b97-4634-9e9e-857ac210a954]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83187c89-e833-4efd-afa0-2cbfe05d8db1 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9c3ac6d-d72a-41c8-9c18-15131250e323 (non-flash)\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:32:04 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-6acb7fce-c440-4767-b0d2-5ccc81f1f8ba tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab (non-flash)
Nov 08 23:32:04 user nova-compute[75045]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83187c89-e833-4efd-afa0-2cbfe05d8db1 (non-flash)
Nov 08 23:32:04 user nova-compute[75045]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9c3ac6d-d72a-41c8-9c18-15131250e323 (non-flash)
Nov 08 23:32:04 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 23:32:04 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-6acb7fce-c440-4767-b0d2-5ccc81f1f8ba tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab (non-flash)
Nov 08 23:32:04 user nova-compute[75045]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83187c89-e833-4efd-afa0-2cbfe05d8db1 (non-flash)
Nov 08 23:32:04 user nova-compute[75045]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9c3ac6d-d72a-41c8-9c18-15131250e323 (non-flash)
Nov 08 23:32:04 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 23:32:04 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:165cfb75-c15e-4b34-9324-edd8f21b6173 -p 172.16.0.220:3260 --login {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:32:04 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:165cfb75-c15e-4b34-9324-edd8f21b6173 -p 172.16.0.220:3260 --login" returned: 0 in 0.076s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:32:04 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a0d5297-59ab-47a3-8594-82d3b92c3bd6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:165cfb75-c15e-4b34-9324-edd8f21b6173, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:165cfb75-c15e-4b34-9324-edd8f21b6173, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:32:04 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-6acb7fce-c440-4767-b0d2-5ccc81f1f8ba tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:165cfb75-c15e-4b34-9324-edd8f21b6173, portal: 172.16.0.220,3260]
Nov 08 23:32:04 user nova-compute[75045]: Login to [iface: default, target: iqn.2010-10.org.openstack:165cfb75-c15e-4b34-9324-edd8f21b6173, portal: 172.16.0.220,3260] successful.
Nov 08 23:32:04 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:32:04 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:165cfb75-c15e-4b34-9324-edd8f21b6173 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:32:04 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:165cfb75-c15e-4b34-9324-edd8f21b6173 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:32:04 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[985a98b0-6dd4-40cd-9ffb-8897023015d5]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:32:04 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-6acb7fce-c440-4767-b0d2-5ccc81f1f8ba tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:32:04 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:32:04 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:32:04 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[a40441f9-fe94-48c1-bf37-c49e9d474480]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83187c89-e833-4efd-afa0-2cbfe05d8db1 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9c3ac6d-d72a-41c8-9c18-15131250e323 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:165cfb75-c15e-4b34-9324-edd8f21b6173 (non-flash)\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:32:04 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-6acb7fce-c440-4767-b0d2-5ccc81f1f8ba tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab (non-flash)
Nov 08 23:32:04 user nova-compute[75045]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83187c89-e833-4efd-afa0-2cbfe05d8db1 (non-flash)
Nov 08 23:32:04 user nova-compute[75045]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9c3ac6d-d72a-41c8-9c18-15131250e323 (non-flash)
Nov 08 23:32:04 user nova-compute[75045]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:165cfb75-c15e-4b34-9324-edd8f21b6173 (non-flash)
Nov 08 23:32:04 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 23:32:04 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-6acb7fce-c440-4767-b0d2-5ccc81f1f8ba tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab (non-flash)
Nov 08 23:32:04 user nova-compute[75045]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83187c89-e833-4efd-afa0-2cbfe05d8db1 (non-flash)
Nov 08 23:32:04 user nova-compute[75045]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9c3ac6d-d72a-41c8-9c18-15131250e323 (non-flash)
Nov 08 23:32:04 user nova-compute[75045]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:165cfb75-c15e-4b34-9324-edd8f21b6173 (non-flash)
Nov 08 23:32:04 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 23:32:04 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-6acb7fce-c440-4767-b0d2-5ccc81f1f8ba tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:165cfb75-c15e-4b34-9324-edd8f21b6173" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.309s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 23:32:04 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-6acb7fce-c440-4767-b0d2-5ccc81f1f8ba tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] Connected to 172.16.0.220:3260 {{(pid=75045) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 23:32:04 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-6acb7fce-c440-4767-b0d2-5ccc81f1f8ba tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] HCTL ('33', '-', '-', 0) found on session 33 with lun 0 {{(pid=75045) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 23:32:04 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-6acb7fce-c440-4767-b0d2-5ccc81f1f8ba tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75045) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 23:32:04 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:32:04 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:32:04 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b9c27aa-871a-4bd7-a21b-fb34c7ba26d5]: (4, ('- - 0', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:32:04 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-6acb7fce-c440-4767-b0d2-5ccc81f1f8ba tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] Searching for a device in session 33 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75045) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 23:32:04 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-6acb7fce-c440-4767-b0d2-5ccc81f1f8ba tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:165cfb75-c15e-4b34-9324-edd8f21b6173', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ktTCIhHi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75045) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 23:32:05 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._sync_power_states {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:32:05 user nova-compute[75045]: DEBUG nova.compute.manager [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Triggering sync for uuid 4ae5ff6b-6f2c-4dfd-a4c6-da4809e2cf27 {{(pid=75045) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 08 23:32:05 user nova-compute[75045]: DEBUG nova.compute.manager [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Triggering sync for uuid 0f21fcd3-ac5f-499e-9c34-82af806fda1d {{(pid=75045) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 08 23:32:05 user nova-compute[75045]: DEBUG nova.compute.manager [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Triggering sync for uuid d2c911cf-d5f4-4c19-8335-8c7834184a7e {{(pid=75045) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 08 23:32:05 user nova-compute[75045]: DEBUG nova.compute.manager [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Triggering sync for uuid b5fc7f02-2143-4bcf-92ac-078d5ec10747 {{(pid=75045) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 08 23:32:05 user nova-compute[75045]: DEBUG nova.compute.manager [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Triggering sync for uuid 0b84f2b1-01a3-4789-bcef-8b7c4334132b {{(pid=75045) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 08 23:32:05 user nova-compute[75045]: DEBUG nova.compute.manager [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Triggering sync for uuid fa67b237-f598-4111-87ba-d761aa50d95e {{(pid=75045) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 08 23:32:05 user nova-compute[75045]: DEBUG nova.compute.manager [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Triggering sync for uuid 72c9d731-2b35-434c-8463-1cd6c18fbd6a {{(pid=75045) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 08 23:32:05 user nova-compute[75045]: DEBUG nova.compute.manager [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Triggering sync for uuid 438082fc-a83f-4305-ada6-41a8e1d645a8 {{(pid=75045) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 08 23:32:05 user nova-compute[75045]: DEBUG nova.compute.manager [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Triggering sync for uuid 04169f59-e9a6-4b50-9ad7-7f8c105a376a {{(pid=75045) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 08 23:32:05 user nova-compute[75045]: DEBUG nova.compute.manager [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Triggering sync for uuid 9fd7c34a-55e7-4d54-9c60-03a7155a2685 {{(pid=75045) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 08 23:32:05 user nova-compute[75045]: DEBUG nova.compute.manager [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Triggering sync for uuid adcffd35-00c7-49db-a72f-d6307a90e123 {{(pid=75045) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 08 23:32:05 user nova-compute[75045]: DEBUG nova.compute.manager [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Triggering sync for uuid 9222e62a-9fd8-48b2-a125-83c9cdc589bd {{(pid=75045) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 08 23:32:05 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Acquiring lock "4ae5ff6b-6f2c-4dfd-a4c6-da4809e2cf27" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:32:05 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Lock "4ae5ff6b-6f2c-4dfd-a4c6-da4809e2cf27" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:32:05 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Acquiring lock "0f21fcd3-ac5f-499e-9c34-82af806fda1d" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:32:05 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Lock "0f21fcd3-ac5f-499e-9c34-82af806fda1d" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:32:05 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Acquiring lock "d2c911cf-d5f4-4c19-8335-8c7834184a7e" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:32:05 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Lock "d2c911cf-d5f4-4c19-8335-8c7834184a7e" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:32:05 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Acquiring lock "b5fc7f02-2143-4bcf-92ac-078d5ec10747" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:32:05 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Lock "b5fc7f02-2143-4bcf-92ac-078d5ec10747" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:32:05 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Acquiring lock "0b84f2b1-01a3-4789-bcef-8b7c4334132b" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:32:05 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Lock "0b84f2b1-01a3-4789-bcef-8b7c4334132b" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:32:05 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Acquiring lock "fa67b237-f598-4111-87ba-d761aa50d95e" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:32:05 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Lock "fa67b237-f598-4111-87ba-d761aa50d95e" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:32:05 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Acquiring lock "72c9d731-2b35-434c-8463-1cd6c18fbd6a" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:32:05 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Lock "72c9d731-2b35-434c-8463-1cd6c18fbd6a" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:32:05 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Acquiring lock "438082fc-a83f-4305-ada6-41a8e1d645a8" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:32:05 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Lock "438082fc-a83f-4305-ada6-41a8e1d645a8" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:32:05 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Acquiring lock "04169f59-e9a6-4b50-9ad7-7f8c105a376a" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:32:05 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Lock "04169f59-e9a6-4b50-9ad7-7f8c105a376a" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:32:05 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Acquiring lock "9fd7c34a-55e7-4d54-9c60-03a7155a2685" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:32:05 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Lock "9fd7c34a-55e7-4d54-9c60-03a7155a2685" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:32:05 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Acquiring lock "adcffd35-00c7-49db-a72f-d6307a90e123" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:32:05 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Acquiring lock "9222e62a-9fd8-48b2-a125-83c9cdc589bd" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:32:05 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Lock "9222e62a-9fd8-48b2-a125-83c9cdc589bd" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:32:05 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Lock "d2c911cf-d5f4-4c19-8335-8c7834184a7e" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.055s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:32:05 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Lock "4ae5ff6b-6f2c-4dfd-a4c6-da4809e2cf27" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.066s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:32:05 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Lock "fa67b237-f598-4111-87ba-d761aa50d95e" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.064s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:32:05 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Lock "0f21fcd3-ac5f-499e-9c34-82af806fda1d" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.077s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:32:05 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Lock "b5fc7f02-2143-4bcf-92ac-078d5ec10747" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.077s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:32:05 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Lock "04169f59-e9a6-4b50-9ad7-7f8c105a376a" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.073s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:32:05 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Lock "9fd7c34a-55e7-4d54-9c60-03a7155a2685" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.079s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:32:05 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Lock "0b84f2b1-01a3-4789-bcef-8b7c4334132b" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.090s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:32:05 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Lock "438082fc-a83f-4305-ada6-41a8e1d645a8" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.095s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:32:05 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Lock "9222e62a-9fd8-48b2-a125-83c9cdc589bd" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.096s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:32:05 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Lock "72c9d731-2b35-434c-8463-1cd6c18fbd6a" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.101s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:32:05 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:32:05 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-6acb7fce-c440-4767-b0d2-5ccc81f1f8ba tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.355s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 23:32:05 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-6acb7fce-c440-4767-b0d2-5ccc81f1f8ba tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] <== connect_volume: return (1357ms) {'type': 'block', 'scsi_wwn': '26432623537653837', 'path': '/dev/sdb'} {{(pid=75045) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 23:32:05 user nova-compute[75045]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6acb7fce-c440-4767-b0d2-5ccc81f1f8ba tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] [instance: adcffd35-00c7-49db-a72f-d6307a90e123] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26432623537653837', 'path': '/dev/sdb'} {{(pid=75045) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 23:32:05 user nova-compute[75045]: DEBUG nova.objects.instance [None req-6acb7fce-c440-4767-b0d2-5ccc81f1f8ba tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] Lazy-loading 'flavor' on Instance uuid adcffd35-00c7-49db-a72f-d6307a90e123 {{(pid=75045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 23:32:05 user nova-compute[75045]: DEBUG nova.virt.libvirt.guest [None req-6acb7fce-c440-4767-b0d2-5ccc81f1f8ba tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] attach device xml: <disk type="block" device="disk">
Nov 08 23:32:05 user nova-compute[75045]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 23:32:05 user nova-compute[75045]:   <source dev="/dev/sdb"/>
Nov 08 23:32:05 user nova-compute[75045]:   <target dev="vdb" bus="virtio"/>
Nov 08 23:32:05 user nova-compute[75045]:   <serial>165cfb75-c15e-4b34-9324-edd8f21b6173</serial>
Nov 08 23:32:05 user nova-compute[75045]: </disk>
Nov 08 23:32:05 user nova-compute[75045]:  {{(pid=75045) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 08 23:32:06 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-6acb7fce-c440-4767-b0d2-5ccc81f1f8ba tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] No BDM found with device name vda, not building metadata. {{(pid=75045) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 23:32:06 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-6acb7fce-c440-4767-b0d2-5ccc81f1f8ba tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75045) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 23:32:06 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-6acb7fce-c440-4767-b0d2-5ccc81f1f8ba tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] No VIF found with MAC fa:16:3e:60:a2:7b, not building metadata {{(pid=75045) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 23:32:06 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:32:06 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-6acb7fce-c440-4767-b0d2-5ccc81f1f8ba tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] Lock "adcffd35-00c7-49db-a72f-d6307a90e123" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 41.519s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:32:06 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Lock "adcffd35-00c7-49db-a72f-d6307a90e123" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 1.250s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:32:06 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Lock "adcffd35-00c7-49db-a72f-d6307a90e123" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.037s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:32:10 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:32:11 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:32:15 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:32:20 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:32:23 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:32:25 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:32:26 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-60f5c230-921a-4bf8-92b2-a6a2534368e9 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Acquiring lock "a63971de-a2bf-4e58-a760-30eaec3b83c0" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:32:26 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-60f5c230-921a-4bf8-92b2-a6a2534368e9 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Lock "a63971de-a2bf-4e58-a760-30eaec3b83c0" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:32:26 user nova-compute[75045]: DEBUG nova.compute.manager [None req-60f5c230-921a-4bf8-92b2-a6a2534368e9 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] [instance: a63971de-a2bf-4e58-a760-30eaec3b83c0] Starting instance... {{(pid=75045) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 23:32:26 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:32:26 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-60f5c230-921a-4bf8-92b2-a6a2534368e9 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:32:26 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-60f5c230-921a-4bf8-92b2-a6a2534368e9 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:32:26 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-60f5c230-921a-4bf8-92b2-a6a2534368e9 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75045) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 23:32:26 user nova-compute[75045]: INFO nova.compute.claims [None req-60f5c230-921a-4bf8-92b2-a6a2534368e9 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] [instance: a63971de-a2bf-4e58-a760-30eaec3b83c0] Claim successful on node user
Nov 08 23:32:27 user nova-compute[75045]: DEBUG nova.compute.provider_tree [None req-60f5c230-921a-4bf8-92b2-a6a2534368e9 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Inventory has not changed in ProviderTree for provider: 62ba5f85-c74d-4b58-986e-d4197e813fd7 {{(pid=75045) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 23:32:27 user nova-compute[75045]: DEBUG nova.scheduler.client.report [None req-60f5c230-921a-4bf8-92b2-a6a2534368e9 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Inventory has not changed for provider 62ba5f85-c74d-4b58-986e-d4197e813fd7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75045) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 23:32:27 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-60f5c230-921a-4bf8-92b2-a6a2534368e9 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.740s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:32:27 user nova-compute[75045]: DEBUG nova.compute.manager [None req-60f5c230-921a-4bf8-92b2-a6a2534368e9 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] [instance: a63971de-a2bf-4e58-a760-30eaec3b83c0] Start building networks asynchronously for instance. {{(pid=75045) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 23:32:27 user nova-compute[75045]: DEBUG nova.compute.manager [None req-60f5c230-921a-4bf8-92b2-a6a2534368e9 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] [instance: a63971de-a2bf-4e58-a760-30eaec3b83c0] Allocating IP information in the background. {{(pid=75045) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 23:32:27 user nova-compute[75045]: DEBUG nova.network.neutron [None req-60f5c230-921a-4bf8-92b2-a6a2534368e9 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] [instance: a63971de-a2bf-4e58-a760-30eaec3b83c0] allocate_for_instance() {{(pid=75045) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 23:32:27 user nova-compute[75045]: INFO nova.virt.libvirt.driver [None req-60f5c230-921a-4bf8-92b2-a6a2534368e9 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] [instance: a63971de-a2bf-4e58-a760-30eaec3b83c0] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 23:32:27 user nova-compute[75045]: DEBUG nova.compute.manager [None req-60f5c230-921a-4bf8-92b2-a6a2534368e9 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] [instance: a63971de-a2bf-4e58-a760-30eaec3b83c0] Start building block device mappings for instance. {{(pid=75045) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 23:32:27 user nova-compute[75045]: DEBUG nova.policy [None req-60f5c230-921a-4bf8-92b2-a6a2534368e9 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4a05b178abe74b779a991e887bf135b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eff4be777d24514be52868961bf7a25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75045) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 23:32:27 user nova-compute[75045]: DEBUG nova.compute.manager [None req-60f5c230-921a-4bf8-92b2-a6a2534368e9 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] [instance: a63971de-a2bf-4e58-a760-30eaec3b83c0] Start spawning the instance on the hypervisor. {{(pid=75045) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 23:32:27 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-60f5c230-921a-4bf8-92b2-a6a2534368e9 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] [instance: a63971de-a2bf-4e58-a760-30eaec3b83c0] Creating instance directory {{(pid=75045) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 23:32:27 user nova-compute[75045]: INFO nova.virt.libvirt.driver [None req-60f5c230-921a-4bf8-92b2-a6a2534368e9 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] [instance: a63971de-a2bf-4e58-a760-30eaec3b83c0] Creating image(s)
Nov 08 23:32:27 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-60f5c230-921a-4bf8-92b2-a6a2534368e9 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Acquiring lock "/opt/stack/data/nova/instances/a63971de-a2bf-4e58-a760-30eaec3b83c0/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:32:27 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-60f5c230-921a-4bf8-92b2-a6a2534368e9 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Lock "/opt/stack/data/nova/instances/a63971de-a2bf-4e58-a760-30eaec3b83c0/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:32:27 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-60f5c230-921a-4bf8-92b2-a6a2534368e9 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Lock "/opt/stack/data/nova/instances/a63971de-a2bf-4e58-a760-30eaec3b83c0/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:32:27 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-60f5c230-921a-4bf8-92b2-a6a2534368e9 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b59f52a99fff51c56dd1edfb83892fb8f647f2f3 --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:32:27 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-60f5c230-921a-4bf8-92b2-a6a2534368e9 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b59f52a99fff51c56dd1edfb83892fb8f647f2f3 --force-share --output=json" returned: 0 in 0.227s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:32:27 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-60f5c230-921a-4bf8-92b2-a6a2534368e9 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Acquiring lock "b59f52a99fff51c56dd1edfb83892fb8f647f2f3" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:32:27 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-60f5c230-921a-4bf8-92b2-a6a2534368e9 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Lock "b59f52a99fff51c56dd1edfb83892fb8f647f2f3" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:32:27 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-60f5c230-921a-4bf8-92b2-a6a2534368e9 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b59f52a99fff51c56dd1edfb83892fb8f647f2f3 --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:32:27 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-60f5c230-921a-4bf8-92b2-a6a2534368e9 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b59f52a99fff51c56dd1edfb83892fb8f647f2f3 --force-share --output=json" returned: 0 in 0.211s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:32:27 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-60f5c230-921a-4bf8-92b2-a6a2534368e9 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b59f52a99fff51c56dd1edfb83892fb8f647f2f3,backing_fmt=raw /opt/stack/data/nova/instances/a63971de-a2bf-4e58-a760-30eaec3b83c0/disk 1073741824 {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:32:27 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-60f5c230-921a-4bf8-92b2-a6a2534368e9 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b59f52a99fff51c56dd1edfb83892fb8f647f2f3,backing_fmt=raw /opt/stack/data/nova/instances/a63971de-a2bf-4e58-a760-30eaec3b83c0/disk 1073741824" returned: 0 in 0.071s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:32:27 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-60f5c230-921a-4bf8-92b2-a6a2534368e9 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Lock "b59f52a99fff51c56dd1edfb83892fb8f647f2f3" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.291s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:32:27 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-60f5c230-921a-4bf8-92b2-a6a2534368e9 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b59f52a99fff51c56dd1edfb83892fb8f647f2f3 --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:32:28 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-60f5c230-921a-4bf8-92b2-a6a2534368e9 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b59f52a99fff51c56dd1edfb83892fb8f647f2f3 --force-share --output=json" returned: 0 in 0.205s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:32:28 user nova-compute[75045]: DEBUG nova.virt.disk.api [None req-60f5c230-921a-4bf8-92b2-a6a2534368e9 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a63971de-a2bf-4e58-a760-30eaec3b83c0/disk. size=1073741824 {{(pid=75045) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 23:32:28 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-60f5c230-921a-4bf8-92b2-a6a2534368e9 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a63971de-a2bf-4e58-a760-30eaec3b83c0/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:32:28 user nova-compute[75045]: DEBUG nova.network.neutron [None req-60f5c230-921a-4bf8-92b2-a6a2534368e9 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] [instance: a63971de-a2bf-4e58-a760-30eaec3b83c0] Successfully created port: 50aeb5be-ac90-4e8f-ace6-e31512769f3b {{(pid=75045) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 23:32:28 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-60f5c230-921a-4bf8-92b2-a6a2534368e9 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a63971de-a2bf-4e58-a760-30eaec3b83c0/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:32:28 user nova-compute[75045]: DEBUG nova.virt.disk.api [None req-60f5c230-921a-4bf8-92b2-a6a2534368e9 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Cannot resize image /opt/stack/data/nova/instances/a63971de-a2bf-4e58-a760-30eaec3b83c0/disk to a smaller size. {{(pid=75045) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 08 23:32:28 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-60f5c230-921a-4bf8-92b2-a6a2534368e9 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] [instance: a63971de-a2bf-4e58-a760-30eaec3b83c0] Created local disks {{(pid=75045) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 23:32:28 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-60f5c230-921a-4bf8-92b2-a6a2534368e9 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] [instance: a63971de-a2bf-4e58-a760-30eaec3b83c0] Ensure instance console log exists: /opt/stack/data/nova/instances/a63971de-a2bf-4e58-a760-30eaec3b83c0/console.log {{(pid=75045) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 23:32:28 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-60f5c230-921a-4bf8-92b2-a6a2534368e9 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:32:28 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-60f5c230-921a-4bf8-92b2-a6a2534368e9 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:32:28 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-60f5c230-921a-4bf8-92b2-a6a2534368e9 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:32:29 user nova-compute[75045]: DEBUG nova.network.neutron [None req-60f5c230-921a-4bf8-92b2-a6a2534368e9 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] [instance: a63971de-a2bf-4e58-a760-30eaec3b83c0] Successfully updated port: 50aeb5be-ac90-4e8f-ace6-e31512769f3b {{(pid=75045) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 23:32:29 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-60f5c230-921a-4bf8-92b2-a6a2534368e9 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Acquiring lock "refresh_cache-a63971de-a2bf-4e58-a760-30eaec3b83c0" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 23:32:29 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-60f5c230-921a-4bf8-92b2-a6a2534368e9 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Acquired lock "refresh_cache-a63971de-a2bf-4e58-a760-30eaec3b83c0" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 23:32:29 user nova-compute[75045]: DEBUG nova.network.neutron [None req-60f5c230-921a-4bf8-92b2-a6a2534368e9 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] [instance: a63971de-a2bf-4e58-a760-30eaec3b83c0] Building network info cache for instance {{(pid=75045) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 23:32:29 user nova-compute[75045]: DEBUG nova.compute.manager [req-38c234fe-dd00-4d4c-92a5-209cb4cce4b5 req-4b687c29-7d39-4dd4-be1b-ed27d434acb8 service nova] [instance: a63971de-a2bf-4e58-a760-30eaec3b83c0] Received event network-changed-50aeb5be-ac90-4e8f-ace6-e31512769f3b {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:32:29 user nova-compute[75045]: DEBUG nova.compute.manager [req-38c234fe-dd00-4d4c-92a5-209cb4cce4b5 req-4b687c29-7d39-4dd4-be1b-ed27d434acb8 service nova] [instance: a63971de-a2bf-4e58-a760-30eaec3b83c0] Refreshing instance network info cache due to event network-changed-50aeb5be-ac90-4e8f-ace6-e31512769f3b. {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 23:32:29 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-38c234fe-dd00-4d4c-92a5-209cb4cce4b5 req-4b687c29-7d39-4dd4-be1b-ed27d434acb8 service nova] Acquiring lock "refresh_cache-a63971de-a2bf-4e58-a760-30eaec3b83c0" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 23:32:29 user nova-compute[75045]: DEBUG nova.network.neutron [None req-60f5c230-921a-4bf8-92b2-a6a2534368e9 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] [instance: a63971de-a2bf-4e58-a760-30eaec3b83c0] Instance cache missing network info. {{(pid=75045) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 23:32:29 user nova-compute[75045]: INFO nova.compute.manager [None req-ccf89d8a-ddfc-4e21-8f37-7fa54098c188 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] [instance: 438082fc-a83f-4305-ada6-41a8e1d645a8] Unrescuing
Nov 08 23:32:29 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-ccf89d8a-ddfc-4e21-8f37-7fa54098c188 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Acquiring lock "refresh_cache-438082fc-a83f-4305-ada6-41a8e1d645a8" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 23:32:29 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-ccf89d8a-ddfc-4e21-8f37-7fa54098c188 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Acquired lock "refresh_cache-438082fc-a83f-4305-ada6-41a8e1d645a8" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 23:32:29 user nova-compute[75045]: DEBUG nova.network.neutron [None req-ccf89d8a-ddfc-4e21-8f37-7fa54098c188 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] [instance: 438082fc-a83f-4305-ada6-41a8e1d645a8] Building network info cache for instance {{(pid=75045) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 23:32:29 user nova-compute[75045]: DEBUG nova.network.neutron [None req-60f5c230-921a-4bf8-92b2-a6a2534368e9 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] [instance: a63971de-a2bf-4e58-a760-30eaec3b83c0] Updating instance_info_cache with network_info: [{"id": "50aeb5be-ac90-4e8f-ace6-e31512769f3b", "address": "fa:16:3e:b4:db:58", "network": {"id": "2f33d93d-98ec-4b87-a0c0-efe2d2ac8f6d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-719527911-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7eff4be777d24514be52868961bf7a25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50aeb5be-ac", "ovs_interfaceid": "50aeb5be-ac90-4e8f-ace6-e31512769f3b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75045) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 23:32:29 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-60f5c230-921a-4bf8-92b2-a6a2534368e9 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Releasing lock "refresh_cache-a63971de-a2bf-4e58-a760-30eaec3b83c0" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 23:32:29 user nova-compute[75045]: DEBUG nova.compute.manager [None req-60f5c230-921a-4bf8-92b2-a6a2534368e9 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] [instance: a63971de-a2bf-4e58-a760-30eaec3b83c0] Instance network_info: |[{"id": "50aeb5be-ac90-4e8f-ace6-e31512769f3b", "address": "fa:16:3e:b4:db:58", "network": {"id": "2f33d93d-98ec-4b87-a0c0-efe2d2ac8f6d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-719527911-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7eff4be777d24514be52868961bf7a25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50aeb5be-ac", "ovs_interfaceid": "50aeb5be-ac90-4e8f-ace6-e31512769f3b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75045) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 23:32:29 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-38c234fe-dd00-4d4c-92a5-209cb4cce4b5 req-4b687c29-7d39-4dd4-be1b-ed27d434acb8 service nova] Acquired lock "refresh_cache-a63971de-a2bf-4e58-a760-30eaec3b83c0" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 23:32:29 user nova-compute[75045]: DEBUG nova.network.neutron [req-38c234fe-dd00-4d4c-92a5-209cb4cce4b5 req-4b687c29-7d39-4dd4-be1b-ed27d434acb8 service nova] [instance: a63971de-a2bf-4e58-a760-30eaec3b83c0] Refreshing network info cache for port 50aeb5be-ac90-4e8f-ace6-e31512769f3b {{(pid=75045) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 23:32:29 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-60f5c230-921a-4bf8-92b2-a6a2534368e9 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] [instance: a63971de-a2bf-4e58-a760-30eaec3b83c0] Start _get_guest_xml network_info=[{"id": "50aeb5be-ac90-4e8f-ace6-e31512769f3b", "address": "fa:16:3e:b4:db:58", "network": {"id": "2f33d93d-98ec-4b87-a0c0-efe2d2ac8f6d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-719527911-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7eff4be777d24514be52868961bf7a25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50aeb5be-ac", "ovs_interfaceid": "50aeb5be-ac90-4e8f-ace6-e31512769f3b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T23:11:54Z,direct_url=<?>,disk_format='qcow2',id=a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b1beba2cc4e7465ea249e2225fb494dc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T23:11:56Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'disk_bus': 'virtio', 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': 'a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75045) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 23:32:29 user nova-compute[75045]: WARNING nova.virt.libvirt.driver [None req-60f5c230-921a-4bf8-92b2-a6a2534368e9 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 23:32:29 user nova-compute[75045]: WARNING nova.virt.libvirt.driver [None req-60f5c230-921a-4bf8-92b2-a6a2534368e9 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 23:32:29 user nova-compute[75045]: DEBUG nova.virt.libvirt.host [None req-60f5c230-921a-4bf8-92b2-a6a2534368e9 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75045) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 23:32:29 user nova-compute[75045]: DEBUG nova.virt.libvirt.host [None req-60f5c230-921a-4bf8-92b2-a6a2534368e9 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] CPU controller missing on host. {{(pid=75045) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 23:32:29 user nova-compute[75045]: DEBUG nova.virt.libvirt.host [None req-60f5c230-921a-4bf8-92b2-a6a2534368e9 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75045) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 23:32:29 user nova-compute[75045]: DEBUG nova.virt.libvirt.host [None req-60f5c230-921a-4bf8-92b2-a6a2534368e9 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] CPU controller found on host. {{(pid=75045) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 23:32:29 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-60f5c230-921a-4bf8-92b2-a6a2534368e9 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75045) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 23:32:29 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-60f5c230-921a-4bf8-92b2-a6a2534368e9 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T23:11:41Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T23:11:54Z,direct_url=<?>,disk_format='qcow2',id=a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b1beba2cc4e7465ea249e2225fb494dc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T23:11:56Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75045) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 23:32:29 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-60f5c230-921a-4bf8-92b2-a6a2534368e9 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Flavor limits 0:0:0 {{(pid=75045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 23:32:29 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-60f5c230-921a-4bf8-92b2-a6a2534368e9 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Image limits 0:0:0 {{(pid=75045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 23:32:29 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-60f5c230-921a-4bf8-92b2-a6a2534368e9 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Flavor pref 0:0:0 {{(pid=75045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 23:32:29 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-60f5c230-921a-4bf8-92b2-a6a2534368e9 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Image pref 0:0:0 {{(pid=75045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 23:32:29 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-60f5c230-921a-4bf8-92b2-a6a2534368e9 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 23:32:29 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-60f5c230-921a-4bf8-92b2-a6a2534368e9 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75045) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 23:32:29 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-60f5c230-921a-4bf8-92b2-a6a2534368e9 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75045) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 23:32:29 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-60f5c230-921a-4bf8-92b2-a6a2534368e9 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Got 1 possible topologies {{(pid=75045) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 23:32:29 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-60f5c230-921a-4bf8-92b2-a6a2534368e9 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75045) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 23:32:29 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-60f5c230-921a-4bf8-92b2-a6a2534368e9 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75045) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 23:32:29 user nova-compute[75045]: DEBUG nova.virt.libvirt.vif [None req-60f5c230-921a-4bf8-92b2-a6a2534368e9 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T23:32:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1719371780',display_name='tempest-AttachVolumeNegativeTest-server-1719371780',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1719371780',id=33,image_ref='a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB/ndcWqmrAqjd9amzTQjo5csFln9xdf5bjPJrTLP3v7vH83IWDBX1aEztMAnOi0L2zsouD5Xt2+6X0K9vkvw1S5+9v8+hwyWJYZViEvi4h9pqOpMpqHmCUUEXlJOYUhlQ==',key_name='tempest-keypair-472326172',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7eff4be777d24514be52868961bf7a25',ramdisk_id='',reservation_id='r-d74g8dpa',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1522456563',owner_user_name='tempest-AttachVolumeNegativeTest-1522456563-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T23:32:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4a05b178abe74b779a991e887bf135b2',uuid=a63971de-a2bf-4e58-a760-30eaec3b83c0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "50aeb5be-ac90-4e8f-ace6-e31512769f3b", "address": "fa:16:3e:b4:db:58", "network": {"id": "2f33d93d-98ec-4b87-a0c0-efe2d2ac8f6d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-719527911-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7eff4be777d24514be52868961bf7a25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50aeb5be-ac", "ovs_interfaceid": "50aeb5be-ac90-4e8f-ace6-e31512769f3b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75045) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 23:32:29 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-60f5c230-921a-4bf8-92b2-a6a2534368e9 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Converting VIF {"id": "50aeb5be-ac90-4e8f-ace6-e31512769f3b", "address": "fa:16:3e:b4:db:58", "network": {"id": "2f33d93d-98ec-4b87-a0c0-efe2d2ac8f6d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-719527911-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7eff4be777d24514be52868961bf7a25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50aeb5be-ac", "ovs_interfaceid": "50aeb5be-ac90-4e8f-ace6-e31512769f3b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 23:32:29 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-60f5c230-921a-4bf8-92b2-a6a2534368e9 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b4:db:58,bridge_name='br-int',has_traffic_filtering=True,id=50aeb5be-ac90-4e8f-ace6-e31512769f3b,network=Network(2f33d93d-98ec-4b87-a0c0-efe2d2ac8f6d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap50aeb5be-ac') {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 23:32:29 user nova-compute[75045]: DEBUG nova.objects.instance [None req-60f5c230-921a-4bf8-92b2-a6a2534368e9 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Lazy-loading 'pci_devices' on Instance uuid a63971de-a2bf-4e58-a760-30eaec3b83c0 {{(pid=75045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 23:32:29 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-60f5c230-921a-4bf8-92b2-a6a2534368e9 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] [instance: a63971de-a2bf-4e58-a760-30eaec3b83c0] End _get_guest_xml xml=<domain type="kvm">
Nov 08 23:32:29 user nova-compute[75045]:   <uuid>a63971de-a2bf-4e58-a760-30eaec3b83c0</uuid>
Nov 08 23:32:29 user nova-compute[75045]:   <name>instance-00000021</name>
Nov 08 23:32:29 user nova-compute[75045]:   <memory>524288</memory>
Nov 08 23:32:29 user nova-compute[75045]:   <vcpu>1</vcpu>
Nov 08 23:32:29 user nova-compute[75045]:   <metadata>
Nov 08 23:32:29 user nova-compute[75045]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 23:32:29 user nova-compute[75045]:       <nova:package version="0.0.0"/>
Nov 08 23:32:29 user nova-compute[75045]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1719371780</nova:name>
Nov 08 23:32:29 user nova-compute[75045]:       <nova:creationTime>2023-11-08 23:32:29</nova:creationTime>
Nov 08 23:32:29 user nova-compute[75045]:       <nova:flavor name="m1.tiny">
Nov 08 23:32:29 user nova-compute[75045]:         <nova:memory>512</nova:memory>
Nov 08 23:32:29 user nova-compute[75045]:         <nova:disk>1</nova:disk>
Nov 08 23:32:29 user nova-compute[75045]:         <nova:swap>0</nova:swap>
Nov 08 23:32:29 user nova-compute[75045]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 23:32:29 user nova-compute[75045]:         <nova:vcpus>1</nova:vcpus>
Nov 08 23:32:29 user nova-compute[75045]:       </nova:flavor>
Nov 08 23:32:29 user nova-compute[75045]:       <nova:owner>
Nov 08 23:32:29 user nova-compute[75045]:         <nova:user uuid="4a05b178abe74b779a991e887bf135b2">tempest-AttachVolumeNegativeTest-1522456563-project-member</nova:user>
Nov 08 23:32:29 user nova-compute[75045]:         <nova:project uuid="7eff4be777d24514be52868961bf7a25">tempest-AttachVolumeNegativeTest-1522456563</nova:project>
Nov 08 23:32:29 user nova-compute[75045]:       </nova:owner>
Nov 08 23:32:29 user nova-compute[75045]:       <nova:root type="image" uuid="a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb"/>
Nov 08 23:32:29 user nova-compute[75045]:       <nova:ports>
Nov 08 23:32:29 user nova-compute[75045]:         <nova:port uuid="50aeb5be-ac90-4e8f-ace6-e31512769f3b">
Nov 08 23:32:29 user nova-compute[75045]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 08 23:32:29 user nova-compute[75045]:         </nova:port>
Nov 08 23:32:29 user nova-compute[75045]:       </nova:ports>
Nov 08 23:32:29 user nova-compute[75045]:     </nova:instance>
Nov 08 23:32:29 user nova-compute[75045]:   </metadata>
Nov 08 23:32:29 user nova-compute[75045]:   <sysinfo type="smbios">
Nov 08 23:32:29 user nova-compute[75045]:     <system>
Nov 08 23:32:29 user nova-compute[75045]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 23:32:29 user nova-compute[75045]:       <entry name="product">OpenStack Nova</entry>
Nov 08 23:32:29 user nova-compute[75045]:       <entry name="version">0.0.0</entry>
Nov 08 23:32:29 user nova-compute[75045]:       <entry name="serial">a63971de-a2bf-4e58-a760-30eaec3b83c0</entry>
Nov 08 23:32:29 user nova-compute[75045]:       <entry name="uuid">a63971de-a2bf-4e58-a760-30eaec3b83c0</entry>
Nov 08 23:32:29 user nova-compute[75045]:       <entry name="family">Virtual Machine</entry>
Nov 08 23:32:29 user nova-compute[75045]:     </system>
Nov 08 23:32:29 user nova-compute[75045]:   </sysinfo>
Nov 08 23:32:29 user nova-compute[75045]:   <os>
Nov 08 23:32:29 user nova-compute[75045]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 23:32:29 user nova-compute[75045]:     <boot dev="hd"/>
Nov 08 23:32:29 user nova-compute[75045]:     <smbios mode="sysinfo"/>
Nov 08 23:32:29 user nova-compute[75045]:   </os>
Nov 08 23:32:29 user nova-compute[75045]:   <features>
Nov 08 23:32:29 user nova-compute[75045]:     <acpi/>
Nov 08 23:32:29 user nova-compute[75045]:     <apic/>
Nov 08 23:32:29 user nova-compute[75045]:     <vmcoreinfo/>
Nov 08 23:32:29 user nova-compute[75045]:   </features>
Nov 08 23:32:29 user nova-compute[75045]:   <clock offset="utc">
Nov 08 23:32:29 user nova-compute[75045]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 23:32:29 user nova-compute[75045]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 23:32:29 user nova-compute[75045]:     <timer name="hpet" present="no"/>
Nov 08 23:32:29 user nova-compute[75045]:   </clock>
Nov 08 23:32:29 user nova-compute[75045]:   <cpu mode="custom" match="exact">
Nov 08 23:32:29 user nova-compute[75045]:     <model>Nehalem</model>
Nov 08 23:32:29 user nova-compute[75045]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 23:32:29 user nova-compute[75045]:   </cpu>
Nov 08 23:32:29 user nova-compute[75045]:   <devices>
Nov 08 23:32:29 user nova-compute[75045]:     <disk type="file" device="disk">
Nov 08 23:32:29 user nova-compute[75045]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 23:32:29 user nova-compute[75045]:       <source file="/opt/stack/data/nova/instances/a63971de-a2bf-4e58-a760-30eaec3b83c0/disk"/>
Nov 08 23:32:29 user nova-compute[75045]:       <target dev="vda" bus="virtio"/>
Nov 08 23:32:29 user nova-compute[75045]:     </disk>
Nov 08 23:32:29 user nova-compute[75045]:     <interface type="ethernet">
Nov 08 23:32:29 user nova-compute[75045]:       <mac address="fa:16:3e:b4:db:58"/>
Nov 08 23:32:29 user nova-compute[75045]:       <model type="virtio"/>
Nov 08 23:32:29 user nova-compute[75045]:       <mtu size="1442"/>
Nov 08 23:32:29 user nova-compute[75045]:       <target dev="tap50aeb5be-ac"/>
Nov 08 23:32:29 user nova-compute[75045]:     </interface>
Nov 08 23:32:29 user nova-compute[75045]:     <serial type="pty">
Nov 08 23:32:29 user nova-compute[75045]:       <log file="/opt/stack/data/nova/instances/a63971de-a2bf-4e58-a760-30eaec3b83c0/console.log" append="off"/>
Nov 08 23:32:29 user nova-compute[75045]:     </serial>
Nov 08 23:32:29 user nova-compute[75045]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 23:32:29 user nova-compute[75045]:     <video>
Nov 08 23:32:29 user nova-compute[75045]:       <model type="virtio"/>
Nov 08 23:32:29 user nova-compute[75045]:     </video>
Nov 08 23:32:29 user nova-compute[75045]:     <rng model="virtio">
Nov 08 23:32:29 user nova-compute[75045]:       <backend model="random">/dev/urandom</backend>
Nov 08 23:32:29 user nova-compute[75045]:     </rng>
Nov 08 23:32:29 user nova-compute[75045]:     <controller type="usb" index="0" model="none"/>
Nov 08 23:32:29 user nova-compute[75045]:     <memballoon model="virtio">
Nov 08 23:32:29 user nova-compute[75045]:       <stats period="10"/>
Nov 08 23:32:29 user nova-compute[75045]:     </memballoon>
Nov 08 23:32:29 user nova-compute[75045]:   </devices>
Nov 08 23:32:29 user nova-compute[75045]: </domain>
Nov 08 23:32:29 user nova-compute[75045]:  {{(pid=75045) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 23:32:29 user nova-compute[75045]: DEBUG nova.virt.libvirt.vif [None req-60f5c230-921a-4bf8-92b2-a6a2534368e9 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T23:32:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1719371780',display_name='tempest-AttachVolumeNegativeTest-server-1719371780',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1719371780',id=33,image_ref='a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB/ndcWqmrAqjd9amzTQjo5csFln9xdf5bjPJrTLP3v7vH83IWDBX1aEztMAnOi0L2zsouD5Xt2+6X0K9vkvw1S5+9v8+hwyWJYZViEvi4h9pqOpMpqHmCUUEXlJOYUhlQ==',key_name='tempest-keypair-472326172',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7eff4be777d24514be52868961bf7a25',ramdisk_id='',reservation_id='r-d74g8dpa',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1522456563',owner_user_name='tempest-AttachVolumeNegativeTest-1522456563-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T23:32:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4a05b178abe74b779a991e887bf135b2',uuid=a63971de-a2bf-4e58-a760-30eaec3b83c0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "50aeb5be-ac90-4e8f-ace6-e31512769f3b", "address": "fa:16:3e:b4:db:58", "network": {"id": "2f33d93d-98ec-4b87-a0c0-efe2d2ac8f6d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-719527911-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7eff4be777d24514be52868961bf7a25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50aeb5be-ac", "ovs_interfaceid": "50aeb5be-ac90-4e8f-ace6-e31512769f3b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75045) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 23:32:29 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-60f5c230-921a-4bf8-92b2-a6a2534368e9 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Converting VIF {"id": "50aeb5be-ac90-4e8f-ace6-e31512769f3b", "address": "fa:16:3e:b4:db:58", "network": {"id": "2f33d93d-98ec-4b87-a0c0-efe2d2ac8f6d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-719527911-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7eff4be777d24514be52868961bf7a25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50aeb5be-ac", "ovs_interfaceid": "50aeb5be-ac90-4e8f-ace6-e31512769f3b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 23:32:29 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-60f5c230-921a-4bf8-92b2-a6a2534368e9 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b4:db:58,bridge_name='br-int',has_traffic_filtering=True,id=50aeb5be-ac90-4e8f-ace6-e31512769f3b,network=Network(2f33d93d-98ec-4b87-a0c0-efe2d2ac8f6d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap50aeb5be-ac') {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 23:32:29 user nova-compute[75045]: DEBUG os_vif [None req-60f5c230-921a-4bf8-92b2-a6a2534368e9 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b4:db:58,bridge_name='br-int',has_traffic_filtering=True,id=50aeb5be-ac90-4e8f-ace6-e31512769f3b,network=Network(2f33d93d-98ec-4b87-a0c0-efe2d2ac8f6d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap50aeb5be-ac') {{(pid=75045) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 23:32:29 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:32:29 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:32:29 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 23:32:29 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:32:29 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '89d922f2-dedf-57bb-8e0b-78acbe2ad974', '_type': 'linux-noop'}}, row=False) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:32:29 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:32:29 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 23:32:29 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:32:29 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap50aeb5be-ac, may_exist=True, interface_attrs={}) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:32:29 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap50aeb5be-ac, col_values=(('qos', UUID('71a45b22-837b-4948-9c3f-9a091bd5e2b5')),), if_exists=True) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:32:29 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap50aeb5be-ac, col_values=(('external_ids', {'iface-id': '50aeb5be-ac90-4e8f-ace6-e31512769f3b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b4:db:58', 'vm-uuid': 'a63971de-a2bf-4e58-a760-30eaec3b83c0'}),), if_exists=True) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:32:29 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:32:29 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 23:32:29 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:32:29 user nova-compute[75045]: INFO os_vif [None req-60f5c230-921a-4bf8-92b2-a6a2534368e9 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b4:db:58,bridge_name='br-int',has_traffic_filtering=True,id=50aeb5be-ac90-4e8f-ace6-e31512769f3b,network=Network(2f33d93d-98ec-4b87-a0c0-efe2d2ac8f6d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap50aeb5be-ac')
Nov 08 23:32:30 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-60f5c230-921a-4bf8-92b2-a6a2534368e9 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] No BDM found with device name vda, not building metadata. {{(pid=75045) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 23:32:30 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-60f5c230-921a-4bf8-92b2-a6a2534368e9 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] No VIF found with MAC fa:16:3e:b4:db:58, not building metadata {{(pid=75045) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 23:32:30 user nova-compute[75045]: DEBUG nova.network.neutron [None req-ccf89d8a-ddfc-4e21-8f37-7fa54098c188 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] [instance: 438082fc-a83f-4305-ada6-41a8e1d645a8] Updating instance_info_cache with network_info: [{"id": "669f0f7f-7c58-42b9-948b-ad3704fb1ab3", "address": "fa:16:3e:57:c2:f9", "network": {"id": "d4cd6998-66d1-4389-bc82-dd000c8962de", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-323966879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bfb6963a6c145d4a7b7e47c8fde7e60", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap669f0f7f-7c", "ovs_interfaceid": "669f0f7f-7c58-42b9-948b-ad3704fb1ab3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75045) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 23:32:30 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-ccf89d8a-ddfc-4e21-8f37-7fa54098c188 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Releasing lock "refresh_cache-438082fc-a83f-4305-ada6-41a8e1d645a8" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 23:32:30 user nova-compute[75045]: DEBUG nova.objects.instance [None req-ccf89d8a-ddfc-4e21-8f37-7fa54098c188 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Lazy-loading 'flavor' on Instance uuid 438082fc-a83f-4305-ada6-41a8e1d645a8 {{(pid=75045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 23:32:30 user nova-compute[75045]: DEBUG nova.network.neutron [req-38c234fe-dd00-4d4c-92a5-209cb4cce4b5 req-4b687c29-7d39-4dd4-be1b-ed27d434acb8 service nova] [instance: a63971de-a2bf-4e58-a760-30eaec3b83c0] Updated VIF entry in instance network info cache for port 50aeb5be-ac90-4e8f-ace6-e31512769f3b. {{(pid=75045) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 23:32:30 user nova-compute[75045]: DEBUG nova.network.neutron [req-38c234fe-dd00-4d4c-92a5-209cb4cce4b5 req-4b687c29-7d39-4dd4-be1b-ed27d434acb8 service nova] [instance: a63971de-a2bf-4e58-a760-30eaec3b83c0] Updating instance_info_cache with network_info: [{"id": "50aeb5be-ac90-4e8f-ace6-e31512769f3b", "address": "fa:16:3e:b4:db:58", "network": {"id": "2f33d93d-98ec-4b87-a0c0-efe2d2ac8f6d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-719527911-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7eff4be777d24514be52868961bf7a25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50aeb5be-ac", "ovs_interfaceid": "50aeb5be-ac90-4e8f-ace6-e31512769f3b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75045) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 23:32:30 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:32:30 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-38c234fe-dd00-4d4c-92a5-209cb4cce4b5 req-4b687c29-7d39-4dd4-be1b-ed27d434acb8 service nova] Releasing lock "refresh_cache-a63971de-a2bf-4e58-a760-30eaec3b83c0" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 23:32:30 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:32:30 user nova-compute[75045]: DEBUG nova.compute.manager [req-617689f5-3f61-42dd-890a-c41777cfcb23 req-d84a3000-5157-4667-b93f-9164d72715de service nova] [instance: 438082fc-a83f-4305-ada6-41a8e1d645a8] Received event network-vif-unplugged-669f0f7f-7c58-42b9-948b-ad3704fb1ab3 {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:32:30 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-617689f5-3f61-42dd-890a-c41777cfcb23 req-d84a3000-5157-4667-b93f-9164d72715de service nova] Acquiring lock "438082fc-a83f-4305-ada6-41a8e1d645a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:32:30 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-617689f5-3f61-42dd-890a-c41777cfcb23 req-d84a3000-5157-4667-b93f-9164d72715de service nova] Lock "438082fc-a83f-4305-ada6-41a8e1d645a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:32:30 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-617689f5-3f61-42dd-890a-c41777cfcb23 req-d84a3000-5157-4667-b93f-9164d72715de service nova] Lock "438082fc-a83f-4305-ada6-41a8e1d645a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:32:30 user nova-compute[75045]: DEBUG nova.compute.manager [req-617689f5-3f61-42dd-890a-c41777cfcb23 req-d84a3000-5157-4667-b93f-9164d72715de service nova] [instance: 438082fc-a83f-4305-ada6-41a8e1d645a8] No waiting events found dispatching network-vif-unplugged-669f0f7f-7c58-42b9-948b-ad3704fb1ab3 {{(pid=75045) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 23:32:30 user nova-compute[75045]: WARNING nova.compute.manager [req-617689f5-3f61-42dd-890a-c41777cfcb23 req-d84a3000-5157-4667-b93f-9164d72715de service nova] [instance: 438082fc-a83f-4305-ada6-41a8e1d645a8] Received unexpected event network-vif-unplugged-669f0f7f-7c58-42b9-948b-ad3704fb1ab3 for instance with vm_state rescued and task_state unrescuing.
Nov 08 23:32:30 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:32:30 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:32:31 user nova-compute[75045]: INFO nova.virt.libvirt.driver [-] [instance: 438082fc-a83f-4305-ada6-41a8e1d645a8] Instance destroyed successfully.
Nov 08 23:32:31 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:32:32 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:32:32 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:32:32 user nova-compute[75045]: DEBUG nova.compute.manager [req-c9f3a028-6fed-405f-8806-d0a64375ec64 req-cf664fbd-d060-4b70-980c-45604c8f34b9 service nova] [instance: a63971de-a2bf-4e58-a760-30eaec3b83c0] Received event network-vif-plugged-50aeb5be-ac90-4e8f-ace6-e31512769f3b {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:32:32 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-c9f3a028-6fed-405f-8806-d0a64375ec64 req-cf664fbd-d060-4b70-980c-45604c8f34b9 service nova] Acquiring lock "a63971de-a2bf-4e58-a760-30eaec3b83c0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:32:32 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-c9f3a028-6fed-405f-8806-d0a64375ec64 req-cf664fbd-d060-4b70-980c-45604c8f34b9 service nova] Lock "a63971de-a2bf-4e58-a760-30eaec3b83c0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:32:32 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-c9f3a028-6fed-405f-8806-d0a64375ec64 req-cf664fbd-d060-4b70-980c-45604c8f34b9 service nova] Lock "a63971de-a2bf-4e58-a760-30eaec3b83c0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:32:32 user nova-compute[75045]: DEBUG nova.compute.manager [req-c9f3a028-6fed-405f-8806-d0a64375ec64 req-cf664fbd-d060-4b70-980c-45604c8f34b9 service nova] [instance: a63971de-a2bf-4e58-a760-30eaec3b83c0] No waiting events found dispatching network-vif-plugged-50aeb5be-ac90-4e8f-ace6-e31512769f3b {{(pid=75045) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 23:32:32 user nova-compute[75045]: WARNING nova.compute.manager [req-c9f3a028-6fed-405f-8806-d0a64375ec64 req-cf664fbd-d060-4b70-980c-45604c8f34b9 service nova] [instance: a63971de-a2bf-4e58-a760-30eaec3b83c0] Received unexpected event network-vif-plugged-50aeb5be-ac90-4e8f-ace6-e31512769f3b for instance with vm_state building and task_state spawning.
Nov 08 23:32:32 user nova-compute[75045]: DEBUG nova.compute.manager [req-92567104-573e-421d-845f-02a95eef0736 req-b57954d1-3a8c-407e-9057-5cd35b8cbc9f service nova] [instance: 438082fc-a83f-4305-ada6-41a8e1d645a8] Received event network-vif-plugged-669f0f7f-7c58-42b9-948b-ad3704fb1ab3 {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:32:32 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-92567104-573e-421d-845f-02a95eef0736 req-b57954d1-3a8c-407e-9057-5cd35b8cbc9f service nova] Acquiring lock "438082fc-a83f-4305-ada6-41a8e1d645a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:32:32 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-92567104-573e-421d-845f-02a95eef0736 req-b57954d1-3a8c-407e-9057-5cd35b8cbc9f service nova] Lock "438082fc-a83f-4305-ada6-41a8e1d645a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:32:32 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-92567104-573e-421d-845f-02a95eef0736 req-b57954d1-3a8c-407e-9057-5cd35b8cbc9f service nova] Lock "438082fc-a83f-4305-ada6-41a8e1d645a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:32:32 user nova-compute[75045]: DEBUG nova.compute.manager [req-92567104-573e-421d-845f-02a95eef0736 req-b57954d1-3a8c-407e-9057-5cd35b8cbc9f service nova] [instance: 438082fc-a83f-4305-ada6-41a8e1d645a8] No waiting events found dispatching network-vif-plugged-669f0f7f-7c58-42b9-948b-ad3704fb1ab3 {{(pid=75045) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 23:32:32 user nova-compute[75045]: WARNING nova.compute.manager [req-92567104-573e-421d-845f-02a95eef0736 req-b57954d1-3a8c-407e-9057-5cd35b8cbc9f service nova] [instance: 438082fc-a83f-4305-ada6-41a8e1d645a8] Received unexpected event network-vif-plugged-669f0f7f-7c58-42b9-948b-ad3704fb1ab3 for instance with vm_state rescued and task_state unrescuing.
Nov 08 23:32:32 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:32:32 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:32:32 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:32:32 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:32:33 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:32:33 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:32:33 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:32:33 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:32:33 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:32:34 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:32:34 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:32:34 user nova-compute[75045]: DEBUG nova.compute.manager [req-5b635b53-7248-4ecc-b2b3-f967b55a09fb req-4f31e356-33e3-4933-ac70-22a81771269c service nova] [instance: a63971de-a2bf-4e58-a760-30eaec3b83c0] Received event network-vif-plugged-50aeb5be-ac90-4e8f-ace6-e31512769f3b {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:32:34 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-5b635b53-7248-4ecc-b2b3-f967b55a09fb req-4f31e356-33e3-4933-ac70-22a81771269c service nova] Acquiring lock "a63971de-a2bf-4e58-a760-30eaec3b83c0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:32:34 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-5b635b53-7248-4ecc-b2b3-f967b55a09fb req-4f31e356-33e3-4933-ac70-22a81771269c service nova] Lock "a63971de-a2bf-4e58-a760-30eaec3b83c0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:32:34 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-5b635b53-7248-4ecc-b2b3-f967b55a09fb req-4f31e356-33e3-4933-ac70-22a81771269c service nova] Lock "a63971de-a2bf-4e58-a760-30eaec3b83c0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:32:34 user nova-compute[75045]: DEBUG nova.compute.manager [req-5b635b53-7248-4ecc-b2b3-f967b55a09fb req-4f31e356-33e3-4933-ac70-22a81771269c service nova] [instance: a63971de-a2bf-4e58-a760-30eaec3b83c0] No waiting events found dispatching network-vif-plugged-50aeb5be-ac90-4e8f-ace6-e31512769f3b {{(pid=75045) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 23:32:34 user nova-compute[75045]: WARNING nova.compute.manager [req-5b635b53-7248-4ecc-b2b3-f967b55a09fb req-4f31e356-33e3-4933-ac70-22a81771269c service nova] [instance: a63971de-a2bf-4e58-a760-30eaec3b83c0] Received unexpected event network-vif-plugged-50aeb5be-ac90-4e8f-ace6-e31512769f3b for instance with vm_state building and task_state spawning.
Nov 08 23:32:34 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-78fd3453-e5e7-43a1-bded-262a4f2ab11d tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Acquiring lock "04169f59-e9a6-4b50-9ad7-7f8c105a376a" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:32:34 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-78fd3453-e5e7-43a1-bded-262a4f2ab11d tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Lock "04169f59-e9a6-4b50-9ad7-7f8c105a376a" acquired by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:32:34 user nova-compute[75045]: DEBUG nova.compute.manager [None req-78fd3453-e5e7-43a1-bded-262a4f2ab11d tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] [instance: 04169f59-e9a6-4b50-9ad7-7f8c105a376a] Going to confirm migration 2 {{(pid=75045) do_confirm_resize /opt/stack/nova/nova/compute/manager.py:4774}}
Nov 08 23:32:34 user nova-compute[75045]: DEBUG nova.compute.manager [req-0b71cd2b-1bc7-40bd-b3bf-4d7d63cb9859 req-e6c4ecd3-02a6-48c3-91c1-ddb831d14598 service nova] [instance: 438082fc-a83f-4305-ada6-41a8e1d645a8] Received event network-vif-plugged-669f0f7f-7c58-42b9-948b-ad3704fb1ab3 {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:32:34 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-0b71cd2b-1bc7-40bd-b3bf-4d7d63cb9859 req-e6c4ecd3-02a6-48c3-91c1-ddb831d14598 service nova] Acquiring lock "438082fc-a83f-4305-ada6-41a8e1d645a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:32:34 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-0b71cd2b-1bc7-40bd-b3bf-4d7d63cb9859 req-e6c4ecd3-02a6-48c3-91c1-ddb831d14598 service nova] Lock "438082fc-a83f-4305-ada6-41a8e1d645a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:32:34 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-0b71cd2b-1bc7-40bd-b3bf-4d7d63cb9859 req-e6c4ecd3-02a6-48c3-91c1-ddb831d14598 service nova] Lock "438082fc-a83f-4305-ada6-41a8e1d645a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:32:34 user nova-compute[75045]: DEBUG nova.compute.manager [req-0b71cd2b-1bc7-40bd-b3bf-4d7d63cb9859 req-e6c4ecd3-02a6-48c3-91c1-ddb831d14598 service nova] [instance: 438082fc-a83f-4305-ada6-41a8e1d645a8] No waiting events found dispatching network-vif-plugged-669f0f7f-7c58-42b9-948b-ad3704fb1ab3 {{(pid=75045) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 23:32:34 user nova-compute[75045]: WARNING nova.compute.manager [req-0b71cd2b-1bc7-40bd-b3bf-4d7d63cb9859 req-e6c4ecd3-02a6-48c3-91c1-ddb831d14598 service nova] [instance: 438082fc-a83f-4305-ada6-41a8e1d645a8] Received unexpected event network-vif-plugged-669f0f7f-7c58-42b9-948b-ad3704fb1ab3 for instance with vm_state rescued and task_state unrescuing.
Nov 08 23:32:34 user nova-compute[75045]: DEBUG nova.compute.manager [req-0b71cd2b-1bc7-40bd-b3bf-4d7d63cb9859 req-e6c4ecd3-02a6-48c3-91c1-ddb831d14598 service nova] [instance: 438082fc-a83f-4305-ada6-41a8e1d645a8] Received event network-vif-plugged-669f0f7f-7c58-42b9-948b-ad3704fb1ab3 {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:32:34 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-0b71cd2b-1bc7-40bd-b3bf-4d7d63cb9859 req-e6c4ecd3-02a6-48c3-91c1-ddb831d14598 service nova] Acquiring lock "438082fc-a83f-4305-ada6-41a8e1d645a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:32:34 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-0b71cd2b-1bc7-40bd-b3bf-4d7d63cb9859 req-e6c4ecd3-02a6-48c3-91c1-ddb831d14598 service nova] Lock "438082fc-a83f-4305-ada6-41a8e1d645a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:32:34 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-0b71cd2b-1bc7-40bd-b3bf-4d7d63cb9859 req-e6c4ecd3-02a6-48c3-91c1-ddb831d14598 service nova] Lock "438082fc-a83f-4305-ada6-41a8e1d645a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:32:34 user nova-compute[75045]: DEBUG nova.compute.manager [req-0b71cd2b-1bc7-40bd-b3bf-4d7d63cb9859 req-e6c4ecd3-02a6-48c3-91c1-ddb831d14598 service nova] [instance: 438082fc-a83f-4305-ada6-41a8e1d645a8] No waiting events found dispatching network-vif-plugged-669f0f7f-7c58-42b9-948b-ad3704fb1ab3 {{(pid=75045) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 23:32:34 user nova-compute[75045]: WARNING nova.compute.manager [req-0b71cd2b-1bc7-40bd-b3bf-4d7d63cb9859 req-e6c4ecd3-02a6-48c3-91c1-ddb831d14598 service nova] [instance: 438082fc-a83f-4305-ada6-41a8e1d645a8] Received unexpected event network-vif-plugged-669f0f7f-7c58-42b9-948b-ad3704fb1ab3 for instance with vm_state rescued and task_state unrescuing.
Nov 08 23:32:34 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:32:35 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-78fd3453-e5e7-43a1-bded-262a4f2ab11d tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Acquiring lock "refresh_cache-04169f59-e9a6-4b50-9ad7-7f8c105a376a" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 23:32:35 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-78fd3453-e5e7-43a1-bded-262a4f2ab11d tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Acquired lock "refresh_cache-04169f59-e9a6-4b50-9ad7-7f8c105a376a" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 23:32:35 user nova-compute[75045]: DEBUG nova.network.neutron [None req-78fd3453-e5e7-43a1-bded-262a4f2ab11d tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] [instance: 04169f59-e9a6-4b50-9ad7-7f8c105a376a] Building network info cache for instance {{(pid=75045) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 23:32:35 user nova-compute[75045]: DEBUG nova.objects.instance [None req-78fd3453-e5e7-43a1-bded-262a4f2ab11d tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Lazy-loading 'info_cache' on Instance uuid 04169f59-e9a6-4b50-9ad7-7f8c105a376a {{(pid=75045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 23:32:35 user nova-compute[75045]: DEBUG nova.compute.manager [None req-60f5c230-921a-4bf8-92b2-a6a2534368e9 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] [instance: a63971de-a2bf-4e58-a760-30eaec3b83c0] Instance event wait completed in 0 seconds for  {{(pid=75045) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 23:32:35 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-60f5c230-921a-4bf8-92b2-a6a2534368e9 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] [instance: a63971de-a2bf-4e58-a760-30eaec3b83c0] Guest created on hypervisor {{(pid=75045) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 23:32:35 user nova-compute[75045]: INFO nova.virt.libvirt.driver [-] [instance: a63971de-a2bf-4e58-a760-30eaec3b83c0] Instance spawned successfully.
Nov 08 23:32:35 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-60f5c230-921a-4bf8-92b2-a6a2534368e9 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] [instance: a63971de-a2bf-4e58-a760-30eaec3b83c0] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75045) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 23:32:35 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-60f5c230-921a-4bf8-92b2-a6a2534368e9 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] [instance: a63971de-a2bf-4e58-a760-30eaec3b83c0] Found default for hw_cdrom_bus of ide {{(pid=75045) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 23:32:35 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-60f5c230-921a-4bf8-92b2-a6a2534368e9 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] [instance: a63971de-a2bf-4e58-a760-30eaec3b83c0] Found default for hw_disk_bus of virtio {{(pid=75045) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 23:32:35 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-60f5c230-921a-4bf8-92b2-a6a2534368e9 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] [instance: a63971de-a2bf-4e58-a760-30eaec3b83c0] Found default for hw_input_bus of None {{(pid=75045) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 23:32:35 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-60f5c230-921a-4bf8-92b2-a6a2534368e9 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] [instance: a63971de-a2bf-4e58-a760-30eaec3b83c0] Found default for hw_pointer_model of None {{(pid=75045) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 23:32:35 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-60f5c230-921a-4bf8-92b2-a6a2534368e9 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] [instance: a63971de-a2bf-4e58-a760-30eaec3b83c0] Found default for hw_video_model of virtio {{(pid=75045) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 23:32:35 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-60f5c230-921a-4bf8-92b2-a6a2534368e9 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] [instance: a63971de-a2bf-4e58-a760-30eaec3b83c0] Found default for hw_vif_model of virtio {{(pid=75045) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 23:32:35 user nova-compute[75045]: INFO nova.compute.manager [None req-60f5c230-921a-4bf8-92b2-a6a2534368e9 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] [instance: a63971de-a2bf-4e58-a760-30eaec3b83c0] Took 8.57 seconds to spawn the instance on the hypervisor.
Nov 08 23:32:36 user nova-compute[75045]: DEBUG nova.compute.manager [None req-60f5c230-921a-4bf8-92b2-a6a2534368e9 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] [instance: a63971de-a2bf-4e58-a760-30eaec3b83c0] Checking state {{(pid=75045) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 23:32:36 user nova-compute[75045]: INFO nova.compute.manager [None req-60f5c230-921a-4bf8-92b2-a6a2534368e9 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] [instance: a63971de-a2bf-4e58-a760-30eaec3b83c0] Took 9.68 seconds to build instance.
Nov 08 23:32:36 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-60f5c230-921a-4bf8-92b2-a6a2534368e9 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Lock "a63971de-a2bf-4e58-a760-30eaec3b83c0" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.799s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:32:36 user nova-compute[75045]: DEBUG nova.compute.manager [None req-ccf89d8a-ddfc-4e21-8f37-7fa54098c188 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] [instance: 438082fc-a83f-4305-ada6-41a8e1d645a8] Checking state {{(pid=75045) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 23:32:36 user nova-compute[75045]: DEBUG nova.network.neutron [None req-78fd3453-e5e7-43a1-bded-262a4f2ab11d tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] [instance: 04169f59-e9a6-4b50-9ad7-7f8c105a376a] Updating instance_info_cache with network_info: [{"id": "96af9673-bb3c-4173-8439-0be6d2b922cf", "address": "fa:16:3e:a5:6d:8b", "network": {"id": "700b5784-d35b-45c0-a4d3-1ab8aa4c48aa", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-194469807-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.175", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e63623113f11463d9035bb990de43510", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96af9673-bb", "ovs_interfaceid": "96af9673-bb3c-4173-8439-0be6d2b922cf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75045) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 23:32:36 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:32:36 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-78fd3453-e5e7-43a1-bded-262a4f2ab11d tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Releasing lock "refresh_cache-04169f59-e9a6-4b50-9ad7-7f8c105a376a" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 23:32:36 user nova-compute[75045]: DEBUG nova.objects.instance [None req-78fd3453-e5e7-43a1-bded-262a4f2ab11d tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Lazy-loading 'migration_context' on Instance uuid 04169f59-e9a6-4b50-9ad7-7f8c105a376a {{(pid=75045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 23:32:36 user nova-compute[75045]: DEBUG nova.objects.base [None req-78fd3453-e5e7-43a1-bded-262a4f2ab11d tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Object Instance<04169f59-e9a6-4b50-9ad7-7f8c105a376a> lazy-loaded attributes: info_cache,migration_context {{(pid=75045) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 23:32:36 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-78fd3453-e5e7-43a1-bded-262a4f2ab11d tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:32:36 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-78fd3453-e5e7-43a1-bded-262a4f2ab11d tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:32:36 user nova-compute[75045]: DEBUG nova.compute.provider_tree [None req-78fd3453-e5e7-43a1-bded-262a4f2ab11d tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Inventory has not changed in ProviderTree for provider: 62ba5f85-c74d-4b58-986e-d4197e813fd7 {{(pid=75045) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 23:32:36 user nova-compute[75045]: DEBUG nova.scheduler.client.report [None req-78fd3453-e5e7-43a1-bded-262a4f2ab11d tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Inventory has not changed for provider 62ba5f85-c74d-4b58-986e-d4197e813fd7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75045) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 23:32:36 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-78fd3453-e5e7-43a1-bded-262a4f2ab11d tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: held 0.578s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:32:37 user nova-compute[75045]: INFO nova.scheduler.client.report [None req-78fd3453-e5e7-43a1-bded-262a4f2ab11d tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Deleted allocation for migration 70a58e7e-3b1b-4b22-87a4-7bd063b467e1
Nov 08 23:32:37 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-78fd3453-e5e7-43a1-bded-262a4f2ab11d tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Lock "04169f59-e9a6-4b50-9ad7-7f8c105a376a" "released" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: held 2.688s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:32:39 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:32:41 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:32:42 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:32:42 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:32:42 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:32:42 user nova-compute[75045]: DEBUG nova.compute.manager [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75045) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 23:32:44 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:32:44 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:32:44 user nova-compute[75045]: DEBUG nova.compute.manager [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Starting heal instance info cache {{(pid=75045) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 23:32:44 user nova-compute[75045]: DEBUG nova.compute.manager [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Rebuilding the list of instances to heal {{(pid=75045) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 08 23:32:45 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Acquiring lock "refresh_cache-4ae5ff6b-6f2c-4dfd-a4c6-da4809e2cf27" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 23:32:45 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Acquired lock "refresh_cache-4ae5ff6b-6f2c-4dfd-a4c6-da4809e2cf27" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 23:32:45 user nova-compute[75045]: DEBUG nova.network.neutron [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] [instance: 4ae5ff6b-6f2c-4dfd-a4c6-da4809e2cf27] Forcefully refreshing network info cache for instance {{(pid=75045) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 23:32:45 user nova-compute[75045]: DEBUG nova.objects.instance [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Lazy-loading 'info_cache' on Instance uuid 4ae5ff6b-6f2c-4dfd-a4c6-da4809e2cf27 {{(pid=75045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 23:32:45 user nova-compute[75045]: DEBUG nova.network.neutron [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] [instance: 4ae5ff6b-6f2c-4dfd-a4c6-da4809e2cf27] Updating instance_info_cache with network_info: [{"id": "cfa24a0c-4dce-4dae-a5d7-10ebfa1cc305", "address": "fa:16:3e:33:11:13", "network": {"id": "d4cd6998-66d1-4389-bc82-dd000c8962de", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-323966879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bfb6963a6c145d4a7b7e47c8fde7e60", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcfa24a0c-4d", "ovs_interfaceid": "cfa24a0c-4dce-4dae-a5d7-10ebfa1cc305", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75045) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 23:32:45 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Releasing lock "refresh_cache-4ae5ff6b-6f2c-4dfd-a4c6-da4809e2cf27" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 23:32:45 user nova-compute[75045]: DEBUG nova.compute.manager [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] [instance: 4ae5ff6b-6f2c-4dfd-a4c6-da4809e2cf27] Updated the network info_cache for instance {{(pid=75045) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 23:32:46 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:32:46 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:32:46 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:32:46 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager.update_available_resource {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:32:47 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:32:47 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:32:47 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:32:47 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Auditing locally available compute resources for user (node: user) {{(pid=75045) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 23:32:47 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72c9d731-2b35-434c-8463-1cd6c18fbd6a/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:32:47 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72c9d731-2b35-434c-8463-1cd6c18fbd6a/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:32:47 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72c9d731-2b35-434c-8463-1cd6c18fbd6a/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:32:47 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72c9d731-2b35-434c-8463-1cd6c18fbd6a/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:32:47 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fd7c34a-55e7-4d54-9c60-03a7155a2685/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:32:47 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fd7c34a-55e7-4d54-9c60-03a7155a2685/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:32:47 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fd7c34a-55e7-4d54-9c60-03a7155a2685/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:32:48 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fd7c34a-55e7-4d54-9c60-03a7155a2685/disk --force-share --output=json" returned: 0 in 0.233s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:32:48 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ae5ff6b-6f2c-4dfd-a4c6-da4809e2cf27/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:32:48 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ae5ff6b-6f2c-4dfd-a4c6-da4809e2cf27/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:32:48 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ae5ff6b-6f2c-4dfd-a4c6-da4809e2cf27/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:32:48 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ae5ff6b-6f2c-4dfd-a4c6-da4809e2cf27/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:32:48 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] skipping disk /dev/sdh (vda) as it is a volume {{(pid=75045) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 23:32:48 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a63971de-a2bf-4e58-a760-30eaec3b83c0/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:32:48 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a63971de-a2bf-4e58-a760-30eaec3b83c0/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:32:48 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a63971de-a2bf-4e58-a760-30eaec3b83c0/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:32:48 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a63971de-a2bf-4e58-a760-30eaec3b83c0/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:32:48 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f21fcd3-ac5f-499e-9c34-82af806fda1d/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:32:49 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f21fcd3-ac5f-499e-9c34-82af806fda1d/disk --force-share --output=json" returned: 0 in 0.251s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:32:49 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f21fcd3-ac5f-499e-9c34-82af806fda1d/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:32:49 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:32:49 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f21fcd3-ac5f-499e-9c34-82af806fda1d/disk --force-share --output=json" returned: 0 in 0.243s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:32:49 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75045) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 23:32:49 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa67b237-f598-4111-87ba-d761aa50d95e/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:32:49 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa67b237-f598-4111-87ba-d761aa50d95e/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:32:49 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa67b237-f598-4111-87ba-d761aa50d95e/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:32:49 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:32:49 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa67b237-f598-4111-87ba-d761aa50d95e/disk --force-share --output=json" returned: 0 in 0.284s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:32:49 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9222e62a-9fd8-48b2-a125-83c9cdc589bd/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:32:50 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9222e62a-9fd8-48b2-a125-83c9cdc589bd/disk --force-share --output=json" returned: 0 in 0.287s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:32:50 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9222e62a-9fd8-48b2-a125-83c9cdc589bd/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:32:50 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9222e62a-9fd8-48b2-a125-83c9cdc589bd/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:32:50 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75045) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 23:32:50 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5fc7f02-2143-4bcf-92ac-078d5ec10747/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:32:50 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5fc7f02-2143-4bcf-92ac-078d5ec10747/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:32:50 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5fc7f02-2143-4bcf-92ac-078d5ec10747/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:32:50 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-bdd0ab15-9664-412e-86f1-003e441bbf59 tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] Acquiring lock "adcffd35-00c7-49db-a72f-d6307a90e123" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:32:50 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-bdd0ab15-9664-412e-86f1-003e441bbf59 tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] Lock "adcffd35-00c7-49db-a72f-d6307a90e123" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:32:50 user nova-compute[75045]: INFO nova.compute.manager [None req-bdd0ab15-9664-412e-86f1-003e441bbf59 tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] [instance: adcffd35-00c7-49db-a72f-d6307a90e123] Detaching volume 165cfb75-c15e-4b34-9324-edd8f21b6173
Nov 08 23:32:50 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5fc7f02-2143-4bcf-92ac-078d5ec10747/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:32:50 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/adcffd35-00c7-49db-a72f-d6307a90e123/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:32:51 user nova-compute[75045]: INFO nova.virt.block_device [None req-bdd0ab15-9664-412e-86f1-003e441bbf59 tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] [instance: adcffd35-00c7-49db-a72f-d6307a90e123] Attempting to driver detach volume 165cfb75-c15e-4b34-9324-edd8f21b6173 from mountpoint /dev/vdb
Nov 08 23:32:51 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-bdd0ab15-9664-412e-86f1-003e441bbf59 tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] Attempting to detach device vdb from instance adcffd35-00c7-49db-a72f-d6307a90e123 from the persistent domain config. {{(pid=75045) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 08 23:32:51 user nova-compute[75045]: DEBUG nova.virt.libvirt.guest [None req-bdd0ab15-9664-412e-86f1-003e441bbf59 tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 23:32:51 user nova-compute[75045]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 23:32:51 user nova-compute[75045]:   <source dev="/dev/sdb"/>
Nov 08 23:32:51 user nova-compute[75045]:   <target dev="vdb" bus="virtio"/>
Nov 08 23:32:51 user nova-compute[75045]:   <serial>165cfb75-c15e-4b34-9324-edd8f21b6173</serial>
Nov 08 23:32:51 user nova-compute[75045]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 08 23:32:51 user nova-compute[75045]: </disk>
Nov 08 23:32:51 user nova-compute[75045]:  {{(pid=75045) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 23:32:51 user nova-compute[75045]: INFO nova.virt.libvirt.driver [None req-bdd0ab15-9664-412e-86f1-003e441bbf59 tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] Successfully detached device vdb from instance adcffd35-00c7-49db-a72f-d6307a90e123 from the persistent domain config.
Nov 08 23:32:51 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-bdd0ab15-9664-412e-86f1-003e441bbf59 tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance adcffd35-00c7-49db-a72f-d6307a90e123 from the live domain config. {{(pid=75045) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 08 23:32:51 user nova-compute[75045]: DEBUG nova.virt.libvirt.guest [None req-bdd0ab15-9664-412e-86f1-003e441bbf59 tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 23:32:51 user nova-compute[75045]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 23:32:51 user nova-compute[75045]:   <source dev="/dev/sdb"/>
Nov 08 23:32:51 user nova-compute[75045]:   <target dev="vdb" bus="virtio"/>
Nov 08 23:32:51 user nova-compute[75045]:   <serial>165cfb75-c15e-4b34-9324-edd8f21b6173</serial>
Nov 08 23:32:51 user nova-compute[75045]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 08 23:32:51 user nova-compute[75045]: </disk>
Nov 08 23:32:51 user nova-compute[75045]:  {{(pid=75045) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 23:32:51 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/adcffd35-00c7-49db-a72f-d6307a90e123/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:32:51 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/adcffd35-00c7-49db-a72f-d6307a90e123/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:32:51 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:32:51 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/adcffd35-00c7-49db-a72f-d6307a90e123/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:32:51 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75045) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 23:32:51 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b84f2b1-01a3-4789-bcef-8b7c4334132b/disk.rescue --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:32:51 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-bdd0ab15-9664-412e-86f1-003e441bbf59 tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance adcffd35-00c7-49db-a72f-d6307a90e123 {{(pid=75045) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 08 23:32:51 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b84f2b1-01a3-4789-bcef-8b7c4334132b/disk.rescue --force-share --output=json" returned: 0 in 0.241s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:32:51 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b84f2b1-01a3-4789-bcef-8b7c4334132b/disk.rescue --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:32:51 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b84f2b1-01a3-4789-bcef-8b7c4334132b/disk.rescue --force-share --output=json" returned: 0 in 0.219s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:32:51 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b84f2b1-01a3-4789-bcef-8b7c4334132b/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:32:52 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b84f2b1-01a3-4789-bcef-8b7c4334132b/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:32:52 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b84f2b1-01a3-4789-bcef-8b7c4334132b/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:32:52 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b84f2b1-01a3-4789-bcef-8b7c4334132b/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:32:52 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:32:52 user nova-compute[75045]: WARNING nova.virt.libvirt.driver [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 23:32:52 user nova-compute[75045]: WARNING nova.virt.libvirt.driver [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 23:32:52 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Hypervisor/Node resource view: name=user free_ram=7152MB free_disk=24.870792388916016GB free_vcpus=-1 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75045) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 23:32:52 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:32:52 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:32:53 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Instance 4ae5ff6b-6f2c-4dfd-a4c6-da4809e2cf27 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75045) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 23:32:53 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Instance 0f21fcd3-ac5f-499e-9c34-82af806fda1d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75045) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 23:32:53 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Instance d2c911cf-d5f4-4c19-8335-8c7834184a7e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75045) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 23:32:53 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Instance b5fc7f02-2143-4bcf-92ac-078d5ec10747 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75045) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 23:32:53 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Instance 0b84f2b1-01a3-4789-bcef-8b7c4334132b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75045) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 23:32:53 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Instance fa67b237-f598-4111-87ba-d761aa50d95e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75045) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 23:32:53 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Instance 72c9d731-2b35-434c-8463-1cd6c18fbd6a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75045) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 23:32:53 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Instance 438082fc-a83f-4305-ada6-41a8e1d645a8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75045) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 23:32:53 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Instance 9fd7c34a-55e7-4d54-9c60-03a7155a2685 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75045) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 23:32:53 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Instance adcffd35-00c7-49db-a72f-d6307a90e123 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75045) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 23:32:53 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Instance 04169f59-e9a6-4b50-9ad7-7f8c105a376a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75045) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 23:32:53 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Instance 9222e62a-9fd8-48b2-a125-83c9cdc589bd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75045) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 23:32:53 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Instance a63971de-a2bf-4e58-a760-30eaec3b83c0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75045) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 23:32:53 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=75045) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 23:32:53 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Final resource view: name=user phys_ram=16011MB used_ram=8704MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=75045) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 23:32:53 user nova-compute[75045]: DEBUG nova.compute.provider_tree [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Inventory has not changed in ProviderTree for provider: 62ba5f85-c74d-4b58-986e-d4197e813fd7 {{(pid=75045) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 23:32:53 user nova-compute[75045]: DEBUG nova.scheduler.client.report [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Inventory has not changed for provider 62ba5f85-c74d-4b58-986e-d4197e813fd7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75045) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 23:32:53 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Compute_service record updated for user:user {{(pid=75045) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 23:32:53 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.709s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:32:54 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:32:54 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:32:56 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:32:59 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:33:00 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:33:01 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:33:02 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:33:04 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:33:06 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-0d281d14-a46c-40c5-8a9b-22edebe0b66a tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] Acquiring lock "78955913-bbab-4b00-bc9b-12116f249d7e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:33:06 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-0d281d14-a46c-40c5-8a9b-22edebe0b66a tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] Lock "78955913-bbab-4b00-bc9b-12116f249d7e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:33:06 user nova-compute[75045]: DEBUG nova.compute.manager [None req-0d281d14-a46c-40c5-8a9b-22edebe0b66a tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] [instance: 78955913-bbab-4b00-bc9b-12116f249d7e] Starting instance... {{(pid=75045) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 23:33:06 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:33:06 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-0d281d14-a46c-40c5-8a9b-22edebe0b66a tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:33:06 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-0d281d14-a46c-40c5-8a9b-22edebe0b66a tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:33:06 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-0d281d14-a46c-40c5-8a9b-22edebe0b66a tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75045) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 23:33:06 user nova-compute[75045]: INFO nova.compute.claims [None req-0d281d14-a46c-40c5-8a9b-22edebe0b66a tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] [instance: 78955913-bbab-4b00-bc9b-12116f249d7e] Claim successful on node user
Nov 08 23:33:06 user nova-compute[75045]: DEBUG nova.compute.provider_tree [None req-0d281d14-a46c-40c5-8a9b-22edebe0b66a tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] Inventory has not changed in ProviderTree for provider: 62ba5f85-c74d-4b58-986e-d4197e813fd7 {{(pid=75045) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 23:33:06 user nova-compute[75045]: DEBUG nova.scheduler.client.report [None req-0d281d14-a46c-40c5-8a9b-22edebe0b66a tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] Inventory has not changed for provider 62ba5f85-c74d-4b58-986e-d4197e813fd7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75045) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 23:33:07 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-0d281d14-a46c-40c5-8a9b-22edebe0b66a tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.581s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:33:07 user nova-compute[75045]: DEBUG nova.compute.manager [None req-0d281d14-a46c-40c5-8a9b-22edebe0b66a tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] [instance: 78955913-bbab-4b00-bc9b-12116f249d7e] Start building networks asynchronously for instance. {{(pid=75045) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 23:33:07 user nova-compute[75045]: DEBUG nova.compute.manager [None req-0d281d14-a46c-40c5-8a9b-22edebe0b66a tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] [instance: 78955913-bbab-4b00-bc9b-12116f249d7e] Allocating IP information in the background. {{(pid=75045) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 23:33:07 user nova-compute[75045]: DEBUG nova.network.neutron [None req-0d281d14-a46c-40c5-8a9b-22edebe0b66a tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] [instance: 78955913-bbab-4b00-bc9b-12116f249d7e] allocate_for_instance() {{(pid=75045) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 23:33:07 user nova-compute[75045]: INFO nova.virt.libvirt.driver [None req-0d281d14-a46c-40c5-8a9b-22edebe0b66a tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] [instance: 78955913-bbab-4b00-bc9b-12116f249d7e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 23:33:07 user nova-compute[75045]: DEBUG nova.compute.manager [None req-0d281d14-a46c-40c5-8a9b-22edebe0b66a tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] [instance: 78955913-bbab-4b00-bc9b-12116f249d7e] Start building block device mappings for instance. {{(pid=75045) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 23:33:07 user nova-compute[75045]: DEBUG nova.policy [None req-0d281d14-a46c-40c5-8a9b-22edebe0b66a tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7a98fe96727741d0b148f3aaa8abf6f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ad736027d034259a052da3f62bd575f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75045) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 23:33:07 user nova-compute[75045]: DEBUG nova.compute.manager [None req-0d281d14-a46c-40c5-8a9b-22edebe0b66a tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] [instance: 78955913-bbab-4b00-bc9b-12116f249d7e] Start spawning the instance on the hypervisor. {{(pid=75045) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 23:33:07 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-0d281d14-a46c-40c5-8a9b-22edebe0b66a tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] [instance: 78955913-bbab-4b00-bc9b-12116f249d7e] Creating instance directory {{(pid=75045) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 23:33:07 user nova-compute[75045]: INFO nova.virt.libvirt.driver [None req-0d281d14-a46c-40c5-8a9b-22edebe0b66a tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] [instance: 78955913-bbab-4b00-bc9b-12116f249d7e] Creating image(s)
Nov 08 23:33:07 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-0d281d14-a46c-40c5-8a9b-22edebe0b66a tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] Acquiring lock "/opt/stack/data/nova/instances/78955913-bbab-4b00-bc9b-12116f249d7e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:33:07 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-0d281d14-a46c-40c5-8a9b-22edebe0b66a tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] Lock "/opt/stack/data/nova/instances/78955913-bbab-4b00-bc9b-12116f249d7e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:33:07 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-0d281d14-a46c-40c5-8a9b-22edebe0b66a tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] Lock "/opt/stack/data/nova/instances/78955913-bbab-4b00-bc9b-12116f249d7e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:33:07 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-0d281d14-a46c-40c5-8a9b-22edebe0b66a tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b59f52a99fff51c56dd1edfb83892fb8f647f2f3 --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:33:07 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-0d281d14-a46c-40c5-8a9b-22edebe0b66a tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b59f52a99fff51c56dd1edfb83892fb8f647f2f3 --force-share --output=json" returned: 0 in 0.178s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:33:07 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-0d281d14-a46c-40c5-8a9b-22edebe0b66a tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] Acquiring lock "b59f52a99fff51c56dd1edfb83892fb8f647f2f3" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:33:07 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-0d281d14-a46c-40c5-8a9b-22edebe0b66a tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] Lock "b59f52a99fff51c56dd1edfb83892fb8f647f2f3" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:33:07 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-0d281d14-a46c-40c5-8a9b-22edebe0b66a tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b59f52a99fff51c56dd1edfb83892fb8f647f2f3 --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:33:07 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-0d281d14-a46c-40c5-8a9b-22edebe0b66a tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b59f52a99fff51c56dd1edfb83892fb8f647f2f3 --force-share --output=json" returned: 0 in 0.191s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:33:07 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-0d281d14-a46c-40c5-8a9b-22edebe0b66a tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b59f52a99fff51c56dd1edfb83892fb8f647f2f3,backing_fmt=raw /opt/stack/data/nova/instances/78955913-bbab-4b00-bc9b-12116f249d7e/disk 1073741824 {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:33:07 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-0d281d14-a46c-40c5-8a9b-22edebe0b66a tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b59f52a99fff51c56dd1edfb83892fb8f647f2f3,backing_fmt=raw /opt/stack/data/nova/instances/78955913-bbab-4b00-bc9b-12116f249d7e/disk 1073741824" returned: 0 in 0.061s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:33:07 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-0d281d14-a46c-40c5-8a9b-22edebe0b66a tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] Lock "b59f52a99fff51c56dd1edfb83892fb8f647f2f3" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.259s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:33:07 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-0d281d14-a46c-40c5-8a9b-22edebe0b66a tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b59f52a99fff51c56dd1edfb83892fb8f647f2f3 --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:33:07 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-0d281d14-a46c-40c5-8a9b-22edebe0b66a tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b59f52a99fff51c56dd1edfb83892fb8f647f2f3 --force-share --output=json" returned: 0 in 0.273s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:33:07 user nova-compute[75045]: DEBUG nova.virt.disk.api [None req-0d281d14-a46c-40c5-8a9b-22edebe0b66a tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] Checking if we can resize image /opt/stack/data/nova/instances/78955913-bbab-4b00-bc9b-12116f249d7e/disk. size=1073741824 {{(pid=75045) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 23:33:07 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-0d281d14-a46c-40c5-8a9b-22edebe0b66a tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78955913-bbab-4b00-bc9b-12116f249d7e/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:33:08 user nova-compute[75045]: DEBUG nova.network.neutron [None req-0d281d14-a46c-40c5-8a9b-22edebe0b66a tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] [instance: 78955913-bbab-4b00-bc9b-12116f249d7e] Successfully created port: fc66a792-914f-48c4-ae57-cbda1615ff0b {{(pid=75045) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 23:33:08 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-0d281d14-a46c-40c5-8a9b-22edebe0b66a tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78955913-bbab-4b00-bc9b-12116f249d7e/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:33:08 user nova-compute[75045]: DEBUG nova.virt.disk.api [None req-0d281d14-a46c-40c5-8a9b-22edebe0b66a tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] Cannot resize image /opt/stack/data/nova/instances/78955913-bbab-4b00-bc9b-12116f249d7e/disk to a smaller size. {{(pid=75045) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 08 23:33:08 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-0d281d14-a46c-40c5-8a9b-22edebe0b66a tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] [instance: 78955913-bbab-4b00-bc9b-12116f249d7e] Created local disks {{(pid=75045) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 23:33:08 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-0d281d14-a46c-40c5-8a9b-22edebe0b66a tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] [instance: 78955913-bbab-4b00-bc9b-12116f249d7e] Ensure instance console log exists: /opt/stack/data/nova/instances/78955913-bbab-4b00-bc9b-12116f249d7e/console.log {{(pid=75045) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 23:33:08 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-0d281d14-a46c-40c5-8a9b-22edebe0b66a tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:33:08 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-0d281d14-a46c-40c5-8a9b-22edebe0b66a tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:33:08 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-0d281d14-a46c-40c5-8a9b-22edebe0b66a tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:33:09 user nova-compute[75045]: DEBUG nova.network.neutron [None req-0d281d14-a46c-40c5-8a9b-22edebe0b66a tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] [instance: 78955913-bbab-4b00-bc9b-12116f249d7e] Successfully updated port: fc66a792-914f-48c4-ae57-cbda1615ff0b {{(pid=75045) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 23:33:09 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-0d281d14-a46c-40c5-8a9b-22edebe0b66a tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] Acquiring lock "refresh_cache-78955913-bbab-4b00-bc9b-12116f249d7e" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 23:33:09 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-0d281d14-a46c-40c5-8a9b-22edebe0b66a tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] Acquired lock "refresh_cache-78955913-bbab-4b00-bc9b-12116f249d7e" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 23:33:09 user nova-compute[75045]: DEBUG nova.network.neutron [None req-0d281d14-a46c-40c5-8a9b-22edebe0b66a tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] [instance: 78955913-bbab-4b00-bc9b-12116f249d7e] Building network info cache for instance {{(pid=75045) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 23:33:09 user nova-compute[75045]: DEBUG nova.compute.manager [req-a838dfb0-a30c-45a5-b954-684f0f70bb0b req-15d47a27-0dae-451f-a909-11f5f8e4c549 service nova] [instance: 78955913-bbab-4b00-bc9b-12116f249d7e] Received event network-changed-fc66a792-914f-48c4-ae57-cbda1615ff0b {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:33:09 user nova-compute[75045]: DEBUG nova.compute.manager [req-a838dfb0-a30c-45a5-b954-684f0f70bb0b req-15d47a27-0dae-451f-a909-11f5f8e4c549 service nova] [instance: 78955913-bbab-4b00-bc9b-12116f249d7e] Refreshing instance network info cache due to event network-changed-fc66a792-914f-48c4-ae57-cbda1615ff0b. {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 23:33:09 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-a838dfb0-a30c-45a5-b954-684f0f70bb0b req-15d47a27-0dae-451f-a909-11f5f8e4c549 service nova] Acquiring lock "refresh_cache-78955913-bbab-4b00-bc9b-12116f249d7e" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 23:33:09 user nova-compute[75045]: DEBUG nova.network.neutron [None req-0d281d14-a46c-40c5-8a9b-22edebe0b66a tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] [instance: 78955913-bbab-4b00-bc9b-12116f249d7e] Instance cache missing network info. {{(pid=75045) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 23:33:09 user nova-compute[75045]: DEBUG nova.network.neutron [None req-0d281d14-a46c-40c5-8a9b-22edebe0b66a tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] [instance: 78955913-bbab-4b00-bc9b-12116f249d7e] Updating instance_info_cache with network_info: [{"id": "fc66a792-914f-48c4-ae57-cbda1615ff0b", "address": "fa:16:3e:58:00:3d", "network": {"id": "1b10bc53-ef32-4f01-82f6-ed9f95f7e3f2", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-518782773-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ad736027d034259a052da3f62bd575f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc66a792-91", "ovs_interfaceid": "fc66a792-914f-48c4-ae57-cbda1615ff0b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75045) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 23:33:09 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-0d281d14-a46c-40c5-8a9b-22edebe0b66a tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] Releasing lock "refresh_cache-78955913-bbab-4b00-bc9b-12116f249d7e" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 23:33:09 user nova-compute[75045]: DEBUG nova.compute.manager [None req-0d281d14-a46c-40c5-8a9b-22edebe0b66a tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] [instance: 78955913-bbab-4b00-bc9b-12116f249d7e] Instance network_info: |[{"id": "fc66a792-914f-48c4-ae57-cbda1615ff0b", "address": "fa:16:3e:58:00:3d", "network": {"id": "1b10bc53-ef32-4f01-82f6-ed9f95f7e3f2", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-518782773-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ad736027d034259a052da3f62bd575f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc66a792-91", "ovs_interfaceid": "fc66a792-914f-48c4-ae57-cbda1615ff0b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75045) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 23:33:09 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-a838dfb0-a30c-45a5-b954-684f0f70bb0b req-15d47a27-0dae-451f-a909-11f5f8e4c549 service nova] Acquired lock "refresh_cache-78955913-bbab-4b00-bc9b-12116f249d7e" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 23:33:09 user nova-compute[75045]: DEBUG nova.network.neutron [req-a838dfb0-a30c-45a5-b954-684f0f70bb0b req-15d47a27-0dae-451f-a909-11f5f8e4c549 service nova] [instance: 78955913-bbab-4b00-bc9b-12116f249d7e] Refreshing network info cache for port fc66a792-914f-48c4-ae57-cbda1615ff0b {{(pid=75045) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 23:33:09 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-0d281d14-a46c-40c5-8a9b-22edebe0b66a tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] [instance: 78955913-bbab-4b00-bc9b-12116f249d7e] Start _get_guest_xml network_info=[{"id": "fc66a792-914f-48c4-ae57-cbda1615ff0b", "address": "fa:16:3e:58:00:3d", "network": {"id": "1b10bc53-ef32-4f01-82f6-ed9f95f7e3f2", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-518782773-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ad736027d034259a052da3f62bd575f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc66a792-91", "ovs_interfaceid": "fc66a792-914f-48c4-ae57-cbda1615ff0b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T23:11:54Z,direct_url=<?>,disk_format='qcow2',id=a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b1beba2cc4e7465ea249e2225fb494dc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T23:11:56Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'disk_bus': 'virtio', 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': 'a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75045) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 23:33:09 user nova-compute[75045]: WARNING nova.virt.libvirt.driver [None req-0d281d14-a46c-40c5-8a9b-22edebe0b66a tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 23:33:09 user nova-compute[75045]: WARNING nova.virt.libvirt.driver [None req-0d281d14-a46c-40c5-8a9b-22edebe0b66a tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 23:33:09 user nova-compute[75045]: DEBUG nova.virt.libvirt.host [None req-0d281d14-a46c-40c5-8a9b-22edebe0b66a tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75045) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 23:33:09 user nova-compute[75045]: DEBUG nova.virt.libvirt.host [None req-0d281d14-a46c-40c5-8a9b-22edebe0b66a tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] CPU controller missing on host. {{(pid=75045) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 23:33:09 user nova-compute[75045]: DEBUG nova.virt.libvirt.host [None req-0d281d14-a46c-40c5-8a9b-22edebe0b66a tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75045) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 23:33:09 user nova-compute[75045]: DEBUG nova.virt.libvirt.host [None req-0d281d14-a46c-40c5-8a9b-22edebe0b66a tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] CPU controller found on host. {{(pid=75045) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 23:33:09 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-0d281d14-a46c-40c5-8a9b-22edebe0b66a tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75045) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 23:33:09 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-0d281d14-a46c-40c5-8a9b-22edebe0b66a tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T23:11:41Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T23:11:54Z,direct_url=<?>,disk_format='qcow2',id=a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b1beba2cc4e7465ea249e2225fb494dc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T23:11:56Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75045) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 23:33:09 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-0d281d14-a46c-40c5-8a9b-22edebe0b66a tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] Flavor limits 0:0:0 {{(pid=75045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 23:33:09 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-0d281d14-a46c-40c5-8a9b-22edebe0b66a tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] Image limits 0:0:0 {{(pid=75045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 23:33:09 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-0d281d14-a46c-40c5-8a9b-22edebe0b66a tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] Flavor pref 0:0:0 {{(pid=75045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 23:33:09 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-0d281d14-a46c-40c5-8a9b-22edebe0b66a tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] Image pref 0:0:0 {{(pid=75045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 23:33:09 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-0d281d14-a46c-40c5-8a9b-22edebe0b66a tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 23:33:09 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-0d281d14-a46c-40c5-8a9b-22edebe0b66a tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75045) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 23:33:09 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-0d281d14-a46c-40c5-8a9b-22edebe0b66a tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75045) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 23:33:09 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-0d281d14-a46c-40c5-8a9b-22edebe0b66a tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] Got 1 possible topologies {{(pid=75045) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 23:33:09 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-0d281d14-a46c-40c5-8a9b-22edebe0b66a tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75045) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 23:33:09 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-0d281d14-a46c-40c5-8a9b-22edebe0b66a tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75045) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 23:33:09 user nova-compute[75045]: DEBUG nova.virt.libvirt.vif [None req-0d281d14-a46c-40c5-8a9b-22edebe0b66a tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T23:33:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1514498655',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1514498655',id=34,image_ref='a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFx298Irz5GXMZkz0H8Ipklwpf+YgHBBRbJWKyrNrzld19ushXoOxyTLKkgNy4UE8867KMerPvCE78DRV+sjIC5+ZqVsJQYtVE98CDOOjfXA2MhCuUN1Cxpvu54Oh9q6/Q==',key_name='tempest-keypair-1615005599',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3ad736027d034259a052da3f62bd575f',ramdisk_id='',reservation_id='r-ofqmeskf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1769593098',owner_user_name='tempest-AttachVolumeShelveTestJSON-1769593098-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T23:33:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7a98fe96727741d0b148f3aaa8abf6f1',uuid=78955913-bbab-4b00-bc9b-12116f249d7e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fc66a792-914f-48c4-ae57-cbda1615ff0b", "address": "fa:16:3e:58:00:3d", "network": {"id": "1b10bc53-ef32-4f01-82f6-ed9f95f7e3f2", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-518782773-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ad736027d034259a052da3f62bd575f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc66a792-91", "ovs_interfaceid": "fc66a792-914f-48c4-ae57-cbda1615ff0b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75045) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 23:33:09 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-0d281d14-a46c-40c5-8a9b-22edebe0b66a tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] Converting VIF {"id": "fc66a792-914f-48c4-ae57-cbda1615ff0b", "address": "fa:16:3e:58:00:3d", "network": {"id": "1b10bc53-ef32-4f01-82f6-ed9f95f7e3f2", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-518782773-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ad736027d034259a052da3f62bd575f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc66a792-91", "ovs_interfaceid": "fc66a792-914f-48c4-ae57-cbda1615ff0b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 23:33:09 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-0d281d14-a46c-40c5-8a9b-22edebe0b66a tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:58:00:3d,bridge_name='br-int',has_traffic_filtering=True,id=fc66a792-914f-48c4-ae57-cbda1615ff0b,network=Network(1b10bc53-ef32-4f01-82f6-ed9f95f7e3f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc66a792-91') {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 23:33:09 user nova-compute[75045]: DEBUG nova.objects.instance [None req-0d281d14-a46c-40c5-8a9b-22edebe0b66a tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] Lazy-loading 'pci_devices' on Instance uuid 78955913-bbab-4b00-bc9b-12116f249d7e {{(pid=75045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 23:33:09 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-0d281d14-a46c-40c5-8a9b-22edebe0b66a tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] [instance: 78955913-bbab-4b00-bc9b-12116f249d7e] End _get_guest_xml xml=<domain type="kvm">
Nov 08 23:33:09 user nova-compute[75045]:   <uuid>78955913-bbab-4b00-bc9b-12116f249d7e</uuid>
Nov 08 23:33:09 user nova-compute[75045]:   <name>instance-00000022</name>
Nov 08 23:33:09 user nova-compute[75045]:   <memory>524288</memory>
Nov 08 23:33:09 user nova-compute[75045]:   <vcpu>1</vcpu>
Nov 08 23:33:09 user nova-compute[75045]:   <metadata>
Nov 08 23:33:09 user nova-compute[75045]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 23:33:09 user nova-compute[75045]:       <nova:package version="0.0.0"/>
Nov 08 23:33:09 user nova-compute[75045]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1514498655</nova:name>
Nov 08 23:33:09 user nova-compute[75045]:       <nova:creationTime>2023-11-08 23:33:09</nova:creationTime>
Nov 08 23:33:09 user nova-compute[75045]:       <nova:flavor name="m1.tiny">
Nov 08 23:33:09 user nova-compute[75045]:         <nova:memory>512</nova:memory>
Nov 08 23:33:09 user nova-compute[75045]:         <nova:disk>1</nova:disk>
Nov 08 23:33:09 user nova-compute[75045]:         <nova:swap>0</nova:swap>
Nov 08 23:33:09 user nova-compute[75045]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 23:33:09 user nova-compute[75045]:         <nova:vcpus>1</nova:vcpus>
Nov 08 23:33:09 user nova-compute[75045]:       </nova:flavor>
Nov 08 23:33:09 user nova-compute[75045]:       <nova:owner>
Nov 08 23:33:09 user nova-compute[75045]:         <nova:user uuid="7a98fe96727741d0b148f3aaa8abf6f1">tempest-AttachVolumeShelveTestJSON-1769593098-project-member</nova:user>
Nov 08 23:33:09 user nova-compute[75045]:         <nova:project uuid="3ad736027d034259a052da3f62bd575f">tempest-AttachVolumeShelveTestJSON-1769593098</nova:project>
Nov 08 23:33:09 user nova-compute[75045]:       </nova:owner>
Nov 08 23:33:09 user nova-compute[75045]:       <nova:root type="image" uuid="a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb"/>
Nov 08 23:33:09 user nova-compute[75045]:       <nova:ports>
Nov 08 23:33:09 user nova-compute[75045]:         <nova:port uuid="fc66a792-914f-48c4-ae57-cbda1615ff0b">
Nov 08 23:33:09 user nova-compute[75045]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 08 23:33:09 user nova-compute[75045]:         </nova:port>
Nov 08 23:33:09 user nova-compute[75045]:       </nova:ports>
Nov 08 23:33:09 user nova-compute[75045]:     </nova:instance>
Nov 08 23:33:09 user nova-compute[75045]:   </metadata>
Nov 08 23:33:09 user nova-compute[75045]:   <sysinfo type="smbios">
Nov 08 23:33:09 user nova-compute[75045]:     <system>
Nov 08 23:33:09 user nova-compute[75045]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 23:33:09 user nova-compute[75045]:       <entry name="product">OpenStack Nova</entry>
Nov 08 23:33:09 user nova-compute[75045]:       <entry name="version">0.0.0</entry>
Nov 08 23:33:09 user nova-compute[75045]:       <entry name="serial">78955913-bbab-4b00-bc9b-12116f249d7e</entry>
Nov 08 23:33:09 user nova-compute[75045]:       <entry name="uuid">78955913-bbab-4b00-bc9b-12116f249d7e</entry>
Nov 08 23:33:09 user nova-compute[75045]:       <entry name="family">Virtual Machine</entry>
Nov 08 23:33:09 user nova-compute[75045]:     </system>
Nov 08 23:33:09 user nova-compute[75045]:   </sysinfo>
Nov 08 23:33:09 user nova-compute[75045]:   <os>
Nov 08 23:33:09 user nova-compute[75045]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 23:33:09 user nova-compute[75045]:     <boot dev="hd"/>
Nov 08 23:33:09 user nova-compute[75045]:     <smbios mode="sysinfo"/>
Nov 08 23:33:09 user nova-compute[75045]:   </os>
Nov 08 23:33:09 user nova-compute[75045]:   <features>
Nov 08 23:33:09 user nova-compute[75045]:     <acpi/>
Nov 08 23:33:09 user nova-compute[75045]:     <apic/>
Nov 08 23:33:09 user nova-compute[75045]:     <vmcoreinfo/>
Nov 08 23:33:09 user nova-compute[75045]:   </features>
Nov 08 23:33:09 user nova-compute[75045]:   <clock offset="utc">
Nov 08 23:33:09 user nova-compute[75045]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 23:33:09 user nova-compute[75045]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 23:33:09 user nova-compute[75045]:     <timer name="hpet" present="no"/>
Nov 08 23:33:09 user nova-compute[75045]:   </clock>
Nov 08 23:33:09 user nova-compute[75045]:   <cpu mode="custom" match="exact">
Nov 08 23:33:09 user nova-compute[75045]:     <model>Nehalem</model>
Nov 08 23:33:09 user nova-compute[75045]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 23:33:09 user nova-compute[75045]:   </cpu>
Nov 08 23:33:09 user nova-compute[75045]:   <devices>
Nov 08 23:33:09 user nova-compute[75045]:     <disk type="file" device="disk">
Nov 08 23:33:09 user nova-compute[75045]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 23:33:09 user nova-compute[75045]:       <source file="/opt/stack/data/nova/instances/78955913-bbab-4b00-bc9b-12116f249d7e/disk"/>
Nov 08 23:33:09 user nova-compute[75045]:       <target dev="vda" bus="virtio"/>
Nov 08 23:33:09 user nova-compute[75045]:     </disk>
Nov 08 23:33:09 user nova-compute[75045]:     <interface type="ethernet">
Nov 08 23:33:09 user nova-compute[75045]:       <mac address="fa:16:3e:58:00:3d"/>
Nov 08 23:33:09 user nova-compute[75045]:       <model type="virtio"/>
Nov 08 23:33:09 user nova-compute[75045]:       <mtu size="1442"/>
Nov 08 23:33:09 user nova-compute[75045]:       <target dev="tapfc66a792-91"/>
Nov 08 23:33:09 user nova-compute[75045]:     </interface>
Nov 08 23:33:09 user nova-compute[75045]:     <serial type="pty">
Nov 08 23:33:09 user nova-compute[75045]:       <log file="/opt/stack/data/nova/instances/78955913-bbab-4b00-bc9b-12116f249d7e/console.log" append="off"/>
Nov 08 23:33:09 user nova-compute[75045]:     </serial>
Nov 08 23:33:09 user nova-compute[75045]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 23:33:09 user nova-compute[75045]:     <video>
Nov 08 23:33:09 user nova-compute[75045]:       <model type="virtio"/>
Nov 08 23:33:09 user nova-compute[75045]:     </video>
Nov 08 23:33:09 user nova-compute[75045]:     <rng model="virtio">
Nov 08 23:33:09 user nova-compute[75045]:       <backend model="random">/dev/urandom</backend>
Nov 08 23:33:09 user nova-compute[75045]:     </rng>
Nov 08 23:33:09 user nova-compute[75045]:     <controller type="usb" index="0" model="none"/>
Nov 08 23:33:09 user nova-compute[75045]:     <memballoon model="virtio">
Nov 08 23:33:09 user nova-compute[75045]:       <stats period="10"/>
Nov 08 23:33:09 user nova-compute[75045]:     </memballoon>
Nov 08 23:33:09 user nova-compute[75045]:   </devices>
Nov 08 23:33:09 user nova-compute[75045]: </domain>
Nov 08 23:33:09 user nova-compute[75045]:  {{(pid=75045) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 23:33:09 user nova-compute[75045]: DEBUG nova.virt.libvirt.vif [None req-0d281d14-a46c-40c5-8a9b-22edebe0b66a tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T23:33:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1514498655',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1514498655',id=34,image_ref='a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFx298Irz5GXMZkz0H8Ipklwpf+YgHBBRbJWKyrNrzld19ushXoOxyTLKkgNy4UE8867KMerPvCE78DRV+sjIC5+ZqVsJQYtVE98CDOOjfXA2MhCuUN1Cxpvu54Oh9q6/Q==',key_name='tempest-keypair-1615005599',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3ad736027d034259a052da3f62bd575f',ramdisk_id='',reservation_id='r-ofqmeskf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1769593098',owner_user_name='tempest-AttachVolumeShelveTestJSON-1769593098-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T23:33:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7a98fe96727741d0b148f3aaa8abf6f1',uuid=78955913-bbab-4b00-bc9b-12116f249d7e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fc66a792-914f-48c4-ae57-cbda1615ff0b", "address": "fa:16:3e:58:00:3d", "network": {"id": "1b10bc53-ef32-4f01-82f6-ed9f95f7e3f2", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-518782773-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ad736027d034259a052da3f62bd575f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc66a792-91", "ovs_interfaceid": "fc66a792-914f-48c4-ae57-cbda1615ff0b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75045) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 23:33:09 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-0d281d14-a46c-40c5-8a9b-22edebe0b66a tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] Converting VIF {"id": "fc66a792-914f-48c4-ae57-cbda1615ff0b", "address": "fa:16:3e:58:00:3d", "network": {"id": "1b10bc53-ef32-4f01-82f6-ed9f95f7e3f2", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-518782773-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ad736027d034259a052da3f62bd575f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc66a792-91", "ovs_interfaceid": "fc66a792-914f-48c4-ae57-cbda1615ff0b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 23:33:09 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-0d281d14-a46c-40c5-8a9b-22edebe0b66a tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:58:00:3d,bridge_name='br-int',has_traffic_filtering=True,id=fc66a792-914f-48c4-ae57-cbda1615ff0b,network=Network(1b10bc53-ef32-4f01-82f6-ed9f95f7e3f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc66a792-91') {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 23:33:09 user nova-compute[75045]: DEBUG os_vif [None req-0d281d14-a46c-40c5-8a9b-22edebe0b66a tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:58:00:3d,bridge_name='br-int',has_traffic_filtering=True,id=fc66a792-914f-48c4-ae57-cbda1615ff0b,network=Network(1b10bc53-ef32-4f01-82f6-ed9f95f7e3f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc66a792-91') {{(pid=75045) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 23:33:09 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:33:09 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:33:09 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 23:33:09 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:33:09 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e46fb777-631c-53c6-ace4-96a1c31458fd', '_type': 'linux-noop'}}, row=False) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:33:09 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:33:09 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 23:33:09 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:33:09 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfc66a792-91, may_exist=True, interface_attrs={}) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:33:09 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapfc66a792-91, col_values=(('qos', UUID('27d27478-b081-418d-82de-f4623b8a7edf')),), if_exists=True) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:33:09 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapfc66a792-91, col_values=(('external_ids', {'iface-id': 'fc66a792-914f-48c4-ae57-cbda1615ff0b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:58:00:3d', 'vm-uuid': '78955913-bbab-4b00-bc9b-12116f249d7e'}),), if_exists=True) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:33:09 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:33:09 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 23:33:09 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:33:09 user nova-compute[75045]: INFO os_vif [None req-0d281d14-a46c-40c5-8a9b-22edebe0b66a tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:58:00:3d,bridge_name='br-int',has_traffic_filtering=True,id=fc66a792-914f-48c4-ae57-cbda1615ff0b,network=Network(1b10bc53-ef32-4f01-82f6-ed9f95f7e3f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc66a792-91')
Nov 08 23:33:09 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-0d281d14-a46c-40c5-8a9b-22edebe0b66a tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] No BDM found with device name vda, not building metadata. {{(pid=75045) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 23:33:09 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-0d281d14-a46c-40c5-8a9b-22edebe0b66a tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] No VIF found with MAC fa:16:3e:58:00:3d, not building metadata {{(pid=75045) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 23:33:10 user nova-compute[75045]: DEBUG nova.network.neutron [req-a838dfb0-a30c-45a5-b954-684f0f70bb0b req-15d47a27-0dae-451f-a909-11f5f8e4c549 service nova] [instance: 78955913-bbab-4b00-bc9b-12116f249d7e] Updated VIF entry in instance network info cache for port fc66a792-914f-48c4-ae57-cbda1615ff0b. {{(pid=75045) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 23:33:10 user nova-compute[75045]: DEBUG nova.network.neutron [req-a838dfb0-a30c-45a5-b954-684f0f70bb0b req-15d47a27-0dae-451f-a909-11f5f8e4c549 service nova] [instance: 78955913-bbab-4b00-bc9b-12116f249d7e] Updating instance_info_cache with network_info: [{"id": "fc66a792-914f-48c4-ae57-cbda1615ff0b", "address": "fa:16:3e:58:00:3d", "network": {"id": "1b10bc53-ef32-4f01-82f6-ed9f95f7e3f2", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-518782773-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ad736027d034259a052da3f62bd575f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc66a792-91", "ovs_interfaceid": "fc66a792-914f-48c4-ae57-cbda1615ff0b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75045) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 23:33:10 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-a838dfb0-a30c-45a5-b954-684f0f70bb0b req-15d47a27-0dae-451f-a909-11f5f8e4c549 service nova] Releasing lock "refresh_cache-78955913-bbab-4b00-bc9b-12116f249d7e" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 23:33:11 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:33:11 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:33:11 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:33:11 user nova-compute[75045]: DEBUG nova.compute.manager [req-941d44cf-3c92-48b5-951a-7d769df03f33 req-4e04f470-cff6-4149-9a27-11f0d5f9f3ef service nova] [instance: 78955913-bbab-4b00-bc9b-12116f249d7e] Received event network-vif-plugged-fc66a792-914f-48c4-ae57-cbda1615ff0b {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:33:11 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-941d44cf-3c92-48b5-951a-7d769df03f33 req-4e04f470-cff6-4149-9a27-11f0d5f9f3ef service nova] Acquiring lock "78955913-bbab-4b00-bc9b-12116f249d7e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:33:11 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-941d44cf-3c92-48b5-951a-7d769df03f33 req-4e04f470-cff6-4149-9a27-11f0d5f9f3ef service nova] Lock "78955913-bbab-4b00-bc9b-12116f249d7e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:33:11 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-941d44cf-3c92-48b5-951a-7d769df03f33 req-4e04f470-cff6-4149-9a27-11f0d5f9f3ef service nova] Lock "78955913-bbab-4b00-bc9b-12116f249d7e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:33:11 user nova-compute[75045]: DEBUG nova.compute.manager [req-941d44cf-3c92-48b5-951a-7d769df03f33 req-4e04f470-cff6-4149-9a27-11f0d5f9f3ef service nova] [instance: 78955913-bbab-4b00-bc9b-12116f249d7e] No waiting events found dispatching network-vif-plugged-fc66a792-914f-48c4-ae57-cbda1615ff0b {{(pid=75045) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 23:33:11 user nova-compute[75045]: WARNING nova.compute.manager [req-941d44cf-3c92-48b5-951a-7d769df03f33 req-4e04f470-cff6-4149-9a27-11f0d5f9f3ef service nova] [instance: 78955913-bbab-4b00-bc9b-12116f249d7e] Received unexpected event network-vif-plugged-fc66a792-914f-48c4-ae57-cbda1615ff0b for instance with vm_state building and task_state spawning.
Nov 08 23:33:11 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:33:11 user nova-compute[75045]: WARNING nova.virt.libvirt.driver [None req-bdd0ab15-9664-412e-86f1-003e441bbf59 tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance adcffd35-00c7-49db-a72f-d6307a90e123 is timed out.
Nov 08 23:33:11 user nova-compute[75045]: INFO nova.virt.libvirt.driver [None req-bdd0ab15-9664-412e-86f1-003e441bbf59 tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] Successfully detached device vdb from instance adcffd35-00c7-49db-a72f-d6307a90e123 from the live domain config.
Nov 08 23:33:11 user nova-compute[75045]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bdd0ab15-9664-412e-86f1-003e441bbf59 tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] [instance: adcffd35-00c7-49db-a72f-d6307a90e123] calling os-brick to detach iSCSI Volume {{(pid=75045) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 23:33:11 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdd0ab15-9664-412e-86f1-003e441bbf59 tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1b68210460>, {'target_iqn': 'iqn.2010-10.org.openstack:165cfb75-c15e-4b34-9324-edd8f21b6173', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ktTCIhHi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75045) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 23:33:11 user nova-compute[75045]: WARNING os_brick.initiator.connectors.base [None req-bdd0ab15-9664-412e-86f1-003e441bbf59 tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 23:33:11 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-bdd0ab15-9664-412e-86f1-003e441bbf59 tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 23:33:11 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-bdd0ab15-9664-412e-86f1-003e441bbf59 tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 23:33:11 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:33:11 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:33:11 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[21aec386-a760-4e44-a057-b95fbbb8f439]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:165cfb75-c15e-4b34-9324-edd8f21b6173\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:83187c89-e833-4efd-afa0-2cbfe05d8db1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e9c3ac6d-d72a-41c8-9c18-15131250e323\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:33:11 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdd0ab15-9664-412e-86f1-003e441bbf59 tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 23:33:11 user nova-compute[75045]: No targets found.
Nov 08 23:33:11 user nova-compute[75045]: iSNS:
Nov 08 23:33:11 user nova-compute[75045]: No targets found.
Nov 08 23:33:11 user nova-compute[75045]: STATIC:
Nov 08 23:33:11 user nova-compute[75045]: Target: iqn.2010-10.org.openstack:165cfb75-c15e-4b34-9324-edd8f21b6173
Nov 08 23:33:11 user nova-compute[75045]:         Portal: 172.16.0.220:3260,-1
Nov 08 23:33:11 user nova-compute[75045]:                 Iface Name: default
Nov 08 23:33:11 user nova-compute[75045]: Target: iqn.2010-10.org.openstack:83187c89-e833-4efd-afa0-2cbfe05d8db1
Nov 08 23:33:11 user nova-compute[75045]:         Portal: 172.16.0.220:3260,-1
Nov 08 23:33:11 user nova-compute[75045]:                 Iface Name: default
Nov 08 23:33:11 user nova-compute[75045]: Target: iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab
Nov 08 23:33:11 user nova-compute[75045]:         Portal: 172.16.0.220:3260,-1
Nov 08 23:33:11 user nova-compute[75045]:                 Iface Name: default
Nov 08 23:33:11 user nova-compute[75045]: Target: iqn.2010-10.org.openstack:e9c3ac6d-d72a-41c8-9c18-15131250e323
Nov 08 23:33:11 user nova-compute[75045]:         Portal: 172.16.0.220:3260,-1
Nov 08 23:33:11 user nova-compute[75045]:                 Iface Name: default
Nov 08 23:33:11 user nova-compute[75045]: FIRMWARE:
Nov 08 23:33:11 user nova-compute[75045]: No targets found.
Nov 08 23:33:11 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 23:33:11 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdd0ab15-9664-412e-86f1-003e441bbf59 tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 23:33:11 user nova-compute[75045]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 23:33:11 user nova-compute[75045]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75045) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 23:33:11 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdd0ab15-9664-412e-86f1-003e441bbf59 tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:165cfb75-c15e-4b34-9324-edd8f21b6173', 0)] {{(pid=75045) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 23:33:11 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:33:11 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:33:11 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[83966674-4387-4316-b4d1-5c9e0dfdffb9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:165cfb75-c15e-4b34-9324-edd8f21b6173\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:83187c89-e833-4efd-afa0-2cbfe05d8db1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e9c3ac6d-d72a-41c8-9c18-15131250e323\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:33:11 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:33:11 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:33:11 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee54aab1-baf3-4e35-9382-17bcbcab25af]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83187c89-e833-4efd-afa0-2cbfe05d8db1 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9c3ac6d-d72a-41c8-9c18-15131250e323 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:165cfb75-c15e-4b34-9324-edd8f21b6173 (non-flash)\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:33:11 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdd0ab15-9664-412e-86f1-003e441bbf59 tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab (non-flash)
Nov 08 23:33:11 user nova-compute[75045]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83187c89-e833-4efd-afa0-2cbfe05d8db1 (non-flash)
Nov 08 23:33:11 user nova-compute[75045]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9c3ac6d-d72a-41c8-9c18-15131250e323 (non-flash)
Nov 08 23:33:11 user nova-compute[75045]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:165cfb75-c15e-4b34-9324-edd8f21b6173 (non-flash)
Nov 08 23:33:11 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 23:33:11 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdd0ab15-9664-412e-86f1-003e441bbf59 tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab (non-flash)
Nov 08 23:33:11 user nova-compute[75045]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83187c89-e833-4efd-afa0-2cbfe05d8db1 (non-flash)
Nov 08 23:33:11 user nova-compute[75045]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9c3ac6d-d72a-41c8-9c18-15131250e323 (non-flash)
Nov 08 23:33:11 user nova-compute[75045]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:165cfb75-c15e-4b34-9324-edd8f21b6173 (non-flash)
Nov 08 23:33:11 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 23:33:11 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdd0ab15-9664-412e-86f1-003e441bbf59 tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1b485b11b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:165cfb75-c15e-4b34-9324-edd8f21b6173'): ({'sdb'}, set())}) {{(pid=75045) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 23:33:11 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-bdd0ab15-9664-412e-86f1-003e441bbf59 tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] Removing single pathed devices sdb {{(pid=75045) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 23:33:11 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:33:11 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:33:11 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[d409e9e3-efc7-4387-ad42-909b7e3ebbe1]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:33:11 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:33:11 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:33:11 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1f1dd5b-fad0-4565-93e1-2a92ce2a14a2]: (4, ('ok\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:33:11 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-bdd0ab15-9664-412e-86f1-003e441bbf59 tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] Flushing IO for device /dev/sdb {{(pid=75045) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 23:33:11 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:33:11 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:33:11 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[687f6fee-069f-46a8-b349-cb49c5b2e564]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:33:11 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-bdd0ab15-9664-412e-86f1-003e441bbf59 tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75045) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 23:33:11 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:33:11 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:33:11 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:33:11 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:33:11 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.051s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:33:11 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c281d27-f9b6-49cc-82e8-ef45628d9f85]: (4, ('1', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:33:11 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-bdd0ab15-9664-412e-86f1-003e441bbf59 tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75045) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 23:33:11 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-bdd0ab15-9664-412e-86f1-003e441bbf59 tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] SCSI volumes sdb have been removed. {{(pid=75045) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 23:33:11 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdd0ab15-9664-412e-86f1-003e441bbf59 tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:165cfb75-c15e-4b34-9324-edd8f21b6173')] {{(pid=75045) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 23:33:11 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:165cfb75-c15e-4b34-9324-edd8f21b6173 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:33:11 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:33:11 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:165cfb75-c15e-4b34-9324-edd8f21b6173 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:33:11 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[17bc4d40-72b8-4e08-9e5c-57c1aad82b1c]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:33:11 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdd0ab15-9664-412e-86f1-003e441bbf59 tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:33:11 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:165cfb75-c15e-4b34-9324-edd8f21b6173 -p 172.16.0.220:3260 --logout {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:33:11 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:165cfb75-c15e-4b34-9324-edd8f21b6173 -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:33:11 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e4e6fd4-46e5-4cd4-b62a-e8fc421d145f]: (4, ('Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:165cfb75-c15e-4b34-9324-edd8f21b6173, portal: 172.16.0.220,3260]\nLogout of [sid: 33, target: iqn.2010-10.org.openstack:165cfb75-c15e-4b34-9324-edd8f21b6173, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:33:11 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdd0ab15-9664-412e-86f1-003e441bbf59 tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:165cfb75-c15e-4b34-9324-edd8f21b6173, portal: 172.16.0.220,3260]
Nov 08 23:33:11 user nova-compute[75045]: Logout of [sid: 33, target: iqn.2010-10.org.openstack:165cfb75-c15e-4b34-9324-edd8f21b6173, portal: 172.16.0.220,3260] successful.
Nov 08 23:33:11 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:33:11 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:165cfb75-c15e-4b34-9324-edd8f21b6173 -p 172.16.0.220:3260 --op delete {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:33:11 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:165cfb75-c15e-4b34-9324-edd8f21b6173 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:33:11 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd075be6-5896-409b-9311-f9a4ad7d6498]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:33:11 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdd0ab15-9664-412e-86f1-003e441bbf59 tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:33:11 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-bdd0ab15-9664-412e-86f1-003e441bbf59 tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.347s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 23:33:11 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdd0ab15-9664-412e-86f1-003e441bbf59 tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] <== disconnect_volume: return (349ms) None {{(pid=75045) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 23:33:11 user nova-compute[75045]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bdd0ab15-9664-412e-86f1-003e441bbf59 tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] [instance: adcffd35-00c7-49db-a72f-d6307a90e123] Disconnected iSCSI Volume {{(pid=75045) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 23:33:12 user nova-compute[75045]: DEBUG nova.objects.instance [None req-bdd0ab15-9664-412e-86f1-003e441bbf59 tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] Lazy-loading 'flavor' on Instance uuid adcffd35-00c7-49db-a72f-d6307a90e123 {{(pid=75045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 23:33:12 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-bdd0ab15-9664-412e-86f1-003e441bbf59 tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] Lock "adcffd35-00c7-49db-a72f-d6307a90e123" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.156s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:33:13 user nova-compute[75045]: DEBUG nova.compute.manager [req-e22ccce6-af54-44e7-bead-9702408b6034 req-f52f9c4f-e6a1-4c98-be8d-5886ff335073 service nova] [instance: 78955913-bbab-4b00-bc9b-12116f249d7e] Received event network-vif-plugged-fc66a792-914f-48c4-ae57-cbda1615ff0b {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:33:13 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-e22ccce6-af54-44e7-bead-9702408b6034 req-f52f9c4f-e6a1-4c98-be8d-5886ff335073 service nova] Acquiring lock "78955913-bbab-4b00-bc9b-12116f249d7e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:33:13 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-e22ccce6-af54-44e7-bead-9702408b6034 req-f52f9c4f-e6a1-4c98-be8d-5886ff335073 service nova] Lock "78955913-bbab-4b00-bc9b-12116f249d7e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:33:13 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-e22ccce6-af54-44e7-bead-9702408b6034 req-f52f9c4f-e6a1-4c98-be8d-5886ff335073 service nova] Lock "78955913-bbab-4b00-bc9b-12116f249d7e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:33:13 user nova-compute[75045]: DEBUG nova.compute.manager [req-e22ccce6-af54-44e7-bead-9702408b6034 req-f52f9c4f-e6a1-4c98-be8d-5886ff335073 service nova] [instance: 78955913-bbab-4b00-bc9b-12116f249d7e] No waiting events found dispatching network-vif-plugged-fc66a792-914f-48c4-ae57-cbda1615ff0b {{(pid=75045) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 23:33:13 user nova-compute[75045]: WARNING nova.compute.manager [req-e22ccce6-af54-44e7-bead-9702408b6034 req-f52f9c4f-e6a1-4c98-be8d-5886ff335073 service nova] [instance: 78955913-bbab-4b00-bc9b-12116f249d7e] Received unexpected event network-vif-plugged-fc66a792-914f-48c4-ae57-cbda1615ff0b for instance with vm_state building and task_state spawning.
Nov 08 23:33:13 user nova-compute[75045]: DEBUG nova.compute.manager [None req-0d281d14-a46c-40c5-8a9b-22edebe0b66a tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] [instance: 78955913-bbab-4b00-bc9b-12116f249d7e] Instance event wait completed in 0 seconds for  {{(pid=75045) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 23:33:13 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-0d281d14-a46c-40c5-8a9b-22edebe0b66a tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] [instance: 78955913-bbab-4b00-bc9b-12116f249d7e] Guest created on hypervisor {{(pid=75045) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 23:33:13 user nova-compute[75045]: INFO nova.virt.libvirt.driver [-] [instance: 78955913-bbab-4b00-bc9b-12116f249d7e] Instance spawned successfully.
Nov 08 23:33:13 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-0d281d14-a46c-40c5-8a9b-22edebe0b66a tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] [instance: 78955913-bbab-4b00-bc9b-12116f249d7e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75045) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 23:33:13 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-0d281d14-a46c-40c5-8a9b-22edebe0b66a tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] [instance: 78955913-bbab-4b00-bc9b-12116f249d7e] Found default for hw_cdrom_bus of ide {{(pid=75045) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 23:33:13 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-0d281d14-a46c-40c5-8a9b-22edebe0b66a tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] [instance: 78955913-bbab-4b00-bc9b-12116f249d7e] Found default for hw_disk_bus of virtio {{(pid=75045) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 23:33:13 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-0d281d14-a46c-40c5-8a9b-22edebe0b66a tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] [instance: 78955913-bbab-4b00-bc9b-12116f249d7e] Found default for hw_input_bus of None {{(pid=75045) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 23:33:13 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-0d281d14-a46c-40c5-8a9b-22edebe0b66a tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] [instance: 78955913-bbab-4b00-bc9b-12116f249d7e] Found default for hw_pointer_model of None {{(pid=75045) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 23:33:13 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-0d281d14-a46c-40c5-8a9b-22edebe0b66a tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] [instance: 78955913-bbab-4b00-bc9b-12116f249d7e] Found default for hw_video_model of virtio {{(pid=75045) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 23:33:13 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-0d281d14-a46c-40c5-8a9b-22edebe0b66a tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] [instance: 78955913-bbab-4b00-bc9b-12116f249d7e] Found default for hw_vif_model of virtio {{(pid=75045) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 23:33:13 user nova-compute[75045]: INFO nova.compute.manager [None req-0d281d14-a46c-40c5-8a9b-22edebe0b66a tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] [instance: 78955913-bbab-4b00-bc9b-12116f249d7e] Took 6.28 seconds to spawn the instance on the hypervisor.
Nov 08 23:33:13 user nova-compute[75045]: DEBUG nova.compute.manager [None req-0d281d14-a46c-40c5-8a9b-22edebe0b66a tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] [instance: 78955913-bbab-4b00-bc9b-12116f249d7e] Checking state {{(pid=75045) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 23:33:13 user nova-compute[75045]: INFO nova.compute.manager [None req-0d281d14-a46c-40c5-8a9b-22edebe0b66a tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] [instance: 78955913-bbab-4b00-bc9b-12116f249d7e] Took 7.23 seconds to build instance.
Nov 08 23:33:13 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-0d281d14-a46c-40c5-8a9b-22edebe0b66a tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] Lock "78955913-bbab-4b00-bc9b-12116f249d7e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.347s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:33:14 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:33:16 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:33:19 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:33:21 user nova-compute[75045]: DEBUG nova.compute.manager [req-067b17d3-77f3-47b0-9f2c-595a51ea52e4 req-aae8307f-3bc6-459a-a991-5124bea68271 service nova] [instance: 9222e62a-9fd8-48b2-a125-83c9cdc589bd] Received event network-changed-5dae7844-411c-47aa-ba3e-bc209136f0a6 {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:33:21 user nova-compute[75045]: DEBUG nova.compute.manager [req-067b17d3-77f3-47b0-9f2c-595a51ea52e4 req-aae8307f-3bc6-459a-a991-5124bea68271 service nova] [instance: 9222e62a-9fd8-48b2-a125-83c9cdc589bd] Refreshing instance network info cache due to event network-changed-5dae7844-411c-47aa-ba3e-bc209136f0a6. {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 23:33:21 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-067b17d3-77f3-47b0-9f2c-595a51ea52e4 req-aae8307f-3bc6-459a-a991-5124bea68271 service nova] Acquiring lock "refresh_cache-9222e62a-9fd8-48b2-a125-83c9cdc589bd" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 23:33:21 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-067b17d3-77f3-47b0-9f2c-595a51ea52e4 req-aae8307f-3bc6-459a-a991-5124bea68271 service nova] Acquired lock "refresh_cache-9222e62a-9fd8-48b2-a125-83c9cdc589bd" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 23:33:21 user nova-compute[75045]: DEBUG nova.network.neutron [req-067b17d3-77f3-47b0-9f2c-595a51ea52e4 req-aae8307f-3bc6-459a-a991-5124bea68271 service nova] [instance: 9222e62a-9fd8-48b2-a125-83c9cdc589bd] Refreshing network info cache for port 5dae7844-411c-47aa-ba3e-bc209136f0a6 {{(pid=75045) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 23:33:21 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-d167bb59-e52c-4412-b12a-2107fd4b7c49 tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] Acquiring lock "9222e62a-9fd8-48b2-a125-83c9cdc589bd" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:33:21 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-d167bb59-e52c-4412-b12a-2107fd4b7c49 tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] Lock "9222e62a-9fd8-48b2-a125-83c9cdc589bd" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:33:21 user nova-compute[75045]: DEBUG nova.objects.instance [None req-d167bb59-e52c-4412-b12a-2107fd4b7c49 tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] Lazy-loading 'flavor' on Instance uuid 9222e62a-9fd8-48b2-a125-83c9cdc589bd {{(pid=75045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 23:33:21 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-d167bb59-e52c-4412-b12a-2107fd4b7c49 tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] Lock "9222e62a-9fd8-48b2-a125-83c9cdc589bd" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:33:21 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:33:21 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-d167bb59-e52c-4412-b12a-2107fd4b7c49 tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] Acquiring lock "9222e62a-9fd8-48b2-a125-83c9cdc589bd" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:33:21 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-d167bb59-e52c-4412-b12a-2107fd4b7c49 tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] Lock "9222e62a-9fd8-48b2-a125-83c9cdc589bd" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:33:21 user nova-compute[75045]: INFO nova.compute.manager [None req-d167bb59-e52c-4412-b12a-2107fd4b7c49 tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] [instance: 9222e62a-9fd8-48b2-a125-83c9cdc589bd] Attaching volume 1b2a3b04-13be-4853-822c-29c416757252 to /dev/vdb
Nov 08 23:33:21 user nova-compute[75045]: DEBUG nova.network.neutron [req-067b17d3-77f3-47b0-9f2c-595a51ea52e4 req-aae8307f-3bc6-459a-a991-5124bea68271 service nova] [instance: 9222e62a-9fd8-48b2-a125-83c9cdc589bd] Updated VIF entry in instance network info cache for port 5dae7844-411c-47aa-ba3e-bc209136f0a6. {{(pid=75045) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 23:33:21 user nova-compute[75045]: DEBUG nova.network.neutron [req-067b17d3-77f3-47b0-9f2c-595a51ea52e4 req-aae8307f-3bc6-459a-a991-5124bea68271 service nova] [instance: 9222e62a-9fd8-48b2-a125-83c9cdc589bd] Updating instance_info_cache with network_info: [{"id": "5dae7844-411c-47aa-ba3e-bc209136f0a6", "address": "fa:16:3e:a4:11:9a", "network": {"id": "08d1669a-f667-4c79-8e49-0ad183f57046", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1863648032-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.156", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bbb640407ef94f568aea892f1834d6d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5dae7844-41", "ovs_interfaceid": "5dae7844-411c-47aa-ba3e-bc209136f0a6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75045) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 23:33:21 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-067b17d3-77f3-47b0-9f2c-595a51ea52e4 req-aae8307f-3bc6-459a-a991-5124bea68271 service nova] Releasing lock "refresh_cache-9222e62a-9fd8-48b2-a125-83c9cdc589bd" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 23:33:21 user nova-compute[75045]: DEBUG os_brick.utils [None req-d167bb59-e52c-4412-b12a-2107fd4b7c49 tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75045) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 23:33:21 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:33:21 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:33:21 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ad6c4f8-66d7-4b81-acf5-5071e39f6e16]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6217bd6e884\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:33:21 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:33:21 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:33:21 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[41f5ac8d-0652-43d3-a9fa-b5d875c6c7f3]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:33:21 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:33:21 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:33:21 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e60dee7-4526-4d9b-822c-12363a4f9576]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:33:21 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f273e7a-d6b8-4b17-aaaf-7db56f601743]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:33:21 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-d167bb59-e52c-4412-b12a-2107fd4b7c49 tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] Running cmd (subprocess): nvme version {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:33:21 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-d167bb59-e52c-4412-b12a-2107fd4b7c49 tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] 'nvme version' failed. Not Retrying. {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 23:33:21 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d167bb59-e52c-4412-b12a-2107fd4b7c49 tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] nvme not present on system {{(pid=75045) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 23:33:21 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:33:21 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 23:33:21 user nova-compute[75045]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 23:33:21 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[74a7e1c6-0412-4f3f-9151-6c23ff6c9e21]: (4, '') {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:33:21 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.lightos [None req-d167bb59-e52c-4412-b12a-2107fd4b7c49 tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75045) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 23:33:21 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.lightos [None req-d167bb59-e52c-4412-b12a-2107fd4b7c49 tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75045) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 23:33:21 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.lightos [None req-d167bb59-e52c-4412-b12a-2107fd4b7c49 tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] LIGHTOS: no hostnqn found. {{(pid=75045) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 23:33:21 user nova-compute[75045]: DEBUG os_brick.utils [None req-d167bb59-e52c-4412-b12a-2107fd4b7c49 tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6217bd6e884', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75045) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 23:33:21 user nova-compute[75045]: DEBUG nova.virt.block_device [None req-d167bb59-e52c-4412-b12a-2107fd4b7c49 tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] [instance: 9222e62a-9fd8-48b2-a125-83c9cdc589bd] Updating existing volume attachment record: 1b550dd8-9e52-414f-b719-b3de35a24b06 {{(pid=75045) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 23:33:24 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:33:26 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:33:29 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:33:31 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:33:34 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:33:36 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:33:39 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:33:39 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:33:41 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:33:41 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:33:41 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:33:43 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:33:43 user nova-compute[75045]: DEBUG nova.compute.manager [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75045) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 23:33:44 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:33:44 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:33:44 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:33:44 user nova-compute[75045]: DEBUG nova.compute.manager [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Starting heal instance info cache {{(pid=75045) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 23:33:45 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Acquiring lock "refresh_cache-0f21fcd3-ac5f-499e-9c34-82af806fda1d" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 23:33:45 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Acquired lock "refresh_cache-0f21fcd3-ac5f-499e-9c34-82af806fda1d" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 23:33:45 user nova-compute[75045]: DEBUG nova.network.neutron [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] [instance: 0f21fcd3-ac5f-499e-9c34-82af806fda1d] Forcefully refreshing network info cache for instance {{(pid=75045) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 23:33:45 user nova-compute[75045]: DEBUG nova.network.neutron [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] [instance: 0f21fcd3-ac5f-499e-9c34-82af806fda1d] Updating instance_info_cache with network_info: [{"id": "ab02704d-73c2-409c-9d43-1a087ebf369a", "address": "fa:16:3e:b3:b2:47", "network": {"id": "700b5784-d35b-45c0-a4d3-1ab8aa4c48aa", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-194469807-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e63623113f11463d9035bb990de43510", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab02704d-73", "ovs_interfaceid": "ab02704d-73c2-409c-9d43-1a087ebf369a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75045) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 23:33:45 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Releasing lock "refresh_cache-0f21fcd3-ac5f-499e-9c34-82af806fda1d" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 23:33:45 user nova-compute[75045]: DEBUG nova.compute.manager [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] [instance: 0f21fcd3-ac5f-499e-9c34-82af806fda1d] Updated the network info_cache for instance {{(pid=75045) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 23:33:46 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:33:46 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:33:46 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:33:47 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:33:47 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager.update_available_resource {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:33:48 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:33:48 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:33:48 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:33:48 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Auditing locally available compute resources for user (node: user) {{(pid=75045) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 23:33:48 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72c9d731-2b35-434c-8463-1cd6c18fbd6a/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:33:48 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72c9d731-2b35-434c-8463-1cd6c18fbd6a/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:33:48 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72c9d731-2b35-434c-8463-1cd6c18fbd6a/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:33:48 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72c9d731-2b35-434c-8463-1cd6c18fbd6a/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:33:48 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fd7c34a-55e7-4d54-9c60-03a7155a2685/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:33:48 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fd7c34a-55e7-4d54-9c60-03a7155a2685/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:33:48 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fd7c34a-55e7-4d54-9c60-03a7155a2685/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:33:49 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fd7c34a-55e7-4d54-9c60-03a7155a2685/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:33:49 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ae5ff6b-6f2c-4dfd-a4c6-da4809e2cf27/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:33:49 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ae5ff6b-6f2c-4dfd-a4c6-da4809e2cf27/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:33:49 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ae5ff6b-6f2c-4dfd-a4c6-da4809e2cf27/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:33:49 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ae5ff6b-6f2c-4dfd-a4c6-da4809e2cf27/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:33:49 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] skipping disk /dev/sdh (vda) as it is a volume {{(pid=75045) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 23:33:49 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a63971de-a2bf-4e58-a760-30eaec3b83c0/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:33:49 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a63971de-a2bf-4e58-a760-30eaec3b83c0/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:33:49 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a63971de-a2bf-4e58-a760-30eaec3b83c0/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:33:49 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:33:49 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a63971de-a2bf-4e58-a760-30eaec3b83c0/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:33:49 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f21fcd3-ac5f-499e-9c34-82af806fda1d/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:33:50 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f21fcd3-ac5f-499e-9c34-82af806fda1d/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:33:50 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f21fcd3-ac5f-499e-9c34-82af806fda1d/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:33:50 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f21fcd3-ac5f-499e-9c34-82af806fda1d/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:33:50 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75045) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 23:33:50 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa67b237-f598-4111-87ba-d761aa50d95e/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:33:50 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa67b237-f598-4111-87ba-d761aa50d95e/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:33:50 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa67b237-f598-4111-87ba-d761aa50d95e/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:33:50 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa67b237-f598-4111-87ba-d761aa50d95e/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:33:50 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78955913-bbab-4b00-bc9b-12116f249d7e/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:33:50 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78955913-bbab-4b00-bc9b-12116f249d7e/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:33:50 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78955913-bbab-4b00-bc9b-12116f249d7e/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:33:51 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78955913-bbab-4b00-bc9b-12116f249d7e/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:33:51 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9222e62a-9fd8-48b2-a125-83c9cdc589bd/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:33:51 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9222e62a-9fd8-48b2-a125-83c9cdc589bd/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:33:51 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9222e62a-9fd8-48b2-a125-83c9cdc589bd/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:33:51 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9222e62a-9fd8-48b2-a125-83c9cdc589bd/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:33:51 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75045) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 23:33:51 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5fc7f02-2143-4bcf-92ac-078d5ec10747/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:33:51 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5fc7f02-2143-4bcf-92ac-078d5ec10747/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:33:51 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5fc7f02-2143-4bcf-92ac-078d5ec10747/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:33:51 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5fc7f02-2143-4bcf-92ac-078d5ec10747/disk --force-share --output=json" returned: 0 in 0.235s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:33:51 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/adcffd35-00c7-49db-a72f-d6307a90e123/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:33:52 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/adcffd35-00c7-49db-a72f-d6307a90e123/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:33:52 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/adcffd35-00c7-49db-a72f-d6307a90e123/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:33:52 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/adcffd35-00c7-49db-a72f-d6307a90e123/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:33:52 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b84f2b1-01a3-4789-bcef-8b7c4334132b/disk.rescue --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:33:52 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b84f2b1-01a3-4789-bcef-8b7c4334132b/disk.rescue --force-share --output=json" returned: 0 in 0.175s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:33:52 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b84f2b1-01a3-4789-bcef-8b7c4334132b/disk.rescue --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:33:52 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b84f2b1-01a3-4789-bcef-8b7c4334132b/disk.rescue --force-share --output=json" returned: 0 in 0.174s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:33:52 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b84f2b1-01a3-4789-bcef-8b7c4334132b/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:33:52 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b84f2b1-01a3-4789-bcef-8b7c4334132b/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:33:52 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b84f2b1-01a3-4789-bcef-8b7c4334132b/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:33:53 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b84f2b1-01a3-4789-bcef-8b7c4334132b/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:33:53 user nova-compute[75045]: WARNING nova.virt.libvirt.driver [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 23:33:53 user nova-compute[75045]: WARNING nova.virt.libvirt.driver [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 23:33:53 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Hypervisor/Node resource view: name=user free_ram=7126MB free_disk=24.801959991455078GB free_vcpus=-2 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75045) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 23:33:53 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:33:53 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:33:53 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Instance 4ae5ff6b-6f2c-4dfd-a4c6-da4809e2cf27 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75045) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 23:33:53 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Instance 0f21fcd3-ac5f-499e-9c34-82af806fda1d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75045) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 23:33:53 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Instance d2c911cf-d5f4-4c19-8335-8c7834184a7e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75045) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 23:33:53 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Instance b5fc7f02-2143-4bcf-92ac-078d5ec10747 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75045) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 23:33:53 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Instance 0b84f2b1-01a3-4789-bcef-8b7c4334132b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75045) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 23:33:53 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Instance fa67b237-f598-4111-87ba-d761aa50d95e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75045) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 23:33:53 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Instance 72c9d731-2b35-434c-8463-1cd6c18fbd6a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75045) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 23:33:53 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Instance 438082fc-a83f-4305-ada6-41a8e1d645a8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75045) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 23:33:53 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Instance 9fd7c34a-55e7-4d54-9c60-03a7155a2685 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75045) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 23:33:53 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Instance adcffd35-00c7-49db-a72f-d6307a90e123 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75045) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 23:33:53 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Instance 04169f59-e9a6-4b50-9ad7-7f8c105a376a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75045) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 23:33:53 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Instance 9222e62a-9fd8-48b2-a125-83c9cdc589bd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75045) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 23:33:53 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Instance a63971de-a2bf-4e58-a760-30eaec3b83c0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75045) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 23:33:53 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Instance 78955913-bbab-4b00-bc9b-12116f249d7e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75045) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 23:33:53 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Total usable vcpus: 12, total allocated vcpus: 14 {{(pid=75045) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 23:33:53 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Final resource view: name=user phys_ram=16011MB used_ram=9216MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=14 pci_stats=[] {{(pid=75045) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 23:33:54 user nova-compute[75045]: DEBUG nova.compute.provider_tree [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Inventory has not changed in ProviderTree for provider: 62ba5f85-c74d-4b58-986e-d4197e813fd7 {{(pid=75045) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 23:33:54 user nova-compute[75045]: DEBUG nova.scheduler.client.report [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Inventory has not changed for provider 62ba5f85-c74d-4b58-986e-d4197e813fd7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75045) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 23:33:54 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Compute_service record updated for user:user {{(pid=75045) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 23:33:54 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.759s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:33:54 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:33:56 user nova-compute[75045]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d167bb59-e52c-4412-b12a-2107fd4b7c49 tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] [instance: 9222e62a-9fd8-48b2-a125-83c9cdc589bd] Calling os-brick to attach iSCSI Volume {{(pid=75045) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 23:33:56 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-d167bb59-e52c-4412-b12a-2107fd4b7c49 tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1b68210460>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:1b2a3b04-13be-4853-822c-29c416757252', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MAhTqXGu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75045) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 23:33:56 user nova-compute[75045]: WARNING os_brick.initiator.connectors.base [None req-d167bb59-e52c-4412-b12a-2107fd4b7c49 tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 23:33:56 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-d167bb59-e52c-4412-b12a-2107fd4b7c49 tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 23:33:56 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-d167bb59-e52c-4412-b12a-2107fd4b7c49 tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 23:33:56 user nova-compute[75045]: WARNING os_brick.initiator.connectors.base [None req-d167bb59-e52c-4412-b12a-2107fd4b7c49 tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 23:33:56 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-d167bb59-e52c-4412-b12a-2107fd4b7c49 tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1b2a3b04-13be-4853-822c-29c416757252" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 23:33:56 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-d167bb59-e52c-4412-b12a-2107fd4b7c49 tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1b2a3b04-13be-4853-822c-29c416757252" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.004s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 23:33:56 user nova-compute[75045]: INFO os_brick.initiator.connectors.iscsi [None req-d167bb59-e52c-4412-b12a-2107fd4b7c49 tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 23:33:56 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b2a3b04-13be-4853-822c-29c416757252 -p 172.16.0.220:3260 {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:33:56 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b2a3b04-13be-4853-822c-29c416757252 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:33:56 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[81bc8cda-c652-4863-98af-2459195386c9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:33:56 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-d167bb59-e52c-4412-b12a-2107fd4b7c49 tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 23:33:56 user nova-compute[75045]:  {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:33:56 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b2a3b04-13be-4853-822c-29c416757252 -p 172.16.0.220:3260 --interface default --op new {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:33:56 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b2a3b04-13be-4853-822c-29c416757252 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.027s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:33:56 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[acc06d10-16e8-4912-a808-a77e7f4f816e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1b2a3b04-13be-4853-822c-29c416757252] added\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:33:56 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-d167bb59-e52c-4412-b12a-2107fd4b7c49 tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1b2a3b04-13be-4853-822c-29c416757252] added
Nov 08 23:33:56 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:33:56 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b2a3b04-13be-4853-822c-29c416757252 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:33:56 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b2a3b04-13be-4853-822c-29c416757252 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:33:56 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[228068a6-b278-45c0-8ef2-42c7425d3786]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:33:56 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-d167bb59-e52c-4412-b12a-2107fd4b7c49 tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:33:56 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b2a3b04-13be-4853-822c-29c416757252 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:33:56 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b2a3b04-13be-4853-822c-29c416757252 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.029s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:33:56 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2905a27-9a95-47d3-9d5c-97b0f3fcb810]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:33:56 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-d167bb59-e52c-4412-b12a-2107fd4b7c49 tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:33:56 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b2a3b04-13be-4853-822c-29c416757252 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MAhTqXGu {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:33:56 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b2a3b04-13be-4853-822c-29c416757252 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MAhTqXGu" returned: 0 in 0.029s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:33:56 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[80f4b18f-2489-4a9a-bdc6-21cc80c195c9]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:33:56 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-d167bb59-e52c-4412-b12a-2107fd4b7c49 tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'MAhTqXGu'): stdout= stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:33:56 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b2a3b04-13be-4853-822c-29c416757252 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:33:56 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b2a3b04-13be-4853-822c-29c416757252 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:33:56 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bee0089-f616-4153-84fb-fb54a388a589]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:33:56 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-d167bb59-e52c-4412-b12a-2107fd4b7c49 tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:33:56 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:33:56 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:33:56 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[11aadfd7-2a56-4ee6-9acc-f034e9096496]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83187c89-e833-4efd-afa0-2cbfe05d8db1 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9c3ac6d-d72a-41c8-9c18-15131250e323 (non-flash)\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:33:56 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-d167bb59-e52c-4412-b12a-2107fd4b7c49 tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab (non-flash)
Nov 08 23:33:56 user nova-compute[75045]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83187c89-e833-4efd-afa0-2cbfe05d8db1 (non-flash)
Nov 08 23:33:56 user nova-compute[75045]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9c3ac6d-d72a-41c8-9c18-15131250e323 (non-flash)
Nov 08 23:33:56 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 23:33:56 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-d167bb59-e52c-4412-b12a-2107fd4b7c49 tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab (non-flash)
Nov 08 23:33:56 user nova-compute[75045]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83187c89-e833-4efd-afa0-2cbfe05d8db1 (non-flash)
Nov 08 23:33:56 user nova-compute[75045]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9c3ac6d-d72a-41c8-9c18-15131250e323 (non-flash)
Nov 08 23:33:56 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 23:33:56 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b2a3b04-13be-4853-822c-29c416757252 -p 172.16.0.220:3260 --login {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:33:56 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:33:56 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b2a3b04-13be-4853-822c-29c416757252 -p 172.16.0.220:3260 --login" returned: 0 in 0.077s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:33:56 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[b592531b-fa8e-49f5-8b6f-5a0c0c1b3487]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1b2a3b04-13be-4853-822c-29c416757252, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1b2a3b04-13be-4853-822c-29c416757252, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:33:56 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-d167bb59-e52c-4412-b12a-2107fd4b7c49 tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1b2a3b04-13be-4853-822c-29c416757252, portal: 172.16.0.220,3260]
Nov 08 23:33:56 user nova-compute[75045]: Login to [iface: default, target: iqn.2010-10.org.openstack:1b2a3b04-13be-4853-822c-29c416757252, portal: 172.16.0.220,3260] successful.
Nov 08 23:33:56 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:33:56 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b2a3b04-13be-4853-822c-29c416757252 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:33:56 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b2a3b04-13be-4853-822c-29c416757252 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:33:56 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[53098405-65e0-4632-8b48-26478c80c610]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:33:56 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-d167bb59-e52c-4412-b12a-2107fd4b7c49 tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:33:56 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:33:56 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:33:56 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a9f9ce3-e768-463d-8e94-b30ae13c2a54]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83187c89-e833-4efd-afa0-2cbfe05d8db1 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9c3ac6d-d72a-41c8-9c18-15131250e323 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b2a3b04-13be-4853-822c-29c416757252 (non-flash)\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:33:56 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-d167bb59-e52c-4412-b12a-2107fd4b7c49 tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab (non-flash)
Nov 08 23:33:56 user nova-compute[75045]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83187c89-e833-4efd-afa0-2cbfe05d8db1 (non-flash)
Nov 08 23:33:56 user nova-compute[75045]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9c3ac6d-d72a-41c8-9c18-15131250e323 (non-flash)
Nov 08 23:33:56 user nova-compute[75045]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b2a3b04-13be-4853-822c-29c416757252 (non-flash)
Nov 08 23:33:56 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 23:33:56 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-d167bb59-e52c-4412-b12a-2107fd4b7c49 tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab (non-flash)
Nov 08 23:33:56 user nova-compute[75045]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83187c89-e833-4efd-afa0-2cbfe05d8db1 (non-flash)
Nov 08 23:33:56 user nova-compute[75045]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9c3ac6d-d72a-41c8-9c18-15131250e323 (non-flash)
Nov 08 23:33:56 user nova-compute[75045]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b2a3b04-13be-4853-822c-29c416757252 (non-flash)
Nov 08 23:33:56 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 23:33:56 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-d167bb59-e52c-4412-b12a-2107fd4b7c49 tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1b2a3b04-13be-4853-822c-29c416757252" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.366s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 23:33:56 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-d167bb59-e52c-4412-b12a-2107fd4b7c49 tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] Connected to 172.16.0.220:3260 {{(pid=75045) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 23:33:56 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-d167bb59-e52c-4412-b12a-2107fd4b7c49 tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] HCTL ('33', '-', '-', 0) found on session 34 with lun 0 {{(pid=75045) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 23:33:56 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-d167bb59-e52c-4412-b12a-2107fd4b7c49 tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75045) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 23:33:56 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:33:56 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.024s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:33:56 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[7973220a-15b0-4ea3-ae76-4d1c5e782fe5]: (4, ('- - 0', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:33:56 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-d167bb59-e52c-4412-b12a-2107fd4b7c49 tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] Searching for a device in session 34 and hctl ['33', '*', '*', 0] yield: None {{(pid=75045) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 23:33:57 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-d167bb59-e52c-4412-b12a-2107fd4b7c49 tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] Searching for a device in session 34 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75045) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 23:33:57 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-d167bb59-e52c-4412-b12a-2107fd4b7c49 tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:1b2a3b04-13be-4853-822c-29c416757252', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MAhTqXGu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75045) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 23:33:57 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-d167bb59-e52c-4412-b12a-2107fd4b7c49 tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.410s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 23:33:57 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-d167bb59-e52c-4412-b12a-2107fd4b7c49 tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] <== connect_volume: return (1412ms) {'type': 'block', 'scsi_wwn': '23336323134313038', 'path': '/dev/sdb'} {{(pid=75045) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 23:33:57 user nova-compute[75045]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d167bb59-e52c-4412-b12a-2107fd4b7c49 tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] [instance: 9222e62a-9fd8-48b2-a125-83c9cdc589bd] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23336323134313038', 'path': '/dev/sdb'} {{(pid=75045) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 23:33:57 user nova-compute[75045]: DEBUG nova.objects.instance [None req-d167bb59-e52c-4412-b12a-2107fd4b7c49 tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] Lazy-loading 'flavor' on Instance uuid 9222e62a-9fd8-48b2-a125-83c9cdc589bd {{(pid=75045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 23:33:57 user nova-compute[75045]: DEBUG nova.virt.libvirt.guest [None req-d167bb59-e52c-4412-b12a-2107fd4b7c49 tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] attach device xml: <disk type="block" device="disk">
Nov 08 23:33:57 user nova-compute[75045]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 23:33:57 user nova-compute[75045]:   <source dev="/dev/sdb"/>
Nov 08 23:33:57 user nova-compute[75045]:   <target dev="vdb" bus="virtio"/>
Nov 08 23:33:57 user nova-compute[75045]:   <serial>1b2a3b04-13be-4853-822c-29c416757252</serial>
Nov 08 23:33:57 user nova-compute[75045]: </disk>
Nov 08 23:33:57 user nova-compute[75045]:  {{(pid=75045) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 08 23:33:58 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-d167bb59-e52c-4412-b12a-2107fd4b7c49 tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] No BDM found with device name vda, not building metadata. {{(pid=75045) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 23:33:58 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-d167bb59-e52c-4412-b12a-2107fd4b7c49 tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75045) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 23:33:58 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-d167bb59-e52c-4412-b12a-2107fd4b7c49 tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] No VIF found with MAC fa:16:3e:a4:11:9a, not building metadata {{(pid=75045) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 23:33:58 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-d167bb59-e52c-4412-b12a-2107fd4b7c49 tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] Lock "9222e62a-9fd8-48b2-a125-83c9cdc589bd" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 36.697s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:33:59 user nova-compute[75045]: INFO nova.compute.manager [None req-7a605092-17e8-460d-b045-eaf465ec7f4b tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] [instance: 9222e62a-9fd8-48b2-a125-83c9cdc589bd] Rescuing
Nov 08 23:33:59 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-7a605092-17e8-460d-b045-eaf465ec7f4b tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] Acquiring lock "refresh_cache-9222e62a-9fd8-48b2-a125-83c9cdc589bd" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 23:33:59 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-7a605092-17e8-460d-b045-eaf465ec7f4b tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] Acquired lock "refresh_cache-9222e62a-9fd8-48b2-a125-83c9cdc589bd" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 23:33:59 user nova-compute[75045]: DEBUG nova.network.neutron [None req-7a605092-17e8-460d-b045-eaf465ec7f4b tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] [instance: 9222e62a-9fd8-48b2-a125-83c9cdc589bd] Building network info cache for instance {{(pid=75045) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 23:33:59 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:33:59 user nova-compute[75045]: DEBUG nova.network.neutron [None req-7a605092-17e8-460d-b045-eaf465ec7f4b tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] [instance: 9222e62a-9fd8-48b2-a125-83c9cdc589bd] Updating instance_info_cache with network_info: [{"id": "5dae7844-411c-47aa-ba3e-bc209136f0a6", "address": "fa:16:3e:a4:11:9a", "network": {"id": "08d1669a-f667-4c79-8e49-0ad183f57046", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1863648032-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.156", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bbb640407ef94f568aea892f1834d6d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5dae7844-41", "ovs_interfaceid": "5dae7844-411c-47aa-ba3e-bc209136f0a6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75045) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 23:33:59 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-7a605092-17e8-460d-b045-eaf465ec7f4b tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] Releasing lock "refresh_cache-9222e62a-9fd8-48b2-a125-83c9cdc589bd" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 23:34:00 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:34:00 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:34:00 user nova-compute[75045]: DEBUG nova.compute.manager [req-d7a3a3cc-8c59-4082-9d5a-2b720952f9cc req-6445241a-7996-46f3-9e0d-469c7c583c5a service nova] [instance: 9222e62a-9fd8-48b2-a125-83c9cdc589bd] Received event network-vif-unplugged-5dae7844-411c-47aa-ba3e-bc209136f0a6 {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:34:00 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-d7a3a3cc-8c59-4082-9d5a-2b720952f9cc req-6445241a-7996-46f3-9e0d-469c7c583c5a service nova] Acquiring lock "9222e62a-9fd8-48b2-a125-83c9cdc589bd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:34:00 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-d7a3a3cc-8c59-4082-9d5a-2b720952f9cc req-6445241a-7996-46f3-9e0d-469c7c583c5a service nova] Lock "9222e62a-9fd8-48b2-a125-83c9cdc589bd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:34:00 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-d7a3a3cc-8c59-4082-9d5a-2b720952f9cc req-6445241a-7996-46f3-9e0d-469c7c583c5a service nova] Lock "9222e62a-9fd8-48b2-a125-83c9cdc589bd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:34:00 user nova-compute[75045]: DEBUG nova.compute.manager [req-d7a3a3cc-8c59-4082-9d5a-2b720952f9cc req-6445241a-7996-46f3-9e0d-469c7c583c5a service nova] [instance: 9222e62a-9fd8-48b2-a125-83c9cdc589bd] No waiting events found dispatching network-vif-unplugged-5dae7844-411c-47aa-ba3e-bc209136f0a6 {{(pid=75045) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 23:34:00 user nova-compute[75045]: WARNING nova.compute.manager [req-d7a3a3cc-8c59-4082-9d5a-2b720952f9cc req-6445241a-7996-46f3-9e0d-469c7c583c5a service nova] [instance: 9222e62a-9fd8-48b2-a125-83c9cdc589bd] Received unexpected event network-vif-unplugged-5dae7844-411c-47aa-ba3e-bc209136f0a6 for instance with vm_state active and task_state rescuing.
Nov 08 23:34:00 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:34:00 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:34:00 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:34:00 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:34:01 user nova-compute[75045]: INFO nova.virt.libvirt.driver [-] [instance: 9222e62a-9fd8-48b2-a125-83c9cdc589bd] Instance destroyed successfully.
Nov 08 23:34:01 user nova-compute[75045]: INFO nova.virt.libvirt.driver [None req-7a605092-17e8-460d-b045-eaf465ec7f4b tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] [instance: 9222e62a-9fd8-48b2-a125-83c9cdc589bd] Attempting rescue
Nov 08 23:34:01 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-7a605092-17e8-460d-b045-eaf465ec7f4b tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75045) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 08 23:34:01 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-7a605092-17e8-460d-b045-eaf465ec7f4b tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] [instance: 9222e62a-9fd8-48b2-a125-83c9cdc589bd] Instance directory exists: not creating {{(pid=75045) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 08 23:34:01 user nova-compute[75045]: INFO nova.virt.libvirt.driver [None req-7a605092-17e8-460d-b045-eaf465ec7f4b tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] [instance: 9222e62a-9fd8-48b2-a125-83c9cdc589bd] Creating image(s)
Nov 08 23:34:01 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-7a605092-17e8-460d-b045-eaf465ec7f4b tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] Acquiring lock "/opt/stack/data/nova/instances/9222e62a-9fd8-48b2-a125-83c9cdc589bd/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:34:01 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-7a605092-17e8-460d-b045-eaf465ec7f4b tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] Lock "/opt/stack/data/nova/instances/9222e62a-9fd8-48b2-a125-83c9cdc589bd/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:34:01 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-7a605092-17e8-460d-b045-eaf465ec7f4b tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] Lock "/opt/stack/data/nova/instances/9222e62a-9fd8-48b2-a125-83c9cdc589bd/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:34:01 user nova-compute[75045]: DEBUG nova.objects.instance [None req-7a605092-17e8-460d-b045-eaf465ec7f4b tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] Lazy-loading 'trusted_certs' on Instance uuid 9222e62a-9fd8-48b2-a125-83c9cdc589bd {{(pid=75045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 23:34:01 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-7a605092-17e8-460d-b045-eaf465ec7f4b tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] Acquiring lock "b59f52a99fff51c56dd1edfb83892fb8f647f2f3" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:34:01 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-7a605092-17e8-460d-b045-eaf465ec7f4b tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] Lock "b59f52a99fff51c56dd1edfb83892fb8f647f2f3" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:34:01 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-7a605092-17e8-460d-b045-eaf465ec7f4b tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b59f52a99fff51c56dd1edfb83892fb8f647f2f3 --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:34:01 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-7a605092-17e8-460d-b045-eaf465ec7f4b tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b59f52a99fff51c56dd1edfb83892fb8f647f2f3 --force-share --output=json" returned: 0 in 0.185s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:34:01 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-7a605092-17e8-460d-b045-eaf465ec7f4b tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b59f52a99fff51c56dd1edfb83892fb8f647f2f3,backing_fmt=raw /opt/stack/data/nova/instances/9222e62a-9fd8-48b2-a125-83c9cdc589bd/disk.rescue {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:34:01 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-7a605092-17e8-460d-b045-eaf465ec7f4b tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b59f52a99fff51c56dd1edfb83892fb8f647f2f3,backing_fmt=raw /opt/stack/data/nova/instances/9222e62a-9fd8-48b2-a125-83c9cdc589bd/disk.rescue" returned: 0 in 0.049s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:34:01 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-7a605092-17e8-460d-b045-eaf465ec7f4b tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] Lock "b59f52a99fff51c56dd1edfb83892fb8f647f2f3" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.242s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:34:01 user nova-compute[75045]: DEBUG nova.objects.instance [None req-7a605092-17e8-460d-b045-eaf465ec7f4b tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] Lazy-loading 'migration_context' on Instance uuid 9222e62a-9fd8-48b2-a125-83c9cdc589bd {{(pid=75045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 23:34:01 user nova-compute[75045]: DEBUG nova.objects.base [None req-7a605092-17e8-460d-b045-eaf465ec7f4b tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] Object Instance<9222e62a-9fd8-48b2-a125-83c9cdc589bd> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75045) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 23:34:01 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-7a605092-17e8-460d-b045-eaf465ec7f4b tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] [instance: 9222e62a-9fd8-48b2-a125-83c9cdc589bd] Created local disks {{(pid=75045) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 23:34:01 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-7a605092-17e8-460d-b045-eaf465ec7f4b tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] [instance: 9222e62a-9fd8-48b2-a125-83c9cdc589bd] Start _get_guest_xml network_info=[{"id": "5dae7844-411c-47aa-ba3e-bc209136f0a6", "address": "fa:16:3e:a4:11:9a", "network": {"id": "08d1669a-f667-4c79-8e49-0ad183f57046", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1863648032-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.156", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1863648032-network", "vif_mac": "fa:16:3e:a4:11:9a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bbb640407ef94f568aea892f1834d6d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5dae7844-41", "ovs_interfaceid": "5dae7844-411c-47aa-ba3e-bc209136f0a6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T23:11:54Z,direct_url=<?>,disk_format='qcow2',id=a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b1beba2cc4e7465ea249e2225fb494dc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T23:11:56Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=75045) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 23:34:01 user nova-compute[75045]: DEBUG nova.objects.instance [None req-7a605092-17e8-460d-b045-eaf465ec7f4b tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] Lazy-loading 'resources' on Instance uuid 9222e62a-9fd8-48b2-a125-83c9cdc589bd {{(pid=75045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 23:34:01 user nova-compute[75045]: DEBUG nova.objects.base [None req-7a605092-17e8-460d-b045-eaf465ec7f4b tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] Object Instance<9222e62a-9fd8-48b2-a125-83c9cdc589bd> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75045) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 23:34:01 user nova-compute[75045]: DEBUG nova.objects.instance [None req-7a605092-17e8-460d-b045-eaf465ec7f4b tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] Lazy-loading 'numa_topology' on Instance uuid 9222e62a-9fd8-48b2-a125-83c9cdc589bd {{(pid=75045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 23:34:01 user nova-compute[75045]: DEBUG nova.objects.base [None req-7a605092-17e8-460d-b045-eaf465ec7f4b tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] Object Instance<9222e62a-9fd8-48b2-a125-83c9cdc589bd> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75045) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 23:34:01 user nova-compute[75045]: WARNING nova.virt.libvirt.driver [None req-7a605092-17e8-460d-b045-eaf465ec7f4b tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 23:34:01 user nova-compute[75045]: WARNING nova.virt.libvirt.driver [None req-7a605092-17e8-460d-b045-eaf465ec7f4b tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 23:34:01 user nova-compute[75045]: DEBUG nova.virt.libvirt.host [None req-7a605092-17e8-460d-b045-eaf465ec7f4b tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75045) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 23:34:01 user nova-compute[75045]: DEBUG nova.virt.libvirt.host [None req-7a605092-17e8-460d-b045-eaf465ec7f4b tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] CPU controller missing on host. {{(pid=75045) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 23:34:01 user nova-compute[75045]: DEBUG nova.virt.libvirt.host [None req-7a605092-17e8-460d-b045-eaf465ec7f4b tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75045) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 23:34:01 user nova-compute[75045]: DEBUG nova.virt.libvirt.host [None req-7a605092-17e8-460d-b045-eaf465ec7f4b tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] CPU controller found on host. {{(pid=75045) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 23:34:01 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-7a605092-17e8-460d-b045-eaf465ec7f4b tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75045) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 23:34:01 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-7a605092-17e8-460d-b045-eaf465ec7f4b tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T23:11:41Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T23:11:54Z,direct_url=<?>,disk_format='qcow2',id=a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b1beba2cc4e7465ea249e2225fb494dc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T23:11:56Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75045) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 23:34:01 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-7a605092-17e8-460d-b045-eaf465ec7f4b tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] Flavor limits 0:0:0 {{(pid=75045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 23:34:01 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-7a605092-17e8-460d-b045-eaf465ec7f4b tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] Image limits 0:0:0 {{(pid=75045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 23:34:01 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-7a605092-17e8-460d-b045-eaf465ec7f4b tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] Flavor pref 0:0:0 {{(pid=75045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 23:34:01 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-7a605092-17e8-460d-b045-eaf465ec7f4b tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] Image pref 0:0:0 {{(pid=75045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 23:34:01 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-7a605092-17e8-460d-b045-eaf465ec7f4b tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 23:34:01 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-7a605092-17e8-460d-b045-eaf465ec7f4b tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75045) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 23:34:01 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-7a605092-17e8-460d-b045-eaf465ec7f4b tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75045) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 23:34:01 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-7a605092-17e8-460d-b045-eaf465ec7f4b tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] Got 1 possible topologies {{(pid=75045) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 23:34:01 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-7a605092-17e8-460d-b045-eaf465ec7f4b tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75045) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 23:34:01 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-7a605092-17e8-460d-b045-eaf465ec7f4b tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75045) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 23:34:01 user nova-compute[75045]: DEBUG nova.objects.instance [None req-7a605092-17e8-460d-b045-eaf465ec7f4b tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] Lazy-loading 'vcpu_model' on Instance uuid 9222e62a-9fd8-48b2-a125-83c9cdc589bd {{(pid=75045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 23:34:01 user nova-compute[75045]: DEBUG nova.objects.base [None req-7a605092-17e8-460d-b045-eaf465ec7f4b tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] Object Instance<9222e62a-9fd8-48b2-a125-83c9cdc589bd> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75045) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 23:34:01 user nova-compute[75045]: DEBUG nova.virt.libvirt.vif [None req-7a605092-17e8-460d-b045-eaf465ec7f4b tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T23:31:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-419578876',display_name='tempest-ServerRescueNegativeTestJSON-server-419578876',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-419578876',id=32,image_ref='a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE8xPLrIBEJgewpGKZ9+DADirH1va8Jw2TK7fJYueqPBCf/b4zQxE+KZaoScWKrWN36A5mrbfEJVAf2HqeXPqc0l3rzXsv0urNXE5MLSGsJKkp23YT6dxav8ybWtbSI0/w==',key_name='tempest-keypair-175527667',keypairs=<?>,launch_index=0,launched_at=2023-11-08T23:31:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bbb640407ef94f568aea892f1834d6d1',ramdisk_id='',reservation_id='r-vju4zt3n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-187452128',owner_user_name='tempest-ServerRescueNegativeTestJSON-187452128-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T23:31:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f16e465ffb49488db3de445a473fd77a',uuid=9222e62a-9fd8-48b2-a125-83c9cdc589bd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5dae7844-411c-47aa-ba3e-bc209136f0a6", "address": "fa:16:3e:a4:11:9a", "network": {"id": "08d1669a-f667-4c79-8e49-0ad183f57046", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1863648032-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.156", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1863648032-network", "vif_mac": "fa:16:3e:a4:11:9a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bbb640407ef94f568aea892f1834d6d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5dae7844-41", "ovs_interfaceid": "5dae7844-411c-47aa-ba3e-bc209136f0a6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75045) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 23:34:01 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-7a605092-17e8-460d-b045-eaf465ec7f4b tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] Converting VIF {"id": "5dae7844-411c-47aa-ba3e-bc209136f0a6", "address": "fa:16:3e:a4:11:9a", "network": {"id": "08d1669a-f667-4c79-8e49-0ad183f57046", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1863648032-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.156", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1863648032-network", "vif_mac": "fa:16:3e:a4:11:9a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bbb640407ef94f568aea892f1834d6d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5dae7844-41", "ovs_interfaceid": "5dae7844-411c-47aa-ba3e-bc209136f0a6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 23:34:01 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-7a605092-17e8-460d-b045-eaf465ec7f4b tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a4:11:9a,bridge_name='br-int',has_traffic_filtering=True,id=5dae7844-411c-47aa-ba3e-bc209136f0a6,network=Network(08d1669a-f667-4c79-8e49-0ad183f57046),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5dae7844-41') {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 23:34:01 user nova-compute[75045]: DEBUG nova.objects.instance [None req-7a605092-17e8-460d-b045-eaf465ec7f4b tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] Lazy-loading 'pci_devices' on Instance uuid 9222e62a-9fd8-48b2-a125-83c9cdc589bd {{(pid=75045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 23:34:01 user nova-compute[75045]: DEBUG nova.objects.base [None req-7a605092-17e8-460d-b045-eaf465ec7f4b tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] Object Instance<9222e62a-9fd8-48b2-a125-83c9cdc589bd> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75045) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 23:34:01 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-7a605092-17e8-460d-b045-eaf465ec7f4b tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] [instance: 9222e62a-9fd8-48b2-a125-83c9cdc589bd] End _get_guest_xml xml=<domain type="kvm">
Nov 08 23:34:01 user nova-compute[75045]:   <uuid>9222e62a-9fd8-48b2-a125-83c9cdc589bd</uuid>
Nov 08 23:34:01 user nova-compute[75045]:   <name>instance-00000020</name>
Nov 08 23:34:01 user nova-compute[75045]:   <memory>524288</memory>
Nov 08 23:34:01 user nova-compute[75045]:   <vcpu>1</vcpu>
Nov 08 23:34:01 user nova-compute[75045]:   <metadata>
Nov 08 23:34:01 user nova-compute[75045]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 23:34:01 user nova-compute[75045]:       <nova:package version="0.0.0"/>
Nov 08 23:34:01 user nova-compute[75045]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-419578876</nova:name>
Nov 08 23:34:01 user nova-compute[75045]:       <nova:creationTime>2023-11-08 23:34:01</nova:creationTime>
Nov 08 23:34:01 user nova-compute[75045]:       <nova:flavor name="m1.tiny">
Nov 08 23:34:01 user nova-compute[75045]:         <nova:memory>512</nova:memory>
Nov 08 23:34:01 user nova-compute[75045]:         <nova:disk>1</nova:disk>
Nov 08 23:34:01 user nova-compute[75045]:         <nova:swap>0</nova:swap>
Nov 08 23:34:01 user nova-compute[75045]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 23:34:01 user nova-compute[75045]:         <nova:vcpus>1</nova:vcpus>
Nov 08 23:34:01 user nova-compute[75045]:       </nova:flavor>
Nov 08 23:34:01 user nova-compute[75045]:       <nova:owner>
Nov 08 23:34:01 user nova-compute[75045]:         <nova:user uuid="f16e465ffb49488db3de445a473fd77a">tempest-ServerRescueNegativeTestJSON-187452128-project-member</nova:user>
Nov 08 23:34:01 user nova-compute[75045]:         <nova:project uuid="bbb640407ef94f568aea892f1834d6d1">tempest-ServerRescueNegativeTestJSON-187452128</nova:project>
Nov 08 23:34:01 user nova-compute[75045]:       </nova:owner>
Nov 08 23:34:01 user nova-compute[75045]:       <nova:root type="image" uuid="a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb"/>
Nov 08 23:34:01 user nova-compute[75045]:       <nova:ports>
Nov 08 23:34:01 user nova-compute[75045]:         <nova:port uuid="5dae7844-411c-47aa-ba3e-bc209136f0a6">
Nov 08 23:34:01 user nova-compute[75045]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 08 23:34:01 user nova-compute[75045]:         </nova:port>
Nov 08 23:34:01 user nova-compute[75045]:       </nova:ports>
Nov 08 23:34:01 user nova-compute[75045]:     </nova:instance>
Nov 08 23:34:01 user nova-compute[75045]:   </metadata>
Nov 08 23:34:01 user nova-compute[75045]:   <sysinfo type="smbios">
Nov 08 23:34:01 user nova-compute[75045]:     <system>
Nov 08 23:34:01 user nova-compute[75045]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 23:34:01 user nova-compute[75045]:       <entry name="product">OpenStack Nova</entry>
Nov 08 23:34:01 user nova-compute[75045]:       <entry name="version">0.0.0</entry>
Nov 08 23:34:01 user nova-compute[75045]:       <entry name="serial">9222e62a-9fd8-48b2-a125-83c9cdc589bd</entry>
Nov 08 23:34:01 user nova-compute[75045]:       <entry name="uuid">9222e62a-9fd8-48b2-a125-83c9cdc589bd</entry>
Nov 08 23:34:01 user nova-compute[75045]:       <entry name="family">Virtual Machine</entry>
Nov 08 23:34:01 user nova-compute[75045]:     </system>
Nov 08 23:34:01 user nova-compute[75045]:   </sysinfo>
Nov 08 23:34:01 user nova-compute[75045]:   <os>
Nov 08 23:34:01 user nova-compute[75045]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 23:34:01 user nova-compute[75045]:     <smbios mode="sysinfo"/>
Nov 08 23:34:01 user nova-compute[75045]:   </os>
Nov 08 23:34:01 user nova-compute[75045]:   <features>
Nov 08 23:34:01 user nova-compute[75045]:     <acpi/>
Nov 08 23:34:01 user nova-compute[75045]:     <apic/>
Nov 08 23:34:01 user nova-compute[75045]:     <vmcoreinfo/>
Nov 08 23:34:01 user nova-compute[75045]:   </features>
Nov 08 23:34:01 user nova-compute[75045]:   <clock offset="utc">
Nov 08 23:34:01 user nova-compute[75045]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 23:34:01 user nova-compute[75045]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 23:34:01 user nova-compute[75045]:     <timer name="hpet" present="no"/>
Nov 08 23:34:01 user nova-compute[75045]:   </clock>
Nov 08 23:34:01 user nova-compute[75045]:   <cpu mode="custom" match="exact">
Nov 08 23:34:01 user nova-compute[75045]:     <model>Nehalem</model>
Nov 08 23:34:01 user nova-compute[75045]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 23:34:01 user nova-compute[75045]:   </cpu>
Nov 08 23:34:01 user nova-compute[75045]:   <devices>
Nov 08 23:34:01 user nova-compute[75045]:     <disk type="file" device="disk">
Nov 08 23:34:01 user nova-compute[75045]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 23:34:01 user nova-compute[75045]:       <source file="/opt/stack/data/nova/instances/9222e62a-9fd8-48b2-a125-83c9cdc589bd/disk.rescue"/>
Nov 08 23:34:01 user nova-compute[75045]:       <target dev="vda" bus="virtio"/>
Nov 08 23:34:01 user nova-compute[75045]:     </disk>
Nov 08 23:34:01 user nova-compute[75045]:     <disk type="file" device="disk">
Nov 08 23:34:01 user nova-compute[75045]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 23:34:01 user nova-compute[75045]:       <source file="/opt/stack/data/nova/instances/9222e62a-9fd8-48b2-a125-83c9cdc589bd/disk"/>
Nov 08 23:34:01 user nova-compute[75045]:       <target dev="vdb" bus="virtio"/>
Nov 08 23:34:01 user nova-compute[75045]:     </disk>
Nov 08 23:34:01 user nova-compute[75045]:     <interface type="ethernet">
Nov 08 23:34:01 user nova-compute[75045]:       <mac address="fa:16:3e:a4:11:9a"/>
Nov 08 23:34:01 user nova-compute[75045]:       <model type="virtio"/>
Nov 08 23:34:01 user nova-compute[75045]:       <mtu size="1442"/>
Nov 08 23:34:01 user nova-compute[75045]:       <target dev="tap5dae7844-41"/>
Nov 08 23:34:01 user nova-compute[75045]:     </interface>
Nov 08 23:34:01 user nova-compute[75045]:     <serial type="pty">
Nov 08 23:34:01 user nova-compute[75045]:       <log file="/opt/stack/data/nova/instances/9222e62a-9fd8-48b2-a125-83c9cdc589bd/console.log" append="off"/>
Nov 08 23:34:01 user nova-compute[75045]:     </serial>
Nov 08 23:34:01 user nova-compute[75045]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 23:34:01 user nova-compute[75045]:     <video>
Nov 08 23:34:01 user nova-compute[75045]:       <model type="virtio"/>
Nov 08 23:34:01 user nova-compute[75045]:     </video>
Nov 08 23:34:01 user nova-compute[75045]:     <rng model="virtio">
Nov 08 23:34:01 user nova-compute[75045]:       <backend model="random">/dev/urandom</backend>
Nov 08 23:34:01 user nova-compute[75045]:     </rng>
Nov 08 23:34:01 user nova-compute[75045]:     <controller type="usb" index="0" model="none"/>
Nov 08 23:34:01 user nova-compute[75045]:     <memballoon model="virtio">
Nov 08 23:34:01 user nova-compute[75045]:       <stats period="10"/>
Nov 08 23:34:01 user nova-compute[75045]:     </memballoon>
Nov 08 23:34:01 user nova-compute[75045]:   </devices>
Nov 08 23:34:01 user nova-compute[75045]: </domain>
Nov 08 23:34:01 user nova-compute[75045]:  {{(pid=75045) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 23:34:01 user nova-compute[75045]: INFO nova.virt.libvirt.driver [-] [instance: 9222e62a-9fd8-48b2-a125-83c9cdc589bd] Instance destroyed successfully.
Nov 08 23:34:01 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-7a605092-17e8-460d-b045-eaf465ec7f4b tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] No BDM found with device name vda, not building metadata. {{(pid=75045) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 23:34:01 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-7a605092-17e8-460d-b045-eaf465ec7f4b tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75045) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 23:34:01 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-7a605092-17e8-460d-b045-eaf465ec7f4b tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] No VIF found with MAC fa:16:3e:a4:11:9a, not building metadata {{(pid=75045) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 23:34:02 user nova-compute[75045]: DEBUG nova.compute.manager [req-384152e2-3bf8-434d-ad7e-49c6fe0d6d2d req-41aa2a36-7b4b-4074-9d2c-4efc8174c483 service nova] [instance: 9222e62a-9fd8-48b2-a125-83c9cdc589bd] Received event network-vif-plugged-5dae7844-411c-47aa-ba3e-bc209136f0a6 {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:34:02 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-384152e2-3bf8-434d-ad7e-49c6fe0d6d2d req-41aa2a36-7b4b-4074-9d2c-4efc8174c483 service nova] Acquiring lock "9222e62a-9fd8-48b2-a125-83c9cdc589bd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:34:02 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-384152e2-3bf8-434d-ad7e-49c6fe0d6d2d req-41aa2a36-7b4b-4074-9d2c-4efc8174c483 service nova] Lock "9222e62a-9fd8-48b2-a125-83c9cdc589bd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:34:02 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-384152e2-3bf8-434d-ad7e-49c6fe0d6d2d req-41aa2a36-7b4b-4074-9d2c-4efc8174c483 service nova] Lock "9222e62a-9fd8-48b2-a125-83c9cdc589bd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:34:02 user nova-compute[75045]: DEBUG nova.compute.manager [req-384152e2-3bf8-434d-ad7e-49c6fe0d6d2d req-41aa2a36-7b4b-4074-9d2c-4efc8174c483 service nova] [instance: 9222e62a-9fd8-48b2-a125-83c9cdc589bd] No waiting events found dispatching network-vif-plugged-5dae7844-411c-47aa-ba3e-bc209136f0a6 {{(pid=75045) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 23:34:02 user nova-compute[75045]: WARNING nova.compute.manager [req-384152e2-3bf8-434d-ad7e-49c6fe0d6d2d req-41aa2a36-7b4b-4074-9d2c-4efc8174c483 service nova] [instance: 9222e62a-9fd8-48b2-a125-83c9cdc589bd] Received unexpected event network-vif-plugged-5dae7844-411c-47aa-ba3e-bc209136f0a6 for instance with vm_state active and task_state rescuing.
Nov 08 23:34:02 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:34:02 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:34:02 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:34:02 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:34:03 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:34:04 user nova-compute[75045]: DEBUG nova.compute.manager [req-30cb695b-909b-4f3c-80d6-c857f62fc585 req-4c27eb0b-b408-4bca-a05a-585d5dd34ad3 service nova] [instance: 9222e62a-9fd8-48b2-a125-83c9cdc589bd] Received event network-vif-plugged-5dae7844-411c-47aa-ba3e-bc209136f0a6 {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:34:04 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-30cb695b-909b-4f3c-80d6-c857f62fc585 req-4c27eb0b-b408-4bca-a05a-585d5dd34ad3 service nova] Acquiring lock "9222e62a-9fd8-48b2-a125-83c9cdc589bd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:34:04 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-30cb695b-909b-4f3c-80d6-c857f62fc585 req-4c27eb0b-b408-4bca-a05a-585d5dd34ad3 service nova] Lock "9222e62a-9fd8-48b2-a125-83c9cdc589bd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:34:04 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-30cb695b-909b-4f3c-80d6-c857f62fc585 req-4c27eb0b-b408-4bca-a05a-585d5dd34ad3 service nova] Lock "9222e62a-9fd8-48b2-a125-83c9cdc589bd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:34:04 user nova-compute[75045]: DEBUG nova.compute.manager [req-30cb695b-909b-4f3c-80d6-c857f62fc585 req-4c27eb0b-b408-4bca-a05a-585d5dd34ad3 service nova] [instance: 9222e62a-9fd8-48b2-a125-83c9cdc589bd] No waiting events found dispatching network-vif-plugged-5dae7844-411c-47aa-ba3e-bc209136f0a6 {{(pid=75045) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 23:34:04 user nova-compute[75045]: WARNING nova.compute.manager [req-30cb695b-909b-4f3c-80d6-c857f62fc585 req-4c27eb0b-b408-4bca-a05a-585d5dd34ad3 service nova] [instance: 9222e62a-9fd8-48b2-a125-83c9cdc589bd] Received unexpected event network-vif-plugged-5dae7844-411c-47aa-ba3e-bc209136f0a6 for instance with vm_state active and task_state rescuing.
Nov 08 23:34:04 user nova-compute[75045]: DEBUG nova.compute.manager [req-30cb695b-909b-4f3c-80d6-c857f62fc585 req-4c27eb0b-b408-4bca-a05a-585d5dd34ad3 service nova] [instance: 9222e62a-9fd8-48b2-a125-83c9cdc589bd] Received event network-vif-plugged-5dae7844-411c-47aa-ba3e-bc209136f0a6 {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:34:04 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-30cb695b-909b-4f3c-80d6-c857f62fc585 req-4c27eb0b-b408-4bca-a05a-585d5dd34ad3 service nova] Acquiring lock "9222e62a-9fd8-48b2-a125-83c9cdc589bd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:34:04 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-30cb695b-909b-4f3c-80d6-c857f62fc585 req-4c27eb0b-b408-4bca-a05a-585d5dd34ad3 service nova] Lock "9222e62a-9fd8-48b2-a125-83c9cdc589bd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:34:04 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-30cb695b-909b-4f3c-80d6-c857f62fc585 req-4c27eb0b-b408-4bca-a05a-585d5dd34ad3 service nova] Lock "9222e62a-9fd8-48b2-a125-83c9cdc589bd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:34:04 user nova-compute[75045]: DEBUG nova.compute.manager [req-30cb695b-909b-4f3c-80d6-c857f62fc585 req-4c27eb0b-b408-4bca-a05a-585d5dd34ad3 service nova] [instance: 9222e62a-9fd8-48b2-a125-83c9cdc589bd] No waiting events found dispatching network-vif-plugged-5dae7844-411c-47aa-ba3e-bc209136f0a6 {{(pid=75045) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 23:34:04 user nova-compute[75045]: WARNING nova.compute.manager [req-30cb695b-909b-4f3c-80d6-c857f62fc585 req-4c27eb0b-b408-4bca-a05a-585d5dd34ad3 service nova] [instance: 9222e62a-9fd8-48b2-a125-83c9cdc589bd] Received unexpected event network-vif-plugged-5dae7844-411c-47aa-ba3e-bc209136f0a6 for instance with vm_state active and task_state rescuing.
Nov 08 23:34:04 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:34:05 user nova-compute[75045]: DEBUG nova.compute.manager [None req-7a605092-17e8-460d-b045-eaf465ec7f4b tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] [instance: 9222e62a-9fd8-48b2-a125-83c9cdc589bd] Checking state {{(pid=75045) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 23:34:06 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-4879496c-012e-4a4d-97e1-7910402721d0 tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] Acquiring lock "adcffd35-00c7-49db-a72f-d6307a90e123" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:34:06 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-4879496c-012e-4a4d-97e1-7910402721d0 tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] Lock "adcffd35-00c7-49db-a72f-d6307a90e123" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:34:06 user nova-compute[75045]: DEBUG nova.objects.instance [None req-4879496c-012e-4a4d-97e1-7910402721d0 tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] Lazy-loading 'flavor' on Instance uuid adcffd35-00c7-49db-a72f-d6307a90e123 {{(pid=75045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 23:34:06 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:34:06 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-4879496c-012e-4a4d-97e1-7910402721d0 tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] Lock "adcffd35-00c7-49db-a72f-d6307a90e123" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:34:06 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-4879496c-012e-4a4d-97e1-7910402721d0 tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] Acquiring lock "adcffd35-00c7-49db-a72f-d6307a90e123" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:34:06 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-4879496c-012e-4a4d-97e1-7910402721d0 tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] Lock "adcffd35-00c7-49db-a72f-d6307a90e123" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:34:06 user nova-compute[75045]: INFO nova.compute.manager [None req-4879496c-012e-4a4d-97e1-7910402721d0 tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] [instance: adcffd35-00c7-49db-a72f-d6307a90e123] Attaching volume 4fd05cc1-4e93-4804-ab93-57b0435dacea to /dev/vdb
Nov 08 23:34:06 user nova-compute[75045]: DEBUG nova.compute.manager [req-8feff677-f57f-4bee-ba2f-877149bf9f08 req-71796262-9850-4b47-b82e-4ccdef5c40ff service nova] [instance: 9fd7c34a-55e7-4d54-9c60-03a7155a2685] Received event network-changed-b44611d2-ca0a-4e01-b44d-cdf537474195 {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:34:06 user nova-compute[75045]: DEBUG nova.compute.manager [req-8feff677-f57f-4bee-ba2f-877149bf9f08 req-71796262-9850-4b47-b82e-4ccdef5c40ff service nova] [instance: 9fd7c34a-55e7-4d54-9c60-03a7155a2685] Refreshing instance network info cache due to event network-changed-b44611d2-ca0a-4e01-b44d-cdf537474195. {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 23:34:06 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-8feff677-f57f-4bee-ba2f-877149bf9f08 req-71796262-9850-4b47-b82e-4ccdef5c40ff service nova] Acquiring lock "refresh_cache-9fd7c34a-55e7-4d54-9c60-03a7155a2685" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 23:34:06 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-8feff677-f57f-4bee-ba2f-877149bf9f08 req-71796262-9850-4b47-b82e-4ccdef5c40ff service nova] Acquired lock "refresh_cache-9fd7c34a-55e7-4d54-9c60-03a7155a2685" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 23:34:06 user nova-compute[75045]: DEBUG nova.network.neutron [req-8feff677-f57f-4bee-ba2f-877149bf9f08 req-71796262-9850-4b47-b82e-4ccdef5c40ff service nova] [instance: 9fd7c34a-55e7-4d54-9c60-03a7155a2685] Refreshing network info cache for port b44611d2-ca0a-4e01-b44d-cdf537474195 {{(pid=75045) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 23:34:06 user nova-compute[75045]: DEBUG os_brick.utils [None req-4879496c-012e-4a4d-97e1-7910402721d0 tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75045) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 23:34:06 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:34:06 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:34:06 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[118fe741-bdad-43de-953c-f3a9c6cbb5fe]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6217bd6e884\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:34:06 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:34:06 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.021s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:34:06 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4e82ecc-1b19-43a1-9c44-bc88c991620e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:34:06 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:34:06 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:34:06 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[a77cc1c3-6a50-4e5a-8b6e-be11c14f9244]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:34:06 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[1016b64c-cfd7-4f45-b293-025cbbbd0dc0]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:34:06 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-4879496c-012e-4a4d-97e1-7910402721d0 tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] Running cmd (subprocess): nvme version {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:34:07 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-4879496c-012e-4a4d-97e1-7910402721d0 tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] 'nvme version' failed. Not Retrying. {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 23:34:07 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4879496c-012e-4a4d-97e1-7910402721d0 tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] nvme not present on system {{(pid=75045) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 23:34:07 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:34:07 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 23:34:07 user nova-compute[75045]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 23:34:07 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[2adc307c-7a9d-4b86-a310-be3bd7839852]: (4, '') {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:34:07 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.lightos [None req-4879496c-012e-4a4d-97e1-7910402721d0 tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75045) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 23:34:07 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.lightos [None req-4879496c-012e-4a4d-97e1-7910402721d0 tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75045) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 23:34:07 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.lightos [None req-4879496c-012e-4a4d-97e1-7910402721d0 tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] LIGHTOS: no hostnqn found. {{(pid=75045) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 23:34:07 user nova-compute[75045]: DEBUG os_brick.utils [None req-4879496c-012e-4a4d-97e1-7910402721d0 tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] <== get_connector_properties: return (163ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6217bd6e884', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75045) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 23:34:07 user nova-compute[75045]: DEBUG nova.virt.block_device [None req-4879496c-012e-4a4d-97e1-7910402721d0 tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] [instance: adcffd35-00c7-49db-a72f-d6307a90e123] Updating existing volume attachment record: f7bb26b3-6147-4583-9898-63b96f96e005 {{(pid=75045) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 23:34:07 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-6ae1fc52-4f28-4677-8480-6857964b89fe tempest-TestStampPattern-2120781434 tempest-TestStampPattern-2120781434-project-member] Acquiring lock "9fd7c34a-55e7-4d54-9c60-03a7155a2685" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:34:07 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-6ae1fc52-4f28-4677-8480-6857964b89fe tempest-TestStampPattern-2120781434 tempest-TestStampPattern-2120781434-project-member] Lock "9fd7c34a-55e7-4d54-9c60-03a7155a2685" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:34:07 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-6ae1fc52-4f28-4677-8480-6857964b89fe tempest-TestStampPattern-2120781434 tempest-TestStampPattern-2120781434-project-member] Acquiring lock "9fd7c34a-55e7-4d54-9c60-03a7155a2685-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:34:07 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-6ae1fc52-4f28-4677-8480-6857964b89fe tempest-TestStampPattern-2120781434 tempest-TestStampPattern-2120781434-project-member] Lock "9fd7c34a-55e7-4d54-9c60-03a7155a2685-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:34:07 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-6ae1fc52-4f28-4677-8480-6857964b89fe tempest-TestStampPattern-2120781434 tempest-TestStampPattern-2120781434-project-member] Lock "9fd7c34a-55e7-4d54-9c60-03a7155a2685-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:34:07 user nova-compute[75045]: INFO nova.compute.manager [None req-6ae1fc52-4f28-4677-8480-6857964b89fe tempest-TestStampPattern-2120781434 tempest-TestStampPattern-2120781434-project-member] [instance: 9fd7c34a-55e7-4d54-9c60-03a7155a2685] Terminating instance
Nov 08 23:34:07 user nova-compute[75045]: DEBUG nova.compute.manager [None req-6ae1fc52-4f28-4677-8480-6857964b89fe tempest-TestStampPattern-2120781434 tempest-TestStampPattern-2120781434-project-member] [instance: 9fd7c34a-55e7-4d54-9c60-03a7155a2685] Start destroying the instance on the hypervisor. {{(pid=75045) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 23:34:07 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:34:07 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:34:07 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:34:07 user nova-compute[75045]: DEBUG nova.network.neutron [req-8feff677-f57f-4bee-ba2f-877149bf9f08 req-71796262-9850-4b47-b82e-4ccdef5c40ff service nova] [instance: 9fd7c34a-55e7-4d54-9c60-03a7155a2685] Updated VIF entry in instance network info cache for port b44611d2-ca0a-4e01-b44d-cdf537474195. {{(pid=75045) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 23:34:07 user nova-compute[75045]: DEBUG nova.network.neutron [req-8feff677-f57f-4bee-ba2f-877149bf9f08 req-71796262-9850-4b47-b82e-4ccdef5c40ff service nova] [instance: 9fd7c34a-55e7-4d54-9c60-03a7155a2685] Updating instance_info_cache with network_info: [{"id": "b44611d2-ca0a-4e01-b44d-cdf537474195", "address": "fa:16:3e:64:cd:11", "network": {"id": "94c5462e-c9fd-44e6-b02b-9d46156ca7d9", "bridge": "br-int", "label": "tempest-TestStampPattern-1038298369-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "824ed65954dd4eccbe68827aa92fd99f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb44611d2-ca", "ovs_interfaceid": "b44611d2-ca0a-4e01-b44d-cdf537474195", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75045) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 23:34:07 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:34:07 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-8feff677-f57f-4bee-ba2f-877149bf9f08 req-71796262-9850-4b47-b82e-4ccdef5c40ff service nova] Releasing lock "refresh_cache-9fd7c34a-55e7-4d54-9c60-03a7155a2685" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 23:34:07 user nova-compute[75045]: INFO nova.virt.libvirt.driver [-] [instance: 9fd7c34a-55e7-4d54-9c60-03a7155a2685] Instance destroyed successfully.
Nov 08 23:34:07 user nova-compute[75045]: DEBUG nova.objects.instance [None req-6ae1fc52-4f28-4677-8480-6857964b89fe tempest-TestStampPattern-2120781434 tempest-TestStampPattern-2120781434-project-member] Lazy-loading 'resources' on Instance uuid 9fd7c34a-55e7-4d54-9c60-03a7155a2685 {{(pid=75045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 23:34:07 user nova-compute[75045]: DEBUG nova.virt.libvirt.vif [None req-6ae1fc52-4f28-4677-8480-6857964b89fe tempest-TestStampPattern-2120781434 tempest-TestStampPattern-2120781434-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T23:28:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-2132300179',display_name='tempest-TestStampPattern-server-2132300179',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-2132300179',id=30,image_ref='201699ba-9f03-463e-960f-cd2e1c5324e9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEtB72lJ3QT0CbDqyUaMKflPueQqHWlBr/SKULenQ3hS/jygD0NlusOQCbd9nWih3JtFTCaVE0qH0L8SGPLvq+HuEpKiKftv45ffcKHaW5G6qCsZvzG9WD6hpehyxZCg9w==',key_name='tempest-TestStampPattern-276203308',keypairs=<?>,launch_index=0,launched_at=2023-11-08T23:29:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='824ed65954dd4eccbe68827aa92fd99f',ramdisk_id='',reservation_id='r-408nr7q1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='72c9d731-2b35-434c-8463-1cd6c18fbd6a',image_min_disk='1',image_min_ram='0',image_owner_id='824ed65954dd4eccbe68827aa92fd99f',image_owner_project_name='tempest-TestStampPattern-2120781434',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-2120781434-project-member',image_user_id='5aea9d6528d3454eaf0f8b2cc9df7c46',owner_project_name='tempest-TestStampPattern-2120781434',owner_user_name='tempest-TestStampPattern-2120781434-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T23:29:06Z,user_data=None,user_id='5aea9d6528d3454eaf0f8b2cc9df7c46',uuid=9fd7c34a-55e7-4d54-9c60-03a7155a2685,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b44611d2-ca0a-4e01-b44d-cdf537474195", "address": "fa:16:3e:64:cd:11", "network": {"id": "94c5462e-c9fd-44e6-b02b-9d46156ca7d9", "bridge": "br-int", "label": "tempest-TestStampPattern-1038298369-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.206", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "824ed65954dd4eccbe68827aa92fd99f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb44611d2-ca", "ovs_interfaceid": "b44611d2-ca0a-4e01-b44d-cdf537474195", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75045) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 23:34:07 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-6ae1fc52-4f28-4677-8480-6857964b89fe tempest-TestStampPattern-2120781434 tempest-TestStampPattern-2120781434-project-member] Converting VIF {"id": "b44611d2-ca0a-4e01-b44d-cdf537474195", "address": "fa:16:3e:64:cd:11", "network": {"id": "94c5462e-c9fd-44e6-b02b-9d46156ca7d9", "bridge": "br-int", "label": "tempest-TestStampPattern-1038298369-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.206", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "824ed65954dd4eccbe68827aa92fd99f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb44611d2-ca", "ovs_interfaceid": "b44611d2-ca0a-4e01-b44d-cdf537474195", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 23:34:07 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-6ae1fc52-4f28-4677-8480-6857964b89fe tempest-TestStampPattern-2120781434 tempest-TestStampPattern-2120781434-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:64:cd:11,bridge_name='br-int',has_traffic_filtering=True,id=b44611d2-ca0a-4e01-b44d-cdf537474195,network=Network(94c5462e-c9fd-44e6-b02b-9d46156ca7d9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb44611d2-ca') {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 23:34:07 user nova-compute[75045]: DEBUG os_vif [None req-6ae1fc52-4f28-4677-8480-6857964b89fe tempest-TestStampPattern-2120781434 tempest-TestStampPattern-2120781434-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:64:cd:11,bridge_name='br-int',has_traffic_filtering=True,id=b44611d2-ca0a-4e01-b44d-cdf537474195,network=Network(94c5462e-c9fd-44e6-b02b-9d46156ca7d9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb44611d2-ca') {{(pid=75045) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 23:34:07 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:34:07 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb44611d2-ca, bridge=br-int, if_exists=True) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:34:07 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:34:07 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:34:07 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:34:07 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a4e3a9bd-94f0-4f1f-a0df-aa7f9c027552) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:34:07 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 23:34:07 user nova-compute[75045]: INFO os_vif [None req-6ae1fc52-4f28-4677-8480-6857964b89fe tempest-TestStampPattern-2120781434 tempest-TestStampPattern-2120781434-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:64:cd:11,bridge_name='br-int',has_traffic_filtering=True,id=b44611d2-ca0a-4e01-b44d-cdf537474195,network=Network(94c5462e-c9fd-44e6-b02b-9d46156ca7d9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb44611d2-ca')
Nov 08 23:34:07 user nova-compute[75045]: INFO nova.virt.libvirt.driver [None req-6ae1fc52-4f28-4677-8480-6857964b89fe tempest-TestStampPattern-2120781434 tempest-TestStampPattern-2120781434-project-member] [instance: 9fd7c34a-55e7-4d54-9c60-03a7155a2685] Deleting instance files /opt/stack/data/nova/instances/9fd7c34a-55e7-4d54-9c60-03a7155a2685_del
Nov 08 23:34:07 user nova-compute[75045]: INFO nova.virt.libvirt.driver [None req-6ae1fc52-4f28-4677-8480-6857964b89fe tempest-TestStampPattern-2120781434 tempest-TestStampPattern-2120781434-project-member] [instance: 9fd7c34a-55e7-4d54-9c60-03a7155a2685] Deletion of /opt/stack/data/nova/instances/9fd7c34a-55e7-4d54-9c60-03a7155a2685_del complete
Nov 08 23:34:08 user nova-compute[75045]: INFO nova.compute.manager [None req-6ae1fc52-4f28-4677-8480-6857964b89fe tempest-TestStampPattern-2120781434 tempest-TestStampPattern-2120781434-project-member] [instance: 9fd7c34a-55e7-4d54-9c60-03a7155a2685] Took 0.94 seconds to destroy the instance on the hypervisor.
Nov 08 23:34:08 user nova-compute[75045]: DEBUG oslo.service.loopingcall [None req-6ae1fc52-4f28-4677-8480-6857964b89fe tempest-TestStampPattern-2120781434 tempest-TestStampPattern-2120781434-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75045) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 23:34:08 user nova-compute[75045]: DEBUG nova.compute.manager [-] [instance: 9fd7c34a-55e7-4d54-9c60-03a7155a2685] Deallocating network for instance {{(pid=75045) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 23:34:08 user nova-compute[75045]: DEBUG nova.network.neutron [-] [instance: 9fd7c34a-55e7-4d54-9c60-03a7155a2685] deallocate_for_instance() {{(pid=75045) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 23:34:08 user nova-compute[75045]: DEBUG nova.network.neutron [-] [instance: 9fd7c34a-55e7-4d54-9c60-03a7155a2685] Updating instance_info_cache with network_info: [] {{(pid=75045) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 23:34:08 user nova-compute[75045]: INFO nova.compute.manager [-] [instance: 9fd7c34a-55e7-4d54-9c60-03a7155a2685] Took 0.54 seconds to deallocate network for instance.
Nov 08 23:34:08 user nova-compute[75045]: DEBUG nova.compute.manager [req-6dc40fa7-b621-402b-bed2-74d8d9395f12 req-445e3a07-3e65-4146-ad14-5ed16a9089d7 service nova] [instance: 9fd7c34a-55e7-4d54-9c60-03a7155a2685] Received event network-vif-deleted-b44611d2-ca0a-4e01-b44d-cdf537474195 {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:34:08 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-6ae1fc52-4f28-4677-8480-6857964b89fe tempest-TestStampPattern-2120781434 tempest-TestStampPattern-2120781434-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:34:08 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-6ae1fc52-4f28-4677-8480-6857964b89fe tempest-TestStampPattern-2120781434 tempest-TestStampPattern-2120781434-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:34:08 user nova-compute[75045]: DEBUG nova.compute.manager [req-c598f1dc-e10b-4a5c-ac39-5ccfadeda962 req-3298a595-d78d-4174-89d0-2daa8a1928fa service nova] [instance: 9fd7c34a-55e7-4d54-9c60-03a7155a2685] Received event network-vif-unplugged-b44611d2-ca0a-4e01-b44d-cdf537474195 {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:34:08 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-c598f1dc-e10b-4a5c-ac39-5ccfadeda962 req-3298a595-d78d-4174-89d0-2daa8a1928fa service nova] Acquiring lock "9fd7c34a-55e7-4d54-9c60-03a7155a2685-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:34:08 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-c598f1dc-e10b-4a5c-ac39-5ccfadeda962 req-3298a595-d78d-4174-89d0-2daa8a1928fa service nova] Lock "9fd7c34a-55e7-4d54-9c60-03a7155a2685-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:34:08 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-c598f1dc-e10b-4a5c-ac39-5ccfadeda962 req-3298a595-d78d-4174-89d0-2daa8a1928fa service nova] Lock "9fd7c34a-55e7-4d54-9c60-03a7155a2685-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:34:08 user nova-compute[75045]: DEBUG nova.compute.manager [req-c598f1dc-e10b-4a5c-ac39-5ccfadeda962 req-3298a595-d78d-4174-89d0-2daa8a1928fa service nova] [instance: 9fd7c34a-55e7-4d54-9c60-03a7155a2685] No waiting events found dispatching network-vif-unplugged-b44611d2-ca0a-4e01-b44d-cdf537474195 {{(pid=75045) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 23:34:08 user nova-compute[75045]: WARNING nova.compute.manager [req-c598f1dc-e10b-4a5c-ac39-5ccfadeda962 req-3298a595-d78d-4174-89d0-2daa8a1928fa service nova] [instance: 9fd7c34a-55e7-4d54-9c60-03a7155a2685] Received unexpected event network-vif-unplugged-b44611d2-ca0a-4e01-b44d-cdf537474195 for instance with vm_state deleted and task_state None.
Nov 08 23:34:08 user nova-compute[75045]: DEBUG nova.compute.manager [req-c598f1dc-e10b-4a5c-ac39-5ccfadeda962 req-3298a595-d78d-4174-89d0-2daa8a1928fa service nova] [instance: 9fd7c34a-55e7-4d54-9c60-03a7155a2685] Received event network-vif-plugged-b44611d2-ca0a-4e01-b44d-cdf537474195 {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:34:08 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-c598f1dc-e10b-4a5c-ac39-5ccfadeda962 req-3298a595-d78d-4174-89d0-2daa8a1928fa service nova] Acquiring lock "9fd7c34a-55e7-4d54-9c60-03a7155a2685-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:34:08 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-c598f1dc-e10b-4a5c-ac39-5ccfadeda962 req-3298a595-d78d-4174-89d0-2daa8a1928fa service nova] Lock "9fd7c34a-55e7-4d54-9c60-03a7155a2685-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:34:08 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-c598f1dc-e10b-4a5c-ac39-5ccfadeda962 req-3298a595-d78d-4174-89d0-2daa8a1928fa service nova] Lock "9fd7c34a-55e7-4d54-9c60-03a7155a2685-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:34:08 user nova-compute[75045]: DEBUG nova.compute.manager [req-c598f1dc-e10b-4a5c-ac39-5ccfadeda962 req-3298a595-d78d-4174-89d0-2daa8a1928fa service nova] [instance: 9fd7c34a-55e7-4d54-9c60-03a7155a2685] No waiting events found dispatching network-vif-plugged-b44611d2-ca0a-4e01-b44d-cdf537474195 {{(pid=75045) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 23:34:08 user nova-compute[75045]: WARNING nova.compute.manager [req-c598f1dc-e10b-4a5c-ac39-5ccfadeda962 req-3298a595-d78d-4174-89d0-2daa8a1928fa service nova] [instance: 9fd7c34a-55e7-4d54-9c60-03a7155a2685] Received unexpected event network-vif-plugged-b44611d2-ca0a-4e01-b44d-cdf537474195 for instance with vm_state deleted and task_state None.
Nov 08 23:34:09 user nova-compute[75045]: DEBUG nova.compute.provider_tree [None req-6ae1fc52-4f28-4677-8480-6857964b89fe tempest-TestStampPattern-2120781434 tempest-TestStampPattern-2120781434-project-member] Inventory has not changed in ProviderTree for provider: 62ba5f85-c74d-4b58-986e-d4197e813fd7 {{(pid=75045) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 23:34:09 user nova-compute[75045]: DEBUG nova.scheduler.client.report [None req-6ae1fc52-4f28-4677-8480-6857964b89fe tempest-TestStampPattern-2120781434 tempest-TestStampPattern-2120781434-project-member] Inventory has not changed for provider 62ba5f85-c74d-4b58-986e-d4197e813fd7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75045) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 23:34:09 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-6ae1fc52-4f28-4677-8480-6857964b89fe tempest-TestStampPattern-2120781434 tempest-TestStampPattern-2120781434-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.542s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:34:09 user nova-compute[75045]: INFO nova.scheduler.client.report [None req-6ae1fc52-4f28-4677-8480-6857964b89fe tempest-TestStampPattern-2120781434 tempest-TestStampPattern-2120781434-project-member] Deleted allocations for instance 9fd7c34a-55e7-4d54-9c60-03a7155a2685
Nov 08 23:34:09 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-6ae1fc52-4f28-4677-8480-6857964b89fe tempest-TestStampPattern-2120781434 tempest-TestStampPattern-2120781434-project-member] Lock "9fd7c34a-55e7-4d54-9c60-03a7155a2685" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.258s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:34:12 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:34:17 user nova-compute[75045]: DEBUG nova.compute.manager [req-5859325d-5d2c-44bd-a7a5-af5d324835fa req-86c5b3dd-3ee5-4d64-a8ca-dc0ce95a445c service nova] [instance: a63971de-a2bf-4e58-a760-30eaec3b83c0] Received event network-changed-50aeb5be-ac90-4e8f-ace6-e31512769f3b {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:34:17 user nova-compute[75045]: DEBUG nova.compute.manager [req-5859325d-5d2c-44bd-a7a5-af5d324835fa req-86c5b3dd-3ee5-4d64-a8ca-dc0ce95a445c service nova] [instance: a63971de-a2bf-4e58-a760-30eaec3b83c0] Refreshing instance network info cache due to event network-changed-50aeb5be-ac90-4e8f-ace6-e31512769f3b. {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 23:34:17 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-5859325d-5d2c-44bd-a7a5-af5d324835fa req-86c5b3dd-3ee5-4d64-a8ca-dc0ce95a445c service nova] Acquiring lock "refresh_cache-a63971de-a2bf-4e58-a760-30eaec3b83c0" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 23:34:17 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-5859325d-5d2c-44bd-a7a5-af5d324835fa req-86c5b3dd-3ee5-4d64-a8ca-dc0ce95a445c service nova] Acquired lock "refresh_cache-a63971de-a2bf-4e58-a760-30eaec3b83c0" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 23:34:17 user nova-compute[75045]: DEBUG nova.network.neutron [req-5859325d-5d2c-44bd-a7a5-af5d324835fa req-86c5b3dd-3ee5-4d64-a8ca-dc0ce95a445c service nova] [instance: a63971de-a2bf-4e58-a760-30eaec3b83c0] Refreshing network info cache for port 50aeb5be-ac90-4e8f-ace6-e31512769f3b {{(pid=75045) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 23:34:17 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:34:17 user nova-compute[75045]: DEBUG nova.network.neutron [req-5859325d-5d2c-44bd-a7a5-af5d324835fa req-86c5b3dd-3ee5-4d64-a8ca-dc0ce95a445c service nova] [instance: a63971de-a2bf-4e58-a760-30eaec3b83c0] Updated VIF entry in instance network info cache for port 50aeb5be-ac90-4e8f-ace6-e31512769f3b. {{(pid=75045) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 23:34:17 user nova-compute[75045]: DEBUG nova.network.neutron [req-5859325d-5d2c-44bd-a7a5-af5d324835fa req-86c5b3dd-3ee5-4d64-a8ca-dc0ce95a445c service nova] [instance: a63971de-a2bf-4e58-a760-30eaec3b83c0] Updating instance_info_cache with network_info: [{"id": "50aeb5be-ac90-4e8f-ace6-e31512769f3b", "address": "fa:16:3e:b4:db:58", "network": {"id": "2f33d93d-98ec-4b87-a0c0-efe2d2ac8f6d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-719527911-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.197", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7eff4be777d24514be52868961bf7a25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50aeb5be-ac", "ovs_interfaceid": "50aeb5be-ac90-4e8f-ace6-e31512769f3b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75045) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 23:34:17 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-5859325d-5d2c-44bd-a7a5-af5d324835fa req-86c5b3dd-3ee5-4d64-a8ca-dc0ce95a445c service nova] Releasing lock "refresh_cache-a63971de-a2bf-4e58-a760-30eaec3b83c0" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 23:34:20 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-65a986fa-c39c-4a8d-a60a-94ac62e23fef tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Acquiring lock "438082fc-a83f-4305-ada6-41a8e1d645a8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:34:20 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-65a986fa-c39c-4a8d-a60a-94ac62e23fef tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Lock "438082fc-a83f-4305-ada6-41a8e1d645a8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:34:20 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-65a986fa-c39c-4a8d-a60a-94ac62e23fef tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Acquiring lock "438082fc-a83f-4305-ada6-41a8e1d645a8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:34:20 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-65a986fa-c39c-4a8d-a60a-94ac62e23fef tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Lock "438082fc-a83f-4305-ada6-41a8e1d645a8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:34:20 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-65a986fa-c39c-4a8d-a60a-94ac62e23fef tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Lock "438082fc-a83f-4305-ada6-41a8e1d645a8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:34:20 user nova-compute[75045]: INFO nova.compute.manager [None req-65a986fa-c39c-4a8d-a60a-94ac62e23fef tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] [instance: 438082fc-a83f-4305-ada6-41a8e1d645a8] Terminating instance
Nov 08 23:34:20 user nova-compute[75045]: DEBUG nova.compute.manager [None req-65a986fa-c39c-4a8d-a60a-94ac62e23fef tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] [instance: 438082fc-a83f-4305-ada6-41a8e1d645a8] Start destroying the instance on the hypervisor. {{(pid=75045) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 23:34:20 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:34:20 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:34:20 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:34:20 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:34:20 user nova-compute[75045]: DEBUG nova.compute.manager [req-54e20240-c8b7-47ab-af7d-3a765928dbe1 req-63fc4d66-1865-4475-ac92-0d87309f4585 service nova] [instance: 438082fc-a83f-4305-ada6-41a8e1d645a8] Received event network-vif-unplugged-669f0f7f-7c58-42b9-948b-ad3704fb1ab3 {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:34:20 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-54e20240-c8b7-47ab-af7d-3a765928dbe1 req-63fc4d66-1865-4475-ac92-0d87309f4585 service nova] Acquiring lock "438082fc-a83f-4305-ada6-41a8e1d645a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:34:20 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-54e20240-c8b7-47ab-af7d-3a765928dbe1 req-63fc4d66-1865-4475-ac92-0d87309f4585 service nova] Lock "438082fc-a83f-4305-ada6-41a8e1d645a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:34:20 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-54e20240-c8b7-47ab-af7d-3a765928dbe1 req-63fc4d66-1865-4475-ac92-0d87309f4585 service nova] Lock "438082fc-a83f-4305-ada6-41a8e1d645a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:34:20 user nova-compute[75045]: DEBUG nova.compute.manager [req-54e20240-c8b7-47ab-af7d-3a765928dbe1 req-63fc4d66-1865-4475-ac92-0d87309f4585 service nova] [instance: 438082fc-a83f-4305-ada6-41a8e1d645a8] No waiting events found dispatching network-vif-unplugged-669f0f7f-7c58-42b9-948b-ad3704fb1ab3 {{(pid=75045) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 23:34:20 user nova-compute[75045]: DEBUG nova.compute.manager [req-54e20240-c8b7-47ab-af7d-3a765928dbe1 req-63fc4d66-1865-4475-ac92-0d87309f4585 service nova] [instance: 438082fc-a83f-4305-ada6-41a8e1d645a8] Received event network-vif-unplugged-669f0f7f-7c58-42b9-948b-ad3704fb1ab3 for instance with task_state deleting. {{(pid=75045) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 23:34:21 user nova-compute[75045]: INFO nova.virt.libvirt.driver [-] [instance: 438082fc-a83f-4305-ada6-41a8e1d645a8] Instance destroyed successfully.
Nov 08 23:34:21 user nova-compute[75045]: DEBUG nova.objects.instance [None req-65a986fa-c39c-4a8d-a60a-94ac62e23fef tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Lazy-loading 'resources' on Instance uuid 438082fc-a83f-4305-ada6-41a8e1d645a8 {{(pid=75045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 23:34:21 user nova-compute[75045]: DEBUG nova.virt.libvirt.vif [None req-65a986fa-c39c-4a8d-a60a-94ac62e23fef tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T23:27:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-761970552',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-761970552',id=26,image_ref='a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-08T23:30:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6bfb6963a6c145d4a7b7e47c8fde7e60',ramdisk_id='',reservation_id='r-lkcobnbl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-474110917',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T23:32:36Z,user_data=None,user_id='04bb3135250f4465a9947b47f9cde485',uuid=438082fc-a83f-4305-ada6-41a8e1d645a8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "669f0f7f-7c58-42b9-948b-ad3704fb1ab3", "address": "fa:16:3e:57:c2:f9", "network": {"id": "d4cd6998-66d1-4389-bc82-dd000c8962de", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-323966879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bfb6963a6c145d4a7b7e47c8fde7e60", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap669f0f7f-7c", "ovs_interfaceid": "669f0f7f-7c58-42b9-948b-ad3704fb1ab3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75045) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 23:34:21 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-65a986fa-c39c-4a8d-a60a-94ac62e23fef tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Converting VIF {"id": "669f0f7f-7c58-42b9-948b-ad3704fb1ab3", "address": "fa:16:3e:57:c2:f9", "network": {"id": "d4cd6998-66d1-4389-bc82-dd000c8962de", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-323966879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bfb6963a6c145d4a7b7e47c8fde7e60", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap669f0f7f-7c", "ovs_interfaceid": "669f0f7f-7c58-42b9-948b-ad3704fb1ab3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 23:34:21 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-65a986fa-c39c-4a8d-a60a-94ac62e23fef tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:57:c2:f9,bridge_name='br-int',has_traffic_filtering=True,id=669f0f7f-7c58-42b9-948b-ad3704fb1ab3,network=Network(d4cd6998-66d1-4389-bc82-dd000c8962de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap669f0f7f-7c') {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 23:34:21 user nova-compute[75045]: DEBUG os_vif [None req-65a986fa-c39c-4a8d-a60a-94ac62e23fef tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:57:c2:f9,bridge_name='br-int',has_traffic_filtering=True,id=669f0f7f-7c58-42b9-948b-ad3704fb1ab3,network=Network(d4cd6998-66d1-4389-bc82-dd000c8962de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap669f0f7f-7c') {{(pid=75045) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 23:34:21 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:34:21 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap669f0f7f-7c, bridge=br-int, if_exists=True) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:34:21 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:34:21 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 23:34:21 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:34:21 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=cbbd4bce-4d67-4ce5-966f-56e2aea7d0ac) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:34:21 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:34:21 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 23:34:21 user nova-compute[75045]: INFO os_vif [None req-65a986fa-c39c-4a8d-a60a-94ac62e23fef tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:57:c2:f9,bridge_name='br-int',has_traffic_filtering=True,id=669f0f7f-7c58-42b9-948b-ad3704fb1ab3,network=Network(d4cd6998-66d1-4389-bc82-dd000c8962de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap669f0f7f-7c')
Nov 08 23:34:21 user nova-compute[75045]: DEBUG nova.virt.libvirt.volume.iscsi [None req-65a986fa-c39c-4a8d-a60a-94ac62e23fef tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] [instance: 438082fc-a83f-4305-ada6-41a8e1d645a8] calling os-brick to detach iSCSI Volume {{(pid=75045) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 23:34:21 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-65a986fa-c39c-4a8d-a60a-94ac62e23fef tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1b68210460>, {'target_iqn': 'iqn.2010-10.org.openstack:83187c89-e833-4efd-afa0-2cbfe05d8db1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gzFECVaq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=75045) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 23:34:21 user nova-compute[75045]: WARNING os_brick.initiator.connectors.base [None req-65a986fa-c39c-4a8d-a60a-94ac62e23fef tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 23:34:21 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-65a986fa-c39c-4a8d-a60a-94ac62e23fef tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 23:34:21 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-65a986fa-c39c-4a8d-a60a-94ac62e23fef tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 23:34:21 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:34:21 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:34:21 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[84e41402-9d8d-455e-9af7-d78b7bcd698c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:83187c89-e833-4efd-afa0-2cbfe05d8db1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e9c3ac6d-d72a-41c8-9c18-15131250e323\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1b2a3b04-13be-4853-822c-29c416757252\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:34:21 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-65a986fa-c39c-4a8d-a60a-94ac62e23fef tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 23:34:21 user nova-compute[75045]: No targets found.
Nov 08 23:34:21 user nova-compute[75045]: iSNS:
Nov 08 23:34:21 user nova-compute[75045]: No targets found.
Nov 08 23:34:21 user nova-compute[75045]: STATIC:
Nov 08 23:34:21 user nova-compute[75045]: Target: iqn.2010-10.org.openstack:83187c89-e833-4efd-afa0-2cbfe05d8db1
Nov 08 23:34:21 user nova-compute[75045]:         Portal: 172.16.0.220:3260,-1
Nov 08 23:34:21 user nova-compute[75045]:                 Iface Name: default
Nov 08 23:34:21 user nova-compute[75045]: Target: iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab
Nov 08 23:34:21 user nova-compute[75045]:         Portal: 172.16.0.220:3260,-1
Nov 08 23:34:21 user nova-compute[75045]:                 Iface Name: default
Nov 08 23:34:21 user nova-compute[75045]: Target: iqn.2010-10.org.openstack:e9c3ac6d-d72a-41c8-9c18-15131250e323
Nov 08 23:34:21 user nova-compute[75045]:         Portal: 172.16.0.220:3260,-1
Nov 08 23:34:21 user nova-compute[75045]:                 Iface Name: default
Nov 08 23:34:21 user nova-compute[75045]: Target: iqn.2010-10.org.openstack:1b2a3b04-13be-4853-822c-29c416757252
Nov 08 23:34:21 user nova-compute[75045]:         Portal: 172.16.0.220:3260,-1
Nov 08 23:34:21 user nova-compute[75045]:                 Iface Name: default
Nov 08 23:34:21 user nova-compute[75045]: FIRMWARE:
Nov 08 23:34:21 user nova-compute[75045]: No targets found.
Nov 08 23:34:21 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 23:34:21 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-65a986fa-c39c-4a8d-a60a-94ac62e23fef tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 23:34:21 user nova-compute[75045]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 23:34:21 user nova-compute[75045]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75045) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 23:34:21 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-65a986fa-c39c-4a8d-a60a-94ac62e23fef tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:83187c89-e833-4efd-afa0-2cbfe05d8db1', 0)] {{(pid=75045) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 23:34:21 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:34:21 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:34:21 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dd8a4a2-381a-4362-9698-365e8e2069f3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1b2a3b04-13be-4853-822c-29c416757252\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:83187c89-e833-4efd-afa0-2cbfe05d8db1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e9c3ac6d-d72a-41c8-9c18-15131250e323\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:34:21 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:34:21 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:34:21 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7d7470f-1adf-4e21-8ed7-5d036cef6549]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83187c89-e833-4efd-afa0-2cbfe05d8db1 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9c3ac6d-d72a-41c8-9c18-15131250e323 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b2a3b04-13be-4853-822c-29c416757252 (non-flash)\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:34:21 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-65a986fa-c39c-4a8d-a60a-94ac62e23fef tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab (non-flash)
Nov 08 23:34:21 user nova-compute[75045]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83187c89-e833-4efd-afa0-2cbfe05d8db1 (non-flash)
Nov 08 23:34:21 user nova-compute[75045]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9c3ac6d-d72a-41c8-9c18-15131250e323 (non-flash)
Nov 08 23:34:21 user nova-compute[75045]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b2a3b04-13be-4853-822c-29c416757252 (non-flash)
Nov 08 23:34:21 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 23:34:21 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-65a986fa-c39c-4a8d-a60a-94ac62e23fef tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab (non-flash)
Nov 08 23:34:21 user nova-compute[75045]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83187c89-e833-4efd-afa0-2cbfe05d8db1 (non-flash)
Nov 08 23:34:21 user nova-compute[75045]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9c3ac6d-d72a-41c8-9c18-15131250e323 (non-flash)
Nov 08 23:34:21 user nova-compute[75045]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b2a3b04-13be-4853-822c-29c416757252 (non-flash)
Nov 08 23:34:21 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 23:34:21 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-65a986fa-c39c-4a8d-a60a-94ac62e23fef tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1b485b1510>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:83187c89-e833-4efd-afa0-2cbfe05d8db1'): ({'sdd'}, set())}) {{(pid=75045) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 23:34:21 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-65a986fa-c39c-4a8d-a60a-94ac62e23fef tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Removing single pathed devices sdd {{(pid=75045) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 23:34:21 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:34:21 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:34:21 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[08f814f6-d6c8-46a5-ad2d-b31910720ab9]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:34:21 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:34:21 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:34:21 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3c3dd4d-de90-4549-a987-da85ab6f2ee9]: (4, ('ok\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:34:21 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-65a986fa-c39c-4a8d-a60a-94ac62e23fef tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Flushing IO for device /dev/sdd {{(pid=75045) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 23:34:21 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:34:21 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.016s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:34:21 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[54269d68-f204-4d00-946f-cdf27011e493]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:34:21 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-65a986fa-c39c-4a8d-a60a-94ac62e23fef tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75045) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 23:34:21 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:34:21 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:34:21 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.046s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:34:21 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[14efcc0a-da2e-4164-b841-2021a89454e9]: (4, ('1', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:34:21 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-65a986fa-c39c-4a8d-a60a-94ac62e23fef tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75045) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 23:34:21 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-65a986fa-c39c-4a8d-a60a-94ac62e23fef tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] SCSI volumes sdd have been removed. {{(pid=75045) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 23:34:21 user nova-compute[75045]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIOda641c97-a74b9ad3964d4501', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_da641c97', '/dev/disk/by-id/scsi-26137346239616433') {{(pid=86132) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 08 23:34:21 user nova-compute[75045]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-1SCST_BIOda641c97-a74b9ad3964d4501
Nov 08 23:34:21 user nova-compute[75045]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-SSCST_BIO_Storage_da641c97
Nov 08 23:34:21 user nova-compute[75045]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-26137346239616433
Nov 08 23:34:21 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[77e9c606-b7fa-4912-984b-009b7186c89b]: (4, None) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:34:21 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-65a986fa-c39c-4a8d-a60a-94ac62e23fef tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:83187c89-e833-4efd-afa0-2cbfe05d8db1')] {{(pid=75045) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 23:34:21 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83187c89-e833-4efd-afa0-2cbfe05d8db1 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:34:21 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83187c89-e833-4efd-afa0-2cbfe05d8db1 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:34:21 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[9abf1fd6-5ed1-46f1-9dbb-3344daddf1b6]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:34:21 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-65a986fa-c39c-4a8d-a60a-94ac62e23fef tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:34:21 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83187c89-e833-4efd-afa0-2cbfe05d8db1 -p 172.16.0.220:3260 --logout {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:34:21 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83187c89-e833-4efd-afa0-2cbfe05d8db1 -p 172.16.0.220:3260 --logout" returned: 0 in 0.050s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:34:21 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c7a89de-79ce-41ec-80d4-8719fa00fce0]: (4, ('Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:83187c89-e833-4efd-afa0-2cbfe05d8db1, portal: 172.16.0.220,3260]\nLogout of [sid: 29, target: iqn.2010-10.org.openstack:83187c89-e833-4efd-afa0-2cbfe05d8db1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:34:21 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-65a986fa-c39c-4a8d-a60a-94ac62e23fef tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:83187c89-e833-4efd-afa0-2cbfe05d8db1, portal: 172.16.0.220,3260]
Nov 08 23:34:21 user nova-compute[75045]: Logout of [sid: 29, target: iqn.2010-10.org.openstack:83187c89-e833-4efd-afa0-2cbfe05d8db1, portal: 172.16.0.220,3260] successful.
Nov 08 23:34:21 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:34:21 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83187c89-e833-4efd-afa0-2cbfe05d8db1 -p 172.16.0.220:3260 --op delete {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:34:21 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83187c89-e833-4efd-afa0-2cbfe05d8db1 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:34:21 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[91e4a7a0-d81a-4daa-a125-8690b6c33805]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:34:21 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-65a986fa-c39c-4a8d-a60a-94ac62e23fef tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:34:21 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-65a986fa-c39c-4a8d-a60a-94ac62e23fef tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.322s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 23:34:21 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-65a986fa-c39c-4a8d-a60a-94ac62e23fef tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] <== disconnect_volume: return (325ms) None {{(pid=75045) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 23:34:21 user nova-compute[75045]: DEBUG nova.virt.libvirt.volume.iscsi [None req-65a986fa-c39c-4a8d-a60a-94ac62e23fef tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] [instance: 438082fc-a83f-4305-ada6-41a8e1d645a8] Disconnected iSCSI Volume {{(pid=75045) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 23:34:21 user nova-compute[75045]: INFO nova.virt.libvirt.driver [None req-65a986fa-c39c-4a8d-a60a-94ac62e23fef tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] [instance: 438082fc-a83f-4305-ada6-41a8e1d645a8] Deleting instance files /opt/stack/data/nova/instances/438082fc-a83f-4305-ada6-41a8e1d645a8_del
Nov 08 23:34:21 user nova-compute[75045]: INFO nova.virt.libvirt.driver [None req-65a986fa-c39c-4a8d-a60a-94ac62e23fef tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] [instance: 438082fc-a83f-4305-ada6-41a8e1d645a8] Deletion of /opt/stack/data/nova/instances/438082fc-a83f-4305-ada6-41a8e1d645a8_del complete
Nov 08 23:34:21 user nova-compute[75045]: INFO nova.compute.manager [None req-65a986fa-c39c-4a8d-a60a-94ac62e23fef tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] [instance: 438082fc-a83f-4305-ada6-41a8e1d645a8] Took 1.31 seconds to destroy the instance on the hypervisor.
Nov 08 23:34:21 user nova-compute[75045]: DEBUG oslo.service.loopingcall [None req-65a986fa-c39c-4a8d-a60a-94ac62e23fef tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75045) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 23:34:21 user nova-compute[75045]: DEBUG nova.compute.manager [-] [instance: 438082fc-a83f-4305-ada6-41a8e1d645a8] Deallocating network for instance {{(pid=75045) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 23:34:21 user nova-compute[75045]: DEBUG nova.network.neutron [-] [instance: 438082fc-a83f-4305-ada6-41a8e1d645a8] deallocate_for_instance() {{(pid=75045) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 23:34:22 user nova-compute[75045]: DEBUG nova.network.neutron [-] [instance: 438082fc-a83f-4305-ada6-41a8e1d645a8] Updating instance_info_cache with network_info: [] {{(pid=75045) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 23:34:22 user nova-compute[75045]: INFO nova.compute.manager [-] [instance: 438082fc-a83f-4305-ada6-41a8e1d645a8] Took 0.51 seconds to deallocate network for instance.
Nov 08 23:34:22 user nova-compute[75045]: DEBUG nova.compute.manager [req-d3c81bcc-dfb0-4c98-93e2-8606732734eb req-35922bfe-cf2d-45bb-b78e-e8b6498f3fc0 service nova] [instance: 438082fc-a83f-4305-ada6-41a8e1d645a8] Received event network-vif-deleted-669f0f7f-7c58-42b9-948b-ad3704fb1ab3 {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:34:22 user nova-compute[75045]: INFO nova.compute.manager [req-d3c81bcc-dfb0-4c98-93e2-8606732734eb req-35922bfe-cf2d-45bb-b78e-e8b6498f3fc0 service nova] [instance: 438082fc-a83f-4305-ada6-41a8e1d645a8] Neutron deleted interface 669f0f7f-7c58-42b9-948b-ad3704fb1ab3; detaching it from the instance and deleting it from the info cache
Nov 08 23:34:22 user nova-compute[75045]: DEBUG nova.network.neutron [req-d3c81bcc-dfb0-4c98-93e2-8606732734eb req-35922bfe-cf2d-45bb-b78e-e8b6498f3fc0 service nova] [instance: 438082fc-a83f-4305-ada6-41a8e1d645a8] Updating instance_info_cache with network_info: [] {{(pid=75045) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 23:34:22 user nova-compute[75045]: DEBUG nova.compute.manager [req-d3c81bcc-dfb0-4c98-93e2-8606732734eb req-35922bfe-cf2d-45bb-b78e-e8b6498f3fc0 service nova] [instance: 438082fc-a83f-4305-ada6-41a8e1d645a8] Detach interface failed, port_id=669f0f7f-7c58-42b9-948b-ad3704fb1ab3, reason: Instance 438082fc-a83f-4305-ada6-41a8e1d645a8 could not be found. {{(pid=75045) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 08 23:34:22 user nova-compute[75045]: DEBUG nova.compute.manager [req-67111ba9-df1a-4d34-a675-5e614f31fd36 req-358a9468-9038-45b5-ace9-8f5cbcf4f1ab service nova] [instance: 438082fc-a83f-4305-ada6-41a8e1d645a8] Received event network-vif-plugged-669f0f7f-7c58-42b9-948b-ad3704fb1ab3 {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:34:22 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-67111ba9-df1a-4d34-a675-5e614f31fd36 req-358a9468-9038-45b5-ace9-8f5cbcf4f1ab service nova] Acquiring lock "438082fc-a83f-4305-ada6-41a8e1d645a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:34:22 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-67111ba9-df1a-4d34-a675-5e614f31fd36 req-358a9468-9038-45b5-ace9-8f5cbcf4f1ab service nova] Lock "438082fc-a83f-4305-ada6-41a8e1d645a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:34:22 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-67111ba9-df1a-4d34-a675-5e614f31fd36 req-358a9468-9038-45b5-ace9-8f5cbcf4f1ab service nova] Lock "438082fc-a83f-4305-ada6-41a8e1d645a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:34:22 user nova-compute[75045]: DEBUG nova.compute.manager [req-67111ba9-df1a-4d34-a675-5e614f31fd36 req-358a9468-9038-45b5-ace9-8f5cbcf4f1ab service nova] [instance: 438082fc-a83f-4305-ada6-41a8e1d645a8] No waiting events found dispatching network-vif-plugged-669f0f7f-7c58-42b9-948b-ad3704fb1ab3 {{(pid=75045) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 23:34:22 user nova-compute[75045]: WARNING nova.compute.manager [req-67111ba9-df1a-4d34-a675-5e614f31fd36 req-358a9468-9038-45b5-ace9-8f5cbcf4f1ab service nova] [instance: 438082fc-a83f-4305-ada6-41a8e1d645a8] Received unexpected event network-vif-plugged-669f0f7f-7c58-42b9-948b-ad3704fb1ab3 for instance with vm_state active and task_state deleting.
Nov 08 23:34:23 user nova-compute[75045]: INFO nova.compute.manager [None req-65a986fa-c39c-4a8d-a60a-94ac62e23fef tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] [instance: 438082fc-a83f-4305-ada6-41a8e1d645a8] Took 0.92 seconds to detach 1 volumes for instance.
Nov 08 23:34:23 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-65a986fa-c39c-4a8d-a60a-94ac62e23fef tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:34:23 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-65a986fa-c39c-4a8d-a60a-94ac62e23fef tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:34:23 user nova-compute[75045]: DEBUG nova.compute.provider_tree [None req-65a986fa-c39c-4a8d-a60a-94ac62e23fef tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Inventory has not changed in ProviderTree for provider: 62ba5f85-c74d-4b58-986e-d4197e813fd7 {{(pid=75045) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 23:34:23 user nova-compute[75045]: DEBUG nova.scheduler.client.report [None req-65a986fa-c39c-4a8d-a60a-94ac62e23fef tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Inventory has not changed for provider 62ba5f85-c74d-4b58-986e-d4197e813fd7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75045) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 23:34:23 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-65a986fa-c39c-4a8d-a60a-94ac62e23fef tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.414s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:34:23 user nova-compute[75045]: INFO nova.scheduler.client.report [None req-65a986fa-c39c-4a8d-a60a-94ac62e23fef tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Deleted allocations for instance 438082fc-a83f-4305-ada6-41a8e1d645a8
Nov 08 23:34:23 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-65a986fa-c39c-4a8d-a60a-94ac62e23fef tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Lock "438082fc-a83f-4305-ada6-41a8e1d645a8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.337s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:34:24 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-6df7140e-4504-4424-af8e-7de4f494f8b1 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Acquiring lock "a63971de-a2bf-4e58-a760-30eaec3b83c0" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:34:24 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-6df7140e-4504-4424-af8e-7de4f494f8b1 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Lock "a63971de-a2bf-4e58-a760-30eaec3b83c0" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:34:24 user nova-compute[75045]: DEBUG nova.objects.instance [None req-6df7140e-4504-4424-af8e-7de4f494f8b1 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Lazy-loading 'flavor' on Instance uuid a63971de-a2bf-4e58-a760-30eaec3b83c0 {{(pid=75045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 23:34:24 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-6df7140e-4504-4424-af8e-7de4f494f8b1 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Lock "a63971de-a2bf-4e58-a760-30eaec3b83c0" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.059s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:34:24 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-6df7140e-4504-4424-af8e-7de4f494f8b1 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Acquiring lock "a63971de-a2bf-4e58-a760-30eaec3b83c0" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:34:24 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-6df7140e-4504-4424-af8e-7de4f494f8b1 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Lock "a63971de-a2bf-4e58-a760-30eaec3b83c0" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:34:24 user nova-compute[75045]: INFO nova.compute.manager [None req-6df7140e-4504-4424-af8e-7de4f494f8b1 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] [instance: a63971de-a2bf-4e58-a760-30eaec3b83c0] Attaching volume 40af8977-0ce5-4509-93f8-b6c6349aed86 to /dev/vdb
Nov 08 23:34:24 user nova-compute[75045]: DEBUG os_brick.utils [None req-6df7140e-4504-4424-af8e-7de4f494f8b1 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75045) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 23:34:24 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:34:24 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:34:24 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ff48ba4-9669-4cfb-bd0b-b0c47a61a3e0]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6217bd6e884\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:34:24 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:34:24 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:34:24 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[886d14aa-24ed-43be-ad15-8b76c111ffed]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:34:24 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:34:24 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:34:24 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[21e3712e-3180-4930-97d9-a1c65808ebd5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:34:24 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[90f68e9f-0a44-4073-b6d2-bd9c8e47a4df]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:34:24 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-6df7140e-4504-4424-af8e-7de4f494f8b1 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Running cmd (subprocess): nvme version {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:34:24 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-6df7140e-4504-4424-af8e-7de4f494f8b1 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] 'nvme version' failed. Not Retrying. {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 23:34:24 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6df7140e-4504-4424-af8e-7de4f494f8b1 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] nvme not present on system {{(pid=75045) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 23:34:24 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:34:24 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 23:34:24 user nova-compute[75045]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 23:34:24 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[491b4c69-3e29-4107-a3d1-e4fc0c03b018]: (4, '') {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:34:24 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.lightos [None req-6df7140e-4504-4424-af8e-7de4f494f8b1 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75045) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 23:34:24 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.lightos [None req-6df7140e-4504-4424-af8e-7de4f494f8b1 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75045) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 23:34:24 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.lightos [None req-6df7140e-4504-4424-af8e-7de4f494f8b1 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] LIGHTOS: no hostnqn found. {{(pid=75045) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 23:34:24 user nova-compute[75045]: DEBUG os_brick.utils [None req-6df7140e-4504-4424-af8e-7de4f494f8b1 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6217bd6e884', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75045) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 23:34:24 user nova-compute[75045]: DEBUG nova.virt.block_device [None req-6df7140e-4504-4424-af8e-7de4f494f8b1 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] [instance: a63971de-a2bf-4e58-a760-30eaec3b83c0] Updating existing volume attachment record: bdbd50e9-5fbb-4512-b000-ce000c680a84 {{(pid=75045) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 23:34:25 user nova-compute[75045]: INFO nova.compute.manager [None req-c876ae13-f985-495c-ba4c-882ab74ee39d tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] [instance: 04169f59-e9a6-4b50-9ad7-7f8c105a376a] Get console output
Nov 08 23:34:25 user nova-compute[75045]: INFO nova.privsep.libvirt [-] Ignored error while reading from instance console pty: can't concat NoneType to bytes
Nov 08 23:34:26 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:34:26 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:34:31 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:34:31 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:34:35 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:34:36 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:34:36 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:34:40 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:34:41 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:34:41 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:34:42 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:34:46 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:34:46 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:34:48 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:34:48 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:34:48 user nova-compute[75045]: DEBUG nova.compute.manager [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Starting heal instance info cache {{(pid=75045) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 23:34:48 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Acquiring lock "refresh_cache-d2c911cf-d5f4-4c19-8335-8c7834184a7e" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 23:34:48 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Acquired lock "refresh_cache-d2c911cf-d5f4-4c19-8335-8c7834184a7e" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 23:34:48 user nova-compute[75045]: DEBUG nova.network.neutron [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] [instance: d2c911cf-d5f4-4c19-8335-8c7834184a7e] Forcefully refreshing network info cache for instance {{(pid=75045) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 23:34:48 user nova-compute[75045]: DEBUG nova.network.neutron [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] [instance: d2c911cf-d5f4-4c19-8335-8c7834184a7e] Updating instance_info_cache with network_info: [{"id": "f4321c52-b9d5-434c-820f-25cab4239ef4", "address": "fa:16:3e:49:6b:27", "network": {"id": "d4cd6998-66d1-4389-bc82-dd000c8962de", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-323966879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bfb6963a6c145d4a7b7e47c8fde7e60", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4321c52-b9", "ovs_interfaceid": "f4321c52-b9d5-434c-820f-25cab4239ef4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75045) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 23:34:48 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Releasing lock "refresh_cache-d2c911cf-d5f4-4c19-8335-8c7834184a7e" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 23:34:48 user nova-compute[75045]: DEBUG nova.compute.manager [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] [instance: d2c911cf-d5f4-4c19-8335-8c7834184a7e] Updated the network info_cache for instance {{(pid=75045) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 23:34:48 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:34:48 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:34:48 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:34:48 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:34:48 user nova-compute[75045]: DEBUG nova.compute.manager [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75045) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 23:34:48 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:34:48 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:34:49 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager.update_available_resource {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:34:50 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:34:50 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:34:50 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:34:50 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Auditing locally available compute resources for user (node: user) {{(pid=75045) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 23:34:50 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72c9d731-2b35-434c-8463-1cd6c18fbd6a/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:34:50 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72c9d731-2b35-434c-8463-1cd6c18fbd6a/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:34:50 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72c9d731-2b35-434c-8463-1cd6c18fbd6a/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:34:50 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72c9d731-2b35-434c-8463-1cd6c18fbd6a/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:34:50 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ae5ff6b-6f2c-4dfd-a4c6-da4809e2cf27/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:34:50 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ae5ff6b-6f2c-4dfd-a4c6-da4809e2cf27/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:34:50 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ae5ff6b-6f2c-4dfd-a4c6-da4809e2cf27/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:34:50 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ae5ff6b-6f2c-4dfd-a4c6-da4809e2cf27/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:34:50 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] skipping disk /dev/sdh (vda) as it is a volume {{(pid=75045) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 23:34:50 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a63971de-a2bf-4e58-a760-30eaec3b83c0/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:34:51 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a63971de-a2bf-4e58-a760-30eaec3b83c0/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:34:51 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a63971de-a2bf-4e58-a760-30eaec3b83c0/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:34:51 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:34:51 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a63971de-a2bf-4e58-a760-30eaec3b83c0/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:34:51 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f21fcd3-ac5f-499e-9c34-82af806fda1d/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:34:51 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:34:51 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f21fcd3-ac5f-499e-9c34-82af806fda1d/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:34:51 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f21fcd3-ac5f-499e-9c34-82af806fda1d/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:34:51 user nova-compute[75045]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4879496c-012e-4a4d-97e1-7910402721d0 tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] [instance: adcffd35-00c7-49db-a72f-d6307a90e123] Calling os-brick to attach iSCSI Volume {{(pid=75045) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 23:34:51 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-4879496c-012e-4a4d-97e1-7910402721d0 tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1b68210460>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:4fd05cc1-4e93-4804-ab93-57b0435dacea', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jTPwrenI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75045) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 23:34:51 user nova-compute[75045]: WARNING os_brick.initiator.connectors.base [None req-4879496c-012e-4a4d-97e1-7910402721d0 tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 23:34:51 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-4879496c-012e-4a4d-97e1-7910402721d0 tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 23:34:51 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-4879496c-012e-4a4d-97e1-7910402721d0 tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 23:34:51 user nova-compute[75045]: WARNING os_brick.initiator.connectors.base [None req-4879496c-012e-4a4d-97e1-7910402721d0 tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 23:34:51 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-4879496c-012e-4a4d-97e1-7910402721d0 tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4fd05cc1-4e93-4804-ab93-57b0435dacea" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 23:34:51 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-4879496c-012e-4a4d-97e1-7910402721d0 tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4fd05cc1-4e93-4804-ab93-57b0435dacea" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 23:34:51 user nova-compute[75045]: INFO os_brick.initiator.connectors.iscsi [None req-4879496c-012e-4a4d-97e1-7910402721d0 tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 23:34:51 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4fd05cc1-4e93-4804-ab93-57b0435dacea -p 172.16.0.220:3260 {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:34:51 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f21fcd3-ac5f-499e-9c34-82af806fda1d/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:34:51 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4fd05cc1-4e93-4804-ab93-57b0435dacea -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:34:51 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa67b237-f598-4111-87ba-d761aa50d95e/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:34:51 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[e41e1945-08de-450d-8a79-98e758bbc527]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:34:51 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-4879496c-012e-4a4d-97e1-7910402721d0 tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 23:34:51 user nova-compute[75045]:  {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:34:51 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4fd05cc1-4e93-4804-ab93-57b0435dacea -p 172.16.0.220:3260 --interface default --op new {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:34:51 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4fd05cc1-4e93-4804-ab93-57b0435dacea -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:34:51 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf000099-9842-4ded-8eec-c3783e05cfb9]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4fd05cc1-4e93-4804-ab93-57b0435dacea] added\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:34:51 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-4879496c-012e-4a4d-97e1-7910402721d0 tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4fd05cc1-4e93-4804-ab93-57b0435dacea] added
Nov 08 23:34:51 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:34:51 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4fd05cc1-4e93-4804-ab93-57b0435dacea -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:34:51 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4fd05cc1-4e93-4804-ab93-57b0435dacea -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:34:51 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[f49f5761-3de5-4cf1-a19f-06bd0d4176ae]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:34:51 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-4879496c-012e-4a4d-97e1-7910402721d0 tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:34:51 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4fd05cc1-4e93-4804-ab93-57b0435dacea -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:34:51 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4fd05cc1-4e93-4804-ab93-57b0435dacea -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:34:51 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[099ff724-b659-4e3b-8c96-5450531709e8]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:34:51 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-4879496c-012e-4a4d-97e1-7910402721d0 tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:34:51 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4fd05cc1-4e93-4804-ab93-57b0435dacea -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jTPwrenI {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:34:51 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4fd05cc1-4e93-4804-ab93-57b0435dacea -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jTPwrenI" returned: 0 in 0.019s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:34:51 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[72acbb84-e8a6-4e4b-95fa-68154bab6f0c]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:34:51 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-4879496c-012e-4a4d-97e1-7910402721d0 tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'jTPwrenI'): stdout= stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:34:51 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4fd05cc1-4e93-4804-ab93-57b0435dacea -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:34:51 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa67b237-f598-4111-87ba-d761aa50d95e/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:34:51 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa67b237-f598-4111-87ba-d761aa50d95e/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:34:51 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4fd05cc1-4e93-4804-ab93-57b0435dacea -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:34:51 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1a55396-4613-4eaa-b3f3-dba65054200f]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:34:51 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-4879496c-012e-4a4d-97e1-7910402721d0 tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:34:51 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:34:51 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:34:51 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[6361d9b0-6ac6-4e9c-bd25-c389de5fef73]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9c3ac6d-d72a-41c8-9c18-15131250e323 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b2a3b04-13be-4853-822c-29c416757252 (non-flash)\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:34:51 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-4879496c-012e-4a4d-97e1-7910402721d0 tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab (non-flash)
Nov 08 23:34:51 user nova-compute[75045]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9c3ac6d-d72a-41c8-9c18-15131250e323 (non-flash)
Nov 08 23:34:51 user nova-compute[75045]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b2a3b04-13be-4853-822c-29c416757252 (non-flash)
Nov 08 23:34:51 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 23:34:51 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-4879496c-012e-4a4d-97e1-7910402721d0 tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab (non-flash)
Nov 08 23:34:51 user nova-compute[75045]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9c3ac6d-d72a-41c8-9c18-15131250e323 (non-flash)
Nov 08 23:34:51 user nova-compute[75045]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b2a3b04-13be-4853-822c-29c416757252 (non-flash)
Nov 08 23:34:51 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 23:34:51 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4fd05cc1-4e93-4804-ab93-57b0435dacea -p 172.16.0.220:3260 --login {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:34:52 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4fd05cc1-4e93-4804-ab93-57b0435dacea -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:34:52 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[97090ef8-30aa-43e7-a828-6881fb608d26]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4fd05cc1-4e93-4804-ab93-57b0435dacea, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4fd05cc1-4e93-4804-ab93-57b0435dacea, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:34:52 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-4879496c-012e-4a4d-97e1-7910402721d0 tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4fd05cc1-4e93-4804-ab93-57b0435dacea, portal: 172.16.0.220,3260]
Nov 08 23:34:52 user nova-compute[75045]: Login to [iface: default, target: iqn.2010-10.org.openstack:4fd05cc1-4e93-4804-ab93-57b0435dacea, portal: 172.16.0.220,3260] successful.
Nov 08 23:34:52 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:34:52 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4fd05cc1-4e93-4804-ab93-57b0435dacea -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:34:52 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4fd05cc1-4e93-4804-ab93-57b0435dacea -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:34:52 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[70c5580d-84ff-4f95-bc9e-2274d37c1bc0]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:34:52 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-4879496c-012e-4a4d-97e1-7910402721d0 tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:34:52 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:34:52 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:34:52 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[723fb8b5-5059-4176-bb4d-db22ef7d4982]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9c3ac6d-d72a-41c8-9c18-15131250e323 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b2a3b04-13be-4853-822c-29c416757252 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fd05cc1-4e93-4804-ab93-57b0435dacea (non-flash)\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:34:52 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-4879496c-012e-4a4d-97e1-7910402721d0 tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab (non-flash)
Nov 08 23:34:52 user nova-compute[75045]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9c3ac6d-d72a-41c8-9c18-15131250e323 (non-flash)
Nov 08 23:34:52 user nova-compute[75045]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b2a3b04-13be-4853-822c-29c416757252 (non-flash)
Nov 08 23:34:52 user nova-compute[75045]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fd05cc1-4e93-4804-ab93-57b0435dacea (non-flash)
Nov 08 23:34:52 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 23:34:52 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-4879496c-012e-4a4d-97e1-7910402721d0 tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab (non-flash)
Nov 08 23:34:52 user nova-compute[75045]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9c3ac6d-d72a-41c8-9c18-15131250e323 (non-flash)
Nov 08 23:34:52 user nova-compute[75045]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b2a3b04-13be-4853-822c-29c416757252 (non-flash)
Nov 08 23:34:52 user nova-compute[75045]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fd05cc1-4e93-4804-ab93-57b0435dacea (non-flash)
Nov 08 23:34:52 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 23:34:52 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-4879496c-012e-4a4d-97e1-7910402721d0 tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4fd05cc1-4e93-4804-ab93-57b0435dacea" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.409s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 23:34:52 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-4879496c-012e-4a4d-97e1-7910402721d0 tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] Connected to 172.16.0.220:3260 {{(pid=75045) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 23:34:52 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-4879496c-012e-4a4d-97e1-7910402721d0 tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] HCTL ('35', '-', '-', 0) found on session 35 with lun 0 {{(pid=75045) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 23:34:52 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-4879496c-012e-4a4d-97e1-7910402721d0 tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75045) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 23:34:52 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa67b237-f598-4111-87ba-d761aa50d95e/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:34:52 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:34:52 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78955913-bbab-4b00-bc9b-12116f249d7e/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:34:52 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.019s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:34:52 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ec64102-659a-4cac-8a96-4cec76d11b53]: (4, ('- - 0', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:34:52 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-4879496c-012e-4a4d-97e1-7910402721d0 tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] Searching for a device in session 35 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75045) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 23:34:52 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-4879496c-012e-4a4d-97e1-7910402721d0 tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:4fd05cc1-4e93-4804-ab93-57b0435dacea', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jTPwrenI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75045) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 23:34:52 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78955913-bbab-4b00-bc9b-12116f249d7e/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:34:52 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78955913-bbab-4b00-bc9b-12116f249d7e/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:34:52 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78955913-bbab-4b00-bc9b-12116f249d7e/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:34:52 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9222e62a-9fd8-48b2-a125-83c9cdc589bd/disk.rescue --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:34:52 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9222e62a-9fd8-48b2-a125-83c9cdc589bd/disk.rescue --force-share --output=json" returned: 0 in 0.175s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:34:52 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9222e62a-9fd8-48b2-a125-83c9cdc589bd/disk.rescue --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:34:52 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9222e62a-9fd8-48b2-a125-83c9cdc589bd/disk.rescue --force-share --output=json" returned: 0 in 0.228s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:34:52 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] skipping disk /opt/stack/data/nova/instances/9222e62a-9fd8-48b2-a125-83c9cdc589bd/disk (vdb) as it is a volume {{(pid=75045) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 23:34:52 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75045) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 23:34:52 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5fc7f02-2143-4bcf-92ac-078d5ec10747/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:34:53 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5fc7f02-2143-4bcf-92ac-078d5ec10747/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:34:53 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5fc7f02-2143-4bcf-92ac-078d5ec10747/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:34:53 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-4879496c-012e-4a4d-97e1-7910402721d0 tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.505s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 23:34:53 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-4879496c-012e-4a4d-97e1-7910402721d0 tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] <== connect_volume: return (1509ms) {'type': 'block', 'scsi_wwn': '26236313361313633', 'path': '/dev/sdd'} {{(pid=75045) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 23:34:53 user nova-compute[75045]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4879496c-012e-4a4d-97e1-7910402721d0 tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] [instance: adcffd35-00c7-49db-a72f-d6307a90e123] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26236313361313633', 'path': '/dev/sdd'} {{(pid=75045) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 23:34:53 user nova-compute[75045]: DEBUG nova.objects.instance [None req-4879496c-012e-4a4d-97e1-7910402721d0 tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] Lazy-loading 'flavor' on Instance uuid adcffd35-00c7-49db-a72f-d6307a90e123 {{(pid=75045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 23:34:53 user nova-compute[75045]: DEBUG nova.virt.libvirt.guest [None req-4879496c-012e-4a4d-97e1-7910402721d0 tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] attach device xml: <disk type="block" device="disk">
Nov 08 23:34:53 user nova-compute[75045]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 23:34:53 user nova-compute[75045]:   <source dev="/dev/sdd"/>
Nov 08 23:34:53 user nova-compute[75045]:   <target dev="vdb" bus="virtio"/>
Nov 08 23:34:53 user nova-compute[75045]:   <serial>4fd05cc1-4e93-4804-ab93-57b0435dacea</serial>
Nov 08 23:34:53 user nova-compute[75045]: </disk>
Nov 08 23:34:53 user nova-compute[75045]:  {{(pid=75045) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 08 23:34:53 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5fc7f02-2143-4bcf-92ac-078d5ec10747/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:34:53 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/adcffd35-00c7-49db-a72f-d6307a90e123/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:34:53 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-4879496c-012e-4a4d-97e1-7910402721d0 tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] No BDM found with device name vda, not building metadata. {{(pid=75045) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 23:34:53 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-4879496c-012e-4a4d-97e1-7910402721d0 tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75045) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 23:34:53 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-4879496c-012e-4a4d-97e1-7910402721d0 tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] No VIF found with MAC fa:16:3e:60:a2:7b, not building metadata {{(pid=75045) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 23:34:53 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/adcffd35-00c7-49db-a72f-d6307a90e123/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:34:53 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/adcffd35-00c7-49db-a72f-d6307a90e123/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:34:53 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-4879496c-012e-4a4d-97e1-7910402721d0 tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] Lock "adcffd35-00c7-49db-a72f-d6307a90e123" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 47.070s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:34:53 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/adcffd35-00c7-49db-a72f-d6307a90e123/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:34:53 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b84f2b1-01a3-4789-bcef-8b7c4334132b/disk.rescue --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:34:54 user nova-compute[75045]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6df7140e-4504-4424-af8e-7de4f494f8b1 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] [instance: a63971de-a2bf-4e58-a760-30eaec3b83c0] Calling os-brick to attach iSCSI Volume {{(pid=75045) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 23:34:54 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-6df7140e-4504-4424-af8e-7de4f494f8b1 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1b68210460>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:40af8977-0ce5-4509-93f8-b6c6349aed86', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SDpFrqzg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75045) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 23:34:54 user nova-compute[75045]: WARNING os_brick.initiator.connectors.base [None req-6df7140e-4504-4424-af8e-7de4f494f8b1 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 23:34:54 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-6df7140e-4504-4424-af8e-7de4f494f8b1 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 23:34:54 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-6df7140e-4504-4424-af8e-7de4f494f8b1 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 23:34:54 user nova-compute[75045]: WARNING os_brick.initiator.connectors.base [None req-6df7140e-4504-4424-af8e-7de4f494f8b1 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 23:34:54 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-6df7140e-4504-4424-af8e-7de4f494f8b1 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:40af8977-0ce5-4509-93f8-b6c6349aed86" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 23:34:54 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-6df7140e-4504-4424-af8e-7de4f494f8b1 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:40af8977-0ce5-4509-93f8-b6c6349aed86" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 23:34:54 user nova-compute[75045]: INFO os_brick.initiator.connectors.iscsi [None req-6df7140e-4504-4424-af8e-7de4f494f8b1 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 23:34:54 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:40af8977-0ce5-4509-93f8-b6c6349aed86 -p 172.16.0.220:3260 {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:34:54 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:40af8977-0ce5-4509-93f8-b6c6349aed86 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:34:54 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee4861bd-5a79-42bd-a5f5-cf7768d49d62]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:34:54 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-6df7140e-4504-4424-af8e-7de4f494f8b1 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 23:34:54 user nova-compute[75045]:  {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:34:54 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:40af8977-0ce5-4509-93f8-b6c6349aed86 -p 172.16.0.220:3260 --interface default --op new {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:34:54 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:40af8977-0ce5-4509-93f8-b6c6349aed86 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:34:54 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[695d48f7-fa9d-4375-9668-935181ecc7ea]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:40af8977-0ce5-4509-93f8-b6c6349aed86] added\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:34:54 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-6df7140e-4504-4424-af8e-7de4f494f8b1 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:40af8977-0ce5-4509-93f8-b6c6349aed86] added
Nov 08 23:34:54 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:34:54 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:40af8977-0ce5-4509-93f8-b6c6349aed86 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:34:54 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b84f2b1-01a3-4789-bcef-8b7c4334132b/disk.rescue --force-share --output=json" returned: 0 in 0.212s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:34:54 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b84f2b1-01a3-4789-bcef-8b7c4334132b/disk.rescue --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:34:54 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:40af8977-0ce5-4509-93f8-b6c6349aed86 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:34:54 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[87e235de-cac2-4628-bf59-c151553e6b0a]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:34:54 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-6df7140e-4504-4424-af8e-7de4f494f8b1 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:34:54 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:40af8977-0ce5-4509-93f8-b6c6349aed86 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:34:54 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:40af8977-0ce5-4509-93f8-b6c6349aed86 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:34:54 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c6b98a9-f391-4457-9422-cdf46b7038d5]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:34:54 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-6df7140e-4504-4424-af8e-7de4f494f8b1 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:34:54 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:40af8977-0ce5-4509-93f8-b6c6349aed86 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SDpFrqzg {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:34:54 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:40af8977-0ce5-4509-93f8-b6c6349aed86 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SDpFrqzg" returned: 0 in 0.019s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:34:54 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd9a0633-de23-4732-b7b7-3fba5e743628]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:34:54 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-6df7140e-4504-4424-af8e-7de4f494f8b1 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'SDpFrqzg'): stdout= stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:34:54 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:40af8977-0ce5-4509-93f8-b6c6349aed86 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:34:54 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:40af8977-0ce5-4509-93f8-b6c6349aed86 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:34:54 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2648557-b416-4004-a3b9-d717e0e9b498]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:34:54 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-6df7140e-4504-4424-af8e-7de4f494f8b1 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:34:54 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:34:54 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:34:54 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[b29c8a30-e6bf-4218-966d-a6167ee7a465]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9c3ac6d-d72a-41c8-9c18-15131250e323 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b2a3b04-13be-4853-822c-29c416757252 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fd05cc1-4e93-4804-ab93-57b0435dacea (non-flash)\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:34:54 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-6df7140e-4504-4424-af8e-7de4f494f8b1 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab (non-flash)
Nov 08 23:34:54 user nova-compute[75045]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9c3ac6d-d72a-41c8-9c18-15131250e323 (non-flash)
Nov 08 23:34:54 user nova-compute[75045]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b2a3b04-13be-4853-822c-29c416757252 (non-flash)
Nov 08 23:34:54 user nova-compute[75045]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fd05cc1-4e93-4804-ab93-57b0435dacea (non-flash)
Nov 08 23:34:54 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 23:34:54 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-6df7140e-4504-4424-af8e-7de4f494f8b1 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab (non-flash)
Nov 08 23:34:54 user nova-compute[75045]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9c3ac6d-d72a-41c8-9c18-15131250e323 (non-flash)
Nov 08 23:34:54 user nova-compute[75045]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b2a3b04-13be-4853-822c-29c416757252 (non-flash)
Nov 08 23:34:54 user nova-compute[75045]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fd05cc1-4e93-4804-ab93-57b0435dacea (non-flash)
Nov 08 23:34:54 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 23:34:54 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:40af8977-0ce5-4509-93f8-b6c6349aed86 -p 172.16.0.220:3260 --login {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:34:54 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b84f2b1-01a3-4789-bcef-8b7c4334132b/disk.rescue --force-share --output=json" returned: 0 in 0.204s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:34:54 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b84f2b1-01a3-4789-bcef-8b7c4334132b/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:34:54 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:40af8977-0ce5-4509-93f8-b6c6349aed86 -p 172.16.0.220:3260 --login" returned: 0 in 0.072s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:34:54 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b35e4bd-54e1-42a4-a2e5-2cc57af2e90a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:40af8977-0ce5-4509-93f8-b6c6349aed86, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:40af8977-0ce5-4509-93f8-b6c6349aed86, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:34:54 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-6df7140e-4504-4424-af8e-7de4f494f8b1 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:40af8977-0ce5-4509-93f8-b6c6349aed86, portal: 172.16.0.220,3260]
Nov 08 23:34:54 user nova-compute[75045]: Login to [iface: default, target: iqn.2010-10.org.openstack:40af8977-0ce5-4509-93f8-b6c6349aed86, portal: 172.16.0.220,3260] successful.
Nov 08 23:34:54 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:34:54 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:40af8977-0ce5-4509-93f8-b6c6349aed86 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:34:54 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:40af8977-0ce5-4509-93f8-b6c6349aed86 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.073s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:34:54 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[43c464b2-11da-46f9-bcda-d277ca6c25a4]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:34:54 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-6df7140e-4504-4424-af8e-7de4f494f8b1 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:34:54 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:34:54 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:34:54 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dccfeb9-c895-42db-bd76-aa1baaadba0c]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9c3ac6d-d72a-41c8-9c18-15131250e323 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b2a3b04-13be-4853-822c-29c416757252 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fd05cc1-4e93-4804-ab93-57b0435dacea (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40af8977-0ce5-4509-93f8-b6c6349aed86 (non-flash)\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:34:54 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-6df7140e-4504-4424-af8e-7de4f494f8b1 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab (non-flash)
Nov 08 23:34:54 user nova-compute[75045]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9c3ac6d-d72a-41c8-9c18-15131250e323 (non-flash)
Nov 08 23:34:54 user nova-compute[75045]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b2a3b04-13be-4853-822c-29c416757252 (non-flash)
Nov 08 23:34:54 user nova-compute[75045]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fd05cc1-4e93-4804-ab93-57b0435dacea (non-flash)
Nov 08 23:34:54 user nova-compute[75045]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40af8977-0ce5-4509-93f8-b6c6349aed86 (non-flash)
Nov 08 23:34:54 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 23:34:54 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-6df7140e-4504-4424-af8e-7de4f494f8b1 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab (non-flash)
Nov 08 23:34:54 user nova-compute[75045]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9c3ac6d-d72a-41c8-9c18-15131250e323 (non-flash)
Nov 08 23:34:54 user nova-compute[75045]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b2a3b04-13be-4853-822c-29c416757252 (non-flash)
Nov 08 23:34:54 user nova-compute[75045]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fd05cc1-4e93-4804-ab93-57b0435dacea (non-flash)
Nov 08 23:34:54 user nova-compute[75045]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40af8977-0ce5-4509-93f8-b6c6349aed86 (non-flash)
Nov 08 23:34:54 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 23:34:54 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-6df7140e-4504-4424-af8e-7de4f494f8b1 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:40af8977-0ce5-4509-93f8-b6c6349aed86" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.443s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 23:34:54 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-6df7140e-4504-4424-af8e-7de4f494f8b1 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Connected to 172.16.0.220:3260 {{(pid=75045) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 23:34:54 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-6df7140e-4504-4424-af8e-7de4f494f8b1 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] HCTL ('36', '-', '-', 0) found on session 36 with lun 0 {{(pid=75045) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 23:34:54 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-6df7140e-4504-4424-af8e-7de4f494f8b1 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75045) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 23:34:54 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:34:54 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.017s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:34:54 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0a63319-89fc-4361-a983-554822814627]: (4, ('- - 0', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:34:54 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-6df7140e-4504-4424-af8e-7de4f494f8b1 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Searching for a device in session 36 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75045) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 23:34:54 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-6df7140e-4504-4424-af8e-7de4f494f8b1 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:40af8977-0ce5-4509-93f8-b6c6349aed86', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SDpFrqzg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75045) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 23:34:54 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b84f2b1-01a3-4789-bcef-8b7c4334132b/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:34:54 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b84f2b1-01a3-4789-bcef-8b7c4334132b/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:34:54 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b84f2b1-01a3-4789-bcef-8b7c4334132b/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:34:55 user nova-compute[75045]: WARNING nova.virt.libvirt.driver [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 23:34:55 user nova-compute[75045]: WARNING nova.virt.libvirt.driver [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 23:34:55 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Hypervisor/Node resource view: name=user free_ram=7433MB free_disk=24.782485961914062GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75045) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 23:34:55 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:34:55 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.002s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:34:55 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Instance 4ae5ff6b-6f2c-4dfd-a4c6-da4809e2cf27 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75045) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 23:34:55 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Instance 0f21fcd3-ac5f-499e-9c34-82af806fda1d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75045) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 23:34:55 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Instance d2c911cf-d5f4-4c19-8335-8c7834184a7e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75045) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 23:34:55 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Instance b5fc7f02-2143-4bcf-92ac-078d5ec10747 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75045) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 23:34:55 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Instance 0b84f2b1-01a3-4789-bcef-8b7c4334132b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75045) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 23:34:55 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Instance fa67b237-f598-4111-87ba-d761aa50d95e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75045) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 23:34:55 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Instance 72c9d731-2b35-434c-8463-1cd6c18fbd6a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75045) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 23:34:55 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Instance adcffd35-00c7-49db-a72f-d6307a90e123 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75045) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 23:34:55 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Instance 04169f59-e9a6-4b50-9ad7-7f8c105a376a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75045) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 23:34:55 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Instance 9222e62a-9fd8-48b2-a125-83c9cdc589bd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75045) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 23:34:55 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Instance a63971de-a2bf-4e58-a760-30eaec3b83c0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75045) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 23:34:55 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Instance 78955913-bbab-4b00-bc9b-12116f249d7e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75045) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 23:34:55 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=75045) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 23:34:55 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Final resource view: name=user phys_ram=16011MB used_ram=8192MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=75045) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 23:34:55 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-6df7140e-4504-4424-af8e-7de4f494f8b1 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.490s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 23:34:55 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-6df7140e-4504-4424-af8e-7de4f494f8b1 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] <== connect_volume: return (1494ms) {'type': 'block', 'scsi_wwn': '26238653437356561', 'path': '/dev/sde'} {{(pid=75045) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 23:34:55 user nova-compute[75045]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6df7140e-4504-4424-af8e-7de4f494f8b1 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] [instance: a63971de-a2bf-4e58-a760-30eaec3b83c0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26238653437356561', 'path': '/dev/sde'} {{(pid=75045) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 23:34:55 user nova-compute[75045]: DEBUG nova.objects.instance [None req-6df7140e-4504-4424-af8e-7de4f494f8b1 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Lazy-loading 'flavor' on Instance uuid a63971de-a2bf-4e58-a760-30eaec3b83c0 {{(pid=75045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 23:34:55 user nova-compute[75045]: DEBUG nova.virt.libvirt.guest [None req-6df7140e-4504-4424-af8e-7de4f494f8b1 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] attach device xml: <disk type="block" device="disk">
Nov 08 23:34:55 user nova-compute[75045]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 23:34:55 user nova-compute[75045]:   <source dev="/dev/sde"/>
Nov 08 23:34:55 user nova-compute[75045]:   <target dev="vdb" bus="virtio"/>
Nov 08 23:34:55 user nova-compute[75045]:   <serial>40af8977-0ce5-4509-93f8-b6c6349aed86</serial>
Nov 08 23:34:55 user nova-compute[75045]: </disk>
Nov 08 23:34:55 user nova-compute[75045]:  {{(pid=75045) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 08 23:34:55 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-416d7513-0465-4e88-bcb0-a155bb6d06f3 tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] Acquiring lock "adcffd35-00c7-49db-a72f-d6307a90e123" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:34:55 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-416d7513-0465-4e88-bcb0-a155bb6d06f3 tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] Lock "adcffd35-00c7-49db-a72f-d6307a90e123" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:34:55 user nova-compute[75045]: INFO nova.compute.manager [None req-416d7513-0465-4e88-bcb0-a155bb6d06f3 tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] [instance: adcffd35-00c7-49db-a72f-d6307a90e123] Detaching volume 4fd05cc1-4e93-4804-ab93-57b0435dacea
Nov 08 23:34:56 user nova-compute[75045]: DEBUG nova.compute.provider_tree [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Inventory has not changed in ProviderTree for provider: 62ba5f85-c74d-4b58-986e-d4197e813fd7 {{(pid=75045) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 23:34:56 user nova-compute[75045]: DEBUG nova.scheduler.client.report [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Inventory has not changed for provider 62ba5f85-c74d-4b58-986e-d4197e813fd7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75045) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 23:34:56 user nova-compute[75045]: INFO nova.virt.block_device [None req-416d7513-0465-4e88-bcb0-a155bb6d06f3 tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] [instance: adcffd35-00c7-49db-a72f-d6307a90e123] Attempting to driver detach volume 4fd05cc1-4e93-4804-ab93-57b0435dacea from mountpoint /dev/vdb
Nov 08 23:34:56 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-416d7513-0465-4e88-bcb0-a155bb6d06f3 tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] Attempting to detach device vdb from instance adcffd35-00c7-49db-a72f-d6307a90e123 from the persistent domain config. {{(pid=75045) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 08 23:34:56 user nova-compute[75045]: DEBUG nova.virt.libvirt.guest [None req-416d7513-0465-4e88-bcb0-a155bb6d06f3 tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 23:34:56 user nova-compute[75045]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 23:34:56 user nova-compute[75045]:   <source dev="/dev/sdd"/>
Nov 08 23:34:56 user nova-compute[75045]:   <target dev="vdb" bus="virtio"/>
Nov 08 23:34:56 user nova-compute[75045]:   <serial>4fd05cc1-4e93-4804-ab93-57b0435dacea</serial>
Nov 08 23:34:56 user nova-compute[75045]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 08 23:34:56 user nova-compute[75045]: </disk>
Nov 08 23:34:56 user nova-compute[75045]:  {{(pid=75045) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 23:34:56 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Compute_service record updated for user:user {{(pid=75045) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 23:34:56 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.909s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:34:56 user nova-compute[75045]: INFO nova.virt.libvirt.driver [None req-416d7513-0465-4e88-bcb0-a155bb6d06f3 tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] Successfully detached device vdb from instance adcffd35-00c7-49db-a72f-d6307a90e123 from the persistent domain config.
Nov 08 23:34:56 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-416d7513-0465-4e88-bcb0-a155bb6d06f3 tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance adcffd35-00c7-49db-a72f-d6307a90e123 from the live domain config. {{(pid=75045) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 08 23:34:56 user nova-compute[75045]: DEBUG nova.virt.libvirt.guest [None req-416d7513-0465-4e88-bcb0-a155bb6d06f3 tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 23:34:56 user nova-compute[75045]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 23:34:56 user nova-compute[75045]:   <source dev="/dev/sdd"/>
Nov 08 23:34:56 user nova-compute[75045]:   <target dev="vdb" bus="virtio"/>
Nov 08 23:34:56 user nova-compute[75045]:   <serial>4fd05cc1-4e93-4804-ab93-57b0435dacea</serial>
Nov 08 23:34:56 user nova-compute[75045]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 08 23:34:56 user nova-compute[75045]: </disk>
Nov 08 23:34:56 user nova-compute[75045]:  {{(pid=75045) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 23:34:56 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:34:56 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-6df7140e-4504-4424-af8e-7de4f494f8b1 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] No BDM found with device name vda, not building metadata. {{(pid=75045) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 23:34:56 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-6df7140e-4504-4424-af8e-7de4f494f8b1 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75045) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 23:34:56 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-6df7140e-4504-4424-af8e-7de4f494f8b1 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] No VIF found with MAC fa:16:3e:b4:db:58, not building metadata {{(pid=75045) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 23:34:56 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:34:56 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-6df7140e-4504-4424-af8e-7de4f494f8b1 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Lock "a63971de-a2bf-4e58-a760-30eaec3b83c0" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 31.935s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:34:56 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-416d7513-0465-4e88-bcb0-a155bb6d06f3 tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance adcffd35-00c7-49db-a72f-d6307a90e123 {{(pid=75045) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 08 23:34:57 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-16fd8de7-d112-469e-aa64-55a99c6828da tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Acquiring lock "a63971de-a2bf-4e58-a760-30eaec3b83c0" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:34:57 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-16fd8de7-d112-469e-aa64-55a99c6828da tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Lock "a63971de-a2bf-4e58-a760-30eaec3b83c0" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:34:57 user nova-compute[75045]: INFO nova.compute.manager [None req-16fd8de7-d112-469e-aa64-55a99c6828da tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] [instance: a63971de-a2bf-4e58-a760-30eaec3b83c0] Detaching volume 40af8977-0ce5-4509-93f8-b6c6349aed86
Nov 08 23:34:57 user nova-compute[75045]: INFO nova.virt.block_device [None req-16fd8de7-d112-469e-aa64-55a99c6828da tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] [instance: a63971de-a2bf-4e58-a760-30eaec3b83c0] Attempting to driver detach volume 40af8977-0ce5-4509-93f8-b6c6349aed86 from mountpoint /dev/vdb
Nov 08 23:34:57 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-16fd8de7-d112-469e-aa64-55a99c6828da tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Attempting to detach device vdb from instance a63971de-a2bf-4e58-a760-30eaec3b83c0 from the persistent domain config. {{(pid=75045) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 08 23:34:57 user nova-compute[75045]: DEBUG nova.virt.libvirt.guest [None req-16fd8de7-d112-469e-aa64-55a99c6828da tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 23:34:57 user nova-compute[75045]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 23:34:57 user nova-compute[75045]:   <source dev="/dev/sde"/>
Nov 08 23:34:57 user nova-compute[75045]:   <target dev="vdb" bus="virtio"/>
Nov 08 23:34:57 user nova-compute[75045]:   <serial>40af8977-0ce5-4509-93f8-b6c6349aed86</serial>
Nov 08 23:34:57 user nova-compute[75045]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 08 23:34:57 user nova-compute[75045]: </disk>
Nov 08 23:34:57 user nova-compute[75045]:  {{(pid=75045) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 23:34:57 user nova-compute[75045]: INFO nova.virt.libvirt.driver [None req-16fd8de7-d112-469e-aa64-55a99c6828da tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Successfully detached device vdb from instance a63971de-a2bf-4e58-a760-30eaec3b83c0 from the persistent domain config.
Nov 08 23:34:57 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-16fd8de7-d112-469e-aa64-55a99c6828da tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance a63971de-a2bf-4e58-a760-30eaec3b83c0 from the live domain config. {{(pid=75045) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 08 23:34:57 user nova-compute[75045]: DEBUG nova.virt.libvirt.guest [None req-16fd8de7-d112-469e-aa64-55a99c6828da tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 23:34:57 user nova-compute[75045]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 23:34:57 user nova-compute[75045]:   <source dev="/dev/sde"/>
Nov 08 23:34:57 user nova-compute[75045]:   <target dev="vdb" bus="virtio"/>
Nov 08 23:34:57 user nova-compute[75045]:   <serial>40af8977-0ce5-4509-93f8-b6c6349aed86</serial>
Nov 08 23:34:57 user nova-compute[75045]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 08 23:34:57 user nova-compute[75045]: </disk>
Nov 08 23:34:57 user nova-compute[75045]:  {{(pid=75045) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 23:34:57 user nova-compute[75045]: DEBUG nova.compute.manager [req-a9fe9a0d-590a-4ebf-8a3e-43e8d6d81e7c req-a7a2156f-811c-43de-93b3-c000e3c95be9 service nova] [instance: 78955913-bbab-4b00-bc9b-12116f249d7e] Received event network-changed-fc66a792-914f-48c4-ae57-cbda1615ff0b {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:34:57 user nova-compute[75045]: DEBUG nova.compute.manager [req-a9fe9a0d-590a-4ebf-8a3e-43e8d6d81e7c req-a7a2156f-811c-43de-93b3-c000e3c95be9 service nova] [instance: 78955913-bbab-4b00-bc9b-12116f249d7e] Refreshing instance network info cache due to event network-changed-fc66a792-914f-48c4-ae57-cbda1615ff0b. {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 23:34:57 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-a9fe9a0d-590a-4ebf-8a3e-43e8d6d81e7c req-a7a2156f-811c-43de-93b3-c000e3c95be9 service nova] Acquiring lock "refresh_cache-78955913-bbab-4b00-bc9b-12116f249d7e" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 23:34:57 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-a9fe9a0d-590a-4ebf-8a3e-43e8d6d81e7c req-a7a2156f-811c-43de-93b3-c000e3c95be9 service nova] Acquired lock "refresh_cache-78955913-bbab-4b00-bc9b-12116f249d7e" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 23:34:57 user nova-compute[75045]: DEBUG nova.network.neutron [req-a9fe9a0d-590a-4ebf-8a3e-43e8d6d81e7c req-a7a2156f-811c-43de-93b3-c000e3c95be9 service nova] [instance: 78955913-bbab-4b00-bc9b-12116f249d7e] Refreshing network info cache for port fc66a792-914f-48c4-ae57-cbda1615ff0b {{(pid=75045) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 23:34:57 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-16fd8de7-d112-469e-aa64-55a99c6828da tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance a63971de-a2bf-4e58-a760-30eaec3b83c0 {{(pid=75045) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 08 23:34:58 user nova-compute[75045]: DEBUG nova.network.neutron [req-a9fe9a0d-590a-4ebf-8a3e-43e8d6d81e7c req-a7a2156f-811c-43de-93b3-c000e3c95be9 service nova] [instance: 78955913-bbab-4b00-bc9b-12116f249d7e] Updated VIF entry in instance network info cache for port fc66a792-914f-48c4-ae57-cbda1615ff0b. {{(pid=75045) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 23:34:58 user nova-compute[75045]: DEBUG nova.network.neutron [req-a9fe9a0d-590a-4ebf-8a3e-43e8d6d81e7c req-a7a2156f-811c-43de-93b3-c000e3c95be9 service nova] [instance: 78955913-bbab-4b00-bc9b-12116f249d7e] Updating instance_info_cache with network_info: [{"id": "fc66a792-914f-48c4-ae57-cbda1615ff0b", "address": "fa:16:3e:58:00:3d", "network": {"id": "1b10bc53-ef32-4f01-82f6-ed9f95f7e3f2", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-518782773-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.43", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ad736027d034259a052da3f62bd575f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc66a792-91", "ovs_interfaceid": "fc66a792-914f-48c4-ae57-cbda1615ff0b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75045) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 23:34:58 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-a9fe9a0d-590a-4ebf-8a3e-43e8d6d81e7c req-a7a2156f-811c-43de-93b3-c000e3c95be9 service nova] Releasing lock "refresh_cache-78955913-bbab-4b00-bc9b-12116f249d7e" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 23:35:01 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:35:01 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:35:05 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-54bffcb0-0f52-4eba-8958-5ece89f6c811 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] Acquiring lock "78955913-bbab-4b00-bc9b-12116f249d7e" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:35:05 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-54bffcb0-0f52-4eba-8958-5ece89f6c811 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] Lock "78955913-bbab-4b00-bc9b-12116f249d7e" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:35:05 user nova-compute[75045]: INFO nova.compute.manager [None req-54bffcb0-0f52-4eba-8958-5ece89f6c811 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] [instance: 78955913-bbab-4b00-bc9b-12116f249d7e] Shelving
Nov 08 23:35:05 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:35:06 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:35:06 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:35:06 user nova-compute[75045]: DEBUG nova.compute.manager [req-6eae4e0d-45fc-41a0-a400-644f983911fd req-3b6cf8b7-2e2b-4e84-9262-de716c64d1fe service nova] [instance: 78955913-bbab-4b00-bc9b-12116f249d7e] Received event network-vif-unplugged-fc66a792-914f-48c4-ae57-cbda1615ff0b {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:35:06 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-6eae4e0d-45fc-41a0-a400-644f983911fd req-3b6cf8b7-2e2b-4e84-9262-de716c64d1fe service nova] Acquiring lock "78955913-bbab-4b00-bc9b-12116f249d7e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:35:06 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-6eae4e0d-45fc-41a0-a400-644f983911fd req-3b6cf8b7-2e2b-4e84-9262-de716c64d1fe service nova] Lock "78955913-bbab-4b00-bc9b-12116f249d7e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:35:06 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-6eae4e0d-45fc-41a0-a400-644f983911fd req-3b6cf8b7-2e2b-4e84-9262-de716c64d1fe service nova] Lock "78955913-bbab-4b00-bc9b-12116f249d7e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:35:06 user nova-compute[75045]: DEBUG nova.compute.manager [req-6eae4e0d-45fc-41a0-a400-644f983911fd req-3b6cf8b7-2e2b-4e84-9262-de716c64d1fe service nova] [instance: 78955913-bbab-4b00-bc9b-12116f249d7e] No waiting events found dispatching network-vif-unplugged-fc66a792-914f-48c4-ae57-cbda1615ff0b {{(pid=75045) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 23:35:06 user nova-compute[75045]: WARNING nova.compute.manager [req-6eae4e0d-45fc-41a0-a400-644f983911fd req-3b6cf8b7-2e2b-4e84-9262-de716c64d1fe service nova] [instance: 78955913-bbab-4b00-bc9b-12116f249d7e] Received unexpected event network-vif-unplugged-fc66a792-914f-48c4-ae57-cbda1615ff0b for instance with vm_state active and task_state shelving.
Nov 08 23:35:06 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:35:06 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:35:06 user nova-compute[75045]: INFO nova.virt.libvirt.driver [-] [instance: 78955913-bbab-4b00-bc9b-12116f249d7e] Instance destroyed successfully.
Nov 08 23:35:06 user nova-compute[75045]: INFO nova.virt.libvirt.driver [None req-54bffcb0-0f52-4eba-8958-5ece89f6c811 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] [instance: 78955913-bbab-4b00-bc9b-12116f249d7e] Beginning cold snapshot process
Nov 08 23:35:06 user nova-compute[75045]: DEBUG nova.privsep.utils [None req-54bffcb0-0f52-4eba-8958-5ece89f6c811 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75045) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 08 23:35:06 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-54bffcb0-0f52-4eba-8958-5ece89f6c811 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/78955913-bbab-4b00-bc9b-12116f249d7e/disk /opt/stack/data/nova/instances/snapshots/tmp_s_3_a_7/65f8f277fffb427ea55967a0b46e0c44 {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:35:07 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-54bffcb0-0f52-4eba-8958-5ece89f6c811 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/78955913-bbab-4b00-bc9b-12116f249d7e/disk /opt/stack/data/nova/instances/snapshots/tmp_s_3_a_7/65f8f277fffb427ea55967a0b46e0c44" returned: 0 in 0.904s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:35:07 user nova-compute[75045]: INFO nova.virt.libvirt.driver [None req-54bffcb0-0f52-4eba-8958-5ece89f6c811 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] [instance: 78955913-bbab-4b00-bc9b-12116f249d7e] Snapshot extracted, beginning image upload
Nov 08 23:35:08 user nova-compute[75045]: DEBUG nova.compute.manager [req-3b3d2b86-ca98-413f-974d-7d13f93e53bc req-1e703e4d-73ca-40ce-9c95-11653c0696c6 service nova] [instance: 78955913-bbab-4b00-bc9b-12116f249d7e] Received event network-vif-plugged-fc66a792-914f-48c4-ae57-cbda1615ff0b {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:35:08 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-3b3d2b86-ca98-413f-974d-7d13f93e53bc req-1e703e4d-73ca-40ce-9c95-11653c0696c6 service nova] Acquiring lock "78955913-bbab-4b00-bc9b-12116f249d7e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:35:08 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-3b3d2b86-ca98-413f-974d-7d13f93e53bc req-1e703e4d-73ca-40ce-9c95-11653c0696c6 service nova] Lock "78955913-bbab-4b00-bc9b-12116f249d7e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:35:08 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-3b3d2b86-ca98-413f-974d-7d13f93e53bc req-1e703e4d-73ca-40ce-9c95-11653c0696c6 service nova] Lock "78955913-bbab-4b00-bc9b-12116f249d7e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:35:08 user nova-compute[75045]: DEBUG nova.compute.manager [req-3b3d2b86-ca98-413f-974d-7d13f93e53bc req-1e703e4d-73ca-40ce-9c95-11653c0696c6 service nova] [instance: 78955913-bbab-4b00-bc9b-12116f249d7e] No waiting events found dispatching network-vif-plugged-fc66a792-914f-48c4-ae57-cbda1615ff0b {{(pid=75045) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 23:35:08 user nova-compute[75045]: WARNING nova.compute.manager [req-3b3d2b86-ca98-413f-974d-7d13f93e53bc req-1e703e4d-73ca-40ce-9c95-11653c0696c6 service nova] [instance: 78955913-bbab-4b00-bc9b-12116f249d7e] Received unexpected event network-vif-plugged-fc66a792-914f-48c4-ae57-cbda1615ff0b for instance with vm_state active and task_state shelving_image_uploading.
Nov 08 23:35:10 user nova-compute[75045]: INFO nova.virt.libvirt.driver [None req-54bffcb0-0f52-4eba-8958-5ece89f6c811 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] [instance: 78955913-bbab-4b00-bc9b-12116f249d7e] Snapshot image upload complete
Nov 08 23:35:10 user nova-compute[75045]: DEBUG nova.compute.manager [None req-54bffcb0-0f52-4eba-8958-5ece89f6c811 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] [instance: 78955913-bbab-4b00-bc9b-12116f249d7e] Checking state {{(pid=75045) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 23:35:10 user nova-compute[75045]: INFO nova.compute.manager [None req-54bffcb0-0f52-4eba-8958-5ece89f6c811 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] [instance: 78955913-bbab-4b00-bc9b-12116f249d7e] Shelve offloading
Nov 08 23:35:10 user nova-compute[75045]: INFO nova.virt.libvirt.driver [-] [instance: 78955913-bbab-4b00-bc9b-12116f249d7e] Instance destroyed successfully.
Nov 08 23:35:10 user nova-compute[75045]: DEBUG nova.compute.manager [None req-54bffcb0-0f52-4eba-8958-5ece89f6c811 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] [instance: 78955913-bbab-4b00-bc9b-12116f249d7e] Checking state {{(pid=75045) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 23:35:10 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-54bffcb0-0f52-4eba-8958-5ece89f6c811 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] Acquiring lock "refresh_cache-78955913-bbab-4b00-bc9b-12116f249d7e" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 23:35:10 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-54bffcb0-0f52-4eba-8958-5ece89f6c811 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] Acquired lock "refresh_cache-78955913-bbab-4b00-bc9b-12116f249d7e" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 23:35:10 user nova-compute[75045]: DEBUG nova.network.neutron [None req-54bffcb0-0f52-4eba-8958-5ece89f6c811 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] [instance: 78955913-bbab-4b00-bc9b-12116f249d7e] Building network info cache for instance {{(pid=75045) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 23:35:11 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-69d95d34-7bc0-49a4-a3ea-d58d9f7c32c2 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Acquiring lock "fa67b237-f598-4111-87ba-d761aa50d95e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:35:11 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-69d95d34-7bc0-49a4-a3ea-d58d9f7c32c2 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Lock "fa67b237-f598-4111-87ba-d761aa50d95e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:35:11 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-69d95d34-7bc0-49a4-a3ea-d58d9f7c32c2 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Acquiring lock "fa67b237-f598-4111-87ba-d761aa50d95e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:35:11 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-69d95d34-7bc0-49a4-a3ea-d58d9f7c32c2 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Lock "fa67b237-f598-4111-87ba-d761aa50d95e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:35:11 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-69d95d34-7bc0-49a4-a3ea-d58d9f7c32c2 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Lock "fa67b237-f598-4111-87ba-d761aa50d95e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:35:11 user nova-compute[75045]: INFO nova.compute.manager [None req-69d95d34-7bc0-49a4-a3ea-d58d9f7c32c2 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] [instance: fa67b237-f598-4111-87ba-d761aa50d95e] Terminating instance
Nov 08 23:35:11 user nova-compute[75045]: DEBUG nova.compute.manager [None req-69d95d34-7bc0-49a4-a3ea-d58d9f7c32c2 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] [instance: fa67b237-f598-4111-87ba-d761aa50d95e] Start destroying the instance on the hypervisor. {{(pid=75045) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 23:35:11 user nova-compute[75045]: DEBUG nova.network.neutron [None req-54bffcb0-0f52-4eba-8958-5ece89f6c811 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] [instance: 78955913-bbab-4b00-bc9b-12116f249d7e] Updating instance_info_cache with network_info: [{"id": "fc66a792-914f-48c4-ae57-cbda1615ff0b", "address": "fa:16:3e:58:00:3d", "network": {"id": "1b10bc53-ef32-4f01-82f6-ed9f95f7e3f2", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-518782773-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.43", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ad736027d034259a052da3f62bd575f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc66a792-91", "ovs_interfaceid": "fc66a792-914f-48c4-ae57-cbda1615ff0b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75045) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 23:35:11 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-54bffcb0-0f52-4eba-8958-5ece89f6c811 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] Releasing lock "refresh_cache-78955913-bbab-4b00-bc9b-12116f249d7e" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 23:35:11 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:35:11 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:35:11 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:35:11 user nova-compute[75045]: DEBUG nova.compute.manager [req-4790cdac-0f11-4aef-9543-92f6214b0253 req-7f8f7a7f-d50f-4743-9909-569653e8046c service nova] [instance: fa67b237-f598-4111-87ba-d761aa50d95e] Received event network-vif-unplugged-3682fa30-ac2a-4ef9-ad3d-130a38539b80 {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:35:11 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-4790cdac-0f11-4aef-9543-92f6214b0253 req-7f8f7a7f-d50f-4743-9909-569653e8046c service nova] Acquiring lock "fa67b237-f598-4111-87ba-d761aa50d95e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:35:11 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-4790cdac-0f11-4aef-9543-92f6214b0253 req-7f8f7a7f-d50f-4743-9909-569653e8046c service nova] Lock "fa67b237-f598-4111-87ba-d761aa50d95e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:35:11 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-4790cdac-0f11-4aef-9543-92f6214b0253 req-7f8f7a7f-d50f-4743-9909-569653e8046c service nova] Lock "fa67b237-f598-4111-87ba-d761aa50d95e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:35:11 user nova-compute[75045]: DEBUG nova.compute.manager [req-4790cdac-0f11-4aef-9543-92f6214b0253 req-7f8f7a7f-d50f-4743-9909-569653e8046c service nova] [instance: fa67b237-f598-4111-87ba-d761aa50d95e] No waiting events found dispatching network-vif-unplugged-3682fa30-ac2a-4ef9-ad3d-130a38539b80 {{(pid=75045) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 23:35:11 user nova-compute[75045]: DEBUG nova.compute.manager [req-4790cdac-0f11-4aef-9543-92f6214b0253 req-7f8f7a7f-d50f-4743-9909-569653e8046c service nova] [instance: fa67b237-f598-4111-87ba-d761aa50d95e] Received event network-vif-unplugged-3682fa30-ac2a-4ef9-ad3d-130a38539b80 for instance with task_state deleting. {{(pid=75045) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 23:35:11 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:35:11 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:35:11 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:35:11 user nova-compute[75045]: INFO nova.virt.libvirt.driver [-] [instance: fa67b237-f598-4111-87ba-d761aa50d95e] Instance destroyed successfully.
Nov 08 23:35:11 user nova-compute[75045]: DEBUG nova.objects.instance [None req-69d95d34-7bc0-49a4-a3ea-d58d9f7c32c2 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Lazy-loading 'resources' on Instance uuid fa67b237-f598-4111-87ba-d761aa50d95e {{(pid=75045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 23:35:11 user nova-compute[75045]: DEBUG nova.virt.libvirt.vif [None req-69d95d34-7bc0-49a4-a3ea-d58d9f7c32c2 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T23:24:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1499622947',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1499622947',id=23,image_ref='a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-08T23:25:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6bfb6963a6c145d4a7b7e47c8fde7e60',ramdisk_id='',reservation_id='r-ckbtr8ev',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-474110917',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T23:26:54Z,user_data=None,user_id='04bb3135250f4465a9947b47f9cde485',uuid=fa67b237-f598-4111-87ba-d761aa50d95e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3682fa30-ac2a-4ef9-ad3d-130a38539b80", "address": "fa:16:3e:3a:4c:a0", "network": {"id": "d4cd6998-66d1-4389-bc82-dd000c8962de", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-323966879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bfb6963a6c145d4a7b7e47c8fde7e60", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3682fa30-ac", "ovs_interfaceid": "3682fa30-ac2a-4ef9-ad3d-130a38539b80", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75045) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 23:35:11 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-69d95d34-7bc0-49a4-a3ea-d58d9f7c32c2 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Converting VIF {"id": "3682fa30-ac2a-4ef9-ad3d-130a38539b80", "address": "fa:16:3e:3a:4c:a0", "network": {"id": "d4cd6998-66d1-4389-bc82-dd000c8962de", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-323966879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bfb6963a6c145d4a7b7e47c8fde7e60", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3682fa30-ac", "ovs_interfaceid": "3682fa30-ac2a-4ef9-ad3d-130a38539b80", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 23:35:11 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-69d95d34-7bc0-49a4-a3ea-d58d9f7c32c2 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3a:4c:a0,bridge_name='br-int',has_traffic_filtering=True,id=3682fa30-ac2a-4ef9-ad3d-130a38539b80,network=Network(d4cd6998-66d1-4389-bc82-dd000c8962de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3682fa30-ac') {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 23:35:11 user nova-compute[75045]: DEBUG os_vif [None req-69d95d34-7bc0-49a4-a3ea-d58d9f7c32c2 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3a:4c:a0,bridge_name='br-int',has_traffic_filtering=True,id=3682fa30-ac2a-4ef9-ad3d-130a38539b80,network=Network(d4cd6998-66d1-4389-bc82-dd000c8962de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3682fa30-ac') {{(pid=75045) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 23:35:11 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:35:11 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3682fa30-ac, bridge=br-int, if_exists=True) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:35:11 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:35:11 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 23:35:11 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:35:11 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:35:11 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1714c564-ba41-4c6e-bbb7-99bc0b791ee0) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:35:11 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:35:11 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 23:35:12 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:35:12 user nova-compute[75045]: INFO os_vif [None req-69d95d34-7bc0-49a4-a3ea-d58d9f7c32c2 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3a:4c:a0,bridge_name='br-int',has_traffic_filtering=True,id=3682fa30-ac2a-4ef9-ad3d-130a38539b80,network=Network(d4cd6998-66d1-4389-bc82-dd000c8962de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3682fa30-ac')
Nov 08 23:35:12 user nova-compute[75045]: INFO nova.virt.libvirt.driver [None req-69d95d34-7bc0-49a4-a3ea-d58d9f7c32c2 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] [instance: fa67b237-f598-4111-87ba-d761aa50d95e] Deleting instance files /opt/stack/data/nova/instances/fa67b237-f598-4111-87ba-d761aa50d95e_del
Nov 08 23:35:12 user nova-compute[75045]: INFO nova.virt.libvirt.driver [None req-69d95d34-7bc0-49a4-a3ea-d58d9f7c32c2 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] [instance: fa67b237-f598-4111-87ba-d761aa50d95e] Deletion of /opt/stack/data/nova/instances/fa67b237-f598-4111-87ba-d761aa50d95e_del complete
Nov 08 23:35:12 user nova-compute[75045]: INFO nova.compute.manager [None req-69d95d34-7bc0-49a4-a3ea-d58d9f7c32c2 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] [instance: fa67b237-f598-4111-87ba-d761aa50d95e] Took 0.91 seconds to destroy the instance on the hypervisor.
Nov 08 23:35:12 user nova-compute[75045]: DEBUG oslo.service.loopingcall [None req-69d95d34-7bc0-49a4-a3ea-d58d9f7c32c2 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75045) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 23:35:12 user nova-compute[75045]: DEBUG nova.compute.manager [-] [instance: fa67b237-f598-4111-87ba-d761aa50d95e] Deallocating network for instance {{(pid=75045) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 23:35:12 user nova-compute[75045]: DEBUG nova.network.neutron [-] [instance: fa67b237-f598-4111-87ba-d761aa50d95e] deallocate_for_instance() {{(pid=75045) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 23:35:12 user nova-compute[75045]: DEBUG nova.network.neutron [-] [instance: fa67b237-f598-4111-87ba-d761aa50d95e] Updating instance_info_cache with network_info: [] {{(pid=75045) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 23:35:12 user nova-compute[75045]: INFO nova.compute.manager [-] [instance: fa67b237-f598-4111-87ba-d761aa50d95e] Took 0.50 seconds to deallocate network for instance.
Nov 08 23:35:12 user nova-compute[75045]: DEBUG nova.compute.manager [req-135713ca-4844-4492-a4e4-6e79b49356d4 req-31f823fc-32a0-4811-82fc-e7002d3d2f7b service nova] [instance: fa67b237-f598-4111-87ba-d761aa50d95e] Received event network-vif-deleted-3682fa30-ac2a-4ef9-ad3d-130a38539b80 {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:35:12 user nova-compute[75045]: INFO nova.virt.libvirt.driver [-] [instance: 78955913-bbab-4b00-bc9b-12116f249d7e] Instance destroyed successfully.
Nov 08 23:35:12 user nova-compute[75045]: DEBUG nova.objects.instance [None req-54bffcb0-0f52-4eba-8958-5ece89f6c811 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] Lazy-loading 'resources' on Instance uuid 78955913-bbab-4b00-bc9b-12116f249d7e {{(pid=75045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 23:35:12 user nova-compute[75045]: DEBUG nova.virt.libvirt.vif [None req-54bffcb0-0f52-4eba-8958-5ece89f6c811 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T23:33:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1514498655',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1514498655',id=34,image_ref='a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFx298Irz5GXMZkz0H8Ipklwpf+YgHBBRbJWKyrNrzld19ushXoOxyTLKkgNy4UE8867KMerPvCE78DRV+sjIC5+ZqVsJQYtVE98CDOOjfXA2MhCuUN1Cxpvu54Oh9q6/Q==',key_name='tempest-keypair-1615005599',keypairs=<?>,launch_index=0,launched_at=2023-11-08T23:33:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='3ad736027d034259a052da3f62bd575f',ramdisk_id='',reservation_id='r-ofqmeskf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1769593098',owner_user_name='tempest-AttachVolumeShelveTestJSON-1769593098-project-member',shelved_at='2023-11-08T23:35:10.453418',shelved_host='user',shelved_image_id='53c5731d-3d3c-4bc6-805a-27cd1bde48d9'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T23:35:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7a98fe96727741d0b148f3aaa8abf6f1',uuid=78955913-bbab-4b00-bc9b-12116f249d7e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "fc66a792-914f-48c4-ae57-cbda1615ff0b", "address": "fa:16:3e:58:00:3d", "network": {"id": "1b10bc53-ef32-4f01-82f6-ed9f95f7e3f2", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-518782773-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.43", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ad736027d034259a052da3f62bd575f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc66a792-91", "ovs_interfaceid": "fc66a792-914f-48c4-ae57-cbda1615ff0b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75045) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 23:35:12 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-54bffcb0-0f52-4eba-8958-5ece89f6c811 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] Converting VIF {"id": "fc66a792-914f-48c4-ae57-cbda1615ff0b", "address": "fa:16:3e:58:00:3d", "network": {"id": "1b10bc53-ef32-4f01-82f6-ed9f95f7e3f2", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-518782773-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.43", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ad736027d034259a052da3f62bd575f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc66a792-91", "ovs_interfaceid": "fc66a792-914f-48c4-ae57-cbda1615ff0b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 23:35:12 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-54bffcb0-0f52-4eba-8958-5ece89f6c811 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:58:00:3d,bridge_name='br-int',has_traffic_filtering=True,id=fc66a792-914f-48c4-ae57-cbda1615ff0b,network=Network(1b10bc53-ef32-4f01-82f6-ed9f95f7e3f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc66a792-91') {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 23:35:12 user nova-compute[75045]: DEBUG os_vif [None req-54bffcb0-0f52-4eba-8958-5ece89f6c811 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:58:00:3d,bridge_name='br-int',has_traffic_filtering=True,id=fc66a792-914f-48c4-ae57-cbda1615ff0b,network=Network(1b10bc53-ef32-4f01-82f6-ed9f95f7e3f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc66a792-91') {{(pid=75045) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 23:35:12 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-69d95d34-7bc0-49a4-a3ea-d58d9f7c32c2 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:35:12 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-69d95d34-7bc0-49a4-a3ea-d58d9f7c32c2 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:35:12 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:35:12 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfc66a792-91, bridge=br-int, if_exists=True) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:35:12 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:35:12 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 23:35:12 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:35:12 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=27d27478-b081-418d-82de-f4623b8a7edf) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:35:12 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:35:12 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 23:35:12 user nova-compute[75045]: DEBUG nova.compute.manager [req-d5953920-61f5-4f31-9c72-febfef569acd req-f2beba5e-fbe8-4fc0-8c2e-dec150f88523 service nova] [instance: 78955913-bbab-4b00-bc9b-12116f249d7e] Received event network-changed-fc66a792-914f-48c4-ae57-cbda1615ff0b {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:35:12 user nova-compute[75045]: DEBUG nova.compute.manager [req-d5953920-61f5-4f31-9c72-febfef569acd req-f2beba5e-fbe8-4fc0-8c2e-dec150f88523 service nova] [instance: 78955913-bbab-4b00-bc9b-12116f249d7e] Refreshing instance network info cache due to event network-changed-fc66a792-914f-48c4-ae57-cbda1615ff0b. {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 23:35:12 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-d5953920-61f5-4f31-9c72-febfef569acd req-f2beba5e-fbe8-4fc0-8c2e-dec150f88523 service nova] Acquiring lock "refresh_cache-78955913-bbab-4b00-bc9b-12116f249d7e" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 23:35:12 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-d5953920-61f5-4f31-9c72-febfef569acd req-f2beba5e-fbe8-4fc0-8c2e-dec150f88523 service nova] Acquired lock "refresh_cache-78955913-bbab-4b00-bc9b-12116f249d7e" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 23:35:12 user nova-compute[75045]: DEBUG nova.network.neutron [req-d5953920-61f5-4f31-9c72-febfef569acd req-f2beba5e-fbe8-4fc0-8c2e-dec150f88523 service nova] [instance: 78955913-bbab-4b00-bc9b-12116f249d7e] Refreshing network info cache for port fc66a792-914f-48c4-ae57-cbda1615ff0b {{(pid=75045) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 23:35:12 user nova-compute[75045]: INFO os_vif [None req-54bffcb0-0f52-4eba-8958-5ece89f6c811 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:58:00:3d,bridge_name='br-int',has_traffic_filtering=True,id=fc66a792-914f-48c4-ae57-cbda1615ff0b,network=Network(1b10bc53-ef32-4f01-82f6-ed9f95f7e3f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc66a792-91')
Nov 08 23:35:12 user nova-compute[75045]: INFO nova.virt.libvirt.driver [None req-54bffcb0-0f52-4eba-8958-5ece89f6c811 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] [instance: 78955913-bbab-4b00-bc9b-12116f249d7e] Deleting instance files /opt/stack/data/nova/instances/78955913-bbab-4b00-bc9b-12116f249d7e_del
Nov 08 23:35:12 user nova-compute[75045]: INFO nova.virt.libvirt.driver [None req-54bffcb0-0f52-4eba-8958-5ece89f6c811 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] [instance: 78955913-bbab-4b00-bc9b-12116f249d7e] Deletion of /opt/stack/data/nova/instances/78955913-bbab-4b00-bc9b-12116f249d7e_del complete
Nov 08 23:35:12 user nova-compute[75045]: INFO nova.scheduler.client.report [None req-54bffcb0-0f52-4eba-8958-5ece89f6c811 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] Deleted allocations for instance 78955913-bbab-4b00-bc9b-12116f249d7e
Nov 08 23:35:12 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-54bffcb0-0f52-4eba-8958-5ece89f6c811 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:35:13 user nova-compute[75045]: DEBUG nova.compute.provider_tree [None req-69d95d34-7bc0-49a4-a3ea-d58d9f7c32c2 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Inventory has not changed in ProviderTree for provider: 62ba5f85-c74d-4b58-986e-d4197e813fd7 {{(pid=75045) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 23:35:13 user nova-compute[75045]: DEBUG nova.scheduler.client.report [None req-69d95d34-7bc0-49a4-a3ea-d58d9f7c32c2 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Inventory has not changed for provider 62ba5f85-c74d-4b58-986e-d4197e813fd7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75045) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 23:35:13 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-69d95d34-7bc0-49a4-a3ea-d58d9f7c32c2 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.478s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:35:13 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-54bffcb0-0f52-4eba-8958-5ece89f6c811 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.233s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:35:13 user nova-compute[75045]: DEBUG nova.objects.instance [None req-54bffcb0-0f52-4eba-8958-5ece89f6c811 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] Lazy-loading 'numa_topology' on Instance uuid 78955913-bbab-4b00-bc9b-12116f249d7e {{(pid=75045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 23:35:13 user nova-compute[75045]: DEBUG nova.objects.base [None req-54bffcb0-0f52-4eba-8958-5ece89f6c811 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] Object Instance<78955913-bbab-4b00-bc9b-12116f249d7e> lazy-loaded attributes: resources,numa_topology {{(pid=75045) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 23:35:13 user nova-compute[75045]: INFO nova.scheduler.client.report [None req-69d95d34-7bc0-49a4-a3ea-d58d9f7c32c2 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Deleted allocations for instance fa67b237-f598-4111-87ba-d761aa50d95e
Nov 08 23:35:13 user nova-compute[75045]: DEBUG nova.network.neutron [req-d5953920-61f5-4f31-9c72-febfef569acd req-f2beba5e-fbe8-4fc0-8c2e-dec150f88523 service nova] [instance: 78955913-bbab-4b00-bc9b-12116f249d7e] Updated VIF entry in instance network info cache for port fc66a792-914f-48c4-ae57-cbda1615ff0b. {{(pid=75045) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 23:35:13 user nova-compute[75045]: DEBUG nova.network.neutron [req-d5953920-61f5-4f31-9c72-febfef569acd req-f2beba5e-fbe8-4fc0-8c2e-dec150f88523 service nova] [instance: 78955913-bbab-4b00-bc9b-12116f249d7e] Updating instance_info_cache with network_info: [{"id": "fc66a792-914f-48c4-ae57-cbda1615ff0b", "address": "fa:16:3e:58:00:3d", "network": {"id": "1b10bc53-ef32-4f01-82f6-ed9f95f7e3f2", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-518782773-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.43", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ad736027d034259a052da3f62bd575f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tapfc66a792-91", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75045) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 23:35:13 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-d5953920-61f5-4f31-9c72-febfef569acd req-f2beba5e-fbe8-4fc0-8c2e-dec150f88523 service nova] Releasing lock "refresh_cache-78955913-bbab-4b00-bc9b-12116f249d7e" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 23:35:13 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-69d95d34-7bc0-49a4-a3ea-d58d9f7c32c2 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Lock "fa67b237-f598-4111-87ba-d761aa50d95e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.120s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:35:13 user nova-compute[75045]: DEBUG nova.compute.provider_tree [None req-54bffcb0-0f52-4eba-8958-5ece89f6c811 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] Inventory has not changed in ProviderTree for provider: 62ba5f85-c74d-4b58-986e-d4197e813fd7 {{(pid=75045) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 23:35:13 user nova-compute[75045]: DEBUG nova.scheduler.client.report [None req-54bffcb0-0f52-4eba-8958-5ece89f6c811 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] Inventory has not changed for provider 62ba5f85-c74d-4b58-986e-d4197e813fd7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75045) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 23:35:13 user nova-compute[75045]: DEBUG nova.compute.manager [req-800a98bc-6dfa-47cd-a076-4bc32fcf48b6 req-96a610a6-147f-4f78-b3b9-2e2c427237c6 service nova] [instance: fa67b237-f598-4111-87ba-d761aa50d95e] Received event network-vif-plugged-3682fa30-ac2a-4ef9-ad3d-130a38539b80 {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:35:13 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-800a98bc-6dfa-47cd-a076-4bc32fcf48b6 req-96a610a6-147f-4f78-b3b9-2e2c427237c6 service nova] Acquiring lock "fa67b237-f598-4111-87ba-d761aa50d95e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:35:13 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-800a98bc-6dfa-47cd-a076-4bc32fcf48b6 req-96a610a6-147f-4f78-b3b9-2e2c427237c6 service nova] Lock "fa67b237-f598-4111-87ba-d761aa50d95e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:35:13 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-800a98bc-6dfa-47cd-a076-4bc32fcf48b6 req-96a610a6-147f-4f78-b3b9-2e2c427237c6 service nova] Lock "fa67b237-f598-4111-87ba-d761aa50d95e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:35:13 user nova-compute[75045]: DEBUG nova.compute.manager [req-800a98bc-6dfa-47cd-a076-4bc32fcf48b6 req-96a610a6-147f-4f78-b3b9-2e2c427237c6 service nova] [instance: fa67b237-f598-4111-87ba-d761aa50d95e] No waiting events found dispatching network-vif-plugged-3682fa30-ac2a-4ef9-ad3d-130a38539b80 {{(pid=75045) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 23:35:13 user nova-compute[75045]: WARNING nova.compute.manager [req-800a98bc-6dfa-47cd-a076-4bc32fcf48b6 req-96a610a6-147f-4f78-b3b9-2e2c427237c6 service nova] [instance: fa67b237-f598-4111-87ba-d761aa50d95e] Received unexpected event network-vif-plugged-3682fa30-ac2a-4ef9-ad3d-130a38539b80 for instance with vm_state deleted and task_state None.
Nov 08 23:35:13 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-54bffcb0-0f52-4eba-8958-5ece89f6c811 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.384s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:35:13 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-54bffcb0-0f52-4eba-8958-5ece89f6c811 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] Lock "78955913-bbab-4b00-bc9b-12116f249d7e" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 7.688s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:35:15 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-1a0ac375-0ff0-45f9-8b38-916bff77d39b tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] Acquiring lock "b4c0930f-4309-43bb-959b-4f36ec457bb6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:35:15 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-1a0ac375-0ff0-45f9-8b38-916bff77d39b tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] Lock "b4c0930f-4309-43bb-959b-4f36ec457bb6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:35:15 user nova-compute[75045]: DEBUG nova.compute.manager [None req-1a0ac375-0ff0-45f9-8b38-916bff77d39b tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] [instance: b4c0930f-4309-43bb-959b-4f36ec457bb6] Starting instance... {{(pid=75045) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 23:35:15 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-1a0ac375-0ff0-45f9-8b38-916bff77d39b tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:35:15 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-1a0ac375-0ff0-45f9-8b38-916bff77d39b tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:35:15 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-1a0ac375-0ff0-45f9-8b38-916bff77d39b tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75045) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 23:35:15 user nova-compute[75045]: INFO nova.compute.claims [None req-1a0ac375-0ff0-45f9-8b38-916bff77d39b tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] [instance: b4c0930f-4309-43bb-959b-4f36ec457bb6] Claim successful on node user
Nov 08 23:35:16 user nova-compute[75045]: DEBUG nova.compute.provider_tree [None req-1a0ac375-0ff0-45f9-8b38-916bff77d39b tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] Inventory has not changed in ProviderTree for provider: 62ba5f85-c74d-4b58-986e-d4197e813fd7 {{(pid=75045) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 23:35:16 user nova-compute[75045]: DEBUG nova.scheduler.client.report [None req-1a0ac375-0ff0-45f9-8b38-916bff77d39b tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] Inventory has not changed for provider 62ba5f85-c74d-4b58-986e-d4197e813fd7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75045) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 23:35:16 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-1a0ac375-0ff0-45f9-8b38-916bff77d39b tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.565s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:35:16 user nova-compute[75045]: DEBUG nova.compute.manager [None req-1a0ac375-0ff0-45f9-8b38-916bff77d39b tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] [instance: b4c0930f-4309-43bb-959b-4f36ec457bb6] Start building networks asynchronously for instance. {{(pid=75045) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 23:35:16 user nova-compute[75045]: DEBUG nova.compute.manager [None req-1a0ac375-0ff0-45f9-8b38-916bff77d39b tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] [instance: b4c0930f-4309-43bb-959b-4f36ec457bb6] Allocating IP information in the background. {{(pid=75045) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 23:35:16 user nova-compute[75045]: DEBUG nova.network.neutron [None req-1a0ac375-0ff0-45f9-8b38-916bff77d39b tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] [instance: b4c0930f-4309-43bb-959b-4f36ec457bb6] allocate_for_instance() {{(pid=75045) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 23:35:16 user nova-compute[75045]: INFO nova.virt.libvirt.driver [None req-1a0ac375-0ff0-45f9-8b38-916bff77d39b tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] [instance: b4c0930f-4309-43bb-959b-4f36ec457bb6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 23:35:16 user nova-compute[75045]: DEBUG nova.compute.manager [None req-1a0ac375-0ff0-45f9-8b38-916bff77d39b tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] [instance: b4c0930f-4309-43bb-959b-4f36ec457bb6] Start building block device mappings for instance. {{(pid=75045) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 23:35:16 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:35:16 user nova-compute[75045]: DEBUG nova.policy [None req-1a0ac375-0ff0-45f9-8b38-916bff77d39b tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a46e4d0d14c44ec6945c3ce972031a35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f374e5f34c3464fb6f1f82f5d836c57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75045) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 23:35:16 user nova-compute[75045]: DEBUG nova.compute.manager [None req-1a0ac375-0ff0-45f9-8b38-916bff77d39b tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] [instance: b4c0930f-4309-43bb-959b-4f36ec457bb6] Start spawning the instance on the hypervisor. {{(pid=75045) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 23:35:16 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-1a0ac375-0ff0-45f9-8b38-916bff77d39b tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] [instance: b4c0930f-4309-43bb-959b-4f36ec457bb6] Creating instance directory {{(pid=75045) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 23:35:16 user nova-compute[75045]: INFO nova.virt.libvirt.driver [None req-1a0ac375-0ff0-45f9-8b38-916bff77d39b tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] [instance: b4c0930f-4309-43bb-959b-4f36ec457bb6] Creating image(s)
Nov 08 23:35:16 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-1a0ac375-0ff0-45f9-8b38-916bff77d39b tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] Acquiring lock "/opt/stack/data/nova/instances/b4c0930f-4309-43bb-959b-4f36ec457bb6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:35:16 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-1a0ac375-0ff0-45f9-8b38-916bff77d39b tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] Lock "/opt/stack/data/nova/instances/b4c0930f-4309-43bb-959b-4f36ec457bb6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:35:16 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-1a0ac375-0ff0-45f9-8b38-916bff77d39b tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] Lock "/opt/stack/data/nova/instances/b4c0930f-4309-43bb-959b-4f36ec457bb6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.006s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:35:16 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-1a0ac375-0ff0-45f9-8b38-916bff77d39b tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b59f52a99fff51c56dd1edfb83892fb8f647f2f3 --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:35:16 user nova-compute[75045]: WARNING nova.virt.libvirt.driver [None req-416d7513-0465-4e88-bcb0-a155bb6d06f3 tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance adcffd35-00c7-49db-a72f-d6307a90e123 is timed out.
Nov 08 23:35:16 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-1a0ac375-0ff0-45f9-8b38-916bff77d39b tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b59f52a99fff51c56dd1edfb83892fb8f647f2f3 --force-share --output=json" returned: 0 in 0.188s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:35:16 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-1a0ac375-0ff0-45f9-8b38-916bff77d39b tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] Acquiring lock "b59f52a99fff51c56dd1edfb83892fb8f647f2f3" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:35:16 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-1a0ac375-0ff0-45f9-8b38-916bff77d39b tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] Lock "b59f52a99fff51c56dd1edfb83892fb8f647f2f3" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:35:16 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-1a0ac375-0ff0-45f9-8b38-916bff77d39b tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b59f52a99fff51c56dd1edfb83892fb8f647f2f3 --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:35:16 user nova-compute[75045]: INFO nova.virt.libvirt.driver [None req-416d7513-0465-4e88-bcb0-a155bb6d06f3 tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] Successfully detached device vdb from instance adcffd35-00c7-49db-a72f-d6307a90e123 from the live domain config.
Nov 08 23:35:16 user nova-compute[75045]: DEBUG nova.virt.libvirt.volume.iscsi [None req-416d7513-0465-4e88-bcb0-a155bb6d06f3 tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] [instance: adcffd35-00c7-49db-a72f-d6307a90e123] calling os-brick to detach iSCSI Volume {{(pid=75045) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 23:35:16 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-416d7513-0465-4e88-bcb0-a155bb6d06f3 tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1b68210460>, {'target_iqn': 'iqn.2010-10.org.openstack:4fd05cc1-4e93-4804-ab93-57b0435dacea', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jTPwrenI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=75045) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 23:35:16 user nova-compute[75045]: WARNING os_brick.initiator.connectors.base [None req-416d7513-0465-4e88-bcb0-a155bb6d06f3 tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 23:35:16 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-416d7513-0465-4e88-bcb0-a155bb6d06f3 tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 23:35:16 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-416d7513-0465-4e88-bcb0-a155bb6d06f3 tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 23:35:16 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:35:16 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:35:16 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9968491-57d0-47e6-b0c1-627d8863c98e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:40af8977-0ce5-4509-93f8-b6c6349aed86\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e9c3ac6d-d72a-41c8-9c18-15131250e323\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1b2a3b04-13be-4853-822c-29c416757252\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4fd05cc1-4e93-4804-ab93-57b0435dacea\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:35:16 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-416d7513-0465-4e88-bcb0-a155bb6d06f3 tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 23:35:16 user nova-compute[75045]: No targets found.
Nov 08 23:35:16 user nova-compute[75045]: iSNS:
Nov 08 23:35:16 user nova-compute[75045]: No targets found.
Nov 08 23:35:16 user nova-compute[75045]: STATIC:
Nov 08 23:35:16 user nova-compute[75045]: Target: iqn.2010-10.org.openstack:40af8977-0ce5-4509-93f8-b6c6349aed86
Nov 08 23:35:16 user nova-compute[75045]:         Portal: 172.16.0.220:3260,-1
Nov 08 23:35:16 user nova-compute[75045]:                 Iface Name: default
Nov 08 23:35:16 user nova-compute[75045]: Target: iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab
Nov 08 23:35:16 user nova-compute[75045]:         Portal: 172.16.0.220:3260,-1
Nov 08 23:35:16 user nova-compute[75045]:                 Iface Name: default
Nov 08 23:35:16 user nova-compute[75045]: Target: iqn.2010-10.org.openstack:e9c3ac6d-d72a-41c8-9c18-15131250e323
Nov 08 23:35:16 user nova-compute[75045]:         Portal: 172.16.0.220:3260,-1
Nov 08 23:35:16 user nova-compute[75045]:                 Iface Name: default
Nov 08 23:35:16 user nova-compute[75045]: Target: iqn.2010-10.org.openstack:1b2a3b04-13be-4853-822c-29c416757252
Nov 08 23:35:16 user nova-compute[75045]:         Portal: 172.16.0.220:3260,-1
Nov 08 23:35:16 user nova-compute[75045]:                 Iface Name: default
Nov 08 23:35:16 user nova-compute[75045]: Target: iqn.2010-10.org.openstack:4fd05cc1-4e93-4804-ab93-57b0435dacea
Nov 08 23:35:16 user nova-compute[75045]:         Portal: 172.16.0.220:3260,-1
Nov 08 23:35:16 user nova-compute[75045]:                 Iface Name: default
Nov 08 23:35:16 user nova-compute[75045]: FIRMWARE:
Nov 08 23:35:16 user nova-compute[75045]: No targets found.
Nov 08 23:35:16 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 23:35:16 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-416d7513-0465-4e88-bcb0-a155bb6d06f3 tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 23:35:16 user nova-compute[75045]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 23:35:16 user nova-compute[75045]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75045) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 23:35:16 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-416d7513-0465-4e88-bcb0-a155bb6d06f3 tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4fd05cc1-4e93-4804-ab93-57b0435dacea', 0)] {{(pid=75045) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 23:35:16 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:35:16 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:35:16 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6db44e5-a328-4ab2-aca4-fad0dc824c50]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1b2a3b04-13be-4853-822c-29c416757252\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:40af8977-0ce5-4509-93f8-b6c6349aed86\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4fd05cc1-4e93-4804-ab93-57b0435dacea\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e9c3ac6d-d72a-41c8-9c18-15131250e323\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:35:16 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:35:16 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:35:16 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4565385-186f-46ea-9e91-e2fae97d37bd]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9c3ac6d-d72a-41c8-9c18-15131250e323 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b2a3b04-13be-4853-822c-29c416757252 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fd05cc1-4e93-4804-ab93-57b0435dacea (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40af8977-0ce5-4509-93f8-b6c6349aed86 (non-flash)\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:35:16 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-416d7513-0465-4e88-bcb0-a155bb6d06f3 tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab (non-flash)
Nov 08 23:35:16 user nova-compute[75045]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9c3ac6d-d72a-41c8-9c18-15131250e323 (non-flash)
Nov 08 23:35:16 user nova-compute[75045]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b2a3b04-13be-4853-822c-29c416757252 (non-flash)
Nov 08 23:35:16 user nova-compute[75045]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fd05cc1-4e93-4804-ab93-57b0435dacea (non-flash)
Nov 08 23:35:16 user nova-compute[75045]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40af8977-0ce5-4509-93f8-b6c6349aed86 (non-flash)
Nov 08 23:35:16 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 23:35:16 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-416d7513-0465-4e88-bcb0-a155bb6d06f3 tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab (non-flash)
Nov 08 23:35:16 user nova-compute[75045]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9c3ac6d-d72a-41c8-9c18-15131250e323 (non-flash)
Nov 08 23:35:16 user nova-compute[75045]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b2a3b04-13be-4853-822c-29c416757252 (non-flash)
Nov 08 23:35:16 user nova-compute[75045]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fd05cc1-4e93-4804-ab93-57b0435dacea (non-flash)
Nov 08 23:35:16 user nova-compute[75045]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40af8977-0ce5-4509-93f8-b6c6349aed86 (non-flash)
Nov 08 23:35:16 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 23:35:16 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-416d7513-0465-4e88-bcb0-a155bb6d06f3 tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1b68264b80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4fd05cc1-4e93-4804-ab93-57b0435dacea'): ({'sdd'}, set())}) {{(pid=75045) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 23:35:16 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-416d7513-0465-4e88-bcb0-a155bb6d06f3 tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] Removing single pathed devices sdd {{(pid=75045) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 23:35:16 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:35:16 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:35:16 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[b655f75d-54fc-44b7-b4cb-72e70a4fe09b]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:35:16 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:35:17 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.020s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:35:17 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d3ce22a-a62b-4dbb-adc3-22e52873f3b8]: (4, ('ok\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:35:17 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-416d7513-0465-4e88-bcb0-a155bb6d06f3 tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] Flushing IO for device /dev/sdd {{(pid=75045) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 23:35:17 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:35:17 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.016s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:35:17 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9e0c776-2620-4f30-b807-9a428c8f8353]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:35:17 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-416d7513-0465-4e88-bcb0-a155bb6d06f3 tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75045) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 23:35:17 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:35:17 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-1a0ac375-0ff0-45f9-8b38-916bff77d39b tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b59f52a99fff51c56dd1edfb83892fb8f647f2f3 --force-share --output=json" returned: 0 in 0.254s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:35:17 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-1a0ac375-0ff0-45f9-8b38-916bff77d39b tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b59f52a99fff51c56dd1edfb83892fb8f647f2f3,backing_fmt=raw /opt/stack/data/nova/instances/b4c0930f-4309-43bb-959b-4f36ec457bb6/disk 1073741824 {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:35:17 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.049s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:35:17 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2e3e9b4-76fa-4e9c-91f8-5271a20fd6a6]: (4, ('1', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:35:17 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-416d7513-0465-4e88-bcb0-a155bb6d06f3 tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75045) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 23:35:17 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-416d7513-0465-4e88-bcb0-a155bb6d06f3 tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] SCSI volumes sdd have been removed. {{(pid=75045) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 23:35:17 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-416d7513-0465-4e88-bcb0-a155bb6d06f3 tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4fd05cc1-4e93-4804-ab93-57b0435dacea')] {{(pid=75045) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 23:35:17 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4fd05cc1-4e93-4804-ab93-57b0435dacea -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:35:17 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-1a0ac375-0ff0-45f9-8b38-916bff77d39b tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b59f52a99fff51c56dd1edfb83892fb8f647f2f3,backing_fmt=raw /opt/stack/data/nova/instances/b4c0930f-4309-43bb-959b-4f36ec457bb6/disk 1073741824" returned: 0 in 0.054s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:35:17 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-1a0ac375-0ff0-45f9-8b38-916bff77d39b tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] Lock "b59f52a99fff51c56dd1edfb83892fb8f647f2f3" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.313s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:35:17 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-1a0ac375-0ff0-45f9-8b38-916bff77d39b tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b59f52a99fff51c56dd1edfb83892fb8f647f2f3 --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:35:17 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4fd05cc1-4e93-4804-ab93-57b0435dacea -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:35:17 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[a045a3ce-a352-495a-a16e-36c79b31f373]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:35:17 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-416d7513-0465-4e88-bcb0-a155bb6d06f3 tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:35:17 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4fd05cc1-4e93-4804-ab93-57b0435dacea -p 172.16.0.220:3260 --logout {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:35:17 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4fd05cc1-4e93-4804-ab93-57b0435dacea -p 172.16.0.220:3260 --logout" returned: 0 in 0.075s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:35:17 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[b52fefcb-8196-45fd-abc9-219a9df25211]: (4, ('Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:4fd05cc1-4e93-4804-ab93-57b0435dacea, portal: 172.16.0.220,3260]\nLogout of [sid: 35, target: iqn.2010-10.org.openstack:4fd05cc1-4e93-4804-ab93-57b0435dacea, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:35:17 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-416d7513-0465-4e88-bcb0-a155bb6d06f3 tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:4fd05cc1-4e93-4804-ab93-57b0435dacea, portal: 172.16.0.220,3260]
Nov 08 23:35:17 user nova-compute[75045]: Logout of [sid: 35, target: iqn.2010-10.org.openstack:4fd05cc1-4e93-4804-ab93-57b0435dacea, portal: 172.16.0.220,3260] successful.
Nov 08 23:35:17 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:35:17 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4fd05cc1-4e93-4804-ab93-57b0435dacea -p 172.16.0.220:3260 --op delete {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:35:17 user nova-compute[75045]: DEBUG nova.network.neutron [None req-1a0ac375-0ff0-45f9-8b38-916bff77d39b tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] [instance: b4c0930f-4309-43bb-959b-4f36ec457bb6] Successfully created port: 663b2fc9-e6a3-4d9a-81bc-484f78acc4dd {{(pid=75045) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 23:35:17 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4fd05cc1-4e93-4804-ab93-57b0435dacea -p 172.16.0.220:3260 --op delete" returned: 0 in 0.034s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:35:17 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0ff464d-31f2-412c-9389-d2e6a17df49e]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:35:17 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-416d7513-0465-4e88-bcb0-a155bb6d06f3 tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:35:17 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-416d7513-0465-4e88-bcb0-a155bb6d06f3 tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.426s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 23:35:17 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-416d7513-0465-4e88-bcb0-a155bb6d06f3 tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] <== disconnect_volume: return (430ms) None {{(pid=75045) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 23:35:17 user nova-compute[75045]: DEBUG nova.virt.libvirt.volume.iscsi [None req-416d7513-0465-4e88-bcb0-a155bb6d06f3 tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] [instance: adcffd35-00c7-49db-a72f-d6307a90e123] Disconnected iSCSI Volume {{(pid=75045) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 23:35:17 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-1a0ac375-0ff0-45f9-8b38-916bff77d39b tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b59f52a99fff51c56dd1edfb83892fb8f647f2f3 --force-share --output=json" returned: 0 in 0.204s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:35:17 user nova-compute[75045]: DEBUG nova.virt.disk.api [None req-1a0ac375-0ff0-45f9-8b38-916bff77d39b tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b4c0930f-4309-43bb-959b-4f36ec457bb6/disk. size=1073741824 {{(pid=75045) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 23:35:17 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-1a0ac375-0ff0-45f9-8b38-916bff77d39b tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4c0930f-4309-43bb-959b-4f36ec457bb6/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:35:17 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-1a0ac375-0ff0-45f9-8b38-916bff77d39b tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4c0930f-4309-43bb-959b-4f36ec457bb6/disk --force-share --output=json" returned: 0 in 0.252s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:35:17 user nova-compute[75045]: DEBUG nova.virt.disk.api [None req-1a0ac375-0ff0-45f9-8b38-916bff77d39b tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] Cannot resize image /opt/stack/data/nova/instances/b4c0930f-4309-43bb-959b-4f36ec457bb6/disk to a smaller size. {{(pid=75045) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 08 23:35:17 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-1a0ac375-0ff0-45f9-8b38-916bff77d39b tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] [instance: b4c0930f-4309-43bb-959b-4f36ec457bb6] Created local disks {{(pid=75045) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 23:35:17 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-1a0ac375-0ff0-45f9-8b38-916bff77d39b tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] [instance: b4c0930f-4309-43bb-959b-4f36ec457bb6] Ensure instance console log exists: /opt/stack/data/nova/instances/b4c0930f-4309-43bb-959b-4f36ec457bb6/console.log {{(pid=75045) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 23:35:17 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-1a0ac375-0ff0-45f9-8b38-916bff77d39b tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:35:17 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-1a0ac375-0ff0-45f9-8b38-916bff77d39b tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:35:17 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-1a0ac375-0ff0-45f9-8b38-916bff77d39b tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:35:17 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:35:17 user nova-compute[75045]: WARNING nova.virt.libvirt.driver [None req-16fd8de7-d112-469e-aa64-55a99c6828da tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance a63971de-a2bf-4e58-a760-30eaec3b83c0 is timed out.
Nov 08 23:35:17 user nova-compute[75045]: INFO nova.virt.libvirt.driver [None req-16fd8de7-d112-469e-aa64-55a99c6828da tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Successfully detached device vdb from instance a63971de-a2bf-4e58-a760-30eaec3b83c0 from the live domain config.
Nov 08 23:35:17 user nova-compute[75045]: DEBUG nova.virt.libvirt.volume.iscsi [None req-16fd8de7-d112-469e-aa64-55a99c6828da tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] [instance: a63971de-a2bf-4e58-a760-30eaec3b83c0] calling os-brick to detach iSCSI Volume {{(pid=75045) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 23:35:17 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-16fd8de7-d112-469e-aa64-55a99c6828da tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1b68210460>, {'target_iqn': 'iqn.2010-10.org.openstack:40af8977-0ce5-4509-93f8-b6c6349aed86', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SDpFrqzg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=75045) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 23:35:17 user nova-compute[75045]: WARNING os_brick.initiator.connectors.base [None req-16fd8de7-d112-469e-aa64-55a99c6828da tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 23:35:17 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-16fd8de7-d112-469e-aa64-55a99c6828da tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 23:35:17 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-16fd8de7-d112-469e-aa64-55a99c6828da tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 23:35:17 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:35:17 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:35:17 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[fac5cfbf-8318-4505-adf2-5b0e4bcd2ef6]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:40af8977-0ce5-4509-93f8-b6c6349aed86\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e9c3ac6d-d72a-41c8-9c18-15131250e323\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1b2a3b04-13be-4853-822c-29c416757252\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:35:17 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-16fd8de7-d112-469e-aa64-55a99c6828da tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 23:35:17 user nova-compute[75045]: No targets found.
Nov 08 23:35:17 user nova-compute[75045]: iSNS:
Nov 08 23:35:17 user nova-compute[75045]: No targets found.
Nov 08 23:35:17 user nova-compute[75045]: STATIC:
Nov 08 23:35:17 user nova-compute[75045]: Target: iqn.2010-10.org.openstack:40af8977-0ce5-4509-93f8-b6c6349aed86
Nov 08 23:35:17 user nova-compute[75045]:         Portal: 172.16.0.220:3260,-1
Nov 08 23:35:17 user nova-compute[75045]:                 Iface Name: default
Nov 08 23:35:17 user nova-compute[75045]: Target: iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab
Nov 08 23:35:17 user nova-compute[75045]:         Portal: 172.16.0.220:3260,-1
Nov 08 23:35:17 user nova-compute[75045]:                 Iface Name: default
Nov 08 23:35:17 user nova-compute[75045]: Target: iqn.2010-10.org.openstack:e9c3ac6d-d72a-41c8-9c18-15131250e323
Nov 08 23:35:17 user nova-compute[75045]:         Portal: 172.16.0.220:3260,-1
Nov 08 23:35:17 user nova-compute[75045]:                 Iface Name: default
Nov 08 23:35:17 user nova-compute[75045]: Target: iqn.2010-10.org.openstack:1b2a3b04-13be-4853-822c-29c416757252
Nov 08 23:35:17 user nova-compute[75045]:         Portal: 172.16.0.220:3260,-1
Nov 08 23:35:17 user nova-compute[75045]:                 Iface Name: default
Nov 08 23:35:17 user nova-compute[75045]: FIRMWARE:
Nov 08 23:35:17 user nova-compute[75045]: No targets found.
Nov 08 23:35:17 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 23:35:17 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-16fd8de7-d112-469e-aa64-55a99c6828da tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 23:35:17 user nova-compute[75045]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 23:35:17 user nova-compute[75045]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75045) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 23:35:17 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-16fd8de7-d112-469e-aa64-55a99c6828da tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:40af8977-0ce5-4509-93f8-b6c6349aed86', 0)] {{(pid=75045) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 23:35:17 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:35:17 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:35:17 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2b338fc-d205-49ee-94ed-28210b25375b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1b2a3b04-13be-4853-822c-29c416757252\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:40af8977-0ce5-4509-93f8-b6c6349aed86\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e9c3ac6d-d72a-41c8-9c18-15131250e323\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:35:17 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:35:17 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:35:17 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[010f0c08-e3af-4f82-afed-b4f24df03790]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9c3ac6d-d72a-41c8-9c18-15131250e323 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b2a3b04-13be-4853-822c-29c416757252 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40af8977-0ce5-4509-93f8-b6c6349aed86 (non-flash)\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:35:17 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-16fd8de7-d112-469e-aa64-55a99c6828da tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab (non-flash)
Nov 08 23:35:17 user nova-compute[75045]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9c3ac6d-d72a-41c8-9c18-15131250e323 (non-flash)
Nov 08 23:35:17 user nova-compute[75045]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b2a3b04-13be-4853-822c-29c416757252 (non-flash)
Nov 08 23:35:17 user nova-compute[75045]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40af8977-0ce5-4509-93f8-b6c6349aed86 (non-flash)
Nov 08 23:35:17 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 23:35:17 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-16fd8de7-d112-469e-aa64-55a99c6828da tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab (non-flash)
Nov 08 23:35:17 user nova-compute[75045]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9c3ac6d-d72a-41c8-9c18-15131250e323 (non-flash)
Nov 08 23:35:17 user nova-compute[75045]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b2a3b04-13be-4853-822c-29c416757252 (non-flash)
Nov 08 23:35:17 user nova-compute[75045]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40af8977-0ce5-4509-93f8-b6c6349aed86 (non-flash)
Nov 08 23:35:17 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 23:35:17 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-16fd8de7-d112-469e-aa64-55a99c6828da tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1b68113a30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:40af8977-0ce5-4509-93f8-b6c6349aed86'): ({'sde'}, set())}) {{(pid=75045) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 23:35:17 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-16fd8de7-d112-469e-aa64-55a99c6828da tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Removing single pathed devices sde {{(pid=75045) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 23:35:17 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:35:17 user nova-compute[75045]: DEBUG nova.network.neutron [None req-1a0ac375-0ff0-45f9-8b38-916bff77d39b tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] [instance: b4c0930f-4309-43bb-959b-4f36ec457bb6] Successfully updated port: 663b2fc9-e6a3-4d9a-81bc-484f78acc4dd {{(pid=75045) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 23:35:17 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:35:17 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[f50811a3-5dc5-48b1-8862-5a4d0935aafe]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:35:17 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:35:17 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-1a0ac375-0ff0-45f9-8b38-916bff77d39b tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] Acquiring lock "refresh_cache-b4c0930f-4309-43bb-959b-4f36ec457bb6" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 23:35:17 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-1a0ac375-0ff0-45f9-8b38-916bff77d39b tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] Acquired lock "refresh_cache-b4c0930f-4309-43bb-959b-4f36ec457bb6" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 23:35:17 user nova-compute[75045]: DEBUG nova.network.neutron [None req-1a0ac375-0ff0-45f9-8b38-916bff77d39b tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] [instance: b4c0930f-4309-43bb-959b-4f36ec457bb6] Building network info cache for instance {{(pid=75045) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 23:35:17 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.022s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:35:17 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6c8446b-5cc1-4702-86a4-35cc64f47e8a]: (4, ('ok\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:35:17 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-16fd8de7-d112-469e-aa64-55a99c6828da tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Flushing IO for device /dev/sde {{(pid=75045) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 23:35:17 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:35:17 user nova-compute[75045]: DEBUG nova.compute.manager [req-c5df76f6-faad-459d-a103-4370b735777e req-f799ec22-8f97-45c2-b68b-e3739d966cff service nova] [instance: b4c0930f-4309-43bb-959b-4f36ec457bb6] Received event network-changed-663b2fc9-e6a3-4d9a-81bc-484f78acc4dd {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:35:17 user nova-compute[75045]: DEBUG nova.compute.manager [req-c5df76f6-faad-459d-a103-4370b735777e req-f799ec22-8f97-45c2-b68b-e3739d966cff service nova] [instance: b4c0930f-4309-43bb-959b-4f36ec457bb6] Refreshing instance network info cache due to event network-changed-663b2fc9-e6a3-4d9a-81bc-484f78acc4dd. {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 23:35:17 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-c5df76f6-faad-459d-a103-4370b735777e req-f799ec22-8f97-45c2-b68b-e3739d966cff service nova] Acquiring lock "refresh_cache-b4c0930f-4309-43bb-959b-4f36ec457bb6" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 23:35:17 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.017s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:35:17 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b545af9-dea6-469e-bcba-54026e12fcbc]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:35:17 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-16fd8de7-d112-469e-aa64-55a99c6828da tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75045) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 23:35:17 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:35:17 user nova-compute[75045]: DEBUG nova.network.neutron [None req-1a0ac375-0ff0-45f9-8b38-916bff77d39b tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] [instance: b4c0930f-4309-43bb-959b-4f36ec457bb6] Instance cache missing network info. {{(pid=75045) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 23:35:18 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.056s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:35:18 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[bed2ba30-7c6f-456b-a548-fa90784219a6]: (4, ('1', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:35:18 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-16fd8de7-d112-469e-aa64-55a99c6828da tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75045) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 23:35:18 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-16fd8de7-d112-469e-aa64-55a99c6828da tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] SCSI volumes sde have been removed. {{(pid=75045) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 23:35:18 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-16fd8de7-d112-469e-aa64-55a99c6828da tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:40af8977-0ce5-4509-93f8-b6c6349aed86')] {{(pid=75045) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 23:35:18 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:40af8977-0ce5-4509-93f8-b6c6349aed86 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:35:18 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:40af8977-0ce5-4509-93f8-b6c6349aed86 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.033s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:35:18 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ad57ecf-a2a3-4a7d-a8d8-26e8edcd72c5]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:35:18 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-16fd8de7-d112-469e-aa64-55a99c6828da tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:35:18 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:40af8977-0ce5-4509-93f8-b6c6349aed86 -p 172.16.0.220:3260 --logout {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:35:18 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:40af8977-0ce5-4509-93f8-b6c6349aed86 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:35:18 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[7aeba5ad-891f-4820-a0ad-07dd95c4d127]: (4, ('Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:40af8977-0ce5-4509-93f8-b6c6349aed86, portal: 172.16.0.220,3260]\nLogout of [sid: 36, target: iqn.2010-10.org.openstack:40af8977-0ce5-4509-93f8-b6c6349aed86, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:35:18 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-16fd8de7-d112-469e-aa64-55a99c6828da tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:40af8977-0ce5-4509-93f8-b6c6349aed86, portal: 172.16.0.220,3260]
Nov 08 23:35:18 user nova-compute[75045]: Logout of [sid: 36, target: iqn.2010-10.org.openstack:40af8977-0ce5-4509-93f8-b6c6349aed86, portal: 172.16.0.220,3260] successful.
Nov 08 23:35:18 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:35:18 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:40af8977-0ce5-4509-93f8-b6c6349aed86 -p 172.16.0.220:3260 --op delete {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:35:18 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:40af8977-0ce5-4509-93f8-b6c6349aed86 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:35:18 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7722908-e167-48cb-a61a-061f12b8ded5]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:35:18 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-16fd8de7-d112-469e-aa64-55a99c6828da tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:35:18 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-16fd8de7-d112-469e-aa64-55a99c6828da tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.384s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 23:35:18 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-16fd8de7-d112-469e-aa64-55a99c6828da tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] <== disconnect_volume: return (388ms) None {{(pid=75045) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 23:35:18 user nova-compute[75045]: DEBUG nova.virt.libvirt.volume.iscsi [None req-16fd8de7-d112-469e-aa64-55a99c6828da tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] [instance: a63971de-a2bf-4e58-a760-30eaec3b83c0] Disconnected iSCSI Volume {{(pid=75045) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 23:35:18 user nova-compute[75045]: DEBUG nova.network.neutron [None req-1a0ac375-0ff0-45f9-8b38-916bff77d39b tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] [instance: b4c0930f-4309-43bb-959b-4f36ec457bb6] Updating instance_info_cache with network_info: [{"id": "663b2fc9-e6a3-4d9a-81bc-484f78acc4dd", "address": "fa:16:3e:20:81:d8", "network": {"id": "ec929af3-f098-4338-943c-d13305d4d555", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-208938347-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f374e5f34c3464fb6f1f82f5d836c57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap663b2fc9-e6", "ovs_interfaceid": "663b2fc9-e6a3-4d9a-81bc-484f78acc4dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75045) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 23:35:18 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-1a0ac375-0ff0-45f9-8b38-916bff77d39b tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] Releasing lock "refresh_cache-b4c0930f-4309-43bb-959b-4f36ec457bb6" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 23:35:18 user nova-compute[75045]: DEBUG nova.compute.manager [None req-1a0ac375-0ff0-45f9-8b38-916bff77d39b tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] [instance: b4c0930f-4309-43bb-959b-4f36ec457bb6] Instance network_info: |[{"id": "663b2fc9-e6a3-4d9a-81bc-484f78acc4dd", "address": "fa:16:3e:20:81:d8", "network": {"id": "ec929af3-f098-4338-943c-d13305d4d555", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-208938347-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f374e5f34c3464fb6f1f82f5d836c57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap663b2fc9-e6", "ovs_interfaceid": "663b2fc9-e6a3-4d9a-81bc-484f78acc4dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75045) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 23:35:18 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-c5df76f6-faad-459d-a103-4370b735777e req-f799ec22-8f97-45c2-b68b-e3739d966cff service nova] Acquired lock "refresh_cache-b4c0930f-4309-43bb-959b-4f36ec457bb6" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 23:35:18 user nova-compute[75045]: DEBUG nova.network.neutron [req-c5df76f6-faad-459d-a103-4370b735777e req-f799ec22-8f97-45c2-b68b-e3739d966cff service nova] [instance: b4c0930f-4309-43bb-959b-4f36ec457bb6] Refreshing network info cache for port 663b2fc9-e6a3-4d9a-81bc-484f78acc4dd {{(pid=75045) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 23:35:18 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-1a0ac375-0ff0-45f9-8b38-916bff77d39b tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] [instance: b4c0930f-4309-43bb-959b-4f36ec457bb6] Start _get_guest_xml network_info=[{"id": "663b2fc9-e6a3-4d9a-81bc-484f78acc4dd", "address": "fa:16:3e:20:81:d8", "network": {"id": "ec929af3-f098-4338-943c-d13305d4d555", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-208938347-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f374e5f34c3464fb6f1f82f5d836c57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap663b2fc9-e6", "ovs_interfaceid": "663b2fc9-e6a3-4d9a-81bc-484f78acc4dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T23:11:54Z,direct_url=<?>,disk_format='qcow2',id=a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b1beba2cc4e7465ea249e2225fb494dc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T23:11:56Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'disk_bus': 'virtio', 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': 'a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75045) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 23:35:18 user nova-compute[75045]: WARNING nova.virt.libvirt.driver [None req-1a0ac375-0ff0-45f9-8b38-916bff77d39b tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 23:35:18 user nova-compute[75045]: WARNING nova.virt.libvirt.driver [None req-1a0ac375-0ff0-45f9-8b38-916bff77d39b tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 23:35:18 user nova-compute[75045]: DEBUG nova.objects.instance [None req-416d7513-0465-4e88-bcb0-a155bb6d06f3 tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] Lazy-loading 'flavor' on Instance uuid adcffd35-00c7-49db-a72f-d6307a90e123 {{(pid=75045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 23:35:18 user nova-compute[75045]: DEBUG nova.virt.libvirt.host [None req-1a0ac375-0ff0-45f9-8b38-916bff77d39b tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75045) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 23:35:18 user nova-compute[75045]: DEBUG nova.virt.libvirt.host [None req-1a0ac375-0ff0-45f9-8b38-916bff77d39b tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] CPU controller missing on host. {{(pid=75045) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 23:35:18 user nova-compute[75045]: DEBUG nova.virt.libvirt.host [None req-1a0ac375-0ff0-45f9-8b38-916bff77d39b tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75045) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 23:35:18 user nova-compute[75045]: DEBUG nova.virt.libvirt.host [None req-1a0ac375-0ff0-45f9-8b38-916bff77d39b tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] CPU controller found on host. {{(pid=75045) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 23:35:18 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-1a0ac375-0ff0-45f9-8b38-916bff77d39b tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75045) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 23:35:18 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-1a0ac375-0ff0-45f9-8b38-916bff77d39b tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T23:11:41Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T23:11:54Z,direct_url=<?>,disk_format='qcow2',id=a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b1beba2cc4e7465ea249e2225fb494dc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T23:11:56Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75045) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 23:35:18 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-1a0ac375-0ff0-45f9-8b38-916bff77d39b tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] Flavor limits 0:0:0 {{(pid=75045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 23:35:18 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-1a0ac375-0ff0-45f9-8b38-916bff77d39b tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] Image limits 0:0:0 {{(pid=75045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 23:35:18 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-1a0ac375-0ff0-45f9-8b38-916bff77d39b tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] Flavor pref 0:0:0 {{(pid=75045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 23:35:18 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-1a0ac375-0ff0-45f9-8b38-916bff77d39b tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] Image pref 0:0:0 {{(pid=75045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 23:35:18 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-1a0ac375-0ff0-45f9-8b38-916bff77d39b tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 23:35:18 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-1a0ac375-0ff0-45f9-8b38-916bff77d39b tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75045) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 23:35:18 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-1a0ac375-0ff0-45f9-8b38-916bff77d39b tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75045) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 23:35:18 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-1a0ac375-0ff0-45f9-8b38-916bff77d39b tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] Got 1 possible topologies {{(pid=75045) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 23:35:18 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-1a0ac375-0ff0-45f9-8b38-916bff77d39b tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75045) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 23:35:18 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-1a0ac375-0ff0-45f9-8b38-916bff77d39b tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75045) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 23:35:18 user nova-compute[75045]: DEBUG nova.virt.libvirt.vif [None req-1a0ac375-0ff0-45f9-8b38-916bff77d39b tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T23:35:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-2009963107',display_name='tempest-VolumesSnapshotTestJSON-instance-2009963107',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-2009963107',id=35,image_ref='a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLnjKeBjBHoKmy9j4HNkcFvqFAiYNhmGBrR6rb7DdrlyUYn2o/xrjq17JSZrMaGbwZKA3q3h9Q+vaGBdtWJ1bkqUxh0nIfi3eaVgNLcADV+7GSgUqL7YJFBmOmWVAaQ1jA==',key_name='tempest-keypair-830577175',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4f374e5f34c3464fb6f1f82f5d836c57',ramdisk_id='',reservation_id='r-p6s51nzb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-814421851',owner_user_name='tempest-VolumesSnapshotTestJSON-814421851-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T23:35:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a46e4d0d14c44ec6945c3ce972031a35',uuid=b4c0930f-4309-43bb-959b-4f36ec457bb6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "663b2fc9-e6a3-4d9a-81bc-484f78acc4dd", "address": "fa:16:3e:20:81:d8", "network": {"id": "ec929af3-f098-4338-943c-d13305d4d555", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-208938347-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f374e5f34c3464fb6f1f82f5d836c57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap663b2fc9-e6", "ovs_interfaceid": "663b2fc9-e6a3-4d9a-81bc-484f78acc4dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75045) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 23:35:18 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-1a0ac375-0ff0-45f9-8b38-916bff77d39b tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] Converting VIF {"id": "663b2fc9-e6a3-4d9a-81bc-484f78acc4dd", "address": "fa:16:3e:20:81:d8", "network": {"id": "ec929af3-f098-4338-943c-d13305d4d555", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-208938347-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f374e5f34c3464fb6f1f82f5d836c57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap663b2fc9-e6", "ovs_interfaceid": "663b2fc9-e6a3-4d9a-81bc-484f78acc4dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 23:35:18 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-1a0ac375-0ff0-45f9-8b38-916bff77d39b tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:20:81:d8,bridge_name='br-int',has_traffic_filtering=True,id=663b2fc9-e6a3-4d9a-81bc-484f78acc4dd,network=Network(ec929af3-f098-4338-943c-d13305d4d555),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap663b2fc9-e6') {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 23:35:18 user nova-compute[75045]: DEBUG nova.objects.instance [None req-1a0ac375-0ff0-45f9-8b38-916bff77d39b tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] Lazy-loading 'pci_devices' on Instance uuid b4c0930f-4309-43bb-959b-4f36ec457bb6 {{(pid=75045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 23:35:18 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-1a0ac375-0ff0-45f9-8b38-916bff77d39b tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] [instance: b4c0930f-4309-43bb-959b-4f36ec457bb6] End _get_guest_xml xml=<domain type="kvm">
Nov 08 23:35:18 user nova-compute[75045]:   <uuid>b4c0930f-4309-43bb-959b-4f36ec457bb6</uuid>
Nov 08 23:35:18 user nova-compute[75045]:   <name>instance-00000023</name>
Nov 08 23:35:18 user nova-compute[75045]:   <memory>524288</memory>
Nov 08 23:35:18 user nova-compute[75045]:   <vcpu>1</vcpu>
Nov 08 23:35:18 user nova-compute[75045]:   <metadata>
Nov 08 23:35:18 user nova-compute[75045]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 23:35:18 user nova-compute[75045]:       <nova:package version="0.0.0"/>
Nov 08 23:35:18 user nova-compute[75045]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-2009963107</nova:name>
Nov 08 23:35:18 user nova-compute[75045]:       <nova:creationTime>2023-11-08 23:35:18</nova:creationTime>
Nov 08 23:35:18 user nova-compute[75045]:       <nova:flavor name="m1.tiny">
Nov 08 23:35:18 user nova-compute[75045]:         <nova:memory>512</nova:memory>
Nov 08 23:35:18 user nova-compute[75045]:         <nova:disk>1</nova:disk>
Nov 08 23:35:18 user nova-compute[75045]:         <nova:swap>0</nova:swap>
Nov 08 23:35:18 user nova-compute[75045]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 23:35:18 user nova-compute[75045]:         <nova:vcpus>1</nova:vcpus>
Nov 08 23:35:18 user nova-compute[75045]:       </nova:flavor>
Nov 08 23:35:18 user nova-compute[75045]:       <nova:owner>
Nov 08 23:35:18 user nova-compute[75045]:         <nova:user uuid="a46e4d0d14c44ec6945c3ce972031a35">tempest-VolumesSnapshotTestJSON-814421851-project-member</nova:user>
Nov 08 23:35:18 user nova-compute[75045]:         <nova:project uuid="4f374e5f34c3464fb6f1f82f5d836c57">tempest-VolumesSnapshotTestJSON-814421851</nova:project>
Nov 08 23:35:18 user nova-compute[75045]:       </nova:owner>
Nov 08 23:35:18 user nova-compute[75045]:       <nova:root type="image" uuid="a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb"/>
Nov 08 23:35:18 user nova-compute[75045]:       <nova:ports>
Nov 08 23:35:18 user nova-compute[75045]:         <nova:port uuid="663b2fc9-e6a3-4d9a-81bc-484f78acc4dd">
Nov 08 23:35:18 user nova-compute[75045]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 08 23:35:18 user nova-compute[75045]:         </nova:port>
Nov 08 23:35:18 user nova-compute[75045]:       </nova:ports>
Nov 08 23:35:18 user nova-compute[75045]:     </nova:instance>
Nov 08 23:35:18 user nova-compute[75045]:   </metadata>
Nov 08 23:35:18 user nova-compute[75045]:   <sysinfo type="smbios">
Nov 08 23:35:18 user nova-compute[75045]:     <system>
Nov 08 23:35:18 user nova-compute[75045]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 23:35:18 user nova-compute[75045]:       <entry name="product">OpenStack Nova</entry>
Nov 08 23:35:18 user nova-compute[75045]:       <entry name="version">0.0.0</entry>
Nov 08 23:35:18 user nova-compute[75045]:       <entry name="serial">b4c0930f-4309-43bb-959b-4f36ec457bb6</entry>
Nov 08 23:35:18 user nova-compute[75045]:       <entry name="uuid">b4c0930f-4309-43bb-959b-4f36ec457bb6</entry>
Nov 08 23:35:18 user nova-compute[75045]:       <entry name="family">Virtual Machine</entry>
Nov 08 23:35:18 user nova-compute[75045]:     </system>
Nov 08 23:35:18 user nova-compute[75045]:   </sysinfo>
Nov 08 23:35:18 user nova-compute[75045]:   <os>
Nov 08 23:35:18 user nova-compute[75045]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 23:35:18 user nova-compute[75045]:     <boot dev="hd"/>
Nov 08 23:35:18 user nova-compute[75045]:     <smbios mode="sysinfo"/>
Nov 08 23:35:18 user nova-compute[75045]:   </os>
Nov 08 23:35:18 user nova-compute[75045]:   <features>
Nov 08 23:35:18 user nova-compute[75045]:     <acpi/>
Nov 08 23:35:18 user nova-compute[75045]:     <apic/>
Nov 08 23:35:18 user nova-compute[75045]:     <vmcoreinfo/>
Nov 08 23:35:18 user nova-compute[75045]:   </features>
Nov 08 23:35:18 user nova-compute[75045]:   <clock offset="utc">
Nov 08 23:35:18 user nova-compute[75045]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 23:35:18 user nova-compute[75045]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 23:35:18 user nova-compute[75045]:     <timer name="hpet" present="no"/>
Nov 08 23:35:18 user nova-compute[75045]:   </clock>
Nov 08 23:35:18 user nova-compute[75045]:   <cpu mode="custom" match="exact">
Nov 08 23:35:18 user nova-compute[75045]:     <model>Nehalem</model>
Nov 08 23:35:18 user nova-compute[75045]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 23:35:18 user nova-compute[75045]:   </cpu>
Nov 08 23:35:18 user nova-compute[75045]:   <devices>
Nov 08 23:35:18 user nova-compute[75045]:     <disk type="file" device="disk">
Nov 08 23:35:18 user nova-compute[75045]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 23:35:18 user nova-compute[75045]:       <source file="/opt/stack/data/nova/instances/b4c0930f-4309-43bb-959b-4f36ec457bb6/disk"/>
Nov 08 23:35:18 user nova-compute[75045]:       <target dev="vda" bus="virtio"/>
Nov 08 23:35:18 user nova-compute[75045]:     </disk>
Nov 08 23:35:18 user nova-compute[75045]:     <interface type="ethernet">
Nov 08 23:35:18 user nova-compute[75045]:       <mac address="fa:16:3e:20:81:d8"/>
Nov 08 23:35:18 user nova-compute[75045]:       <model type="virtio"/>
Nov 08 23:35:18 user nova-compute[75045]:       <mtu size="1442"/>
Nov 08 23:35:18 user nova-compute[75045]:       <target dev="tap663b2fc9-e6"/>
Nov 08 23:35:18 user nova-compute[75045]:     </interface>
Nov 08 23:35:18 user nova-compute[75045]:     <serial type="pty">
Nov 08 23:35:18 user nova-compute[75045]:       <log file="/opt/stack/data/nova/instances/b4c0930f-4309-43bb-959b-4f36ec457bb6/console.log" append="off"/>
Nov 08 23:35:18 user nova-compute[75045]:     </serial>
Nov 08 23:35:18 user nova-compute[75045]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 23:35:18 user nova-compute[75045]:     <video>
Nov 08 23:35:18 user nova-compute[75045]:       <model type="virtio"/>
Nov 08 23:35:18 user nova-compute[75045]:     </video>
Nov 08 23:35:18 user nova-compute[75045]:     <rng model="virtio">
Nov 08 23:35:18 user nova-compute[75045]:       <backend model="random">/dev/urandom</backend>
Nov 08 23:35:18 user nova-compute[75045]:     </rng>
Nov 08 23:35:18 user nova-compute[75045]:     <controller type="usb" index="0" model="none"/>
Nov 08 23:35:18 user nova-compute[75045]:     <memballoon model="virtio">
Nov 08 23:35:18 user nova-compute[75045]:       <stats period="10"/>
Nov 08 23:35:18 user nova-compute[75045]:     </memballoon>
Nov 08 23:35:18 user nova-compute[75045]:   </devices>
Nov 08 23:35:18 user nova-compute[75045]: </domain>
Nov 08 23:35:18 user nova-compute[75045]:  {{(pid=75045) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 23:35:18 user nova-compute[75045]: DEBUG nova.virt.libvirt.vif [None req-1a0ac375-0ff0-45f9-8b38-916bff77d39b tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T23:35:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-2009963107',display_name='tempest-VolumesSnapshotTestJSON-instance-2009963107',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-2009963107',id=35,image_ref='a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLnjKeBjBHoKmy9j4HNkcFvqFAiYNhmGBrR6rb7DdrlyUYn2o/xrjq17JSZrMaGbwZKA3q3h9Q+vaGBdtWJ1bkqUxh0nIfi3eaVgNLcADV+7GSgUqL7YJFBmOmWVAaQ1jA==',key_name='tempest-keypair-830577175',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4f374e5f34c3464fb6f1f82f5d836c57',ramdisk_id='',reservation_id='r-p6s51nzb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-814421851',owner_user_name='tempest-VolumesSnapshotTestJSON-814421851-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T23:35:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a46e4d0d14c44ec6945c3ce972031a35',uuid=b4c0930f-4309-43bb-959b-4f36ec457bb6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "663b2fc9-e6a3-4d9a-81bc-484f78acc4dd", "address": "fa:16:3e:20:81:d8", "network": {"id": "ec929af3-f098-4338-943c-d13305d4d555", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-208938347-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f374e5f34c3464fb6f1f82f5d836c57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap663b2fc9-e6", "ovs_interfaceid": "663b2fc9-e6a3-4d9a-81bc-484f78acc4dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75045) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 23:35:18 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-1a0ac375-0ff0-45f9-8b38-916bff77d39b tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] Converting VIF {"id": "663b2fc9-e6a3-4d9a-81bc-484f78acc4dd", "address": "fa:16:3e:20:81:d8", "network": {"id": "ec929af3-f098-4338-943c-d13305d4d555", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-208938347-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f374e5f34c3464fb6f1f82f5d836c57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap663b2fc9-e6", "ovs_interfaceid": "663b2fc9-e6a3-4d9a-81bc-484f78acc4dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 23:35:18 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-1a0ac375-0ff0-45f9-8b38-916bff77d39b tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:20:81:d8,bridge_name='br-int',has_traffic_filtering=True,id=663b2fc9-e6a3-4d9a-81bc-484f78acc4dd,network=Network(ec929af3-f098-4338-943c-d13305d4d555),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap663b2fc9-e6') {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 23:35:18 user nova-compute[75045]: DEBUG os_vif [None req-1a0ac375-0ff0-45f9-8b38-916bff77d39b tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:20:81:d8,bridge_name='br-int',has_traffic_filtering=True,id=663b2fc9-e6a3-4d9a-81bc-484f78acc4dd,network=Network(ec929af3-f098-4338-943c-d13305d4d555),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap663b2fc9-e6') {{(pid=75045) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 23:35:18 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:35:18 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:35:18 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 23:35:18 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-416d7513-0465-4e88-bcb0-a155bb6d06f3 tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] Lock "adcffd35-00c7-49db-a72f-d6307a90e123" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.440s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:35:18 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:35:18 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a86abeec-a03e-5668-97ab-a8d89af22392', '_type': 'linux-noop'}}, row=False) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:35:18 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:35:18 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 23:35:18 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:35:18 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap663b2fc9-e6, may_exist=True, interface_attrs={}) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:35:18 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap663b2fc9-e6, col_values=(('qos', UUID('e0e495b9-23e7-4fed-90cd-1b4b12a26660')),), if_exists=True) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:35:18 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap663b2fc9-e6, col_values=(('external_ids', {'iface-id': '663b2fc9-e6a3-4d9a-81bc-484f78acc4dd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:20:81:d8', 'vm-uuid': 'b4c0930f-4309-43bb-959b-4f36ec457bb6'}),), if_exists=True) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:35:18 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:35:18 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 23:35:18 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:35:18 user nova-compute[75045]: INFO os_vif [None req-1a0ac375-0ff0-45f9-8b38-916bff77d39b tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:20:81:d8,bridge_name='br-int',has_traffic_filtering=True,id=663b2fc9-e6a3-4d9a-81bc-484f78acc4dd,network=Network(ec929af3-f098-4338-943c-d13305d4d555),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap663b2fc9-e6')
Nov 08 23:35:18 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-1a0ac375-0ff0-45f9-8b38-916bff77d39b tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] No BDM found with device name vda, not building metadata. {{(pid=75045) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 23:35:18 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-1a0ac375-0ff0-45f9-8b38-916bff77d39b tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] No VIF found with MAC fa:16:3e:20:81:d8, not building metadata {{(pid=75045) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 23:35:18 user nova-compute[75045]: DEBUG nova.network.neutron [req-c5df76f6-faad-459d-a103-4370b735777e req-f799ec22-8f97-45c2-b68b-e3739d966cff service nova] [instance: b4c0930f-4309-43bb-959b-4f36ec457bb6] Updated VIF entry in instance network info cache for port 663b2fc9-e6a3-4d9a-81bc-484f78acc4dd. {{(pid=75045) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 23:35:18 user nova-compute[75045]: DEBUG nova.network.neutron [req-c5df76f6-faad-459d-a103-4370b735777e req-f799ec22-8f97-45c2-b68b-e3739d966cff service nova] [instance: b4c0930f-4309-43bb-959b-4f36ec457bb6] Updating instance_info_cache with network_info: [{"id": "663b2fc9-e6a3-4d9a-81bc-484f78acc4dd", "address": "fa:16:3e:20:81:d8", "network": {"id": "ec929af3-f098-4338-943c-d13305d4d555", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-208938347-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f374e5f34c3464fb6f1f82f5d836c57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap663b2fc9-e6", "ovs_interfaceid": "663b2fc9-e6a3-4d9a-81bc-484f78acc4dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75045) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 23:35:18 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-c5df76f6-faad-459d-a103-4370b735777e req-f799ec22-8f97-45c2-b68b-e3739d966cff service nova] Releasing lock "refresh_cache-b4c0930f-4309-43bb-959b-4f36ec457bb6" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 23:35:19 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:35:19 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:35:20 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:35:20 user nova-compute[75045]: DEBUG nova.compute.manager [req-f117a530-05e8-4343-ba52-393397710949 req-63ba88ea-4927-426c-8e9e-07a33a7a8aeb service nova] [instance: b4c0930f-4309-43bb-959b-4f36ec457bb6] Received event network-vif-plugged-663b2fc9-e6a3-4d9a-81bc-484f78acc4dd {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:35:20 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-f117a530-05e8-4343-ba52-393397710949 req-63ba88ea-4927-426c-8e9e-07a33a7a8aeb service nova] Acquiring lock "b4c0930f-4309-43bb-959b-4f36ec457bb6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:35:20 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-f117a530-05e8-4343-ba52-393397710949 req-63ba88ea-4927-426c-8e9e-07a33a7a8aeb service nova] Lock "b4c0930f-4309-43bb-959b-4f36ec457bb6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:35:20 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-f117a530-05e8-4343-ba52-393397710949 req-63ba88ea-4927-426c-8e9e-07a33a7a8aeb service nova] Lock "b4c0930f-4309-43bb-959b-4f36ec457bb6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:35:20 user nova-compute[75045]: DEBUG nova.compute.manager [req-f117a530-05e8-4343-ba52-393397710949 req-63ba88ea-4927-426c-8e9e-07a33a7a8aeb service nova] [instance: b4c0930f-4309-43bb-959b-4f36ec457bb6] No waiting events found dispatching network-vif-plugged-663b2fc9-e6a3-4d9a-81bc-484f78acc4dd {{(pid=75045) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 23:35:20 user nova-compute[75045]: WARNING nova.compute.manager [req-f117a530-05e8-4343-ba52-393397710949 req-63ba88ea-4927-426c-8e9e-07a33a7a8aeb service nova] [instance: b4c0930f-4309-43bb-959b-4f36ec457bb6] Received unexpected event network-vif-plugged-663b2fc9-e6a3-4d9a-81bc-484f78acc4dd for instance with vm_state building and task_state spawning.
Nov 08 23:35:20 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:35:20 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:35:20 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:35:21 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:35:22 user nova-compute[75045]: DEBUG nova.compute.manager [None req-1a0ac375-0ff0-45f9-8b38-916bff77d39b tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] [instance: b4c0930f-4309-43bb-959b-4f36ec457bb6] Instance event wait completed in 0 seconds for  {{(pid=75045) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 23:35:22 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-1a0ac375-0ff0-45f9-8b38-916bff77d39b tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] [instance: b4c0930f-4309-43bb-959b-4f36ec457bb6] Guest created on hypervisor {{(pid=75045) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 23:35:22 user nova-compute[75045]: INFO nova.virt.libvirt.driver [-] [instance: b4c0930f-4309-43bb-959b-4f36ec457bb6] Instance spawned successfully.
Nov 08 23:35:22 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-1a0ac375-0ff0-45f9-8b38-916bff77d39b tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] [instance: b4c0930f-4309-43bb-959b-4f36ec457bb6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75045) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 23:35:22 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-1a0ac375-0ff0-45f9-8b38-916bff77d39b tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] [instance: b4c0930f-4309-43bb-959b-4f36ec457bb6] Found default for hw_cdrom_bus of ide {{(pid=75045) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 23:35:22 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-1a0ac375-0ff0-45f9-8b38-916bff77d39b tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] [instance: b4c0930f-4309-43bb-959b-4f36ec457bb6] Found default for hw_disk_bus of virtio {{(pid=75045) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 23:35:22 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-1a0ac375-0ff0-45f9-8b38-916bff77d39b tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] [instance: b4c0930f-4309-43bb-959b-4f36ec457bb6] Found default for hw_input_bus of None {{(pid=75045) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 23:35:22 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-1a0ac375-0ff0-45f9-8b38-916bff77d39b tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] [instance: b4c0930f-4309-43bb-959b-4f36ec457bb6] Found default for hw_pointer_model of None {{(pid=75045) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 23:35:22 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-1a0ac375-0ff0-45f9-8b38-916bff77d39b tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] [instance: b4c0930f-4309-43bb-959b-4f36ec457bb6] Found default for hw_video_model of virtio {{(pid=75045) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 23:35:22 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-1a0ac375-0ff0-45f9-8b38-916bff77d39b tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] [instance: b4c0930f-4309-43bb-959b-4f36ec457bb6] Found default for hw_vif_model of virtio {{(pid=75045) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 23:35:22 user nova-compute[75045]: DEBUG nova.compute.manager [req-9c683195-ec8d-427a-b241-6e26bbb2c0e9 req-5ba46416-cede-4bf9-be53-629cdcfe34a7 service nova] [instance: b4c0930f-4309-43bb-959b-4f36ec457bb6] Received event network-vif-plugged-663b2fc9-e6a3-4d9a-81bc-484f78acc4dd {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:35:22 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-9c683195-ec8d-427a-b241-6e26bbb2c0e9 req-5ba46416-cede-4bf9-be53-629cdcfe34a7 service nova] Acquiring lock "b4c0930f-4309-43bb-959b-4f36ec457bb6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:35:22 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-9c683195-ec8d-427a-b241-6e26bbb2c0e9 req-5ba46416-cede-4bf9-be53-629cdcfe34a7 service nova] Lock "b4c0930f-4309-43bb-959b-4f36ec457bb6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:35:22 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-9c683195-ec8d-427a-b241-6e26bbb2c0e9 req-5ba46416-cede-4bf9-be53-629cdcfe34a7 service nova] Lock "b4c0930f-4309-43bb-959b-4f36ec457bb6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:35:22 user nova-compute[75045]: DEBUG nova.compute.manager [req-9c683195-ec8d-427a-b241-6e26bbb2c0e9 req-5ba46416-cede-4bf9-be53-629cdcfe34a7 service nova] [instance: b4c0930f-4309-43bb-959b-4f36ec457bb6] No waiting events found dispatching network-vif-plugged-663b2fc9-e6a3-4d9a-81bc-484f78acc4dd {{(pid=75045) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 23:35:22 user nova-compute[75045]: WARNING nova.compute.manager [req-9c683195-ec8d-427a-b241-6e26bbb2c0e9 req-5ba46416-cede-4bf9-be53-629cdcfe34a7 service nova] [instance: b4c0930f-4309-43bb-959b-4f36ec457bb6] Received unexpected event network-vif-plugged-663b2fc9-e6a3-4d9a-81bc-484f78acc4dd for instance with vm_state building and task_state spawning.
Nov 08 23:35:22 user nova-compute[75045]: INFO nova.compute.manager [None req-1a0ac375-0ff0-45f9-8b38-916bff77d39b tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] [instance: b4c0930f-4309-43bb-959b-4f36ec457bb6] Took 5.70 seconds to spawn the instance on the hypervisor.
Nov 08 23:35:22 user nova-compute[75045]: DEBUG nova.compute.manager [None req-1a0ac375-0ff0-45f9-8b38-916bff77d39b tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] [instance: b4c0930f-4309-43bb-959b-4f36ec457bb6] Checking state {{(pid=75045) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 23:35:22 user nova-compute[75045]: INFO nova.compute.manager [None req-1a0ac375-0ff0-45f9-8b38-916bff77d39b tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] [instance: b4c0930f-4309-43bb-959b-4f36ec457bb6] Took 6.62 seconds to build instance.
Nov 08 23:35:22 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-1a0ac375-0ff0-45f9-8b38-916bff77d39b tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] Lock "b4c0930f-4309-43bb-959b-4f36ec457bb6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.738s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:35:23 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:35:26 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-dad522df-76b9-4ee4-873f-ce72c53f9a76 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Acquiring lock "04169f59-e9a6-4b50-9ad7-7f8c105a376a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:35:26 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-dad522df-76b9-4ee4-873f-ce72c53f9a76 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Lock "04169f59-e9a6-4b50-9ad7-7f8c105a376a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:35:26 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-dad522df-76b9-4ee4-873f-ce72c53f9a76 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Acquiring lock "04169f59-e9a6-4b50-9ad7-7f8c105a376a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:35:26 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-dad522df-76b9-4ee4-873f-ce72c53f9a76 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Lock "04169f59-e9a6-4b50-9ad7-7f8c105a376a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:35:26 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-dad522df-76b9-4ee4-873f-ce72c53f9a76 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Lock "04169f59-e9a6-4b50-9ad7-7f8c105a376a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:35:26 user nova-compute[75045]: INFO nova.compute.manager [None req-dad522df-76b9-4ee4-873f-ce72c53f9a76 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] [instance: 04169f59-e9a6-4b50-9ad7-7f8c105a376a] Terminating instance
Nov 08 23:35:26 user nova-compute[75045]: DEBUG nova.compute.manager [None req-dad522df-76b9-4ee4-873f-ce72c53f9a76 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] [instance: 04169f59-e9a6-4b50-9ad7-7f8c105a376a] Start destroying the instance on the hypervisor. {{(pid=75045) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 23:35:26 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:35:26 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:35:26 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:35:26 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:35:26 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:35:26 user nova-compute[75045]: DEBUG nova.compute.manager [req-4ebc3bc9-0072-449b-8cfd-4585902cd441 req-57e38668-2bf3-4279-aedd-f291e3e11a3b service nova] [instance: 04169f59-e9a6-4b50-9ad7-7f8c105a376a] Received event network-vif-unplugged-96af9673-bb3c-4173-8439-0be6d2b922cf {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:35:26 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-4ebc3bc9-0072-449b-8cfd-4585902cd441 req-57e38668-2bf3-4279-aedd-f291e3e11a3b service nova] Acquiring lock "04169f59-e9a6-4b50-9ad7-7f8c105a376a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:35:26 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-4ebc3bc9-0072-449b-8cfd-4585902cd441 req-57e38668-2bf3-4279-aedd-f291e3e11a3b service nova] Lock "04169f59-e9a6-4b50-9ad7-7f8c105a376a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:35:26 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-4ebc3bc9-0072-449b-8cfd-4585902cd441 req-57e38668-2bf3-4279-aedd-f291e3e11a3b service nova] Lock "04169f59-e9a6-4b50-9ad7-7f8c105a376a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:35:26 user nova-compute[75045]: DEBUG nova.compute.manager [req-4ebc3bc9-0072-449b-8cfd-4585902cd441 req-57e38668-2bf3-4279-aedd-f291e3e11a3b service nova] [instance: 04169f59-e9a6-4b50-9ad7-7f8c105a376a] No waiting events found dispatching network-vif-unplugged-96af9673-bb3c-4173-8439-0be6d2b922cf {{(pid=75045) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 23:35:26 user nova-compute[75045]: DEBUG nova.compute.manager [req-4ebc3bc9-0072-449b-8cfd-4585902cd441 req-57e38668-2bf3-4279-aedd-f291e3e11a3b service nova] [instance: 04169f59-e9a6-4b50-9ad7-7f8c105a376a] Received event network-vif-unplugged-96af9673-bb3c-4173-8439-0be6d2b922cf for instance with task_state deleting. {{(pid=75045) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 23:35:27 user nova-compute[75045]: INFO nova.virt.libvirt.driver [-] [instance: 04169f59-e9a6-4b50-9ad7-7f8c105a376a] Instance destroyed successfully.
Nov 08 23:35:27 user nova-compute[75045]: DEBUG nova.objects.instance [None req-dad522df-76b9-4ee4-873f-ce72c53f9a76 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Lazy-loading 'resources' on Instance uuid 04169f59-e9a6-4b50-9ad7-7f8c105a376a {{(pid=75045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 23:35:27 user nova-compute[75045]: DEBUG nova.virt.libvirt.vif [None req-dad522df-76b9-4ee4-873f-ce72c53f9a76 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T23:28:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1540084668',display_name='tempest-ServerActionsTestOtherA-server-1540084668',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1540084668',id=27,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDODl/KmGTsZ/iebmo5xmCcXvI602I8HkxrrHYOCSHtu28wqdqp4sqz8GjX6RCkUTvwm3o1RrGN7CPAGp6yuNsTNNdTZNeJLiXbNPx6WnByfZzN9Q7qtNxToi4a9/5pZlg==',key_name='tempest-keypair-679582766',keypairs=<?>,launch_index=0,launched_at=2023-11-08T23:31:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e63623113f11463d9035bb990de43510',ramdisk_id='',reservation_id='r-tx09g4z0',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-2056815713',owner_user_name='tempest-ServerActionsTestOtherA-2056815713-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T23:32:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='75fc508f268d4a569ad78598ff019c14',uuid=04169f59-e9a6-4b50-9ad7-7f8c105a376a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "96af9673-bb3c-4173-8439-0be6d2b922cf", "address": "fa:16:3e:a5:6d:8b", "network": {"id": "700b5784-d35b-45c0-a4d3-1ab8aa4c48aa", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-194469807-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.175", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e63623113f11463d9035bb990de43510", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96af9673-bb", "ovs_interfaceid": "96af9673-bb3c-4173-8439-0be6d2b922cf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75045) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 23:35:27 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-dad522df-76b9-4ee4-873f-ce72c53f9a76 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Converting VIF {"id": "96af9673-bb3c-4173-8439-0be6d2b922cf", "address": "fa:16:3e:a5:6d:8b", "network": {"id": "700b5784-d35b-45c0-a4d3-1ab8aa4c48aa", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-194469807-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.175", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e63623113f11463d9035bb990de43510", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96af9673-bb", "ovs_interfaceid": "96af9673-bb3c-4173-8439-0be6d2b922cf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 23:35:27 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-dad522df-76b9-4ee4-873f-ce72c53f9a76 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a5:6d:8b,bridge_name='br-int',has_traffic_filtering=True,id=96af9673-bb3c-4173-8439-0be6d2b922cf,network=Network(700b5784-d35b-45c0-a4d3-1ab8aa4c48aa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96af9673-bb') {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 23:35:27 user nova-compute[75045]: DEBUG os_vif [None req-dad522df-76b9-4ee4-873f-ce72c53f9a76 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a5:6d:8b,bridge_name='br-int',has_traffic_filtering=True,id=96af9673-bb3c-4173-8439-0be6d2b922cf,network=Network(700b5784-d35b-45c0-a4d3-1ab8aa4c48aa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96af9673-bb') {{(pid=75045) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 23:35:27 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:35:27 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap96af9673-bb, bridge=br-int, if_exists=True) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:35:27 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:35:27 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:35:27 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:35:27 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f071ae3a-31f2-4c93-b99f-dd9e04e14e02) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:35:27 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:35:27 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 23:35:27 user nova-compute[75045]: INFO os_vif [None req-dad522df-76b9-4ee4-873f-ce72c53f9a76 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a5:6d:8b,bridge_name='br-int',has_traffic_filtering=True,id=96af9673-bb3c-4173-8439-0be6d2b922cf,network=Network(700b5784-d35b-45c0-a4d3-1ab8aa4c48aa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96af9673-bb')
Nov 08 23:35:27 user nova-compute[75045]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dad522df-76b9-4ee4-873f-ce72c53f9a76 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] [instance: 04169f59-e9a6-4b50-9ad7-7f8c105a376a] calling os-brick to detach iSCSI Volume {{(pid=75045) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 23:35:27 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-dad522df-76b9-4ee4-873f-ce72c53f9a76 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1b68210460>, {'target_iqn': 'iqn.2010-10.org.openstack:e9c3ac6d-d72a-41c8-9c18-15131250e323', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WPeOlnqB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75045) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 23:35:27 user nova-compute[75045]: WARNING os_brick.initiator.connectors.base [None req-dad522df-76b9-4ee4-873f-ce72c53f9a76 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 23:35:27 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-dad522df-76b9-4ee4-873f-ce72c53f9a76 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 23:35:27 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-dad522df-76b9-4ee4-873f-ce72c53f9a76 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 23:35:27 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:35:27 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:35:27 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea96c296-e0a7-4c4a-a5bf-f804777e03bd]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e9c3ac6d-d72a-41c8-9c18-15131250e323\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1b2a3b04-13be-4853-822c-29c416757252\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:35:27 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-dad522df-76b9-4ee4-873f-ce72c53f9a76 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 23:35:27 user nova-compute[75045]: No targets found.
Nov 08 23:35:27 user nova-compute[75045]: iSNS:
Nov 08 23:35:27 user nova-compute[75045]: No targets found.
Nov 08 23:35:27 user nova-compute[75045]: STATIC:
Nov 08 23:35:27 user nova-compute[75045]: Target: iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab
Nov 08 23:35:27 user nova-compute[75045]:         Portal: 172.16.0.220:3260,-1
Nov 08 23:35:27 user nova-compute[75045]:                 Iface Name: default
Nov 08 23:35:27 user nova-compute[75045]: Target: iqn.2010-10.org.openstack:e9c3ac6d-d72a-41c8-9c18-15131250e323
Nov 08 23:35:27 user nova-compute[75045]:         Portal: 172.16.0.220:3260,-1
Nov 08 23:35:27 user nova-compute[75045]:                 Iface Name: default
Nov 08 23:35:27 user nova-compute[75045]: Target: iqn.2010-10.org.openstack:1b2a3b04-13be-4853-822c-29c416757252
Nov 08 23:35:27 user nova-compute[75045]:         Portal: 172.16.0.220:3260,-1
Nov 08 23:35:27 user nova-compute[75045]:                 Iface Name: default
Nov 08 23:35:27 user nova-compute[75045]: FIRMWARE:
Nov 08 23:35:27 user nova-compute[75045]: No targets found.
Nov 08 23:35:27 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 23:35:27 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-dad522df-76b9-4ee4-873f-ce72c53f9a76 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 23:35:27 user nova-compute[75045]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 23:35:27 user nova-compute[75045]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75045) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 23:35:27 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-dad522df-76b9-4ee4-873f-ce72c53f9a76 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e9c3ac6d-d72a-41c8-9c18-15131250e323', 0)] {{(pid=75045) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 23:35:27 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:35:27 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:35:27 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[12082be7-2294-4a16-8477-c973fc4a3809]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1b2a3b04-13be-4853-822c-29c416757252\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e9c3ac6d-d72a-41c8-9c18-15131250e323\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:35:27 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:35:27 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:35:27 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[e50cbe98-8d5d-4802-b136-5dcd5895dee8]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9c3ac6d-d72a-41c8-9c18-15131250e323 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b2a3b04-13be-4853-822c-29c416757252 (non-flash)\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:35:27 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-dad522df-76b9-4ee4-873f-ce72c53f9a76 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab (non-flash)
Nov 08 23:35:27 user nova-compute[75045]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9c3ac6d-d72a-41c8-9c18-15131250e323 (non-flash)
Nov 08 23:35:27 user nova-compute[75045]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b2a3b04-13be-4853-822c-29c416757252 (non-flash)
Nov 08 23:35:27 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 23:35:27 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-dad522df-76b9-4ee4-873f-ce72c53f9a76 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab (non-flash)
Nov 08 23:35:27 user nova-compute[75045]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9c3ac6d-d72a-41c8-9c18-15131250e323 (non-flash)
Nov 08 23:35:27 user nova-compute[75045]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b2a3b04-13be-4853-822c-29c416757252 (non-flash)
Nov 08 23:35:27 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 23:35:27 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-dad522df-76b9-4ee4-873f-ce72c53f9a76 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1b68267c70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e9c3ac6d-d72a-41c8-9c18-15131250e323'): ({'sdc'}, set())}) {{(pid=75045) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 23:35:27 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-dad522df-76b9-4ee4-873f-ce72c53f9a76 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Removing single pathed devices sdc {{(pid=75045) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 23:35:27 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:35:27 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:35:27 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d41a04a-ae0b-4b06-ae91-6965244a5f6e]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:35:27 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:35:27 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:35:27 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[43c46580-8a6a-405c-9714-853814939c01]: (4, ('ok\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:35:27 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-dad522df-76b9-4ee4-873f-ce72c53f9a76 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Flushing IO for device /dev/sdc {{(pid=75045) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 23:35:27 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:35:27 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:35:27 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[01ff7ed2-82cc-4fe1-b534-9f75f4c8888e]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:35:27 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-dad522df-76b9-4ee4-873f-ce72c53f9a76 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75045) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 23:35:27 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:35:27 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.060s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:35:27 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[9735379a-88e8-4c79-ba1b-bd9a0706d82e]: (4, ('1', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:35:27 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-dad522df-76b9-4ee4-873f-ce72c53f9a76 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75045) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 23:35:27 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-dad522df-76b9-4ee4-873f-ce72c53f9a76 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] SCSI volumes sdc have been removed. {{(pid=75045) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 23:35:27 user nova-compute[75045]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-23833353965313638', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_9dfef8e9', '/dev/disk/by-id/scsi-1SCST_BIO9dfef8e9-8359e1682beaf101') {{(pid=86132) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 08 23:35:27 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[71529973-062e-4818-bb62-0f3341298e21]: (4, None) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:35:27 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-dad522df-76b9-4ee4-873f-ce72c53f9a76 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e9c3ac6d-d72a-41c8-9c18-15131250e323')] {{(pid=75045) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 23:35:27 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e9c3ac6d-d72a-41c8-9c18-15131250e323 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:35:27 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e9c3ac6d-d72a-41c8-9c18-15131250e323 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:35:27 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[bccfcf7e-9d47-438a-84a1-b7e600934f33]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:35:27 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-dad522df-76b9-4ee4-873f-ce72c53f9a76 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:35:27 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e9c3ac6d-d72a-41c8-9c18-15131250e323 -p 172.16.0.220:3260 --logout {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:35:27 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e9c3ac6d-d72a-41c8-9c18-15131250e323 -p 172.16.0.220:3260 --logout" returned: 0 in 0.074s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:35:27 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[61903bc5-ae46-4b59-80dd-d12e073a9982]: (4, ('Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:e9c3ac6d-d72a-41c8-9c18-15131250e323, portal: 172.16.0.220,3260]\nLogout of [sid: 32, target: iqn.2010-10.org.openstack:e9c3ac6d-d72a-41c8-9c18-15131250e323, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:35:27 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-dad522df-76b9-4ee4-873f-ce72c53f9a76 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:e9c3ac6d-d72a-41c8-9c18-15131250e323, portal: 172.16.0.220,3260]
Nov 08 23:35:27 user nova-compute[75045]: Logout of [sid: 32, target: iqn.2010-10.org.openstack:e9c3ac6d-d72a-41c8-9c18-15131250e323, portal: 172.16.0.220,3260] successful.
Nov 08 23:35:27 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:35:27 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e9c3ac6d-d72a-41c8-9c18-15131250e323 -p 172.16.0.220:3260 --op delete {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:35:27 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e9c3ac6d-d72a-41c8-9c18-15131250e323 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:35:27 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b15d1d8-f2b7-4ac5-9634-524ad4467000]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:35:27 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-dad522df-76b9-4ee4-873f-ce72c53f9a76 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:35:27 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-dad522df-76b9-4ee4-873f-ce72c53f9a76 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.364s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 23:35:27 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-dad522df-76b9-4ee4-873f-ce72c53f9a76 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] <== disconnect_volume: return (365ms) None {{(pid=75045) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 23:35:27 user nova-compute[75045]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dad522df-76b9-4ee4-873f-ce72c53f9a76 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] [instance: 04169f59-e9a6-4b50-9ad7-7f8c105a376a] Disconnected iSCSI Volume {{(pid=75045) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 23:35:27 user nova-compute[75045]: INFO nova.virt.libvirt.driver [None req-dad522df-76b9-4ee4-873f-ce72c53f9a76 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] [instance: 04169f59-e9a6-4b50-9ad7-7f8c105a376a] Deleting instance files /opt/stack/data/nova/instances/04169f59-e9a6-4b50-9ad7-7f8c105a376a_del
Nov 08 23:35:27 user nova-compute[75045]: INFO nova.virt.libvirt.driver [None req-dad522df-76b9-4ee4-873f-ce72c53f9a76 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] [instance: 04169f59-e9a6-4b50-9ad7-7f8c105a376a] Deletion of /opt/stack/data/nova/instances/04169f59-e9a6-4b50-9ad7-7f8c105a376a_del complete
Nov 08 23:35:27 user nova-compute[75045]: INFO nova.compute.manager [None req-dad522df-76b9-4ee4-873f-ce72c53f9a76 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] [instance: 04169f59-e9a6-4b50-9ad7-7f8c105a376a] Took 1.31 seconds to destroy the instance on the hypervisor.
Nov 08 23:35:27 user nova-compute[75045]: DEBUG oslo.service.loopingcall [None req-dad522df-76b9-4ee4-873f-ce72c53f9a76 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75045) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 23:35:27 user nova-compute[75045]: DEBUG nova.compute.manager [-] [instance: 04169f59-e9a6-4b50-9ad7-7f8c105a376a] Deallocating network for instance {{(pid=75045) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 23:35:27 user nova-compute[75045]: DEBUG nova.network.neutron [-] [instance: 04169f59-e9a6-4b50-9ad7-7f8c105a376a] deallocate_for_instance() {{(pid=75045) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 23:35:28 user nova-compute[75045]: DEBUG nova.network.neutron [-] [instance: 04169f59-e9a6-4b50-9ad7-7f8c105a376a] Updating instance_info_cache with network_info: [] {{(pid=75045) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 23:35:28 user nova-compute[75045]: INFO nova.compute.manager [-] [instance: 04169f59-e9a6-4b50-9ad7-7f8c105a376a] Took 0.86 seconds to deallocate network for instance.
Nov 08 23:35:28 user nova-compute[75045]: DEBUG nova.compute.manager [req-b6c27f5b-6534-4303-8624-4f903251cd4f req-ab013730-2ac3-4156-8985-c5c6a6e0377c service nova] [instance: 04169f59-e9a6-4b50-9ad7-7f8c105a376a] Received event network-vif-plugged-96af9673-bb3c-4173-8439-0be6d2b922cf {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:35:28 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-b6c27f5b-6534-4303-8624-4f903251cd4f req-ab013730-2ac3-4156-8985-c5c6a6e0377c service nova] Acquiring lock "04169f59-e9a6-4b50-9ad7-7f8c105a376a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:35:28 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-b6c27f5b-6534-4303-8624-4f903251cd4f req-ab013730-2ac3-4156-8985-c5c6a6e0377c service nova] Lock "04169f59-e9a6-4b50-9ad7-7f8c105a376a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:35:28 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-b6c27f5b-6534-4303-8624-4f903251cd4f req-ab013730-2ac3-4156-8985-c5c6a6e0377c service nova] Lock "04169f59-e9a6-4b50-9ad7-7f8c105a376a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:35:28 user nova-compute[75045]: DEBUG nova.compute.manager [req-b6c27f5b-6534-4303-8624-4f903251cd4f req-ab013730-2ac3-4156-8985-c5c6a6e0377c service nova] [instance: 04169f59-e9a6-4b50-9ad7-7f8c105a376a] No waiting events found dispatching network-vif-plugged-96af9673-bb3c-4173-8439-0be6d2b922cf {{(pid=75045) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 23:35:28 user nova-compute[75045]: WARNING nova.compute.manager [req-b6c27f5b-6534-4303-8624-4f903251cd4f req-ab013730-2ac3-4156-8985-c5c6a6e0377c service nova] [instance: 04169f59-e9a6-4b50-9ad7-7f8c105a376a] Received unexpected event network-vif-plugged-96af9673-bb3c-4173-8439-0be6d2b922cf for instance with vm_state active and task_state deleting.
Nov 08 23:35:28 user nova-compute[75045]: DEBUG nova.compute.manager [req-b6c27f5b-6534-4303-8624-4f903251cd4f req-ab013730-2ac3-4156-8985-c5c6a6e0377c service nova] [instance: 04169f59-e9a6-4b50-9ad7-7f8c105a376a] Received event network-vif-deleted-96af9673-bb3c-4173-8439-0be6d2b922cf {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:35:29 user nova-compute[75045]: DEBUG nova.objects.instance [None req-16fd8de7-d112-469e-aa64-55a99c6828da tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Lazy-loading 'flavor' on Instance uuid a63971de-a2bf-4e58-a760-30eaec3b83c0 {{(pid=75045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 23:35:29 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-16fd8de7-d112-469e-aa64-55a99c6828da tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Lock "a63971de-a2bf-4e58-a760-30eaec3b83c0" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 32.148s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:35:29 user nova-compute[75045]: INFO nova.compute.manager [None req-dad522df-76b9-4ee4-873f-ce72c53f9a76 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] [instance: 04169f59-e9a6-4b50-9ad7-7f8c105a376a] Took 1.00 seconds to detach 1 volumes for instance.
Nov 08 23:35:29 user nova-compute[75045]: DEBUG nova.compute.manager [None req-dad522df-76b9-4ee4-873f-ce72c53f9a76 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] [instance: 04169f59-e9a6-4b50-9ad7-7f8c105a376a] Deleting volume: e9c3ac6d-d72a-41c8-9c18-15131250e323 {{(pid=75045) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 08 23:35:29 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-dad522df-76b9-4ee4-873f-ce72c53f9a76 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:35:29 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-dad522df-76b9-4ee4-873f-ce72c53f9a76 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:35:30 user nova-compute[75045]: DEBUG nova.compute.provider_tree [None req-dad522df-76b9-4ee4-873f-ce72c53f9a76 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Inventory has not changed in ProviderTree for provider: 62ba5f85-c74d-4b58-986e-d4197e813fd7 {{(pid=75045) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 23:35:30 user nova-compute[75045]: DEBUG nova.scheduler.client.report [None req-dad522df-76b9-4ee4-873f-ce72c53f9a76 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Inventory has not changed for provider 62ba5f85-c74d-4b58-986e-d4197e813fd7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75045) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 23:35:30 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-dad522df-76b9-4ee4-873f-ce72c53f9a76 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.468s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:35:30 user nova-compute[75045]: INFO nova.scheduler.client.report [None req-dad522df-76b9-4ee4-873f-ce72c53f9a76 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Deleted allocations for instance 04169f59-e9a6-4b50-9ad7-7f8c105a376a
Nov 08 23:35:30 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-dad522df-76b9-4ee4-873f-ce72c53f9a76 tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Lock "04169f59-e9a6-4b50-9ad7-7f8c105a376a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.934s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:35:31 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:35:32 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:35:37 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 23:35:37 user nova-compute[75045]: DEBUG nova.compute.manager [req-c8a17b97-c376-4f58-9019-5d1d1f6acca3 req-af849966-dd2a-4c8b-b214-15e8be8f48d2 service nova] [instance: 72c9d731-2b35-434c-8463-1cd6c18fbd6a] Received event network-changed-996f98bd-77bf-4176-8fe3-ea98b0c070a0 {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:35:37 user nova-compute[75045]: DEBUG nova.compute.manager [req-c8a17b97-c376-4f58-9019-5d1d1f6acca3 req-af849966-dd2a-4c8b-b214-15e8be8f48d2 service nova] [instance: 72c9d731-2b35-434c-8463-1cd6c18fbd6a] Refreshing instance network info cache due to event network-changed-996f98bd-77bf-4176-8fe3-ea98b0c070a0. {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 23:35:37 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-c8a17b97-c376-4f58-9019-5d1d1f6acca3 req-af849966-dd2a-4c8b-b214-15e8be8f48d2 service nova] Acquiring lock "refresh_cache-72c9d731-2b35-434c-8463-1cd6c18fbd6a" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 23:35:37 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-c8a17b97-c376-4f58-9019-5d1d1f6acca3 req-af849966-dd2a-4c8b-b214-15e8be8f48d2 service nova] Acquired lock "refresh_cache-72c9d731-2b35-434c-8463-1cd6c18fbd6a" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 23:35:37 user nova-compute[75045]: DEBUG nova.network.neutron [req-c8a17b97-c376-4f58-9019-5d1d1f6acca3 req-af849966-dd2a-4c8b-b214-15e8be8f48d2 service nova] [instance: 72c9d731-2b35-434c-8463-1cd6c18fbd6a] Refreshing network info cache for port 996f98bd-77bf-4176-8fe3-ea98b0c070a0 {{(pid=75045) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 23:35:37 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-44a36e27-d0b1-4060-a8d6-08287b96bb4b tempest-TestStampPattern-2120781434 tempest-TestStampPattern-2120781434-project-member] Acquiring lock "72c9d731-2b35-434c-8463-1cd6c18fbd6a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:35:37 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-44a36e27-d0b1-4060-a8d6-08287b96bb4b tempest-TestStampPattern-2120781434 tempest-TestStampPattern-2120781434-project-member] Lock "72c9d731-2b35-434c-8463-1cd6c18fbd6a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:35:37 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-44a36e27-d0b1-4060-a8d6-08287b96bb4b tempest-TestStampPattern-2120781434 tempest-TestStampPattern-2120781434-project-member] Acquiring lock "72c9d731-2b35-434c-8463-1cd6c18fbd6a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:35:37 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-44a36e27-d0b1-4060-a8d6-08287b96bb4b tempest-TestStampPattern-2120781434 tempest-TestStampPattern-2120781434-project-member] Lock "72c9d731-2b35-434c-8463-1cd6c18fbd6a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:35:37 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-44a36e27-d0b1-4060-a8d6-08287b96bb4b tempest-TestStampPattern-2120781434 tempest-TestStampPattern-2120781434-project-member] Lock "72c9d731-2b35-434c-8463-1cd6c18fbd6a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:35:37 user nova-compute[75045]: INFO nova.compute.manager [None req-44a36e27-d0b1-4060-a8d6-08287b96bb4b tempest-TestStampPattern-2120781434 tempest-TestStampPattern-2120781434-project-member] [instance: 72c9d731-2b35-434c-8463-1cd6c18fbd6a] Terminating instance
Nov 08 23:35:37 user nova-compute[75045]: DEBUG nova.compute.manager [None req-44a36e27-d0b1-4060-a8d6-08287b96bb4b tempest-TestStampPattern-2120781434 tempest-TestStampPattern-2120781434-project-member] [instance: 72c9d731-2b35-434c-8463-1cd6c18fbd6a] Start destroying the instance on the hypervisor. {{(pid=75045) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 23:35:38 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:35:38 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:35:38 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:35:38 user nova-compute[75045]: DEBUG nova.compute.manager [req-27c9b91b-54ae-4cf1-8219-046a1b726063 req-66455577-2f4f-494b-8fc1-f48690556385 service nova] [instance: 72c9d731-2b35-434c-8463-1cd6c18fbd6a] Received event network-vif-unplugged-996f98bd-77bf-4176-8fe3-ea98b0c070a0 {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:35:38 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-27c9b91b-54ae-4cf1-8219-046a1b726063 req-66455577-2f4f-494b-8fc1-f48690556385 service nova] Acquiring lock "72c9d731-2b35-434c-8463-1cd6c18fbd6a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:35:38 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-27c9b91b-54ae-4cf1-8219-046a1b726063 req-66455577-2f4f-494b-8fc1-f48690556385 service nova] Lock "72c9d731-2b35-434c-8463-1cd6c18fbd6a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:35:38 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-27c9b91b-54ae-4cf1-8219-046a1b726063 req-66455577-2f4f-494b-8fc1-f48690556385 service nova] Lock "72c9d731-2b35-434c-8463-1cd6c18fbd6a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:35:38 user nova-compute[75045]: DEBUG nova.compute.manager [req-27c9b91b-54ae-4cf1-8219-046a1b726063 req-66455577-2f4f-494b-8fc1-f48690556385 service nova] [instance: 72c9d731-2b35-434c-8463-1cd6c18fbd6a] No waiting events found dispatching network-vif-unplugged-996f98bd-77bf-4176-8fe3-ea98b0c070a0 {{(pid=75045) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 23:35:38 user nova-compute[75045]: DEBUG nova.compute.manager [req-27c9b91b-54ae-4cf1-8219-046a1b726063 req-66455577-2f4f-494b-8fc1-f48690556385 service nova] [instance: 72c9d731-2b35-434c-8463-1cd6c18fbd6a] Received event network-vif-unplugged-996f98bd-77bf-4176-8fe3-ea98b0c070a0 for instance with task_state deleting. {{(pid=75045) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 23:35:38 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:35:38 user nova-compute[75045]: DEBUG nova.network.neutron [req-c8a17b97-c376-4f58-9019-5d1d1f6acca3 req-af849966-dd2a-4c8b-b214-15e8be8f48d2 service nova] [instance: 72c9d731-2b35-434c-8463-1cd6c18fbd6a] Updated VIF entry in instance network info cache for port 996f98bd-77bf-4176-8fe3-ea98b0c070a0. {{(pid=75045) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 23:35:38 user nova-compute[75045]: DEBUG nova.network.neutron [req-c8a17b97-c376-4f58-9019-5d1d1f6acca3 req-af849966-dd2a-4c8b-b214-15e8be8f48d2 service nova] [instance: 72c9d731-2b35-434c-8463-1cd6c18fbd6a] Updating instance_info_cache with network_info: [{"id": "996f98bd-77bf-4176-8fe3-ea98b0c070a0", "address": "fa:16:3e:bb:6f:51", "network": {"id": "94c5462e-c9fd-44e6-b02b-9d46156ca7d9", "bridge": "br-int", "label": "tempest-TestStampPattern-1038298369-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "824ed65954dd4eccbe68827aa92fd99f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap996f98bd-77", "ovs_interfaceid": "996f98bd-77bf-4176-8fe3-ea98b0c070a0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75045) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 23:35:38 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-c8a17b97-c376-4f58-9019-5d1d1f6acca3 req-af849966-dd2a-4c8b-b214-15e8be8f48d2 service nova] Releasing lock "refresh_cache-72c9d731-2b35-434c-8463-1cd6c18fbd6a" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 23:35:38 user nova-compute[75045]: INFO nova.virt.libvirt.driver [-] [instance: 72c9d731-2b35-434c-8463-1cd6c18fbd6a] Instance destroyed successfully.
Nov 08 23:35:38 user nova-compute[75045]: DEBUG nova.objects.instance [None req-44a36e27-d0b1-4060-a8d6-08287b96bb4b tempest-TestStampPattern-2120781434 tempest-TestStampPattern-2120781434-project-member] Lazy-loading 'resources' on Instance uuid 72c9d731-2b35-434c-8463-1cd6c18fbd6a {{(pid=75045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 23:35:38 user nova-compute[75045]: DEBUG nova.virt.libvirt.vif [None req-44a36e27-d0b1-4060-a8d6-08287b96bb4b tempest-TestStampPattern-2120781434 tempest-TestStampPattern-2120781434-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T23:25:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-107227434',display_name='tempest-TestStampPattern-server-107227434',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-107227434',id=25,image_ref='a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEtB72lJ3QT0CbDqyUaMKflPueQqHWlBr/SKULenQ3hS/jygD0NlusOQCbd9nWih3JtFTCaVE0qH0L8SGPLvq+HuEpKiKftv45ffcKHaW5G6qCsZvzG9WD6hpehyxZCg9w==',key_name='tempest-TestStampPattern-276203308',keypairs=<?>,launch_index=0,launched_at=2023-11-08T23:25:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='824ed65954dd4eccbe68827aa92fd99f',ramdisk_id='',reservation_id='r-t957pnu1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestStampPattern-2120781434',owner_user_name='tempest-TestStampPattern-2120781434-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T23:28:54Z,user_data=None,user_id='5aea9d6528d3454eaf0f8b2cc9df7c46',uuid=72c9d731-2b35-434c-8463-1cd6c18fbd6a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "996f98bd-77bf-4176-8fe3-ea98b0c070a0", "address": "fa:16:3e:bb:6f:51", "network": {"id": "94c5462e-c9fd-44e6-b02b-9d46156ca7d9", "bridge": "br-int", "label": "tempest-TestStampPattern-1038298369-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.150", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "824ed65954dd4eccbe68827aa92fd99f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap996f98bd-77", "ovs_interfaceid": "996f98bd-77bf-4176-8fe3-ea98b0c070a0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75045) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 23:35:38 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-44a36e27-d0b1-4060-a8d6-08287b96bb4b tempest-TestStampPattern-2120781434 tempest-TestStampPattern-2120781434-project-member] Converting VIF {"id": "996f98bd-77bf-4176-8fe3-ea98b0c070a0", "address": "fa:16:3e:bb:6f:51", "network": {"id": "94c5462e-c9fd-44e6-b02b-9d46156ca7d9", "bridge": "br-int", "label": "tempest-TestStampPattern-1038298369-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.150", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "824ed65954dd4eccbe68827aa92fd99f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap996f98bd-77", "ovs_interfaceid": "996f98bd-77bf-4176-8fe3-ea98b0c070a0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 23:35:38 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-44a36e27-d0b1-4060-a8d6-08287b96bb4b tempest-TestStampPattern-2120781434 tempest-TestStampPattern-2120781434-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:bb:6f:51,bridge_name='br-int',has_traffic_filtering=True,id=996f98bd-77bf-4176-8fe3-ea98b0c070a0,network=Network(94c5462e-c9fd-44e6-b02b-9d46156ca7d9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap996f98bd-77') {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 23:35:38 user nova-compute[75045]: DEBUG os_vif [None req-44a36e27-d0b1-4060-a8d6-08287b96bb4b tempest-TestStampPattern-2120781434 tempest-TestStampPattern-2120781434-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:bb:6f:51,bridge_name='br-int',has_traffic_filtering=True,id=996f98bd-77bf-4176-8fe3-ea98b0c070a0,network=Network(94c5462e-c9fd-44e6-b02b-9d46156ca7d9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap996f98bd-77') {{(pid=75045) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 23:35:38 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:35:38 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap996f98bd-77, bridge=br-int, if_exists=True) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:35:38 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:35:38 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 23:35:38 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:35:38 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e6796033-100a-46a1-b174-30180dcce511) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:35:38 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:35:38 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 23:35:38 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:35:38 user nova-compute[75045]: INFO os_vif [None req-44a36e27-d0b1-4060-a8d6-08287b96bb4b tempest-TestStampPattern-2120781434 tempest-TestStampPattern-2120781434-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:bb:6f:51,bridge_name='br-int',has_traffic_filtering=True,id=996f98bd-77bf-4176-8fe3-ea98b0c070a0,network=Network(94c5462e-c9fd-44e6-b02b-9d46156ca7d9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap996f98bd-77')
Nov 08 23:35:38 user nova-compute[75045]: INFO nova.virt.libvirt.driver [None req-44a36e27-d0b1-4060-a8d6-08287b96bb4b tempest-TestStampPattern-2120781434 tempest-TestStampPattern-2120781434-project-member] [instance: 72c9d731-2b35-434c-8463-1cd6c18fbd6a] Deleting instance files /opt/stack/data/nova/instances/72c9d731-2b35-434c-8463-1cd6c18fbd6a_del
Nov 08 23:35:38 user nova-compute[75045]: INFO nova.virt.libvirt.driver [None req-44a36e27-d0b1-4060-a8d6-08287b96bb4b tempest-TestStampPattern-2120781434 tempest-TestStampPattern-2120781434-project-member] [instance: 72c9d731-2b35-434c-8463-1cd6c18fbd6a] Deletion of /opt/stack/data/nova/instances/72c9d731-2b35-434c-8463-1cd6c18fbd6a_del complete
Nov 08 23:35:38 user nova-compute[75045]: INFO nova.compute.manager [None req-44a36e27-d0b1-4060-a8d6-08287b96bb4b tempest-TestStampPattern-2120781434 tempest-TestStampPattern-2120781434-project-member] [instance: 72c9d731-2b35-434c-8463-1cd6c18fbd6a] Took 0.89 seconds to destroy the instance on the hypervisor.
Nov 08 23:35:38 user nova-compute[75045]: DEBUG oslo.service.loopingcall [None req-44a36e27-d0b1-4060-a8d6-08287b96bb4b tempest-TestStampPattern-2120781434 tempest-TestStampPattern-2120781434-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75045) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 23:35:38 user nova-compute[75045]: DEBUG nova.compute.manager [-] [instance: 72c9d731-2b35-434c-8463-1cd6c18fbd6a] Deallocating network for instance {{(pid=75045) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 23:35:38 user nova-compute[75045]: DEBUG nova.network.neutron [-] [instance: 72c9d731-2b35-434c-8463-1cd6c18fbd6a] deallocate_for_instance() {{(pid=75045) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 23:35:39 user nova-compute[75045]: DEBUG nova.network.neutron [-] [instance: 72c9d731-2b35-434c-8463-1cd6c18fbd6a] Updating instance_info_cache with network_info: [] {{(pid=75045) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 23:35:39 user nova-compute[75045]: INFO nova.compute.manager [-] [instance: 72c9d731-2b35-434c-8463-1cd6c18fbd6a] Took 0.59 seconds to deallocate network for instance.
Nov 08 23:35:39 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-44a36e27-d0b1-4060-a8d6-08287b96bb4b tempest-TestStampPattern-2120781434 tempest-TestStampPattern-2120781434-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:35:39 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-44a36e27-d0b1-4060-a8d6-08287b96bb4b tempest-TestStampPattern-2120781434 tempest-TestStampPattern-2120781434-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:35:39 user nova-compute[75045]: DEBUG nova.compute.manager [req-35886c1e-79d9-451b-b9e0-7ca7e4108ce1 req-e298cc25-6893-40b5-a011-420ec4fb66b3 service nova] [instance: 72c9d731-2b35-434c-8463-1cd6c18fbd6a] Received event network-vif-deleted-996f98bd-77bf-4176-8fe3-ea98b0c070a0 {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:35:39 user nova-compute[75045]: DEBUG nova.compute.provider_tree [None req-44a36e27-d0b1-4060-a8d6-08287b96bb4b tempest-TestStampPattern-2120781434 tempest-TestStampPattern-2120781434-project-member] Inventory has not changed in ProviderTree for provider: 62ba5f85-c74d-4b58-986e-d4197e813fd7 {{(pid=75045) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 23:35:39 user nova-compute[75045]: DEBUG nova.scheduler.client.report [None req-44a36e27-d0b1-4060-a8d6-08287b96bb4b tempest-TestStampPattern-2120781434 tempest-TestStampPattern-2120781434-project-member] Inventory has not changed for provider 62ba5f85-c74d-4b58-986e-d4197e813fd7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75045) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 23:35:39 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-44a36e27-d0b1-4060-a8d6-08287b96bb4b tempest-TestStampPattern-2120781434 tempest-TestStampPattern-2120781434-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.456s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:35:39 user nova-compute[75045]: INFO nova.scheduler.client.report [None req-44a36e27-d0b1-4060-a8d6-08287b96bb4b tempest-TestStampPattern-2120781434 tempest-TestStampPattern-2120781434-project-member] Deleted allocations for instance 72c9d731-2b35-434c-8463-1cd6c18fbd6a
Nov 08 23:35:40 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-44a36e27-d0b1-4060-a8d6-08287b96bb4b tempest-TestStampPattern-2120781434 tempest-TestStampPattern-2120781434-project-member] Lock "72c9d731-2b35-434c-8463-1cd6c18fbd6a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.190s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:35:40 user nova-compute[75045]: DEBUG nova.compute.manager [req-17897d23-1506-411e-b763-d70956ac6bd7 req-ebd2916c-526f-4f57-9b87-96e1459e2742 service nova] [instance: 72c9d731-2b35-434c-8463-1cd6c18fbd6a] Received event network-vif-plugged-996f98bd-77bf-4176-8fe3-ea98b0c070a0 {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:35:40 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-17897d23-1506-411e-b763-d70956ac6bd7 req-ebd2916c-526f-4f57-9b87-96e1459e2742 service nova] Acquiring lock "72c9d731-2b35-434c-8463-1cd6c18fbd6a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:35:40 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-17897d23-1506-411e-b763-d70956ac6bd7 req-ebd2916c-526f-4f57-9b87-96e1459e2742 service nova] Lock "72c9d731-2b35-434c-8463-1cd6c18fbd6a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:35:40 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-17897d23-1506-411e-b763-d70956ac6bd7 req-ebd2916c-526f-4f57-9b87-96e1459e2742 service nova] Lock "72c9d731-2b35-434c-8463-1cd6c18fbd6a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:35:40 user nova-compute[75045]: DEBUG nova.compute.manager [req-17897d23-1506-411e-b763-d70956ac6bd7 req-ebd2916c-526f-4f57-9b87-96e1459e2742 service nova] [instance: 72c9d731-2b35-434c-8463-1cd6c18fbd6a] No waiting events found dispatching network-vif-plugged-996f98bd-77bf-4176-8fe3-ea98b0c070a0 {{(pid=75045) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 23:35:40 user nova-compute[75045]: WARNING nova.compute.manager [req-17897d23-1506-411e-b763-d70956ac6bd7 req-ebd2916c-526f-4f57-9b87-96e1459e2742 service nova] [instance: 72c9d731-2b35-434c-8463-1cd6c18fbd6a] Received unexpected event network-vif-plugged-996f98bd-77bf-4176-8fe3-ea98b0c070a0 for instance with vm_state deleted and task_state None.
Nov 08 23:35:41 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:35:43 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:35:46 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:35:47 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-f316a3d3-2cab-42e4-96e7-f04b9d639cb3 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Acquiring lock "a63971de-a2bf-4e58-a760-30eaec3b83c0" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:35:47 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-f316a3d3-2cab-42e4-96e7-f04b9d639cb3 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Lock "a63971de-a2bf-4e58-a760-30eaec3b83c0" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:35:47 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-f316a3d3-2cab-42e4-96e7-f04b9d639cb3 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Acquiring lock "a63971de-a2bf-4e58-a760-30eaec3b83c0-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:35:47 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-f316a3d3-2cab-42e4-96e7-f04b9d639cb3 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Lock "a63971de-a2bf-4e58-a760-30eaec3b83c0-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:35:47 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-f316a3d3-2cab-42e4-96e7-f04b9d639cb3 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Lock "a63971de-a2bf-4e58-a760-30eaec3b83c0-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:35:47 user nova-compute[75045]: INFO nova.compute.manager [None req-f316a3d3-2cab-42e4-96e7-f04b9d639cb3 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] [instance: a63971de-a2bf-4e58-a760-30eaec3b83c0] Terminating instance
Nov 08 23:35:47 user nova-compute[75045]: DEBUG nova.compute.manager [None req-f316a3d3-2cab-42e4-96e7-f04b9d639cb3 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] [instance: a63971de-a2bf-4e58-a760-30eaec3b83c0] Start destroying the instance on the hypervisor. {{(pid=75045) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 23:35:47 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:35:47 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:35:47 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:35:47 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:35:47 user nova-compute[75045]: DEBUG nova.compute.manager [req-782eeb0b-1270-43a0-8242-09fe88e54346 req-88fab1aa-2b5d-4074-b5af-6d5a1f19052d service nova] [instance: a63971de-a2bf-4e58-a760-30eaec3b83c0] Received event network-vif-unplugged-50aeb5be-ac90-4e8f-ace6-e31512769f3b {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:35:47 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-782eeb0b-1270-43a0-8242-09fe88e54346 req-88fab1aa-2b5d-4074-b5af-6d5a1f19052d service nova] Acquiring lock "a63971de-a2bf-4e58-a760-30eaec3b83c0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:35:47 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-782eeb0b-1270-43a0-8242-09fe88e54346 req-88fab1aa-2b5d-4074-b5af-6d5a1f19052d service nova] Lock "a63971de-a2bf-4e58-a760-30eaec3b83c0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:35:47 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-782eeb0b-1270-43a0-8242-09fe88e54346 req-88fab1aa-2b5d-4074-b5af-6d5a1f19052d service nova] Lock "a63971de-a2bf-4e58-a760-30eaec3b83c0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:35:47 user nova-compute[75045]: DEBUG nova.compute.manager [req-782eeb0b-1270-43a0-8242-09fe88e54346 req-88fab1aa-2b5d-4074-b5af-6d5a1f19052d service nova] [instance: a63971de-a2bf-4e58-a760-30eaec3b83c0] No waiting events found dispatching network-vif-unplugged-50aeb5be-ac90-4e8f-ace6-e31512769f3b {{(pid=75045) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 23:35:47 user nova-compute[75045]: DEBUG nova.compute.manager [req-782eeb0b-1270-43a0-8242-09fe88e54346 req-88fab1aa-2b5d-4074-b5af-6d5a1f19052d service nova] [instance: a63971de-a2bf-4e58-a760-30eaec3b83c0] Received event network-vif-unplugged-50aeb5be-ac90-4e8f-ace6-e31512769f3b for instance with task_state deleting. {{(pid=75045) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 23:35:48 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:35:48 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:35:48 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:35:48 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:35:48 user nova-compute[75045]: INFO nova.virt.libvirt.driver [-] [instance: a63971de-a2bf-4e58-a760-30eaec3b83c0] Instance destroyed successfully.
Nov 08 23:35:48 user nova-compute[75045]: DEBUG nova.objects.instance [None req-f316a3d3-2cab-42e4-96e7-f04b9d639cb3 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Lazy-loading 'resources' on Instance uuid a63971de-a2bf-4e58-a760-30eaec3b83c0 {{(pid=75045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 23:35:48 user nova-compute[75045]: DEBUG nova.virt.libvirt.vif [None req-f316a3d3-2cab-42e4-96e7-f04b9d639cb3 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T23:32:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1719371780',display_name='tempest-AttachVolumeNegativeTest-server-1719371780',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1719371780',id=33,image_ref='a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB/ndcWqmrAqjd9amzTQjo5csFln9xdf5bjPJrTLP3v7vH83IWDBX1aEztMAnOi0L2zsouD5Xt2+6X0K9vkvw1S5+9v8+hwyWJYZViEvi4h9pqOpMpqHmCUUEXlJOYUhlQ==',key_name='tempest-keypair-472326172',keypairs=<?>,launch_index=0,launched_at=2023-11-08T23:32:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7eff4be777d24514be52868961bf7a25',ramdisk_id='',reservation_id='r-d74g8dpa',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1522456563',owner_user_name='tempest-AttachVolumeNegativeTest-1522456563-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T23:32:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4a05b178abe74b779a991e887bf135b2',uuid=a63971de-a2bf-4e58-a760-30eaec3b83c0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "50aeb5be-ac90-4e8f-ace6-e31512769f3b", "address": "fa:16:3e:b4:db:58", "network": {"id": "2f33d93d-98ec-4b87-a0c0-efe2d2ac8f6d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-719527911-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.197", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7eff4be777d24514be52868961bf7a25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50aeb5be-ac", "ovs_interfaceid": "50aeb5be-ac90-4e8f-ace6-e31512769f3b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75045) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 23:35:48 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-f316a3d3-2cab-42e4-96e7-f04b9d639cb3 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Converting VIF {"id": "50aeb5be-ac90-4e8f-ace6-e31512769f3b", "address": "fa:16:3e:b4:db:58", "network": {"id": "2f33d93d-98ec-4b87-a0c0-efe2d2ac8f6d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-719527911-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.197", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7eff4be777d24514be52868961bf7a25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50aeb5be-ac", "ovs_interfaceid": "50aeb5be-ac90-4e8f-ace6-e31512769f3b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 23:35:48 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-f316a3d3-2cab-42e4-96e7-f04b9d639cb3 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b4:db:58,bridge_name='br-int',has_traffic_filtering=True,id=50aeb5be-ac90-4e8f-ace6-e31512769f3b,network=Network(2f33d93d-98ec-4b87-a0c0-efe2d2ac8f6d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap50aeb5be-ac') {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 23:35:48 user nova-compute[75045]: DEBUG os_vif [None req-f316a3d3-2cab-42e4-96e7-f04b9d639cb3 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b4:db:58,bridge_name='br-int',has_traffic_filtering=True,id=50aeb5be-ac90-4e8f-ace6-e31512769f3b,network=Network(2f33d93d-98ec-4b87-a0c0-efe2d2ac8f6d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap50aeb5be-ac') {{(pid=75045) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 23:35:48 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:35:48 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap50aeb5be-ac, bridge=br-int, if_exists=True) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:35:48 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:35:48 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 23:35:48 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:35:48 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=71a45b22-837b-4948-9c3f-9a091bd5e2b5) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:35:48 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:35:48 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 23:35:48 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:35:48 user nova-compute[75045]: INFO os_vif [None req-f316a3d3-2cab-42e4-96e7-f04b9d639cb3 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b4:db:58,bridge_name='br-int',has_traffic_filtering=True,id=50aeb5be-ac90-4e8f-ace6-e31512769f3b,network=Network(2f33d93d-98ec-4b87-a0c0-efe2d2ac8f6d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap50aeb5be-ac')
Nov 08 23:35:48 user nova-compute[75045]: INFO nova.virt.libvirt.driver [None req-f316a3d3-2cab-42e4-96e7-f04b9d639cb3 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] [instance: a63971de-a2bf-4e58-a760-30eaec3b83c0] Deleting instance files /opt/stack/data/nova/instances/a63971de-a2bf-4e58-a760-30eaec3b83c0_del
Nov 08 23:35:48 user nova-compute[75045]: INFO nova.virt.libvirt.driver [None req-f316a3d3-2cab-42e4-96e7-f04b9d639cb3 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] [instance: a63971de-a2bf-4e58-a760-30eaec3b83c0] Deletion of /opt/stack/data/nova/instances/a63971de-a2bf-4e58-a760-30eaec3b83c0_del complete
Nov 08 23:35:48 user nova-compute[75045]: INFO nova.compute.manager [None req-f316a3d3-2cab-42e4-96e7-f04b9d639cb3 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] [instance: a63971de-a2bf-4e58-a760-30eaec3b83c0] Took 0.95 seconds to destroy the instance on the hypervisor.
Nov 08 23:35:48 user nova-compute[75045]: DEBUG oslo.service.loopingcall [None req-f316a3d3-2cab-42e4-96e7-f04b9d639cb3 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75045) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 23:35:48 user nova-compute[75045]: DEBUG nova.compute.manager [-] [instance: a63971de-a2bf-4e58-a760-30eaec3b83c0] Deallocating network for instance {{(pid=75045) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 23:35:48 user nova-compute[75045]: DEBUG nova.network.neutron [-] [instance: a63971de-a2bf-4e58-a760-30eaec3b83c0] deallocate_for_instance() {{(pid=75045) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 23:35:48 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:35:48 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:35:48 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:35:48 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:35:49 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:35:49 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:35:49 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:35:49 user nova-compute[75045]: DEBUG nova.network.neutron [-] [instance: a63971de-a2bf-4e58-a760-30eaec3b83c0] Updating instance_info_cache with network_info: [] {{(pid=75045) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 23:35:49 user nova-compute[75045]: INFO nova.compute.manager [-] [instance: a63971de-a2bf-4e58-a760-30eaec3b83c0] Took 0.78 seconds to deallocate network for instance.
Nov 08 23:35:49 user nova-compute[75045]: DEBUG nova.compute.manager [req-ef38be66-3b86-4700-9c2f-e14bc5d0c008 req-865865bc-f6fa-4ab4-90a3-610ced4a8f1a service nova] [instance: a63971de-a2bf-4e58-a760-30eaec3b83c0] Received event network-vif-deleted-50aeb5be-ac90-4e8f-ace6-e31512769f3b {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:35:49 user nova-compute[75045]: INFO nova.compute.manager [req-ef38be66-3b86-4700-9c2f-e14bc5d0c008 req-865865bc-f6fa-4ab4-90a3-610ced4a8f1a service nova] [instance: a63971de-a2bf-4e58-a760-30eaec3b83c0] Neutron deleted interface 50aeb5be-ac90-4e8f-ace6-e31512769f3b; detaching it from the instance and deleting it from the info cache
Nov 08 23:35:49 user nova-compute[75045]: DEBUG nova.network.neutron [req-ef38be66-3b86-4700-9c2f-e14bc5d0c008 req-865865bc-f6fa-4ab4-90a3-610ced4a8f1a service nova] [instance: a63971de-a2bf-4e58-a760-30eaec3b83c0] Updating instance_info_cache with network_info: [] {{(pid=75045) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 23:35:49 user nova-compute[75045]: DEBUG nova.compute.manager [req-ef38be66-3b86-4700-9c2f-e14bc5d0c008 req-865865bc-f6fa-4ab4-90a3-610ced4a8f1a service nova] [instance: a63971de-a2bf-4e58-a760-30eaec3b83c0] Detach interface failed, port_id=50aeb5be-ac90-4e8f-ace6-e31512769f3b, reason: Instance a63971de-a2bf-4e58-a760-30eaec3b83c0 could not be found. {{(pid=75045) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 08 23:35:49 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-f316a3d3-2cab-42e4-96e7-f04b9d639cb3 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:35:49 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-f316a3d3-2cab-42e4-96e7-f04b9d639cb3 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:35:49 user nova-compute[75045]: DEBUG nova.compute.provider_tree [None req-f316a3d3-2cab-42e4-96e7-f04b9d639cb3 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Inventory has not changed in ProviderTree for provider: 62ba5f85-c74d-4b58-986e-d4197e813fd7 {{(pid=75045) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 23:35:49 user nova-compute[75045]: DEBUG nova.scheduler.client.report [None req-f316a3d3-2cab-42e4-96e7-f04b9d639cb3 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Inventory has not changed for provider 62ba5f85-c74d-4b58-986e-d4197e813fd7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75045) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 23:35:49 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-f316a3d3-2cab-42e4-96e7-f04b9d639cb3 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.309s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:35:49 user nova-compute[75045]: INFO nova.scheduler.client.report [None req-f316a3d3-2cab-42e4-96e7-f04b9d639cb3 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Deleted allocations for instance a63971de-a2bf-4e58-a760-30eaec3b83c0
Nov 08 23:35:49 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-f316a3d3-2cab-42e4-96e7-f04b9d639cb3 tempest-AttachVolumeNegativeTest-1522456563 tempest-AttachVolumeNegativeTest-1522456563-project-member] Lock "a63971de-a2bf-4e58-a760-30eaec3b83c0" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.221s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:35:49 user nova-compute[75045]: DEBUG nova.compute.manager [req-0af111c4-025c-4bae-b708-d7b010631609 req-9acb9b2a-cfc0-4b3d-b40c-53cba5ea851b service nova] [instance: a63971de-a2bf-4e58-a760-30eaec3b83c0] Received event network-vif-plugged-50aeb5be-ac90-4e8f-ace6-e31512769f3b {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:35:49 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-0af111c4-025c-4bae-b708-d7b010631609 req-9acb9b2a-cfc0-4b3d-b40c-53cba5ea851b service nova] Acquiring lock "a63971de-a2bf-4e58-a760-30eaec3b83c0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:35:49 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-0af111c4-025c-4bae-b708-d7b010631609 req-9acb9b2a-cfc0-4b3d-b40c-53cba5ea851b service nova] Lock "a63971de-a2bf-4e58-a760-30eaec3b83c0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:35:49 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-0af111c4-025c-4bae-b708-d7b010631609 req-9acb9b2a-cfc0-4b3d-b40c-53cba5ea851b service nova] Lock "a63971de-a2bf-4e58-a760-30eaec3b83c0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:35:49 user nova-compute[75045]: DEBUG nova.compute.manager [req-0af111c4-025c-4bae-b708-d7b010631609 req-9acb9b2a-cfc0-4b3d-b40c-53cba5ea851b service nova] [instance: a63971de-a2bf-4e58-a760-30eaec3b83c0] No waiting events found dispatching network-vif-plugged-50aeb5be-ac90-4e8f-ace6-e31512769f3b {{(pid=75045) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 23:35:49 user nova-compute[75045]: WARNING nova.compute.manager [req-0af111c4-025c-4bae-b708-d7b010631609 req-9acb9b2a-cfc0-4b3d-b40c-53cba5ea851b service nova] [instance: a63971de-a2bf-4e58-a760-30eaec3b83c0] Received unexpected event network-vif-plugged-50aeb5be-ac90-4e8f-ace6-e31512769f3b for instance with vm_state deleted and task_state None.
Nov 08 23:35:49 user nova-compute[75045]: DEBUG nova.compute.manager [req-0af111c4-025c-4bae-b708-d7b010631609 req-9acb9b2a-cfc0-4b3d-b40c-53cba5ea851b service nova] [instance: a63971de-a2bf-4e58-a760-30eaec3b83c0] Received event network-vif-plugged-50aeb5be-ac90-4e8f-ace6-e31512769f3b {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:35:49 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-0af111c4-025c-4bae-b708-d7b010631609 req-9acb9b2a-cfc0-4b3d-b40c-53cba5ea851b service nova] Acquiring lock "a63971de-a2bf-4e58-a760-30eaec3b83c0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:35:49 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-0af111c4-025c-4bae-b708-d7b010631609 req-9acb9b2a-cfc0-4b3d-b40c-53cba5ea851b service nova] Lock "a63971de-a2bf-4e58-a760-30eaec3b83c0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:35:49 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-0af111c4-025c-4bae-b708-d7b010631609 req-9acb9b2a-cfc0-4b3d-b40c-53cba5ea851b service nova] Lock "a63971de-a2bf-4e58-a760-30eaec3b83c0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:35:49 user nova-compute[75045]: DEBUG nova.compute.manager [req-0af111c4-025c-4bae-b708-d7b010631609 req-9acb9b2a-cfc0-4b3d-b40c-53cba5ea851b service nova] [instance: a63971de-a2bf-4e58-a760-30eaec3b83c0] No waiting events found dispatching network-vif-plugged-50aeb5be-ac90-4e8f-ace6-e31512769f3b {{(pid=75045) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 23:35:49 user nova-compute[75045]: WARNING nova.compute.manager [req-0af111c4-025c-4bae-b708-d7b010631609 req-9acb9b2a-cfc0-4b3d-b40c-53cba5ea851b service nova] [instance: a63971de-a2bf-4e58-a760-30eaec3b83c0] Received unexpected event network-vif-plugged-50aeb5be-ac90-4e8f-ace6-e31512769f3b for instance with vm_state deleted and task_state None.
Nov 08 23:35:49 user nova-compute[75045]: DEBUG nova.compute.manager [req-0af111c4-025c-4bae-b708-d7b010631609 req-9acb9b2a-cfc0-4b3d-b40c-53cba5ea851b service nova] [instance: a63971de-a2bf-4e58-a760-30eaec3b83c0] Received event network-vif-plugged-50aeb5be-ac90-4e8f-ace6-e31512769f3b {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:35:49 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-0af111c4-025c-4bae-b708-d7b010631609 req-9acb9b2a-cfc0-4b3d-b40c-53cba5ea851b service nova] Acquiring lock "a63971de-a2bf-4e58-a760-30eaec3b83c0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:35:49 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-0af111c4-025c-4bae-b708-d7b010631609 req-9acb9b2a-cfc0-4b3d-b40c-53cba5ea851b service nova] Lock "a63971de-a2bf-4e58-a760-30eaec3b83c0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:35:49 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-0af111c4-025c-4bae-b708-d7b010631609 req-9acb9b2a-cfc0-4b3d-b40c-53cba5ea851b service nova] Lock "a63971de-a2bf-4e58-a760-30eaec3b83c0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:35:49 user nova-compute[75045]: DEBUG nova.compute.manager [req-0af111c4-025c-4bae-b708-d7b010631609 req-9acb9b2a-cfc0-4b3d-b40c-53cba5ea851b service nova] [instance: a63971de-a2bf-4e58-a760-30eaec3b83c0] No waiting events found dispatching network-vif-plugged-50aeb5be-ac90-4e8f-ace6-e31512769f3b {{(pid=75045) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 23:35:49 user nova-compute[75045]: WARNING nova.compute.manager [req-0af111c4-025c-4bae-b708-d7b010631609 req-9acb9b2a-cfc0-4b3d-b40c-53cba5ea851b service nova] [instance: a63971de-a2bf-4e58-a760-30eaec3b83c0] Received unexpected event network-vif-plugged-50aeb5be-ac90-4e8f-ace6-e31512769f3b for instance with vm_state deleted and task_state None.
Nov 08 23:35:49 user nova-compute[75045]: DEBUG nova.compute.manager [req-0af111c4-025c-4bae-b708-d7b010631609 req-9acb9b2a-cfc0-4b3d-b40c-53cba5ea851b service nova] [instance: a63971de-a2bf-4e58-a760-30eaec3b83c0] Received event network-vif-unplugged-50aeb5be-ac90-4e8f-ace6-e31512769f3b {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:35:49 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-0af111c4-025c-4bae-b708-d7b010631609 req-9acb9b2a-cfc0-4b3d-b40c-53cba5ea851b service nova] Acquiring lock "a63971de-a2bf-4e58-a760-30eaec3b83c0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:35:49 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-0af111c4-025c-4bae-b708-d7b010631609 req-9acb9b2a-cfc0-4b3d-b40c-53cba5ea851b service nova] Lock "a63971de-a2bf-4e58-a760-30eaec3b83c0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:35:49 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-0af111c4-025c-4bae-b708-d7b010631609 req-9acb9b2a-cfc0-4b3d-b40c-53cba5ea851b service nova] Lock "a63971de-a2bf-4e58-a760-30eaec3b83c0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:35:49 user nova-compute[75045]: DEBUG nova.compute.manager [req-0af111c4-025c-4bae-b708-d7b010631609 req-9acb9b2a-cfc0-4b3d-b40c-53cba5ea851b service nova] [instance: a63971de-a2bf-4e58-a760-30eaec3b83c0] No waiting events found dispatching network-vif-unplugged-50aeb5be-ac90-4e8f-ace6-e31512769f3b {{(pid=75045) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 23:35:49 user nova-compute[75045]: WARNING nova.compute.manager [req-0af111c4-025c-4bae-b708-d7b010631609 req-9acb9b2a-cfc0-4b3d-b40c-53cba5ea851b service nova] [instance: a63971de-a2bf-4e58-a760-30eaec3b83c0] Received unexpected event network-vif-unplugged-50aeb5be-ac90-4e8f-ace6-e31512769f3b for instance with vm_state deleted and task_state None.
Nov 08 23:35:49 user nova-compute[75045]: DEBUG nova.compute.manager [req-0af111c4-025c-4bae-b708-d7b010631609 req-9acb9b2a-cfc0-4b3d-b40c-53cba5ea851b service nova] [instance: a63971de-a2bf-4e58-a760-30eaec3b83c0] Received event network-vif-plugged-50aeb5be-ac90-4e8f-ace6-e31512769f3b {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:35:49 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-0af111c4-025c-4bae-b708-d7b010631609 req-9acb9b2a-cfc0-4b3d-b40c-53cba5ea851b service nova] Acquiring lock "a63971de-a2bf-4e58-a760-30eaec3b83c0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:35:49 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-0af111c4-025c-4bae-b708-d7b010631609 req-9acb9b2a-cfc0-4b3d-b40c-53cba5ea851b service nova] Lock "a63971de-a2bf-4e58-a760-30eaec3b83c0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:35:49 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-0af111c4-025c-4bae-b708-d7b010631609 req-9acb9b2a-cfc0-4b3d-b40c-53cba5ea851b service nova] Lock "a63971de-a2bf-4e58-a760-30eaec3b83c0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:35:49 user nova-compute[75045]: DEBUG nova.compute.manager [req-0af111c4-025c-4bae-b708-d7b010631609 req-9acb9b2a-cfc0-4b3d-b40c-53cba5ea851b service nova] [instance: a63971de-a2bf-4e58-a760-30eaec3b83c0] No waiting events found dispatching network-vif-plugged-50aeb5be-ac90-4e8f-ace6-e31512769f3b {{(pid=75045) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 23:35:49 user nova-compute[75045]: WARNING nova.compute.manager [req-0af111c4-025c-4bae-b708-d7b010631609 req-9acb9b2a-cfc0-4b3d-b40c-53cba5ea851b service nova] [instance: a63971de-a2bf-4e58-a760-30eaec3b83c0] Received unexpected event network-vif-plugged-50aeb5be-ac90-4e8f-ace6-e31512769f3b for instance with vm_state deleted and task_state None.
Nov 08 23:35:50 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:35:50 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:35:50 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:35:50 user nova-compute[75045]: DEBUG nova.compute.manager [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Starting heal instance info cache {{(pid=75045) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 23:35:50 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Acquiring lock "refresh_cache-b5fc7f02-2143-4bcf-92ac-078d5ec10747" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 23:35:50 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Acquired lock "refresh_cache-b5fc7f02-2143-4bcf-92ac-078d5ec10747" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 23:35:50 user nova-compute[75045]: DEBUG nova.network.neutron [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] [instance: b5fc7f02-2143-4bcf-92ac-078d5ec10747] Forcefully refreshing network info cache for instance {{(pid=75045) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 23:35:50 user nova-compute[75045]: INFO nova.compute.manager [None req-63be0d96-be44-48d2-8aa8-6405ab8a594a tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] [instance: 9222e62a-9fd8-48b2-a125-83c9cdc589bd] Unrescuing
Nov 08 23:35:50 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-63be0d96-be44-48d2-8aa8-6405ab8a594a tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] Acquiring lock "refresh_cache-9222e62a-9fd8-48b2-a125-83c9cdc589bd" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 23:35:50 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-63be0d96-be44-48d2-8aa8-6405ab8a594a tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] Acquired lock "refresh_cache-9222e62a-9fd8-48b2-a125-83c9cdc589bd" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 23:35:50 user nova-compute[75045]: DEBUG nova.network.neutron [None req-63be0d96-be44-48d2-8aa8-6405ab8a594a tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] [instance: 9222e62a-9fd8-48b2-a125-83c9cdc589bd] Building network info cache for instance {{(pid=75045) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 23:35:50 user nova-compute[75045]: DEBUG nova.network.neutron [None req-63be0d96-be44-48d2-8aa8-6405ab8a594a tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] [instance: 9222e62a-9fd8-48b2-a125-83c9cdc589bd] Updating instance_info_cache with network_info: [{"id": "5dae7844-411c-47aa-ba3e-bc209136f0a6", "address": "fa:16:3e:a4:11:9a", "network": {"id": "08d1669a-f667-4c79-8e49-0ad183f57046", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1863648032-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.156", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bbb640407ef94f568aea892f1834d6d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5dae7844-41", "ovs_interfaceid": "5dae7844-411c-47aa-ba3e-bc209136f0a6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75045) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 23:35:50 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-63be0d96-be44-48d2-8aa8-6405ab8a594a tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] Releasing lock "refresh_cache-9222e62a-9fd8-48b2-a125-83c9cdc589bd" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 23:35:50 user nova-compute[75045]: DEBUG nova.objects.instance [None req-63be0d96-be44-48d2-8aa8-6405ab8a594a tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] Lazy-loading 'flavor' on Instance uuid 9222e62a-9fd8-48b2-a125-83c9cdc589bd {{(pid=75045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 23:35:50 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:35:51 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:35:51 user nova-compute[75045]: DEBUG nova.network.neutron [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] [instance: b5fc7f02-2143-4bcf-92ac-078d5ec10747] Updating instance_info_cache with network_info: [{"id": "cde7cd95-3b8b-4980-8abc-be5c221a40ff", "address": "fa:16:3e:2d:09:a7", "network": {"id": "08d1669a-f667-4c79-8e49-0ad183f57046", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1863648032-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bbb640407ef94f568aea892f1834d6d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcde7cd95-3b", "ovs_interfaceid": "cde7cd95-3b8b-4980-8abc-be5c221a40ff", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75045) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 23:35:51 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Releasing lock "refresh_cache-b5fc7f02-2143-4bcf-92ac-078d5ec10747" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 23:35:51 user nova-compute[75045]: DEBUG nova.compute.manager [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] [instance: b5fc7f02-2143-4bcf-92ac-078d5ec10747] Updated the network info_cache for instance {{(pid=75045) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 23:35:51 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:35:51 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:35:51 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:35:51 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:35:51 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:35:51 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:35:51 user nova-compute[75045]: DEBUG nova.compute.manager [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75045) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 23:35:51 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager.update_available_resource {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:35:51 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:35:51 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:35:51 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:35:51 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Auditing locally available compute resources for user (node: user) {{(pid=75045) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 23:35:51 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:35:51 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:35:51 user nova-compute[75045]: DEBUG nova.compute.manager [req-23d09918-dbda-4ddd-8f63-366cbe1fd2fb req-3d87f6e3-4c76-49a4-8f5f-7212c4df6a3e service nova] [instance: 9222e62a-9fd8-48b2-a125-83c9cdc589bd] Received event network-vif-unplugged-5dae7844-411c-47aa-ba3e-bc209136f0a6 {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:35:51 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-23d09918-dbda-4ddd-8f63-366cbe1fd2fb req-3d87f6e3-4c76-49a4-8f5f-7212c4df6a3e service nova] Acquiring lock "9222e62a-9fd8-48b2-a125-83c9cdc589bd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:35:51 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-23d09918-dbda-4ddd-8f63-366cbe1fd2fb req-3d87f6e3-4c76-49a4-8f5f-7212c4df6a3e service nova] Lock "9222e62a-9fd8-48b2-a125-83c9cdc589bd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:35:51 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-23d09918-dbda-4ddd-8f63-366cbe1fd2fb req-3d87f6e3-4c76-49a4-8f5f-7212c4df6a3e service nova] Lock "9222e62a-9fd8-48b2-a125-83c9cdc589bd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:35:51 user nova-compute[75045]: DEBUG nova.compute.manager [req-23d09918-dbda-4ddd-8f63-366cbe1fd2fb req-3d87f6e3-4c76-49a4-8f5f-7212c4df6a3e service nova] [instance: 9222e62a-9fd8-48b2-a125-83c9cdc589bd] No waiting events found dispatching network-vif-unplugged-5dae7844-411c-47aa-ba3e-bc209136f0a6 {{(pid=75045) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 23:35:51 user nova-compute[75045]: WARNING nova.compute.manager [req-23d09918-dbda-4ddd-8f63-366cbe1fd2fb req-3d87f6e3-4c76-49a4-8f5f-7212c4df6a3e service nova] [instance: 9222e62a-9fd8-48b2-a125-83c9cdc589bd] Received unexpected event network-vif-unplugged-5dae7844-411c-47aa-ba3e-bc209136f0a6 for instance with vm_state rescued and task_state unrescuing.
Nov 08 23:35:51 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:35:51 user nova-compute[75045]: INFO nova.virt.libvirt.driver [-] [instance: 9222e62a-9fd8-48b2-a125-83c9cdc589bd] Instance destroyed successfully.
Nov 08 23:35:52 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-4d63238c-1361-48e3-aa13-a807824da565 tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] Acquiring lock "adcffd35-00c7-49db-a72f-d6307a90e123" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:35:52 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-4d63238c-1361-48e3-aa13-a807824da565 tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] Lock "adcffd35-00c7-49db-a72f-d6307a90e123" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:35:52 user nova-compute[75045]: DEBUG nova.objects.instance [None req-4d63238c-1361-48e3-aa13-a807824da565 tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] Lazy-loading 'flavor' on Instance uuid adcffd35-00c7-49db-a72f-d6307a90e123 {{(pid=75045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 23:35:52 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-4d63238c-1361-48e3-aa13-a807824da565 tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] Lock "adcffd35-00c7-49db-a72f-d6307a90e123" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.052s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:35:52 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-4d63238c-1361-48e3-aa13-a807824da565 tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] Acquiring lock "adcffd35-00c7-49db-a72f-d6307a90e123" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:35:52 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-4d63238c-1361-48e3-aa13-a807824da565 tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] Lock "adcffd35-00c7-49db-a72f-d6307a90e123" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:35:52 user nova-compute[75045]: INFO nova.compute.manager [None req-4d63238c-1361-48e3-aa13-a807824da565 tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] [instance: adcffd35-00c7-49db-a72f-d6307a90e123] Attaching volume 7c46c452-9bc3-48fc-b758-6de79dbab523 to /dev/vdb
Nov 08 23:35:52 user nova-compute[75045]: DEBUG os_brick.utils [None req-4d63238c-1361-48e3-aa13-a807824da565 tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75045) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 23:35:52 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:35:52 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:35:52 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3f525fe-6f30-498d-bf9f-bfa8fa267958]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6217bd6e884\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:35:52 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:35:52 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:35:52 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a4b3d79-07d3-4aa0-b1e8-e1eb663acc8d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:35:52 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:35:52 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:35:52 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[efa51340-1edf-49bd-853a-5c1ce9674758]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:35:52 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6947f37-efd1-40d2-bf98-25bb6f180c13]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:35:52 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-4d63238c-1361-48e3-aa13-a807824da565 tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] Running cmd (subprocess): nvme version {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:35:52 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-4d63238c-1361-48e3-aa13-a807824da565 tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] 'nvme version' failed. Not Retrying. {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 23:35:52 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4d63238c-1361-48e3-aa13-a807824da565 tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] nvme not present on system {{(pid=75045) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 23:35:52 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:35:52 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 23:35:52 user nova-compute[75045]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 23:35:52 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd4f0e9a-1815-4a37-98cb-57a9053f3583]: (4, '') {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:35:52 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.lightos [None req-4d63238c-1361-48e3-aa13-a807824da565 tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75045) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 23:35:52 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.lightos [None req-4d63238c-1361-48e3-aa13-a807824da565 tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75045) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 23:35:52 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.lightos [None req-4d63238c-1361-48e3-aa13-a807824da565 tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] LIGHTOS: no hostnqn found. {{(pid=75045) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 23:35:52 user nova-compute[75045]: DEBUG os_brick.utils [None req-4d63238c-1361-48e3-aa13-a807824da565 tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6217bd6e884', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75045) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 23:35:52 user nova-compute[75045]: DEBUG nova.virt.block_device [None req-4d63238c-1361-48e3-aa13-a807824da565 tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] [instance: adcffd35-00c7-49db-a72f-d6307a90e123] Updating existing volume attachment record: c34fcb4d-9bc4-42fb-93ea-0c2d53f9046d {{(pid=75045) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 23:35:52 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:35:52 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:35:52 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:35:52 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:35:53 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:35:53 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:35:53 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4c0930f-4309-43bb-959b-4f36ec457bb6/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:35:53 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:35:53 user nova-compute[75045]: DEBUG nova.compute.manager [req-fba1263e-68e7-4cd8-99be-2248078d2a67 req-4b84ce0e-74f3-46a9-88f6-2b7c92ff9a39 service nova] [instance: 9222e62a-9fd8-48b2-a125-83c9cdc589bd] Received event network-vif-plugged-5dae7844-411c-47aa-ba3e-bc209136f0a6 {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:35:53 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-fba1263e-68e7-4cd8-99be-2248078d2a67 req-4b84ce0e-74f3-46a9-88f6-2b7c92ff9a39 service nova] Acquiring lock "9222e62a-9fd8-48b2-a125-83c9cdc589bd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:35:53 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-fba1263e-68e7-4cd8-99be-2248078d2a67 req-4b84ce0e-74f3-46a9-88f6-2b7c92ff9a39 service nova] Lock "9222e62a-9fd8-48b2-a125-83c9cdc589bd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:35:53 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-fba1263e-68e7-4cd8-99be-2248078d2a67 req-4b84ce0e-74f3-46a9-88f6-2b7c92ff9a39 service nova] Lock "9222e62a-9fd8-48b2-a125-83c9cdc589bd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:35:53 user nova-compute[75045]: DEBUG nova.compute.manager [req-fba1263e-68e7-4cd8-99be-2248078d2a67 req-4b84ce0e-74f3-46a9-88f6-2b7c92ff9a39 service nova] [instance: 9222e62a-9fd8-48b2-a125-83c9cdc589bd] No waiting events found dispatching network-vif-plugged-5dae7844-411c-47aa-ba3e-bc209136f0a6 {{(pid=75045) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 23:35:53 user nova-compute[75045]: WARNING nova.compute.manager [req-fba1263e-68e7-4cd8-99be-2248078d2a67 req-4b84ce0e-74f3-46a9-88f6-2b7c92ff9a39 service nova] [instance: 9222e62a-9fd8-48b2-a125-83c9cdc589bd] Received unexpected event network-vif-plugged-5dae7844-411c-47aa-ba3e-bc209136f0a6 for instance with vm_state rescued and task_state unrescuing.
Nov 08 23:35:53 user nova-compute[75045]: DEBUG nova.compute.manager [req-fba1263e-68e7-4cd8-99be-2248078d2a67 req-4b84ce0e-74f3-46a9-88f6-2b7c92ff9a39 service nova] [instance: 9222e62a-9fd8-48b2-a125-83c9cdc589bd] Received event network-vif-plugged-5dae7844-411c-47aa-ba3e-bc209136f0a6 {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:35:53 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-fba1263e-68e7-4cd8-99be-2248078d2a67 req-4b84ce0e-74f3-46a9-88f6-2b7c92ff9a39 service nova] Acquiring lock "9222e62a-9fd8-48b2-a125-83c9cdc589bd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:35:53 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-fba1263e-68e7-4cd8-99be-2248078d2a67 req-4b84ce0e-74f3-46a9-88f6-2b7c92ff9a39 service nova] Lock "9222e62a-9fd8-48b2-a125-83c9cdc589bd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:35:53 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-fba1263e-68e7-4cd8-99be-2248078d2a67 req-4b84ce0e-74f3-46a9-88f6-2b7c92ff9a39 service nova] Lock "9222e62a-9fd8-48b2-a125-83c9cdc589bd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:35:53 user nova-compute[75045]: DEBUG nova.compute.manager [req-fba1263e-68e7-4cd8-99be-2248078d2a67 req-4b84ce0e-74f3-46a9-88f6-2b7c92ff9a39 service nova] [instance: 9222e62a-9fd8-48b2-a125-83c9cdc589bd] No waiting events found dispatching network-vif-plugged-5dae7844-411c-47aa-ba3e-bc209136f0a6 {{(pid=75045) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 23:35:53 user nova-compute[75045]: WARNING nova.compute.manager [req-fba1263e-68e7-4cd8-99be-2248078d2a67 req-4b84ce0e-74f3-46a9-88f6-2b7c92ff9a39 service nova] [instance: 9222e62a-9fd8-48b2-a125-83c9cdc589bd] Received unexpected event network-vif-plugged-5dae7844-411c-47aa-ba3e-bc209136f0a6 for instance with vm_state rescued and task_state unrescuing.
Nov 08 23:35:53 user nova-compute[75045]: DEBUG nova.compute.manager [req-fba1263e-68e7-4cd8-99be-2248078d2a67 req-4b84ce0e-74f3-46a9-88f6-2b7c92ff9a39 service nova] [instance: 9222e62a-9fd8-48b2-a125-83c9cdc589bd] Received event network-vif-plugged-5dae7844-411c-47aa-ba3e-bc209136f0a6 {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:35:53 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-fba1263e-68e7-4cd8-99be-2248078d2a67 req-4b84ce0e-74f3-46a9-88f6-2b7c92ff9a39 service nova] Acquiring lock "9222e62a-9fd8-48b2-a125-83c9cdc589bd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:35:53 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-fba1263e-68e7-4cd8-99be-2248078d2a67 req-4b84ce0e-74f3-46a9-88f6-2b7c92ff9a39 service nova] Lock "9222e62a-9fd8-48b2-a125-83c9cdc589bd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:35:53 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-fba1263e-68e7-4cd8-99be-2248078d2a67 req-4b84ce0e-74f3-46a9-88f6-2b7c92ff9a39 service nova] Lock "9222e62a-9fd8-48b2-a125-83c9cdc589bd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:35:53 user nova-compute[75045]: DEBUG nova.compute.manager [req-fba1263e-68e7-4cd8-99be-2248078d2a67 req-4b84ce0e-74f3-46a9-88f6-2b7c92ff9a39 service nova] [instance: 9222e62a-9fd8-48b2-a125-83c9cdc589bd] No waiting events found dispatching network-vif-plugged-5dae7844-411c-47aa-ba3e-bc209136f0a6 {{(pid=75045) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 23:35:53 user nova-compute[75045]: WARNING nova.compute.manager [req-fba1263e-68e7-4cd8-99be-2248078d2a67 req-4b84ce0e-74f3-46a9-88f6-2b7c92ff9a39 service nova] [instance: 9222e62a-9fd8-48b2-a125-83c9cdc589bd] Received unexpected event network-vif-plugged-5dae7844-411c-47aa-ba3e-bc209136f0a6 for instance with vm_state rescued and task_state unrescuing.
Nov 08 23:35:53 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4c0930f-4309-43bb-959b-4f36ec457bb6/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:35:53 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4c0930f-4309-43bb-959b-4f36ec457bb6/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:35:53 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4c0930f-4309-43bb-959b-4f36ec457bb6/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:35:53 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ae5ff6b-6f2c-4dfd-a4c6-da4809e2cf27/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:35:53 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ae5ff6b-6f2c-4dfd-a4c6-da4809e2cf27/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:35:53 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ae5ff6b-6f2c-4dfd-a4c6-da4809e2cf27/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:35:54 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ae5ff6b-6f2c-4dfd-a4c6-da4809e2cf27/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:35:54 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] skipping disk /dev/sdh (vda) as it is a volume {{(pid=75045) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 23:35:54 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f21fcd3-ac5f-499e-9c34-82af806fda1d/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:35:54 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f21fcd3-ac5f-499e-9c34-82af806fda1d/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:35:54 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f21fcd3-ac5f-499e-9c34-82af806fda1d/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:35:54 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f21fcd3-ac5f-499e-9c34-82af806fda1d/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:35:54 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9222e62a-9fd8-48b2-a125-83c9cdc589bd/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:35:54 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9222e62a-9fd8-48b2-a125-83c9cdc589bd/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:35:54 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9222e62a-9fd8-48b2-a125-83c9cdc589bd/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:35:54 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9222e62a-9fd8-48b2-a125-83c9cdc589bd/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:35:54 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75045) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 23:35:54 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5fc7f02-2143-4bcf-92ac-078d5ec10747/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:35:55 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5fc7f02-2143-4bcf-92ac-078d5ec10747/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:35:55 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5fc7f02-2143-4bcf-92ac-078d5ec10747/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:35:55 user nova-compute[75045]: DEBUG nova.compute.manager [None req-63be0d96-be44-48d2-8aa8-6405ab8a594a tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] [instance: 9222e62a-9fd8-48b2-a125-83c9cdc589bd] Checking state {{(pid=75045) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 23:35:55 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5fc7f02-2143-4bcf-92ac-078d5ec10747/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:35:55 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/adcffd35-00c7-49db-a72f-d6307a90e123/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:35:55 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/adcffd35-00c7-49db-a72f-d6307a90e123/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:35:55 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/adcffd35-00c7-49db-a72f-d6307a90e123/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:35:55 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/adcffd35-00c7-49db-a72f-d6307a90e123/disk --force-share --output=json" returned: 0 in 0.275s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:35:55 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b84f2b1-01a3-4789-bcef-8b7c4334132b/disk.rescue --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:35:55 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b84f2b1-01a3-4789-bcef-8b7c4334132b/disk.rescue --force-share --output=json" returned: 0 in 0.211s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:35:55 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b84f2b1-01a3-4789-bcef-8b7c4334132b/disk.rescue --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:35:56 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b84f2b1-01a3-4789-bcef-8b7c4334132b/disk.rescue --force-share --output=json" returned: 0 in 0.194s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:35:56 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b84f2b1-01a3-4789-bcef-8b7c4334132b/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:35:56 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b84f2b1-01a3-4789-bcef-8b7c4334132b/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:35:56 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b84f2b1-01a3-4789-bcef-8b7c4334132b/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:35:56 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b84f2b1-01a3-4789-bcef-8b7c4334132b/disk --force-share --output=json" returned: 0 in 0.248s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:35:56 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:35:57 user nova-compute[75045]: WARNING nova.virt.libvirt.driver [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 23:35:57 user nova-compute[75045]: WARNING nova.virt.libvirt.driver [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 23:35:57 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Hypervisor/Node resource view: name=user free_ram=8052MB free_disk=25.000022888183594GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75045) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 23:35:57 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:35:57 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:35:57 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Instance 4ae5ff6b-6f2c-4dfd-a4c6-da4809e2cf27 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75045) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 23:35:57 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Instance 0f21fcd3-ac5f-499e-9c34-82af806fda1d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75045) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 23:35:57 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Instance d2c911cf-d5f4-4c19-8335-8c7834184a7e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75045) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 23:35:57 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Instance b5fc7f02-2143-4bcf-92ac-078d5ec10747 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75045) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 23:35:57 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Instance 0b84f2b1-01a3-4789-bcef-8b7c4334132b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75045) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 23:35:57 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Instance adcffd35-00c7-49db-a72f-d6307a90e123 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75045) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 23:35:57 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Instance 9222e62a-9fd8-48b2-a125-83c9cdc589bd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75045) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 23:35:57 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Instance b4c0930f-4309-43bb-959b-4f36ec457bb6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75045) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 23:35:57 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=75045) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 23:35:57 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=75045) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 23:35:57 user nova-compute[75045]: DEBUG nova.compute.provider_tree [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Inventory has not changed in ProviderTree for provider: 62ba5f85-c74d-4b58-986e-d4197e813fd7 {{(pid=75045) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 23:35:57 user nova-compute[75045]: DEBUG nova.scheduler.client.report [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Inventory has not changed for provider 62ba5f85-c74d-4b58-986e-d4197e813fd7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75045) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 23:35:57 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Compute_service record updated for user:user {{(pid=75045) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 23:35:57 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.469s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:35:58 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:36:01 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-0c4e0a47-ab33-4430-8a5f-2c3effb935de tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Acquiring lock "d2c911cf-d5f4-4c19-8335-8c7834184a7e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:36:01 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-0c4e0a47-ab33-4430-8a5f-2c3effb935de tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Lock "d2c911cf-d5f4-4c19-8335-8c7834184a7e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:36:01 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-0c4e0a47-ab33-4430-8a5f-2c3effb935de tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Acquiring lock "d2c911cf-d5f4-4c19-8335-8c7834184a7e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:36:01 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-0c4e0a47-ab33-4430-8a5f-2c3effb935de tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Lock "d2c911cf-d5f4-4c19-8335-8c7834184a7e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:36:01 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-0c4e0a47-ab33-4430-8a5f-2c3effb935de tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Lock "d2c911cf-d5f4-4c19-8335-8c7834184a7e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:36:02 user nova-compute[75045]: INFO nova.compute.manager [None req-0c4e0a47-ab33-4430-8a5f-2c3effb935de tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] [instance: d2c911cf-d5f4-4c19-8335-8c7834184a7e] Terminating instance
Nov 08 23:36:02 user nova-compute[75045]: DEBUG nova.compute.manager [None req-0c4e0a47-ab33-4430-8a5f-2c3effb935de tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] [instance: d2c911cf-d5f4-4c19-8335-8c7834184a7e] Start destroying the instance on the hypervisor. {{(pid=75045) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 23:36:02 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:36:02 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:36:02 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:36:02 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:36:02 user nova-compute[75045]: DEBUG nova.compute.manager [req-392dfdc5-05bf-4d47-9707-a26a89525a23 req-8204b7a8-6811-4e42-874c-6ccf03354adf service nova] [instance: d2c911cf-d5f4-4c19-8335-8c7834184a7e] Received event network-vif-unplugged-f4321c52-b9d5-434c-820f-25cab4239ef4 {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:36:02 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-392dfdc5-05bf-4d47-9707-a26a89525a23 req-8204b7a8-6811-4e42-874c-6ccf03354adf service nova] Acquiring lock "d2c911cf-d5f4-4c19-8335-8c7834184a7e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:36:02 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-392dfdc5-05bf-4d47-9707-a26a89525a23 req-8204b7a8-6811-4e42-874c-6ccf03354adf service nova] Lock "d2c911cf-d5f4-4c19-8335-8c7834184a7e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:36:02 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-392dfdc5-05bf-4d47-9707-a26a89525a23 req-8204b7a8-6811-4e42-874c-6ccf03354adf service nova] Lock "d2c911cf-d5f4-4c19-8335-8c7834184a7e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:36:02 user nova-compute[75045]: DEBUG nova.compute.manager [req-392dfdc5-05bf-4d47-9707-a26a89525a23 req-8204b7a8-6811-4e42-874c-6ccf03354adf service nova] [instance: d2c911cf-d5f4-4c19-8335-8c7834184a7e] No waiting events found dispatching network-vif-unplugged-f4321c52-b9d5-434c-820f-25cab4239ef4 {{(pid=75045) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 23:36:02 user nova-compute[75045]: DEBUG nova.compute.manager [req-392dfdc5-05bf-4d47-9707-a26a89525a23 req-8204b7a8-6811-4e42-874c-6ccf03354adf service nova] [instance: d2c911cf-d5f4-4c19-8335-8c7834184a7e] Received event network-vif-unplugged-f4321c52-b9d5-434c-820f-25cab4239ef4 for instance with task_state deleting. {{(pid=75045) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 23:36:03 user nova-compute[75045]: INFO nova.virt.libvirt.driver [-] [instance: d2c911cf-d5f4-4c19-8335-8c7834184a7e] Instance destroyed successfully.
Nov 08 23:36:03 user nova-compute[75045]: DEBUG nova.objects.instance [None req-0c4e0a47-ab33-4430-8a5f-2c3effb935de tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Lazy-loading 'resources' on Instance uuid d2c911cf-d5f4-4c19-8335-8c7834184a7e {{(pid=75045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 23:36:03 user nova-compute[75045]: DEBUG nova.virt.libvirt.vif [None req-0c4e0a47-ab33-4430-8a5f-2c3effb935de tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T23:18:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-2063862125',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-2063862125',id=11,image_ref='a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-08T23:21:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6bfb6963a6c145d4a7b7e47c8fde7e60',ramdisk_id='',reservation_id='r-kiu16ror',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-474110917',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T23:23:10Z,user_data=None,user_id='04bb3135250f4465a9947b47f9cde485',uuid=d2c911cf-d5f4-4c19-8335-8c7834184a7e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f4321c52-b9d5-434c-820f-25cab4239ef4", "address": "fa:16:3e:49:6b:27", "network": {"id": "d4cd6998-66d1-4389-bc82-dd000c8962de", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-323966879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bfb6963a6c145d4a7b7e47c8fde7e60", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4321c52-b9", "ovs_interfaceid": "f4321c52-b9d5-434c-820f-25cab4239ef4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75045) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 23:36:03 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-0c4e0a47-ab33-4430-8a5f-2c3effb935de tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Converting VIF {"id": "f4321c52-b9d5-434c-820f-25cab4239ef4", "address": "fa:16:3e:49:6b:27", "network": {"id": "d4cd6998-66d1-4389-bc82-dd000c8962de", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-323966879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bfb6963a6c145d4a7b7e47c8fde7e60", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4321c52-b9", "ovs_interfaceid": "f4321c52-b9d5-434c-820f-25cab4239ef4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 23:36:03 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-0c4e0a47-ab33-4430-8a5f-2c3effb935de tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:49:6b:27,bridge_name='br-int',has_traffic_filtering=True,id=f4321c52-b9d5-434c-820f-25cab4239ef4,network=Network(d4cd6998-66d1-4389-bc82-dd000c8962de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4321c52-b9') {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 23:36:03 user nova-compute[75045]: DEBUG os_vif [None req-0c4e0a47-ab33-4430-8a5f-2c3effb935de tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:49:6b:27,bridge_name='br-int',has_traffic_filtering=True,id=f4321c52-b9d5-434c-820f-25cab4239ef4,network=Network(d4cd6998-66d1-4389-bc82-dd000c8962de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4321c52-b9') {{(pid=75045) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 23:36:03 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:36:03 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf4321c52-b9, bridge=br-int, if_exists=True) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:36:03 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 23:36:03 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:36:03 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=02c3d59c-a5be-4fff-9c34-1e9136d2c3ee) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:36:03 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:36:03 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 23:36:03 user nova-compute[75045]: INFO os_vif [None req-0c4e0a47-ab33-4430-8a5f-2c3effb935de tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:49:6b:27,bridge_name='br-int',has_traffic_filtering=True,id=f4321c52-b9d5-434c-820f-25cab4239ef4,network=Network(d4cd6998-66d1-4389-bc82-dd000c8962de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4321c52-b9')
Nov 08 23:36:03 user nova-compute[75045]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0c4e0a47-ab33-4430-8a5f-2c3effb935de tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] [instance: d2c911cf-d5f4-4c19-8335-8c7834184a7e] calling os-brick to detach iSCSI Volume {{(pid=75045) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 23:36:03 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c4e0a47-ab33-4430-8a5f-2c3effb935de tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1b68210460>, {'target_iqn': 'iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nAfSpkVl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': True}}" {{(pid=75045) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 23:36:03 user nova-compute[75045]: WARNING os_brick.initiator.connectors.base [None req-0c4e0a47-ab33-4430-8a5f-2c3effb935de tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 23:36:03 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-0c4e0a47-ab33-4430-8a5f-2c3effb935de tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 23:36:03 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-0c4e0a47-ab33-4430-8a5f-2c3effb935de tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 23:36:03 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:36:03 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:36:03 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c683983-f94c-4533-be70-f0eb8b5eca6b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1b2a3b04-13be-4853-822c-29c416757252\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:36:03 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c4e0a47-ab33-4430-8a5f-2c3effb935de tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 23:36:03 user nova-compute[75045]: No targets found.
Nov 08 23:36:03 user nova-compute[75045]: iSNS:
Nov 08 23:36:03 user nova-compute[75045]: No targets found.
Nov 08 23:36:03 user nova-compute[75045]: STATIC:
Nov 08 23:36:03 user nova-compute[75045]: Target: iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab
Nov 08 23:36:03 user nova-compute[75045]:         Portal: 172.16.0.220:3260,-1
Nov 08 23:36:03 user nova-compute[75045]:                 Iface Name: default
Nov 08 23:36:03 user nova-compute[75045]: Target: iqn.2010-10.org.openstack:1b2a3b04-13be-4853-822c-29c416757252
Nov 08 23:36:03 user nova-compute[75045]:         Portal: 172.16.0.220:3260,-1
Nov 08 23:36:03 user nova-compute[75045]:                 Iface Name: default
Nov 08 23:36:03 user nova-compute[75045]: FIRMWARE:
Nov 08 23:36:03 user nova-compute[75045]: No targets found.
Nov 08 23:36:03 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 23:36:03 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c4e0a47-ab33-4430-8a5f-2c3effb935de tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 23:36:03 user nova-compute[75045]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 23:36:03 user nova-compute[75045]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75045) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 23:36:03 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c4e0a47-ab33-4430-8a5f-2c3effb935de tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab', 0)] {{(pid=75045) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 23:36:03 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:36:03 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:36:03 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dae7804-ef3d-4e26-a073-22e181eedfb7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1b2a3b04-13be-4853-822c-29c416757252\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:36:03 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:36:03 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:36:03 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5a7190f-ef4e-4336-a707-6ae1d58b8d31]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b2a3b04-13be-4853-822c-29c416757252 (non-flash)\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:36:03 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c4e0a47-ab33-4430-8a5f-2c3effb935de tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab (non-flash)
Nov 08 23:36:03 user nova-compute[75045]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b2a3b04-13be-4853-822c-29c416757252 (non-flash)
Nov 08 23:36:03 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 23:36:03 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c4e0a47-ab33-4430-8a5f-2c3effb935de tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab (non-flash)
Nov 08 23:36:03 user nova-compute[75045]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b2a3b04-13be-4853-822c-29c416757252 (non-flash)
Nov 08 23:36:03 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 23:36:03 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c4e0a47-ab33-4430-8a5f-2c3effb935de tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1b79427130>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab'): ({'sdh'}, set())}) {{(pid=75045) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 23:36:03 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-0c4e0a47-ab33-4430-8a5f-2c3effb935de tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Removing single pathed devices sdh {{(pid=75045) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 23:36:03 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:36:03 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:36:03 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cf502dc-014f-4322-a587-2c788a63a23d]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:36:03 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:36:03 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.020s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:36:03 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b3392bf-f7f0-4489-8564-22ef62148a1b]: (4, ('ok\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:36:03 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-0c4e0a47-ab33-4430-8a5f-2c3effb935de tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Flushing IO for device /dev/sdh {{(pid=75045) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 23:36:03 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:36:03 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.015s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:36:03 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e12f2f8-a24d-4ac0-b2a4-952576a76b53]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:36:03 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-0c4e0a47-ab33-4430-8a5f-2c3effb935de tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=75045) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 23:36:03 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:36:03 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.048s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:36:03 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbecb419-5500-4cc2-a25a-2a04c05688b1]: (4, ('1', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:36:03 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-0c4e0a47-ab33-4430-8a5f-2c3effb935de tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=75045) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 23:36:03 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-0c4e0a47-ab33-4430-8a5f-2c3effb935de tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] SCSI volumes sdh have been removed. {{(pid=75045) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 23:36:03 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c4e0a47-ab33-4430-8a5f-2c3effb935de tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab')] {{(pid=75045) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 23:36:03 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:36:03 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:36:03 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[64b25469-09a2-4401-8f2e-d275d807fc70]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:36:03 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c4e0a47-ab33-4430-8a5f-2c3effb935de tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:36:03 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab -p 172.16.0.220:3260 --logout {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:36:03 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:36:03 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[59b29200-53c6-4108-8c45-5118eba2d0f1]: (4, ('Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab, portal: 172.16.0.220,3260]\nLogout of [sid: 11, target: iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:36:03 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c4e0a47-ab33-4430-8a5f-2c3effb935de tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab, portal: 172.16.0.220,3260]
Nov 08 23:36:03 user nova-compute[75045]: Logout of [sid: 11, target: iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab, portal: 172.16.0.220,3260] successful.
Nov 08 23:36:03 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:36:03 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab -p 172.16.0.220:3260 --op delete {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:36:03 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7df0819-9ce3-4a97-b0f9-217e351b22ab -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:36:03 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffd15d44-9e88-4e42-9a1b-57a132be7a61]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:36:03 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c4e0a47-ab33-4430-8a5f-2c3effb935de tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:36:03 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-0c4e0a47-ab33-4430-8a5f-2c3effb935de tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.314s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 23:36:03 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c4e0a47-ab33-4430-8a5f-2c3effb935de tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] <== disconnect_volume: return (315ms) None {{(pid=75045) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 23:36:03 user nova-compute[75045]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0c4e0a47-ab33-4430-8a5f-2c3effb935de tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] [instance: d2c911cf-d5f4-4c19-8335-8c7834184a7e] Disconnected iSCSI Volume {{(pid=75045) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 23:36:03 user nova-compute[75045]: INFO nova.virt.libvirt.driver [None req-0c4e0a47-ab33-4430-8a5f-2c3effb935de tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] [instance: d2c911cf-d5f4-4c19-8335-8c7834184a7e] Deleting instance files /opt/stack/data/nova/instances/d2c911cf-d5f4-4c19-8335-8c7834184a7e_del
Nov 08 23:36:03 user nova-compute[75045]: INFO nova.virt.libvirt.driver [None req-0c4e0a47-ab33-4430-8a5f-2c3effb935de tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] [instance: d2c911cf-d5f4-4c19-8335-8c7834184a7e] Deletion of /opt/stack/data/nova/instances/d2c911cf-d5f4-4c19-8335-8c7834184a7e_del complete
Nov 08 23:36:03 user nova-compute[75045]: INFO nova.compute.manager [None req-0c4e0a47-ab33-4430-8a5f-2c3effb935de tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] [instance: d2c911cf-d5f4-4c19-8335-8c7834184a7e] Took 1.40 seconds to destroy the instance on the hypervisor.
Nov 08 23:36:03 user nova-compute[75045]: DEBUG oslo.service.loopingcall [None req-0c4e0a47-ab33-4430-8a5f-2c3effb935de tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75045) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 23:36:03 user nova-compute[75045]: DEBUG nova.compute.manager [-] [instance: d2c911cf-d5f4-4c19-8335-8c7834184a7e] Deallocating network for instance {{(pid=75045) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 23:36:03 user nova-compute[75045]: DEBUG nova.network.neutron [-] [instance: d2c911cf-d5f4-4c19-8335-8c7834184a7e] deallocate_for_instance() {{(pid=75045) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 23:36:04 user nova-compute[75045]: DEBUG nova.network.neutron [-] [instance: d2c911cf-d5f4-4c19-8335-8c7834184a7e] Updating instance_info_cache with network_info: [] {{(pid=75045) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 23:36:04 user nova-compute[75045]: INFO nova.compute.manager [-] [instance: d2c911cf-d5f4-4c19-8335-8c7834184a7e] Took 0.48 seconds to deallocate network for instance.
Nov 08 23:36:04 user nova-compute[75045]: DEBUG nova.compute.manager [req-0166b6e4-ad44-4534-b6a8-57f9ca70d41e req-a5433fcf-8d07-4ac2-8938-8d50e7e038fb service nova] [instance: d2c911cf-d5f4-4c19-8335-8c7834184a7e] Received event network-vif-deleted-f4321c52-b9d5-434c-820f-25cab4239ef4 {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:36:04 user nova-compute[75045]: INFO nova.compute.manager [req-0166b6e4-ad44-4534-b6a8-57f9ca70d41e req-a5433fcf-8d07-4ac2-8938-8d50e7e038fb service nova] [instance: d2c911cf-d5f4-4c19-8335-8c7834184a7e] Neutron deleted interface f4321c52-b9d5-434c-820f-25cab4239ef4; detaching it from the instance and deleting it from the info cache
Nov 08 23:36:04 user nova-compute[75045]: DEBUG nova.network.neutron [req-0166b6e4-ad44-4534-b6a8-57f9ca70d41e req-a5433fcf-8d07-4ac2-8938-8d50e7e038fb service nova] [instance: d2c911cf-d5f4-4c19-8335-8c7834184a7e] Updating instance_info_cache with network_info: [] {{(pid=75045) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 23:36:04 user nova-compute[75045]: DEBUG nova.compute.manager [req-0166b6e4-ad44-4534-b6a8-57f9ca70d41e req-a5433fcf-8d07-4ac2-8938-8d50e7e038fb service nova] [instance: d2c911cf-d5f4-4c19-8335-8c7834184a7e] Detach interface failed, port_id=f4321c52-b9d5-434c-820f-25cab4239ef4, reason: Instance d2c911cf-d5f4-4c19-8335-8c7834184a7e could not be found. {{(pid=75045) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 08 23:36:04 user nova-compute[75045]: DEBUG nova.compute.manager [req-f61bb8e9-fb5f-4271-9087-892318845f94 req-906d4025-72f7-4a31-9cf6-878ebb0e1a01 service nova] [instance: d2c911cf-d5f4-4c19-8335-8c7834184a7e] Received event network-vif-plugged-f4321c52-b9d5-434c-820f-25cab4239ef4 {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:36:04 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-f61bb8e9-fb5f-4271-9087-892318845f94 req-906d4025-72f7-4a31-9cf6-878ebb0e1a01 service nova] Acquiring lock "d2c911cf-d5f4-4c19-8335-8c7834184a7e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:36:04 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-f61bb8e9-fb5f-4271-9087-892318845f94 req-906d4025-72f7-4a31-9cf6-878ebb0e1a01 service nova] Lock "d2c911cf-d5f4-4c19-8335-8c7834184a7e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:36:04 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-f61bb8e9-fb5f-4271-9087-892318845f94 req-906d4025-72f7-4a31-9cf6-878ebb0e1a01 service nova] Lock "d2c911cf-d5f4-4c19-8335-8c7834184a7e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:36:04 user nova-compute[75045]: DEBUG nova.compute.manager [req-f61bb8e9-fb5f-4271-9087-892318845f94 req-906d4025-72f7-4a31-9cf6-878ebb0e1a01 service nova] [instance: d2c911cf-d5f4-4c19-8335-8c7834184a7e] No waiting events found dispatching network-vif-plugged-f4321c52-b9d5-434c-820f-25cab4239ef4 {{(pid=75045) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 23:36:04 user nova-compute[75045]: WARNING nova.compute.manager [req-f61bb8e9-fb5f-4271-9087-892318845f94 req-906d4025-72f7-4a31-9cf6-878ebb0e1a01 service nova] [instance: d2c911cf-d5f4-4c19-8335-8c7834184a7e] Received unexpected event network-vif-plugged-f4321c52-b9d5-434c-820f-25cab4239ef4 for instance with vm_state active and task_state deleting.
Nov 08 23:36:08 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:36:11 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:36:13 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:36:16 user nova-compute[75045]: INFO nova.compute.manager [None req-0c4e0a47-ab33-4430-8a5f-2c3effb935de tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] [instance: d2c911cf-d5f4-4c19-8335-8c7834184a7e] Took 12.39 seconds to detach 1 volumes for instance.
Nov 08 23:36:16 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-0c4e0a47-ab33-4430-8a5f-2c3effb935de tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:36:16 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-0c4e0a47-ab33-4430-8a5f-2c3effb935de tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:36:16 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:36:16 user nova-compute[75045]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4d63238c-1361-48e3-aa13-a807824da565 tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] [instance: adcffd35-00c7-49db-a72f-d6307a90e123] Calling os-brick to attach iSCSI Volume {{(pid=75045) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 23:36:16 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d63238c-1361-48e3-aa13-a807824da565 tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1b68210460>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:7c46c452-9bc3-48fc-b758-6de79dbab523', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vYrfdJDb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75045) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 23:36:16 user nova-compute[75045]: WARNING os_brick.initiator.connectors.base [None req-4d63238c-1361-48e3-aa13-a807824da565 tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 23:36:16 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-4d63238c-1361-48e3-aa13-a807824da565 tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 23:36:16 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-4d63238c-1361-48e3-aa13-a807824da565 tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 23:36:16 user nova-compute[75045]: WARNING os_brick.initiator.connectors.base [None req-4d63238c-1361-48e3-aa13-a807824da565 tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 23:36:16 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-4d63238c-1361-48e3-aa13-a807824da565 tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7c46c452-9bc3-48fc-b758-6de79dbab523" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 23:36:16 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-4d63238c-1361-48e3-aa13-a807824da565 tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7c46c452-9bc3-48fc-b758-6de79dbab523" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 23:36:16 user nova-compute[75045]: INFO os_brick.initiator.connectors.iscsi [None req-4d63238c-1361-48e3-aa13-a807824da565 tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 23:36:16 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c46c452-9bc3-48fc-b758-6de79dbab523 -p 172.16.0.220:3260 {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:36:16 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c46c452-9bc3-48fc-b758-6de79dbab523 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:36:16 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[9808d9fc-897f-49d6-9cfd-8b57b70b356e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:36:16 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d63238c-1361-48e3-aa13-a807824da565 tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 23:36:16 user nova-compute[75045]:  {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:36:16 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c46c452-9bc3-48fc-b758-6de79dbab523 -p 172.16.0.220:3260 --interface default --op new {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:36:16 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c46c452-9bc3-48fc-b758-6de79dbab523 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:36:16 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[3346aa72-039c-462d-ae4b-75db655305a9]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7c46c452-9bc3-48fc-b758-6de79dbab523] added\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:36:16 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d63238c-1361-48e3-aa13-a807824da565 tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7c46c452-9bc3-48fc-b758-6de79dbab523] added
Nov 08 23:36:16 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:36:16 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c46c452-9bc3-48fc-b758-6de79dbab523 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:36:16 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c46c452-9bc3-48fc-b758-6de79dbab523 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:36:16 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[13bc09b6-a4a9-48d4-9d0f-c168a75e2aba]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:36:16 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d63238c-1361-48e3-aa13-a807824da565 tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:36:16 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c46c452-9bc3-48fc-b758-6de79dbab523 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:36:16 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c46c452-9bc3-48fc-b758-6de79dbab523 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:36:16 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[53bbd17f-5e55-4bdd-88f7-38497ec85f0d]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:36:16 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d63238c-1361-48e3-aa13-a807824da565 tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:36:16 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c46c452-9bc3-48fc-b758-6de79dbab523 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vYrfdJDb {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:36:16 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c46c452-9bc3-48fc-b758-6de79dbab523 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vYrfdJDb" returned: 0 in 0.022s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:36:16 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[d72de7ed-34dd-4dbb-a435-192c00431ed1]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:36:16 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d63238c-1361-48e3-aa13-a807824da565 tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'vYrfdJDb'): stdout= stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:36:16 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c46c452-9bc3-48fc-b758-6de79dbab523 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:36:16 user nova-compute[75045]: DEBUG nova.compute.provider_tree [None req-0c4e0a47-ab33-4430-8a5f-2c3effb935de tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Inventory has not changed in ProviderTree for provider: 62ba5f85-c74d-4b58-986e-d4197e813fd7 {{(pid=75045) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 23:36:16 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c46c452-9bc3-48fc-b758-6de79dbab523 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:36:16 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[f07f3da8-362b-46f9-bca2-ee120f66af42]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:36:16 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d63238c-1361-48e3-aa13-a807824da565 tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:36:16 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:36:16 user nova-compute[75045]: DEBUG nova.scheduler.client.report [None req-0c4e0a47-ab33-4430-8a5f-2c3effb935de tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Inventory has not changed for provider 62ba5f85-c74d-4b58-986e-d4197e813fd7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75045) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 23:36:16 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:36:16 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a002b3d-9169-495c-9756-9936a7245459]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b2a3b04-13be-4853-822c-29c416757252 (non-flash)\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:36:16 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d63238c-1361-48e3-aa13-a807824da565 tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b2a3b04-13be-4853-822c-29c416757252 (non-flash)
Nov 08 23:36:16 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 23:36:16 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d63238c-1361-48e3-aa13-a807824da565 tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b2a3b04-13be-4853-822c-29c416757252 (non-flash)
Nov 08 23:36:16 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 23:36:16 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c46c452-9bc3-48fc-b758-6de79dbab523 -p 172.16.0.220:3260 --login {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:36:16 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-0c4e0a47-ab33-4430-8a5f-2c3effb935de tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.334s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:36:16 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c46c452-9bc3-48fc-b758-6de79dbab523 -p 172.16.0.220:3260 --login" returned: 0 in 0.050s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:36:16 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[7825ff6c-1b0a-4bda-a5a0-7c5ffc124d27]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7c46c452-9bc3-48fc-b758-6de79dbab523, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7c46c452-9bc3-48fc-b758-6de79dbab523, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:36:16 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d63238c-1361-48e3-aa13-a807824da565 tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7c46c452-9bc3-48fc-b758-6de79dbab523, portal: 172.16.0.220,3260]
Nov 08 23:36:16 user nova-compute[75045]: Login to [iface: default, target: iqn.2010-10.org.openstack:7c46c452-9bc3-48fc-b758-6de79dbab523, portal: 172.16.0.220,3260] successful.
Nov 08 23:36:16 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:36:16 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c46c452-9bc3-48fc-b758-6de79dbab523 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:36:16 user nova-compute[75045]: INFO nova.scheduler.client.report [None req-0c4e0a47-ab33-4430-8a5f-2c3effb935de tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Deleted allocations for instance d2c911cf-d5f4-4c19-8335-8c7834184a7e
Nov 08 23:36:16 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c46c452-9bc3-48fc-b758-6de79dbab523 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:36:16 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[a222b382-4d27-4620-a722-58de496baf3a]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:36:16 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d63238c-1361-48e3-aa13-a807824da565 tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:36:16 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:36:16 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:36:16 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4c29ef2-a8d4-447b-9193-d133c01c1813]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b2a3b04-13be-4853-822c-29c416757252 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c46c452-9bc3-48fc-b758-6de79dbab523 (non-flash)\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:36:16 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d63238c-1361-48e3-aa13-a807824da565 tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b2a3b04-13be-4853-822c-29c416757252 (non-flash)
Nov 08 23:36:16 user nova-compute[75045]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c46c452-9bc3-48fc-b758-6de79dbab523 (non-flash)
Nov 08 23:36:16 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 23:36:16 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d63238c-1361-48e3-aa13-a807824da565 tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b2a3b04-13be-4853-822c-29c416757252 (non-flash)
Nov 08 23:36:16 user nova-compute[75045]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c46c452-9bc3-48fc-b758-6de79dbab523 (non-flash)
Nov 08 23:36:16 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 23:36:16 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-4d63238c-1361-48e3-aa13-a807824da565 tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7c46c452-9bc3-48fc-b758-6de79dbab523" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.346s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 23:36:16 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d63238c-1361-48e3-aa13-a807824da565 tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] Connected to 172.16.0.220:3260 {{(pid=75045) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 23:36:16 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-4d63238c-1361-48e3-aa13-a807824da565 tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] HCTL ('34', '-', '-', 0) found on session 37 with lun 0 {{(pid=75045) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 23:36:16 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-4d63238c-1361-48e3-aa13-a807824da565 tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75045) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 23:36:16 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:36:16 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:36:16 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[18be0451-ddca-420c-8e2a-65d5a372634b]: (4, ('- - 0', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:36:16 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-4d63238c-1361-48e3-aa13-a807824da565 tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] Searching for a device in session 37 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75045) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 23:36:16 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d63238c-1361-48e3-aa13-a807824da565 tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:7c46c452-9bc3-48fc-b758-6de79dbab523', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vYrfdJDb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75045) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 23:36:16 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-0c4e0a47-ab33-4430-8a5f-2c3effb935de tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Lock "d2c911cf-d5f4-4c19-8335-8c7834184a7e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 15.144s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:36:17 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-4d63238c-1361-48e3-aa13-a807824da565 tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.378s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 23:36:17 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d63238c-1361-48e3-aa13-a807824da565 tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] <== connect_volume: return (1380ms) {'type': 'block', 'scsi_wwn': '26532376137323763', 'path': '/dev/sdc'} {{(pid=75045) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 23:36:17 user nova-compute[75045]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4d63238c-1361-48e3-aa13-a807824da565 tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] [instance: adcffd35-00c7-49db-a72f-d6307a90e123] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26532376137323763', 'path': '/dev/sdc'} {{(pid=75045) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 23:36:17 user nova-compute[75045]: DEBUG nova.objects.instance [None req-4d63238c-1361-48e3-aa13-a807824da565 tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] Lazy-loading 'flavor' on Instance uuid adcffd35-00c7-49db-a72f-d6307a90e123 {{(pid=75045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 23:36:17 user nova-compute[75045]: DEBUG nova.virt.libvirt.guest [None req-4d63238c-1361-48e3-aa13-a807824da565 tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] attach device xml: <disk type="block" device="disk">
Nov 08 23:36:17 user nova-compute[75045]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 23:36:17 user nova-compute[75045]:   <source dev="/dev/sdc"/>
Nov 08 23:36:17 user nova-compute[75045]:   <target dev="vdb" bus="virtio"/>
Nov 08 23:36:17 user nova-compute[75045]:   <serial>7c46c452-9bc3-48fc-b758-6de79dbab523</serial>
Nov 08 23:36:17 user nova-compute[75045]: </disk>
Nov 08 23:36:17 user nova-compute[75045]:  {{(pid=75045) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 08 23:36:18 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:36:18 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-4d63238c-1361-48e3-aa13-a807824da565 tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] No BDM found with device name vda, not building metadata. {{(pid=75045) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 23:36:18 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-4d63238c-1361-48e3-aa13-a807824da565 tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75045) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 23:36:18 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-4d63238c-1361-48e3-aa13-a807824da565 tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] No VIF found with MAC fa:16:3e:60:a2:7b, not building metadata {{(pid=75045) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 23:36:18 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-4d63238c-1361-48e3-aa13-a807824da565 tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] Lock "adcffd35-00c7-49db-a72f-d6307a90e123" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 26.086s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:36:20 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-4f6da503-e0ce-4828-a3e9-447f2c86780d tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] Acquiring lock "adcffd35-00c7-49db-a72f-d6307a90e123" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:36:20 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-4f6da503-e0ce-4828-a3e9-447f2c86780d tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] Lock "adcffd35-00c7-49db-a72f-d6307a90e123" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:36:20 user nova-compute[75045]: INFO nova.compute.manager [None req-4f6da503-e0ce-4828-a3e9-447f2c86780d tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] [instance: adcffd35-00c7-49db-a72f-d6307a90e123] Detaching volume 7c46c452-9bc3-48fc-b758-6de79dbab523
Nov 08 23:36:20 user nova-compute[75045]: INFO nova.virt.block_device [None req-4f6da503-e0ce-4828-a3e9-447f2c86780d tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] [instance: adcffd35-00c7-49db-a72f-d6307a90e123] Attempting to driver detach volume 7c46c452-9bc3-48fc-b758-6de79dbab523 from mountpoint /dev/vdb
Nov 08 23:36:21 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-4f6da503-e0ce-4828-a3e9-447f2c86780d tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] Attempting to detach device vdb from instance adcffd35-00c7-49db-a72f-d6307a90e123 from the persistent domain config. {{(pid=75045) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 08 23:36:21 user nova-compute[75045]: DEBUG nova.virt.libvirt.guest [None req-4f6da503-e0ce-4828-a3e9-447f2c86780d tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 23:36:21 user nova-compute[75045]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 23:36:21 user nova-compute[75045]:   <source dev="/dev/sdc"/>
Nov 08 23:36:21 user nova-compute[75045]:   <target dev="vdb" bus="virtio"/>
Nov 08 23:36:21 user nova-compute[75045]:   <serial>7c46c452-9bc3-48fc-b758-6de79dbab523</serial>
Nov 08 23:36:21 user nova-compute[75045]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 08 23:36:21 user nova-compute[75045]: </disk>
Nov 08 23:36:21 user nova-compute[75045]:  {{(pid=75045) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 23:36:21 user nova-compute[75045]: INFO nova.virt.libvirt.driver [None req-4f6da503-e0ce-4828-a3e9-447f2c86780d tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] Successfully detached device vdb from instance adcffd35-00c7-49db-a72f-d6307a90e123 from the persistent domain config.
Nov 08 23:36:21 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-4f6da503-e0ce-4828-a3e9-447f2c86780d tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance adcffd35-00c7-49db-a72f-d6307a90e123 from the live domain config. {{(pid=75045) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 08 23:36:21 user nova-compute[75045]: DEBUG nova.virt.libvirt.guest [None req-4f6da503-e0ce-4828-a3e9-447f2c86780d tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 23:36:21 user nova-compute[75045]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 23:36:21 user nova-compute[75045]:   <source dev="/dev/sdc"/>
Nov 08 23:36:21 user nova-compute[75045]:   <target dev="vdb" bus="virtio"/>
Nov 08 23:36:21 user nova-compute[75045]:   <serial>7c46c452-9bc3-48fc-b758-6de79dbab523</serial>
Nov 08 23:36:21 user nova-compute[75045]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 08 23:36:21 user nova-compute[75045]: </disk>
Nov 08 23:36:21 user nova-compute[75045]:  {{(pid=75045) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 23:36:21 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-4f6da503-e0ce-4828-a3e9-447f2c86780d tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance adcffd35-00c7-49db-a72f-d6307a90e123 {{(pid=75045) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 08 23:36:21 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:36:23 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:36:26 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:36:28 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:36:28 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2e3a88c7-cea2-4929-ae1d-2217dc7d05fa tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Acquiring lock "0f21fcd3-ac5f-499e-9c34-82af806fda1d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:36:28 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2e3a88c7-cea2-4929-ae1d-2217dc7d05fa tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Lock "0f21fcd3-ac5f-499e-9c34-82af806fda1d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:36:28 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2e3a88c7-cea2-4929-ae1d-2217dc7d05fa tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Acquiring lock "0f21fcd3-ac5f-499e-9c34-82af806fda1d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:36:28 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2e3a88c7-cea2-4929-ae1d-2217dc7d05fa tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Lock "0f21fcd3-ac5f-499e-9c34-82af806fda1d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:36:28 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2e3a88c7-cea2-4929-ae1d-2217dc7d05fa tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Lock "0f21fcd3-ac5f-499e-9c34-82af806fda1d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:36:28 user nova-compute[75045]: INFO nova.compute.manager [None req-2e3a88c7-cea2-4929-ae1d-2217dc7d05fa tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] [instance: 0f21fcd3-ac5f-499e-9c34-82af806fda1d] Terminating instance
Nov 08 23:36:28 user nova-compute[75045]: DEBUG nova.compute.manager [None req-2e3a88c7-cea2-4929-ae1d-2217dc7d05fa tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] [instance: 0f21fcd3-ac5f-499e-9c34-82af806fda1d] Start destroying the instance on the hypervisor. {{(pid=75045) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 23:36:28 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:36:28 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:36:28 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:36:29 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:36:29 user nova-compute[75045]: DEBUG nova.compute.manager [req-00734101-a291-4abc-a253-654137a7527b req-0448058c-c14c-44a9-97f7-d4764232dfa0 service nova] [instance: 0f21fcd3-ac5f-499e-9c34-82af806fda1d] Received event network-vif-unplugged-ab02704d-73c2-409c-9d43-1a087ebf369a {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:36:29 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-00734101-a291-4abc-a253-654137a7527b req-0448058c-c14c-44a9-97f7-d4764232dfa0 service nova] Acquiring lock "0f21fcd3-ac5f-499e-9c34-82af806fda1d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:36:29 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-00734101-a291-4abc-a253-654137a7527b req-0448058c-c14c-44a9-97f7-d4764232dfa0 service nova] Lock "0f21fcd3-ac5f-499e-9c34-82af806fda1d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:36:29 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-00734101-a291-4abc-a253-654137a7527b req-0448058c-c14c-44a9-97f7-d4764232dfa0 service nova] Lock "0f21fcd3-ac5f-499e-9c34-82af806fda1d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:36:29 user nova-compute[75045]: DEBUG nova.compute.manager [req-00734101-a291-4abc-a253-654137a7527b req-0448058c-c14c-44a9-97f7-d4764232dfa0 service nova] [instance: 0f21fcd3-ac5f-499e-9c34-82af806fda1d] No waiting events found dispatching network-vif-unplugged-ab02704d-73c2-409c-9d43-1a087ebf369a {{(pid=75045) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 23:36:29 user nova-compute[75045]: DEBUG nova.compute.manager [req-00734101-a291-4abc-a253-654137a7527b req-0448058c-c14c-44a9-97f7-d4764232dfa0 service nova] [instance: 0f21fcd3-ac5f-499e-9c34-82af806fda1d] Received event network-vif-unplugged-ab02704d-73c2-409c-9d43-1a087ebf369a for instance with task_state deleting. {{(pid=75045) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 23:36:29 user nova-compute[75045]: INFO nova.virt.libvirt.driver [-] [instance: 0f21fcd3-ac5f-499e-9c34-82af806fda1d] Instance destroyed successfully.
Nov 08 23:36:29 user nova-compute[75045]: DEBUG nova.objects.instance [None req-2e3a88c7-cea2-4929-ae1d-2217dc7d05fa tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Lazy-loading 'resources' on Instance uuid 0f21fcd3-ac5f-499e-9c34-82af806fda1d {{(pid=75045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 23:36:29 user nova-compute[75045]: DEBUG nova.virt.libvirt.vif [None req-2e3a88c7-cea2-4929-ae1d-2217dc7d05fa tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T23:15:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1980505455',display_name='tempest-ServerActionsTestOtherA-server-1980505455',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1980505455',id=3,image_ref='a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDODl/KmGTsZ/iebmo5xmCcXvI602I8HkxrrHYOCSHtu28wqdqp4sqz8GjX6RCkUTvwm3o1RrGN7CPAGp6yuNsTNNdTZNeJLiXbNPx6WnByfZzN9Q7qtNxToi4a9/5pZlg==',key_name='tempest-keypair-679582766',keypairs=<?>,launch_index=0,launched_at=2023-11-08T23:15:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e63623113f11463d9035bb990de43510',ramdisk_id='',reservation_id='r-szkzg0a8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-2056815713',owner_user_name='tempest-ServerActionsTestOtherA-2056815713-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T23:15:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='75fc508f268d4a569ad78598ff019c14',uuid=0f21fcd3-ac5f-499e-9c34-82af806fda1d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ab02704d-73c2-409c-9d43-1a087ebf369a", "address": "fa:16:3e:b3:b2:47", "network": {"id": "700b5784-d35b-45c0-a4d3-1ab8aa4c48aa", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-194469807-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e63623113f11463d9035bb990de43510", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab02704d-73", "ovs_interfaceid": "ab02704d-73c2-409c-9d43-1a087ebf369a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75045) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 23:36:29 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-2e3a88c7-cea2-4929-ae1d-2217dc7d05fa tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Converting VIF {"id": "ab02704d-73c2-409c-9d43-1a087ebf369a", "address": "fa:16:3e:b3:b2:47", "network": {"id": "700b5784-d35b-45c0-a4d3-1ab8aa4c48aa", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-194469807-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e63623113f11463d9035bb990de43510", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab02704d-73", "ovs_interfaceid": "ab02704d-73c2-409c-9d43-1a087ebf369a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 23:36:29 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-2e3a88c7-cea2-4929-ae1d-2217dc7d05fa tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b3:b2:47,bridge_name='br-int',has_traffic_filtering=True,id=ab02704d-73c2-409c-9d43-1a087ebf369a,network=Network(700b5784-d35b-45c0-a4d3-1ab8aa4c48aa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapab02704d-73') {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 23:36:29 user nova-compute[75045]: DEBUG os_vif [None req-2e3a88c7-cea2-4929-ae1d-2217dc7d05fa tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b3:b2:47,bridge_name='br-int',has_traffic_filtering=True,id=ab02704d-73c2-409c-9d43-1a087ebf369a,network=Network(700b5784-d35b-45c0-a4d3-1ab8aa4c48aa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapab02704d-73') {{(pid=75045) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 23:36:29 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:36:29 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapab02704d-73, bridge=br-int, if_exists=True) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:36:29 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:36:29 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:36:29 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:36:29 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=55bce19c-b3dc-418e-81e5-83cdc9be408b) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:36:29 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:36:29 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:36:29 user nova-compute[75045]: INFO os_vif [None req-2e3a88c7-cea2-4929-ae1d-2217dc7d05fa tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b3:b2:47,bridge_name='br-int',has_traffic_filtering=True,id=ab02704d-73c2-409c-9d43-1a087ebf369a,network=Network(700b5784-d35b-45c0-a4d3-1ab8aa4c48aa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapab02704d-73')
Nov 08 23:36:29 user nova-compute[75045]: INFO nova.virt.libvirt.driver [None req-2e3a88c7-cea2-4929-ae1d-2217dc7d05fa tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] [instance: 0f21fcd3-ac5f-499e-9c34-82af806fda1d] Deleting instance files /opt/stack/data/nova/instances/0f21fcd3-ac5f-499e-9c34-82af806fda1d_del
Nov 08 23:36:29 user nova-compute[75045]: INFO nova.virt.libvirt.driver [None req-2e3a88c7-cea2-4929-ae1d-2217dc7d05fa tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] [instance: 0f21fcd3-ac5f-499e-9c34-82af806fda1d] Deletion of /opt/stack/data/nova/instances/0f21fcd3-ac5f-499e-9c34-82af806fda1d_del complete
Nov 08 23:36:29 user nova-compute[75045]: INFO nova.compute.manager [None req-2e3a88c7-cea2-4929-ae1d-2217dc7d05fa tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] [instance: 0f21fcd3-ac5f-499e-9c34-82af806fda1d] Took 0.91 seconds to destroy the instance on the hypervisor.
Nov 08 23:36:29 user nova-compute[75045]: DEBUG oslo.service.loopingcall [None req-2e3a88c7-cea2-4929-ae1d-2217dc7d05fa tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75045) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 23:36:29 user nova-compute[75045]: DEBUG nova.compute.manager [-] [instance: 0f21fcd3-ac5f-499e-9c34-82af806fda1d] Deallocating network for instance {{(pid=75045) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 23:36:29 user nova-compute[75045]: DEBUG nova.network.neutron [-] [instance: 0f21fcd3-ac5f-499e-9c34-82af806fda1d] deallocate_for_instance() {{(pid=75045) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 23:36:30 user nova-compute[75045]: DEBUG nova.network.neutron [-] [instance: 0f21fcd3-ac5f-499e-9c34-82af806fda1d] Updating instance_info_cache with network_info: [] {{(pid=75045) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 23:36:30 user nova-compute[75045]: INFO nova.compute.manager [-] [instance: 0f21fcd3-ac5f-499e-9c34-82af806fda1d] Took 0.51 seconds to deallocate network for instance.
Nov 08 23:36:30 user nova-compute[75045]: DEBUG nova.compute.manager [req-d36da85d-4c29-4d7e-bcad-b3ce11264d1e req-5cd18c3a-8bf9-47fb-904d-d2c9e1548db4 service nova] [instance: 0f21fcd3-ac5f-499e-9c34-82af806fda1d] Received event network-vif-deleted-ab02704d-73c2-409c-9d43-1a087ebf369a {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:36:30 user nova-compute[75045]: INFO nova.compute.manager [req-d36da85d-4c29-4d7e-bcad-b3ce11264d1e req-5cd18c3a-8bf9-47fb-904d-d2c9e1548db4 service nova] [instance: 0f21fcd3-ac5f-499e-9c34-82af806fda1d] Neutron deleted interface ab02704d-73c2-409c-9d43-1a087ebf369a; detaching it from the instance and deleting it from the info cache
Nov 08 23:36:30 user nova-compute[75045]: DEBUG nova.network.neutron [req-d36da85d-4c29-4d7e-bcad-b3ce11264d1e req-5cd18c3a-8bf9-47fb-904d-d2c9e1548db4 service nova] [instance: 0f21fcd3-ac5f-499e-9c34-82af806fda1d] Updating instance_info_cache with network_info: [] {{(pid=75045) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 23:36:30 user nova-compute[75045]: DEBUG nova.compute.manager [req-d36da85d-4c29-4d7e-bcad-b3ce11264d1e req-5cd18c3a-8bf9-47fb-904d-d2c9e1548db4 service nova] [instance: 0f21fcd3-ac5f-499e-9c34-82af806fda1d] Detach interface failed, port_id=ab02704d-73c2-409c-9d43-1a087ebf369a, reason: Instance 0f21fcd3-ac5f-499e-9c34-82af806fda1d could not be found. {{(pid=75045) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 08 23:36:30 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2e3a88c7-cea2-4929-ae1d-2217dc7d05fa tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:36:30 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2e3a88c7-cea2-4929-ae1d-2217dc7d05fa tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:36:30 user nova-compute[75045]: DEBUG nova.compute.provider_tree [None req-2e3a88c7-cea2-4929-ae1d-2217dc7d05fa tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Inventory has not changed in ProviderTree for provider: 62ba5f85-c74d-4b58-986e-d4197e813fd7 {{(pid=75045) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 23:36:30 user nova-compute[75045]: DEBUG nova.scheduler.client.report [None req-2e3a88c7-cea2-4929-ae1d-2217dc7d05fa tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Inventory has not changed for provider 62ba5f85-c74d-4b58-986e-d4197e813fd7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75045) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 23:36:30 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2e3a88c7-cea2-4929-ae1d-2217dc7d05fa tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.297s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:36:30 user nova-compute[75045]: INFO nova.scheduler.client.report [None req-2e3a88c7-cea2-4929-ae1d-2217dc7d05fa tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Deleted allocations for instance 0f21fcd3-ac5f-499e-9c34-82af806fda1d
Nov 08 23:36:30 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2e3a88c7-cea2-4929-ae1d-2217dc7d05fa tempest-ServerActionsTestOtherA-2056815713 tempest-ServerActionsTestOtherA-2056815713-project-member] Lock "0f21fcd3-ac5f-499e-9c34-82af806fda1d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.913s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:36:31 user nova-compute[75045]: DEBUG nova.compute.manager [req-950f60c4-dd94-4c17-b2bf-c88fafc93d9f req-5afd3930-df6f-4f63-a1da-c494a97b330e service nova] [instance: 0f21fcd3-ac5f-499e-9c34-82af806fda1d] Received event network-vif-plugged-ab02704d-73c2-409c-9d43-1a087ebf369a {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:36:31 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-950f60c4-dd94-4c17-b2bf-c88fafc93d9f req-5afd3930-df6f-4f63-a1da-c494a97b330e service nova] Acquiring lock "0f21fcd3-ac5f-499e-9c34-82af806fda1d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:36:31 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-950f60c4-dd94-4c17-b2bf-c88fafc93d9f req-5afd3930-df6f-4f63-a1da-c494a97b330e service nova] Lock "0f21fcd3-ac5f-499e-9c34-82af806fda1d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:36:31 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-950f60c4-dd94-4c17-b2bf-c88fafc93d9f req-5afd3930-df6f-4f63-a1da-c494a97b330e service nova] Lock "0f21fcd3-ac5f-499e-9c34-82af806fda1d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:36:31 user nova-compute[75045]: DEBUG nova.compute.manager [req-950f60c4-dd94-4c17-b2bf-c88fafc93d9f req-5afd3930-df6f-4f63-a1da-c494a97b330e service nova] [instance: 0f21fcd3-ac5f-499e-9c34-82af806fda1d] No waiting events found dispatching network-vif-plugged-ab02704d-73c2-409c-9d43-1a087ebf369a {{(pid=75045) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 23:36:31 user nova-compute[75045]: WARNING nova.compute.manager [req-950f60c4-dd94-4c17-b2bf-c88fafc93d9f req-5afd3930-df6f-4f63-a1da-c494a97b330e service nova] [instance: 0f21fcd3-ac5f-499e-9c34-82af806fda1d] Received unexpected event network-vif-plugged-ab02704d-73c2-409c-9d43-1a087ebf369a for instance with vm_state deleted and task_state None.
Nov 08 23:36:34 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:36:39 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 23:36:40 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:36:41 user nova-compute[75045]: WARNING nova.virt.libvirt.driver [None req-4f6da503-e0ce-4828-a3e9-447f2c86780d tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance adcffd35-00c7-49db-a72f-d6307a90e123 is timed out.
Nov 08 23:36:41 user nova-compute[75045]: INFO nova.virt.libvirt.driver [None req-4f6da503-e0ce-4828-a3e9-447f2c86780d tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] Successfully detached device vdb from instance adcffd35-00c7-49db-a72f-d6307a90e123 from the live domain config.
Nov 08 23:36:41 user nova-compute[75045]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4f6da503-e0ce-4828-a3e9-447f2c86780d tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] [instance: adcffd35-00c7-49db-a72f-d6307a90e123] calling os-brick to detach iSCSI Volume {{(pid=75045) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 23:36:41 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f6da503-e0ce-4828-a3e9-447f2c86780d tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1b68210460>, {'target_iqn': 'iqn.2010-10.org.openstack:7c46c452-9bc3-48fc-b758-6de79dbab523', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vYrfdJDb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75045) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 23:36:41 user nova-compute[75045]: WARNING os_brick.initiator.connectors.base [None req-4f6da503-e0ce-4828-a3e9-447f2c86780d tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 23:36:41 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-4f6da503-e0ce-4828-a3e9-447f2c86780d tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 23:36:41 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-4f6da503-e0ce-4828-a3e9-447f2c86780d tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 23:36:41 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:36:41 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:36:41 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ccbde8f-e7f2-4b48-85bc-d2e97c9945ec]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:1b2a3b04-13be-4853-822c-29c416757252\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7c46c452-9bc3-48fc-b758-6de79dbab523\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:36:41 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f6da503-e0ce-4828-a3e9-447f2c86780d tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 23:36:41 user nova-compute[75045]: No targets found.
Nov 08 23:36:41 user nova-compute[75045]: iSNS:
Nov 08 23:36:41 user nova-compute[75045]: No targets found.
Nov 08 23:36:41 user nova-compute[75045]: STATIC:
Nov 08 23:36:41 user nova-compute[75045]: Target: iqn.2010-10.org.openstack:1b2a3b04-13be-4853-822c-29c416757252
Nov 08 23:36:41 user nova-compute[75045]:         Portal: 172.16.0.220:3260,-1
Nov 08 23:36:41 user nova-compute[75045]:                 Iface Name: default
Nov 08 23:36:41 user nova-compute[75045]: Target: iqn.2010-10.org.openstack:7c46c452-9bc3-48fc-b758-6de79dbab523
Nov 08 23:36:41 user nova-compute[75045]:         Portal: 172.16.0.220:3260,-1
Nov 08 23:36:41 user nova-compute[75045]:                 Iface Name: default
Nov 08 23:36:41 user nova-compute[75045]: FIRMWARE:
Nov 08 23:36:41 user nova-compute[75045]: No targets found.
Nov 08 23:36:41 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 23:36:41 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f6da503-e0ce-4828-a3e9-447f2c86780d tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 23:36:41 user nova-compute[75045]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 23:36:41 user nova-compute[75045]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75045) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 23:36:41 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f6da503-e0ce-4828-a3e9-447f2c86780d tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7c46c452-9bc3-48fc-b758-6de79dbab523', 0)] {{(pid=75045) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 23:36:41 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:36:41 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:36:41 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[3040f575-697c-44ef-9f99-fa339653bc49]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1b2a3b04-13be-4853-822c-29c416757252\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7c46c452-9bc3-48fc-b758-6de79dbab523\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:36:41 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:36:41 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:36:41 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b1164d8-041a-4c9c-b362-ecb32a61a761]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b2a3b04-13be-4853-822c-29c416757252 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c46c452-9bc3-48fc-b758-6de79dbab523 (non-flash)\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:36:41 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f6da503-e0ce-4828-a3e9-447f2c86780d tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b2a3b04-13be-4853-822c-29c416757252 (non-flash)
Nov 08 23:36:41 user nova-compute[75045]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c46c452-9bc3-48fc-b758-6de79dbab523 (non-flash)
Nov 08 23:36:41 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 23:36:41 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f6da503-e0ce-4828-a3e9-447f2c86780d tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b2a3b04-13be-4853-822c-29c416757252 (non-flash)
Nov 08 23:36:41 user nova-compute[75045]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c46c452-9bc3-48fc-b758-6de79dbab523 (non-flash)
Nov 08 23:36:41 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 23:36:41 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f6da503-e0ce-4828-a3e9-447f2c86780d tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1b4848c9d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7c46c452-9bc3-48fc-b758-6de79dbab523'): ({'sdc'}, set())}) {{(pid=75045) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 23:36:41 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-4f6da503-e0ce-4828-a3e9-447f2c86780d tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] Removing single pathed devices sdc {{(pid=75045) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 23:36:41 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:36:41 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:36:41 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fde0e01-e326-45c2-bd73-64d058533f80]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:36:41 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:36:41 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:36:41 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee877328-f040-4bf7-8b49-4ac9f43246ae]: (4, ('ok\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:36:41 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-4f6da503-e0ce-4828-a3e9-447f2c86780d tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] Flushing IO for device /dev/sdc {{(pid=75045) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 23:36:41 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:36:41 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:36:41 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fdc2d66-d891-46ce-a16e-cfd2b100c35c]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:36:41 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-4f6da503-e0ce-4828-a3e9-447f2c86780d tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75045) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 23:36:41 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:36:41 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.034s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:36:41 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[dde25bbb-cde4-4ed6-8a98-776059487f7d]: (4, ('1', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:36:41 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-4f6da503-e0ce-4828-a3e9-447f2c86780d tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75045) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 23:36:41 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-4f6da503-e0ce-4828-a3e9-447f2c86780d tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] SCSI volumes sdc have been removed. {{(pid=75045) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 23:36:41 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f6da503-e0ce-4828-a3e9-447f2c86780d tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7c46c452-9bc3-48fc-b758-6de79dbab523')] {{(pid=75045) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 23:36:41 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c46c452-9bc3-48fc-b758-6de79dbab523 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:36:41 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c46c452-9bc3-48fc-b758-6de79dbab523 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:36:41 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1fc0a2e-5b95-4c00-9120-4a7e6aba74fd]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:36:41 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f6da503-e0ce-4828-a3e9-447f2c86780d tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:36:41 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c46c452-9bc3-48fc-b758-6de79dbab523 -p 172.16.0.220:3260 --logout {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:36:41 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c46c452-9bc3-48fc-b758-6de79dbab523 -p 172.16.0.220:3260 --logout" returned: 0 in 0.050s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:36:41 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[66380075-8bb0-40dd-8e1f-c6b178f7ca38]: (4, ('Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:7c46c452-9bc3-48fc-b758-6de79dbab523, portal: 172.16.0.220,3260]\nLogout of [sid: 37, target: iqn.2010-10.org.openstack:7c46c452-9bc3-48fc-b758-6de79dbab523, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:36:41 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f6da503-e0ce-4828-a3e9-447f2c86780d tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:7c46c452-9bc3-48fc-b758-6de79dbab523, portal: 172.16.0.220,3260]
Nov 08 23:36:41 user nova-compute[75045]: Logout of [sid: 37, target: iqn.2010-10.org.openstack:7c46c452-9bc3-48fc-b758-6de79dbab523, portal: 172.16.0.220,3260] successful.
Nov 08 23:36:41 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:36:41 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c46c452-9bc3-48fc-b758-6de79dbab523 -p 172.16.0.220:3260 --op delete {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:36:41 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c46c452-9bc3-48fc-b758-6de79dbab523 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:36:41 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e94ce78-a39a-42b1-83a9-d6b88fffdcf8]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:36:41 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f6da503-e0ce-4828-a3e9-447f2c86780d tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:36:41 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-4f6da503-e0ce-4828-a3e9-447f2c86780d tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.295s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 23:36:41 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f6da503-e0ce-4828-a3e9-447f2c86780d tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] <== disconnect_volume: return (297ms) None {{(pid=75045) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 23:36:41 user nova-compute[75045]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4f6da503-e0ce-4828-a3e9-447f2c86780d tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] [instance: adcffd35-00c7-49db-a72f-d6307a90e123] Disconnected iSCSI Volume {{(pid=75045) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 23:36:43 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:36:44 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:36:46 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:36:49 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:36:51 user nova-compute[75045]: DEBUG nova.objects.instance [None req-4f6da503-e0ce-4828-a3e9-447f2c86780d tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] Lazy-loading 'flavor' on Instance uuid adcffd35-00c7-49db-a72f-d6307a90e123 {{(pid=75045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 23:36:51 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-4f6da503-e0ce-4828-a3e9-447f2c86780d tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] Lock "adcffd35-00c7-49db-a72f-d6307a90e123" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 30.782s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:36:52 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-dcdf37ff-7eec-485d-8ec4-e36295896011 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Acquiring lock "4ae5ff6b-6f2c-4dfd-a4c6-da4809e2cf27" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:36:52 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-dcdf37ff-7eec-485d-8ec4-e36295896011 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Lock "4ae5ff6b-6f2c-4dfd-a4c6-da4809e2cf27" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:36:52 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-dcdf37ff-7eec-485d-8ec4-e36295896011 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Acquiring lock "4ae5ff6b-6f2c-4dfd-a4c6-da4809e2cf27-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:36:52 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-dcdf37ff-7eec-485d-8ec4-e36295896011 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Lock "4ae5ff6b-6f2c-4dfd-a4c6-da4809e2cf27-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:36:52 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-dcdf37ff-7eec-485d-8ec4-e36295896011 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Lock "4ae5ff6b-6f2c-4dfd-a4c6-da4809e2cf27-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:36:52 user nova-compute[75045]: INFO nova.compute.manager [None req-dcdf37ff-7eec-485d-8ec4-e36295896011 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] [instance: 4ae5ff6b-6f2c-4dfd-a4c6-da4809e2cf27] Terminating instance
Nov 08 23:36:52 user nova-compute[75045]: DEBUG nova.compute.manager [None req-dcdf37ff-7eec-485d-8ec4-e36295896011 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] [instance: 4ae5ff6b-6f2c-4dfd-a4c6-da4809e2cf27] Start destroying the instance on the hypervisor. {{(pid=75045) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 23:36:52 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:36:52 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:36:52 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:36:52 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:36:52 user nova-compute[75045]: DEBUG nova.compute.manager [req-be280be9-1fd3-4cf0-9d95-8f919b41bf19 req-ead519e5-9988-46f4-8651-65898eb3fbe9 service nova] [instance: 4ae5ff6b-6f2c-4dfd-a4c6-da4809e2cf27] Received event network-vif-unplugged-cfa24a0c-4dce-4dae-a5d7-10ebfa1cc305 {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:36:52 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-be280be9-1fd3-4cf0-9d95-8f919b41bf19 req-ead519e5-9988-46f4-8651-65898eb3fbe9 service nova] Acquiring lock "4ae5ff6b-6f2c-4dfd-a4c6-da4809e2cf27-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:36:52 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-be280be9-1fd3-4cf0-9d95-8f919b41bf19 req-ead519e5-9988-46f4-8651-65898eb3fbe9 service nova] Lock "4ae5ff6b-6f2c-4dfd-a4c6-da4809e2cf27-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:36:52 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-be280be9-1fd3-4cf0-9d95-8f919b41bf19 req-ead519e5-9988-46f4-8651-65898eb3fbe9 service nova] Lock "4ae5ff6b-6f2c-4dfd-a4c6-da4809e2cf27-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:36:52 user nova-compute[75045]: DEBUG nova.compute.manager [req-be280be9-1fd3-4cf0-9d95-8f919b41bf19 req-ead519e5-9988-46f4-8651-65898eb3fbe9 service nova] [instance: 4ae5ff6b-6f2c-4dfd-a4c6-da4809e2cf27] No waiting events found dispatching network-vif-unplugged-cfa24a0c-4dce-4dae-a5d7-10ebfa1cc305 {{(pid=75045) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 23:36:52 user nova-compute[75045]: DEBUG nova.compute.manager [req-be280be9-1fd3-4cf0-9d95-8f919b41bf19 req-ead519e5-9988-46f4-8651-65898eb3fbe9 service nova] [instance: 4ae5ff6b-6f2c-4dfd-a4c6-da4809e2cf27] Received event network-vif-unplugged-cfa24a0c-4dce-4dae-a5d7-10ebfa1cc305 for instance with task_state deleting. {{(pid=75045) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 23:36:53 user nova-compute[75045]: INFO nova.virt.libvirt.driver [-] [instance: 4ae5ff6b-6f2c-4dfd-a4c6-da4809e2cf27] Instance destroyed successfully.
Nov 08 23:36:53 user nova-compute[75045]: DEBUG nova.objects.instance [None req-dcdf37ff-7eec-485d-8ec4-e36295896011 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Lazy-loading 'resources' on Instance uuid 4ae5ff6b-6f2c-4dfd-a4c6-da4809e2cf27 {{(pid=75045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 23:36:53 user nova-compute[75045]: DEBUG nova.virt.libvirt.vif [None req-dcdf37ff-7eec-485d-8ec4-e36295896011 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T23:15:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1262128998',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1262128998',id=1,image_ref='a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-08T23:15:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6bfb6963a6c145d4a7b7e47c8fde7e60',ramdisk_id='',reservation_id='r-29lhow1b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-474110917',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T23:17:29Z,user_data=None,user_id='04bb3135250f4465a9947b47f9cde485',uuid=4ae5ff6b-6f2c-4dfd-a4c6-da4809e2cf27,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cfa24a0c-4dce-4dae-a5d7-10ebfa1cc305", "address": "fa:16:3e:33:11:13", "network": {"id": "d4cd6998-66d1-4389-bc82-dd000c8962de", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-323966879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bfb6963a6c145d4a7b7e47c8fde7e60", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcfa24a0c-4d", "ovs_interfaceid": "cfa24a0c-4dce-4dae-a5d7-10ebfa1cc305", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75045) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 23:36:53 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-dcdf37ff-7eec-485d-8ec4-e36295896011 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Converting VIF {"id": "cfa24a0c-4dce-4dae-a5d7-10ebfa1cc305", "address": "fa:16:3e:33:11:13", "network": {"id": "d4cd6998-66d1-4389-bc82-dd000c8962de", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-323966879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bfb6963a6c145d4a7b7e47c8fde7e60", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcfa24a0c-4d", "ovs_interfaceid": "cfa24a0c-4dce-4dae-a5d7-10ebfa1cc305", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 23:36:53 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-dcdf37ff-7eec-485d-8ec4-e36295896011 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:33:11:13,bridge_name='br-int',has_traffic_filtering=True,id=cfa24a0c-4dce-4dae-a5d7-10ebfa1cc305,network=Network(d4cd6998-66d1-4389-bc82-dd000c8962de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcfa24a0c-4d') {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 23:36:53 user nova-compute[75045]: DEBUG os_vif [None req-dcdf37ff-7eec-485d-8ec4-e36295896011 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:33:11:13,bridge_name='br-int',has_traffic_filtering=True,id=cfa24a0c-4dce-4dae-a5d7-10ebfa1cc305,network=Network(d4cd6998-66d1-4389-bc82-dd000c8962de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcfa24a0c-4d') {{(pid=75045) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 23:36:53 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:36:53 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapcfa24a0c-4d, bridge=br-int, if_exists=True) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:36:53 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:36:53 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:36:53 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:36:53 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b0765290-b336-43e5-b5c3-5866e490ddad) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:36:53 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:36:53 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:36:53 user nova-compute[75045]: INFO os_vif [None req-dcdf37ff-7eec-485d-8ec4-e36295896011 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:33:11:13,bridge_name='br-int',has_traffic_filtering=True,id=cfa24a0c-4dce-4dae-a5d7-10ebfa1cc305,network=Network(d4cd6998-66d1-4389-bc82-dd000c8962de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcfa24a0c-4d')
Nov 08 23:36:53 user nova-compute[75045]: INFO nova.virt.libvirt.driver [None req-dcdf37ff-7eec-485d-8ec4-e36295896011 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] [instance: 4ae5ff6b-6f2c-4dfd-a4c6-da4809e2cf27] Deleting instance files /opt/stack/data/nova/instances/4ae5ff6b-6f2c-4dfd-a4c6-da4809e2cf27_del
Nov 08 23:36:53 user nova-compute[75045]: INFO nova.virt.libvirt.driver [None req-dcdf37ff-7eec-485d-8ec4-e36295896011 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] [instance: 4ae5ff6b-6f2c-4dfd-a4c6-da4809e2cf27] Deletion of /opt/stack/data/nova/instances/4ae5ff6b-6f2c-4dfd-a4c6-da4809e2cf27_del complete
Nov 08 23:36:53 user nova-compute[75045]: INFO nova.compute.manager [None req-dcdf37ff-7eec-485d-8ec4-e36295896011 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] [instance: 4ae5ff6b-6f2c-4dfd-a4c6-da4809e2cf27] Took 0.67 seconds to destroy the instance on the hypervisor.
Nov 08 23:36:53 user nova-compute[75045]: DEBUG oslo.service.loopingcall [None req-dcdf37ff-7eec-485d-8ec4-e36295896011 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75045) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 23:36:53 user nova-compute[75045]: DEBUG nova.compute.manager [-] [instance: 4ae5ff6b-6f2c-4dfd-a4c6-da4809e2cf27] Deallocating network for instance {{(pid=75045) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 23:36:53 user nova-compute[75045]: DEBUG nova.network.neutron [-] [instance: 4ae5ff6b-6f2c-4dfd-a4c6-da4809e2cf27] deallocate_for_instance() {{(pid=75045) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 23:36:53 user nova-compute[75045]: DEBUG nova.network.neutron [-] [instance: 4ae5ff6b-6f2c-4dfd-a4c6-da4809e2cf27] Updating instance_info_cache with network_info: [] {{(pid=75045) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 23:36:53 user nova-compute[75045]: INFO nova.compute.manager [-] [instance: 4ae5ff6b-6f2c-4dfd-a4c6-da4809e2cf27] Took 0.40 seconds to deallocate network for instance.
Nov 08 23:36:53 user nova-compute[75045]: DEBUG nova.compute.manager [req-e29422a0-f553-4ed8-a385-5d6608241824 req-e7332569-aee2-4182-8208-d935b1e46b41 service nova] [instance: 4ae5ff6b-6f2c-4dfd-a4c6-da4809e2cf27] Received event network-vif-deleted-cfa24a0c-4dce-4dae-a5d7-10ebfa1cc305 {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:36:53 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-dcdf37ff-7eec-485d-8ec4-e36295896011 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:36:53 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-dcdf37ff-7eec-485d-8ec4-e36295896011 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:36:53 user nova-compute[75045]: DEBUG nova.scheduler.client.report [None req-dcdf37ff-7eec-485d-8ec4-e36295896011 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Refreshing inventories for resource provider 62ba5f85-c74d-4b58-986e-d4197e813fd7 {{(pid=75045) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 08 23:36:53 user nova-compute[75045]: DEBUG nova.scheduler.client.report [None req-dcdf37ff-7eec-485d-8ec4-e36295896011 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Updating ProviderTree inventory for provider 62ba5f85-c74d-4b58-986e-d4197e813fd7 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75045) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 08 23:36:53 user nova-compute[75045]: DEBUG nova.compute.provider_tree [None req-dcdf37ff-7eec-485d-8ec4-e36295896011 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Updating inventory in ProviderTree for provider 62ba5f85-c74d-4b58-986e-d4197e813fd7 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75045) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 08 23:36:53 user nova-compute[75045]: DEBUG nova.scheduler.client.report [None req-dcdf37ff-7eec-485d-8ec4-e36295896011 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Refreshing aggregate associations for resource provider 62ba5f85-c74d-4b58-986e-d4197e813fd7, aggregates: None {{(pid=75045) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 08 23:36:54 user nova-compute[75045]: DEBUG nova.scheduler.client.report [None req-dcdf37ff-7eec-485d-8ec4-e36295896011 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Refreshing trait associations for resource provider 62ba5f85-c74d-4b58-986e-d4197e813fd7, traits: COMPUTE_STORAGE_BUS_SCSI,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_TRUSTED_CERTS,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_VIRTIO,HW_CPU_X86_SSSE3,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_FDC,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_RESCUE_BFV,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSE2,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN {{(pid=75045) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 08 23:36:54 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:36:54 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:36:54 user nova-compute[75045]: DEBUG nova.compute.manager [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Starting heal instance info cache {{(pid=75045) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 23:36:54 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Acquiring lock "refresh_cache-0b84f2b1-01a3-4789-bcef-8b7c4334132b" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 23:36:54 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Acquired lock "refresh_cache-0b84f2b1-01a3-4789-bcef-8b7c4334132b" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 23:36:54 user nova-compute[75045]: DEBUG nova.network.neutron [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] [instance: 0b84f2b1-01a3-4789-bcef-8b7c4334132b] Forcefully refreshing network info cache for instance {{(pid=75045) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 23:36:54 user nova-compute[75045]: DEBUG nova.compute.provider_tree [None req-dcdf37ff-7eec-485d-8ec4-e36295896011 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Inventory has not changed in ProviderTree for provider: 62ba5f85-c74d-4b58-986e-d4197e813fd7 {{(pid=75045) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 23:36:54 user nova-compute[75045]: DEBUG nova.scheduler.client.report [None req-dcdf37ff-7eec-485d-8ec4-e36295896011 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Inventory has not changed for provider 62ba5f85-c74d-4b58-986e-d4197e813fd7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75045) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 23:36:54 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-dcdf37ff-7eec-485d-8ec4-e36295896011 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.679s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:36:54 user nova-compute[75045]: INFO nova.scheduler.client.report [None req-dcdf37ff-7eec-485d-8ec4-e36295896011 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Deleted allocations for instance 4ae5ff6b-6f2c-4dfd-a4c6-da4809e2cf27
Nov 08 23:36:54 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-dcdf37ff-7eec-485d-8ec4-e36295896011 tempest-ServerBootFromVolumeStableRescueTest-474110917 tempest-ServerBootFromVolumeStableRescueTest-474110917-project-member] Lock "4ae5ff6b-6f2c-4dfd-a4c6-da4809e2cf27" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.946s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:36:54 user nova-compute[75045]: DEBUG nova.network.neutron [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] [instance: 0b84f2b1-01a3-4789-bcef-8b7c4334132b] Updating instance_info_cache with network_info: [{"id": "c0a20899-be58-4d47-95e2-e129f636162c", "address": "fa:16:3e:69:a7:d0", "network": {"id": "08d1669a-f667-4c79-8e49-0ad183f57046", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1863648032-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bbb640407ef94f568aea892f1834d6d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0a20899-be", "ovs_interfaceid": "c0a20899-be58-4d47-95e2-e129f636162c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75045) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 23:36:54 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Releasing lock "refresh_cache-0b84f2b1-01a3-4789-bcef-8b7c4334132b" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 23:36:54 user nova-compute[75045]: DEBUG nova.compute.manager [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] [instance: 0b84f2b1-01a3-4789-bcef-8b7c4334132b] Updated the network info_cache for instance {{(pid=75045) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 23:36:54 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:36:54 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:36:54 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:36:54 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:36:54 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:36:54 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:36:54 user nova-compute[75045]: DEBUG nova.compute.manager [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75045) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 23:36:54 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager.update_available_resource {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:36:54 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:36:54 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:36:54 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:36:54 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Auditing locally available compute resources for user (node: user) {{(pid=75045) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 23:36:54 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4c0930f-4309-43bb-959b-4f36ec457bb6/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:36:54 user nova-compute[75045]: DEBUG nova.compute.manager [req-c9a93f94-4886-4ac0-b6e3-ac4e3dbd97a6 req-e5ebdc6f-11ce-44b8-aae6-2c0c6368e4c1 service nova] [instance: 4ae5ff6b-6f2c-4dfd-a4c6-da4809e2cf27] Received event network-vif-plugged-cfa24a0c-4dce-4dae-a5d7-10ebfa1cc305 {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:36:54 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-c9a93f94-4886-4ac0-b6e3-ac4e3dbd97a6 req-e5ebdc6f-11ce-44b8-aae6-2c0c6368e4c1 service nova] Acquiring lock "4ae5ff6b-6f2c-4dfd-a4c6-da4809e2cf27-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:36:54 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-c9a93f94-4886-4ac0-b6e3-ac4e3dbd97a6 req-e5ebdc6f-11ce-44b8-aae6-2c0c6368e4c1 service nova] Lock "4ae5ff6b-6f2c-4dfd-a4c6-da4809e2cf27-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:36:54 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-c9a93f94-4886-4ac0-b6e3-ac4e3dbd97a6 req-e5ebdc6f-11ce-44b8-aae6-2c0c6368e4c1 service nova] Lock "4ae5ff6b-6f2c-4dfd-a4c6-da4809e2cf27-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:36:54 user nova-compute[75045]: DEBUG nova.compute.manager [req-c9a93f94-4886-4ac0-b6e3-ac4e3dbd97a6 req-e5ebdc6f-11ce-44b8-aae6-2c0c6368e4c1 service nova] [instance: 4ae5ff6b-6f2c-4dfd-a4c6-da4809e2cf27] No waiting events found dispatching network-vif-plugged-cfa24a0c-4dce-4dae-a5d7-10ebfa1cc305 {{(pid=75045) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 23:36:54 user nova-compute[75045]: WARNING nova.compute.manager [req-c9a93f94-4886-4ac0-b6e3-ac4e3dbd97a6 req-e5ebdc6f-11ce-44b8-aae6-2c0c6368e4c1 service nova] [instance: 4ae5ff6b-6f2c-4dfd-a4c6-da4809e2cf27] Received unexpected event network-vif-plugged-cfa24a0c-4dce-4dae-a5d7-10ebfa1cc305 for instance with vm_state deleted and task_state None.
Nov 08 23:36:54 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4c0930f-4309-43bb-959b-4f36ec457bb6/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:36:54 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4c0930f-4309-43bb-959b-4f36ec457bb6/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:36:55 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4c0930f-4309-43bb-959b-4f36ec457bb6/disk --force-share --output=json" returned: 0 in 0.235s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:36:55 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9222e62a-9fd8-48b2-a125-83c9cdc589bd/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:36:55 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9222e62a-9fd8-48b2-a125-83c9cdc589bd/disk --force-share --output=json" returned: 0 in 0.247s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:36:55 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9222e62a-9fd8-48b2-a125-83c9cdc589bd/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:36:55 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9222e62a-9fd8-48b2-a125-83c9cdc589bd/disk --force-share --output=json" returned: 0 in 0.245s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:36:55 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75045) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 23:36:55 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5fc7f02-2143-4bcf-92ac-078d5ec10747/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:36:55 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5fc7f02-2143-4bcf-92ac-078d5ec10747/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:36:55 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5fc7f02-2143-4bcf-92ac-078d5ec10747/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:36:56 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5fc7f02-2143-4bcf-92ac-078d5ec10747/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:36:56 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/adcffd35-00c7-49db-a72f-d6307a90e123/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:36:56 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/adcffd35-00c7-49db-a72f-d6307a90e123/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:36:56 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/adcffd35-00c7-49db-a72f-d6307a90e123/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:36:56 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/adcffd35-00c7-49db-a72f-d6307a90e123/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:36:56 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b84f2b1-01a3-4789-bcef-8b7c4334132b/disk.rescue --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:36:56 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b84f2b1-01a3-4789-bcef-8b7c4334132b/disk.rescue --force-share --output=json" returned: 0 in 0.180s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:36:56 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b84f2b1-01a3-4789-bcef-8b7c4334132b/disk.rescue --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:36:56 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b84f2b1-01a3-4789-bcef-8b7c4334132b/disk.rescue --force-share --output=json" returned: 0 in 0.196s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:36:56 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b84f2b1-01a3-4789-bcef-8b7c4334132b/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:36:57 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b84f2b1-01a3-4789-bcef-8b7c4334132b/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:36:57 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b84f2b1-01a3-4789-bcef-8b7c4334132b/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:36:57 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b84f2b1-01a3-4789-bcef-8b7c4334132b/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:36:57 user nova-compute[75045]: WARNING nova.virt.libvirt.driver [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 23:36:57 user nova-compute[75045]: WARNING nova.virt.libvirt.driver [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 23:36:57 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Hypervisor/Node resource view: name=user free_ram=8320MB free_disk=25.14813232421875GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75045) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 23:36:57 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:36:57 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:36:57 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Instance b5fc7f02-2143-4bcf-92ac-078d5ec10747 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75045) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 23:36:57 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Instance 0b84f2b1-01a3-4789-bcef-8b7c4334132b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75045) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 23:36:57 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Instance adcffd35-00c7-49db-a72f-d6307a90e123 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75045) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 23:36:57 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Instance 9222e62a-9fd8-48b2-a125-83c9cdc589bd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75045) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 23:36:57 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Instance b4c0930f-4309-43bb-959b-4f36ec457bb6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75045) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 23:36:57 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=75045) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 23:36:57 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=75045) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 23:36:58 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:36:58 user nova-compute[75045]: DEBUG nova.compute.provider_tree [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Inventory has not changed in ProviderTree for provider: 62ba5f85-c74d-4b58-986e-d4197e813fd7 {{(pid=75045) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 23:36:58 user nova-compute[75045]: DEBUG nova.scheduler.client.report [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Inventory has not changed for provider 62ba5f85-c74d-4b58-986e-d4197e813fd7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75045) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 23:36:58 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Compute_service record updated for user:user {{(pid=75045) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 23:36:58 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.529s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:36:58 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:36:58 user nova-compute[75045]: DEBUG nova.compute.manager [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Cleaning up deleted instances with incomplete migration  {{(pid=75045) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 08 23:36:58 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:36:58 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-0d869fc9-2c14-4784-aa11-87edd52b76c9 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] Acquiring lock "78955913-bbab-4b00-bc9b-12116f249d7e" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:36:58 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-0d869fc9-2c14-4784-aa11-87edd52b76c9 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] Lock "78955913-bbab-4b00-bc9b-12116f249d7e" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:36:58 user nova-compute[75045]: INFO nova.compute.manager [None req-0d869fc9-2c14-4784-aa11-87edd52b76c9 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] [instance: 78955913-bbab-4b00-bc9b-12116f249d7e] Unshelving
Nov 08 23:36:58 user nova-compute[75045]: INFO nova.virt.block_device [None req-0d869fc9-2c14-4784-aa11-87edd52b76c9 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] [instance: 78955913-bbab-4b00-bc9b-12116f249d7e] Booting with volume 5c6e98f2-e9be-4c1a-b335-61187862dfec at /dev/vdc
Nov 08 23:36:58 user nova-compute[75045]: DEBUG os_brick.utils [None req-0d869fc9-2c14-4784-aa11-87edd52b76c9 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75045) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 23:36:58 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:36:58 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:36:58 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b84fda5-6e71-4dd2-a528-b7c020f1b088]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6217bd6e884\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:36:58 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:36:58 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:36:58 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c18b374-cab1-4a7f-8eca-17158ad8ad49]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:36:58 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:36:58 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:36:58 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad5cd63a-4bb3-4ceb-ac6e-5203c51f8e9c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:36:58 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e465179-9c89-4b92-b7ae-84d20929ece1]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:36:58 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-0d869fc9-2c14-4784-aa11-87edd52b76c9 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] Running cmd (subprocess): nvme version {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:36:58 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-0d869fc9-2c14-4784-aa11-87edd52b76c9 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] 'nvme version' failed. Not Retrying. {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 23:36:58 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0d869fc9-2c14-4784-aa11-87edd52b76c9 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] nvme not present on system {{(pid=75045) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 23:36:58 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:36:58 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 23:36:58 user nova-compute[75045]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 23:36:58 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[34a6ca0b-5b12-4088-8368-7efb36aaadd5]: (4, '') {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:36:58 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.lightos [None req-0d869fc9-2c14-4784-aa11-87edd52b76c9 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75045) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 23:36:58 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.lightos [None req-0d869fc9-2c14-4784-aa11-87edd52b76c9 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75045) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 23:36:58 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.lightos [None req-0d869fc9-2c14-4784-aa11-87edd52b76c9 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] LIGHTOS: no hostnqn found. {{(pid=75045) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 23:36:58 user nova-compute[75045]: DEBUG os_brick.utils [None req-0d869fc9-2c14-4784-aa11-87edd52b76c9 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6217bd6e884', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75045) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 23:36:58 user nova-compute[75045]: DEBUG nova.virt.block_device [None req-0d869fc9-2c14-4784-aa11-87edd52b76c9 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] [instance: 78955913-bbab-4b00-bc9b-12116f249d7e] Updating existing volume attachment record: 905995ff-b2bc-421c-af38-260f72c7bf3f {{(pid=75045) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 23:37:01 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:37:02 user nova-compute[75045]: DEBUG nova.compute.manager [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Cleaning up deleted instances {{(pid=75045) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 08 23:37:02 user nova-compute[75045]: DEBUG nova.compute.manager [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] There are 0 instances to clean {{(pid=75045) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 08 23:37:03 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:37:06 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:37:06 user nova-compute[75045]: DEBUG nova.compute.manager [req-eb57bf17-7dc4-415e-853f-2b640fce8418 req-ea25e490-0142-4800-9e21-f8b18c5b7e56 service nova] [instance: b4c0930f-4309-43bb-959b-4f36ec457bb6] Received event network-changed-663b2fc9-e6a3-4d9a-81bc-484f78acc4dd {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:37:06 user nova-compute[75045]: DEBUG nova.compute.manager [req-eb57bf17-7dc4-415e-853f-2b640fce8418 req-ea25e490-0142-4800-9e21-f8b18c5b7e56 service nova] [instance: b4c0930f-4309-43bb-959b-4f36ec457bb6] Refreshing instance network info cache due to event network-changed-663b2fc9-e6a3-4d9a-81bc-484f78acc4dd. {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 23:37:06 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-eb57bf17-7dc4-415e-853f-2b640fce8418 req-ea25e490-0142-4800-9e21-f8b18c5b7e56 service nova] Acquiring lock "refresh_cache-b4c0930f-4309-43bb-959b-4f36ec457bb6" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 23:37:06 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-eb57bf17-7dc4-415e-853f-2b640fce8418 req-ea25e490-0142-4800-9e21-f8b18c5b7e56 service nova] Acquired lock "refresh_cache-b4c0930f-4309-43bb-959b-4f36ec457bb6" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 23:37:06 user nova-compute[75045]: DEBUG nova.network.neutron [req-eb57bf17-7dc4-415e-853f-2b640fce8418 req-ea25e490-0142-4800-9e21-f8b18c5b7e56 service nova] [instance: b4c0930f-4309-43bb-959b-4f36ec457bb6] Refreshing network info cache for port 663b2fc9-e6a3-4d9a-81bc-484f78acc4dd {{(pid=75045) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 23:37:06 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-e29d9391-65e2-4aff-941f-955367ee9a78 tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] Acquiring lock "b4c0930f-4309-43bb-959b-4f36ec457bb6" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:37:06 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-e29d9391-65e2-4aff-941f-955367ee9a78 tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] Lock "b4c0930f-4309-43bb-959b-4f36ec457bb6" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:37:06 user nova-compute[75045]: DEBUG nova.objects.instance [None req-e29d9391-65e2-4aff-941f-955367ee9a78 tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] Lazy-loading 'flavor' on Instance uuid b4c0930f-4309-43bb-959b-4f36ec457bb6 {{(pid=75045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 23:37:06 user nova-compute[75045]: INFO nova.virt.libvirt.driver [None req-e29d9391-65e2-4aff-941f-955367ee9a78 tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] [instance: b4c0930f-4309-43bb-959b-4f36ec457bb6] Ignoring supplied device name: /dev/vdb
Nov 08 23:37:06 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-e29d9391-65e2-4aff-941f-955367ee9a78 tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] Lock "b4c0930f-4309-43bb-959b-4f36ec457bb6" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.059s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:37:07 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-e29d9391-65e2-4aff-941f-955367ee9a78 tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] Acquiring lock "b4c0930f-4309-43bb-959b-4f36ec457bb6" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:37:07 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-e29d9391-65e2-4aff-941f-955367ee9a78 tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] Lock "b4c0930f-4309-43bb-959b-4f36ec457bb6" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:37:07 user nova-compute[75045]: INFO nova.compute.manager [None req-e29d9391-65e2-4aff-941f-955367ee9a78 tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] [instance: b4c0930f-4309-43bb-959b-4f36ec457bb6] Attaching volume 3f065c57-b67d-415e-9b6a-77d213104733 to /dev/vdb
Nov 08 23:37:07 user nova-compute[75045]: DEBUG nova.network.neutron [req-eb57bf17-7dc4-415e-853f-2b640fce8418 req-ea25e490-0142-4800-9e21-f8b18c5b7e56 service nova] [instance: b4c0930f-4309-43bb-959b-4f36ec457bb6] Updated VIF entry in instance network info cache for port 663b2fc9-e6a3-4d9a-81bc-484f78acc4dd. {{(pid=75045) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 23:37:07 user nova-compute[75045]: DEBUG nova.network.neutron [req-eb57bf17-7dc4-415e-853f-2b640fce8418 req-ea25e490-0142-4800-9e21-f8b18c5b7e56 service nova] [instance: b4c0930f-4309-43bb-959b-4f36ec457bb6] Updating instance_info_cache with network_info: [{"id": "663b2fc9-e6a3-4d9a-81bc-484f78acc4dd", "address": "fa:16:3e:20:81:d8", "network": {"id": "ec929af3-f098-4338-943c-d13305d4d555", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-208938347-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.151", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f374e5f34c3464fb6f1f82f5d836c57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap663b2fc9-e6", "ovs_interfaceid": "663b2fc9-e6a3-4d9a-81bc-484f78acc4dd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75045) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 23:37:07 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-eb57bf17-7dc4-415e-853f-2b640fce8418 req-ea25e490-0142-4800-9e21-f8b18c5b7e56 service nova] Releasing lock "refresh_cache-b4c0930f-4309-43bb-959b-4f36ec457bb6" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 23:37:07 user nova-compute[75045]: DEBUG os_brick.utils [None req-e29d9391-65e2-4aff-941f-955367ee9a78 tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75045) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 23:37:07 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:37:07 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.020s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:37:07 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5d507dd-9e7e-467c-9c87-dece1a025872]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6217bd6e884\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:37:07 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:37:07 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:37:07 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fbc3aad-6ede-48ec-8e7f-5d7dd2143a2b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:37:07 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:37:07 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:37:07 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[20e8d92c-9a09-4471-a34d-49912998e007]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:37:07 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ee6dd34-92e8-4c8b-bbb0-ae32477fd97b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:37:07 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-e29d9391-65e2-4aff-941f-955367ee9a78 tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] Running cmd (subprocess): nvme version {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:37:07 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-e29d9391-65e2-4aff-941f-955367ee9a78 tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] 'nvme version' failed. Not Retrying. {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 23:37:07 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e29d9391-65e2-4aff-941f-955367ee9a78 tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] nvme not present on system {{(pid=75045) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 23:37:07 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:37:07 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 23:37:07 user nova-compute[75045]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 23:37:07 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1531871-2055-48a1-a826-d2ce50c0d3bc]: (4, '') {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:37:07 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.lightos [None req-e29d9391-65e2-4aff-941f-955367ee9a78 tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75045) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 23:37:07 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.lightos [None req-e29d9391-65e2-4aff-941f-955367ee9a78 tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75045) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 23:37:07 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.lightos [None req-e29d9391-65e2-4aff-941f-955367ee9a78 tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] LIGHTOS: no hostnqn found. {{(pid=75045) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 23:37:07 user nova-compute[75045]: DEBUG os_brick.utils [None req-e29d9391-65e2-4aff-941f-955367ee9a78 tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] <== get_connector_properties: return (137ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6217bd6e884', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75045) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 23:37:07 user nova-compute[75045]: DEBUG nova.virt.block_device [None req-e29d9391-65e2-4aff-941f-955367ee9a78 tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] [instance: b4c0930f-4309-43bb-959b-4f36ec457bb6] Updating existing volume attachment record: 07cffe5e-3aee-453c-95df-bb3dcc129eba {{(pid=75045) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 23:37:08 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:37:11 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:37:13 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:37:16 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:37:16 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:37:18 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:37:21 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:37:23 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:37:23 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:37:28 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:37:28 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:37:30 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:37:31 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:37:32 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-3f36b171-a164-4a89-994a-c4f37cc87731 tempest-ServersNegativeTestJSON-1185286380 tempest-ServersNegativeTestJSON-1185286380-project-member] Acquiring lock "244c4cc9-2837-40c9-b4ad-37dc435c9749" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:37:32 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-3f36b171-a164-4a89-994a-c4f37cc87731 tempest-ServersNegativeTestJSON-1185286380 tempest-ServersNegativeTestJSON-1185286380-project-member] Lock "244c4cc9-2837-40c9-b4ad-37dc435c9749" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:37:32 user nova-compute[75045]: DEBUG nova.compute.manager [None req-3f36b171-a164-4a89-994a-c4f37cc87731 tempest-ServersNegativeTestJSON-1185286380 tempest-ServersNegativeTestJSON-1185286380-project-member] [instance: 244c4cc9-2837-40c9-b4ad-37dc435c9749] Starting instance... {{(pid=75045) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 23:37:32 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-3f36b171-a164-4a89-994a-c4f37cc87731 tempest-ServersNegativeTestJSON-1185286380 tempest-ServersNegativeTestJSON-1185286380-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:37:32 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-3f36b171-a164-4a89-994a-c4f37cc87731 tempest-ServersNegativeTestJSON-1185286380 tempest-ServersNegativeTestJSON-1185286380-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:37:32 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-3f36b171-a164-4a89-994a-c4f37cc87731 tempest-ServersNegativeTestJSON-1185286380 tempest-ServersNegativeTestJSON-1185286380-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75045) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 23:37:32 user nova-compute[75045]: INFO nova.compute.claims [None req-3f36b171-a164-4a89-994a-c4f37cc87731 tempest-ServersNegativeTestJSON-1185286380 tempest-ServersNegativeTestJSON-1185286380-project-member] [instance: 244c4cc9-2837-40c9-b4ad-37dc435c9749] Claim successful on node user
Nov 08 23:37:32 user nova-compute[75045]: DEBUG nova.compute.provider_tree [None req-3f36b171-a164-4a89-994a-c4f37cc87731 tempest-ServersNegativeTestJSON-1185286380 tempest-ServersNegativeTestJSON-1185286380-project-member] Inventory has not changed in ProviderTree for provider: 62ba5f85-c74d-4b58-986e-d4197e813fd7 {{(pid=75045) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 23:37:32 user nova-compute[75045]: DEBUG nova.scheduler.client.report [None req-3f36b171-a164-4a89-994a-c4f37cc87731 tempest-ServersNegativeTestJSON-1185286380 tempest-ServersNegativeTestJSON-1185286380-project-member] Inventory has not changed for provider 62ba5f85-c74d-4b58-986e-d4197e813fd7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75045) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 23:37:32 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-3f36b171-a164-4a89-994a-c4f37cc87731 tempest-ServersNegativeTestJSON-1185286380 tempest-ServersNegativeTestJSON-1185286380-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.350s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:37:32 user nova-compute[75045]: DEBUG nova.compute.manager [None req-3f36b171-a164-4a89-994a-c4f37cc87731 tempest-ServersNegativeTestJSON-1185286380 tempest-ServersNegativeTestJSON-1185286380-project-member] [instance: 244c4cc9-2837-40c9-b4ad-37dc435c9749] Start building networks asynchronously for instance. {{(pid=75045) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 23:37:32 user nova-compute[75045]: DEBUG nova.compute.manager [None req-3f36b171-a164-4a89-994a-c4f37cc87731 tempest-ServersNegativeTestJSON-1185286380 tempest-ServersNegativeTestJSON-1185286380-project-member] [instance: 244c4cc9-2837-40c9-b4ad-37dc435c9749] Allocating IP information in the background. {{(pid=75045) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 23:37:32 user nova-compute[75045]: DEBUG nova.network.neutron [None req-3f36b171-a164-4a89-994a-c4f37cc87731 tempest-ServersNegativeTestJSON-1185286380 tempest-ServersNegativeTestJSON-1185286380-project-member] [instance: 244c4cc9-2837-40c9-b4ad-37dc435c9749] allocate_for_instance() {{(pid=75045) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 23:37:32 user nova-compute[75045]: INFO nova.virt.libvirt.driver [None req-3f36b171-a164-4a89-994a-c4f37cc87731 tempest-ServersNegativeTestJSON-1185286380 tempest-ServersNegativeTestJSON-1185286380-project-member] [instance: 244c4cc9-2837-40c9-b4ad-37dc435c9749] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 23:37:32 user nova-compute[75045]: DEBUG nova.compute.manager [None req-3f36b171-a164-4a89-994a-c4f37cc87731 tempest-ServersNegativeTestJSON-1185286380 tempest-ServersNegativeTestJSON-1185286380-project-member] [instance: 244c4cc9-2837-40c9-b4ad-37dc435c9749] Start building block device mappings for instance. {{(pid=75045) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 23:37:32 user nova-compute[75045]: DEBUG nova.policy [None req-3f36b171-a164-4a89-994a-c4f37cc87731 tempest-ServersNegativeTestJSON-1185286380 tempest-ServersNegativeTestJSON-1185286380-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '43c4b404522b424b8e23b2b5687a7821', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61c8f99e9d284b51bbf7bbf6bdfb8662', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75045) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 23:37:32 user nova-compute[75045]: DEBUG nova.compute.manager [None req-3f36b171-a164-4a89-994a-c4f37cc87731 tempest-ServersNegativeTestJSON-1185286380 tempest-ServersNegativeTestJSON-1185286380-project-member] [instance: 244c4cc9-2837-40c9-b4ad-37dc435c9749] Start spawning the instance on the hypervisor. {{(pid=75045) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 23:37:32 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-3f36b171-a164-4a89-994a-c4f37cc87731 tempest-ServersNegativeTestJSON-1185286380 tempest-ServersNegativeTestJSON-1185286380-project-member] [instance: 244c4cc9-2837-40c9-b4ad-37dc435c9749] Creating instance directory {{(pid=75045) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 23:37:32 user nova-compute[75045]: INFO nova.virt.libvirt.driver [None req-3f36b171-a164-4a89-994a-c4f37cc87731 tempest-ServersNegativeTestJSON-1185286380 tempest-ServersNegativeTestJSON-1185286380-project-member] [instance: 244c4cc9-2837-40c9-b4ad-37dc435c9749] Creating image(s)
Nov 08 23:37:32 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-3f36b171-a164-4a89-994a-c4f37cc87731 tempest-ServersNegativeTestJSON-1185286380 tempest-ServersNegativeTestJSON-1185286380-project-member] Acquiring lock "/opt/stack/data/nova/instances/244c4cc9-2837-40c9-b4ad-37dc435c9749/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:37:32 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-3f36b171-a164-4a89-994a-c4f37cc87731 tempest-ServersNegativeTestJSON-1185286380 tempest-ServersNegativeTestJSON-1185286380-project-member] Lock "/opt/stack/data/nova/instances/244c4cc9-2837-40c9-b4ad-37dc435c9749/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:37:32 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-3f36b171-a164-4a89-994a-c4f37cc87731 tempest-ServersNegativeTestJSON-1185286380 tempest-ServersNegativeTestJSON-1185286380-project-member] Lock "/opt/stack/data/nova/instances/244c4cc9-2837-40c9-b4ad-37dc435c9749/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:37:32 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-3f36b171-a164-4a89-994a-c4f37cc87731 tempest-ServersNegativeTestJSON-1185286380 tempest-ServersNegativeTestJSON-1185286380-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b59f52a99fff51c56dd1edfb83892fb8f647f2f3 --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:37:33 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-3f36b171-a164-4a89-994a-c4f37cc87731 tempest-ServersNegativeTestJSON-1185286380 tempest-ServersNegativeTestJSON-1185286380-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b59f52a99fff51c56dd1edfb83892fb8f647f2f3 --force-share --output=json" returned: 0 in 0.192s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:37:33 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-3f36b171-a164-4a89-994a-c4f37cc87731 tempest-ServersNegativeTestJSON-1185286380 tempest-ServersNegativeTestJSON-1185286380-project-member] Acquiring lock "b59f52a99fff51c56dd1edfb83892fb8f647f2f3" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:37:33 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-3f36b171-a164-4a89-994a-c4f37cc87731 tempest-ServersNegativeTestJSON-1185286380 tempest-ServersNegativeTestJSON-1185286380-project-member] Lock "b59f52a99fff51c56dd1edfb83892fb8f647f2f3" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:37:33 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-3f36b171-a164-4a89-994a-c4f37cc87731 tempest-ServersNegativeTestJSON-1185286380 tempest-ServersNegativeTestJSON-1185286380-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b59f52a99fff51c56dd1edfb83892fb8f647f2f3 --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:37:33 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:37:33 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-3f36b171-a164-4a89-994a-c4f37cc87731 tempest-ServersNegativeTestJSON-1185286380 tempest-ServersNegativeTestJSON-1185286380-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b59f52a99fff51c56dd1edfb83892fb8f647f2f3 --force-share --output=json" returned: 0 in 0.190s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:37:33 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-3f36b171-a164-4a89-994a-c4f37cc87731 tempest-ServersNegativeTestJSON-1185286380 tempest-ServersNegativeTestJSON-1185286380-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b59f52a99fff51c56dd1edfb83892fb8f647f2f3,backing_fmt=raw /opt/stack/data/nova/instances/244c4cc9-2837-40c9-b4ad-37dc435c9749/disk 1073741824 {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:37:33 user nova-compute[75045]: DEBUG nova.network.neutron [None req-3f36b171-a164-4a89-994a-c4f37cc87731 tempest-ServersNegativeTestJSON-1185286380 tempest-ServersNegativeTestJSON-1185286380-project-member] [instance: 244c4cc9-2837-40c9-b4ad-37dc435c9749] Successfully created port: a5a35e2b-77b5-4f76-a70a-0088652c0420 {{(pid=75045) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 23:37:33 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-3f36b171-a164-4a89-994a-c4f37cc87731 tempest-ServersNegativeTestJSON-1185286380 tempest-ServersNegativeTestJSON-1185286380-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b59f52a99fff51c56dd1edfb83892fb8f647f2f3,backing_fmt=raw /opt/stack/data/nova/instances/244c4cc9-2837-40c9-b4ad-37dc435c9749/disk 1073741824" returned: 0 in 0.050s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:37:33 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-3f36b171-a164-4a89-994a-c4f37cc87731 tempest-ServersNegativeTestJSON-1185286380 tempest-ServersNegativeTestJSON-1185286380-project-member] Lock "b59f52a99fff51c56dd1edfb83892fb8f647f2f3" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.244s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:37:33 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-3f36b171-a164-4a89-994a-c4f37cc87731 tempest-ServersNegativeTestJSON-1185286380 tempest-ServersNegativeTestJSON-1185286380-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b59f52a99fff51c56dd1edfb83892fb8f647f2f3 --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:37:33 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-3f36b171-a164-4a89-994a-c4f37cc87731 tempest-ServersNegativeTestJSON-1185286380 tempest-ServersNegativeTestJSON-1185286380-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b59f52a99fff51c56dd1edfb83892fb8f647f2f3 --force-share --output=json" returned: 0 in 0.199s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:37:33 user nova-compute[75045]: DEBUG nova.virt.disk.api [None req-3f36b171-a164-4a89-994a-c4f37cc87731 tempest-ServersNegativeTestJSON-1185286380 tempest-ServersNegativeTestJSON-1185286380-project-member] Checking if we can resize image /opt/stack/data/nova/instances/244c4cc9-2837-40c9-b4ad-37dc435c9749/disk. size=1073741824 {{(pid=75045) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 23:37:33 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-3f36b171-a164-4a89-994a-c4f37cc87731 tempest-ServersNegativeTestJSON-1185286380 tempest-ServersNegativeTestJSON-1185286380-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/244c4cc9-2837-40c9-b4ad-37dc435c9749/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:37:33 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-3f36b171-a164-4a89-994a-c4f37cc87731 tempest-ServersNegativeTestJSON-1185286380 tempest-ServersNegativeTestJSON-1185286380-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/244c4cc9-2837-40c9-b4ad-37dc435c9749/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:37:33 user nova-compute[75045]: DEBUG nova.virt.disk.api [None req-3f36b171-a164-4a89-994a-c4f37cc87731 tempest-ServersNegativeTestJSON-1185286380 tempest-ServersNegativeTestJSON-1185286380-project-member] Cannot resize image /opt/stack/data/nova/instances/244c4cc9-2837-40c9-b4ad-37dc435c9749/disk to a smaller size. {{(pid=75045) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 08 23:37:33 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-3f36b171-a164-4a89-994a-c4f37cc87731 tempest-ServersNegativeTestJSON-1185286380 tempest-ServersNegativeTestJSON-1185286380-project-member] [instance: 244c4cc9-2837-40c9-b4ad-37dc435c9749] Created local disks {{(pid=75045) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 23:37:33 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-3f36b171-a164-4a89-994a-c4f37cc87731 tempest-ServersNegativeTestJSON-1185286380 tempest-ServersNegativeTestJSON-1185286380-project-member] [instance: 244c4cc9-2837-40c9-b4ad-37dc435c9749] Ensure instance console log exists: /opt/stack/data/nova/instances/244c4cc9-2837-40c9-b4ad-37dc435c9749/console.log {{(pid=75045) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 23:37:33 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-3f36b171-a164-4a89-994a-c4f37cc87731 tempest-ServersNegativeTestJSON-1185286380 tempest-ServersNegativeTestJSON-1185286380-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:37:33 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-3f36b171-a164-4a89-994a-c4f37cc87731 tempest-ServersNegativeTestJSON-1185286380 tempest-ServersNegativeTestJSON-1185286380-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:37:33 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-3f36b171-a164-4a89-994a-c4f37cc87731 tempest-ServersNegativeTestJSON-1185286380 tempest-ServersNegativeTestJSON-1185286380-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:37:34 user nova-compute[75045]: DEBUG nova.network.neutron [None req-3f36b171-a164-4a89-994a-c4f37cc87731 tempest-ServersNegativeTestJSON-1185286380 tempest-ServersNegativeTestJSON-1185286380-project-member] [instance: 244c4cc9-2837-40c9-b4ad-37dc435c9749] Successfully updated port: a5a35e2b-77b5-4f76-a70a-0088652c0420 {{(pid=75045) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 23:37:34 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-3f36b171-a164-4a89-994a-c4f37cc87731 tempest-ServersNegativeTestJSON-1185286380 tempest-ServersNegativeTestJSON-1185286380-project-member] Acquiring lock "refresh_cache-244c4cc9-2837-40c9-b4ad-37dc435c9749" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 23:37:34 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-3f36b171-a164-4a89-994a-c4f37cc87731 tempest-ServersNegativeTestJSON-1185286380 tempest-ServersNegativeTestJSON-1185286380-project-member] Acquired lock "refresh_cache-244c4cc9-2837-40c9-b4ad-37dc435c9749" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 23:37:34 user nova-compute[75045]: DEBUG nova.network.neutron [None req-3f36b171-a164-4a89-994a-c4f37cc87731 tempest-ServersNegativeTestJSON-1185286380 tempest-ServersNegativeTestJSON-1185286380-project-member] [instance: 244c4cc9-2837-40c9-b4ad-37dc435c9749] Building network info cache for instance {{(pid=75045) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 23:37:34 user nova-compute[75045]: DEBUG nova.compute.manager [req-4ec6c2c8-b78f-424c-af74-6c7f06933512 req-e7cb3b0a-6cd4-4311-af79-118d7b13ca53 service nova] [instance: 244c4cc9-2837-40c9-b4ad-37dc435c9749] Received event network-changed-a5a35e2b-77b5-4f76-a70a-0088652c0420 {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:37:34 user nova-compute[75045]: DEBUG nova.compute.manager [req-4ec6c2c8-b78f-424c-af74-6c7f06933512 req-e7cb3b0a-6cd4-4311-af79-118d7b13ca53 service nova] [instance: 244c4cc9-2837-40c9-b4ad-37dc435c9749] Refreshing instance network info cache due to event network-changed-a5a35e2b-77b5-4f76-a70a-0088652c0420. {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 23:37:34 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-4ec6c2c8-b78f-424c-af74-6c7f06933512 req-e7cb3b0a-6cd4-4311-af79-118d7b13ca53 service nova] Acquiring lock "refresh_cache-244c4cc9-2837-40c9-b4ad-37dc435c9749" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 23:37:34 user nova-compute[75045]: DEBUG nova.network.neutron [None req-3f36b171-a164-4a89-994a-c4f37cc87731 tempest-ServersNegativeTestJSON-1185286380 tempest-ServersNegativeTestJSON-1185286380-project-member] [instance: 244c4cc9-2837-40c9-b4ad-37dc435c9749] Instance cache missing network info. {{(pid=75045) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 23:37:34 user nova-compute[75045]: DEBUG nova.network.neutron [None req-3f36b171-a164-4a89-994a-c4f37cc87731 tempest-ServersNegativeTestJSON-1185286380 tempest-ServersNegativeTestJSON-1185286380-project-member] [instance: 244c4cc9-2837-40c9-b4ad-37dc435c9749] Updating instance_info_cache with network_info: [{"id": "a5a35e2b-77b5-4f76-a70a-0088652c0420", "address": "fa:16:3e:9f:19:4e", "network": {"id": "eac8b567-0d31-42ec-b05d-2ca251612286", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1889897935-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "61c8f99e9d284b51bbf7bbf6bdfb8662", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5a35e2b-77", "ovs_interfaceid": "a5a35e2b-77b5-4f76-a70a-0088652c0420", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75045) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 23:37:34 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-3f36b171-a164-4a89-994a-c4f37cc87731 tempest-ServersNegativeTestJSON-1185286380 tempest-ServersNegativeTestJSON-1185286380-project-member] Releasing lock "refresh_cache-244c4cc9-2837-40c9-b4ad-37dc435c9749" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 23:37:34 user nova-compute[75045]: DEBUG nova.compute.manager [None req-3f36b171-a164-4a89-994a-c4f37cc87731 tempest-ServersNegativeTestJSON-1185286380 tempest-ServersNegativeTestJSON-1185286380-project-member] [instance: 244c4cc9-2837-40c9-b4ad-37dc435c9749] Instance network_info: |[{"id": "a5a35e2b-77b5-4f76-a70a-0088652c0420", "address": "fa:16:3e:9f:19:4e", "network": {"id": "eac8b567-0d31-42ec-b05d-2ca251612286", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1889897935-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "61c8f99e9d284b51bbf7bbf6bdfb8662", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5a35e2b-77", "ovs_interfaceid": "a5a35e2b-77b5-4f76-a70a-0088652c0420", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75045) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 23:37:34 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-4ec6c2c8-b78f-424c-af74-6c7f06933512 req-e7cb3b0a-6cd4-4311-af79-118d7b13ca53 service nova] Acquired lock "refresh_cache-244c4cc9-2837-40c9-b4ad-37dc435c9749" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 23:37:34 user nova-compute[75045]: DEBUG nova.network.neutron [req-4ec6c2c8-b78f-424c-af74-6c7f06933512 req-e7cb3b0a-6cd4-4311-af79-118d7b13ca53 service nova] [instance: 244c4cc9-2837-40c9-b4ad-37dc435c9749] Refreshing network info cache for port a5a35e2b-77b5-4f76-a70a-0088652c0420 {{(pid=75045) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 23:37:34 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-3f36b171-a164-4a89-994a-c4f37cc87731 tempest-ServersNegativeTestJSON-1185286380 tempest-ServersNegativeTestJSON-1185286380-project-member] [instance: 244c4cc9-2837-40c9-b4ad-37dc435c9749] Start _get_guest_xml network_info=[{"id": "a5a35e2b-77b5-4f76-a70a-0088652c0420", "address": "fa:16:3e:9f:19:4e", "network": {"id": "eac8b567-0d31-42ec-b05d-2ca251612286", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1889897935-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "61c8f99e9d284b51bbf7bbf6bdfb8662", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5a35e2b-77", "ovs_interfaceid": "a5a35e2b-77b5-4f76-a70a-0088652c0420", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T23:11:54Z,direct_url=<?>,disk_format='qcow2',id=a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b1beba2cc4e7465ea249e2225fb494dc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T23:11:56Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'disk_bus': 'virtio', 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': 'a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75045) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 23:37:34 user nova-compute[75045]: WARNING nova.virt.libvirt.driver [None req-3f36b171-a164-4a89-994a-c4f37cc87731 tempest-ServersNegativeTestJSON-1185286380 tempest-ServersNegativeTestJSON-1185286380-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 23:37:34 user nova-compute[75045]: WARNING nova.virt.libvirt.driver [None req-3f36b171-a164-4a89-994a-c4f37cc87731 tempest-ServersNegativeTestJSON-1185286380 tempest-ServersNegativeTestJSON-1185286380-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 23:37:34 user nova-compute[75045]: DEBUG nova.virt.libvirt.host [None req-3f36b171-a164-4a89-994a-c4f37cc87731 tempest-ServersNegativeTestJSON-1185286380 tempest-ServersNegativeTestJSON-1185286380-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75045) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 23:37:34 user nova-compute[75045]: DEBUG nova.virt.libvirt.host [None req-3f36b171-a164-4a89-994a-c4f37cc87731 tempest-ServersNegativeTestJSON-1185286380 tempest-ServersNegativeTestJSON-1185286380-project-member] CPU controller missing on host. {{(pid=75045) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 23:37:34 user nova-compute[75045]: DEBUG nova.virt.libvirt.host [None req-3f36b171-a164-4a89-994a-c4f37cc87731 tempest-ServersNegativeTestJSON-1185286380 tempest-ServersNegativeTestJSON-1185286380-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75045) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 23:37:34 user nova-compute[75045]: DEBUG nova.virt.libvirt.host [None req-3f36b171-a164-4a89-994a-c4f37cc87731 tempest-ServersNegativeTestJSON-1185286380 tempest-ServersNegativeTestJSON-1185286380-project-member] CPU controller found on host. {{(pid=75045) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 23:37:34 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-3f36b171-a164-4a89-994a-c4f37cc87731 tempest-ServersNegativeTestJSON-1185286380 tempest-ServersNegativeTestJSON-1185286380-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75045) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 23:37:34 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-3f36b171-a164-4a89-994a-c4f37cc87731 tempest-ServersNegativeTestJSON-1185286380 tempest-ServersNegativeTestJSON-1185286380-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T23:11:41Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T23:11:54Z,direct_url=<?>,disk_format='qcow2',id=a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b1beba2cc4e7465ea249e2225fb494dc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T23:11:56Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75045) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 23:37:34 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-3f36b171-a164-4a89-994a-c4f37cc87731 tempest-ServersNegativeTestJSON-1185286380 tempest-ServersNegativeTestJSON-1185286380-project-member] Flavor limits 0:0:0 {{(pid=75045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 23:37:34 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-3f36b171-a164-4a89-994a-c4f37cc87731 tempest-ServersNegativeTestJSON-1185286380 tempest-ServersNegativeTestJSON-1185286380-project-member] Image limits 0:0:0 {{(pid=75045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 23:37:34 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-3f36b171-a164-4a89-994a-c4f37cc87731 tempest-ServersNegativeTestJSON-1185286380 tempest-ServersNegativeTestJSON-1185286380-project-member] Flavor pref 0:0:0 {{(pid=75045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 23:37:34 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-3f36b171-a164-4a89-994a-c4f37cc87731 tempest-ServersNegativeTestJSON-1185286380 tempest-ServersNegativeTestJSON-1185286380-project-member] Image pref 0:0:0 {{(pid=75045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 23:37:34 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-3f36b171-a164-4a89-994a-c4f37cc87731 tempest-ServersNegativeTestJSON-1185286380 tempest-ServersNegativeTestJSON-1185286380-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 23:37:34 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-3f36b171-a164-4a89-994a-c4f37cc87731 tempest-ServersNegativeTestJSON-1185286380 tempest-ServersNegativeTestJSON-1185286380-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75045) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 23:37:34 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-3f36b171-a164-4a89-994a-c4f37cc87731 tempest-ServersNegativeTestJSON-1185286380 tempest-ServersNegativeTestJSON-1185286380-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75045) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 23:37:34 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-3f36b171-a164-4a89-994a-c4f37cc87731 tempest-ServersNegativeTestJSON-1185286380 tempest-ServersNegativeTestJSON-1185286380-project-member] Got 1 possible topologies {{(pid=75045) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 23:37:34 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-3f36b171-a164-4a89-994a-c4f37cc87731 tempest-ServersNegativeTestJSON-1185286380 tempest-ServersNegativeTestJSON-1185286380-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75045) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 23:37:34 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-3f36b171-a164-4a89-994a-c4f37cc87731 tempest-ServersNegativeTestJSON-1185286380 tempest-ServersNegativeTestJSON-1185286380-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75045) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 23:37:34 user nova-compute[75045]: DEBUG nova.virt.libvirt.vif [None req-3f36b171-a164-4a89-994a-c4f37cc87731 tempest-ServersNegativeTestJSON-1185286380 tempest-ServersNegativeTestJSON-1185286380-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T23:37:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1122899853',display_name='tempest-ServersNegativeTestJSON-server-1122899853',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1122899853',id=36,image_ref='a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='61c8f99e9d284b51bbf7bbf6bdfb8662',ramdisk_id='',reservation_id='r-qvqox6rw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1185286380',owner_user_name='tempest-ServersNegativeTestJSON-1185286380-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T23:37:33Z,user_data=None,user_id='43c4b404522b424b8e23b2b5687a7821',uuid=244c4cc9-2837-40c9-b4ad-37dc435c9749,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a5a35e2b-77b5-4f76-a70a-0088652c0420", "address": "fa:16:3e:9f:19:4e", "network": {"id": "eac8b567-0d31-42ec-b05d-2ca251612286", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1889897935-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "61c8f99e9d284b51bbf7bbf6bdfb8662", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5a35e2b-77", "ovs_interfaceid": "a5a35e2b-77b5-4f76-a70a-0088652c0420", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75045) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 23:37:34 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-3f36b171-a164-4a89-994a-c4f37cc87731 tempest-ServersNegativeTestJSON-1185286380 tempest-ServersNegativeTestJSON-1185286380-project-member] Converting VIF {"id": "a5a35e2b-77b5-4f76-a70a-0088652c0420", "address": "fa:16:3e:9f:19:4e", "network": {"id": "eac8b567-0d31-42ec-b05d-2ca251612286", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1889897935-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "61c8f99e9d284b51bbf7bbf6bdfb8662", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5a35e2b-77", "ovs_interfaceid": "a5a35e2b-77b5-4f76-a70a-0088652c0420", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 23:37:34 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-3f36b171-a164-4a89-994a-c4f37cc87731 tempest-ServersNegativeTestJSON-1185286380 tempest-ServersNegativeTestJSON-1185286380-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9f:19:4e,bridge_name='br-int',has_traffic_filtering=True,id=a5a35e2b-77b5-4f76-a70a-0088652c0420,network=Network(eac8b567-0d31-42ec-b05d-2ca251612286),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa5a35e2b-77') {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 23:37:34 user nova-compute[75045]: DEBUG nova.objects.instance [None req-3f36b171-a164-4a89-994a-c4f37cc87731 tempest-ServersNegativeTestJSON-1185286380 tempest-ServersNegativeTestJSON-1185286380-project-member] Lazy-loading 'pci_devices' on Instance uuid 244c4cc9-2837-40c9-b4ad-37dc435c9749 {{(pid=75045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 23:37:34 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-3f36b171-a164-4a89-994a-c4f37cc87731 tempest-ServersNegativeTestJSON-1185286380 tempest-ServersNegativeTestJSON-1185286380-project-member] [instance: 244c4cc9-2837-40c9-b4ad-37dc435c9749] End _get_guest_xml xml=<domain type="kvm">
Nov 08 23:37:34 user nova-compute[75045]:   <uuid>244c4cc9-2837-40c9-b4ad-37dc435c9749</uuid>
Nov 08 23:37:34 user nova-compute[75045]:   <name>instance-00000024</name>
Nov 08 23:37:34 user nova-compute[75045]:   <memory>524288</memory>
Nov 08 23:37:34 user nova-compute[75045]:   <vcpu>1</vcpu>
Nov 08 23:37:34 user nova-compute[75045]:   <metadata>
Nov 08 23:37:34 user nova-compute[75045]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 23:37:34 user nova-compute[75045]:       <nova:package version="0.0.0"/>
Nov 08 23:37:34 user nova-compute[75045]:       <nova:name>tempest-ServersNegativeTestJSON-server-1122899853</nova:name>
Nov 08 23:37:34 user nova-compute[75045]:       <nova:creationTime>2023-11-08 23:37:34</nova:creationTime>
Nov 08 23:37:34 user nova-compute[75045]:       <nova:flavor name="m1.tiny">
Nov 08 23:37:34 user nova-compute[75045]:         <nova:memory>512</nova:memory>
Nov 08 23:37:34 user nova-compute[75045]:         <nova:disk>1</nova:disk>
Nov 08 23:37:34 user nova-compute[75045]:         <nova:swap>0</nova:swap>
Nov 08 23:37:34 user nova-compute[75045]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 23:37:34 user nova-compute[75045]:         <nova:vcpus>1</nova:vcpus>
Nov 08 23:37:34 user nova-compute[75045]:       </nova:flavor>
Nov 08 23:37:34 user nova-compute[75045]:       <nova:owner>
Nov 08 23:37:34 user nova-compute[75045]:         <nova:user uuid="43c4b404522b424b8e23b2b5687a7821">tempest-ServersNegativeTestJSON-1185286380-project-member</nova:user>
Nov 08 23:37:34 user nova-compute[75045]:         <nova:project uuid="61c8f99e9d284b51bbf7bbf6bdfb8662">tempest-ServersNegativeTestJSON-1185286380</nova:project>
Nov 08 23:37:34 user nova-compute[75045]:       </nova:owner>
Nov 08 23:37:34 user nova-compute[75045]:       <nova:root type="image" uuid="a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb"/>
Nov 08 23:37:34 user nova-compute[75045]:       <nova:ports>
Nov 08 23:37:34 user nova-compute[75045]:         <nova:port uuid="a5a35e2b-77b5-4f76-a70a-0088652c0420">
Nov 08 23:37:34 user nova-compute[75045]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 08 23:37:34 user nova-compute[75045]:         </nova:port>
Nov 08 23:37:34 user nova-compute[75045]:       </nova:ports>
Nov 08 23:37:34 user nova-compute[75045]:     </nova:instance>
Nov 08 23:37:34 user nova-compute[75045]:   </metadata>
Nov 08 23:37:34 user nova-compute[75045]:   <sysinfo type="smbios">
Nov 08 23:37:34 user nova-compute[75045]:     <system>
Nov 08 23:37:34 user nova-compute[75045]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 23:37:34 user nova-compute[75045]:       <entry name="product">OpenStack Nova</entry>
Nov 08 23:37:34 user nova-compute[75045]:       <entry name="version">0.0.0</entry>
Nov 08 23:37:34 user nova-compute[75045]:       <entry name="serial">244c4cc9-2837-40c9-b4ad-37dc435c9749</entry>
Nov 08 23:37:34 user nova-compute[75045]:       <entry name="uuid">244c4cc9-2837-40c9-b4ad-37dc435c9749</entry>
Nov 08 23:37:34 user nova-compute[75045]:       <entry name="family">Virtual Machine</entry>
Nov 08 23:37:34 user nova-compute[75045]:     </system>
Nov 08 23:37:34 user nova-compute[75045]:   </sysinfo>
Nov 08 23:37:34 user nova-compute[75045]:   <os>
Nov 08 23:37:34 user nova-compute[75045]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 23:37:34 user nova-compute[75045]:     <boot dev="hd"/>
Nov 08 23:37:34 user nova-compute[75045]:     <smbios mode="sysinfo"/>
Nov 08 23:37:34 user nova-compute[75045]:   </os>
Nov 08 23:37:34 user nova-compute[75045]:   <features>
Nov 08 23:37:34 user nova-compute[75045]:     <acpi/>
Nov 08 23:37:34 user nova-compute[75045]:     <apic/>
Nov 08 23:37:34 user nova-compute[75045]:     <vmcoreinfo/>
Nov 08 23:37:34 user nova-compute[75045]:   </features>
Nov 08 23:37:34 user nova-compute[75045]:   <clock offset="utc">
Nov 08 23:37:34 user nova-compute[75045]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 23:37:34 user nova-compute[75045]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 23:37:34 user nova-compute[75045]:     <timer name="hpet" present="no"/>
Nov 08 23:37:34 user nova-compute[75045]:   </clock>
Nov 08 23:37:34 user nova-compute[75045]:   <cpu mode="custom" match="exact">
Nov 08 23:37:34 user nova-compute[75045]:     <model>Nehalem</model>
Nov 08 23:37:34 user nova-compute[75045]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 23:37:34 user nova-compute[75045]:   </cpu>
Nov 08 23:37:34 user nova-compute[75045]:   <devices>
Nov 08 23:37:34 user nova-compute[75045]:     <disk type="file" device="disk">
Nov 08 23:37:34 user nova-compute[75045]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 23:37:34 user nova-compute[75045]:       <source file="/opt/stack/data/nova/instances/244c4cc9-2837-40c9-b4ad-37dc435c9749/disk"/>
Nov 08 23:37:34 user nova-compute[75045]:       <target dev="vda" bus="virtio"/>
Nov 08 23:37:34 user nova-compute[75045]:     </disk>
Nov 08 23:37:34 user nova-compute[75045]:     <interface type="ethernet">
Nov 08 23:37:34 user nova-compute[75045]:       <mac address="fa:16:3e:9f:19:4e"/>
Nov 08 23:37:34 user nova-compute[75045]:       <model type="virtio"/>
Nov 08 23:37:34 user nova-compute[75045]:       <mtu size="1442"/>
Nov 08 23:37:34 user nova-compute[75045]:       <target dev="tapa5a35e2b-77"/>
Nov 08 23:37:34 user nova-compute[75045]:     </interface>
Nov 08 23:37:34 user nova-compute[75045]:     <serial type="pty">
Nov 08 23:37:34 user nova-compute[75045]:       <log file="/opt/stack/data/nova/instances/244c4cc9-2837-40c9-b4ad-37dc435c9749/console.log" append="off"/>
Nov 08 23:37:34 user nova-compute[75045]:     </serial>
Nov 08 23:37:34 user nova-compute[75045]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 23:37:34 user nova-compute[75045]:     <video>
Nov 08 23:37:34 user nova-compute[75045]:       <model type="virtio"/>
Nov 08 23:37:34 user nova-compute[75045]:     </video>
Nov 08 23:37:34 user nova-compute[75045]:     <rng model="virtio">
Nov 08 23:37:34 user nova-compute[75045]:       <backend model="random">/dev/urandom</backend>
Nov 08 23:37:34 user nova-compute[75045]:     </rng>
Nov 08 23:37:34 user nova-compute[75045]:     <controller type="usb" index="0" model="none"/>
Nov 08 23:37:34 user nova-compute[75045]:     <memballoon model="virtio">
Nov 08 23:37:34 user nova-compute[75045]:       <stats period="10"/>
Nov 08 23:37:34 user nova-compute[75045]:     </memballoon>
Nov 08 23:37:34 user nova-compute[75045]:   </devices>
Nov 08 23:37:34 user nova-compute[75045]: </domain>
Nov 08 23:37:34 user nova-compute[75045]:  {{(pid=75045) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 23:37:34 user nova-compute[75045]: DEBUG nova.virt.libvirt.vif [None req-3f36b171-a164-4a89-994a-c4f37cc87731 tempest-ServersNegativeTestJSON-1185286380 tempest-ServersNegativeTestJSON-1185286380-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T23:37:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1122899853',display_name='tempest-ServersNegativeTestJSON-server-1122899853',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1122899853',id=36,image_ref='a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='61c8f99e9d284b51bbf7bbf6bdfb8662',ramdisk_id='',reservation_id='r-qvqox6rw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1185286380',owner_user_name='tempest-ServersNegativeTestJSON-1185286380-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T23:37:33Z,user_data=None,user_id='43c4b404522b424b8e23b2b5687a7821',uuid=244c4cc9-2837-40c9-b4ad-37dc435c9749,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a5a35e2b-77b5-4f76-a70a-0088652c0420", "address": "fa:16:3e:9f:19:4e", "network": {"id": "eac8b567-0d31-42ec-b05d-2ca251612286", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1889897935-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "61c8f99e9d284b51bbf7bbf6bdfb8662", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5a35e2b-77", "ovs_interfaceid": "a5a35e2b-77b5-4f76-a70a-0088652c0420", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75045) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 23:37:34 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-3f36b171-a164-4a89-994a-c4f37cc87731 tempest-ServersNegativeTestJSON-1185286380 tempest-ServersNegativeTestJSON-1185286380-project-member] Converting VIF {"id": "a5a35e2b-77b5-4f76-a70a-0088652c0420", "address": "fa:16:3e:9f:19:4e", "network": {"id": "eac8b567-0d31-42ec-b05d-2ca251612286", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1889897935-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "61c8f99e9d284b51bbf7bbf6bdfb8662", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5a35e2b-77", "ovs_interfaceid": "a5a35e2b-77b5-4f76-a70a-0088652c0420", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 23:37:34 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-3f36b171-a164-4a89-994a-c4f37cc87731 tempest-ServersNegativeTestJSON-1185286380 tempest-ServersNegativeTestJSON-1185286380-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9f:19:4e,bridge_name='br-int',has_traffic_filtering=True,id=a5a35e2b-77b5-4f76-a70a-0088652c0420,network=Network(eac8b567-0d31-42ec-b05d-2ca251612286),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa5a35e2b-77') {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 23:37:34 user nova-compute[75045]: DEBUG os_vif [None req-3f36b171-a164-4a89-994a-c4f37cc87731 tempest-ServersNegativeTestJSON-1185286380 tempest-ServersNegativeTestJSON-1185286380-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9f:19:4e,bridge_name='br-int',has_traffic_filtering=True,id=a5a35e2b-77b5-4f76-a70a-0088652c0420,network=Network(eac8b567-0d31-42ec-b05d-2ca251612286),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa5a35e2b-77') {{(pid=75045) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 23:37:34 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:37:34 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:37:34 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 23:37:34 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:37:34 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '537a2a44-ff79-552f-a247-307edc069a3b', '_type': 'linux-noop'}}, row=False) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:37:34 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:37:34 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 23:37:34 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:37:34 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa5a35e2b-77, may_exist=True, interface_attrs={}) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:37:34 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa5a35e2b-77, col_values=(('qos', UUID('88bfd7d5-2720-4bc9-a1e1-ab2a11c6ffff')),), if_exists=True) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:37:34 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa5a35e2b-77, col_values=(('external_ids', {'iface-id': 'a5a35e2b-77b5-4f76-a70a-0088652c0420', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9f:19:4e', 'vm-uuid': '244c4cc9-2837-40c9-b4ad-37dc435c9749'}),), if_exists=True) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:37:34 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:37:34 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 23:37:34 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:37:34 user nova-compute[75045]: INFO os_vif [None req-3f36b171-a164-4a89-994a-c4f37cc87731 tempest-ServersNegativeTestJSON-1185286380 tempest-ServersNegativeTestJSON-1185286380-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9f:19:4e,bridge_name='br-int',has_traffic_filtering=True,id=a5a35e2b-77b5-4f76-a70a-0088652c0420,network=Network(eac8b567-0d31-42ec-b05d-2ca251612286),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa5a35e2b-77')
Nov 08 23:37:34 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-3f36b171-a164-4a89-994a-c4f37cc87731 tempest-ServersNegativeTestJSON-1185286380 tempest-ServersNegativeTestJSON-1185286380-project-member] No BDM found with device name vda, not building metadata. {{(pid=75045) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 23:37:34 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-3f36b171-a164-4a89-994a-c4f37cc87731 tempest-ServersNegativeTestJSON-1185286380 tempest-ServersNegativeTestJSON-1185286380-project-member] No VIF found with MAC fa:16:3e:9f:19:4e, not building metadata {{(pid=75045) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 23:37:34 user nova-compute[75045]: DEBUG nova.network.neutron [req-4ec6c2c8-b78f-424c-af74-6c7f06933512 req-e7cb3b0a-6cd4-4311-af79-118d7b13ca53 service nova] [instance: 244c4cc9-2837-40c9-b4ad-37dc435c9749] Updated VIF entry in instance network info cache for port a5a35e2b-77b5-4f76-a70a-0088652c0420. {{(pid=75045) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 23:37:34 user nova-compute[75045]: DEBUG nova.network.neutron [req-4ec6c2c8-b78f-424c-af74-6c7f06933512 req-e7cb3b0a-6cd4-4311-af79-118d7b13ca53 service nova] [instance: 244c4cc9-2837-40c9-b4ad-37dc435c9749] Updating instance_info_cache with network_info: [{"id": "a5a35e2b-77b5-4f76-a70a-0088652c0420", "address": "fa:16:3e:9f:19:4e", "network": {"id": "eac8b567-0d31-42ec-b05d-2ca251612286", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1889897935-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "61c8f99e9d284b51bbf7bbf6bdfb8662", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5a35e2b-77", "ovs_interfaceid": "a5a35e2b-77b5-4f76-a70a-0088652c0420", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75045) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 23:37:34 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-4ec6c2c8-b78f-424c-af74-6c7f06933512 req-e7cb3b0a-6cd4-4311-af79-118d7b13ca53 service nova] Releasing lock "refresh_cache-244c4cc9-2837-40c9-b4ad-37dc435c9749" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 23:37:35 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:37:36 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:37:36 user nova-compute[75045]: DEBUG nova.compute.manager [req-78e8ab5b-2d0d-4303-b200-afca99388922 req-5a412936-35d5-4df4-a423-5ce7eaec1ae5 service nova] [instance: 244c4cc9-2837-40c9-b4ad-37dc435c9749] Received event network-vif-plugged-a5a35e2b-77b5-4f76-a70a-0088652c0420 {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:37:36 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-78e8ab5b-2d0d-4303-b200-afca99388922 req-5a412936-35d5-4df4-a423-5ce7eaec1ae5 service nova] Acquiring lock "244c4cc9-2837-40c9-b4ad-37dc435c9749-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:37:36 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-78e8ab5b-2d0d-4303-b200-afca99388922 req-5a412936-35d5-4df4-a423-5ce7eaec1ae5 service nova] Lock "244c4cc9-2837-40c9-b4ad-37dc435c9749-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:37:36 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-78e8ab5b-2d0d-4303-b200-afca99388922 req-5a412936-35d5-4df4-a423-5ce7eaec1ae5 service nova] Lock "244c4cc9-2837-40c9-b4ad-37dc435c9749-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:37:36 user nova-compute[75045]: DEBUG nova.compute.manager [req-78e8ab5b-2d0d-4303-b200-afca99388922 req-5a412936-35d5-4df4-a423-5ce7eaec1ae5 service nova] [instance: 244c4cc9-2837-40c9-b4ad-37dc435c9749] No waiting events found dispatching network-vif-plugged-a5a35e2b-77b5-4f76-a70a-0088652c0420 {{(pid=75045) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 23:37:36 user nova-compute[75045]: WARNING nova.compute.manager [req-78e8ab5b-2d0d-4303-b200-afca99388922 req-5a412936-35d5-4df4-a423-5ce7eaec1ae5 service nova] [instance: 244c4cc9-2837-40c9-b4ad-37dc435c9749] Received unexpected event network-vif-plugged-a5a35e2b-77b5-4f76-a70a-0088652c0420 for instance with vm_state building and task_state spawning.
Nov 08 23:37:36 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:37:36 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:37:36 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:37:38 user nova-compute[75045]: DEBUG nova.compute.manager [None req-3f36b171-a164-4a89-994a-c4f37cc87731 tempest-ServersNegativeTestJSON-1185286380 tempest-ServersNegativeTestJSON-1185286380-project-member] [instance: 244c4cc9-2837-40c9-b4ad-37dc435c9749] Instance event wait completed in 0 seconds for  {{(pid=75045) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 23:37:38 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-3f36b171-a164-4a89-994a-c4f37cc87731 tempest-ServersNegativeTestJSON-1185286380 tempest-ServersNegativeTestJSON-1185286380-project-member] [instance: 244c4cc9-2837-40c9-b4ad-37dc435c9749] Guest created on hypervisor {{(pid=75045) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 23:37:38 user nova-compute[75045]: INFO nova.virt.libvirt.driver [-] [instance: 244c4cc9-2837-40c9-b4ad-37dc435c9749] Instance spawned successfully.
Nov 08 23:37:38 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-3f36b171-a164-4a89-994a-c4f37cc87731 tempest-ServersNegativeTestJSON-1185286380 tempest-ServersNegativeTestJSON-1185286380-project-member] [instance: 244c4cc9-2837-40c9-b4ad-37dc435c9749] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75045) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 23:37:38 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-3f36b171-a164-4a89-994a-c4f37cc87731 tempest-ServersNegativeTestJSON-1185286380 tempest-ServersNegativeTestJSON-1185286380-project-member] [instance: 244c4cc9-2837-40c9-b4ad-37dc435c9749] Found default for hw_cdrom_bus of ide {{(pid=75045) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 23:37:38 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-3f36b171-a164-4a89-994a-c4f37cc87731 tempest-ServersNegativeTestJSON-1185286380 tempest-ServersNegativeTestJSON-1185286380-project-member] [instance: 244c4cc9-2837-40c9-b4ad-37dc435c9749] Found default for hw_disk_bus of virtio {{(pid=75045) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 23:37:38 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-3f36b171-a164-4a89-994a-c4f37cc87731 tempest-ServersNegativeTestJSON-1185286380 tempest-ServersNegativeTestJSON-1185286380-project-member] [instance: 244c4cc9-2837-40c9-b4ad-37dc435c9749] Found default for hw_input_bus of None {{(pid=75045) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 23:37:38 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-3f36b171-a164-4a89-994a-c4f37cc87731 tempest-ServersNegativeTestJSON-1185286380 tempest-ServersNegativeTestJSON-1185286380-project-member] [instance: 244c4cc9-2837-40c9-b4ad-37dc435c9749] Found default for hw_pointer_model of None {{(pid=75045) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 23:37:38 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-3f36b171-a164-4a89-994a-c4f37cc87731 tempest-ServersNegativeTestJSON-1185286380 tempest-ServersNegativeTestJSON-1185286380-project-member] [instance: 244c4cc9-2837-40c9-b4ad-37dc435c9749] Found default for hw_video_model of virtio {{(pid=75045) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 23:37:38 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-3f36b171-a164-4a89-994a-c4f37cc87731 tempest-ServersNegativeTestJSON-1185286380 tempest-ServersNegativeTestJSON-1185286380-project-member] [instance: 244c4cc9-2837-40c9-b4ad-37dc435c9749] Found default for hw_vif_model of virtio {{(pid=75045) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 23:37:38 user nova-compute[75045]: INFO nova.compute.manager [None req-3f36b171-a164-4a89-994a-c4f37cc87731 tempest-ServersNegativeTestJSON-1185286380 tempest-ServersNegativeTestJSON-1185286380-project-member] [instance: 244c4cc9-2837-40c9-b4ad-37dc435c9749] Took 5.49 seconds to spawn the instance on the hypervisor.
Nov 08 23:37:38 user nova-compute[75045]: DEBUG nova.compute.manager [None req-3f36b171-a164-4a89-994a-c4f37cc87731 tempest-ServersNegativeTestJSON-1185286380 tempest-ServersNegativeTestJSON-1185286380-project-member] [instance: 244c4cc9-2837-40c9-b4ad-37dc435c9749] Checking state {{(pid=75045) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 23:37:38 user nova-compute[75045]: INFO nova.compute.manager [None req-3f36b171-a164-4a89-994a-c4f37cc87731 tempest-ServersNegativeTestJSON-1185286380 tempest-ServersNegativeTestJSON-1185286380-project-member] [instance: 244c4cc9-2837-40c9-b4ad-37dc435c9749] Took 6.20 seconds to build instance.
Nov 08 23:37:38 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-3f36b171-a164-4a89-994a-c4f37cc87731 tempest-ServersNegativeTestJSON-1185286380 tempest-ServersNegativeTestJSON-1185286380-project-member] Lock "244c4cc9-2837-40c9-b4ad-37dc435c9749" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.301s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:37:38 user nova-compute[75045]: DEBUG nova.compute.manager [req-f45c3a8d-7a72-4585-9554-8108a10530d3 req-6811ebc3-bc18-4068-bc95-a9ac7dfaca48 service nova] [instance: 244c4cc9-2837-40c9-b4ad-37dc435c9749] Received event network-vif-plugged-a5a35e2b-77b5-4f76-a70a-0088652c0420 {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:37:38 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-f45c3a8d-7a72-4585-9554-8108a10530d3 req-6811ebc3-bc18-4068-bc95-a9ac7dfaca48 service nova] Acquiring lock "244c4cc9-2837-40c9-b4ad-37dc435c9749-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:37:38 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-f45c3a8d-7a72-4585-9554-8108a10530d3 req-6811ebc3-bc18-4068-bc95-a9ac7dfaca48 service nova] Lock "244c4cc9-2837-40c9-b4ad-37dc435c9749-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:37:38 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-f45c3a8d-7a72-4585-9554-8108a10530d3 req-6811ebc3-bc18-4068-bc95-a9ac7dfaca48 service nova] Lock "244c4cc9-2837-40c9-b4ad-37dc435c9749-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:37:38 user nova-compute[75045]: DEBUG nova.compute.manager [req-f45c3a8d-7a72-4585-9554-8108a10530d3 req-6811ebc3-bc18-4068-bc95-a9ac7dfaca48 service nova] [instance: 244c4cc9-2837-40c9-b4ad-37dc435c9749] No waiting events found dispatching network-vif-plugged-a5a35e2b-77b5-4f76-a70a-0088652c0420 {{(pid=75045) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 23:37:38 user nova-compute[75045]: WARNING nova.compute.manager [req-f45c3a8d-7a72-4585-9554-8108a10530d3 req-6811ebc3-bc18-4068-bc95-a9ac7dfaca48 service nova] [instance: 244c4cc9-2837-40c9-b4ad-37dc435c9749] Received unexpected event network-vif-plugged-a5a35e2b-77b5-4f76-a70a-0088652c0420 for instance with vm_state active and task_state None.
Nov 08 23:37:39 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:37:41 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:37:42 user nova-compute[75045]: DEBUG nova.compute.manager [req-31ad9a64-8213-4ee6-9eeb-265dc2b7ec6b req-f023aad3-4f5e-4390-92ab-76111f8f4145 service nova] [instance: 9222e62a-9fd8-48b2-a125-83c9cdc589bd] Received event network-changed-5dae7844-411c-47aa-ba3e-bc209136f0a6 {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:37:42 user nova-compute[75045]: DEBUG nova.compute.manager [req-31ad9a64-8213-4ee6-9eeb-265dc2b7ec6b req-f023aad3-4f5e-4390-92ab-76111f8f4145 service nova] [instance: 9222e62a-9fd8-48b2-a125-83c9cdc589bd] Refreshing instance network info cache due to event network-changed-5dae7844-411c-47aa-ba3e-bc209136f0a6. {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 23:37:42 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-31ad9a64-8213-4ee6-9eeb-265dc2b7ec6b req-f023aad3-4f5e-4390-92ab-76111f8f4145 service nova] Acquiring lock "refresh_cache-9222e62a-9fd8-48b2-a125-83c9cdc589bd" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 23:37:42 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-31ad9a64-8213-4ee6-9eeb-265dc2b7ec6b req-f023aad3-4f5e-4390-92ab-76111f8f4145 service nova] Acquired lock "refresh_cache-9222e62a-9fd8-48b2-a125-83c9cdc589bd" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 23:37:42 user nova-compute[75045]: DEBUG nova.network.neutron [req-31ad9a64-8213-4ee6-9eeb-265dc2b7ec6b req-f023aad3-4f5e-4390-92ab-76111f8f4145 service nova] [instance: 9222e62a-9fd8-48b2-a125-83c9cdc589bd] Refreshing network info cache for port 5dae7844-411c-47aa-ba3e-bc209136f0a6 {{(pid=75045) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 23:37:42 user nova-compute[75045]: DEBUG nova.network.neutron [req-31ad9a64-8213-4ee6-9eeb-265dc2b7ec6b req-f023aad3-4f5e-4390-92ab-76111f8f4145 service nova] [instance: 9222e62a-9fd8-48b2-a125-83c9cdc589bd] Updated VIF entry in instance network info cache for port 5dae7844-411c-47aa-ba3e-bc209136f0a6. {{(pid=75045) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 23:37:42 user nova-compute[75045]: DEBUG nova.network.neutron [req-31ad9a64-8213-4ee6-9eeb-265dc2b7ec6b req-f023aad3-4f5e-4390-92ab-76111f8f4145 service nova] [instance: 9222e62a-9fd8-48b2-a125-83c9cdc589bd] Updating instance_info_cache with network_info: [{"id": "5dae7844-411c-47aa-ba3e-bc209136f0a6", "address": "fa:16:3e:a4:11:9a", "network": {"id": "08d1669a-f667-4c79-8e49-0ad183f57046", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1863648032-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.156", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bbb640407ef94f568aea892f1834d6d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5dae7844-41", "ovs_interfaceid": "5dae7844-411c-47aa-ba3e-bc209136f0a6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75045) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 23:37:42 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-47c35086-f020-4ac2-bb27-7ed07a65a655 tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] Acquiring lock "9222e62a-9fd8-48b2-a125-83c9cdc589bd" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:37:42 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-47c35086-f020-4ac2-bb27-7ed07a65a655 tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] Lock "9222e62a-9fd8-48b2-a125-83c9cdc589bd" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:37:42 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-31ad9a64-8213-4ee6-9eeb-265dc2b7ec6b req-f023aad3-4f5e-4390-92ab-76111f8f4145 service nova] Releasing lock "refresh_cache-9222e62a-9fd8-48b2-a125-83c9cdc589bd" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 23:37:42 user nova-compute[75045]: INFO nova.compute.manager [None req-47c35086-f020-4ac2-bb27-7ed07a65a655 tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] [instance: 9222e62a-9fd8-48b2-a125-83c9cdc589bd] Detaching volume 1b2a3b04-13be-4853-822c-29c416757252
Nov 08 23:37:42 user nova-compute[75045]: INFO nova.virt.block_device [None req-47c35086-f020-4ac2-bb27-7ed07a65a655 tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] [instance: 9222e62a-9fd8-48b2-a125-83c9cdc589bd] Attempting to driver detach volume 1b2a3b04-13be-4853-822c-29c416757252 from mountpoint /dev/vdb
Nov 08 23:37:42 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-47c35086-f020-4ac2-bb27-7ed07a65a655 tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] Attempting to detach device vdb from instance 9222e62a-9fd8-48b2-a125-83c9cdc589bd from the persistent domain config. {{(pid=75045) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 08 23:37:42 user nova-compute[75045]: DEBUG nova.virt.libvirt.guest [None req-47c35086-f020-4ac2-bb27-7ed07a65a655 tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 23:37:42 user nova-compute[75045]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 23:37:42 user nova-compute[75045]:   <source dev="/dev/sdb"/>
Nov 08 23:37:42 user nova-compute[75045]:   <target dev="vdb" bus="virtio"/>
Nov 08 23:37:42 user nova-compute[75045]:   <serial>1b2a3b04-13be-4853-822c-29c416757252</serial>
Nov 08 23:37:42 user nova-compute[75045]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 08 23:37:42 user nova-compute[75045]: </disk>
Nov 08 23:37:42 user nova-compute[75045]:  {{(pid=75045) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 23:37:42 user nova-compute[75045]: INFO nova.virt.libvirt.driver [None req-47c35086-f020-4ac2-bb27-7ed07a65a655 tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] Successfully detached device vdb from instance 9222e62a-9fd8-48b2-a125-83c9cdc589bd from the persistent domain config.
Nov 08 23:37:42 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-47c35086-f020-4ac2-bb27-7ed07a65a655 tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 9222e62a-9fd8-48b2-a125-83c9cdc589bd from the live domain config. {{(pid=75045) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 08 23:37:42 user nova-compute[75045]: DEBUG nova.virt.libvirt.guest [None req-47c35086-f020-4ac2-bb27-7ed07a65a655 tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 23:37:42 user nova-compute[75045]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 23:37:42 user nova-compute[75045]:   <source dev="/dev/sdb"/>
Nov 08 23:37:42 user nova-compute[75045]:   <target dev="vdb" bus="virtio"/>
Nov 08 23:37:42 user nova-compute[75045]:   <serial>1b2a3b04-13be-4853-822c-29c416757252</serial>
Nov 08 23:37:42 user nova-compute[75045]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 08 23:37:42 user nova-compute[75045]: </disk>
Nov 08 23:37:42 user nova-compute[75045]:  {{(pid=75045) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 23:37:43 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-47c35086-f020-4ac2-bb27-7ed07a65a655 tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 9222e62a-9fd8-48b2-a125-83c9cdc589bd {{(pid=75045) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 08 23:37:44 user nova-compute[75045]: DEBUG nova.compute.manager [req-b09e6692-4ca0-4873-9cfe-bf8cbb271036 req-5a712b9f-8acc-42b8-9e31-6a5394ac3e7e service nova] [instance: 9222e62a-9fd8-48b2-a125-83c9cdc589bd] Received event network-changed-5dae7844-411c-47aa-ba3e-bc209136f0a6 {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:37:44 user nova-compute[75045]: DEBUG nova.compute.manager [req-b09e6692-4ca0-4873-9cfe-bf8cbb271036 req-5a712b9f-8acc-42b8-9e31-6a5394ac3e7e service nova] [instance: 9222e62a-9fd8-48b2-a125-83c9cdc589bd] Refreshing instance network info cache due to event network-changed-5dae7844-411c-47aa-ba3e-bc209136f0a6. {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 23:37:44 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-b09e6692-4ca0-4873-9cfe-bf8cbb271036 req-5a712b9f-8acc-42b8-9e31-6a5394ac3e7e service nova] Acquiring lock "refresh_cache-9222e62a-9fd8-48b2-a125-83c9cdc589bd" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 23:37:44 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-b09e6692-4ca0-4873-9cfe-bf8cbb271036 req-5a712b9f-8acc-42b8-9e31-6a5394ac3e7e service nova] Acquired lock "refresh_cache-9222e62a-9fd8-48b2-a125-83c9cdc589bd" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 23:37:44 user nova-compute[75045]: DEBUG nova.network.neutron [req-b09e6692-4ca0-4873-9cfe-bf8cbb271036 req-5a712b9f-8acc-42b8-9e31-6a5394ac3e7e service nova] [instance: 9222e62a-9fd8-48b2-a125-83c9cdc589bd] Refreshing network info cache for port 5dae7844-411c-47aa-ba3e-bc209136f0a6 {{(pid=75045) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 23:37:44 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:37:44 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:37:45 user nova-compute[75045]: DEBUG nova.network.neutron [req-b09e6692-4ca0-4873-9cfe-bf8cbb271036 req-5a712b9f-8acc-42b8-9e31-6a5394ac3e7e service nova] [instance: 9222e62a-9fd8-48b2-a125-83c9cdc589bd] Updated VIF entry in instance network info cache for port 5dae7844-411c-47aa-ba3e-bc209136f0a6. {{(pid=75045) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 23:37:45 user nova-compute[75045]: DEBUG nova.network.neutron [req-b09e6692-4ca0-4873-9cfe-bf8cbb271036 req-5a712b9f-8acc-42b8-9e31-6a5394ac3e7e service nova] [instance: 9222e62a-9fd8-48b2-a125-83c9cdc589bd] Updating instance_info_cache with network_info: [{"id": "5dae7844-411c-47aa-ba3e-bc209136f0a6", "address": "fa:16:3e:a4:11:9a", "network": {"id": "08d1669a-f667-4c79-8e49-0ad183f57046", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1863648032-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.156", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bbb640407ef94f568aea892f1834d6d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5dae7844-41", "ovs_interfaceid": "5dae7844-411c-47aa-ba3e-bc209136f0a6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75045) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 23:37:45 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-b09e6692-4ca0-4873-9cfe-bf8cbb271036 req-5a712b9f-8acc-42b8-9e31-6a5394ac3e7e service nova] Releasing lock "refresh_cache-9222e62a-9fd8-48b2-a125-83c9cdc589bd" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 23:37:46 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:37:46 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:37:46 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:37:46 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:37:48 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:37:48 user nova-compute[75045]: DEBUG nova.compute.manager [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Starting heal instance info cache {{(pid=75045) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 23:37:49 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Acquiring lock "refresh_cache-adcffd35-00c7-49db-a72f-d6307a90e123" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 23:37:49 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Acquired lock "refresh_cache-adcffd35-00c7-49db-a72f-d6307a90e123" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 23:37:49 user nova-compute[75045]: DEBUG nova.network.neutron [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] [instance: adcffd35-00c7-49db-a72f-d6307a90e123] Forcefully refreshing network info cache for instance {{(pid=75045) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 23:37:49 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:37:49 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:37:49 user nova-compute[75045]: DEBUG nova.network.neutron [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] [instance: adcffd35-00c7-49db-a72f-d6307a90e123] Updating instance_info_cache with network_info: [{"id": "cbed987e-37ab-4cb9-b01a-ecad76d98f21", "address": "fa:16:3e:60:a2:7b", "network": {"id": "fe74884d-c24e-4be8-b45a-eb825b3563a3", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1344943603-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.6", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3343bcd412b54ef0bcfed8be47b0353a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbed987e-37", "ovs_interfaceid": "cbed987e-37ab-4cb9-b01a-ecad76d98f21", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75045) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 23:37:49 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Releasing lock "refresh_cache-adcffd35-00c7-49db-a72f-d6307a90e123" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 23:37:49 user nova-compute[75045]: DEBUG nova.compute.manager [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] [instance: adcffd35-00c7-49db-a72f-d6307a90e123] Updated the network info_cache for instance {{(pid=75045) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 23:37:49 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:37:49 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:37:49 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:37:49 user nova-compute[75045]: DEBUG nova.compute.manager [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75045) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 23:37:50 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:37:50 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:37:51 user nova-compute[75045]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e29d9391-65e2-4aff-941f-955367ee9a78 tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] [instance: b4c0930f-4309-43bb-959b-4f36ec457bb6] Calling os-brick to attach iSCSI Volume {{(pid=75045) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 23:37:51 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-e29d9391-65e2-4aff-941f-955367ee9a78 tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1b68210460>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3f065c57-b67d-415e-9b6a-77d213104733', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rwXRcekv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75045) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 23:37:51 user nova-compute[75045]: WARNING os_brick.initiator.connectors.base [None req-e29d9391-65e2-4aff-941f-955367ee9a78 tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 23:37:51 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-e29d9391-65e2-4aff-941f-955367ee9a78 tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 23:37:51 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-e29d9391-65e2-4aff-941f-955367ee9a78 tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 23:37:51 user nova-compute[75045]: WARNING os_brick.initiator.connectors.base [None req-e29d9391-65e2-4aff-941f-955367ee9a78 tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 23:37:51 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-e29d9391-65e2-4aff-941f-955367ee9a78 tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3f065c57-b67d-415e-9b6a-77d213104733" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 23:37:51 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-e29d9391-65e2-4aff-941f-955367ee9a78 tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3f065c57-b67d-415e-9b6a-77d213104733" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 23:37:51 user nova-compute[75045]: INFO os_brick.initiator.connectors.iscsi [None req-e29d9391-65e2-4aff-941f-955367ee9a78 tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 23:37:51 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f065c57-b67d-415e-9b6a-77d213104733 -p 172.16.0.220:3260 {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:37:51 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f065c57-b67d-415e-9b6a-77d213104733 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:37:51 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[09c41109-1d87-44bf-b85f-6335b8e403e8]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:37:51 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-e29d9391-65e2-4aff-941f-955367ee9a78 tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 23:37:51 user nova-compute[75045]:  {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:37:51 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f065c57-b67d-415e-9b6a-77d213104733 -p 172.16.0.220:3260 --interface default --op new {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:37:51 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f065c57-b67d-415e-9b6a-77d213104733 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:37:51 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[3651620c-4c49-475e-a9cd-bf74dbe5d282]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3f065c57-b67d-415e-9b6a-77d213104733] added\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:37:51 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-e29d9391-65e2-4aff-941f-955367ee9a78 tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3f065c57-b67d-415e-9b6a-77d213104733] added
Nov 08 23:37:51 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:37:51 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f065c57-b67d-415e-9b6a-77d213104733 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:37:51 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f065c57-b67d-415e-9b6a-77d213104733 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.031s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:37:51 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[c39b37b4-ec84-44cc-aa7e-c2878b6cc54c]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:37:51 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-e29d9391-65e2-4aff-941f-955367ee9a78 tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:37:51 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f065c57-b67d-415e-9b6a-77d213104733 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:37:51 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f065c57-b67d-415e-9b6a-77d213104733 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.032s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:37:51 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[99e792ab-16ba-4201-a659-013af3f0d6fe]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:37:51 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-e29d9391-65e2-4aff-941f-955367ee9a78 tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:37:51 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-0d869fc9-2c14-4784-aa11-87edd52b76c9 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:37:51 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-0d869fc9-2c14-4784-aa11-87edd52b76c9 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:37:51 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f065c57-b67d-415e-9b6a-77d213104733 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rwXRcekv {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:37:51 user nova-compute[75045]: DEBUG nova.objects.instance [None req-0d869fc9-2c14-4784-aa11-87edd52b76c9 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] Lazy-loading 'pci_requests' on Instance uuid 78955913-bbab-4b00-bc9b-12116f249d7e {{(pid=75045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 23:37:51 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f065c57-b67d-415e-9b6a-77d213104733 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rwXRcekv" returned: 0 in 0.022s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:37:51 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[4091fd85-3972-49de-b4d1-20cd8f2dd63c]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:37:51 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-e29d9391-65e2-4aff-941f-955367ee9a78 tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'rwXRcekv'): stdout= stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:37:51 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f065c57-b67d-415e-9b6a-77d213104733 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:37:51 user nova-compute[75045]: DEBUG nova.objects.instance [None req-0d869fc9-2c14-4784-aa11-87edd52b76c9 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] Lazy-loading 'numa_topology' on Instance uuid 78955913-bbab-4b00-bc9b-12116f249d7e {{(pid=75045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 23:37:51 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f065c57-b67d-415e-9b6a-77d213104733 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:37:51 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea6ef0e6-669c-4f04-990b-1b0efffb61fd]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:37:51 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-e29d9391-65e2-4aff-941f-955367ee9a78 tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:37:51 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:37:51 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-0d869fc9-2c14-4784-aa11-87edd52b76c9 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75045) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 23:37:51 user nova-compute[75045]: INFO nova.compute.claims [None req-0d869fc9-2c14-4784-aa11-87edd52b76c9 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] [instance: 78955913-bbab-4b00-bc9b-12116f249d7e] Claim successful on node user
Nov 08 23:37:51 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:37:51 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[9335b498-09c2-47bf-8c44-b8f769ce3cda]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b2a3b04-13be-4853-822c-29c416757252 (non-flash)\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:37:51 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-e29d9391-65e2-4aff-941f-955367ee9a78 tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b2a3b04-13be-4853-822c-29c416757252 (non-flash)
Nov 08 23:37:51 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 23:37:51 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-e29d9391-65e2-4aff-941f-955367ee9a78 tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b2a3b04-13be-4853-822c-29c416757252 (non-flash)
Nov 08 23:37:51 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 23:37:51 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f065c57-b67d-415e-9b6a-77d213104733 -p 172.16.0.220:3260 --login {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:37:51 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f065c57-b67d-415e-9b6a-77d213104733 -p 172.16.0.220:3260 --login" returned: 0 in 0.070s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:37:51 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e63533a-e4d5-41f9-ac03-612c49e85068]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3f065c57-b67d-415e-9b6a-77d213104733, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3f065c57-b67d-415e-9b6a-77d213104733, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:37:51 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-e29d9391-65e2-4aff-941f-955367ee9a78 tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3f065c57-b67d-415e-9b6a-77d213104733, portal: 172.16.0.220,3260]
Nov 08 23:37:51 user nova-compute[75045]: Login to [iface: default, target: iqn.2010-10.org.openstack:3f065c57-b67d-415e-9b6a-77d213104733, portal: 172.16.0.220,3260] successful.
Nov 08 23:37:51 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:37:51 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f065c57-b67d-415e-9b6a-77d213104733 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:37:51 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f065c57-b67d-415e-9b6a-77d213104733 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.173s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:37:51 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[b39b1b85-4e25-49a2-b76a-8663d6953559]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:37:51 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-e29d9391-65e2-4aff-941f-955367ee9a78 tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:37:51 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:37:51 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:37:51 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:37:51 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7d58bd6-5d43-46ba-b031-43bc2cbbce2a]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b2a3b04-13be-4853-822c-29c416757252 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f065c57-b67d-415e-9b6a-77d213104733 (non-flash)\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:37:51 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-e29d9391-65e2-4aff-941f-955367ee9a78 tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b2a3b04-13be-4853-822c-29c416757252 (non-flash)
Nov 08 23:37:51 user nova-compute[75045]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f065c57-b67d-415e-9b6a-77d213104733 (non-flash)
Nov 08 23:37:51 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 23:37:51 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-e29d9391-65e2-4aff-941f-955367ee9a78 tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b2a3b04-13be-4853-822c-29c416757252 (non-flash)
Nov 08 23:37:51 user nova-compute[75045]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f065c57-b67d-415e-9b6a-77d213104733 (non-flash)
Nov 08 23:37:51 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 23:37:51 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-e29d9391-65e2-4aff-941f-955367ee9a78 tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3f065c57-b67d-415e-9b6a-77d213104733" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.495s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 23:37:51 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-e29d9391-65e2-4aff-941f-955367ee9a78 tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] Connected to 172.16.0.220:3260 {{(pid=75045) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 23:37:51 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-e29d9391-65e2-4aff-941f-955367ee9a78 tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] HCTL ('34', '-', '-', 0) found on session 38 with lun 0 {{(pid=75045) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 23:37:51 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-e29d9391-65e2-4aff-941f-955367ee9a78 tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75045) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 23:37:51 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:37:51 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:37:51 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[73325587-3aa0-4fd5-b29f-f98d7baae7bc]: (4, ('- - 0', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:37:51 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-e29d9391-65e2-4aff-941f-955367ee9a78 tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] Searching for a device in session 38 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75045) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 23:37:51 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-e29d9391-65e2-4aff-941f-955367ee9a78 tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:3f065c57-b67d-415e-9b6a-77d213104733', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rwXRcekv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75045) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 23:37:51 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:37:51 user nova-compute[75045]: DEBUG nova.compute.provider_tree [None req-0d869fc9-2c14-4784-aa11-87edd52b76c9 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] Inventory has not changed in ProviderTree for provider: 62ba5f85-c74d-4b58-986e-d4197e813fd7 {{(pid=75045) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 23:37:51 user nova-compute[75045]: DEBUG nova.scheduler.client.report [None req-0d869fc9-2c14-4784-aa11-87edd52b76c9 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] Inventory has not changed for provider 62ba5f85-c74d-4b58-986e-d4197e813fd7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75045) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 23:37:51 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-3a27b56d-1bb5-4cfa-938e-eb57edf0d03d tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] Acquiring lock "adcffd35-00c7-49db-a72f-d6307a90e123" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:37:51 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-3a27b56d-1bb5-4cfa-938e-eb57edf0d03d tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] Lock "adcffd35-00c7-49db-a72f-d6307a90e123" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:37:52 user nova-compute[75045]: DEBUG nova.objects.instance [None req-3a27b56d-1bb5-4cfa-938e-eb57edf0d03d tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] Lazy-loading 'flavor' on Instance uuid adcffd35-00c7-49db-a72f-d6307a90e123 {{(pid=75045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 23:37:52 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-0d869fc9-2c14-4784-aa11-87edd52b76c9 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.758s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:37:52 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-3a27b56d-1bb5-4cfa-938e-eb57edf0d03d tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] Lock "adcffd35-00c7-49db-a72f-d6307a90e123" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.159s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:37:52 user nova-compute[75045]: INFO nova.network.neutron [None req-0d869fc9-2c14-4784-aa11-87edd52b76c9 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] [instance: 78955913-bbab-4b00-bc9b-12116f249d7e] Updating port fc66a792-914f-48c4-ae57-cbda1615ff0b with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Nov 08 23:37:52 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-3a27b56d-1bb5-4cfa-938e-eb57edf0d03d tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] Acquiring lock "adcffd35-00c7-49db-a72f-d6307a90e123" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:37:52 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-3a27b56d-1bb5-4cfa-938e-eb57edf0d03d tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] Lock "adcffd35-00c7-49db-a72f-d6307a90e123" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:37:52 user nova-compute[75045]: INFO nova.compute.manager [None req-3a27b56d-1bb5-4cfa-938e-eb57edf0d03d tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] [instance: adcffd35-00c7-49db-a72f-d6307a90e123] Attaching volume 80df088f-ab7a-442e-8a53-86fcb06aaf1d to /dev/vdb
Nov 08 23:37:52 user nova-compute[75045]: DEBUG os_brick.utils [None req-3a27b56d-1bb5-4cfa-938e-eb57edf0d03d tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75045) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 23:37:52 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:37:52 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:37:52 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[497782df-9cb6-439f-bebf-9aca91203fe9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6217bd6e884\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:37:52 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:37:52 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:37:52 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d94e43c-25c9-4c39-9b23-4c54c6c135c5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:37:52 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:37:52 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:37:52 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[f566fbf4-5a80-4e98-b7cd-dcc00e9c7565]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:37:52 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf9978b8-ea3b-41e9-aa02-341ab19d07be]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:37:52 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-3a27b56d-1bb5-4cfa-938e-eb57edf0d03d tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] Running cmd (subprocess): nvme version {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:37:52 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-3a27b56d-1bb5-4cfa-938e-eb57edf0d03d tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] 'nvme version' failed. Not Retrying. {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 23:37:52 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3a27b56d-1bb5-4cfa-938e-eb57edf0d03d tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] nvme not present on system {{(pid=75045) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 23:37:52 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:37:52 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 23:37:52 user nova-compute[75045]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 23:37:52 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[136d7be7-03dd-4779-abda-957712b3f682]: (4, '') {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:37:52 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.lightos [None req-3a27b56d-1bb5-4cfa-938e-eb57edf0d03d tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75045) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 23:37:52 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.lightos [None req-3a27b56d-1bb5-4cfa-938e-eb57edf0d03d tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75045) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 23:37:52 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.lightos [None req-3a27b56d-1bb5-4cfa-938e-eb57edf0d03d tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] LIGHTOS: no hostnqn found. {{(pid=75045) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 23:37:52 user nova-compute[75045]: DEBUG os_brick.utils [None req-3a27b56d-1bb5-4cfa-938e-eb57edf0d03d tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] <== get_connector_properties: return (132ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6217bd6e884', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75045) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 23:37:52 user nova-compute[75045]: DEBUG nova.virt.block_device [None req-3a27b56d-1bb5-4cfa-938e-eb57edf0d03d tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] [instance: adcffd35-00c7-49db-a72f-d6307a90e123] Updating existing volume attachment record: ee16fbc4-0b43-4c7f-bb2c-8024c2af349d {{(pid=75045) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 23:37:52 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-e29d9391-65e2-4aff-941f-955367ee9a78 tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.531s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 23:37:52 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-e29d9391-65e2-4aff-941f-955367ee9a78 tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] <== connect_volume: return (1533ms) {'type': 'block', 'scsi_wwn': '23764636131353164', 'path': '/dev/sdc'} {{(pid=75045) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 23:37:52 user nova-compute[75045]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e29d9391-65e2-4aff-941f-955367ee9a78 tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] [instance: b4c0930f-4309-43bb-959b-4f36ec457bb6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23764636131353164', 'path': '/dev/sdc'} {{(pid=75045) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 23:37:52 user nova-compute[75045]: DEBUG nova.objects.instance [None req-e29d9391-65e2-4aff-941f-955367ee9a78 tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] Lazy-loading 'flavor' on Instance uuid b4c0930f-4309-43bb-959b-4f36ec457bb6 {{(pid=75045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 23:37:52 user nova-compute[75045]: DEBUG nova.virt.libvirt.guest [None req-e29d9391-65e2-4aff-941f-955367ee9a78 tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] attach device xml: <disk type="block" device="disk">
Nov 08 23:37:52 user nova-compute[75045]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 23:37:52 user nova-compute[75045]:   <source dev="/dev/sdc"/>
Nov 08 23:37:52 user nova-compute[75045]:   <target dev="vdb" bus="virtio"/>
Nov 08 23:37:52 user nova-compute[75045]:   <serial>3f065c57-b67d-415e-9b6a-77d213104733</serial>
Nov 08 23:37:52 user nova-compute[75045]: </disk>
Nov 08 23:37:52 user nova-compute[75045]:  {{(pid=75045) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 08 23:37:52 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager.update_available_resource {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:37:53 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:37:53 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.002s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:37:53 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:37:53 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Auditing locally available compute resources for user (node: user) {{(pid=75045) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 23:37:53 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-e29d9391-65e2-4aff-941f-955367ee9a78 tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] No BDM found with device name vda, not building metadata. {{(pid=75045) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 23:37:53 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-e29d9391-65e2-4aff-941f-955367ee9a78 tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75045) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 23:37:53 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-e29d9391-65e2-4aff-941f-955367ee9a78 tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] No VIF found with MAC fa:16:3e:20:81:d8, not building metadata {{(pid=75045) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 23:37:53 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-0d869fc9-2c14-4784-aa11-87edd52b76c9 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] Acquiring lock "refresh_cache-78955913-bbab-4b00-bc9b-12116f249d7e" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 23:37:53 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-0d869fc9-2c14-4784-aa11-87edd52b76c9 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] Acquired lock "refresh_cache-78955913-bbab-4b00-bc9b-12116f249d7e" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 23:37:53 user nova-compute[75045]: DEBUG nova.network.neutron [None req-0d869fc9-2c14-4784-aa11-87edd52b76c9 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] [instance: 78955913-bbab-4b00-bc9b-12116f249d7e] Building network info cache for instance {{(pid=75045) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 23:37:53 user nova-compute[75045]: DEBUG nova.compute.manager [req-483823f3-e9b2-4f87-80eb-1c33c085b3e3 req-fdc6ad5d-920d-4512-a008-3da2e1ef9562 service nova] [instance: 78955913-bbab-4b00-bc9b-12116f249d7e] Received event network-changed-fc66a792-914f-48c4-ae57-cbda1615ff0b {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:37:53 user nova-compute[75045]: DEBUG nova.compute.manager [req-483823f3-e9b2-4f87-80eb-1c33c085b3e3 req-fdc6ad5d-920d-4512-a008-3da2e1ef9562 service nova] [instance: 78955913-bbab-4b00-bc9b-12116f249d7e] Refreshing instance network info cache due to event network-changed-fc66a792-914f-48c4-ae57-cbda1615ff0b. {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 23:37:53 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-483823f3-e9b2-4f87-80eb-1c33c085b3e3 req-fdc6ad5d-920d-4512-a008-3da2e1ef9562 service nova] Acquiring lock "refresh_cache-78955913-bbab-4b00-bc9b-12116f249d7e" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 23:37:53 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/244c4cc9-2837-40c9-b4ad-37dc435c9749/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:37:53 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-e29d9391-65e2-4aff-941f-955367ee9a78 tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] Lock "b4c0930f-4309-43bb-959b-4f36ec457bb6" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 46.311s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:37:53 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/244c4cc9-2837-40c9-b4ad-37dc435c9749/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:37:53 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/244c4cc9-2837-40c9-b4ad-37dc435c9749/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:37:53 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/244c4cc9-2837-40c9-b4ad-37dc435c9749/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:37:53 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4c0930f-4309-43bb-959b-4f36ec457bb6/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:37:53 user nova-compute[75045]: DEBUG nova.network.neutron [None req-0d869fc9-2c14-4784-aa11-87edd52b76c9 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] [instance: 78955913-bbab-4b00-bc9b-12116f249d7e] Updating instance_info_cache with network_info: [{"id": "fc66a792-914f-48c4-ae57-cbda1615ff0b", "address": "fa:16:3e:58:00:3d", "network": {"id": "1b10bc53-ef32-4f01-82f6-ed9f95f7e3f2", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-518782773-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.43", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ad736027d034259a052da3f62bd575f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc66a792-91", "ovs_interfaceid": "fc66a792-914f-48c4-ae57-cbda1615ff0b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75045) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 23:37:53 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4c0930f-4309-43bb-959b-4f36ec457bb6/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:37:53 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4c0930f-4309-43bb-959b-4f36ec457bb6/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:37:53 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-0d869fc9-2c14-4784-aa11-87edd52b76c9 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] Releasing lock "refresh_cache-78955913-bbab-4b00-bc9b-12116f249d7e" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 23:37:53 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-0d869fc9-2c14-4784-aa11-87edd52b76c9 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] [instance: 78955913-bbab-4b00-bc9b-12116f249d7e] Creating instance directory {{(pid=75045) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 23:37:53 user nova-compute[75045]: INFO nova.virt.libvirt.driver [None req-0d869fc9-2c14-4784-aa11-87edd52b76c9 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] [instance: 78955913-bbab-4b00-bc9b-12116f249d7e] Creating image(s)
Nov 08 23:37:53 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-0d869fc9-2c14-4784-aa11-87edd52b76c9 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] Acquiring lock "/opt/stack/data/nova/instances/78955913-bbab-4b00-bc9b-12116f249d7e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:37:53 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-0d869fc9-2c14-4784-aa11-87edd52b76c9 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] Lock "/opt/stack/data/nova/instances/78955913-bbab-4b00-bc9b-12116f249d7e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:37:53 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-0d869fc9-2c14-4784-aa11-87edd52b76c9 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] Lock "/opt/stack/data/nova/instances/78955913-bbab-4b00-bc9b-12116f249d7e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:37:53 user nova-compute[75045]: DEBUG nova.objects.instance [None req-0d869fc9-2c14-4784-aa11-87edd52b76c9 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] Lazy-loading 'trusted_certs' on Instance uuid 78955913-bbab-4b00-bc9b-12116f249d7e {{(pid=75045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 23:37:53 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-483823f3-e9b2-4f87-80eb-1c33c085b3e3 req-fdc6ad5d-920d-4512-a008-3da2e1ef9562 service nova] Acquired lock "refresh_cache-78955913-bbab-4b00-bc9b-12116f249d7e" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 23:37:53 user nova-compute[75045]: DEBUG nova.network.neutron [req-483823f3-e9b2-4f87-80eb-1c33c085b3e3 req-fdc6ad5d-920d-4512-a008-3da2e1ef9562 service nova] [instance: 78955913-bbab-4b00-bc9b-12116f249d7e] Refreshing network info cache for port fc66a792-914f-48c4-ae57-cbda1615ff0b {{(pid=75045) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 23:37:53 user nova-compute[75045]: DEBUG nova.objects.base [None req-0d869fc9-2c14-4784-aa11-87edd52b76c9 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] Object Instance<78955913-bbab-4b00-bc9b-12116f249d7e> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=75045) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 23:37:53 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-0d869fc9-2c14-4784-aa11-87edd52b76c9 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] Acquiring lock "4c51d55374ccc2195641a2efec032472dab01998" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:37:53 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-0d869fc9-2c14-4784-aa11-87edd52b76c9 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] Lock "4c51d55374ccc2195641a2efec032472dab01998" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:37:54 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4c0930f-4309-43bb-959b-4f36ec457bb6/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:37:54 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75045) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 23:37:54 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9222e62a-9fd8-48b2-a125-83c9cdc589bd/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:37:55 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-0d869fc9-2c14-4784-aa11-87edd52b76c9 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4c51d55374ccc2195641a2efec032472dab01998.part --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:37:55 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:37:55 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9222e62a-9fd8-48b2-a125-83c9cdc589bd/disk --force-share --output=json" returned: 0 in 1.073s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:37:55 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 23:37:55 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9222e62a-9fd8-48b2-a125-83c9cdc589bd/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:37:55 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9222e62a-9fd8-48b2-a125-83c9cdc589bd/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:37:55 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5fc7f02-2143-4bcf-92ac-078d5ec10747/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:37:55 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-0d869fc9-2c14-4784-aa11-87edd52b76c9 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4c51d55374ccc2195641a2efec032472dab01998.part --force-share --output=json" returned: 0 in 0.340s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:37:55 user nova-compute[75045]: DEBUG nova.virt.images [None req-0d869fc9-2c14-4784-aa11-87edd52b76c9 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] 53c5731d-3d3c-4bc6-805a-27cd1bde48d9 was qcow2, converting to raw {{(pid=75045) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 08 23:37:55 user nova-compute[75045]: DEBUG nova.privsep.utils [None req-0d869fc9-2c14-4784-aa11-87edd52b76c9 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75045) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 08 23:37:55 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-0d869fc9-2c14-4784-aa11-87edd52b76c9 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/4c51d55374ccc2195641a2efec032472dab01998.part /opt/stack/data/nova/instances/_base/4c51d55374ccc2195641a2efec032472dab01998.converted {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:37:55 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5fc7f02-2143-4bcf-92ac-078d5ec10747/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:37:55 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5fc7f02-2143-4bcf-92ac-078d5ec10747/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:37:55 user nova-compute[75045]: DEBUG nova.network.neutron [req-483823f3-e9b2-4f87-80eb-1c33c085b3e3 req-fdc6ad5d-920d-4512-a008-3da2e1ef9562 service nova] [instance: 78955913-bbab-4b00-bc9b-12116f249d7e] Updated VIF entry in instance network info cache for port fc66a792-914f-48c4-ae57-cbda1615ff0b. {{(pid=75045) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 23:37:55 user nova-compute[75045]: DEBUG nova.network.neutron [req-483823f3-e9b2-4f87-80eb-1c33c085b3e3 req-fdc6ad5d-920d-4512-a008-3da2e1ef9562 service nova] [instance: 78955913-bbab-4b00-bc9b-12116f249d7e] Updating instance_info_cache with network_info: [{"id": "fc66a792-914f-48c4-ae57-cbda1615ff0b", "address": "fa:16:3e:58:00:3d", "network": {"id": "1b10bc53-ef32-4f01-82f6-ed9f95f7e3f2", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-518782773-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.43", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ad736027d034259a052da3f62bd575f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc66a792-91", "ovs_interfaceid": "fc66a792-914f-48c4-ae57-cbda1615ff0b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75045) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 23:37:55 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-483823f3-e9b2-4f87-80eb-1c33c085b3e3 req-fdc6ad5d-920d-4512-a008-3da2e1ef9562 service nova] Releasing lock "refresh_cache-78955913-bbab-4b00-bc9b-12116f249d7e" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 23:37:55 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5fc7f02-2143-4bcf-92ac-078d5ec10747/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:37:55 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/adcffd35-00c7-49db-a72f-d6307a90e123/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:37:55 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-0d869fc9-2c14-4784-aa11-87edd52b76c9 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/4c51d55374ccc2195641a2efec032472dab01998.part /opt/stack/data/nova/instances/_base/4c51d55374ccc2195641a2efec032472dab01998.converted" returned: 0 in 0.482s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:37:55 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-0d869fc9-2c14-4784-aa11-87edd52b76c9 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4c51d55374ccc2195641a2efec032472dab01998.converted --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:37:56 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/adcffd35-00c7-49db-a72f-d6307a90e123/disk --force-share --output=json" returned: 0 in 0.324s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:37:56 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/adcffd35-00c7-49db-a72f-d6307a90e123/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:37:56 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-0d869fc9-2c14-4784-aa11-87edd52b76c9 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4c51d55374ccc2195641a2efec032472dab01998.converted --force-share --output=json" returned: 0 in 0.265s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:37:56 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-0d869fc9-2c14-4784-aa11-87edd52b76c9 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] Lock "4c51d55374ccc2195641a2efec032472dab01998" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.240s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:37:56 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-0d869fc9-2c14-4784-aa11-87edd52b76c9 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4c51d55374ccc2195641a2efec032472dab01998 --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:37:56 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/adcffd35-00c7-49db-a72f-d6307a90e123/disk --force-share --output=json" returned: 0 in 0.284s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:37:56 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b84f2b1-01a3-4789-bcef-8b7c4334132b/disk.rescue --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:37:56 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-0d869fc9-2c14-4784-aa11-87edd52b76c9 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4c51d55374ccc2195641a2efec032472dab01998 --force-share --output=json" returned: 0 in 0.270s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:37:56 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-0d869fc9-2c14-4784-aa11-87edd52b76c9 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] Acquiring lock "4c51d55374ccc2195641a2efec032472dab01998" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:37:56 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-0d869fc9-2c14-4784-aa11-87edd52b76c9 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] Lock "4c51d55374ccc2195641a2efec032472dab01998" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:37:56 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-0d869fc9-2c14-4784-aa11-87edd52b76c9 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4c51d55374ccc2195641a2efec032472dab01998 --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:37:56 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b84f2b1-01a3-4789-bcef-8b7c4334132b/disk.rescue --force-share --output=json" returned: 0 in 0.228s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:37:56 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b84f2b1-01a3-4789-bcef-8b7c4334132b/disk.rescue --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:37:56 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:37:56 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-0d869fc9-2c14-4784-aa11-87edd52b76c9 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4c51d55374ccc2195641a2efec032472dab01998 --force-share --output=json" returned: 0 in 0.257s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:37:56 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-0d869fc9-2c14-4784-aa11-87edd52b76c9 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4c51d55374ccc2195641a2efec032472dab01998,backing_fmt=raw /opt/stack/data/nova/instances/78955913-bbab-4b00-bc9b-12116f249d7e/disk 1073741824 {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:37:56 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-0d869fc9-2c14-4784-aa11-87edd52b76c9 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4c51d55374ccc2195641a2efec032472dab01998,backing_fmt=raw /opt/stack/data/nova/instances/78955913-bbab-4b00-bc9b-12116f249d7e/disk 1073741824" returned: 0 in 0.061s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:37:56 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-0d869fc9-2c14-4784-aa11-87edd52b76c9 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] Lock "4c51d55374ccc2195641a2efec032472dab01998" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.328s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:37:56 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-0d869fc9-2c14-4784-aa11-87edd52b76c9 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4c51d55374ccc2195641a2efec032472dab01998 --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:37:56 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b84f2b1-01a3-4789-bcef-8b7c4334132b/disk.rescue --force-share --output=json" returned: 0 in 0.276s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:37:56 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b84f2b1-01a3-4789-bcef-8b7c4334132b/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:37:57 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-0d869fc9-2c14-4784-aa11-87edd52b76c9 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4c51d55374ccc2195641a2efec032472dab01998 --force-share --output=json" returned: 0 in 0.216s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:37:57 user nova-compute[75045]: DEBUG nova.objects.instance [None req-0d869fc9-2c14-4784-aa11-87edd52b76c9 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] Lazy-loading 'migration_context' on Instance uuid 78955913-bbab-4b00-bc9b-12116f249d7e {{(pid=75045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 23:37:57 user nova-compute[75045]: DEBUG nova.objects.base [None req-0d869fc9-2c14-4784-aa11-87edd52b76c9 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] Object Instance<78955913-bbab-4b00-bc9b-12116f249d7e> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=75045) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 23:37:57 user nova-compute[75045]: INFO nova.virt.libvirt.driver [None req-0d869fc9-2c14-4784-aa11-87edd52b76c9 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] [instance: 78955913-bbab-4b00-bc9b-12116f249d7e] Rebasing disk image.
Nov 08 23:37:57 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-0d869fc9-2c14-4784-aa11-87edd52b76c9 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b59f52a99fff51c56dd1edfb83892fb8f647f2f3 --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:37:57 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b84f2b1-01a3-4789-bcef-8b7c4334132b/disk --force-share --output=json" returned: 0 in 0.244s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:37:57 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b84f2b1-01a3-4789-bcef-8b7c4334132b/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:37:57 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-0d869fc9-2c14-4784-aa11-87edd52b76c9 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b59f52a99fff51c56dd1edfb83892fb8f647f2f3 --force-share --output=json" returned: 0 in 0.196s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:37:57 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-0d869fc9-2c14-4784-aa11-87edd52b76c9 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/b59f52a99fff51c56dd1edfb83892fb8f647f2f3 -F raw /opt/stack/data/nova/instances/78955913-bbab-4b00-bc9b-12116f249d7e/disk {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:37:57 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b84f2b1-01a3-4789-bcef-8b7c4334132b/disk --force-share --output=json" returned: 0 in 0.260s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:37:57 user nova-compute[75045]: WARNING nova.virt.libvirt.driver [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 23:37:57 user nova-compute[75045]: WARNING nova.virt.libvirt.driver [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 23:37:57 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Hypervisor/Node resource view: name=user free_ram=8158MB free_disk=25.100875854492188GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75045) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 23:37:57 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:37:57 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:37:57 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Instance b5fc7f02-2143-4bcf-92ac-078d5ec10747 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75045) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 23:37:57 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Instance 0b84f2b1-01a3-4789-bcef-8b7c4334132b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75045) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 23:37:57 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Instance adcffd35-00c7-49db-a72f-d6307a90e123 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75045) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 23:37:57 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Instance 9222e62a-9fd8-48b2-a125-83c9cdc589bd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75045) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 23:37:57 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Instance b4c0930f-4309-43bb-959b-4f36ec457bb6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75045) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 23:37:57 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] [instance: 78955913-bbab-4b00-bc9b-12116f249d7e] Instance with task_state "spawning" is not being actively managed by this compute host but has allocations referencing this compute node (62ba5f85-c74d-4b58-986e-d4197e813fd7): {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. Skipping heal of allocations during the task state transition. {{(pid=75045) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1777}}
Nov 08 23:37:57 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Instance 244c4cc9-2837-40c9-b4ad-37dc435c9749 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75045) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 23:37:58 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=75045) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 23:37:58 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=75045) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 23:37:58 user nova-compute[75045]: DEBUG nova.compute.provider_tree [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Inventory has not changed in ProviderTree for provider: 62ba5f85-c74d-4b58-986e-d4197e813fd7 {{(pid=75045) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 23:37:58 user nova-compute[75045]: DEBUG nova.scheduler.client.report [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Inventory has not changed for provider 62ba5f85-c74d-4b58-986e-d4197e813fd7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75045) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 23:37:58 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Compute_service record updated for user:user {{(pid=75045) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 23:37:58 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.428s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:37:59 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-ef4c6d79-ae9f-4cdc-afda-9d769cd009a6 tempest-ServerStableDeviceRescueTest-1847572360 tempest-ServerStableDeviceRescueTest-1847572360-project-member] Acquiring lock "7ee587a0-e271-4262-a252-2ccb6c2faecb" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:37:59 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-ef4c6d79-ae9f-4cdc-afda-9d769cd009a6 tempest-ServerStableDeviceRescueTest-1847572360 tempest-ServerStableDeviceRescueTest-1847572360-project-member] Lock "7ee587a0-e271-4262-a252-2ccb6c2faecb" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:37:59 user nova-compute[75045]: DEBUG nova.compute.manager [None req-ef4c6d79-ae9f-4cdc-afda-9d769cd009a6 tempest-ServerStableDeviceRescueTest-1847572360 tempest-ServerStableDeviceRescueTest-1847572360-project-member] [instance: 7ee587a0-e271-4262-a252-2ccb6c2faecb] Starting instance... {{(pid=75045) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 23:37:59 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-ef4c6d79-ae9f-4cdc-afda-9d769cd009a6 tempest-ServerStableDeviceRescueTest-1847572360 tempest-ServerStableDeviceRescueTest-1847572360-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:37:59 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-ef4c6d79-ae9f-4cdc-afda-9d769cd009a6 tempest-ServerStableDeviceRescueTest-1847572360 tempest-ServerStableDeviceRescueTest-1847572360-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:37:59 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-ef4c6d79-ae9f-4cdc-afda-9d769cd009a6 tempest-ServerStableDeviceRescueTest-1847572360 tempest-ServerStableDeviceRescueTest-1847572360-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75045) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 23:37:59 user nova-compute[75045]: INFO nova.compute.claims [None req-ef4c6d79-ae9f-4cdc-afda-9d769cd009a6 tempest-ServerStableDeviceRescueTest-1847572360 tempest-ServerStableDeviceRescueTest-1847572360-project-member] [instance: 7ee587a0-e271-4262-a252-2ccb6c2faecb] Claim successful on node user
Nov 08 23:38:00 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-0d869fc9-2c14-4784-aa11-87edd52b76c9 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/b59f52a99fff51c56dd1edfb83892fb8f647f2f3 -F raw /opt/stack/data/nova/instances/78955913-bbab-4b00-bc9b-12116f249d7e/disk" returned: 0 in 2.756s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:38:00 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-0d869fc9-2c14-4784-aa11-87edd52b76c9 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] [instance: 78955913-bbab-4b00-bc9b-12116f249d7e] Created local disks {{(pid=75045) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 23:38:00 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-0d869fc9-2c14-4784-aa11-87edd52b76c9 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] [instance: 78955913-bbab-4b00-bc9b-12116f249d7e] Ensure instance console log exists: /opt/stack/data/nova/instances/78955913-bbab-4b00-bc9b-12116f249d7e/console.log {{(pid=75045) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 23:38:00 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-0d869fc9-2c14-4784-aa11-87edd52b76c9 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:38:00 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-0d869fc9-2c14-4784-aa11-87edd52b76c9 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:38:00 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-0d869fc9-2c14-4784-aa11-87edd52b76c9 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:38:00 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-0d869fc9-2c14-4784-aa11-87edd52b76c9 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] [instance: 78955913-bbab-4b00-bc9b-12116f249d7e] Start _get_guest_xml network_info=[{"id": "fc66a792-914f-48c4-ae57-cbda1615ff0b", "address": "fa:16:3e:58:00:3d", "network": {"id": "1b10bc53-ef32-4f01-82f6-ed9f95f7e3f2", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-518782773-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.43", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ad736027d034259a052da3f62bd575f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc66a792-91", "ovs_interfaceid": "fc66a792-914f-48c4-ae57-cbda1615ff0b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='ba40d78d3e7c3bc0cc6ab15c6a8aecb9',container_format='bare',created_at=2023-11-08T23:35:06Z,direct_url=<?>,disk_format='qcow2',id=53c5731d-3d3c-4bc6-805a-27cd1bde48d9,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1514498655-shelved',owner='3ad736027d034259a052da3f62bd575f',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-08T23:35:10Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'disk_bus': 'virtio', 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': 'a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb'}], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'device_type': 'disk', 'attachment_id': '905995ff-b2bc-421c-af38-260f72c7bf3f', 'guest_format': None, 'disk_bus': 'virtio', 'boot_index': None, 'mount_device': '/dev/vdc', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:5c6e98f2-e9be-4c1a-b335-61187862dfec', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rpHAkTqz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attached', 'instance': '78955913-bbab-4b00-bc9b-12116f249d7e', 'attached_at': '', 'detached_at': '', 'volume_id': '5c6e98f2-e9be-4c1a-b335-61187862dfec', 'serial': '5c6e98f2-e9be-4c1a-b335-61187862dfec'}, 'volume_type': None} {{(pid=75045) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 23:38:00 user nova-compute[75045]: WARNING nova.virt.libvirt.driver [None req-0d869fc9-2c14-4784-aa11-87edd52b76c9 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 23:38:00 user nova-compute[75045]: WARNING nova.virt.libvirt.driver [None req-0d869fc9-2c14-4784-aa11-87edd52b76c9 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 23:38:00 user nova-compute[75045]: DEBUG nova.virt.libvirt.host [None req-0d869fc9-2c14-4784-aa11-87edd52b76c9 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75045) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 23:38:00 user nova-compute[75045]: DEBUG nova.virt.libvirt.host [None req-0d869fc9-2c14-4784-aa11-87edd52b76c9 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] CPU controller missing on host. {{(pid=75045) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 23:38:00 user nova-compute[75045]: DEBUG nova.virt.libvirt.host [None req-0d869fc9-2c14-4784-aa11-87edd52b76c9 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75045) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 23:38:00 user nova-compute[75045]: DEBUG nova.virt.libvirt.host [None req-0d869fc9-2c14-4784-aa11-87edd52b76c9 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] CPU controller found on host. {{(pid=75045) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 23:38:00 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-0d869fc9-2c14-4784-aa11-87edd52b76c9 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75045) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 23:38:00 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-0d869fc9-2c14-4784-aa11-87edd52b76c9 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T23:11:41Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='ba40d78d3e7c3bc0cc6ab15c6a8aecb9',container_format='bare',created_at=2023-11-08T23:35:06Z,direct_url=<?>,disk_format='qcow2',id=53c5731d-3d3c-4bc6-805a-27cd1bde48d9,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1514498655-shelved',owner='3ad736027d034259a052da3f62bd575f',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-08T23:35:10Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75045) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 23:38:00 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-0d869fc9-2c14-4784-aa11-87edd52b76c9 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] Flavor limits 0:0:0 {{(pid=75045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 23:38:00 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-0d869fc9-2c14-4784-aa11-87edd52b76c9 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] Image limits 0:0:0 {{(pid=75045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 23:38:00 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-0d869fc9-2c14-4784-aa11-87edd52b76c9 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] Flavor pref 0:0:0 {{(pid=75045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 23:38:00 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-0d869fc9-2c14-4784-aa11-87edd52b76c9 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] Image pref 0:0:0 {{(pid=75045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 23:38:00 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-0d869fc9-2c14-4784-aa11-87edd52b76c9 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 23:38:00 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-0d869fc9-2c14-4784-aa11-87edd52b76c9 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75045) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 23:38:00 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-0d869fc9-2c14-4784-aa11-87edd52b76c9 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75045) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 23:38:00 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-0d869fc9-2c14-4784-aa11-87edd52b76c9 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] Got 1 possible topologies {{(pid=75045) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 23:38:00 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-0d869fc9-2c14-4784-aa11-87edd52b76c9 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75045) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 23:38:00 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-0d869fc9-2c14-4784-aa11-87edd52b76c9 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75045) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 23:38:00 user nova-compute[75045]: DEBUG nova.objects.instance [None req-0d869fc9-2c14-4784-aa11-87edd52b76c9 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] Lazy-loading 'vcpu_model' on Instance uuid 78955913-bbab-4b00-bc9b-12116f249d7e {{(pid=75045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 23:38:00 user nova-compute[75045]: DEBUG nova.objects.base [None req-0d869fc9-2c14-4784-aa11-87edd52b76c9 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] Object Instance<78955913-bbab-4b00-bc9b-12116f249d7e> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=75045) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 23:38:00 user nova-compute[75045]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0d869fc9-2c14-4784-aa11-87edd52b76c9 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] [instance: 78955913-bbab-4b00-bc9b-12116f249d7e] Calling os-brick to attach iSCSI Volume {{(pid=75045) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 23:38:00 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d869fc9-2c14-4784-aa11-87edd52b76c9 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1b68210460>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5c6e98f2-e9be-4c1a-b335-61187862dfec', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rpHAkTqz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75045) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 23:38:00 user nova-compute[75045]: WARNING os_brick.initiator.connectors.base [None req-0d869fc9-2c14-4784-aa11-87edd52b76c9 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 23:38:00 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-0d869fc9-2c14-4784-aa11-87edd52b76c9 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 23:38:00 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-0d869fc9-2c14-4784-aa11-87edd52b76c9 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 23:38:00 user nova-compute[75045]: WARNING os_brick.initiator.connectors.base [None req-0d869fc9-2c14-4784-aa11-87edd52b76c9 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 23:38:00 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-0d869fc9-2c14-4784-aa11-87edd52b76c9 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5c6e98f2-e9be-4c1a-b335-61187862dfec" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 23:38:00 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-0d869fc9-2c14-4784-aa11-87edd52b76c9 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5c6e98f2-e9be-4c1a-b335-61187862dfec" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 23:38:00 user nova-compute[75045]: INFO os_brick.initiator.connectors.iscsi [None req-0d869fc9-2c14-4784-aa11-87edd52b76c9 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 23:38:00 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:38:00 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c6e98f2-e9be-4c1a-b335-61187862dfec -p 172.16.0.220:3260 {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:38:00 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c6e98f2-e9be-4c1a-b335-61187862dfec -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:38:00 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[828d6ace-f974-4171-a65e-e24c17640b06]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:38:00 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d869fc9-2c14-4784-aa11-87edd52b76c9 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 23:38:00 user nova-compute[75045]:  {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:38:00 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c6e98f2-e9be-4c1a-b335-61187862dfec -p 172.16.0.220:3260 --interface default --op new {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:38:00 user nova-compute[75045]: DEBUG nova.compute.provider_tree [None req-ef4c6d79-ae9f-4cdc-afda-9d769cd009a6 tempest-ServerStableDeviceRescueTest-1847572360 tempest-ServerStableDeviceRescueTest-1847572360-project-member] Inventory has not changed in ProviderTree for provider: 62ba5f85-c74d-4b58-986e-d4197e813fd7 {{(pid=75045) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 23:38:00 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c6e98f2-e9be-4c1a-b335-61187862dfec -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:38:00 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[f84c0d22-62ac-4acf-9fd8-1f59be0713a7]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5c6e98f2-e9be-4c1a-b335-61187862dfec] added\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:38:00 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d869fc9-2c14-4784-aa11-87edd52b76c9 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5c6e98f2-e9be-4c1a-b335-61187862dfec] added
Nov 08 23:38:00 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:38:00 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c6e98f2-e9be-4c1a-b335-61187862dfec -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:38:00 user nova-compute[75045]: DEBUG nova.scheduler.client.report [None req-ef4c6d79-ae9f-4cdc-afda-9d769cd009a6 tempest-ServerStableDeviceRescueTest-1847572360 tempest-ServerStableDeviceRescueTest-1847572360-project-member] Inventory has not changed for provider 62ba5f85-c74d-4b58-986e-d4197e813fd7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75045) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 23:38:00 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c6e98f2-e9be-4c1a-b335-61187862dfec -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:38:00 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2596b48-a542-4558-b718-122b2b952d2c]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:38:00 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d869fc9-2c14-4784-aa11-87edd52b76c9 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:38:00 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c6e98f2-e9be-4c1a-b335-61187862dfec -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:38:00 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-ef4c6d79-ae9f-4cdc-afda-9d769cd009a6 tempest-ServerStableDeviceRescueTest-1847572360 tempest-ServerStableDeviceRescueTest-1847572360-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.689s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:38:00 user nova-compute[75045]: DEBUG nova.compute.manager [None req-ef4c6d79-ae9f-4cdc-afda-9d769cd009a6 tempest-ServerStableDeviceRescueTest-1847572360 tempest-ServerStableDeviceRescueTest-1847572360-project-member] [instance: 7ee587a0-e271-4262-a252-2ccb6c2faecb] Start building networks asynchronously for instance. {{(pid=75045) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 23:38:00 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c6e98f2-e9be-4c1a-b335-61187862dfec -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:38:00 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[46e4ae54-bf50-45d2-86dc-0c1f29143564]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:38:00 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d869fc9-2c14-4784-aa11-87edd52b76c9 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:38:00 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c6e98f2-e9be-4c1a-b335-61187862dfec -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rpHAkTqz {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:38:00 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c6e98f2-e9be-4c1a-b335-61187862dfec -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rpHAkTqz" returned: 0 in 0.018s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:38:00 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[8816e77f-09e8-4de7-bd88-083f34f61f41]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:38:00 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d869fc9-2c14-4784-aa11-87edd52b76c9 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'rpHAkTqz'): stdout= stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:38:00 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c6e98f2-e9be-4c1a-b335-61187862dfec -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:38:00 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c6e98f2-e9be-4c1a-b335-61187862dfec -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.027s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:38:00 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[d70e9bc5-1376-4301-a30a-cf1045badbbb]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:38:00 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d869fc9-2c14-4784-aa11-87edd52b76c9 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:38:00 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:38:00 user nova-compute[75045]: DEBUG nova.compute.manager [None req-ef4c6d79-ae9f-4cdc-afda-9d769cd009a6 tempest-ServerStableDeviceRescueTest-1847572360 tempest-ServerStableDeviceRescueTest-1847572360-project-member] [instance: 7ee587a0-e271-4262-a252-2ccb6c2faecb] Allocating IP information in the background. {{(pid=75045) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 23:38:00 user nova-compute[75045]: DEBUG nova.network.neutron [None req-ef4c6d79-ae9f-4cdc-afda-9d769cd009a6 tempest-ServerStableDeviceRescueTest-1847572360 tempest-ServerStableDeviceRescueTest-1847572360-project-member] [instance: 7ee587a0-e271-4262-a252-2ccb6c2faecb] allocate_for_instance() {{(pid=75045) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 23:38:00 user nova-compute[75045]: INFO nova.virt.libvirt.driver [None req-ef4c6d79-ae9f-4cdc-afda-9d769cd009a6 tempest-ServerStableDeviceRescueTest-1847572360 tempest-ServerStableDeviceRescueTest-1847572360-project-member] [instance: 7ee587a0-e271-4262-a252-2ccb6c2faecb] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 23:38:00 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:38:00 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[89090ccf-96e9-4632-b4f8-388b24a1be10]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b2a3b04-13be-4853-822c-29c416757252 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f065c57-b67d-415e-9b6a-77d213104733 (non-flash)\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:38:00 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d869fc9-2c14-4784-aa11-87edd52b76c9 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b2a3b04-13be-4853-822c-29c416757252 (non-flash)
Nov 08 23:38:00 user nova-compute[75045]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f065c57-b67d-415e-9b6a-77d213104733 (non-flash)
Nov 08 23:38:00 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 23:38:00 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d869fc9-2c14-4784-aa11-87edd52b76c9 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b2a3b04-13be-4853-822c-29c416757252 (non-flash)
Nov 08 23:38:00 user nova-compute[75045]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f065c57-b67d-415e-9b6a-77d213104733 (non-flash)
Nov 08 23:38:00 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 23:38:00 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c6e98f2-e9be-4c1a-b335-61187862dfec -p 172.16.0.220:3260 --login {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:38:00 user nova-compute[75045]: DEBUG nova.compute.manager [None req-ef4c6d79-ae9f-4cdc-afda-9d769cd009a6 tempest-ServerStableDeviceRescueTest-1847572360 tempest-ServerStableDeviceRescueTest-1847572360-project-member] [instance: 7ee587a0-e271-4262-a252-2ccb6c2faecb] Start building block device mappings for instance. {{(pid=75045) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 23:38:00 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c6e98f2-e9be-4c1a-b335-61187862dfec -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:38:00 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[800f1857-7aaa-4ba4-877f-fafb0e617d61]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5c6e98f2-e9be-4c1a-b335-61187862dfec, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5c6e98f2-e9be-4c1a-b335-61187862dfec, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:38:00 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d869fc9-2c14-4784-aa11-87edd52b76c9 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5c6e98f2-e9be-4c1a-b335-61187862dfec, portal: 172.16.0.220,3260]
Nov 08 23:38:00 user nova-compute[75045]: Login to [iface: default, target: iqn.2010-10.org.openstack:5c6e98f2-e9be-4c1a-b335-61187862dfec, portal: 172.16.0.220,3260] successful.
Nov 08 23:38:00 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:38:00 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c6e98f2-e9be-4c1a-b335-61187862dfec -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:38:00 user nova-compute[75045]: DEBUG nova.policy [None req-ef4c6d79-ae9f-4cdc-afda-9d769cd009a6 tempest-ServerStableDeviceRescueTest-1847572360 tempest-ServerStableDeviceRescueTest-1847572360-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '49cdaaab1d134721a522900af5e12d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4760b2fb18b44e26bfbca6bf16aea581', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75045) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 23:38:00 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c6e98f2-e9be-4c1a-b335-61187862dfec -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:38:00 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[37a5d5a4-1e89-4fa9-bf11-5b0238bd8b46]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:38:00 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d869fc9-2c14-4784-aa11-87edd52b76c9 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:38:00 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:38:00 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:38:00 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[75a591cb-7162-4718-8cdf-270c24334e96]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b2a3b04-13be-4853-822c-29c416757252 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f065c57-b67d-415e-9b6a-77d213104733 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c6e98f2-e9be-4c1a-b335-61187862dfec (non-flash)\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:38:00 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d869fc9-2c14-4784-aa11-87edd52b76c9 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b2a3b04-13be-4853-822c-29c416757252 (non-flash)
Nov 08 23:38:00 user nova-compute[75045]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f065c57-b67d-415e-9b6a-77d213104733 (non-flash)
Nov 08 23:38:00 user nova-compute[75045]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c6e98f2-e9be-4c1a-b335-61187862dfec (non-flash)
Nov 08 23:38:00 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 23:38:00 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d869fc9-2c14-4784-aa11-87edd52b76c9 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b2a3b04-13be-4853-822c-29c416757252 (non-flash)
Nov 08 23:38:00 user nova-compute[75045]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f065c57-b67d-415e-9b6a-77d213104733 (non-flash)
Nov 08 23:38:00 user nova-compute[75045]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c6e98f2-e9be-4c1a-b335-61187862dfec (non-flash)
Nov 08 23:38:00 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 23:38:00 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-0d869fc9-2c14-4784-aa11-87edd52b76c9 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5c6e98f2-e9be-4c1a-b335-61187862dfec" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.312s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 23:38:00 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d869fc9-2c14-4784-aa11-87edd52b76c9 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] Connected to 172.16.0.220:3260 {{(pid=75045) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 23:38:00 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-0d869fc9-2c14-4784-aa11-87edd52b76c9 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] HCTL ('35', '-', '-', 0) found on session 39 with lun 0 {{(pid=75045) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 23:38:00 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-0d869fc9-2c14-4784-aa11-87edd52b76c9 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75045) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 23:38:00 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:38:00 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.025s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:38:00 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dfc3655-9904-414f-9f0a-4ab4c82d0d8a]: (4, ('- - 0', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:38:00 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-0d869fc9-2c14-4784-aa11-87edd52b76c9 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] Searching for a device in session 39 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75045) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 23:38:00 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d869fc9-2c14-4784-aa11-87edd52b76c9 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:5c6e98f2-e9be-4c1a-b335-61187862dfec', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rpHAkTqz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75045) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 23:38:00 user nova-compute[75045]: DEBUG nova.compute.manager [None req-ef4c6d79-ae9f-4cdc-afda-9d769cd009a6 tempest-ServerStableDeviceRescueTest-1847572360 tempest-ServerStableDeviceRescueTest-1847572360-project-member] [instance: 7ee587a0-e271-4262-a252-2ccb6c2faecb] Start spawning the instance on the hypervisor. {{(pid=75045) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 23:38:00 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-ef4c6d79-ae9f-4cdc-afda-9d769cd009a6 tempest-ServerStableDeviceRescueTest-1847572360 tempest-ServerStableDeviceRescueTest-1847572360-project-member] [instance: 7ee587a0-e271-4262-a252-2ccb6c2faecb] Creating instance directory {{(pid=75045) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 23:38:00 user nova-compute[75045]: INFO nova.virt.libvirt.driver [None req-ef4c6d79-ae9f-4cdc-afda-9d769cd009a6 tempest-ServerStableDeviceRescueTest-1847572360 tempest-ServerStableDeviceRescueTest-1847572360-project-member] [instance: 7ee587a0-e271-4262-a252-2ccb6c2faecb] Creating image(s)
Nov 08 23:38:00 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-ef4c6d79-ae9f-4cdc-afda-9d769cd009a6 tempest-ServerStableDeviceRescueTest-1847572360 tempest-ServerStableDeviceRescueTest-1847572360-project-member] Acquiring lock "/opt/stack/data/nova/instances/7ee587a0-e271-4262-a252-2ccb6c2faecb/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:38:00 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-ef4c6d79-ae9f-4cdc-afda-9d769cd009a6 tempest-ServerStableDeviceRescueTest-1847572360 tempest-ServerStableDeviceRescueTest-1847572360-project-member] Lock "/opt/stack/data/nova/instances/7ee587a0-e271-4262-a252-2ccb6c2faecb/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:38:00 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-ef4c6d79-ae9f-4cdc-afda-9d769cd009a6 tempest-ServerStableDeviceRescueTest-1847572360 tempest-ServerStableDeviceRescueTest-1847572360-project-member] Lock "/opt/stack/data/nova/instances/7ee587a0-e271-4262-a252-2ccb6c2faecb/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:38:00 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-ef4c6d79-ae9f-4cdc-afda-9d769cd009a6 tempest-ServerStableDeviceRescueTest-1847572360 tempest-ServerStableDeviceRescueTest-1847572360-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b59f52a99fff51c56dd1edfb83892fb8f647f2f3 --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:38:00 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-ef4c6d79-ae9f-4cdc-afda-9d769cd009a6 tempest-ServerStableDeviceRescueTest-1847572360 tempest-ServerStableDeviceRescueTest-1847572360-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b59f52a99fff51c56dd1edfb83892fb8f647f2f3 --force-share --output=json" returned: 0 in 0.214s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:38:00 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-ef4c6d79-ae9f-4cdc-afda-9d769cd009a6 tempest-ServerStableDeviceRescueTest-1847572360 tempest-ServerStableDeviceRescueTest-1847572360-project-member] Acquiring lock "b59f52a99fff51c56dd1edfb83892fb8f647f2f3" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:38:00 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-ef4c6d79-ae9f-4cdc-afda-9d769cd009a6 tempest-ServerStableDeviceRescueTest-1847572360 tempest-ServerStableDeviceRescueTest-1847572360-project-member] Lock "b59f52a99fff51c56dd1edfb83892fb8f647f2f3" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:38:00 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-ef4c6d79-ae9f-4cdc-afda-9d769cd009a6 tempest-ServerStableDeviceRescueTest-1847572360 tempest-ServerStableDeviceRescueTest-1847572360-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b59f52a99fff51c56dd1edfb83892fb8f647f2f3 --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:38:01 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-ef4c6d79-ae9f-4cdc-afda-9d769cd009a6 tempest-ServerStableDeviceRescueTest-1847572360 tempest-ServerStableDeviceRescueTest-1847572360-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b59f52a99fff51c56dd1edfb83892fb8f647f2f3 --force-share --output=json" returned: 0 in 0.228s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:38:01 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-ef4c6d79-ae9f-4cdc-afda-9d769cd009a6 tempest-ServerStableDeviceRescueTest-1847572360 tempest-ServerStableDeviceRescueTest-1847572360-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b59f52a99fff51c56dd1edfb83892fb8f647f2f3,backing_fmt=raw /opt/stack/data/nova/instances/7ee587a0-e271-4262-a252-2ccb6c2faecb/disk 1073741824 {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:38:01 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-ef4c6d79-ae9f-4cdc-afda-9d769cd009a6 tempest-ServerStableDeviceRescueTest-1847572360 tempest-ServerStableDeviceRescueTest-1847572360-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b59f52a99fff51c56dd1edfb83892fb8f647f2f3,backing_fmt=raw /opt/stack/data/nova/instances/7ee587a0-e271-4262-a252-2ccb6c2faecb/disk 1073741824" returned: 0 in 0.057s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:38:01 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-ef4c6d79-ae9f-4cdc-afda-9d769cd009a6 tempest-ServerStableDeviceRescueTest-1847572360 tempest-ServerStableDeviceRescueTest-1847572360-project-member] Lock "b59f52a99fff51c56dd1edfb83892fb8f647f2f3" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.293s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:38:01 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-ef4c6d79-ae9f-4cdc-afda-9d769cd009a6 tempest-ServerStableDeviceRescueTest-1847572360 tempest-ServerStableDeviceRescueTest-1847572360-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b59f52a99fff51c56dd1edfb83892fb8f647f2f3 --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:38:01 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-ef4c6d79-ae9f-4cdc-afda-9d769cd009a6 tempest-ServerStableDeviceRescueTest-1847572360 tempest-ServerStableDeviceRescueTest-1847572360-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b59f52a99fff51c56dd1edfb83892fb8f647f2f3 --force-share --output=json" returned: 0 in 0.197s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:38:01 user nova-compute[75045]: DEBUG nova.virt.disk.api [None req-ef4c6d79-ae9f-4cdc-afda-9d769cd009a6 tempest-ServerStableDeviceRescueTest-1847572360 tempest-ServerStableDeviceRescueTest-1847572360-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7ee587a0-e271-4262-a252-2ccb6c2faecb/disk. size=1073741824 {{(pid=75045) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 23:38:01 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-ef4c6d79-ae9f-4cdc-afda-9d769cd009a6 tempest-ServerStableDeviceRescueTest-1847572360 tempest-ServerStableDeviceRescueTest-1847572360-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ee587a0-e271-4262-a252-2ccb6c2faecb/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:38:01 user nova-compute[75045]: DEBUG nova.network.neutron [None req-ef4c6d79-ae9f-4cdc-afda-9d769cd009a6 tempest-ServerStableDeviceRescueTest-1847572360 tempest-ServerStableDeviceRescueTest-1847572360-project-member] [instance: 7ee587a0-e271-4262-a252-2ccb6c2faecb] Successfully created port: 0b911e0a-0c01-4296-b269-f52ee68772f9 {{(pid=75045) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 23:38:01 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-ef4c6d79-ae9f-4cdc-afda-9d769cd009a6 tempest-ServerStableDeviceRescueTest-1847572360 tempest-ServerStableDeviceRescueTest-1847572360-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ee587a0-e271-4262-a252-2ccb6c2faecb/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:38:01 user nova-compute[75045]: DEBUG nova.virt.disk.api [None req-ef4c6d79-ae9f-4cdc-afda-9d769cd009a6 tempest-ServerStableDeviceRescueTest-1847572360 tempest-ServerStableDeviceRescueTest-1847572360-project-member] Cannot resize image /opt/stack/data/nova/instances/7ee587a0-e271-4262-a252-2ccb6c2faecb/disk to a smaller size. {{(pid=75045) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 08 23:38:01 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-ef4c6d79-ae9f-4cdc-afda-9d769cd009a6 tempest-ServerStableDeviceRescueTest-1847572360 tempest-ServerStableDeviceRescueTest-1847572360-project-member] [instance: 7ee587a0-e271-4262-a252-2ccb6c2faecb] Created local disks {{(pid=75045) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 23:38:01 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-ef4c6d79-ae9f-4cdc-afda-9d769cd009a6 tempest-ServerStableDeviceRescueTest-1847572360 tempest-ServerStableDeviceRescueTest-1847572360-project-member] [instance: 7ee587a0-e271-4262-a252-2ccb6c2faecb] Ensure instance console log exists: /opt/stack/data/nova/instances/7ee587a0-e271-4262-a252-2ccb6c2faecb/console.log {{(pid=75045) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 23:38:01 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-ef4c6d79-ae9f-4cdc-afda-9d769cd009a6 tempest-ServerStableDeviceRescueTest-1847572360 tempest-ServerStableDeviceRescueTest-1847572360-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:38:01 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-ef4c6d79-ae9f-4cdc-afda-9d769cd009a6 tempest-ServerStableDeviceRescueTest-1847572360 tempest-ServerStableDeviceRescueTest-1847572360-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:38:01 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-ef4c6d79-ae9f-4cdc-afda-9d769cd009a6 tempest-ServerStableDeviceRescueTest-1847572360 tempest-ServerStableDeviceRescueTest-1847572360-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:38:01 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-0d869fc9-2c14-4784-aa11-87edd52b76c9 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.358s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 23:38:01 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d869fc9-2c14-4784-aa11-87edd52b76c9 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] <== connect_volume: return (1360ms) {'type': 'block', 'scsi_wwn': '26434353736303239', 'path': '/dev/sdd'} {{(pid=75045) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 23:38:01 user nova-compute[75045]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0d869fc9-2c14-4784-aa11-87edd52b76c9 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] [instance: 78955913-bbab-4b00-bc9b-12116f249d7e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26434353736303239', 'path': '/dev/sdd'} {{(pid=75045) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 23:38:01 user nova-compute[75045]: DEBUG nova.virt.libvirt.vif [None req-0d869fc9-2c14-4784-aa11-87edd52b76c9 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-08T23:33:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1514498655',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1514498655',id=34,image_ref='53c5731d-3d3c-4bc6-805a-27cd1bde48d9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1615005599',keypairs=<?>,launch_index=0,launched_at=2023-11-08T23:33:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='3ad736027d034259a052da3f62bd575f',ramdisk_id='',reservation_id='r-ofqmeskf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1769593098',owner_user_name='tempest-AttachVolumeShelveTestJSON-1769593098-project-member',shelved_at='2023-11-08T23:35:10.453418',shelved_host='user',shelved_image_id='53c5731d-3d3c-4bc6-805a-27cd1bde48d9'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T23:36:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7a98fe96727741d0b148f3aaa8abf6f1',uuid=78955913-bbab-4b00-bc9b-12116f249d7e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "fc66a792-914f-48c4-ae57-cbda1615ff0b", "address": "fa:16:3e:58:00:3d", "network": {"id": "1b10bc53-ef32-4f01-82f6-ed9f95f7e3f2", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-518782773-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.43", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ad736027d034259a052da3f62bd575f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc66a792-91", "ovs_interfaceid": "fc66a792-914f-48c4-ae57-cbda1615ff0b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75045) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 23:38:01 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-0d869fc9-2c14-4784-aa11-87edd52b76c9 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] Converting VIF {"id": "fc66a792-914f-48c4-ae57-cbda1615ff0b", "address": "fa:16:3e:58:00:3d", "network": {"id": "1b10bc53-ef32-4f01-82f6-ed9f95f7e3f2", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-518782773-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.43", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ad736027d034259a052da3f62bd575f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc66a792-91", "ovs_interfaceid": "fc66a792-914f-48c4-ae57-cbda1615ff0b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 23:38:01 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-0d869fc9-2c14-4784-aa11-87edd52b76c9 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:58:00:3d,bridge_name='br-int',has_traffic_filtering=True,id=fc66a792-914f-48c4-ae57-cbda1615ff0b,network=Network(1b10bc53-ef32-4f01-82f6-ed9f95f7e3f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc66a792-91') {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 23:38:01 user nova-compute[75045]: DEBUG nova.objects.instance [None req-0d869fc9-2c14-4784-aa11-87edd52b76c9 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] Lazy-loading 'pci_devices' on Instance uuid 78955913-bbab-4b00-bc9b-12116f249d7e {{(pid=75045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 23:38:01 user nova-compute[75045]: DEBUG nova.objects.base [None req-0d869fc9-2c14-4784-aa11-87edd52b76c9 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] Object Instance<78955913-bbab-4b00-bc9b-12116f249d7e> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=75045) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 23:38:01 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-0d869fc9-2c14-4784-aa11-87edd52b76c9 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] [instance: 78955913-bbab-4b00-bc9b-12116f249d7e] End _get_guest_xml xml=<domain type="kvm">
Nov 08 23:38:01 user nova-compute[75045]:   <uuid>78955913-bbab-4b00-bc9b-12116f249d7e</uuid>
Nov 08 23:38:01 user nova-compute[75045]:   <name>instance-00000022</name>
Nov 08 23:38:01 user nova-compute[75045]:   <memory>524288</memory>
Nov 08 23:38:01 user nova-compute[75045]:   <vcpu>1</vcpu>
Nov 08 23:38:01 user nova-compute[75045]:   <metadata>
Nov 08 23:38:01 user nova-compute[75045]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 23:38:01 user nova-compute[75045]:       <nova:package version="0.0.0"/>
Nov 08 23:38:01 user nova-compute[75045]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1514498655</nova:name>
Nov 08 23:38:01 user nova-compute[75045]:       <nova:creationTime>2023-11-08 23:38:00</nova:creationTime>
Nov 08 23:38:01 user nova-compute[75045]:       <nova:flavor name="m1.tiny">
Nov 08 23:38:01 user nova-compute[75045]:         <nova:memory>512</nova:memory>
Nov 08 23:38:01 user nova-compute[75045]:         <nova:disk>1</nova:disk>
Nov 08 23:38:01 user nova-compute[75045]:         <nova:swap>0</nova:swap>
Nov 08 23:38:01 user nova-compute[75045]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 23:38:01 user nova-compute[75045]:         <nova:vcpus>1</nova:vcpus>
Nov 08 23:38:01 user nova-compute[75045]:       </nova:flavor>
Nov 08 23:38:01 user nova-compute[75045]:       <nova:owner>
Nov 08 23:38:01 user nova-compute[75045]:         <nova:user uuid="7a98fe96727741d0b148f3aaa8abf6f1">tempest-AttachVolumeShelveTestJSON-1769593098-project-member</nova:user>
Nov 08 23:38:01 user nova-compute[75045]:         <nova:project uuid="3ad736027d034259a052da3f62bd575f">tempest-AttachVolumeShelveTestJSON-1769593098</nova:project>
Nov 08 23:38:01 user nova-compute[75045]:       </nova:owner>
Nov 08 23:38:01 user nova-compute[75045]:       <nova:root type="image" uuid="53c5731d-3d3c-4bc6-805a-27cd1bde48d9"/>
Nov 08 23:38:01 user nova-compute[75045]:       <nova:ports>
Nov 08 23:38:01 user nova-compute[75045]:         <nova:port uuid="fc66a792-914f-48c4-ae57-cbda1615ff0b">
Nov 08 23:38:01 user nova-compute[75045]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 08 23:38:01 user nova-compute[75045]:         </nova:port>
Nov 08 23:38:01 user nova-compute[75045]:       </nova:ports>
Nov 08 23:38:01 user nova-compute[75045]:     </nova:instance>
Nov 08 23:38:01 user nova-compute[75045]:   </metadata>
Nov 08 23:38:01 user nova-compute[75045]:   <sysinfo type="smbios">
Nov 08 23:38:01 user nova-compute[75045]:     <system>
Nov 08 23:38:01 user nova-compute[75045]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 23:38:01 user nova-compute[75045]:       <entry name="product">OpenStack Nova</entry>
Nov 08 23:38:01 user nova-compute[75045]:       <entry name="version">0.0.0</entry>
Nov 08 23:38:01 user nova-compute[75045]:       <entry name="serial">78955913-bbab-4b00-bc9b-12116f249d7e</entry>
Nov 08 23:38:01 user nova-compute[75045]:       <entry name="uuid">78955913-bbab-4b00-bc9b-12116f249d7e</entry>
Nov 08 23:38:01 user nova-compute[75045]:       <entry name="family">Virtual Machine</entry>
Nov 08 23:38:01 user nova-compute[75045]:     </system>
Nov 08 23:38:01 user nova-compute[75045]:   </sysinfo>
Nov 08 23:38:01 user nova-compute[75045]:   <os>
Nov 08 23:38:01 user nova-compute[75045]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 23:38:01 user nova-compute[75045]:     <boot dev="hd"/>
Nov 08 23:38:01 user nova-compute[75045]:     <smbios mode="sysinfo"/>
Nov 08 23:38:01 user nova-compute[75045]:   </os>
Nov 08 23:38:01 user nova-compute[75045]:   <features>
Nov 08 23:38:01 user nova-compute[75045]:     <acpi/>
Nov 08 23:38:01 user nova-compute[75045]:     <apic/>
Nov 08 23:38:01 user nova-compute[75045]:     <vmcoreinfo/>
Nov 08 23:38:01 user nova-compute[75045]:   </features>
Nov 08 23:38:01 user nova-compute[75045]:   <clock offset="utc">
Nov 08 23:38:01 user nova-compute[75045]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 23:38:01 user nova-compute[75045]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 23:38:01 user nova-compute[75045]:     <timer name="hpet" present="no"/>
Nov 08 23:38:01 user nova-compute[75045]:   </clock>
Nov 08 23:38:01 user nova-compute[75045]:   <cpu mode="custom" match="exact">
Nov 08 23:38:01 user nova-compute[75045]:     <model>Nehalem</model>
Nov 08 23:38:01 user nova-compute[75045]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 23:38:01 user nova-compute[75045]:   </cpu>
Nov 08 23:38:01 user nova-compute[75045]:   <devices>
Nov 08 23:38:01 user nova-compute[75045]:     <disk type="file" device="disk">
Nov 08 23:38:01 user nova-compute[75045]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 23:38:01 user nova-compute[75045]:       <source file="/opt/stack/data/nova/instances/78955913-bbab-4b00-bc9b-12116f249d7e/disk"/>
Nov 08 23:38:01 user nova-compute[75045]:       <target dev="vda" bus="virtio"/>
Nov 08 23:38:01 user nova-compute[75045]:     </disk>
Nov 08 23:38:01 user nova-compute[75045]:     <disk type="block" device="disk">
Nov 08 23:38:01 user nova-compute[75045]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 23:38:01 user nova-compute[75045]:       <source dev="/dev/sdd"/>
Nov 08 23:38:01 user nova-compute[75045]:       <target dev="vdc" bus="virtio"/>
Nov 08 23:38:01 user nova-compute[75045]:       <serial>5c6e98f2-e9be-4c1a-b335-61187862dfec</serial>
Nov 08 23:38:01 user nova-compute[75045]:     </disk>
Nov 08 23:38:01 user nova-compute[75045]:     <interface type="ethernet">
Nov 08 23:38:01 user nova-compute[75045]:       <mac address="fa:16:3e:58:00:3d"/>
Nov 08 23:38:01 user nova-compute[75045]:       <model type="virtio"/>
Nov 08 23:38:01 user nova-compute[75045]:       <mtu size="1442"/>
Nov 08 23:38:01 user nova-compute[75045]:       <target dev="tapfc66a792-91"/>
Nov 08 23:38:01 user nova-compute[75045]:     </interface>
Nov 08 23:38:01 user nova-compute[75045]:     <serial type="pty">
Nov 08 23:38:01 user nova-compute[75045]:       <log file="/opt/stack/data/nova/instances/78955913-bbab-4b00-bc9b-12116f249d7e/console.log" append="off"/>
Nov 08 23:38:01 user nova-compute[75045]:     </serial>
Nov 08 23:38:01 user nova-compute[75045]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 23:38:01 user nova-compute[75045]:     <video>
Nov 08 23:38:01 user nova-compute[75045]:       <model type="virtio"/>
Nov 08 23:38:01 user nova-compute[75045]:     </video>
Nov 08 23:38:01 user nova-compute[75045]:     <rng model="virtio">
Nov 08 23:38:01 user nova-compute[75045]:       <backend model="random">/dev/urandom</backend>
Nov 08 23:38:01 user nova-compute[75045]:     </rng>
Nov 08 23:38:01 user nova-compute[75045]:     <controller type="usb" index="0" model="none"/>
Nov 08 23:38:01 user nova-compute[75045]:     <memballoon model="virtio">
Nov 08 23:38:01 user nova-compute[75045]:       <stats period="10"/>
Nov 08 23:38:01 user nova-compute[75045]:     </memballoon>
Nov 08 23:38:01 user nova-compute[75045]:   </devices>
Nov 08 23:38:01 user nova-compute[75045]: </domain>
Nov 08 23:38:01 user nova-compute[75045]:  {{(pid=75045) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 23:38:01 user nova-compute[75045]: DEBUG nova.virt.libvirt.vif [None req-0d869fc9-2c14-4784-aa11-87edd52b76c9 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-08T23:33:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1514498655',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1514498655',id=34,image_ref='53c5731d-3d3c-4bc6-805a-27cd1bde48d9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1615005599',keypairs=<?>,launch_index=0,launched_at=2023-11-08T23:33:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='3ad736027d034259a052da3f62bd575f',ramdisk_id='',reservation_id='r-ofqmeskf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1769593098',owner_user_name='tempest-AttachVolumeShelveTestJSON-1769593098-project-member',shelved_at='2023-11-08T23:35:10.453418',shelved_host='user',shelved_image_id='53c5731d-3d3c-4bc6-805a-27cd1bde48d9'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T23:36:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7a98fe96727741d0b148f3aaa8abf6f1',uuid=78955913-bbab-4b00-bc9b-12116f249d7e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "fc66a792-914f-48c4-ae57-cbda1615ff0b", "address": "fa:16:3e:58:00:3d", "network": {"id": "1b10bc53-ef32-4f01-82f6-ed9f95f7e3f2", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-518782773-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.43", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ad736027d034259a052da3f62bd575f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc66a792-91", "ovs_interfaceid": "fc66a792-914f-48c4-ae57-cbda1615ff0b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75045) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 23:38:01 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-0d869fc9-2c14-4784-aa11-87edd52b76c9 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] Converting VIF {"id": "fc66a792-914f-48c4-ae57-cbda1615ff0b", "address": "fa:16:3e:58:00:3d", "network": {"id": "1b10bc53-ef32-4f01-82f6-ed9f95f7e3f2", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-518782773-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.43", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ad736027d034259a052da3f62bd575f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc66a792-91", "ovs_interfaceid": "fc66a792-914f-48c4-ae57-cbda1615ff0b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 23:38:01 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-0d869fc9-2c14-4784-aa11-87edd52b76c9 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:58:00:3d,bridge_name='br-int',has_traffic_filtering=True,id=fc66a792-914f-48c4-ae57-cbda1615ff0b,network=Network(1b10bc53-ef32-4f01-82f6-ed9f95f7e3f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc66a792-91') {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 23:38:01 user nova-compute[75045]: DEBUG os_vif [None req-0d869fc9-2c14-4784-aa11-87edd52b76c9 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:58:00:3d,bridge_name='br-int',has_traffic_filtering=True,id=fc66a792-914f-48c4-ae57-cbda1615ff0b,network=Network(1b10bc53-ef32-4f01-82f6-ed9f95f7e3f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc66a792-91') {{(pid=75045) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 23:38:01 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:38:01 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:38:01 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 23:38:01 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:38:01 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e46fb777-631c-53c6-ace4-96a1c31458fd', '_type': 'linux-noop'}}, row=False) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:38:01 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:38:01 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 23:38:01 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:38:01 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfc66a792-91, may_exist=True, interface_attrs={}) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:38:01 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapfc66a792-91, col_values=(('qos', UUID('03025d86-8415-45c6-8695-652dd16cdfe6')),), if_exists=True) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:38:01 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapfc66a792-91, col_values=(('external_ids', {'iface-id': 'fc66a792-914f-48c4-ae57-cbda1615ff0b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:58:00:3d', 'vm-uuid': '78955913-bbab-4b00-bc9b-12116f249d7e'}),), if_exists=True) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:38:01 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:38:01 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 23:38:01 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:38:01 user nova-compute[75045]: INFO os_vif [None req-0d869fc9-2c14-4784-aa11-87edd52b76c9 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:58:00:3d,bridge_name='br-int',has_traffic_filtering=True,id=fc66a792-914f-48c4-ae57-cbda1615ff0b,network=Network(1b10bc53-ef32-4f01-82f6-ed9f95f7e3f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc66a792-91')
Nov 08 23:38:01 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:38:01 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-0d869fc9-2c14-4784-aa11-87edd52b76c9 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] No BDM found with device name vda, not building metadata. {{(pid=75045) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 23:38:01 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-0d869fc9-2c14-4784-aa11-87edd52b76c9 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75045) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 23:38:01 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-0d869fc9-2c14-4784-aa11-87edd52b76c9 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] No VIF found with MAC fa:16:3e:58:00:3d, not building metadata {{(pid=75045) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 23:38:02 user nova-compute[75045]: DEBUG nova.network.neutron [None req-ef4c6d79-ae9f-4cdc-afda-9d769cd009a6 tempest-ServerStableDeviceRescueTest-1847572360 tempest-ServerStableDeviceRescueTest-1847572360-project-member] [instance: 7ee587a0-e271-4262-a252-2ccb6c2faecb] Successfully updated port: 0b911e0a-0c01-4296-b269-f52ee68772f9 {{(pid=75045) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 23:38:02 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-ef4c6d79-ae9f-4cdc-afda-9d769cd009a6 tempest-ServerStableDeviceRescueTest-1847572360 tempest-ServerStableDeviceRescueTest-1847572360-project-member] Acquiring lock "refresh_cache-7ee587a0-e271-4262-a252-2ccb6c2faecb" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 23:38:02 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-ef4c6d79-ae9f-4cdc-afda-9d769cd009a6 tempest-ServerStableDeviceRescueTest-1847572360 tempest-ServerStableDeviceRescueTest-1847572360-project-member] Acquired lock "refresh_cache-7ee587a0-e271-4262-a252-2ccb6c2faecb" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 23:38:02 user nova-compute[75045]: DEBUG nova.network.neutron [None req-ef4c6d79-ae9f-4cdc-afda-9d769cd009a6 tempest-ServerStableDeviceRescueTest-1847572360 tempest-ServerStableDeviceRescueTest-1847572360-project-member] [instance: 7ee587a0-e271-4262-a252-2ccb6c2faecb] Building network info cache for instance {{(pid=75045) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 23:38:02 user nova-compute[75045]: DEBUG nova.compute.manager [req-a1b45581-6991-442d-99ad-f7ade50c38f1 req-f2373305-4e8a-4844-94a7-ec14da197483 service nova] [instance: 7ee587a0-e271-4262-a252-2ccb6c2faecb] Received event network-changed-0b911e0a-0c01-4296-b269-f52ee68772f9 {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:38:02 user nova-compute[75045]: DEBUG nova.compute.manager [req-a1b45581-6991-442d-99ad-f7ade50c38f1 req-f2373305-4e8a-4844-94a7-ec14da197483 service nova] [instance: 7ee587a0-e271-4262-a252-2ccb6c2faecb] Refreshing instance network info cache due to event network-changed-0b911e0a-0c01-4296-b269-f52ee68772f9. {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 23:38:02 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-a1b45581-6991-442d-99ad-f7ade50c38f1 req-f2373305-4e8a-4844-94a7-ec14da197483 service nova] Acquiring lock "refresh_cache-7ee587a0-e271-4262-a252-2ccb6c2faecb" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 23:38:02 user nova-compute[75045]: DEBUG nova.network.neutron [None req-ef4c6d79-ae9f-4cdc-afda-9d769cd009a6 tempest-ServerStableDeviceRescueTest-1847572360 tempest-ServerStableDeviceRescueTest-1847572360-project-member] [instance: 7ee587a0-e271-4262-a252-2ccb6c2faecb] Instance cache missing network info. {{(pid=75045) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 23:38:02 user nova-compute[75045]: DEBUG nova.network.neutron [None req-ef4c6d79-ae9f-4cdc-afda-9d769cd009a6 tempest-ServerStableDeviceRescueTest-1847572360 tempest-ServerStableDeviceRescueTest-1847572360-project-member] [instance: 7ee587a0-e271-4262-a252-2ccb6c2faecb] Updating instance_info_cache with network_info: [{"id": "0b911e0a-0c01-4296-b269-f52ee68772f9", "address": "fa:16:3e:03:88:6d", "network": {"id": "3fc25e49-b987-4fe7-9c28-6a18b689a411", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1301325538-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4760b2fb18b44e26bfbca6bf16aea581", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b911e0a-0c", "ovs_interfaceid": "0b911e0a-0c01-4296-b269-f52ee68772f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75045) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 23:38:02 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-ef4c6d79-ae9f-4cdc-afda-9d769cd009a6 tempest-ServerStableDeviceRescueTest-1847572360 tempest-ServerStableDeviceRescueTest-1847572360-project-member] Releasing lock "refresh_cache-7ee587a0-e271-4262-a252-2ccb6c2faecb" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 23:38:02 user nova-compute[75045]: DEBUG nova.compute.manager [None req-ef4c6d79-ae9f-4cdc-afda-9d769cd009a6 tempest-ServerStableDeviceRescueTest-1847572360 tempest-ServerStableDeviceRescueTest-1847572360-project-member] [instance: 7ee587a0-e271-4262-a252-2ccb6c2faecb] Instance network_info: |[{"id": "0b911e0a-0c01-4296-b269-f52ee68772f9", "address": "fa:16:3e:03:88:6d", "network": {"id": "3fc25e49-b987-4fe7-9c28-6a18b689a411", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1301325538-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4760b2fb18b44e26bfbca6bf16aea581", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b911e0a-0c", "ovs_interfaceid": "0b911e0a-0c01-4296-b269-f52ee68772f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75045) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 23:38:02 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-a1b45581-6991-442d-99ad-f7ade50c38f1 req-f2373305-4e8a-4844-94a7-ec14da197483 service nova] Acquired lock "refresh_cache-7ee587a0-e271-4262-a252-2ccb6c2faecb" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 23:38:02 user nova-compute[75045]: DEBUG nova.network.neutron [req-a1b45581-6991-442d-99ad-f7ade50c38f1 req-f2373305-4e8a-4844-94a7-ec14da197483 service nova] [instance: 7ee587a0-e271-4262-a252-2ccb6c2faecb] Refreshing network info cache for port 0b911e0a-0c01-4296-b269-f52ee68772f9 {{(pid=75045) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 23:38:02 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-ef4c6d79-ae9f-4cdc-afda-9d769cd009a6 tempest-ServerStableDeviceRescueTest-1847572360 tempest-ServerStableDeviceRescueTest-1847572360-project-member] [instance: 7ee587a0-e271-4262-a252-2ccb6c2faecb] Start _get_guest_xml network_info=[{"id": "0b911e0a-0c01-4296-b269-f52ee68772f9", "address": "fa:16:3e:03:88:6d", "network": {"id": "3fc25e49-b987-4fe7-9c28-6a18b689a411", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1301325538-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4760b2fb18b44e26bfbca6bf16aea581", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b911e0a-0c", "ovs_interfaceid": "0b911e0a-0c01-4296-b269-f52ee68772f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T23:11:54Z,direct_url=<?>,disk_format='qcow2',id=a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b1beba2cc4e7465ea249e2225fb494dc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T23:11:56Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'disk_bus': 'virtio', 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': 'a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75045) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 23:38:02 user nova-compute[75045]: WARNING nova.virt.libvirt.driver [None req-ef4c6d79-ae9f-4cdc-afda-9d769cd009a6 tempest-ServerStableDeviceRescueTest-1847572360 tempest-ServerStableDeviceRescueTest-1847572360-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 23:38:02 user nova-compute[75045]: WARNING nova.virt.libvirt.driver [None req-ef4c6d79-ae9f-4cdc-afda-9d769cd009a6 tempest-ServerStableDeviceRescueTest-1847572360 tempest-ServerStableDeviceRescueTest-1847572360-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 23:38:02 user nova-compute[75045]: DEBUG nova.virt.libvirt.host [None req-ef4c6d79-ae9f-4cdc-afda-9d769cd009a6 tempest-ServerStableDeviceRescueTest-1847572360 tempest-ServerStableDeviceRescueTest-1847572360-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75045) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 23:38:02 user nova-compute[75045]: DEBUG nova.virt.libvirt.host [None req-ef4c6d79-ae9f-4cdc-afda-9d769cd009a6 tempest-ServerStableDeviceRescueTest-1847572360 tempest-ServerStableDeviceRescueTest-1847572360-project-member] CPU controller missing on host. {{(pid=75045) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 23:38:02 user nova-compute[75045]: DEBUG nova.virt.libvirt.host [None req-ef4c6d79-ae9f-4cdc-afda-9d769cd009a6 tempest-ServerStableDeviceRescueTest-1847572360 tempest-ServerStableDeviceRescueTest-1847572360-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75045) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 23:38:02 user nova-compute[75045]: DEBUG nova.virt.libvirt.host [None req-ef4c6d79-ae9f-4cdc-afda-9d769cd009a6 tempest-ServerStableDeviceRescueTest-1847572360 tempest-ServerStableDeviceRescueTest-1847572360-project-member] CPU controller found on host. {{(pid=75045) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 23:38:02 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-ef4c6d79-ae9f-4cdc-afda-9d769cd009a6 tempest-ServerStableDeviceRescueTest-1847572360 tempest-ServerStableDeviceRescueTest-1847572360-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75045) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 23:38:02 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-ef4c6d79-ae9f-4cdc-afda-9d769cd009a6 tempest-ServerStableDeviceRescueTest-1847572360 tempest-ServerStableDeviceRescueTest-1847572360-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T23:11:41Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T23:11:54Z,direct_url=<?>,disk_format='qcow2',id=a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b1beba2cc4e7465ea249e2225fb494dc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T23:11:56Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75045) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 23:38:02 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-ef4c6d79-ae9f-4cdc-afda-9d769cd009a6 tempest-ServerStableDeviceRescueTest-1847572360 tempest-ServerStableDeviceRescueTest-1847572360-project-member] Flavor limits 0:0:0 {{(pid=75045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 23:38:02 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-ef4c6d79-ae9f-4cdc-afda-9d769cd009a6 tempest-ServerStableDeviceRescueTest-1847572360 tempest-ServerStableDeviceRescueTest-1847572360-project-member] Image limits 0:0:0 {{(pid=75045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 23:38:02 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-ef4c6d79-ae9f-4cdc-afda-9d769cd009a6 tempest-ServerStableDeviceRescueTest-1847572360 tempest-ServerStableDeviceRescueTest-1847572360-project-member] Flavor pref 0:0:0 {{(pid=75045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 23:38:02 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-ef4c6d79-ae9f-4cdc-afda-9d769cd009a6 tempest-ServerStableDeviceRescueTest-1847572360 tempest-ServerStableDeviceRescueTest-1847572360-project-member] Image pref 0:0:0 {{(pid=75045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 23:38:02 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-ef4c6d79-ae9f-4cdc-afda-9d769cd009a6 tempest-ServerStableDeviceRescueTest-1847572360 tempest-ServerStableDeviceRescueTest-1847572360-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 23:38:02 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-ef4c6d79-ae9f-4cdc-afda-9d769cd009a6 tempest-ServerStableDeviceRescueTest-1847572360 tempest-ServerStableDeviceRescueTest-1847572360-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75045) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 23:38:02 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-ef4c6d79-ae9f-4cdc-afda-9d769cd009a6 tempest-ServerStableDeviceRescueTest-1847572360 tempest-ServerStableDeviceRescueTest-1847572360-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75045) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 23:38:02 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-ef4c6d79-ae9f-4cdc-afda-9d769cd009a6 tempest-ServerStableDeviceRescueTest-1847572360 tempest-ServerStableDeviceRescueTest-1847572360-project-member] Got 1 possible topologies {{(pid=75045) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 23:38:02 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-ef4c6d79-ae9f-4cdc-afda-9d769cd009a6 tempest-ServerStableDeviceRescueTest-1847572360 tempest-ServerStableDeviceRescueTest-1847572360-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75045) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 23:38:02 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-ef4c6d79-ae9f-4cdc-afda-9d769cd009a6 tempest-ServerStableDeviceRescueTest-1847572360 tempest-ServerStableDeviceRescueTest-1847572360-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75045) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 23:38:02 user nova-compute[75045]: DEBUG nova.virt.libvirt.vif [None req-ef4c6d79-ae9f-4cdc-afda-9d769cd009a6 tempest-ServerStableDeviceRescueTest-1847572360 tempest-ServerStableDeviceRescueTest-1847572360-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T23:37:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-511845209',display_name='tempest-ServerStableDeviceRescueTest-server-511845209',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-511845209',id=37,image_ref='a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAazcJf6mPhnLZhu/TEEbRcKRzviHLHtM5RAFvtylVUl63QLHMszWdrsWATDs55dIdfOMRrB/jSYqTaEgUtPxK3t+z/n2SQh/8lXWD+YRF2sDlrMunls4XYUnke1aho+/Q==',key_name='tempest-keypair-1152195583',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4760b2fb18b44e26bfbca6bf16aea581',ramdisk_id='',reservation_id='r-wv3hsg4l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-1847572360',owner_user_name='tempest-ServerStableDeviceRescueTest-1847572360-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T23:38:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='49cdaaab1d134721a522900af5e12d8a',uuid=7ee587a0-e271-4262-a252-2ccb6c2faecb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0b911e0a-0c01-4296-b269-f52ee68772f9", "address": "fa:16:3e:03:88:6d", "network": {"id": "3fc25e49-b987-4fe7-9c28-6a18b689a411", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1301325538-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4760b2fb18b44e26bfbca6bf16aea581", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b911e0a-0c", "ovs_interfaceid": "0b911e0a-0c01-4296-b269-f52ee68772f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75045) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 23:38:02 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-ef4c6d79-ae9f-4cdc-afda-9d769cd009a6 tempest-ServerStableDeviceRescueTest-1847572360 tempest-ServerStableDeviceRescueTest-1847572360-project-member] Converting VIF {"id": "0b911e0a-0c01-4296-b269-f52ee68772f9", "address": "fa:16:3e:03:88:6d", "network": {"id": "3fc25e49-b987-4fe7-9c28-6a18b689a411", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1301325538-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4760b2fb18b44e26bfbca6bf16aea581", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b911e0a-0c", "ovs_interfaceid": "0b911e0a-0c01-4296-b269-f52ee68772f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 23:38:02 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-ef4c6d79-ae9f-4cdc-afda-9d769cd009a6 tempest-ServerStableDeviceRescueTest-1847572360 tempest-ServerStableDeviceRescueTest-1847572360-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:03:88:6d,bridge_name='br-int',has_traffic_filtering=True,id=0b911e0a-0c01-4296-b269-f52ee68772f9,network=Network(3fc25e49-b987-4fe7-9c28-6a18b689a411),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b911e0a-0c') {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 23:38:02 user nova-compute[75045]: DEBUG nova.objects.instance [None req-ef4c6d79-ae9f-4cdc-afda-9d769cd009a6 tempest-ServerStableDeviceRescueTest-1847572360 tempest-ServerStableDeviceRescueTest-1847572360-project-member] Lazy-loading 'pci_devices' on Instance uuid 7ee587a0-e271-4262-a252-2ccb6c2faecb {{(pid=75045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 23:38:02 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-ef4c6d79-ae9f-4cdc-afda-9d769cd009a6 tempest-ServerStableDeviceRescueTest-1847572360 tempest-ServerStableDeviceRescueTest-1847572360-project-member] [instance: 7ee587a0-e271-4262-a252-2ccb6c2faecb] End _get_guest_xml xml=<domain type="kvm">
Nov 08 23:38:02 user nova-compute[75045]:   <uuid>7ee587a0-e271-4262-a252-2ccb6c2faecb</uuid>
Nov 08 23:38:02 user nova-compute[75045]:   <name>instance-00000025</name>
Nov 08 23:38:02 user nova-compute[75045]:   <memory>524288</memory>
Nov 08 23:38:02 user nova-compute[75045]:   <vcpu>1</vcpu>
Nov 08 23:38:02 user nova-compute[75045]:   <metadata>
Nov 08 23:38:02 user nova-compute[75045]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 23:38:02 user nova-compute[75045]:       <nova:package version="0.0.0"/>
Nov 08 23:38:02 user nova-compute[75045]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-511845209</nova:name>
Nov 08 23:38:02 user nova-compute[75045]:       <nova:creationTime>2023-11-08 23:38:02</nova:creationTime>
Nov 08 23:38:02 user nova-compute[75045]:       <nova:flavor name="m1.tiny">
Nov 08 23:38:02 user nova-compute[75045]:         <nova:memory>512</nova:memory>
Nov 08 23:38:02 user nova-compute[75045]:         <nova:disk>1</nova:disk>
Nov 08 23:38:02 user nova-compute[75045]:         <nova:swap>0</nova:swap>
Nov 08 23:38:02 user nova-compute[75045]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 23:38:02 user nova-compute[75045]:         <nova:vcpus>1</nova:vcpus>
Nov 08 23:38:02 user nova-compute[75045]:       </nova:flavor>
Nov 08 23:38:02 user nova-compute[75045]:       <nova:owner>
Nov 08 23:38:02 user nova-compute[75045]:         <nova:user uuid="49cdaaab1d134721a522900af5e12d8a">tempest-ServerStableDeviceRescueTest-1847572360-project-member</nova:user>
Nov 08 23:38:02 user nova-compute[75045]:         <nova:project uuid="4760b2fb18b44e26bfbca6bf16aea581">tempest-ServerStableDeviceRescueTest-1847572360</nova:project>
Nov 08 23:38:02 user nova-compute[75045]:       </nova:owner>
Nov 08 23:38:02 user nova-compute[75045]:       <nova:root type="image" uuid="a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb"/>
Nov 08 23:38:02 user nova-compute[75045]:       <nova:ports>
Nov 08 23:38:02 user nova-compute[75045]:         <nova:port uuid="0b911e0a-0c01-4296-b269-f52ee68772f9">
Nov 08 23:38:02 user nova-compute[75045]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 08 23:38:02 user nova-compute[75045]:         </nova:port>
Nov 08 23:38:02 user nova-compute[75045]:       </nova:ports>
Nov 08 23:38:02 user nova-compute[75045]:     </nova:instance>
Nov 08 23:38:02 user nova-compute[75045]:   </metadata>
Nov 08 23:38:02 user nova-compute[75045]:   <sysinfo type="smbios">
Nov 08 23:38:02 user nova-compute[75045]:     <system>
Nov 08 23:38:02 user nova-compute[75045]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 23:38:02 user nova-compute[75045]:       <entry name="product">OpenStack Nova</entry>
Nov 08 23:38:02 user nova-compute[75045]:       <entry name="version">0.0.0</entry>
Nov 08 23:38:02 user nova-compute[75045]:       <entry name="serial">7ee587a0-e271-4262-a252-2ccb6c2faecb</entry>
Nov 08 23:38:02 user nova-compute[75045]:       <entry name="uuid">7ee587a0-e271-4262-a252-2ccb6c2faecb</entry>
Nov 08 23:38:02 user nova-compute[75045]:       <entry name="family">Virtual Machine</entry>
Nov 08 23:38:02 user nova-compute[75045]:     </system>
Nov 08 23:38:02 user nova-compute[75045]:   </sysinfo>
Nov 08 23:38:02 user nova-compute[75045]:   <os>
Nov 08 23:38:02 user nova-compute[75045]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 23:38:02 user nova-compute[75045]:     <boot dev="hd"/>
Nov 08 23:38:02 user nova-compute[75045]:     <smbios mode="sysinfo"/>
Nov 08 23:38:02 user nova-compute[75045]:   </os>
Nov 08 23:38:02 user nova-compute[75045]:   <features>
Nov 08 23:38:02 user nova-compute[75045]:     <acpi/>
Nov 08 23:38:02 user nova-compute[75045]:     <apic/>
Nov 08 23:38:02 user nova-compute[75045]:     <vmcoreinfo/>
Nov 08 23:38:02 user nova-compute[75045]:   </features>
Nov 08 23:38:02 user nova-compute[75045]:   <clock offset="utc">
Nov 08 23:38:02 user nova-compute[75045]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 23:38:02 user nova-compute[75045]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 23:38:02 user nova-compute[75045]:     <timer name="hpet" present="no"/>
Nov 08 23:38:02 user nova-compute[75045]:   </clock>
Nov 08 23:38:02 user nova-compute[75045]:   <cpu mode="custom" match="exact">
Nov 08 23:38:02 user nova-compute[75045]:     <model>Nehalem</model>
Nov 08 23:38:02 user nova-compute[75045]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 23:38:02 user nova-compute[75045]:   </cpu>
Nov 08 23:38:02 user nova-compute[75045]:   <devices>
Nov 08 23:38:02 user nova-compute[75045]:     <disk type="file" device="disk">
Nov 08 23:38:02 user nova-compute[75045]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 23:38:02 user nova-compute[75045]:       <source file="/opt/stack/data/nova/instances/7ee587a0-e271-4262-a252-2ccb6c2faecb/disk"/>
Nov 08 23:38:02 user nova-compute[75045]:       <target dev="vda" bus="virtio"/>
Nov 08 23:38:02 user nova-compute[75045]:     </disk>
Nov 08 23:38:02 user nova-compute[75045]:     <interface type="ethernet">
Nov 08 23:38:02 user nova-compute[75045]:       <mac address="fa:16:3e:03:88:6d"/>
Nov 08 23:38:02 user nova-compute[75045]:       <model type="virtio"/>
Nov 08 23:38:02 user nova-compute[75045]:       <mtu size="1442"/>
Nov 08 23:38:02 user nova-compute[75045]:       <target dev="tap0b911e0a-0c"/>
Nov 08 23:38:02 user nova-compute[75045]:     </interface>
Nov 08 23:38:02 user nova-compute[75045]:     <serial type="pty">
Nov 08 23:38:02 user nova-compute[75045]:       <log file="/opt/stack/data/nova/instances/7ee587a0-e271-4262-a252-2ccb6c2faecb/console.log" append="off"/>
Nov 08 23:38:02 user nova-compute[75045]:     </serial>
Nov 08 23:38:02 user nova-compute[75045]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 23:38:02 user nova-compute[75045]:     <video>
Nov 08 23:38:02 user nova-compute[75045]:       <model type="virtio"/>
Nov 08 23:38:02 user nova-compute[75045]:     </video>
Nov 08 23:38:02 user nova-compute[75045]:     <rng model="virtio">
Nov 08 23:38:02 user nova-compute[75045]:       <backend model="random">/dev/urandom</backend>
Nov 08 23:38:02 user nova-compute[75045]:     </rng>
Nov 08 23:38:02 user nova-compute[75045]:     <controller type="usb" index="0" model="none"/>
Nov 08 23:38:02 user nova-compute[75045]:     <memballoon model="virtio">
Nov 08 23:38:02 user nova-compute[75045]:       <stats period="10"/>
Nov 08 23:38:02 user nova-compute[75045]:     </memballoon>
Nov 08 23:38:02 user nova-compute[75045]:   </devices>
Nov 08 23:38:02 user nova-compute[75045]: </domain>
Nov 08 23:38:02 user nova-compute[75045]:  {{(pid=75045) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 23:38:02 user nova-compute[75045]: DEBUG nova.virt.libvirt.vif [None req-ef4c6d79-ae9f-4cdc-afda-9d769cd009a6 tempest-ServerStableDeviceRescueTest-1847572360 tempest-ServerStableDeviceRescueTest-1847572360-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T23:37:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-511845209',display_name='tempest-ServerStableDeviceRescueTest-server-511845209',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-511845209',id=37,image_ref='a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAazcJf6mPhnLZhu/TEEbRcKRzviHLHtM5RAFvtylVUl63QLHMszWdrsWATDs55dIdfOMRrB/jSYqTaEgUtPxK3t+z/n2SQh/8lXWD+YRF2sDlrMunls4XYUnke1aho+/Q==',key_name='tempest-keypair-1152195583',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4760b2fb18b44e26bfbca6bf16aea581',ramdisk_id='',reservation_id='r-wv3hsg4l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-1847572360',owner_user_name='tempest-ServerStableDeviceRescueTest-1847572360-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T23:38:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='49cdaaab1d134721a522900af5e12d8a',uuid=7ee587a0-e271-4262-a252-2ccb6c2faecb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0b911e0a-0c01-4296-b269-f52ee68772f9", "address": "fa:16:3e:03:88:6d", "network": {"id": "3fc25e49-b987-4fe7-9c28-6a18b689a411", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1301325538-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4760b2fb18b44e26bfbca6bf16aea581", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b911e0a-0c", "ovs_interfaceid": "0b911e0a-0c01-4296-b269-f52ee68772f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75045) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 23:38:02 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-ef4c6d79-ae9f-4cdc-afda-9d769cd009a6 tempest-ServerStableDeviceRescueTest-1847572360 tempest-ServerStableDeviceRescueTest-1847572360-project-member] Converting VIF {"id": "0b911e0a-0c01-4296-b269-f52ee68772f9", "address": "fa:16:3e:03:88:6d", "network": {"id": "3fc25e49-b987-4fe7-9c28-6a18b689a411", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1301325538-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4760b2fb18b44e26bfbca6bf16aea581", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b911e0a-0c", "ovs_interfaceid": "0b911e0a-0c01-4296-b269-f52ee68772f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 23:38:02 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-ef4c6d79-ae9f-4cdc-afda-9d769cd009a6 tempest-ServerStableDeviceRescueTest-1847572360 tempest-ServerStableDeviceRescueTest-1847572360-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:03:88:6d,bridge_name='br-int',has_traffic_filtering=True,id=0b911e0a-0c01-4296-b269-f52ee68772f9,network=Network(3fc25e49-b987-4fe7-9c28-6a18b689a411),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b911e0a-0c') {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 23:38:02 user nova-compute[75045]: DEBUG os_vif [None req-ef4c6d79-ae9f-4cdc-afda-9d769cd009a6 tempest-ServerStableDeviceRescueTest-1847572360 tempest-ServerStableDeviceRescueTest-1847572360-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:03:88:6d,bridge_name='br-int',has_traffic_filtering=True,id=0b911e0a-0c01-4296-b269-f52ee68772f9,network=Network(3fc25e49-b987-4fe7-9c28-6a18b689a411),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b911e0a-0c') {{(pid=75045) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 23:38:02 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:38:02 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:38:02 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 23:38:02 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:38:02 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ac8e3f05-143c-5783-a330-e7e65be5b97b', '_type': 'linux-noop'}}, row=False) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:38:02 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:38:02 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 23:38:02 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:38:02 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:38:02 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0b911e0a-0c, may_exist=True, interface_attrs={}) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:38:02 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0b911e0a-0c, col_values=(('qos', UUID('cbcf8865-0d32-4330-9017-54647be1d604')),), if_exists=True) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:38:02 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0b911e0a-0c, col_values=(('external_ids', {'iface-id': '0b911e0a-0c01-4296-b269-f52ee68772f9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:03:88:6d', 'vm-uuid': '7ee587a0-e271-4262-a252-2ccb6c2faecb'}),), if_exists=True) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:38:02 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:38:02 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 23:38:02 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:38:02 user nova-compute[75045]: INFO os_vif [None req-ef4c6d79-ae9f-4cdc-afda-9d769cd009a6 tempest-ServerStableDeviceRescueTest-1847572360 tempest-ServerStableDeviceRescueTest-1847572360-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:03:88:6d,bridge_name='br-int',has_traffic_filtering=True,id=0b911e0a-0c01-4296-b269-f52ee68772f9,network=Network(3fc25e49-b987-4fe7-9c28-6a18b689a411),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b911e0a-0c')
Nov 08 23:38:02 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-ef4c6d79-ae9f-4cdc-afda-9d769cd009a6 tempest-ServerStableDeviceRescueTest-1847572360 tempest-ServerStableDeviceRescueTest-1847572360-project-member] No BDM found with device name vda, not building metadata. {{(pid=75045) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 23:38:02 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-ef4c6d79-ae9f-4cdc-afda-9d769cd009a6 tempest-ServerStableDeviceRescueTest-1847572360 tempest-ServerStableDeviceRescueTest-1847572360-project-member] No VIF found with MAC fa:16:3e:03:88:6d, not building metadata {{(pid=75045) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 23:38:02 user nova-compute[75045]: DEBUG nova.network.neutron [req-a1b45581-6991-442d-99ad-f7ade50c38f1 req-f2373305-4e8a-4844-94a7-ec14da197483 service nova] [instance: 7ee587a0-e271-4262-a252-2ccb6c2faecb] Updated VIF entry in instance network info cache for port 0b911e0a-0c01-4296-b269-f52ee68772f9. {{(pid=75045) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 23:38:02 user nova-compute[75045]: DEBUG nova.network.neutron [req-a1b45581-6991-442d-99ad-f7ade50c38f1 req-f2373305-4e8a-4844-94a7-ec14da197483 service nova] [instance: 7ee587a0-e271-4262-a252-2ccb6c2faecb] Updating instance_info_cache with network_info: [{"id": "0b911e0a-0c01-4296-b269-f52ee68772f9", "address": "fa:16:3e:03:88:6d", "network": {"id": "3fc25e49-b987-4fe7-9c28-6a18b689a411", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1301325538-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4760b2fb18b44e26bfbca6bf16aea581", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b911e0a-0c", "ovs_interfaceid": "0b911e0a-0c01-4296-b269-f52ee68772f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75045) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 23:38:02 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-a1b45581-6991-442d-99ad-f7ade50c38f1 req-f2373305-4e8a-4844-94a7-ec14da197483 service nova] Releasing lock "refresh_cache-7ee587a0-e271-4262-a252-2ccb6c2faecb" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 23:38:03 user nova-compute[75045]: WARNING nova.virt.libvirt.driver [None req-47c35086-f020-4ac2-bb27-7ed07a65a655 tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 9222e62a-9fd8-48b2-a125-83c9cdc589bd is timed out.
Nov 08 23:38:03 user nova-compute[75045]: INFO nova.virt.libvirt.driver [None req-47c35086-f020-4ac2-bb27-7ed07a65a655 tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] Successfully detached device vdb from instance 9222e62a-9fd8-48b2-a125-83c9cdc589bd from the live domain config.
Nov 08 23:38:03 user nova-compute[75045]: DEBUG nova.virt.libvirt.volume.iscsi [None req-47c35086-f020-4ac2-bb27-7ed07a65a655 tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] [instance: 9222e62a-9fd8-48b2-a125-83c9cdc589bd] calling os-brick to detach iSCSI Volume {{(pid=75045) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 23:38:03 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-47c35086-f020-4ac2-bb27-7ed07a65a655 tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1b68210460>, {'target_iqn': 'iqn.2010-10.org.openstack:1b2a3b04-13be-4853-822c-29c416757252', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MAhTqXGu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75045) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 23:38:03 user nova-compute[75045]: WARNING os_brick.initiator.connectors.base [None req-47c35086-f020-4ac2-bb27-7ed07a65a655 tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 23:38:03 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-47c35086-f020-4ac2-bb27-7ed07a65a655 tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 23:38:03 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-47c35086-f020-4ac2-bb27-7ed07a65a655 tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 23:38:03 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:38:03 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:38:03 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[049e0ea6-5963-4a7b-9398-07819b6dbbea]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5c6e98f2-e9be-4c1a-b335-61187862dfec\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3f065c57-b67d-415e-9b6a-77d213104733\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1b2a3b04-13be-4853-822c-29c416757252\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:38:03 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-47c35086-f020-4ac2-bb27-7ed07a65a655 tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 23:38:03 user nova-compute[75045]: No targets found.
Nov 08 23:38:03 user nova-compute[75045]: iSNS:
Nov 08 23:38:03 user nova-compute[75045]: No targets found.
Nov 08 23:38:03 user nova-compute[75045]: STATIC:
Nov 08 23:38:03 user nova-compute[75045]: Target: iqn.2010-10.org.openstack:5c6e98f2-e9be-4c1a-b335-61187862dfec
Nov 08 23:38:03 user nova-compute[75045]:         Portal: 172.16.0.220:3260,-1
Nov 08 23:38:03 user nova-compute[75045]:                 Iface Name: default
Nov 08 23:38:03 user nova-compute[75045]: Target: iqn.2010-10.org.openstack:3f065c57-b67d-415e-9b6a-77d213104733
Nov 08 23:38:03 user nova-compute[75045]:         Portal: 172.16.0.220:3260,-1
Nov 08 23:38:03 user nova-compute[75045]:                 Iface Name: default
Nov 08 23:38:03 user nova-compute[75045]: Target: iqn.2010-10.org.openstack:1b2a3b04-13be-4853-822c-29c416757252
Nov 08 23:38:03 user nova-compute[75045]:         Portal: 172.16.0.220:3260,-1
Nov 08 23:38:03 user nova-compute[75045]:                 Iface Name: default
Nov 08 23:38:03 user nova-compute[75045]: FIRMWARE:
Nov 08 23:38:03 user nova-compute[75045]: No targets found.
Nov 08 23:38:03 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 23:38:03 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-47c35086-f020-4ac2-bb27-7ed07a65a655 tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 23:38:03 user nova-compute[75045]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 23:38:03 user nova-compute[75045]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75045) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 23:38:03 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-47c35086-f020-4ac2-bb27-7ed07a65a655 tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1b2a3b04-13be-4853-822c-29c416757252', 0)] {{(pid=75045) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 23:38:03 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:38:03 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:38:03 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[155f57d3-a731-474a-97dd-7cf1ce227ec3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1b2a3b04-13be-4853-822c-29c416757252\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3f065c57-b67d-415e-9b6a-77d213104733\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5c6e98f2-e9be-4c1a-b335-61187862dfec\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:38:03 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:38:03 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:38:03 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:38:03 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[12c146b0-504d-447a-af37-0ab0c8437805]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b2a3b04-13be-4853-822c-29c416757252 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f065c57-b67d-415e-9b6a-77d213104733 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c6e98f2-e9be-4c1a-b335-61187862dfec (non-flash)\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:38:03 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-47c35086-f020-4ac2-bb27-7ed07a65a655 tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b2a3b04-13be-4853-822c-29c416757252 (non-flash)
Nov 08 23:38:03 user nova-compute[75045]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f065c57-b67d-415e-9b6a-77d213104733 (non-flash)
Nov 08 23:38:03 user nova-compute[75045]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c6e98f2-e9be-4c1a-b335-61187862dfec (non-flash)
Nov 08 23:38:03 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 23:38:03 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-47c35086-f020-4ac2-bb27-7ed07a65a655 tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b2a3b04-13be-4853-822c-29c416757252 (non-flash)
Nov 08 23:38:03 user nova-compute[75045]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f065c57-b67d-415e-9b6a-77d213104733 (non-flash)
Nov 08 23:38:03 user nova-compute[75045]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c6e98f2-e9be-4c1a-b335-61187862dfec (non-flash)
Nov 08 23:38:03 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 23:38:03 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-47c35086-f020-4ac2-bb27-7ed07a65a655 tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1b68111cf0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1b2a3b04-13be-4853-822c-29c416757252'): ({'sdb'}, set())}) {{(pid=75045) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 23:38:03 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-47c35086-f020-4ac2-bb27-7ed07a65a655 tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] Removing single pathed devices sdb {{(pid=75045) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 23:38:03 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:38:03 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:38:03 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:38:03 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[d89ead4f-ced1-41ca-8237-3bf50bd4205c]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:38:03 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:38:03 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:38:03 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:38:03 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.023s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:38:03 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[90d99e9a-392e-49ca-89b4-c9d3de2fc365]: (4, ('ok\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:38:03 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-47c35086-f020-4ac2-bb27-7ed07a65a655 tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] Flushing IO for device /dev/sdb {{(pid=75045) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 23:38:03 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:38:03 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:38:03 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6f96b99-c116-47dc-987e-29a3a734c827]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:38:03 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-47c35086-f020-4ac2-bb27-7ed07a65a655 tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75045) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 23:38:03 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:38:03 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.048s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:38:03 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[642bd8a8-1939-4ce9-a249-ccd3680ea274]: (4, ('1', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:38:03 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-47c35086-f020-4ac2-bb27-7ed07a65a655 tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75045) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 23:38:03 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-47c35086-f020-4ac2-bb27-7ed07a65a655 tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] SCSI volumes sdb have been removed. {{(pid=75045) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 23:38:03 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-47c35086-f020-4ac2-bb27-7ed07a65a655 tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1b2a3b04-13be-4853-822c-29c416757252')] {{(pid=75045) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 23:38:03 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b2a3b04-13be-4853-822c-29c416757252 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:38:03 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b2a3b04-13be-4853-822c-29c416757252 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:38:03 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8b02c8c-c309-4d5b-a7fd-5168ffa9748e]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:38:03 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-47c35086-f020-4ac2-bb27-7ed07a65a655 tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:38:03 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b2a3b04-13be-4853-822c-29c416757252 -p 172.16.0.220:3260 --logout {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:38:03 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b2a3b04-13be-4853-822c-29c416757252 -p 172.16.0.220:3260 --logout" returned: 0 in 0.078s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:38:03 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[f525446f-31fa-4da8-969b-041025c91066]: (4, ('Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:1b2a3b04-13be-4853-822c-29c416757252, portal: 172.16.0.220,3260]\nLogout of [sid: 34, target: iqn.2010-10.org.openstack:1b2a3b04-13be-4853-822c-29c416757252, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:38:03 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-47c35086-f020-4ac2-bb27-7ed07a65a655 tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:1b2a3b04-13be-4853-822c-29c416757252, portal: 172.16.0.220,3260]
Nov 08 23:38:03 user nova-compute[75045]: Logout of [sid: 34, target: iqn.2010-10.org.openstack:1b2a3b04-13be-4853-822c-29c416757252, portal: 172.16.0.220,3260] successful.
Nov 08 23:38:03 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:38:03 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b2a3b04-13be-4853-822c-29c416757252 -p 172.16.0.220:3260 --op delete {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:38:03 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b2a3b04-13be-4853-822c-29c416757252 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:38:03 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9910344-1206-4dbb-bdd0-eb3303254042]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:38:03 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-47c35086-f020-4ac2-bb27-7ed07a65a655 tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:38:03 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-47c35086-f020-4ac2-bb27-7ed07a65a655 tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.364s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 23:38:03 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-47c35086-f020-4ac2-bb27-7ed07a65a655 tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] <== disconnect_volume: return (365ms) None {{(pid=75045) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 23:38:03 user nova-compute[75045]: DEBUG nova.virt.libvirt.volume.iscsi [None req-47c35086-f020-4ac2-bb27-7ed07a65a655 tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] [instance: 9222e62a-9fd8-48b2-a125-83c9cdc589bd] Disconnected iSCSI Volume {{(pid=75045) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 23:38:03 user nova-compute[75045]: DEBUG nova.compute.manager [req-59935041-1f8a-4d55-b8fa-3c2fba570dbd req-ed66259a-acd4-4259-b0f3-862f22f7a57f service nova] [instance: 78955913-bbab-4b00-bc9b-12116f249d7e] Received event network-vif-plugged-fc66a792-914f-48c4-ae57-cbda1615ff0b {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:38:03 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-59935041-1f8a-4d55-b8fa-3c2fba570dbd req-ed66259a-acd4-4259-b0f3-862f22f7a57f service nova] Acquiring lock "78955913-bbab-4b00-bc9b-12116f249d7e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:38:03 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-59935041-1f8a-4d55-b8fa-3c2fba570dbd req-ed66259a-acd4-4259-b0f3-862f22f7a57f service nova] Lock "78955913-bbab-4b00-bc9b-12116f249d7e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:38:03 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-59935041-1f8a-4d55-b8fa-3c2fba570dbd req-ed66259a-acd4-4259-b0f3-862f22f7a57f service nova] Lock "78955913-bbab-4b00-bc9b-12116f249d7e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:38:03 user nova-compute[75045]: DEBUG nova.compute.manager [req-59935041-1f8a-4d55-b8fa-3c2fba570dbd req-ed66259a-acd4-4259-b0f3-862f22f7a57f service nova] [instance: 78955913-bbab-4b00-bc9b-12116f249d7e] No waiting events found dispatching network-vif-plugged-fc66a792-914f-48c4-ae57-cbda1615ff0b {{(pid=75045) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 23:38:03 user nova-compute[75045]: WARNING nova.compute.manager [req-59935041-1f8a-4d55-b8fa-3c2fba570dbd req-ed66259a-acd4-4259-b0f3-862f22f7a57f service nova] [instance: 78955913-bbab-4b00-bc9b-12116f249d7e] Received unexpected event network-vif-plugged-fc66a792-914f-48c4-ae57-cbda1615ff0b for instance with vm_state shelved_offloaded and task_state spawning.
Nov 08 23:38:04 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:38:04 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:38:04 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:38:04 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:38:04 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:38:04 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:38:04 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:38:04 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:38:04 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:38:05 user nova-compute[75045]: DEBUG nova.compute.manager [req-c2b3ec6e-c7af-42c5-be4e-a6d254233e73 req-0924ccc7-35bf-4726-902a-1fbc4c6891f0 service nova] [instance: 7ee587a0-e271-4262-a252-2ccb6c2faecb] Received event network-vif-plugged-0b911e0a-0c01-4296-b269-f52ee68772f9 {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:38:05 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-c2b3ec6e-c7af-42c5-be4e-a6d254233e73 req-0924ccc7-35bf-4726-902a-1fbc4c6891f0 service nova] Acquiring lock "7ee587a0-e271-4262-a252-2ccb6c2faecb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:38:05 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-c2b3ec6e-c7af-42c5-be4e-a6d254233e73 req-0924ccc7-35bf-4726-902a-1fbc4c6891f0 service nova] Lock "7ee587a0-e271-4262-a252-2ccb6c2faecb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:38:05 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-c2b3ec6e-c7af-42c5-be4e-a6d254233e73 req-0924ccc7-35bf-4726-902a-1fbc4c6891f0 service nova] Lock "7ee587a0-e271-4262-a252-2ccb6c2faecb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:38:05 user nova-compute[75045]: DEBUG nova.compute.manager [req-c2b3ec6e-c7af-42c5-be4e-a6d254233e73 req-0924ccc7-35bf-4726-902a-1fbc4c6891f0 service nova] [instance: 7ee587a0-e271-4262-a252-2ccb6c2faecb] No waiting events found dispatching network-vif-plugged-0b911e0a-0c01-4296-b269-f52ee68772f9 {{(pid=75045) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 23:38:05 user nova-compute[75045]: WARNING nova.compute.manager [req-c2b3ec6e-c7af-42c5-be4e-a6d254233e73 req-0924ccc7-35bf-4726-902a-1fbc4c6891f0 service nova] [instance: 7ee587a0-e271-4262-a252-2ccb6c2faecb] Received unexpected event network-vif-plugged-0b911e0a-0c01-4296-b269-f52ee68772f9 for instance with vm_state building and task_state spawning.
Nov 08 23:38:05 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:38:05 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:38:05 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:38:05 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:38:05 user nova-compute[75045]: DEBUG nova.compute.manager [req-053825c2-7ff6-4bd7-82d6-385afd772ae6 req-a6324986-b39f-4546-bef4-be8d25e8cd0b service nova] [instance: 78955913-bbab-4b00-bc9b-12116f249d7e] Received event network-vif-plugged-fc66a792-914f-48c4-ae57-cbda1615ff0b {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:38:05 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-053825c2-7ff6-4bd7-82d6-385afd772ae6 req-a6324986-b39f-4546-bef4-be8d25e8cd0b service nova] Acquiring lock "78955913-bbab-4b00-bc9b-12116f249d7e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:38:05 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-053825c2-7ff6-4bd7-82d6-385afd772ae6 req-a6324986-b39f-4546-bef4-be8d25e8cd0b service nova] Lock "78955913-bbab-4b00-bc9b-12116f249d7e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:38:05 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-053825c2-7ff6-4bd7-82d6-385afd772ae6 req-a6324986-b39f-4546-bef4-be8d25e8cd0b service nova] Lock "78955913-bbab-4b00-bc9b-12116f249d7e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:38:05 user nova-compute[75045]: DEBUG nova.compute.manager [req-053825c2-7ff6-4bd7-82d6-385afd772ae6 req-a6324986-b39f-4546-bef4-be8d25e8cd0b service nova] [instance: 78955913-bbab-4b00-bc9b-12116f249d7e] No waiting events found dispatching network-vif-plugged-fc66a792-914f-48c4-ae57-cbda1615ff0b {{(pid=75045) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 23:38:05 user nova-compute[75045]: WARNING nova.compute.manager [req-053825c2-7ff6-4bd7-82d6-385afd772ae6 req-a6324986-b39f-4546-bef4-be8d25e8cd0b service nova] [instance: 78955913-bbab-4b00-bc9b-12116f249d7e] Received unexpected event network-vif-plugged-fc66a792-914f-48c4-ae57-cbda1615ff0b for instance with vm_state shelved_offloaded and task_state spawning.
Nov 08 23:38:06 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:38:06 user nova-compute[75045]: DEBUG nova.compute.manager [None req-0d869fc9-2c14-4784-aa11-87edd52b76c9 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] [instance: 78955913-bbab-4b00-bc9b-12116f249d7e] Instance event wait completed in 0 seconds for  {{(pid=75045) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 23:38:06 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-0d869fc9-2c14-4784-aa11-87edd52b76c9 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] [instance: 78955913-bbab-4b00-bc9b-12116f249d7e] Guest created on hypervisor {{(pid=75045) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 23:38:06 user nova-compute[75045]: INFO nova.virt.libvirt.driver [-] [instance: 78955913-bbab-4b00-bc9b-12116f249d7e] Instance spawned successfully.
Nov 08 23:38:07 user nova-compute[75045]: DEBUG nova.compute.manager [None req-ef4c6d79-ae9f-4cdc-afda-9d769cd009a6 tempest-ServerStableDeviceRescueTest-1847572360 tempest-ServerStableDeviceRescueTest-1847572360-project-member] [instance: 7ee587a0-e271-4262-a252-2ccb6c2faecb] Instance event wait completed in 0 seconds for  {{(pid=75045) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 23:38:07 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-ef4c6d79-ae9f-4cdc-afda-9d769cd009a6 tempest-ServerStableDeviceRescueTest-1847572360 tempest-ServerStableDeviceRescueTest-1847572360-project-member] [instance: 7ee587a0-e271-4262-a252-2ccb6c2faecb] Guest created on hypervisor {{(pid=75045) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 23:38:07 user nova-compute[75045]: INFO nova.virt.libvirt.driver [-] [instance: 7ee587a0-e271-4262-a252-2ccb6c2faecb] Instance spawned successfully.
Nov 08 23:38:07 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-ef4c6d79-ae9f-4cdc-afda-9d769cd009a6 tempest-ServerStableDeviceRescueTest-1847572360 tempest-ServerStableDeviceRescueTest-1847572360-project-member] [instance: 7ee587a0-e271-4262-a252-2ccb6c2faecb] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75045) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 23:38:07 user nova-compute[75045]: DEBUG nova.compute.manager [req-d0f4ad19-5550-45ca-ae9c-f5043ac8c20e req-29b616d7-4b69-4ae0-8d3e-54d8ecf59d52 service nova] [instance: 7ee587a0-e271-4262-a252-2ccb6c2faecb] Received event network-vif-plugged-0b911e0a-0c01-4296-b269-f52ee68772f9 {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:38:07 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-d0f4ad19-5550-45ca-ae9c-f5043ac8c20e req-29b616d7-4b69-4ae0-8d3e-54d8ecf59d52 service nova] Acquiring lock "7ee587a0-e271-4262-a252-2ccb6c2faecb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:38:07 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-d0f4ad19-5550-45ca-ae9c-f5043ac8c20e req-29b616d7-4b69-4ae0-8d3e-54d8ecf59d52 service nova] Lock "7ee587a0-e271-4262-a252-2ccb6c2faecb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:38:07 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-d0f4ad19-5550-45ca-ae9c-f5043ac8c20e req-29b616d7-4b69-4ae0-8d3e-54d8ecf59d52 service nova] Lock "7ee587a0-e271-4262-a252-2ccb6c2faecb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:38:07 user nova-compute[75045]: DEBUG nova.compute.manager [req-d0f4ad19-5550-45ca-ae9c-f5043ac8c20e req-29b616d7-4b69-4ae0-8d3e-54d8ecf59d52 service nova] [instance: 7ee587a0-e271-4262-a252-2ccb6c2faecb] No waiting events found dispatching network-vif-plugged-0b911e0a-0c01-4296-b269-f52ee68772f9 {{(pid=75045) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 23:38:07 user nova-compute[75045]: WARNING nova.compute.manager [req-d0f4ad19-5550-45ca-ae9c-f5043ac8c20e req-29b616d7-4b69-4ae0-8d3e-54d8ecf59d52 service nova] [instance: 7ee587a0-e271-4262-a252-2ccb6c2faecb] Received unexpected event network-vif-plugged-0b911e0a-0c01-4296-b269-f52ee68772f9 for instance with vm_state building and task_state spawning.
Nov 08 23:38:07 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-ef4c6d79-ae9f-4cdc-afda-9d769cd009a6 tempest-ServerStableDeviceRescueTest-1847572360 tempest-ServerStableDeviceRescueTest-1847572360-project-member] [instance: 7ee587a0-e271-4262-a252-2ccb6c2faecb] Found default for hw_cdrom_bus of ide {{(pid=75045) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 23:38:07 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-ef4c6d79-ae9f-4cdc-afda-9d769cd009a6 tempest-ServerStableDeviceRescueTest-1847572360 tempest-ServerStableDeviceRescueTest-1847572360-project-member] [instance: 7ee587a0-e271-4262-a252-2ccb6c2faecb] Found default for hw_disk_bus of virtio {{(pid=75045) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 23:38:07 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-ef4c6d79-ae9f-4cdc-afda-9d769cd009a6 tempest-ServerStableDeviceRescueTest-1847572360 tempest-ServerStableDeviceRescueTest-1847572360-project-member] [instance: 7ee587a0-e271-4262-a252-2ccb6c2faecb] Found default for hw_input_bus of None {{(pid=75045) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 23:38:07 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-ef4c6d79-ae9f-4cdc-afda-9d769cd009a6 tempest-ServerStableDeviceRescueTest-1847572360 tempest-ServerStableDeviceRescueTest-1847572360-project-member] [instance: 7ee587a0-e271-4262-a252-2ccb6c2faecb] Found default for hw_pointer_model of None {{(pid=75045) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 23:38:07 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-ef4c6d79-ae9f-4cdc-afda-9d769cd009a6 tempest-ServerStableDeviceRescueTest-1847572360 tempest-ServerStableDeviceRescueTest-1847572360-project-member] [instance: 7ee587a0-e271-4262-a252-2ccb6c2faecb] Found default for hw_video_model of virtio {{(pid=75045) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 23:38:07 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-ef4c6d79-ae9f-4cdc-afda-9d769cd009a6 tempest-ServerStableDeviceRescueTest-1847572360 tempest-ServerStableDeviceRescueTest-1847572360-project-member] [instance: 7ee587a0-e271-4262-a252-2ccb6c2faecb] Found default for hw_vif_model of virtio {{(pid=75045) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 23:38:07 user nova-compute[75045]: INFO nova.compute.manager [None req-ef4c6d79-ae9f-4cdc-afda-9d769cd009a6 tempest-ServerStableDeviceRescueTest-1847572360 tempest-ServerStableDeviceRescueTest-1847572360-project-member] [instance: 7ee587a0-e271-4262-a252-2ccb6c2faecb] Took 6.65 seconds to spawn the instance on the hypervisor.
Nov 08 23:38:07 user nova-compute[75045]: DEBUG nova.compute.manager [None req-ef4c6d79-ae9f-4cdc-afda-9d769cd009a6 tempest-ServerStableDeviceRescueTest-1847572360 tempest-ServerStableDeviceRescueTest-1847572360-project-member] [instance: 7ee587a0-e271-4262-a252-2ccb6c2faecb] Checking state {{(pid=75045) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 23:38:07 user nova-compute[75045]: DEBUG nova.compute.manager [None req-0d869fc9-2c14-4784-aa11-87edd52b76c9 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] [instance: 78955913-bbab-4b00-bc9b-12116f249d7e] Checking state {{(pid=75045) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 23:38:07 user nova-compute[75045]: INFO nova.compute.manager [None req-ef4c6d79-ae9f-4cdc-afda-9d769cd009a6 tempest-ServerStableDeviceRescueTest-1847572360 tempest-ServerStableDeviceRescueTest-1847572360-project-member] [instance: 7ee587a0-e271-4262-a252-2ccb6c2faecb] Took 7.80 seconds to build instance.
Nov 08 23:38:07 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-ef4c6d79-ae9f-4cdc-afda-9d769cd009a6 tempest-ServerStableDeviceRescueTest-1847572360 tempest-ServerStableDeviceRescueTest-1847572360-project-member] Lock "7ee587a0-e271-4262-a252-2ccb6c2faecb" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.174s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:38:07 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-0d869fc9-2c14-4784-aa11-87edd52b76c9 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] Lock "78955913-bbab-4b00-bc9b-12116f249d7e" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 68.964s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:38:07 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:38:11 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:38:12 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:38:15 user nova-compute[75045]: DEBUG nova.objects.instance [None req-47c35086-f020-4ac2-bb27-7ed07a65a655 tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] Lazy-loading 'flavor' on Instance uuid 9222e62a-9fd8-48b2-a125-83c9cdc589bd {{(pid=75045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 23:38:15 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-47c35086-f020-4ac2-bb27-7ed07a65a655 tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] Lock "9222e62a-9fd8-48b2-a125-83c9cdc589bd" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 32.712s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:38:15 user nova-compute[75045]: ERROR nova.volume.cinder [None req-3a27b56d-1bb5-4cfa-938e-eb57edf0d03d tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] Update attachment failed for attachment ee16fbc4-0b43-4c7f-bb2c-8024c2af349d. Error: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-1ef4890e-e8d9-4fb0-a95a-71ef1b235c74) Code: 500: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-1ef4890e-e8d9-4fb0-a95a-71ef1b235c74)
Nov 08 23:38:15 user nova-compute[75045]: ERROR nova.compute.manager [None req-3a27b56d-1bb5-4cfa-938e-eb57edf0d03d tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] [instance: adcffd35-00c7-49db-a72f-d6307a90e123] Failed to attach 80df088f-ab7a-442e-8a53-86fcb06aaf1d at /dev/vdb: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-1ef4890e-e8d9-4fb0-a95a-71ef1b235c74)
Nov 08 23:38:15 user nova-compute[75045]: ERROR nova.compute.manager [instance: adcffd35-00c7-49db-a72f-d6307a90e123] Traceback (most recent call last):
Nov 08 23:38:15 user nova-compute[75045]: ERROR nova.compute.manager [instance: adcffd35-00c7-49db-a72f-d6307a90e123]   File "/opt/stack/nova/nova/compute/manager.py", line 7567, in _attach_volume
Nov 08 23:38:15 user nova-compute[75045]: ERROR nova.compute.manager [instance: adcffd35-00c7-49db-a72f-d6307a90e123]     bdm.attach(context, instance, self.volume_api, self.driver,
Nov 08 23:38:15 user nova-compute[75045]: ERROR nova.compute.manager [instance: adcffd35-00c7-49db-a72f-d6307a90e123]   File "/opt/stack/nova/nova/virt/block_device.py", line 46, in wrapped
Nov 08 23:38:15 user nova-compute[75045]: ERROR nova.compute.manager [instance: adcffd35-00c7-49db-a72f-d6307a90e123]     ret_val = method(obj, context, *args, **kwargs)
Nov 08 23:38:15 user nova-compute[75045]: ERROR nova.compute.manager [instance: adcffd35-00c7-49db-a72f-d6307a90e123]   File "/opt/stack/nova/nova/virt/block_device.py", line 734, in attach
Nov 08 23:38:15 user nova-compute[75045]: ERROR nova.compute.manager [instance: adcffd35-00c7-49db-a72f-d6307a90e123]     self._do_attach(context, instance, volume, volume_api,
Nov 08 23:38:15 user nova-compute[75045]: ERROR nova.compute.manager [instance: adcffd35-00c7-49db-a72f-d6307a90e123]   File "/opt/stack/nova/nova/virt/block_device.py", line 719, in _do_attach
Nov 08 23:38:15 user nova-compute[75045]: ERROR nova.compute.manager [instance: adcffd35-00c7-49db-a72f-d6307a90e123]     self._volume_attach(context, volume, connector, instance,
Nov 08 23:38:15 user nova-compute[75045]: ERROR nova.compute.manager [instance: adcffd35-00c7-49db-a72f-d6307a90e123]   File "/opt/stack/nova/nova/virt/block_device.py", line 633, in _volume_attach
Nov 08 23:38:15 user nova-compute[75045]: ERROR nova.compute.manager [instance: adcffd35-00c7-49db-a72f-d6307a90e123]     connection_info = volume_api.attachment_update(
Nov 08 23:38:15 user nova-compute[75045]: ERROR nova.compute.manager [instance: adcffd35-00c7-49db-a72f-d6307a90e123]   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 08 23:38:15 user nova-compute[75045]: ERROR nova.compute.manager [instance: adcffd35-00c7-49db-a72f-d6307a90e123]     res = method(self, ctx, *args, **kwargs)
Nov 08 23:38:15 user nova-compute[75045]: ERROR nova.compute.manager [instance: adcffd35-00c7-49db-a72f-d6307a90e123]   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Nov 08 23:38:15 user nova-compute[75045]: ERROR nova.compute.manager [instance: adcffd35-00c7-49db-a72f-d6307a90e123]     res = method(self, ctx, attachment_id, *args, **kwargs)
Nov 08 23:38:15 user nova-compute[75045]: ERROR nova.compute.manager [instance: adcffd35-00c7-49db-a72f-d6307a90e123]   File "/opt/stack/nova/nova/volume/cinder.py", line 915, in attachment_update
Nov 08 23:38:15 user nova-compute[75045]: ERROR nova.compute.manager [instance: adcffd35-00c7-49db-a72f-d6307a90e123]     with excutils.save_and_reraise_exception():
Nov 08 23:38:15 user nova-compute[75045]: ERROR nova.compute.manager [instance: adcffd35-00c7-49db-a72f-d6307a90e123]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 08 23:38:15 user nova-compute[75045]: ERROR nova.compute.manager [instance: adcffd35-00c7-49db-a72f-d6307a90e123]     self.force_reraise()
Nov 08 23:38:15 user nova-compute[75045]: ERROR nova.compute.manager [instance: adcffd35-00c7-49db-a72f-d6307a90e123]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 08 23:38:15 user nova-compute[75045]: ERROR nova.compute.manager [instance: adcffd35-00c7-49db-a72f-d6307a90e123]     raise self.value
Nov 08 23:38:15 user nova-compute[75045]: ERROR nova.compute.manager [instance: adcffd35-00c7-49db-a72f-d6307a90e123]   File "/opt/stack/nova/nova/volume/cinder.py", line 909, in attachment_update
Nov 08 23:38:15 user nova-compute[75045]: ERROR nova.compute.manager [instance: adcffd35-00c7-49db-a72f-d6307a90e123]     context, '3.44', skip_version_check=True).attachments.update(
Nov 08 23:38:15 user nova-compute[75045]: ERROR nova.compute.manager [instance: adcffd35-00c7-49db-a72f-d6307a90e123]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Nov 08 23:38:15 user nova-compute[75045]: ERROR nova.compute.manager [instance: adcffd35-00c7-49db-a72f-d6307a90e123]     return method.func(obj, *args, **kwargs)
Nov 08 23:38:15 user nova-compute[75045]: ERROR nova.compute.manager [instance: adcffd35-00c7-49db-a72f-d6307a90e123]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Nov 08 23:38:15 user nova-compute[75045]: ERROR nova.compute.manager [instance: adcffd35-00c7-49db-a72f-d6307a90e123]     resp = self._update('/attachments/%s' % id, body)
Nov 08 23:38:15 user nova-compute[75045]: ERROR nova.compute.manager [instance: adcffd35-00c7-49db-a72f-d6307a90e123]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Nov 08 23:38:15 user nova-compute[75045]: ERROR nova.compute.manager [instance: adcffd35-00c7-49db-a72f-d6307a90e123]     resp, body = self.api.client.put(url, body=body, **kwargs)
Nov 08 23:38:15 user nova-compute[75045]: ERROR nova.compute.manager [instance: adcffd35-00c7-49db-a72f-d6307a90e123]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Nov 08 23:38:15 user nova-compute[75045]: ERROR nova.compute.manager [instance: adcffd35-00c7-49db-a72f-d6307a90e123]     return self._cs_request(url, 'PUT', **kwargs)
Nov 08 23:38:15 user nova-compute[75045]: ERROR nova.compute.manager [instance: adcffd35-00c7-49db-a72f-d6307a90e123]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 08 23:38:15 user nova-compute[75045]: ERROR nova.compute.manager [instance: adcffd35-00c7-49db-a72f-d6307a90e123]     return self.request(url, method, **kwargs)
Nov 08 23:38:15 user nova-compute[75045]: ERROR nova.compute.manager [instance: adcffd35-00c7-49db-a72f-d6307a90e123]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 08 23:38:15 user nova-compute[75045]: ERROR nova.compute.manager [instance: adcffd35-00c7-49db-a72f-d6307a90e123]     raise exceptions.from_response(resp, body)
Nov 08 23:38:15 user nova-compute[75045]: ERROR nova.compute.manager [instance: adcffd35-00c7-49db-a72f-d6307a90e123] cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-1ef4890e-e8d9-4fb0-a95a-71ef1b235c74)
Nov 08 23:38:15 user nova-compute[75045]: ERROR nova.compute.manager [instance: adcffd35-00c7-49db-a72f-d6307a90e123] 
Nov 08 23:38:15 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-3a27b56d-1bb5-4cfa-938e-eb57edf0d03d tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] Lock "adcffd35-00c7-49db-a72f-d6307a90e123" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 23.664s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:38:16 user nova-compute[75045]: ERROR oslo_messaging.rpc.server [None req-3a27b56d-1bb5-4cfa-938e-eb57edf0d03d tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] Exception during message handling: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-1ef4890e-e8d9-4fb0-a95a-71ef1b235c74)
Nov 08 23:38:16 user nova-compute[75045]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 08 23:38:16 user nova-compute[75045]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Nov 08 23:38:16 user nova-compute[75045]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Nov 08 23:38:16 user nova-compute[75045]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Nov 08 23:38:16 user nova-compute[75045]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Nov 08 23:38:16 user nova-compute[75045]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Nov 08 23:38:16 user nova-compute[75045]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Nov 08 23:38:16 user nova-compute[75045]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Nov 08 23:38:16 user nova-compute[75045]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 08 23:38:16 user nova-compute[75045]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 08 23:38:16 user nova-compute[75045]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 08 23:38:16 user nova-compute[75045]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 08 23:38:16 user nova-compute[75045]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 08 23:38:16 user nova-compute[75045]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Nov 08 23:38:16 user nova-compute[75045]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Nov 08 23:38:16 user nova-compute[75045]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/utils.py", line 1439, in decorated_function
Nov 08 23:38:16 user nova-compute[75045]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Nov 08 23:38:16 user nova-compute[75045]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 213, in decorated_function
Nov 08 23:38:16 user nova-compute[75045]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 08 23:38:16 user nova-compute[75045]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 08 23:38:16 user nova-compute[75045]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 08 23:38:16 user nova-compute[75045]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 08 23:38:16 user nova-compute[75045]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 08 23:38:16 user nova-compute[75045]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 203, in decorated_function
Nov 08 23:38:16 user nova-compute[75045]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Nov 08 23:38:16 user nova-compute[75045]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7553, in attach_volume
Nov 08 23:38:16 user nova-compute[75045]: ERROR oslo_messaging.rpc.server     do_attach_volume(context, instance, driver_bdm)
Nov 08 23:38:16 user nova-compute[75045]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py", line 414, in inner
Nov 08 23:38:16 user nova-compute[75045]: ERROR oslo_messaging.rpc.server     return f(*args, **kwargs)
Nov 08 23:38:16 user nova-compute[75045]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7550, in do_attach_volume
Nov 08 23:38:16 user nova-compute[75045]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 08 23:38:16 user nova-compute[75045]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 08 23:38:16 user nova-compute[75045]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 08 23:38:16 user nova-compute[75045]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 08 23:38:16 user nova-compute[75045]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 08 23:38:16 user nova-compute[75045]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7548, in do_attach_volume
Nov 08 23:38:16 user nova-compute[75045]: ERROR oslo_messaging.rpc.server     return self._attach_volume(context, instance, driver_bdm)
Nov 08 23:38:16 user nova-compute[75045]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7570, in _attach_volume
Nov 08 23:38:16 user nova-compute[75045]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 08 23:38:16 user nova-compute[75045]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 08 23:38:16 user nova-compute[75045]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 08 23:38:16 user nova-compute[75045]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 08 23:38:16 user nova-compute[75045]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 08 23:38:16 user nova-compute[75045]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7567, in _attach_volume
Nov 08 23:38:16 user nova-compute[75045]: ERROR oslo_messaging.rpc.server     bdm.attach(context, instance, self.volume_api, self.driver,
Nov 08 23:38:16 user nova-compute[75045]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 46, in wrapped
Nov 08 23:38:16 user nova-compute[75045]: ERROR oslo_messaging.rpc.server     ret_val = method(obj, context, *args, **kwargs)
Nov 08 23:38:16 user nova-compute[75045]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 734, in attach
Nov 08 23:38:16 user nova-compute[75045]: ERROR oslo_messaging.rpc.server     self._do_attach(context, instance, volume, volume_api,
Nov 08 23:38:16 user nova-compute[75045]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 719, in _do_attach
Nov 08 23:38:16 user nova-compute[75045]: ERROR oslo_messaging.rpc.server     self._volume_attach(context, volume, connector, instance,
Nov 08 23:38:16 user nova-compute[75045]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 633, in _volume_attach
Nov 08 23:38:16 user nova-compute[75045]: ERROR oslo_messaging.rpc.server     connection_info = volume_api.attachment_update(
Nov 08 23:38:16 user nova-compute[75045]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 08 23:38:16 user nova-compute[75045]: ERROR oslo_messaging.rpc.server     res = method(self, ctx, *args, **kwargs)
Nov 08 23:38:16 user nova-compute[75045]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Nov 08 23:38:16 user nova-compute[75045]: ERROR oslo_messaging.rpc.server     res = method(self, ctx, attachment_id, *args, **kwargs)
Nov 08 23:38:16 user nova-compute[75045]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 915, in attachment_update
Nov 08 23:38:16 user nova-compute[75045]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 08 23:38:16 user nova-compute[75045]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 08 23:38:16 user nova-compute[75045]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 08 23:38:16 user nova-compute[75045]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 08 23:38:16 user nova-compute[75045]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 08 23:38:16 user nova-compute[75045]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 909, in attachment_update
Nov 08 23:38:16 user nova-compute[75045]: ERROR oslo_messaging.rpc.server     context, '3.44', skip_version_check=True).attachments.update(
Nov 08 23:38:16 user nova-compute[75045]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Nov 08 23:38:16 user nova-compute[75045]: ERROR oslo_messaging.rpc.server     return method.func(obj, *args, **kwargs)
Nov 08 23:38:16 user nova-compute[75045]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Nov 08 23:38:16 user nova-compute[75045]: ERROR oslo_messaging.rpc.server     resp = self._update('/attachments/%s' % id, body)
Nov 08 23:38:16 user nova-compute[75045]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Nov 08 23:38:16 user nova-compute[75045]: ERROR oslo_messaging.rpc.server     resp, body = self.api.client.put(url, body=body, **kwargs)
Nov 08 23:38:16 user nova-compute[75045]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Nov 08 23:38:16 user nova-compute[75045]: ERROR oslo_messaging.rpc.server     return self._cs_request(url, 'PUT', **kwargs)
Nov 08 23:38:16 user nova-compute[75045]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 08 23:38:16 user nova-compute[75045]: ERROR oslo_messaging.rpc.server     return self.request(url, method, **kwargs)
Nov 08 23:38:16 user nova-compute[75045]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 08 23:38:16 user nova-compute[75045]: ERROR oslo_messaging.rpc.server     raise exceptions.from_response(resp, body)
Nov 08 23:38:16 user nova-compute[75045]: ERROR oslo_messaging.rpc.server cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-1ef4890e-e8d9-4fb0-a95a-71ef1b235c74)
Nov 08 23:38:16 user nova-compute[75045]: ERROR oslo_messaging.rpc.server 
Nov 08 23:38:17 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:38:21 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:38:22 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:38:26 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:38:27 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:38:31 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:38:32 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:38:33 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-e5c9e830-953d-4572-a14e-1b720f84cfa8 tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] Acquiring lock "9222e62a-9fd8-48b2-a125-83c9cdc589bd" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:38:33 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-e5c9e830-953d-4572-a14e-1b720f84cfa8 tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] Lock "9222e62a-9fd8-48b2-a125-83c9cdc589bd" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:38:33 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-e5c9e830-953d-4572-a14e-1b720f84cfa8 tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] Acquiring lock "9222e62a-9fd8-48b2-a125-83c9cdc589bd-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:38:33 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-e5c9e830-953d-4572-a14e-1b720f84cfa8 tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] Lock "9222e62a-9fd8-48b2-a125-83c9cdc589bd-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:38:33 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-e5c9e830-953d-4572-a14e-1b720f84cfa8 tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] Lock "9222e62a-9fd8-48b2-a125-83c9cdc589bd-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:38:33 user nova-compute[75045]: INFO nova.compute.manager [None req-e5c9e830-953d-4572-a14e-1b720f84cfa8 tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] [instance: 9222e62a-9fd8-48b2-a125-83c9cdc589bd] Terminating instance
Nov 08 23:38:33 user nova-compute[75045]: DEBUG nova.compute.manager [None req-e5c9e830-953d-4572-a14e-1b720f84cfa8 tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] [instance: 9222e62a-9fd8-48b2-a125-83c9cdc589bd] Start destroying the instance on the hypervisor. {{(pid=75045) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 23:38:33 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:38:33 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:38:33 user nova-compute[75045]: DEBUG nova.compute.manager [req-960bb6a3-e82b-4e4b-907a-04a1b04eaad0 req-eded11d0-68cf-41c3-8897-85948fd3cedf service nova] [instance: 9222e62a-9fd8-48b2-a125-83c9cdc589bd] Received event network-vif-unplugged-5dae7844-411c-47aa-ba3e-bc209136f0a6 {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:38:33 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-960bb6a3-e82b-4e4b-907a-04a1b04eaad0 req-eded11d0-68cf-41c3-8897-85948fd3cedf service nova] Acquiring lock "9222e62a-9fd8-48b2-a125-83c9cdc589bd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:38:33 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-960bb6a3-e82b-4e4b-907a-04a1b04eaad0 req-eded11d0-68cf-41c3-8897-85948fd3cedf service nova] Lock "9222e62a-9fd8-48b2-a125-83c9cdc589bd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:38:33 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-960bb6a3-e82b-4e4b-907a-04a1b04eaad0 req-eded11d0-68cf-41c3-8897-85948fd3cedf service nova] Lock "9222e62a-9fd8-48b2-a125-83c9cdc589bd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:38:33 user nova-compute[75045]: DEBUG nova.compute.manager [req-960bb6a3-e82b-4e4b-907a-04a1b04eaad0 req-eded11d0-68cf-41c3-8897-85948fd3cedf service nova] [instance: 9222e62a-9fd8-48b2-a125-83c9cdc589bd] No waiting events found dispatching network-vif-unplugged-5dae7844-411c-47aa-ba3e-bc209136f0a6 {{(pid=75045) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 23:38:33 user nova-compute[75045]: DEBUG nova.compute.manager [req-960bb6a3-e82b-4e4b-907a-04a1b04eaad0 req-eded11d0-68cf-41c3-8897-85948fd3cedf service nova] [instance: 9222e62a-9fd8-48b2-a125-83c9cdc589bd] Received event network-vif-unplugged-5dae7844-411c-47aa-ba3e-bc209136f0a6 for instance with task_state deleting. {{(pid=75045) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 23:38:33 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:38:33 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:38:34 user nova-compute[75045]: INFO nova.virt.libvirt.driver [-] [instance: 9222e62a-9fd8-48b2-a125-83c9cdc589bd] Instance destroyed successfully.
Nov 08 23:38:34 user nova-compute[75045]: DEBUG nova.objects.instance [None req-e5c9e830-953d-4572-a14e-1b720f84cfa8 tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] Lazy-loading 'resources' on Instance uuid 9222e62a-9fd8-48b2-a125-83c9cdc589bd {{(pid=75045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 23:38:34 user nova-compute[75045]: DEBUG nova.virt.libvirt.vif [None req-e5c9e830-953d-4572-a14e-1b720f84cfa8 tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T23:31:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-419578876',display_name='tempest-ServerRescueNegativeTestJSON-server-419578876',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-419578876',id=32,image_ref='a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE8xPLrIBEJgewpGKZ9+DADirH1va8Jw2TK7fJYueqPBCf/b4zQxE+KZaoScWKrWN36A5mrbfEJVAf2HqeXPqc0l3rzXsv0urNXE5MLSGsJKkp23YT6dxav8ybWtbSI0/w==',key_name='tempest-keypair-175527667',keypairs=<?>,launch_index=0,launched_at=2023-11-08T23:34:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bbb640407ef94f568aea892f1834d6d1',ramdisk_id='',reservation_id='r-vju4zt3n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-187452128',owner_user_name='tempest-ServerRescueNegativeTestJSON-187452128-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T23:35:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f16e465ffb49488db3de445a473fd77a',uuid=9222e62a-9fd8-48b2-a125-83c9cdc589bd,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5dae7844-411c-47aa-ba3e-bc209136f0a6", "address": "fa:16:3e:a4:11:9a", "network": {"id": "08d1669a-f667-4c79-8e49-0ad183f57046", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1863648032-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.156", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bbb640407ef94f568aea892f1834d6d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5dae7844-41", "ovs_interfaceid": "5dae7844-411c-47aa-ba3e-bc209136f0a6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75045) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 23:38:34 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-e5c9e830-953d-4572-a14e-1b720f84cfa8 tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] Converting VIF {"id": "5dae7844-411c-47aa-ba3e-bc209136f0a6", "address": "fa:16:3e:a4:11:9a", "network": {"id": "08d1669a-f667-4c79-8e49-0ad183f57046", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1863648032-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.156", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bbb640407ef94f568aea892f1834d6d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5dae7844-41", "ovs_interfaceid": "5dae7844-411c-47aa-ba3e-bc209136f0a6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 23:38:34 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-e5c9e830-953d-4572-a14e-1b720f84cfa8 tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a4:11:9a,bridge_name='br-int',has_traffic_filtering=True,id=5dae7844-411c-47aa-ba3e-bc209136f0a6,network=Network(08d1669a-f667-4c79-8e49-0ad183f57046),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5dae7844-41') {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 23:38:34 user nova-compute[75045]: DEBUG os_vif [None req-e5c9e830-953d-4572-a14e-1b720f84cfa8 tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a4:11:9a,bridge_name='br-int',has_traffic_filtering=True,id=5dae7844-411c-47aa-ba3e-bc209136f0a6,network=Network(08d1669a-f667-4c79-8e49-0ad183f57046),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5dae7844-41') {{(pid=75045) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 23:38:34 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:38:34 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5dae7844-41, bridge=br-int, if_exists=True) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:38:34 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:38:34 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 23:38:34 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:38:34 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6d55cb72-7877-4f5d-b037-1f9700e8ba0b) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:38:34 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:38:34 user nova-compute[75045]: INFO os_vif [None req-e5c9e830-953d-4572-a14e-1b720f84cfa8 tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a4:11:9a,bridge_name='br-int',has_traffic_filtering=True,id=5dae7844-411c-47aa-ba3e-bc209136f0a6,network=Network(08d1669a-f667-4c79-8e49-0ad183f57046),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5dae7844-41')
Nov 08 23:38:34 user nova-compute[75045]: INFO nova.virt.libvirt.driver [None req-e5c9e830-953d-4572-a14e-1b720f84cfa8 tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] [instance: 9222e62a-9fd8-48b2-a125-83c9cdc589bd] Deleting instance files /opt/stack/data/nova/instances/9222e62a-9fd8-48b2-a125-83c9cdc589bd_del
Nov 08 23:38:34 user nova-compute[75045]: INFO nova.virt.libvirt.driver [None req-e5c9e830-953d-4572-a14e-1b720f84cfa8 tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] [instance: 9222e62a-9fd8-48b2-a125-83c9cdc589bd] Deletion of /opt/stack/data/nova/instances/9222e62a-9fd8-48b2-a125-83c9cdc589bd_del complete
Nov 08 23:38:34 user nova-compute[75045]: INFO nova.compute.manager [None req-e5c9e830-953d-4572-a14e-1b720f84cfa8 tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] [instance: 9222e62a-9fd8-48b2-a125-83c9cdc589bd] Took 0.92 seconds to destroy the instance on the hypervisor.
Nov 08 23:38:34 user nova-compute[75045]: DEBUG oslo.service.loopingcall [None req-e5c9e830-953d-4572-a14e-1b720f84cfa8 tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75045) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 23:38:34 user nova-compute[75045]: DEBUG nova.compute.manager [-] [instance: 9222e62a-9fd8-48b2-a125-83c9cdc589bd] Deallocating network for instance {{(pid=75045) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 23:38:34 user nova-compute[75045]: DEBUG nova.network.neutron [-] [instance: 9222e62a-9fd8-48b2-a125-83c9cdc589bd] deallocate_for_instance() {{(pid=75045) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 23:38:35 user nova-compute[75045]: DEBUG nova.network.neutron [-] [instance: 9222e62a-9fd8-48b2-a125-83c9cdc589bd] Updating instance_info_cache with network_info: [] {{(pid=75045) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 23:38:35 user nova-compute[75045]: INFO nova.compute.manager [-] [instance: 9222e62a-9fd8-48b2-a125-83c9cdc589bd] Took 1.04 seconds to deallocate network for instance.
Nov 08 23:38:35 user nova-compute[75045]: DEBUG nova.compute.manager [req-1145f314-aa29-4947-a11e-da78af6a2c0d req-e76e7be8-659d-47db-93c0-0b87ec25b313 service nova] [instance: 9222e62a-9fd8-48b2-a125-83c9cdc589bd] Received event network-vif-deleted-5dae7844-411c-47aa-ba3e-bc209136f0a6 {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:38:35 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-e5c9e830-953d-4572-a14e-1b720f84cfa8 tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:38:35 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-e5c9e830-953d-4572-a14e-1b720f84cfa8 tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:38:35 user nova-compute[75045]: DEBUG nova.compute.provider_tree [None req-e5c9e830-953d-4572-a14e-1b720f84cfa8 tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] Inventory has not changed in ProviderTree for provider: 62ba5f85-c74d-4b58-986e-d4197e813fd7 {{(pid=75045) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 23:38:35 user nova-compute[75045]: DEBUG nova.scheduler.client.report [None req-e5c9e830-953d-4572-a14e-1b720f84cfa8 tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] Inventory has not changed for provider 62ba5f85-c74d-4b58-986e-d4197e813fd7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75045) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 23:38:35 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-e5c9e830-953d-4572-a14e-1b720f84cfa8 tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.316s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:38:35 user nova-compute[75045]: INFO nova.scheduler.client.report [None req-e5c9e830-953d-4572-a14e-1b720f84cfa8 tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] Deleted allocations for instance 9222e62a-9fd8-48b2-a125-83c9cdc589bd
Nov 08 23:38:35 user nova-compute[75045]: DEBUG nova.compute.manager [req-bf7909c5-54e0-4c15-82be-5d49884f4f1e req-2a7b14a7-f8b5-467c-8fe6-9dda3e2758be service nova] [instance: 9222e62a-9fd8-48b2-a125-83c9cdc589bd] Received event network-vif-plugged-5dae7844-411c-47aa-ba3e-bc209136f0a6 {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:38:35 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-bf7909c5-54e0-4c15-82be-5d49884f4f1e req-2a7b14a7-f8b5-467c-8fe6-9dda3e2758be service nova] Acquiring lock "9222e62a-9fd8-48b2-a125-83c9cdc589bd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:38:35 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-bf7909c5-54e0-4c15-82be-5d49884f4f1e req-2a7b14a7-f8b5-467c-8fe6-9dda3e2758be service nova] Lock "9222e62a-9fd8-48b2-a125-83c9cdc589bd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:38:35 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-bf7909c5-54e0-4c15-82be-5d49884f4f1e req-2a7b14a7-f8b5-467c-8fe6-9dda3e2758be service nova] Lock "9222e62a-9fd8-48b2-a125-83c9cdc589bd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:38:35 user nova-compute[75045]: DEBUG nova.compute.manager [req-bf7909c5-54e0-4c15-82be-5d49884f4f1e req-2a7b14a7-f8b5-467c-8fe6-9dda3e2758be service nova] [instance: 9222e62a-9fd8-48b2-a125-83c9cdc589bd] No waiting events found dispatching network-vif-plugged-5dae7844-411c-47aa-ba3e-bc209136f0a6 {{(pid=75045) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 23:38:35 user nova-compute[75045]: WARNING nova.compute.manager [req-bf7909c5-54e0-4c15-82be-5d49884f4f1e req-2a7b14a7-f8b5-467c-8fe6-9dda3e2758be service nova] [instance: 9222e62a-9fd8-48b2-a125-83c9cdc589bd] Received unexpected event network-vif-plugged-5dae7844-411c-47aa-ba3e-bc209136f0a6 for instance with vm_state deleted and task_state None.
Nov 08 23:38:35 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-e5c9e830-953d-4572-a14e-1b720f84cfa8 tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] Lock "9222e62a-9fd8-48b2-a125-83c9cdc589bd" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.486s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:38:36 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:38:39 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:38:44 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 23:38:49 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 23:38:49 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:38:49 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75045) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 23:38:49 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75045) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 23:38:49 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75045) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 23:38:49 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:38:51 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:38:51 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:38:51 user nova-compute[75045]: DEBUG nova.compute.manager [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Starting heal instance info cache {{(pid=75045) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 23:38:51 user nova-compute[75045]: DEBUG nova.compute.manager [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Didn't find any instances for network info cache update. {{(pid=75045) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 08 23:38:51 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:38:51 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:38:51 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:38:51 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:38:51 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:38:51 user nova-compute[75045]: DEBUG nova.compute.manager [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75045) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 23:38:51 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:38:53 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager.update_available_resource {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:38:54 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:38:54 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:38:54 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:38:54 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Auditing locally available compute resources for user (node: user) {{(pid=75045) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 23:38:54 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:38:54 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/244c4cc9-2837-40c9-b4ad-37dc435c9749/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:38:54 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/244c4cc9-2837-40c9-b4ad-37dc435c9749/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:38:54 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/244c4cc9-2837-40c9-b4ad-37dc435c9749/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:38:54 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/244c4cc9-2837-40c9-b4ad-37dc435c9749/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:38:54 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4c0930f-4309-43bb-959b-4f36ec457bb6/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:38:54 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4c0930f-4309-43bb-959b-4f36ec457bb6/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:38:54 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4c0930f-4309-43bb-959b-4f36ec457bb6/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:38:54 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4c0930f-4309-43bb-959b-4f36ec457bb6/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:38:54 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75045) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 23:38:54 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ee587a0-e271-4262-a252-2ccb6c2faecb/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:38:55 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ee587a0-e271-4262-a252-2ccb6c2faecb/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:38:55 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ee587a0-e271-4262-a252-2ccb6c2faecb/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:38:55 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ee587a0-e271-4262-a252-2ccb6c2faecb/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:38:55 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78955913-bbab-4b00-bc9b-12116f249d7e/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:38:55 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78955913-bbab-4b00-bc9b-12116f249d7e/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:38:55 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78955913-bbab-4b00-bc9b-12116f249d7e/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:38:55 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78955913-bbab-4b00-bc9b-12116f249d7e/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:38:55 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] skipping disk /dev/sdd (vdc) as it is a volume {{(pid=75045) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 23:38:55 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5fc7f02-2143-4bcf-92ac-078d5ec10747/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:38:55 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5fc7f02-2143-4bcf-92ac-078d5ec10747/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:38:55 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5fc7f02-2143-4bcf-92ac-078d5ec10747/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:38:56 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5fc7f02-2143-4bcf-92ac-078d5ec10747/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:38:56 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/adcffd35-00c7-49db-a72f-d6307a90e123/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:38:56 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/adcffd35-00c7-49db-a72f-d6307a90e123/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:38:56 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/adcffd35-00c7-49db-a72f-d6307a90e123/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:38:56 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/adcffd35-00c7-49db-a72f-d6307a90e123/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:38:56 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b84f2b1-01a3-4789-bcef-8b7c4334132b/disk.rescue --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:38:56 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b84f2b1-01a3-4789-bcef-8b7c4334132b/disk.rescue --force-share --output=json" returned: 0 in 0.213s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:38:56 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b84f2b1-01a3-4789-bcef-8b7c4334132b/disk.rescue --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:38:57 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b84f2b1-01a3-4789-bcef-8b7c4334132b/disk.rescue --force-share --output=json" returned: 0 in 0.254s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:38:57 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b84f2b1-01a3-4789-bcef-8b7c4334132b/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:38:57 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b84f2b1-01a3-4789-bcef-8b7c4334132b/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:38:57 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b84f2b1-01a3-4789-bcef-8b7c4334132b/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:38:57 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b84f2b1-01a3-4789-bcef-8b7c4334132b/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:38:57 user nova-compute[75045]: WARNING nova.virt.libvirt.driver [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 23:38:57 user nova-compute[75045]: WARNING nova.virt.libvirt.driver [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 23:38:57 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Hypervisor/Node resource view: name=user free_ram=7979MB free_disk=25.069896697998047GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75045) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 23:38:57 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:38:57 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:38:57 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Instance b5fc7f02-2143-4bcf-92ac-078d5ec10747 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75045) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 23:38:57 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Instance 0b84f2b1-01a3-4789-bcef-8b7c4334132b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75045) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 23:38:57 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Instance adcffd35-00c7-49db-a72f-d6307a90e123 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75045) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 23:38:57 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Instance b4c0930f-4309-43bb-959b-4f36ec457bb6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75045) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 23:38:57 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Instance 78955913-bbab-4b00-bc9b-12116f249d7e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75045) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 23:38:57 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Instance 244c4cc9-2837-40c9-b4ad-37dc435c9749 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75045) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 23:38:57 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Instance 7ee587a0-e271-4262-a252-2ccb6c2faecb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75045) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 23:38:57 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=75045) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 23:38:57 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=75045) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 23:38:58 user nova-compute[75045]: DEBUG nova.compute.provider_tree [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Inventory has not changed in ProviderTree for provider: 62ba5f85-c74d-4b58-986e-d4197e813fd7 {{(pid=75045) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 23:38:58 user nova-compute[75045]: DEBUG nova.scheduler.client.report [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Inventory has not changed for provider 62ba5f85-c74d-4b58-986e-d4197e813fd7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75045) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 23:38:58 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Compute_service record updated for user:user {{(pid=75045) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 23:38:58 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.438s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:38:59 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 23:39:04 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:39:08 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-e126d4db-fccf-4643-afdb-64988a2f612c tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] Acquiring lock "b4c0930f-4309-43bb-959b-4f36ec457bb6" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:39:08 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-e126d4db-fccf-4643-afdb-64988a2f612c tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] Lock "b4c0930f-4309-43bb-959b-4f36ec457bb6" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:39:08 user nova-compute[75045]: INFO nova.compute.manager [None req-e126d4db-fccf-4643-afdb-64988a2f612c tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] [instance: b4c0930f-4309-43bb-959b-4f36ec457bb6] Detaching volume 3f065c57-b67d-415e-9b6a-77d213104733
Nov 08 23:39:08 user nova-compute[75045]: INFO nova.virt.block_device [None req-e126d4db-fccf-4643-afdb-64988a2f612c tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] [instance: b4c0930f-4309-43bb-959b-4f36ec457bb6] Attempting to driver detach volume 3f065c57-b67d-415e-9b6a-77d213104733 from mountpoint /dev/vdb
Nov 08 23:39:08 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-3ff81658-28e0-4b04-8d8d-119f7fbe836e tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] Acquiring lock "b4c0930f-4309-43bb-959b-4f36ec457bb6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:39:08 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-e126d4db-fccf-4643-afdb-64988a2f612c tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] Attempting to detach device vdb from instance b4c0930f-4309-43bb-959b-4f36ec457bb6 from the persistent domain config. {{(pid=75045) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 08 23:39:08 user nova-compute[75045]: DEBUG nova.virt.libvirt.guest [None req-e126d4db-fccf-4643-afdb-64988a2f612c tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 23:39:08 user nova-compute[75045]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 23:39:08 user nova-compute[75045]:   <source dev="/dev/sdc"/>
Nov 08 23:39:08 user nova-compute[75045]:   <target dev="vdb" bus="virtio"/>
Nov 08 23:39:08 user nova-compute[75045]:   <serial>3f065c57-b67d-415e-9b6a-77d213104733</serial>
Nov 08 23:39:08 user nova-compute[75045]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 08 23:39:08 user nova-compute[75045]: </disk>
Nov 08 23:39:08 user nova-compute[75045]:  {{(pid=75045) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 23:39:08 user nova-compute[75045]: INFO nova.virt.libvirt.driver [None req-e126d4db-fccf-4643-afdb-64988a2f612c tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] Successfully detached device vdb from instance b4c0930f-4309-43bb-959b-4f36ec457bb6 from the persistent domain config.
Nov 08 23:39:08 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-e126d4db-fccf-4643-afdb-64988a2f612c tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance b4c0930f-4309-43bb-959b-4f36ec457bb6 from the live domain config. {{(pid=75045) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 08 23:39:08 user nova-compute[75045]: DEBUG nova.virt.libvirt.guest [None req-e126d4db-fccf-4643-afdb-64988a2f612c tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 23:39:08 user nova-compute[75045]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 23:39:08 user nova-compute[75045]:   <source dev="/dev/sdc"/>
Nov 08 23:39:08 user nova-compute[75045]:   <target dev="vdb" bus="virtio"/>
Nov 08 23:39:08 user nova-compute[75045]:   <serial>3f065c57-b67d-415e-9b6a-77d213104733</serial>
Nov 08 23:39:08 user nova-compute[75045]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 08 23:39:08 user nova-compute[75045]: </disk>
Nov 08 23:39:08 user nova-compute[75045]:  {{(pid=75045) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 23:39:09 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 23:39:09 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:39:09 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75045) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 23:39:09 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75045) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 23:39:09 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75045) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 23:39:09 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 23:39:09 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-e126d4db-fccf-4643-afdb-64988a2f612c tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance b4c0930f-4309-43bb-959b-4f36ec457bb6 {{(pid=75045) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 08 23:39:11 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:39:14 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:39:15 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:39:18 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:39:19 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:39:21 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:39:22 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:39:23 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-dab1f7a6-70e1-4ada-a012-1e04e04ac26b tempest-ServersNegativeTestJSON-1185286380 tempest-ServersNegativeTestJSON-1185286380-project-member] Acquiring lock "c3df54db-78d7-436b-b86a-df3257b170e6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:39:23 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-dab1f7a6-70e1-4ada-a012-1e04e04ac26b tempest-ServersNegativeTestJSON-1185286380 tempest-ServersNegativeTestJSON-1185286380-project-member] Lock "c3df54db-78d7-436b-b86a-df3257b170e6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:39:23 user nova-compute[75045]: DEBUG nova.compute.manager [None req-dab1f7a6-70e1-4ada-a012-1e04e04ac26b tempest-ServersNegativeTestJSON-1185286380 tempest-ServersNegativeTestJSON-1185286380-project-member] [instance: c3df54db-78d7-436b-b86a-df3257b170e6] Starting instance... {{(pid=75045) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 23:39:24 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-dab1f7a6-70e1-4ada-a012-1e04e04ac26b tempest-ServersNegativeTestJSON-1185286380 tempest-ServersNegativeTestJSON-1185286380-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:39:24 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-dab1f7a6-70e1-4ada-a012-1e04e04ac26b tempest-ServersNegativeTestJSON-1185286380 tempest-ServersNegativeTestJSON-1185286380-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:39:24 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-dab1f7a6-70e1-4ada-a012-1e04e04ac26b tempest-ServersNegativeTestJSON-1185286380 tempest-ServersNegativeTestJSON-1185286380-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75045) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 23:39:24 user nova-compute[75045]: INFO nova.compute.claims [None req-dab1f7a6-70e1-4ada-a012-1e04e04ac26b tempest-ServersNegativeTestJSON-1185286380 tempest-ServersNegativeTestJSON-1185286380-project-member] [instance: c3df54db-78d7-436b-b86a-df3257b170e6] Claim successful on node user
Nov 08 23:39:24 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:39:24 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:39:24 user nova-compute[75045]: DEBUG nova.compute.provider_tree [None req-dab1f7a6-70e1-4ada-a012-1e04e04ac26b tempest-ServersNegativeTestJSON-1185286380 tempest-ServersNegativeTestJSON-1185286380-project-member] Inventory has not changed in ProviderTree for provider: 62ba5f85-c74d-4b58-986e-d4197e813fd7 {{(pid=75045) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 23:39:24 user nova-compute[75045]: DEBUG nova.scheduler.client.report [None req-dab1f7a6-70e1-4ada-a012-1e04e04ac26b tempest-ServersNegativeTestJSON-1185286380 tempest-ServersNegativeTestJSON-1185286380-project-member] Inventory has not changed for provider 62ba5f85-c74d-4b58-986e-d4197e813fd7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75045) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 23:39:24 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-dab1f7a6-70e1-4ada-a012-1e04e04ac26b tempest-ServersNegativeTestJSON-1185286380 tempest-ServersNegativeTestJSON-1185286380-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.448s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:39:24 user nova-compute[75045]: DEBUG nova.compute.manager [None req-dab1f7a6-70e1-4ada-a012-1e04e04ac26b tempest-ServersNegativeTestJSON-1185286380 tempest-ServersNegativeTestJSON-1185286380-project-member] [instance: c3df54db-78d7-436b-b86a-df3257b170e6] Start building networks asynchronously for instance. {{(pid=75045) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 23:39:24 user nova-compute[75045]: DEBUG nova.compute.manager [None req-dab1f7a6-70e1-4ada-a012-1e04e04ac26b tempest-ServersNegativeTestJSON-1185286380 tempest-ServersNegativeTestJSON-1185286380-project-member] [instance: c3df54db-78d7-436b-b86a-df3257b170e6] Allocating IP information in the background. {{(pid=75045) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 23:39:24 user nova-compute[75045]: DEBUG nova.network.neutron [None req-dab1f7a6-70e1-4ada-a012-1e04e04ac26b tempest-ServersNegativeTestJSON-1185286380 tempest-ServersNegativeTestJSON-1185286380-project-member] [instance: c3df54db-78d7-436b-b86a-df3257b170e6] allocate_for_instance() {{(pid=75045) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 23:39:24 user nova-compute[75045]: INFO nova.virt.libvirt.driver [None req-dab1f7a6-70e1-4ada-a012-1e04e04ac26b tempest-ServersNegativeTestJSON-1185286380 tempest-ServersNegativeTestJSON-1185286380-project-member] [instance: c3df54db-78d7-436b-b86a-df3257b170e6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 23:39:24 user nova-compute[75045]: DEBUG nova.compute.manager [None req-dab1f7a6-70e1-4ada-a012-1e04e04ac26b tempest-ServersNegativeTestJSON-1185286380 tempest-ServersNegativeTestJSON-1185286380-project-member] [instance: c3df54db-78d7-436b-b86a-df3257b170e6] Start building block device mappings for instance. {{(pid=75045) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 23:39:24 user nova-compute[75045]: DEBUG nova.policy [None req-dab1f7a6-70e1-4ada-a012-1e04e04ac26b tempest-ServersNegativeTestJSON-1185286380 tempest-ServersNegativeTestJSON-1185286380-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '43c4b404522b424b8e23b2b5687a7821', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61c8f99e9d284b51bbf7bbf6bdfb8662', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75045) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 23:39:24 user nova-compute[75045]: DEBUG nova.compute.manager [None req-dab1f7a6-70e1-4ada-a012-1e04e04ac26b tempest-ServersNegativeTestJSON-1185286380 tempest-ServersNegativeTestJSON-1185286380-project-member] [instance: c3df54db-78d7-436b-b86a-df3257b170e6] Start spawning the instance on the hypervisor. {{(pid=75045) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 23:39:24 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-dab1f7a6-70e1-4ada-a012-1e04e04ac26b tempest-ServersNegativeTestJSON-1185286380 tempest-ServersNegativeTestJSON-1185286380-project-member] [instance: c3df54db-78d7-436b-b86a-df3257b170e6] Creating instance directory {{(pid=75045) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 23:39:24 user nova-compute[75045]: INFO nova.virt.libvirt.driver [None req-dab1f7a6-70e1-4ada-a012-1e04e04ac26b tempest-ServersNegativeTestJSON-1185286380 tempest-ServersNegativeTestJSON-1185286380-project-member] [instance: c3df54db-78d7-436b-b86a-df3257b170e6] Creating image(s)
Nov 08 23:39:24 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-dab1f7a6-70e1-4ada-a012-1e04e04ac26b tempest-ServersNegativeTestJSON-1185286380 tempest-ServersNegativeTestJSON-1185286380-project-member] Acquiring lock "/opt/stack/data/nova/instances/c3df54db-78d7-436b-b86a-df3257b170e6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:39:24 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-dab1f7a6-70e1-4ada-a012-1e04e04ac26b tempest-ServersNegativeTestJSON-1185286380 tempest-ServersNegativeTestJSON-1185286380-project-member] Lock "/opt/stack/data/nova/instances/c3df54db-78d7-436b-b86a-df3257b170e6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:39:24 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-dab1f7a6-70e1-4ada-a012-1e04e04ac26b tempest-ServersNegativeTestJSON-1185286380 tempest-ServersNegativeTestJSON-1185286380-project-member] Lock "/opt/stack/data/nova/instances/c3df54db-78d7-436b-b86a-df3257b170e6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:39:24 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-dab1f7a6-70e1-4ada-a012-1e04e04ac26b tempest-ServersNegativeTestJSON-1185286380 tempest-ServersNegativeTestJSON-1185286380-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b59f52a99fff51c56dd1edfb83892fb8f647f2f3 --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:39:24 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-dab1f7a6-70e1-4ada-a012-1e04e04ac26b tempest-ServersNegativeTestJSON-1185286380 tempest-ServersNegativeTestJSON-1185286380-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b59f52a99fff51c56dd1edfb83892fb8f647f2f3 --force-share --output=json" returned: 0 in 0.189s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:39:24 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-dab1f7a6-70e1-4ada-a012-1e04e04ac26b tempest-ServersNegativeTestJSON-1185286380 tempest-ServersNegativeTestJSON-1185286380-project-member] Acquiring lock "b59f52a99fff51c56dd1edfb83892fb8f647f2f3" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:39:24 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-dab1f7a6-70e1-4ada-a012-1e04e04ac26b tempest-ServersNegativeTestJSON-1185286380 tempest-ServersNegativeTestJSON-1185286380-project-member] Lock "b59f52a99fff51c56dd1edfb83892fb8f647f2f3" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:39:24 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-dab1f7a6-70e1-4ada-a012-1e04e04ac26b tempest-ServersNegativeTestJSON-1185286380 tempest-ServersNegativeTestJSON-1185286380-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b59f52a99fff51c56dd1edfb83892fb8f647f2f3 --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:39:25 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-dab1f7a6-70e1-4ada-a012-1e04e04ac26b tempest-ServersNegativeTestJSON-1185286380 tempest-ServersNegativeTestJSON-1185286380-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b59f52a99fff51c56dd1edfb83892fb8f647f2f3 --force-share --output=json" returned: 0 in 0.181s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:39:25 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-dab1f7a6-70e1-4ada-a012-1e04e04ac26b tempest-ServersNegativeTestJSON-1185286380 tempest-ServersNegativeTestJSON-1185286380-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b59f52a99fff51c56dd1edfb83892fb8f647f2f3,backing_fmt=raw /opt/stack/data/nova/instances/c3df54db-78d7-436b-b86a-df3257b170e6/disk 1073741824 {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:39:25 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-dab1f7a6-70e1-4ada-a012-1e04e04ac26b tempest-ServersNegativeTestJSON-1185286380 tempest-ServersNegativeTestJSON-1185286380-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b59f52a99fff51c56dd1edfb83892fb8f647f2f3,backing_fmt=raw /opt/stack/data/nova/instances/c3df54db-78d7-436b-b86a-df3257b170e6/disk 1073741824" returned: 0 in 0.054s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:39:25 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-dab1f7a6-70e1-4ada-a012-1e04e04ac26b tempest-ServersNegativeTestJSON-1185286380 tempest-ServersNegativeTestJSON-1185286380-project-member] Lock "b59f52a99fff51c56dd1edfb83892fb8f647f2f3" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.244s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:39:25 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-dab1f7a6-70e1-4ada-a012-1e04e04ac26b tempest-ServersNegativeTestJSON-1185286380 tempest-ServersNegativeTestJSON-1185286380-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b59f52a99fff51c56dd1edfb83892fb8f647f2f3 --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:39:25 user nova-compute[75045]: DEBUG nova.network.neutron [None req-dab1f7a6-70e1-4ada-a012-1e04e04ac26b tempest-ServersNegativeTestJSON-1185286380 tempest-ServersNegativeTestJSON-1185286380-project-member] [instance: c3df54db-78d7-436b-b86a-df3257b170e6] Successfully created port: ebefec6f-8abb-429a-90dd-8a6995ad4625 {{(pid=75045) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 23:39:25 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-dab1f7a6-70e1-4ada-a012-1e04e04ac26b tempest-ServersNegativeTestJSON-1185286380 tempest-ServersNegativeTestJSON-1185286380-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b59f52a99fff51c56dd1edfb83892fb8f647f2f3 --force-share --output=json" returned: 0 in 0.212s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:39:25 user nova-compute[75045]: DEBUG nova.virt.disk.api [None req-dab1f7a6-70e1-4ada-a012-1e04e04ac26b tempest-ServersNegativeTestJSON-1185286380 tempest-ServersNegativeTestJSON-1185286380-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c3df54db-78d7-436b-b86a-df3257b170e6/disk. size=1073741824 {{(pid=75045) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 23:39:25 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-dab1f7a6-70e1-4ada-a012-1e04e04ac26b tempest-ServersNegativeTestJSON-1185286380 tempest-ServersNegativeTestJSON-1185286380-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3df54db-78d7-436b-b86a-df3257b170e6/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:39:25 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-dab1f7a6-70e1-4ada-a012-1e04e04ac26b tempest-ServersNegativeTestJSON-1185286380 tempest-ServersNegativeTestJSON-1185286380-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3df54db-78d7-436b-b86a-df3257b170e6/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:39:25 user nova-compute[75045]: DEBUG nova.virt.disk.api [None req-dab1f7a6-70e1-4ada-a012-1e04e04ac26b tempest-ServersNegativeTestJSON-1185286380 tempest-ServersNegativeTestJSON-1185286380-project-member] Cannot resize image /opt/stack/data/nova/instances/c3df54db-78d7-436b-b86a-df3257b170e6/disk to a smaller size. {{(pid=75045) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 08 23:39:25 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-dab1f7a6-70e1-4ada-a012-1e04e04ac26b tempest-ServersNegativeTestJSON-1185286380 tempest-ServersNegativeTestJSON-1185286380-project-member] [instance: c3df54db-78d7-436b-b86a-df3257b170e6] Created local disks {{(pid=75045) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 23:39:25 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-dab1f7a6-70e1-4ada-a012-1e04e04ac26b tempest-ServersNegativeTestJSON-1185286380 tempest-ServersNegativeTestJSON-1185286380-project-member] [instance: c3df54db-78d7-436b-b86a-df3257b170e6] Ensure instance console log exists: /opt/stack/data/nova/instances/c3df54db-78d7-436b-b86a-df3257b170e6/console.log {{(pid=75045) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 23:39:25 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-dab1f7a6-70e1-4ada-a012-1e04e04ac26b tempest-ServersNegativeTestJSON-1185286380 tempest-ServersNegativeTestJSON-1185286380-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:39:25 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-dab1f7a6-70e1-4ada-a012-1e04e04ac26b tempest-ServersNegativeTestJSON-1185286380 tempest-ServersNegativeTestJSON-1185286380-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:39:25 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-dab1f7a6-70e1-4ada-a012-1e04e04ac26b tempest-ServersNegativeTestJSON-1185286380 tempest-ServersNegativeTestJSON-1185286380-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:39:25 user nova-compute[75045]: DEBUG nova.network.neutron [None req-dab1f7a6-70e1-4ada-a012-1e04e04ac26b tempest-ServersNegativeTestJSON-1185286380 tempest-ServersNegativeTestJSON-1185286380-project-member] [instance: c3df54db-78d7-436b-b86a-df3257b170e6] Successfully updated port: ebefec6f-8abb-429a-90dd-8a6995ad4625 {{(pid=75045) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 23:39:25 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-dab1f7a6-70e1-4ada-a012-1e04e04ac26b tempest-ServersNegativeTestJSON-1185286380 tempest-ServersNegativeTestJSON-1185286380-project-member] Acquiring lock "refresh_cache-c3df54db-78d7-436b-b86a-df3257b170e6" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 23:39:25 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-dab1f7a6-70e1-4ada-a012-1e04e04ac26b tempest-ServersNegativeTestJSON-1185286380 tempest-ServersNegativeTestJSON-1185286380-project-member] Acquired lock "refresh_cache-c3df54db-78d7-436b-b86a-df3257b170e6" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 23:39:25 user nova-compute[75045]: DEBUG nova.network.neutron [None req-dab1f7a6-70e1-4ada-a012-1e04e04ac26b tempest-ServersNegativeTestJSON-1185286380 tempest-ServersNegativeTestJSON-1185286380-project-member] [instance: c3df54db-78d7-436b-b86a-df3257b170e6] Building network info cache for instance {{(pid=75045) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 23:39:26 user nova-compute[75045]: DEBUG nova.compute.manager [req-8fd77aeb-4709-4ac1-9b31-f74cbd67f66c req-ecb45c44-17bd-4472-a7f1-98eb640a051c service nova] [instance: c3df54db-78d7-436b-b86a-df3257b170e6] Received event network-changed-ebefec6f-8abb-429a-90dd-8a6995ad4625 {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:39:26 user nova-compute[75045]: DEBUG nova.compute.manager [req-8fd77aeb-4709-4ac1-9b31-f74cbd67f66c req-ecb45c44-17bd-4472-a7f1-98eb640a051c service nova] [instance: c3df54db-78d7-436b-b86a-df3257b170e6] Refreshing instance network info cache due to event network-changed-ebefec6f-8abb-429a-90dd-8a6995ad4625. {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 23:39:26 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-8fd77aeb-4709-4ac1-9b31-f74cbd67f66c req-ecb45c44-17bd-4472-a7f1-98eb640a051c service nova] Acquiring lock "refresh_cache-c3df54db-78d7-436b-b86a-df3257b170e6" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 23:39:26 user nova-compute[75045]: DEBUG nova.network.neutron [None req-dab1f7a6-70e1-4ada-a012-1e04e04ac26b tempest-ServersNegativeTestJSON-1185286380 tempest-ServersNegativeTestJSON-1185286380-project-member] [instance: c3df54db-78d7-436b-b86a-df3257b170e6] Instance cache missing network info. {{(pid=75045) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 23:39:26 user nova-compute[75045]: DEBUG nova.network.neutron [None req-dab1f7a6-70e1-4ada-a012-1e04e04ac26b tempest-ServersNegativeTestJSON-1185286380 tempest-ServersNegativeTestJSON-1185286380-project-member] [instance: c3df54db-78d7-436b-b86a-df3257b170e6] Updating instance_info_cache with network_info: [{"id": "ebefec6f-8abb-429a-90dd-8a6995ad4625", "address": "fa:16:3e:37:87:58", "network": {"id": "eac8b567-0d31-42ec-b05d-2ca251612286", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1889897935-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "61c8f99e9d284b51bbf7bbf6bdfb8662", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebefec6f-8a", "ovs_interfaceid": "ebefec6f-8abb-429a-90dd-8a6995ad4625", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75045) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 23:39:26 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-dab1f7a6-70e1-4ada-a012-1e04e04ac26b tempest-ServersNegativeTestJSON-1185286380 tempest-ServersNegativeTestJSON-1185286380-project-member] Releasing lock "refresh_cache-c3df54db-78d7-436b-b86a-df3257b170e6" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 23:39:26 user nova-compute[75045]: DEBUG nova.compute.manager [None req-dab1f7a6-70e1-4ada-a012-1e04e04ac26b tempest-ServersNegativeTestJSON-1185286380 tempest-ServersNegativeTestJSON-1185286380-project-member] [instance: c3df54db-78d7-436b-b86a-df3257b170e6] Instance network_info: |[{"id": "ebefec6f-8abb-429a-90dd-8a6995ad4625", "address": "fa:16:3e:37:87:58", "network": {"id": "eac8b567-0d31-42ec-b05d-2ca251612286", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1889897935-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "61c8f99e9d284b51bbf7bbf6bdfb8662", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebefec6f-8a", "ovs_interfaceid": "ebefec6f-8abb-429a-90dd-8a6995ad4625", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75045) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 23:39:26 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-8fd77aeb-4709-4ac1-9b31-f74cbd67f66c req-ecb45c44-17bd-4472-a7f1-98eb640a051c service nova] Acquired lock "refresh_cache-c3df54db-78d7-436b-b86a-df3257b170e6" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 23:39:26 user nova-compute[75045]: DEBUG nova.network.neutron [req-8fd77aeb-4709-4ac1-9b31-f74cbd67f66c req-ecb45c44-17bd-4472-a7f1-98eb640a051c service nova] [instance: c3df54db-78d7-436b-b86a-df3257b170e6] Refreshing network info cache for port ebefec6f-8abb-429a-90dd-8a6995ad4625 {{(pid=75045) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 23:39:26 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-dab1f7a6-70e1-4ada-a012-1e04e04ac26b tempest-ServersNegativeTestJSON-1185286380 tempest-ServersNegativeTestJSON-1185286380-project-member] [instance: c3df54db-78d7-436b-b86a-df3257b170e6] Start _get_guest_xml network_info=[{"id": "ebefec6f-8abb-429a-90dd-8a6995ad4625", "address": "fa:16:3e:37:87:58", "network": {"id": "eac8b567-0d31-42ec-b05d-2ca251612286", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1889897935-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "61c8f99e9d284b51bbf7bbf6bdfb8662", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebefec6f-8a", "ovs_interfaceid": "ebefec6f-8abb-429a-90dd-8a6995ad4625", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T23:11:54Z,direct_url=<?>,disk_format='qcow2',id=a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b1beba2cc4e7465ea249e2225fb494dc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T23:11:56Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'disk_bus': 'virtio', 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': 'a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75045) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 23:39:26 user nova-compute[75045]: WARNING nova.virt.libvirt.driver [None req-dab1f7a6-70e1-4ada-a012-1e04e04ac26b tempest-ServersNegativeTestJSON-1185286380 tempest-ServersNegativeTestJSON-1185286380-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 23:39:26 user nova-compute[75045]: WARNING nova.virt.libvirt.driver [None req-dab1f7a6-70e1-4ada-a012-1e04e04ac26b tempest-ServersNegativeTestJSON-1185286380 tempest-ServersNegativeTestJSON-1185286380-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 23:39:26 user nova-compute[75045]: DEBUG nova.virt.libvirt.host [None req-dab1f7a6-70e1-4ada-a012-1e04e04ac26b tempest-ServersNegativeTestJSON-1185286380 tempest-ServersNegativeTestJSON-1185286380-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75045) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 23:39:26 user nova-compute[75045]: DEBUG nova.virt.libvirt.host [None req-dab1f7a6-70e1-4ada-a012-1e04e04ac26b tempest-ServersNegativeTestJSON-1185286380 tempest-ServersNegativeTestJSON-1185286380-project-member] CPU controller missing on host. {{(pid=75045) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 23:39:26 user nova-compute[75045]: DEBUG nova.virt.libvirt.host [None req-dab1f7a6-70e1-4ada-a012-1e04e04ac26b tempest-ServersNegativeTestJSON-1185286380 tempest-ServersNegativeTestJSON-1185286380-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75045) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 23:39:26 user nova-compute[75045]: DEBUG nova.virt.libvirt.host [None req-dab1f7a6-70e1-4ada-a012-1e04e04ac26b tempest-ServersNegativeTestJSON-1185286380 tempest-ServersNegativeTestJSON-1185286380-project-member] CPU controller found on host. {{(pid=75045) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 23:39:26 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-dab1f7a6-70e1-4ada-a012-1e04e04ac26b tempest-ServersNegativeTestJSON-1185286380 tempest-ServersNegativeTestJSON-1185286380-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75045) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 23:39:26 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-dab1f7a6-70e1-4ada-a012-1e04e04ac26b tempest-ServersNegativeTestJSON-1185286380 tempest-ServersNegativeTestJSON-1185286380-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T23:11:41Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T23:11:54Z,direct_url=<?>,disk_format='qcow2',id=a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b1beba2cc4e7465ea249e2225fb494dc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T23:11:56Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75045) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 23:39:26 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-dab1f7a6-70e1-4ada-a012-1e04e04ac26b tempest-ServersNegativeTestJSON-1185286380 tempest-ServersNegativeTestJSON-1185286380-project-member] Flavor limits 0:0:0 {{(pid=75045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 23:39:26 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-dab1f7a6-70e1-4ada-a012-1e04e04ac26b tempest-ServersNegativeTestJSON-1185286380 tempest-ServersNegativeTestJSON-1185286380-project-member] Image limits 0:0:0 {{(pid=75045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 23:39:26 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-dab1f7a6-70e1-4ada-a012-1e04e04ac26b tempest-ServersNegativeTestJSON-1185286380 tempest-ServersNegativeTestJSON-1185286380-project-member] Flavor pref 0:0:0 {{(pid=75045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 23:39:26 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-dab1f7a6-70e1-4ada-a012-1e04e04ac26b tempest-ServersNegativeTestJSON-1185286380 tempest-ServersNegativeTestJSON-1185286380-project-member] Image pref 0:0:0 {{(pid=75045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 23:39:26 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-dab1f7a6-70e1-4ada-a012-1e04e04ac26b tempest-ServersNegativeTestJSON-1185286380 tempest-ServersNegativeTestJSON-1185286380-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 23:39:26 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-dab1f7a6-70e1-4ada-a012-1e04e04ac26b tempest-ServersNegativeTestJSON-1185286380 tempest-ServersNegativeTestJSON-1185286380-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75045) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 23:39:26 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-dab1f7a6-70e1-4ada-a012-1e04e04ac26b tempest-ServersNegativeTestJSON-1185286380 tempest-ServersNegativeTestJSON-1185286380-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75045) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 23:39:26 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-dab1f7a6-70e1-4ada-a012-1e04e04ac26b tempest-ServersNegativeTestJSON-1185286380 tempest-ServersNegativeTestJSON-1185286380-project-member] Got 1 possible topologies {{(pid=75045) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 23:39:26 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-dab1f7a6-70e1-4ada-a012-1e04e04ac26b tempest-ServersNegativeTestJSON-1185286380 tempest-ServersNegativeTestJSON-1185286380-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75045) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 23:39:26 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-dab1f7a6-70e1-4ada-a012-1e04e04ac26b tempest-ServersNegativeTestJSON-1185286380 tempest-ServersNegativeTestJSON-1185286380-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75045) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 23:39:26 user nova-compute[75045]: DEBUG nova.virt.libvirt.vif [None req-dab1f7a6-70e1-4ada-a012-1e04e04ac26b tempest-ServersNegativeTestJSON-1185286380 tempest-ServersNegativeTestJSON-1185286380-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T23:39:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1982442390',display_name='tempest-ServersNegativeTestJSON-server-1982442390',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1982442390',id=38,image_ref='a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='61c8f99e9d284b51bbf7bbf6bdfb8662',ramdisk_id='',reservation_id='r-r2fmzdht',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1185286380',owner_user_name='tempest-ServersNegativeTestJSON-1185286380-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T23:39:25Z,user_data=None,user_id='43c4b404522b424b8e23b2b5687a7821',uuid=c3df54db-78d7-436b-b86a-df3257b170e6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ebefec6f-8abb-429a-90dd-8a6995ad4625", "address": "fa:16:3e:37:87:58", "network": {"id": "eac8b567-0d31-42ec-b05d-2ca251612286", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1889897935-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "61c8f99e9d284b51bbf7bbf6bdfb8662", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebefec6f-8a", "ovs_interfaceid": "ebefec6f-8abb-429a-90dd-8a6995ad4625", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75045) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 23:39:26 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-dab1f7a6-70e1-4ada-a012-1e04e04ac26b tempest-ServersNegativeTestJSON-1185286380 tempest-ServersNegativeTestJSON-1185286380-project-member] Converting VIF {"id": "ebefec6f-8abb-429a-90dd-8a6995ad4625", "address": "fa:16:3e:37:87:58", "network": {"id": "eac8b567-0d31-42ec-b05d-2ca251612286", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1889897935-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "61c8f99e9d284b51bbf7bbf6bdfb8662", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebefec6f-8a", "ovs_interfaceid": "ebefec6f-8abb-429a-90dd-8a6995ad4625", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 23:39:26 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-dab1f7a6-70e1-4ada-a012-1e04e04ac26b tempest-ServersNegativeTestJSON-1185286380 tempest-ServersNegativeTestJSON-1185286380-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:37:87:58,bridge_name='br-int',has_traffic_filtering=True,id=ebefec6f-8abb-429a-90dd-8a6995ad4625,network=Network(eac8b567-0d31-42ec-b05d-2ca251612286),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapebefec6f-8a') {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 23:39:26 user nova-compute[75045]: DEBUG nova.objects.instance [None req-dab1f7a6-70e1-4ada-a012-1e04e04ac26b tempest-ServersNegativeTestJSON-1185286380 tempest-ServersNegativeTestJSON-1185286380-project-member] Lazy-loading 'pci_devices' on Instance uuid c3df54db-78d7-436b-b86a-df3257b170e6 {{(pid=75045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 23:39:26 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-dab1f7a6-70e1-4ada-a012-1e04e04ac26b tempest-ServersNegativeTestJSON-1185286380 tempest-ServersNegativeTestJSON-1185286380-project-member] [instance: c3df54db-78d7-436b-b86a-df3257b170e6] End _get_guest_xml xml=<domain type="kvm">
Nov 08 23:39:26 user nova-compute[75045]:   <uuid>c3df54db-78d7-436b-b86a-df3257b170e6</uuid>
Nov 08 23:39:26 user nova-compute[75045]:   <name>instance-00000026</name>
Nov 08 23:39:26 user nova-compute[75045]:   <memory>524288</memory>
Nov 08 23:39:26 user nova-compute[75045]:   <vcpu>1</vcpu>
Nov 08 23:39:26 user nova-compute[75045]:   <metadata>
Nov 08 23:39:26 user nova-compute[75045]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 23:39:26 user nova-compute[75045]:       <nova:package version="0.0.0"/>
Nov 08 23:39:26 user nova-compute[75045]:       <nova:name>tempest-ServersNegativeTestJSON-server-1982442390</nova:name>
Nov 08 23:39:26 user nova-compute[75045]:       <nova:creationTime>2023-11-08 23:39:26</nova:creationTime>
Nov 08 23:39:26 user nova-compute[75045]:       <nova:flavor name="m1.tiny">
Nov 08 23:39:26 user nova-compute[75045]:         <nova:memory>512</nova:memory>
Nov 08 23:39:26 user nova-compute[75045]:         <nova:disk>1</nova:disk>
Nov 08 23:39:26 user nova-compute[75045]:         <nova:swap>0</nova:swap>
Nov 08 23:39:26 user nova-compute[75045]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 23:39:26 user nova-compute[75045]:         <nova:vcpus>1</nova:vcpus>
Nov 08 23:39:26 user nova-compute[75045]:       </nova:flavor>
Nov 08 23:39:26 user nova-compute[75045]:       <nova:owner>
Nov 08 23:39:26 user nova-compute[75045]:         <nova:user uuid="43c4b404522b424b8e23b2b5687a7821">tempest-ServersNegativeTestJSON-1185286380-project-member</nova:user>
Nov 08 23:39:26 user nova-compute[75045]:         <nova:project uuid="61c8f99e9d284b51bbf7bbf6bdfb8662">tempest-ServersNegativeTestJSON-1185286380</nova:project>
Nov 08 23:39:26 user nova-compute[75045]:       </nova:owner>
Nov 08 23:39:26 user nova-compute[75045]:       <nova:root type="image" uuid="a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb"/>
Nov 08 23:39:26 user nova-compute[75045]:       <nova:ports>
Nov 08 23:39:26 user nova-compute[75045]:         <nova:port uuid="ebefec6f-8abb-429a-90dd-8a6995ad4625">
Nov 08 23:39:26 user nova-compute[75045]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 08 23:39:26 user nova-compute[75045]:         </nova:port>
Nov 08 23:39:26 user nova-compute[75045]:       </nova:ports>
Nov 08 23:39:26 user nova-compute[75045]:     </nova:instance>
Nov 08 23:39:26 user nova-compute[75045]:   </metadata>
Nov 08 23:39:26 user nova-compute[75045]:   <sysinfo type="smbios">
Nov 08 23:39:26 user nova-compute[75045]:     <system>
Nov 08 23:39:26 user nova-compute[75045]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 23:39:26 user nova-compute[75045]:       <entry name="product">OpenStack Nova</entry>
Nov 08 23:39:26 user nova-compute[75045]:       <entry name="version">0.0.0</entry>
Nov 08 23:39:26 user nova-compute[75045]:       <entry name="serial">c3df54db-78d7-436b-b86a-df3257b170e6</entry>
Nov 08 23:39:26 user nova-compute[75045]:       <entry name="uuid">c3df54db-78d7-436b-b86a-df3257b170e6</entry>
Nov 08 23:39:26 user nova-compute[75045]:       <entry name="family">Virtual Machine</entry>
Nov 08 23:39:26 user nova-compute[75045]:     </system>
Nov 08 23:39:26 user nova-compute[75045]:   </sysinfo>
Nov 08 23:39:26 user nova-compute[75045]:   <os>
Nov 08 23:39:26 user nova-compute[75045]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 23:39:26 user nova-compute[75045]:     <boot dev="hd"/>
Nov 08 23:39:26 user nova-compute[75045]:     <smbios mode="sysinfo"/>
Nov 08 23:39:26 user nova-compute[75045]:   </os>
Nov 08 23:39:26 user nova-compute[75045]:   <features>
Nov 08 23:39:26 user nova-compute[75045]:     <acpi/>
Nov 08 23:39:26 user nova-compute[75045]:     <apic/>
Nov 08 23:39:26 user nova-compute[75045]:     <vmcoreinfo/>
Nov 08 23:39:26 user nova-compute[75045]:   </features>
Nov 08 23:39:26 user nova-compute[75045]:   <clock offset="utc">
Nov 08 23:39:26 user nova-compute[75045]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 23:39:26 user nova-compute[75045]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 23:39:26 user nova-compute[75045]:     <timer name="hpet" present="no"/>
Nov 08 23:39:26 user nova-compute[75045]:   </clock>
Nov 08 23:39:26 user nova-compute[75045]:   <cpu mode="custom" match="exact">
Nov 08 23:39:26 user nova-compute[75045]:     <model>Nehalem</model>
Nov 08 23:39:26 user nova-compute[75045]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 23:39:26 user nova-compute[75045]:   </cpu>
Nov 08 23:39:26 user nova-compute[75045]:   <devices>
Nov 08 23:39:26 user nova-compute[75045]:     <disk type="file" device="disk">
Nov 08 23:39:26 user nova-compute[75045]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 23:39:26 user nova-compute[75045]:       <source file="/opt/stack/data/nova/instances/c3df54db-78d7-436b-b86a-df3257b170e6/disk"/>
Nov 08 23:39:26 user nova-compute[75045]:       <target dev="vda" bus="virtio"/>
Nov 08 23:39:26 user nova-compute[75045]:     </disk>
Nov 08 23:39:26 user nova-compute[75045]:     <interface type="ethernet">
Nov 08 23:39:26 user nova-compute[75045]:       <mac address="fa:16:3e:37:87:58"/>
Nov 08 23:39:26 user nova-compute[75045]:       <model type="virtio"/>
Nov 08 23:39:26 user nova-compute[75045]:       <mtu size="1442"/>
Nov 08 23:39:26 user nova-compute[75045]:       <target dev="tapebefec6f-8a"/>
Nov 08 23:39:26 user nova-compute[75045]:     </interface>
Nov 08 23:39:26 user nova-compute[75045]:     <serial type="pty">
Nov 08 23:39:26 user nova-compute[75045]:       <log file="/opt/stack/data/nova/instances/c3df54db-78d7-436b-b86a-df3257b170e6/console.log" append="off"/>
Nov 08 23:39:26 user nova-compute[75045]:     </serial>
Nov 08 23:39:26 user nova-compute[75045]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 23:39:26 user nova-compute[75045]:     <video>
Nov 08 23:39:26 user nova-compute[75045]:       <model type="virtio"/>
Nov 08 23:39:26 user nova-compute[75045]:     </video>
Nov 08 23:39:26 user nova-compute[75045]:     <rng model="virtio">
Nov 08 23:39:26 user nova-compute[75045]:       <backend model="random">/dev/urandom</backend>
Nov 08 23:39:26 user nova-compute[75045]:     </rng>
Nov 08 23:39:26 user nova-compute[75045]:     <controller type="usb" index="0" model="none"/>
Nov 08 23:39:26 user nova-compute[75045]:     <memballoon model="virtio">
Nov 08 23:39:26 user nova-compute[75045]:       <stats period="10"/>
Nov 08 23:39:26 user nova-compute[75045]:     </memballoon>
Nov 08 23:39:26 user nova-compute[75045]:   </devices>
Nov 08 23:39:26 user nova-compute[75045]: </domain>
Nov 08 23:39:26 user nova-compute[75045]:  {{(pid=75045) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 23:39:26 user nova-compute[75045]: DEBUG nova.virt.libvirt.vif [None req-dab1f7a6-70e1-4ada-a012-1e04e04ac26b tempest-ServersNegativeTestJSON-1185286380 tempest-ServersNegativeTestJSON-1185286380-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T23:39:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1982442390',display_name='tempest-ServersNegativeTestJSON-server-1982442390',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1982442390',id=38,image_ref='a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='61c8f99e9d284b51bbf7bbf6bdfb8662',ramdisk_id='',reservation_id='r-r2fmzdht',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1185286380',owner_user_name='tempest-ServersNegativeTestJSON-1185286380-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T23:39:25Z,user_data=None,user_id='43c4b404522b424b8e23b2b5687a7821',uuid=c3df54db-78d7-436b-b86a-df3257b170e6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ebefec6f-8abb-429a-90dd-8a6995ad4625", "address": "fa:16:3e:37:87:58", "network": {"id": "eac8b567-0d31-42ec-b05d-2ca251612286", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1889897935-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "61c8f99e9d284b51bbf7bbf6bdfb8662", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebefec6f-8a", "ovs_interfaceid": "ebefec6f-8abb-429a-90dd-8a6995ad4625", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75045) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 23:39:26 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-dab1f7a6-70e1-4ada-a012-1e04e04ac26b tempest-ServersNegativeTestJSON-1185286380 tempest-ServersNegativeTestJSON-1185286380-project-member] Converting VIF {"id": "ebefec6f-8abb-429a-90dd-8a6995ad4625", "address": "fa:16:3e:37:87:58", "network": {"id": "eac8b567-0d31-42ec-b05d-2ca251612286", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1889897935-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "61c8f99e9d284b51bbf7bbf6bdfb8662", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebefec6f-8a", "ovs_interfaceid": "ebefec6f-8abb-429a-90dd-8a6995ad4625", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 23:39:26 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-dab1f7a6-70e1-4ada-a012-1e04e04ac26b tempest-ServersNegativeTestJSON-1185286380 tempest-ServersNegativeTestJSON-1185286380-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:37:87:58,bridge_name='br-int',has_traffic_filtering=True,id=ebefec6f-8abb-429a-90dd-8a6995ad4625,network=Network(eac8b567-0d31-42ec-b05d-2ca251612286),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapebefec6f-8a') {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 23:39:26 user nova-compute[75045]: DEBUG os_vif [None req-dab1f7a6-70e1-4ada-a012-1e04e04ac26b tempest-ServersNegativeTestJSON-1185286380 tempest-ServersNegativeTestJSON-1185286380-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:37:87:58,bridge_name='br-int',has_traffic_filtering=True,id=ebefec6f-8abb-429a-90dd-8a6995ad4625,network=Network(eac8b567-0d31-42ec-b05d-2ca251612286),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapebefec6f-8a') {{(pid=75045) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 23:39:26 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:39:26 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:39:26 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 23:39:26 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:39:26 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2228c99f-c45c-5bb1-a367-576f895b5937', '_type': 'linux-noop'}}, row=False) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:39:26 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:39:26 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 23:39:26 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:39:26 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapebefec6f-8a, may_exist=True, interface_attrs={}) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:39:26 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapebefec6f-8a, col_values=(('qos', UUID('5a2d12d0-998d-4c03-9a51-5c26288ffb9d')),), if_exists=True) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:39:26 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapebefec6f-8a, col_values=(('external_ids', {'iface-id': 'ebefec6f-8abb-429a-90dd-8a6995ad4625', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:37:87:58', 'vm-uuid': 'c3df54db-78d7-436b-b86a-df3257b170e6'}),), if_exists=True) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:39:26 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:39:26 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 23:39:26 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:39:26 user nova-compute[75045]: INFO os_vif [None req-dab1f7a6-70e1-4ada-a012-1e04e04ac26b tempest-ServersNegativeTestJSON-1185286380 tempest-ServersNegativeTestJSON-1185286380-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:37:87:58,bridge_name='br-int',has_traffic_filtering=True,id=ebefec6f-8abb-429a-90dd-8a6995ad4625,network=Network(eac8b567-0d31-42ec-b05d-2ca251612286),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapebefec6f-8a')
Nov 08 23:39:26 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-dab1f7a6-70e1-4ada-a012-1e04e04ac26b tempest-ServersNegativeTestJSON-1185286380 tempest-ServersNegativeTestJSON-1185286380-project-member] No BDM found with device name vda, not building metadata. {{(pid=75045) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 23:39:26 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-dab1f7a6-70e1-4ada-a012-1e04e04ac26b tempest-ServersNegativeTestJSON-1185286380 tempest-ServersNegativeTestJSON-1185286380-project-member] No VIF found with MAC fa:16:3e:37:87:58, not building metadata {{(pid=75045) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 23:39:26 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:39:26 user nova-compute[75045]: DEBUG nova.network.neutron [req-8fd77aeb-4709-4ac1-9b31-f74cbd67f66c req-ecb45c44-17bd-4472-a7f1-98eb640a051c service nova] [instance: c3df54db-78d7-436b-b86a-df3257b170e6] Updated VIF entry in instance network info cache for port ebefec6f-8abb-429a-90dd-8a6995ad4625. {{(pid=75045) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 23:39:26 user nova-compute[75045]: DEBUG nova.network.neutron [req-8fd77aeb-4709-4ac1-9b31-f74cbd67f66c req-ecb45c44-17bd-4472-a7f1-98eb640a051c service nova] [instance: c3df54db-78d7-436b-b86a-df3257b170e6] Updating instance_info_cache with network_info: [{"id": "ebefec6f-8abb-429a-90dd-8a6995ad4625", "address": "fa:16:3e:37:87:58", "network": {"id": "eac8b567-0d31-42ec-b05d-2ca251612286", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1889897935-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "61c8f99e9d284b51bbf7bbf6bdfb8662", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebefec6f-8a", "ovs_interfaceid": "ebefec6f-8abb-429a-90dd-8a6995ad4625", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75045) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 23:39:26 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-8fd77aeb-4709-4ac1-9b31-f74cbd67f66c req-ecb45c44-17bd-4472-a7f1-98eb640a051c service nova] Releasing lock "refresh_cache-c3df54db-78d7-436b-b86a-df3257b170e6" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 23:39:27 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:39:27 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:39:27 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:39:27 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:39:28 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:39:29 user nova-compute[75045]: DEBUG nova.compute.manager [req-49d35bd1-62a4-478b-a708-8d5ea4c31c82 req-6786b46d-f544-446c-a77d-ed57c81ee564 service nova] [instance: c3df54db-78d7-436b-b86a-df3257b170e6] Received event network-vif-plugged-ebefec6f-8abb-429a-90dd-8a6995ad4625 {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:39:29 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-49d35bd1-62a4-478b-a708-8d5ea4c31c82 req-6786b46d-f544-446c-a77d-ed57c81ee564 service nova] Acquiring lock "c3df54db-78d7-436b-b86a-df3257b170e6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:39:29 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-49d35bd1-62a4-478b-a708-8d5ea4c31c82 req-6786b46d-f544-446c-a77d-ed57c81ee564 service nova] Lock "c3df54db-78d7-436b-b86a-df3257b170e6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:39:29 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-49d35bd1-62a4-478b-a708-8d5ea4c31c82 req-6786b46d-f544-446c-a77d-ed57c81ee564 service nova] Lock "c3df54db-78d7-436b-b86a-df3257b170e6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:39:29 user nova-compute[75045]: DEBUG nova.compute.manager [req-49d35bd1-62a4-478b-a708-8d5ea4c31c82 req-6786b46d-f544-446c-a77d-ed57c81ee564 service nova] [instance: c3df54db-78d7-436b-b86a-df3257b170e6] No waiting events found dispatching network-vif-plugged-ebefec6f-8abb-429a-90dd-8a6995ad4625 {{(pid=75045) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 23:39:29 user nova-compute[75045]: WARNING nova.compute.manager [req-49d35bd1-62a4-478b-a708-8d5ea4c31c82 req-6786b46d-f544-446c-a77d-ed57c81ee564 service nova] [instance: c3df54db-78d7-436b-b86a-df3257b170e6] Received unexpected event network-vif-plugged-ebefec6f-8abb-429a-90dd-8a6995ad4625 for instance with vm_state building and task_state spawning.
Nov 08 23:39:29 user nova-compute[75045]: WARNING nova.virt.libvirt.driver [None req-e126d4db-fccf-4643-afdb-64988a2f612c tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance b4c0930f-4309-43bb-959b-4f36ec457bb6 is timed out.
Nov 08 23:39:29 user nova-compute[75045]: INFO nova.virt.libvirt.driver [None req-e126d4db-fccf-4643-afdb-64988a2f612c tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] Successfully detached device vdb from instance b4c0930f-4309-43bb-959b-4f36ec457bb6 from the live domain config.
Nov 08 23:39:29 user nova-compute[75045]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e126d4db-fccf-4643-afdb-64988a2f612c tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] [instance: b4c0930f-4309-43bb-959b-4f36ec457bb6] calling os-brick to detach iSCSI Volume {{(pid=75045) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 23:39:29 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-e126d4db-fccf-4643-afdb-64988a2f612c tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1b68210460>, {'target_iqn': 'iqn.2010-10.org.openstack:3f065c57-b67d-415e-9b6a-77d213104733', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rwXRcekv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75045) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 23:39:29 user nova-compute[75045]: WARNING os_brick.initiator.connectors.base [None req-e126d4db-fccf-4643-afdb-64988a2f612c tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 23:39:29 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-e126d4db-fccf-4643-afdb-64988a2f612c tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 23:39:29 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-e126d4db-fccf-4643-afdb-64988a2f612c tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 23:39:29 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:39:29 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:39:29 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[331288a8-7c55-4c3b-b85e-b30b49323916]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5c6e98f2-e9be-4c1a-b335-61187862dfec\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3f065c57-b67d-415e-9b6a-77d213104733\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:39:29 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-e126d4db-fccf-4643-afdb-64988a2f612c tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 23:39:29 user nova-compute[75045]: No targets found.
Nov 08 23:39:29 user nova-compute[75045]: iSNS:
Nov 08 23:39:29 user nova-compute[75045]: No targets found.
Nov 08 23:39:29 user nova-compute[75045]: STATIC:
Nov 08 23:39:29 user nova-compute[75045]: Target: iqn.2010-10.org.openstack:5c6e98f2-e9be-4c1a-b335-61187862dfec
Nov 08 23:39:29 user nova-compute[75045]:         Portal: 172.16.0.220:3260,-1
Nov 08 23:39:29 user nova-compute[75045]:                 Iface Name: default
Nov 08 23:39:29 user nova-compute[75045]: Target: iqn.2010-10.org.openstack:3f065c57-b67d-415e-9b6a-77d213104733
Nov 08 23:39:29 user nova-compute[75045]:         Portal: 172.16.0.220:3260,-1
Nov 08 23:39:29 user nova-compute[75045]:                 Iface Name: default
Nov 08 23:39:29 user nova-compute[75045]: FIRMWARE:
Nov 08 23:39:29 user nova-compute[75045]: No targets found.
Nov 08 23:39:29 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 23:39:29 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-e126d4db-fccf-4643-afdb-64988a2f612c tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 23:39:29 user nova-compute[75045]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 23:39:29 user nova-compute[75045]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75045) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 23:39:29 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-e126d4db-fccf-4643-afdb-64988a2f612c tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3f065c57-b67d-415e-9b6a-77d213104733', 0)] {{(pid=75045) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 23:39:29 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:39:29 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:39:29 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cbbf716-2ced-4cf7-a671-57fcb2bd3ce8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3f065c57-b67d-415e-9b6a-77d213104733\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5c6e98f2-e9be-4c1a-b335-61187862dfec\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:39:29 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:39:29 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:39:29 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c2ca224-d666-43e3-a134-04e90f79ce15]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f065c57-b67d-415e-9b6a-77d213104733 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c6e98f2-e9be-4c1a-b335-61187862dfec (non-flash)\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:39:29 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-e126d4db-fccf-4643-afdb-64988a2f612c tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f065c57-b67d-415e-9b6a-77d213104733 (non-flash)
Nov 08 23:39:29 user nova-compute[75045]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c6e98f2-e9be-4c1a-b335-61187862dfec (non-flash)
Nov 08 23:39:29 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 23:39:29 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-e126d4db-fccf-4643-afdb-64988a2f612c tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f065c57-b67d-415e-9b6a-77d213104733 (non-flash)
Nov 08 23:39:29 user nova-compute[75045]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c6e98f2-e9be-4c1a-b335-61187862dfec (non-flash)
Nov 08 23:39:29 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 23:39:29 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-e126d4db-fccf-4643-afdb-64988a2f612c tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1b68268ee0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3f065c57-b67d-415e-9b6a-77d213104733'): ({'sdc'}, set())}) {{(pid=75045) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 23:39:29 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-e126d4db-fccf-4643-afdb-64988a2f612c tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] Removing single pathed devices sdc {{(pid=75045) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 23:39:29 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:39:29 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:39:29 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[82d07088-7e0e-42cf-a8e3-83a6cb7b16d0]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:39:29 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:39:29 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:39:29 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd041384-a33b-421b-86ce-68b3b3a80068]: (4, ('ok\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:39:29 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-e126d4db-fccf-4643-afdb-64988a2f612c tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] Flushing IO for device /dev/sdc {{(pid=75045) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 23:39:29 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:39:29 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:39:29 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[3797db9f-618c-4c71-a150-b2aa0f8e8057]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:39:29 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-e126d4db-fccf-4643-afdb-64988a2f612c tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75045) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 23:39:29 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:39:29 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.055s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:39:29 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[1df0cde7-e4ee-4a64-a164-d3ee71df6a6c]: (4, ('1', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:39:29 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-e126d4db-fccf-4643-afdb-64988a2f612c tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75045) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 23:39:29 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-e126d4db-fccf-4643-afdb-64988a2f612c tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] SCSI volumes sdc have been removed. {{(pid=75045) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 23:39:29 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-e126d4db-fccf-4643-afdb-64988a2f612c tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3f065c57-b67d-415e-9b6a-77d213104733')] {{(pid=75045) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 23:39:29 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f065c57-b67d-415e-9b6a-77d213104733 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:39:29 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f065c57-b67d-415e-9b6a-77d213104733 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:39:29 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[d592f8de-263c-471c-9bb6-5fff342b8e0b]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:39:29 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-e126d4db-fccf-4643-afdb-64988a2f612c tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:39:29 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f065c57-b67d-415e-9b6a-77d213104733 -p 172.16.0.220:3260 --logout {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:39:29 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f065c57-b67d-415e-9b6a-77d213104733 -p 172.16.0.220:3260 --logout" returned: 0 in 0.049s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:39:29 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[21010a68-bb0e-425a-bdf0-dd4ef999c866]: (4, ('Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:3f065c57-b67d-415e-9b6a-77d213104733, portal: 172.16.0.220,3260]\nLogout of [sid: 38, target: iqn.2010-10.org.openstack:3f065c57-b67d-415e-9b6a-77d213104733, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:39:29 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-e126d4db-fccf-4643-afdb-64988a2f612c tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:3f065c57-b67d-415e-9b6a-77d213104733, portal: 172.16.0.220,3260]
Nov 08 23:39:29 user nova-compute[75045]: Logout of [sid: 38, target: iqn.2010-10.org.openstack:3f065c57-b67d-415e-9b6a-77d213104733, portal: 172.16.0.220,3260] successful.
Nov 08 23:39:29 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:39:29 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f065c57-b67d-415e-9b6a-77d213104733 -p 172.16.0.220:3260 --op delete {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:39:29 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f065c57-b67d-415e-9b6a-77d213104733 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:39:29 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9834f01-f9ba-4957-9a1c-4158e543db96]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:39:29 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-e126d4db-fccf-4643-afdb-64988a2f612c tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:39:29 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-e126d4db-fccf-4643-afdb-64988a2f612c tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.295s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 23:39:29 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-e126d4db-fccf-4643-afdb-64988a2f612c tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] <== disconnect_volume: return (296ms) None {{(pid=75045) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 23:39:29 user nova-compute[75045]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e126d4db-fccf-4643-afdb-64988a2f612c tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] [instance: b4c0930f-4309-43bb-959b-4f36ec457bb6] Disconnected iSCSI Volume {{(pid=75045) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 23:39:29 user nova-compute[75045]: DEBUG nova.compute.manager [None req-dab1f7a6-70e1-4ada-a012-1e04e04ac26b tempest-ServersNegativeTestJSON-1185286380 tempest-ServersNegativeTestJSON-1185286380-project-member] [instance: c3df54db-78d7-436b-b86a-df3257b170e6] Instance event wait completed in 0 seconds for  {{(pid=75045) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 23:39:29 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-dab1f7a6-70e1-4ada-a012-1e04e04ac26b tempest-ServersNegativeTestJSON-1185286380 tempest-ServersNegativeTestJSON-1185286380-project-member] [instance: c3df54db-78d7-436b-b86a-df3257b170e6] Guest created on hypervisor {{(pid=75045) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 23:39:29 user nova-compute[75045]: INFO nova.virt.libvirt.driver [-] [instance: c3df54db-78d7-436b-b86a-df3257b170e6] Instance spawned successfully.
Nov 08 23:39:29 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-dab1f7a6-70e1-4ada-a012-1e04e04ac26b tempest-ServersNegativeTestJSON-1185286380 tempest-ServersNegativeTestJSON-1185286380-project-member] [instance: c3df54db-78d7-436b-b86a-df3257b170e6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75045) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 23:39:29 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-dab1f7a6-70e1-4ada-a012-1e04e04ac26b tempest-ServersNegativeTestJSON-1185286380 tempest-ServersNegativeTestJSON-1185286380-project-member] [instance: c3df54db-78d7-436b-b86a-df3257b170e6] Found default for hw_cdrom_bus of ide {{(pid=75045) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 23:39:29 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-dab1f7a6-70e1-4ada-a012-1e04e04ac26b tempest-ServersNegativeTestJSON-1185286380 tempest-ServersNegativeTestJSON-1185286380-project-member] [instance: c3df54db-78d7-436b-b86a-df3257b170e6] Found default for hw_disk_bus of virtio {{(pid=75045) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 23:39:29 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-dab1f7a6-70e1-4ada-a012-1e04e04ac26b tempest-ServersNegativeTestJSON-1185286380 tempest-ServersNegativeTestJSON-1185286380-project-member] [instance: c3df54db-78d7-436b-b86a-df3257b170e6] Found default for hw_input_bus of None {{(pid=75045) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 23:39:29 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-dab1f7a6-70e1-4ada-a012-1e04e04ac26b tempest-ServersNegativeTestJSON-1185286380 tempest-ServersNegativeTestJSON-1185286380-project-member] [instance: c3df54db-78d7-436b-b86a-df3257b170e6] Found default for hw_pointer_model of None {{(pid=75045) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 23:39:29 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-dab1f7a6-70e1-4ada-a012-1e04e04ac26b tempest-ServersNegativeTestJSON-1185286380 tempest-ServersNegativeTestJSON-1185286380-project-member] [instance: c3df54db-78d7-436b-b86a-df3257b170e6] Found default for hw_video_model of virtio {{(pid=75045) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 23:39:29 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-dab1f7a6-70e1-4ada-a012-1e04e04ac26b tempest-ServersNegativeTestJSON-1185286380 tempest-ServersNegativeTestJSON-1185286380-project-member] [instance: c3df54db-78d7-436b-b86a-df3257b170e6] Found default for hw_vif_model of virtio {{(pid=75045) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 23:39:30 user nova-compute[75045]: INFO nova.compute.manager [None req-dab1f7a6-70e1-4ada-a012-1e04e04ac26b tempest-ServersNegativeTestJSON-1185286380 tempest-ServersNegativeTestJSON-1185286380-project-member] [instance: c3df54db-78d7-436b-b86a-df3257b170e6] Took 5.28 seconds to spawn the instance on the hypervisor.
Nov 08 23:39:30 user nova-compute[75045]: DEBUG nova.compute.manager [None req-dab1f7a6-70e1-4ada-a012-1e04e04ac26b tempest-ServersNegativeTestJSON-1185286380 tempest-ServersNegativeTestJSON-1185286380-project-member] [instance: c3df54db-78d7-436b-b86a-df3257b170e6] Checking state {{(pid=75045) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 23:39:30 user nova-compute[75045]: INFO nova.compute.manager [None req-dab1f7a6-70e1-4ada-a012-1e04e04ac26b tempest-ServersNegativeTestJSON-1185286380 tempest-ServersNegativeTestJSON-1185286380-project-member] [instance: c3df54db-78d7-436b-b86a-df3257b170e6] Took 6.14 seconds to build instance.
Nov 08 23:39:30 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-dab1f7a6-70e1-4ada-a012-1e04e04ac26b tempest-ServersNegativeTestJSON-1185286380 tempest-ServersNegativeTestJSON-1185286380-project-member] Lock "c3df54db-78d7-436b-b86a-df3257b170e6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.323s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:39:31 user nova-compute[75045]: DEBUG nova.compute.manager [req-c4918389-0c09-4384-af21-b4981d39ae11 req-4099232e-5d9b-4b90-86c0-628642331f00 service nova] [instance: c3df54db-78d7-436b-b86a-df3257b170e6] Received event network-vif-plugged-ebefec6f-8abb-429a-90dd-8a6995ad4625 {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:39:31 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-c4918389-0c09-4384-af21-b4981d39ae11 req-4099232e-5d9b-4b90-86c0-628642331f00 service nova] Acquiring lock "c3df54db-78d7-436b-b86a-df3257b170e6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:39:31 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-c4918389-0c09-4384-af21-b4981d39ae11 req-4099232e-5d9b-4b90-86c0-628642331f00 service nova] Lock "c3df54db-78d7-436b-b86a-df3257b170e6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:39:31 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-c4918389-0c09-4384-af21-b4981d39ae11 req-4099232e-5d9b-4b90-86c0-628642331f00 service nova] Lock "c3df54db-78d7-436b-b86a-df3257b170e6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:39:31 user nova-compute[75045]: DEBUG nova.compute.manager [req-c4918389-0c09-4384-af21-b4981d39ae11 req-4099232e-5d9b-4b90-86c0-628642331f00 service nova] [instance: c3df54db-78d7-436b-b86a-df3257b170e6] No waiting events found dispatching network-vif-plugged-ebefec6f-8abb-429a-90dd-8a6995ad4625 {{(pid=75045) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 23:39:31 user nova-compute[75045]: WARNING nova.compute.manager [req-c4918389-0c09-4384-af21-b4981d39ae11 req-4099232e-5d9b-4b90-86c0-628642331f00 service nova] [instance: c3df54db-78d7-436b-b86a-df3257b170e6] Received unexpected event network-vif-plugged-ebefec6f-8abb-429a-90dd-8a6995ad4625 for instance with vm_state active and task_state None.
Nov 08 23:39:31 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:39:31 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:39:36 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:39:36 user nova-compute[75045]: DEBUG nova.objects.instance [None req-e126d4db-fccf-4643-afdb-64988a2f612c tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] Lazy-loading 'flavor' on Instance uuid b4c0930f-4309-43bb-959b-4f36ec457bb6 {{(pid=75045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 23:39:36 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-e126d4db-fccf-4643-afdb-64988a2f612c tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] Lock "b4c0930f-4309-43bb-959b-4f36ec457bb6" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 28.165s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:39:36 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-3ff81658-28e0-4b04-8d8d-119f7fbe836e tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] Lock "b4c0930f-4309-43bb-959b-4f36ec457bb6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 28.051s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:39:36 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-3ff81658-28e0-4b04-8d8d-119f7fbe836e tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] Acquiring lock "b4c0930f-4309-43bb-959b-4f36ec457bb6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:39:36 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-3ff81658-28e0-4b04-8d8d-119f7fbe836e tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] Lock "b4c0930f-4309-43bb-959b-4f36ec457bb6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:39:36 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-3ff81658-28e0-4b04-8d8d-119f7fbe836e tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] Lock "b4c0930f-4309-43bb-959b-4f36ec457bb6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:39:36 user nova-compute[75045]: INFO nova.compute.manager [None req-3ff81658-28e0-4b04-8d8d-119f7fbe836e tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] [instance: b4c0930f-4309-43bb-959b-4f36ec457bb6] Terminating instance
Nov 08 23:39:36 user nova-compute[75045]: DEBUG nova.compute.manager [None req-3ff81658-28e0-4b04-8d8d-119f7fbe836e tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] [instance: b4c0930f-4309-43bb-959b-4f36ec457bb6] Start destroying the instance on the hypervisor. {{(pid=75045) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 23:39:36 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:39:36 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:39:36 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:39:37 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:39:37 user nova-compute[75045]: DEBUG nova.compute.manager [req-56eb0cff-199c-40b8-88dc-92bdd187fa26 req-2cf561a7-9679-4660-8064-349499e9be62 service nova] [instance: b4c0930f-4309-43bb-959b-4f36ec457bb6] Received event network-vif-unplugged-663b2fc9-e6a3-4d9a-81bc-484f78acc4dd {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:39:37 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-56eb0cff-199c-40b8-88dc-92bdd187fa26 req-2cf561a7-9679-4660-8064-349499e9be62 service nova] Acquiring lock "b4c0930f-4309-43bb-959b-4f36ec457bb6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:39:37 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-56eb0cff-199c-40b8-88dc-92bdd187fa26 req-2cf561a7-9679-4660-8064-349499e9be62 service nova] Lock "b4c0930f-4309-43bb-959b-4f36ec457bb6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:39:37 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-56eb0cff-199c-40b8-88dc-92bdd187fa26 req-2cf561a7-9679-4660-8064-349499e9be62 service nova] Lock "b4c0930f-4309-43bb-959b-4f36ec457bb6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:39:37 user nova-compute[75045]: DEBUG nova.compute.manager [req-56eb0cff-199c-40b8-88dc-92bdd187fa26 req-2cf561a7-9679-4660-8064-349499e9be62 service nova] [instance: b4c0930f-4309-43bb-959b-4f36ec457bb6] No waiting events found dispatching network-vif-unplugged-663b2fc9-e6a3-4d9a-81bc-484f78acc4dd {{(pid=75045) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 23:39:37 user nova-compute[75045]: DEBUG nova.compute.manager [req-56eb0cff-199c-40b8-88dc-92bdd187fa26 req-2cf561a7-9679-4660-8064-349499e9be62 service nova] [instance: b4c0930f-4309-43bb-959b-4f36ec457bb6] Received event network-vif-unplugged-663b2fc9-e6a3-4d9a-81bc-484f78acc4dd for instance with task_state deleting. {{(pid=75045) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 23:39:37 user nova-compute[75045]: INFO nova.virt.libvirt.driver [-] [instance: b4c0930f-4309-43bb-959b-4f36ec457bb6] Instance destroyed successfully.
Nov 08 23:39:37 user nova-compute[75045]: DEBUG nova.objects.instance [None req-3ff81658-28e0-4b04-8d8d-119f7fbe836e tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] Lazy-loading 'resources' on Instance uuid b4c0930f-4309-43bb-959b-4f36ec457bb6 {{(pid=75045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 23:39:37 user nova-compute[75045]: DEBUG nova.virt.libvirt.vif [None req-3ff81658-28e0-4b04-8d8d-119f7fbe836e tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T23:35:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-2009963107',display_name='tempest-VolumesSnapshotTestJSON-instance-2009963107',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-2009963107',id=35,image_ref='a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLnjKeBjBHoKmy9j4HNkcFvqFAiYNhmGBrR6rb7DdrlyUYn2o/xrjq17JSZrMaGbwZKA3q3h9Q+vaGBdtWJ1bkqUxh0nIfi3eaVgNLcADV+7GSgUqL7YJFBmOmWVAaQ1jA==',key_name='tempest-keypair-830577175',keypairs=<?>,launch_index=0,launched_at=2023-11-08T23:35:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4f374e5f34c3464fb6f1f82f5d836c57',ramdisk_id='',reservation_id='r-p6s51nzb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-814421851',owner_user_name='tempest-VolumesSnapshotTestJSON-814421851-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T23:35:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a46e4d0d14c44ec6945c3ce972031a35',uuid=b4c0930f-4309-43bb-959b-4f36ec457bb6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "663b2fc9-e6a3-4d9a-81bc-484f78acc4dd", "address": "fa:16:3e:20:81:d8", "network": {"id": "ec929af3-f098-4338-943c-d13305d4d555", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-208938347-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.151", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f374e5f34c3464fb6f1f82f5d836c57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap663b2fc9-e6", "ovs_interfaceid": "663b2fc9-e6a3-4d9a-81bc-484f78acc4dd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75045) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 23:39:37 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-3ff81658-28e0-4b04-8d8d-119f7fbe836e tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] Converting VIF {"id": "663b2fc9-e6a3-4d9a-81bc-484f78acc4dd", "address": "fa:16:3e:20:81:d8", "network": {"id": "ec929af3-f098-4338-943c-d13305d4d555", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-208938347-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.151", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f374e5f34c3464fb6f1f82f5d836c57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap663b2fc9-e6", "ovs_interfaceid": "663b2fc9-e6a3-4d9a-81bc-484f78acc4dd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 23:39:37 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-3ff81658-28e0-4b04-8d8d-119f7fbe836e tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:20:81:d8,bridge_name='br-int',has_traffic_filtering=True,id=663b2fc9-e6a3-4d9a-81bc-484f78acc4dd,network=Network(ec929af3-f098-4338-943c-d13305d4d555),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap663b2fc9-e6') {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 23:39:37 user nova-compute[75045]: DEBUG os_vif [None req-3ff81658-28e0-4b04-8d8d-119f7fbe836e tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:20:81:d8,bridge_name='br-int',has_traffic_filtering=True,id=663b2fc9-e6a3-4d9a-81bc-484f78acc4dd,network=Network(ec929af3-f098-4338-943c-d13305d4d555),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap663b2fc9-e6') {{(pid=75045) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 23:39:37 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:39:37 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap663b2fc9-e6, bridge=br-int, if_exists=True) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:39:37 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:39:37 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 23:39:37 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:39:37 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e0e495b9-23e7-4fed-90cd-1b4b12a26660) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:39:37 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:39:37 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:39:37 user nova-compute[75045]: INFO os_vif [None req-3ff81658-28e0-4b04-8d8d-119f7fbe836e tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:20:81:d8,bridge_name='br-int',has_traffic_filtering=True,id=663b2fc9-e6a3-4d9a-81bc-484f78acc4dd,network=Network(ec929af3-f098-4338-943c-d13305d4d555),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap663b2fc9-e6')
Nov 08 23:39:37 user nova-compute[75045]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3ff81658-28e0-4b04-8d8d-119f7fbe836e tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] [instance: b4c0930f-4309-43bb-959b-4f36ec457bb6] calling os-brick to detach iSCSI Volume {{(pid=75045) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 23:39:37 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ff81658-28e0-4b04-8d8d-119f7fbe836e tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1b68210460>, {'target_iqn': 'iqn.2010-10.org.openstack:3f065c57-b67d-415e-9b6a-77d213104733', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rwXRcekv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75045) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 23:39:37 user nova-compute[75045]: WARNING os_brick.initiator.connectors.base [None req-3ff81658-28e0-4b04-8d8d-119f7fbe836e tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 23:39:37 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-3ff81658-28e0-4b04-8d8d-119f7fbe836e tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 23:39:37 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-3ff81658-28e0-4b04-8d8d-119f7fbe836e tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 23:39:37 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:39:37 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:39:37 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[9950c7c9-2f36-4d15-b9bf-96071083240c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5c6e98f2-e9be-4c1a-b335-61187862dfec\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:39:37 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ff81658-28e0-4b04-8d8d-119f7fbe836e tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 23:39:37 user nova-compute[75045]: No targets found.
Nov 08 23:39:37 user nova-compute[75045]: iSNS:
Nov 08 23:39:37 user nova-compute[75045]: No targets found.
Nov 08 23:39:37 user nova-compute[75045]: STATIC:
Nov 08 23:39:37 user nova-compute[75045]: Target: iqn.2010-10.org.openstack:5c6e98f2-e9be-4c1a-b335-61187862dfec
Nov 08 23:39:37 user nova-compute[75045]:         Portal: 172.16.0.220:3260,-1
Nov 08 23:39:37 user nova-compute[75045]:                 Iface Name: default
Nov 08 23:39:37 user nova-compute[75045]: FIRMWARE:
Nov 08 23:39:37 user nova-compute[75045]: No targets found.
Nov 08 23:39:37 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 23:39:37 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ff81658-28e0-4b04-8d8d-119f7fbe836e tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 23:39:37 user nova-compute[75045]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 23:39:37 user nova-compute[75045]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75045) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 23:39:37 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ff81658-28e0-4b04-8d8d-119f7fbe836e tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3f065c57-b67d-415e-9b6a-77d213104733', 0)] {{(pid=75045) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 23:39:37 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:39:37 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:39:37 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[79ba224d-a65c-44b1-aede-ec3fd2f6d235]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5c6e98f2-e9be-4c1a-b335-61187862dfec\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:39:37 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:39:37 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:39:37 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[d818f450-3c0d-468e-b3b3-74e2fef21ef2]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c6e98f2-e9be-4c1a-b335-61187862dfec (non-flash)\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:39:37 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ff81658-28e0-4b04-8d8d-119f7fbe836e tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c6e98f2-e9be-4c1a-b335-61187862dfec (non-flash)
Nov 08 23:39:37 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 23:39:37 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ff81658-28e0-4b04-8d8d-119f7fbe836e tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c6e98f2-e9be-4c1a-b335-61187862dfec (non-flash)
Nov 08 23:39:37 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 23:39:37 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ff81658-28e0-4b04-8d8d-119f7fbe836e tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1b700815a0>, {}) {{(pid=75045) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 23:39:37 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ff81658-28e0-4b04-8d8d-119f7fbe836e tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] Disconnecting from: [] {{(pid=75045) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 23:39:37 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-3ff81658-28e0-4b04-8d8d-119f7fbe836e tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.076s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 23:39:37 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ff81658-28e0-4b04-8d8d-119f7fbe836e tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] <== disconnect_volume: return (77ms) None {{(pid=75045) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 23:39:37 user nova-compute[75045]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3ff81658-28e0-4b04-8d8d-119f7fbe836e tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] [instance: b4c0930f-4309-43bb-959b-4f36ec457bb6] Disconnected iSCSI Volume {{(pid=75045) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 23:39:37 user nova-compute[75045]: INFO nova.virt.libvirt.driver [None req-3ff81658-28e0-4b04-8d8d-119f7fbe836e tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] [instance: b4c0930f-4309-43bb-959b-4f36ec457bb6] Deleting instance files /opt/stack/data/nova/instances/b4c0930f-4309-43bb-959b-4f36ec457bb6_del
Nov 08 23:39:37 user nova-compute[75045]: INFO nova.virt.libvirt.driver [None req-3ff81658-28e0-4b04-8d8d-119f7fbe836e tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] [instance: b4c0930f-4309-43bb-959b-4f36ec457bb6] Deletion of /opt/stack/data/nova/instances/b4c0930f-4309-43bb-959b-4f36ec457bb6_del complete
Nov 08 23:39:37 user nova-compute[75045]: INFO nova.compute.manager [None req-3ff81658-28e0-4b04-8d8d-119f7fbe836e tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] [instance: b4c0930f-4309-43bb-959b-4f36ec457bb6] Took 0.98 seconds to destroy the instance on the hypervisor.
Nov 08 23:39:37 user nova-compute[75045]: DEBUG oslo.service.loopingcall [None req-3ff81658-28e0-4b04-8d8d-119f7fbe836e tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75045) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 23:39:37 user nova-compute[75045]: DEBUG nova.compute.manager [-] [instance: b4c0930f-4309-43bb-959b-4f36ec457bb6] Deallocating network for instance {{(pid=75045) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 23:39:37 user nova-compute[75045]: DEBUG nova.network.neutron [-] [instance: b4c0930f-4309-43bb-959b-4f36ec457bb6] deallocate_for_instance() {{(pid=75045) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 23:39:38 user nova-compute[75045]: DEBUG nova.network.neutron [-] [instance: b4c0930f-4309-43bb-959b-4f36ec457bb6] Updating instance_info_cache with network_info: [] {{(pid=75045) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 23:39:38 user nova-compute[75045]: DEBUG nova.compute.manager [req-948a2e51-fa8b-4a39-9b03-944744f85f60 req-1b28154c-3d2d-4b9a-a9a9-b7bd89b9d762 service nova] [instance: b4c0930f-4309-43bb-959b-4f36ec457bb6] Received event network-vif-deleted-663b2fc9-e6a3-4d9a-81bc-484f78acc4dd {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:39:38 user nova-compute[75045]: INFO nova.compute.manager [req-948a2e51-fa8b-4a39-9b03-944744f85f60 req-1b28154c-3d2d-4b9a-a9a9-b7bd89b9d762 service nova] [instance: b4c0930f-4309-43bb-959b-4f36ec457bb6] Neutron deleted interface 663b2fc9-e6a3-4d9a-81bc-484f78acc4dd; detaching it from the instance and deleting it from the info cache
Nov 08 23:39:38 user nova-compute[75045]: DEBUG nova.network.neutron [req-948a2e51-fa8b-4a39-9b03-944744f85f60 req-1b28154c-3d2d-4b9a-a9a9-b7bd89b9d762 service nova] [instance: b4c0930f-4309-43bb-959b-4f36ec457bb6] Updating instance_info_cache with network_info: [] {{(pid=75045) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 23:39:38 user nova-compute[75045]: INFO nova.compute.manager [-] [instance: b4c0930f-4309-43bb-959b-4f36ec457bb6] Took 0.83 seconds to deallocate network for instance.
Nov 08 23:39:38 user nova-compute[75045]: DEBUG nova.compute.manager [req-948a2e51-fa8b-4a39-9b03-944744f85f60 req-1b28154c-3d2d-4b9a-a9a9-b7bd89b9d762 service nova] [instance: b4c0930f-4309-43bb-959b-4f36ec457bb6] Detach interface failed, port_id=663b2fc9-e6a3-4d9a-81bc-484f78acc4dd, reason: Instance b4c0930f-4309-43bb-959b-4f36ec457bb6 could not be found. {{(pid=75045) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 08 23:39:38 user nova-compute[75045]: WARNING nova.volume.cinder [None req-3ff81658-28e0-4b04-8d8d-119f7fbe836e tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] Attachment 07cffe5e-3aee-453c-95df-bb3dcc129eba does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 07cffe5e-3aee-453c-95df-bb3dcc129eba. (HTTP 404) (Request-ID: req-d8f6f778-d6e4-4173-bd52-2bec40658998)
Nov 08 23:39:38 user nova-compute[75045]: INFO nova.compute.manager [None req-3ff81658-28e0-4b04-8d8d-119f7fbe836e tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] [instance: b4c0930f-4309-43bb-959b-4f36ec457bb6] Took 0.03 seconds to detach 1 volumes for instance.
Nov 08 23:39:38 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-35b09304-8e9c-44d3-99f8-b99db9aba8ca tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] Acquiring lock "78955913-bbab-4b00-bc9b-12116f249d7e" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:39:38 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-35b09304-8e9c-44d3-99f8-b99db9aba8ca tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] Lock "78955913-bbab-4b00-bc9b-12116f249d7e" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:39:38 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-3ff81658-28e0-4b04-8d8d-119f7fbe836e tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:39:38 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-3ff81658-28e0-4b04-8d8d-119f7fbe836e tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:39:38 user nova-compute[75045]: INFO nova.compute.manager [None req-35b09304-8e9c-44d3-99f8-b99db9aba8ca tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] [instance: 78955913-bbab-4b00-bc9b-12116f249d7e] Detaching volume 5c6e98f2-e9be-4c1a-b335-61187862dfec
Nov 08 23:39:38 user nova-compute[75045]: INFO nova.virt.block_device [None req-35b09304-8e9c-44d3-99f8-b99db9aba8ca tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] [instance: 78955913-bbab-4b00-bc9b-12116f249d7e] Attempting to driver detach volume 5c6e98f2-e9be-4c1a-b335-61187862dfec from mountpoint /dev/vdc
Nov 08 23:39:38 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-35b09304-8e9c-44d3-99f8-b99db9aba8ca tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] Attempting to detach device vdc from instance 78955913-bbab-4b00-bc9b-12116f249d7e from the persistent domain config. {{(pid=75045) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 08 23:39:38 user nova-compute[75045]: DEBUG nova.virt.libvirt.guest [None req-35b09304-8e9c-44d3-99f8-b99db9aba8ca tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 23:39:38 user nova-compute[75045]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 23:39:38 user nova-compute[75045]:   <source dev="/dev/sdd"/>
Nov 08 23:39:38 user nova-compute[75045]:   <target dev="vdc" bus="virtio"/>
Nov 08 23:39:38 user nova-compute[75045]:   <serial>5c6e98f2-e9be-4c1a-b335-61187862dfec</serial>
Nov 08 23:39:38 user nova-compute[75045]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 08 23:39:38 user nova-compute[75045]: </disk>
Nov 08 23:39:38 user nova-compute[75045]:  {{(pid=75045) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 23:39:38 user nova-compute[75045]: INFO nova.virt.libvirt.driver [None req-35b09304-8e9c-44d3-99f8-b99db9aba8ca tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] Successfully detached device vdc from instance 78955913-bbab-4b00-bc9b-12116f249d7e from the persistent domain config.
Nov 08 23:39:38 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-35b09304-8e9c-44d3-99f8-b99db9aba8ca tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 78955913-bbab-4b00-bc9b-12116f249d7e from the live domain config. {{(pid=75045) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 08 23:39:38 user nova-compute[75045]: DEBUG nova.virt.libvirt.guest [None req-35b09304-8e9c-44d3-99f8-b99db9aba8ca tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 23:39:38 user nova-compute[75045]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 23:39:38 user nova-compute[75045]:   <source dev="/dev/sdd"/>
Nov 08 23:39:38 user nova-compute[75045]:   <target dev="vdc" bus="virtio"/>
Nov 08 23:39:38 user nova-compute[75045]:   <serial>5c6e98f2-e9be-4c1a-b335-61187862dfec</serial>
Nov 08 23:39:38 user nova-compute[75045]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 08 23:39:38 user nova-compute[75045]: </disk>
Nov 08 23:39:38 user nova-compute[75045]:  {{(pid=75045) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 23:39:39 user nova-compute[75045]: DEBUG nova.compute.provider_tree [None req-3ff81658-28e0-4b04-8d8d-119f7fbe836e tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] Inventory has not changed in ProviderTree for provider: 62ba5f85-c74d-4b58-986e-d4197e813fd7 {{(pid=75045) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 23:39:39 user nova-compute[75045]: DEBUG nova.scheduler.client.report [None req-3ff81658-28e0-4b04-8d8d-119f7fbe836e tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] Inventory has not changed for provider 62ba5f85-c74d-4b58-986e-d4197e813fd7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75045) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 23:39:39 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-3ff81658-28e0-4b04-8d8d-119f7fbe836e tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.349s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:39:39 user nova-compute[75045]: INFO nova.scheduler.client.report [None req-3ff81658-28e0-4b04-8d8d-119f7fbe836e tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] Deleted allocations for instance b4c0930f-4309-43bb-959b-4f36ec457bb6
Nov 08 23:39:39 user nova-compute[75045]: DEBUG nova.compute.manager [req-5cc79952-8407-4e6e-8517-e3d8147bc958 req-e78603be-e3de-4eb0-adad-73e648cca377 service nova] [instance: b4c0930f-4309-43bb-959b-4f36ec457bb6] Received event network-vif-plugged-663b2fc9-e6a3-4d9a-81bc-484f78acc4dd {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:39:39 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-5cc79952-8407-4e6e-8517-e3d8147bc958 req-e78603be-e3de-4eb0-adad-73e648cca377 service nova] Acquiring lock "b4c0930f-4309-43bb-959b-4f36ec457bb6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:39:39 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-5cc79952-8407-4e6e-8517-e3d8147bc958 req-e78603be-e3de-4eb0-adad-73e648cca377 service nova] Lock "b4c0930f-4309-43bb-959b-4f36ec457bb6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:39:39 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-5cc79952-8407-4e6e-8517-e3d8147bc958 req-e78603be-e3de-4eb0-adad-73e648cca377 service nova] Lock "b4c0930f-4309-43bb-959b-4f36ec457bb6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:39:39 user nova-compute[75045]: DEBUG nova.compute.manager [req-5cc79952-8407-4e6e-8517-e3d8147bc958 req-e78603be-e3de-4eb0-adad-73e648cca377 service nova] [instance: b4c0930f-4309-43bb-959b-4f36ec457bb6] No waiting events found dispatching network-vif-plugged-663b2fc9-e6a3-4d9a-81bc-484f78acc4dd {{(pid=75045) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 23:39:39 user nova-compute[75045]: WARNING nova.compute.manager [req-5cc79952-8407-4e6e-8517-e3d8147bc958 req-e78603be-e3de-4eb0-adad-73e648cca377 service nova] [instance: b4c0930f-4309-43bb-959b-4f36ec457bb6] Received unexpected event network-vif-plugged-663b2fc9-e6a3-4d9a-81bc-484f78acc4dd for instance with vm_state deleted and task_state None.
Nov 08 23:39:39 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-3ff81658-28e0-4b04-8d8d-119f7fbe836e tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] Lock "b4c0930f-4309-43bb-959b-4f36ec457bb6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.426s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:39:39 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-35b09304-8e9c-44d3-99f8-b99db9aba8ca tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 78955913-bbab-4b00-bc9b-12116f249d7e {{(pid=75045) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 08 23:39:41 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:39:42 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:39:46 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:39:47 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:39:49 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-da6e5abb-552e-49ad-821d-db3ab2377b1b tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] Acquiring lock "0b84f2b1-01a3-4789-bcef-8b7c4334132b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:39:49 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-da6e5abb-552e-49ad-821d-db3ab2377b1b tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] Lock "0b84f2b1-01a3-4789-bcef-8b7c4334132b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:39:49 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-da6e5abb-552e-49ad-821d-db3ab2377b1b tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] Acquiring lock "0b84f2b1-01a3-4789-bcef-8b7c4334132b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:39:49 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-da6e5abb-552e-49ad-821d-db3ab2377b1b tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] Lock "0b84f2b1-01a3-4789-bcef-8b7c4334132b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:39:49 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-da6e5abb-552e-49ad-821d-db3ab2377b1b tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] Lock "0b84f2b1-01a3-4789-bcef-8b7c4334132b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:39:49 user nova-compute[75045]: INFO nova.compute.manager [None req-da6e5abb-552e-49ad-821d-db3ab2377b1b tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] [instance: 0b84f2b1-01a3-4789-bcef-8b7c4334132b] Terminating instance
Nov 08 23:39:49 user nova-compute[75045]: DEBUG nova.compute.manager [None req-da6e5abb-552e-49ad-821d-db3ab2377b1b tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] [instance: 0b84f2b1-01a3-4789-bcef-8b7c4334132b] Start destroying the instance on the hypervisor. {{(pid=75045) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 23:39:49 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:39:49 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:39:49 user nova-compute[75045]: DEBUG nova.compute.manager [req-4e179580-d918-48f2-abf2-4d8efbbe99e9 req-8d69fd9b-b1a9-4daa-96d2-8c5c1f1aa99e service nova] [instance: 7ee587a0-e271-4262-a252-2ccb6c2faecb] Received event network-changed-0b911e0a-0c01-4296-b269-f52ee68772f9 {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:39:49 user nova-compute[75045]: DEBUG nova.compute.manager [req-4e179580-d918-48f2-abf2-4d8efbbe99e9 req-8d69fd9b-b1a9-4daa-96d2-8c5c1f1aa99e service nova] [instance: 7ee587a0-e271-4262-a252-2ccb6c2faecb] Refreshing instance network info cache due to event network-changed-0b911e0a-0c01-4296-b269-f52ee68772f9. {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 23:39:49 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-4e179580-d918-48f2-abf2-4d8efbbe99e9 req-8d69fd9b-b1a9-4daa-96d2-8c5c1f1aa99e service nova] Acquiring lock "refresh_cache-7ee587a0-e271-4262-a252-2ccb6c2faecb" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 23:39:49 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-4e179580-d918-48f2-abf2-4d8efbbe99e9 req-8d69fd9b-b1a9-4daa-96d2-8c5c1f1aa99e service nova] Acquired lock "refresh_cache-7ee587a0-e271-4262-a252-2ccb6c2faecb" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 23:39:49 user nova-compute[75045]: DEBUG nova.network.neutron [req-4e179580-d918-48f2-abf2-4d8efbbe99e9 req-8d69fd9b-b1a9-4daa-96d2-8c5c1f1aa99e service nova] [instance: 7ee587a0-e271-4262-a252-2ccb6c2faecb] Refreshing network info cache for port 0b911e0a-0c01-4296-b269-f52ee68772f9 {{(pid=75045) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 23:39:49 user nova-compute[75045]: DEBUG nova.compute.manager [req-99c222a1-242f-4b1a-9424-92e3eb401607 req-c86f66bc-7cba-4de5-9fa6-7b61dc78dc01 service nova] [instance: 0b84f2b1-01a3-4789-bcef-8b7c4334132b] Received event network-vif-unplugged-c0a20899-be58-4d47-95e2-e129f636162c {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:39:49 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-99c222a1-242f-4b1a-9424-92e3eb401607 req-c86f66bc-7cba-4de5-9fa6-7b61dc78dc01 service nova] Acquiring lock "0b84f2b1-01a3-4789-bcef-8b7c4334132b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:39:49 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-99c222a1-242f-4b1a-9424-92e3eb401607 req-c86f66bc-7cba-4de5-9fa6-7b61dc78dc01 service nova] Lock "0b84f2b1-01a3-4789-bcef-8b7c4334132b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:39:49 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-99c222a1-242f-4b1a-9424-92e3eb401607 req-c86f66bc-7cba-4de5-9fa6-7b61dc78dc01 service nova] Lock "0b84f2b1-01a3-4789-bcef-8b7c4334132b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.007s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:39:49 user nova-compute[75045]: DEBUG nova.compute.manager [req-99c222a1-242f-4b1a-9424-92e3eb401607 req-c86f66bc-7cba-4de5-9fa6-7b61dc78dc01 service nova] [instance: 0b84f2b1-01a3-4789-bcef-8b7c4334132b] No waiting events found dispatching network-vif-unplugged-c0a20899-be58-4d47-95e2-e129f636162c {{(pid=75045) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 23:39:49 user nova-compute[75045]: DEBUG nova.compute.manager [req-99c222a1-242f-4b1a-9424-92e3eb401607 req-c86f66bc-7cba-4de5-9fa6-7b61dc78dc01 service nova] [instance: 0b84f2b1-01a3-4789-bcef-8b7c4334132b] Received event network-vif-unplugged-c0a20899-be58-4d47-95e2-e129f636162c for instance with task_state deleting. {{(pid=75045) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 23:39:49 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:39:49 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:39:50 user nova-compute[75045]: DEBUG nova.network.neutron [req-4e179580-d918-48f2-abf2-4d8efbbe99e9 req-8d69fd9b-b1a9-4daa-96d2-8c5c1f1aa99e service nova] [instance: 7ee587a0-e271-4262-a252-2ccb6c2faecb] Updated VIF entry in instance network info cache for port 0b911e0a-0c01-4296-b269-f52ee68772f9. {{(pid=75045) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 23:39:50 user nova-compute[75045]: DEBUG nova.network.neutron [req-4e179580-d918-48f2-abf2-4d8efbbe99e9 req-8d69fd9b-b1a9-4daa-96d2-8c5c1f1aa99e service nova] [instance: 7ee587a0-e271-4262-a252-2ccb6c2faecb] Updating instance_info_cache with network_info: [{"id": "0b911e0a-0c01-4296-b269-f52ee68772f9", "address": "fa:16:3e:03:88:6d", "network": {"id": "3fc25e49-b987-4fe7-9c28-6a18b689a411", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1301325538-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.217", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4760b2fb18b44e26bfbca6bf16aea581", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b911e0a-0c", "ovs_interfaceid": "0b911e0a-0c01-4296-b269-f52ee68772f9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75045) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 23:39:50 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-4e179580-d918-48f2-abf2-4d8efbbe99e9 req-8d69fd9b-b1a9-4daa-96d2-8c5c1f1aa99e service nova] Releasing lock "refresh_cache-7ee587a0-e271-4262-a252-2ccb6c2faecb" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 23:39:50 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:39:50 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:39:50 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:39:50 user nova-compute[75045]: INFO nova.virt.libvirt.driver [-] [instance: 0b84f2b1-01a3-4789-bcef-8b7c4334132b] Instance destroyed successfully.
Nov 08 23:39:50 user nova-compute[75045]: DEBUG nova.objects.instance [None req-da6e5abb-552e-49ad-821d-db3ab2377b1b tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] Lazy-loading 'resources' on Instance uuid 0b84f2b1-01a3-4789-bcef-8b7c4334132b {{(pid=75045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 23:39:50 user nova-compute[75045]: DEBUG nova.virt.libvirt.vif [None req-da6e5abb-552e-49ad-821d-db3ab2377b1b tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T23:22:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-2049313631',display_name='tempest-ServerRescueNegativeTestJSON-server-2049313631',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-2049313631',id=20,image_ref='a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-08T23:24:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bbb640407ef94f568aea892f1834d6d1',ramdisk_id='',reservation_id='r-boxb4qwm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-187452128',owner_user_name='tempest-ServerRescueNegativeTestJSON-187452128-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T23:24:31Z,user_data=None,user_id='f16e465ffb49488db3de445a473fd77a',uuid=0b84f2b1-01a3-4789-bcef-8b7c4334132b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='rescued') vif={"id": "c0a20899-be58-4d47-95e2-e129f636162c", "address": "fa:16:3e:69:a7:d0", "network": {"id": "08d1669a-f667-4c79-8e49-0ad183f57046", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1863648032-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bbb640407ef94f568aea892f1834d6d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0a20899-be", "ovs_interfaceid": "c0a20899-be58-4d47-95e2-e129f636162c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75045) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 23:39:50 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-da6e5abb-552e-49ad-821d-db3ab2377b1b tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] Converting VIF {"id": "c0a20899-be58-4d47-95e2-e129f636162c", "address": "fa:16:3e:69:a7:d0", "network": {"id": "08d1669a-f667-4c79-8e49-0ad183f57046", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1863648032-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bbb640407ef94f568aea892f1834d6d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0a20899-be", "ovs_interfaceid": "c0a20899-be58-4d47-95e2-e129f636162c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 23:39:50 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-da6e5abb-552e-49ad-821d-db3ab2377b1b tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:69:a7:d0,bridge_name='br-int',has_traffic_filtering=True,id=c0a20899-be58-4d47-95e2-e129f636162c,network=Network(08d1669a-f667-4c79-8e49-0ad183f57046),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc0a20899-be') {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 23:39:50 user nova-compute[75045]: DEBUG os_vif [None req-da6e5abb-552e-49ad-821d-db3ab2377b1b tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:69:a7:d0,bridge_name='br-int',has_traffic_filtering=True,id=c0a20899-be58-4d47-95e2-e129f636162c,network=Network(08d1669a-f667-4c79-8e49-0ad183f57046),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc0a20899-be') {{(pid=75045) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 23:39:50 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:39:50 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc0a20899-be, bridge=br-int, if_exists=True) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:39:50 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:39:50 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 23:39:50 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:39:50 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:39:50 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ac4d8242-652e-4a40-a439-eec265e16d98) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:39:50 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:39:50 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 23:39:50 user nova-compute[75045]: INFO os_vif [None req-da6e5abb-552e-49ad-821d-db3ab2377b1b tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:69:a7:d0,bridge_name='br-int',has_traffic_filtering=True,id=c0a20899-be58-4d47-95e2-e129f636162c,network=Network(08d1669a-f667-4c79-8e49-0ad183f57046),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc0a20899-be')
Nov 08 23:39:50 user nova-compute[75045]: INFO nova.virt.libvirt.driver [None req-da6e5abb-552e-49ad-821d-db3ab2377b1b tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] [instance: 0b84f2b1-01a3-4789-bcef-8b7c4334132b] Deleting instance files /opt/stack/data/nova/instances/0b84f2b1-01a3-4789-bcef-8b7c4334132b_del
Nov 08 23:39:50 user nova-compute[75045]: INFO nova.virt.libvirt.driver [None req-da6e5abb-552e-49ad-821d-db3ab2377b1b tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] [instance: 0b84f2b1-01a3-4789-bcef-8b7c4334132b] Deletion of /opt/stack/data/nova/instances/0b84f2b1-01a3-4789-bcef-8b7c4334132b_del complete
Nov 08 23:39:50 user nova-compute[75045]: INFO nova.compute.manager [None req-da6e5abb-552e-49ad-821d-db3ab2377b1b tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] [instance: 0b84f2b1-01a3-4789-bcef-8b7c4334132b] Took 1.09 seconds to destroy the instance on the hypervisor.
Nov 08 23:39:50 user nova-compute[75045]: DEBUG oslo.service.loopingcall [None req-da6e5abb-552e-49ad-821d-db3ab2377b1b tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75045) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 23:39:50 user nova-compute[75045]: DEBUG nova.compute.manager [-] [instance: 0b84f2b1-01a3-4789-bcef-8b7c4334132b] Deallocating network for instance {{(pid=75045) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 23:39:50 user nova-compute[75045]: DEBUG nova.network.neutron [-] [instance: 0b84f2b1-01a3-4789-bcef-8b7c4334132b] deallocate_for_instance() {{(pid=75045) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 23:39:50 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:39:50 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:39:50 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:39:50 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:39:50 user nova-compute[75045]: DEBUG nova.compute.manager [None req-e98be96f-a20a-4305-86c5-ab2af6ad77aa tempest-ServerStableDeviceRescueTest-1847572360 tempest-ServerStableDeviceRescueTest-1847572360-project-member] [instance: 7ee587a0-e271-4262-a252-2ccb6c2faecb] Checking state {{(pid=75045) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 23:39:51 user nova-compute[75045]: INFO nova.compute.manager [None req-e98be96f-a20a-4305-86c5-ab2af6ad77aa tempest-ServerStableDeviceRescueTest-1847572360 tempest-ServerStableDeviceRescueTest-1847572360-project-member] [instance: 7ee587a0-e271-4262-a252-2ccb6c2faecb] instance snapshotting
Nov 08 23:39:51 user nova-compute[75045]: DEBUG nova.network.neutron [-] [instance: 0b84f2b1-01a3-4789-bcef-8b7c4334132b] Updating instance_info_cache with network_info: [] {{(pid=75045) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 23:39:51 user nova-compute[75045]: INFO nova.compute.manager [-] [instance: 0b84f2b1-01a3-4789-bcef-8b7c4334132b] Took 0.57 seconds to deallocate network for instance.
Nov 08 23:39:51 user nova-compute[75045]: INFO nova.virt.libvirt.driver [None req-e98be96f-a20a-4305-86c5-ab2af6ad77aa tempest-ServerStableDeviceRescueTest-1847572360 tempest-ServerStableDeviceRescueTest-1847572360-project-member] [instance: 7ee587a0-e271-4262-a252-2ccb6c2faecb] Beginning live snapshot process
Nov 08 23:39:51 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-da6e5abb-552e-49ad-821d-db3ab2377b1b tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:39:51 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-da6e5abb-552e-49ad-821d-db3ab2377b1b tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:39:51 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-e98be96f-a20a-4305-86c5-ab2af6ad77aa tempest-ServerStableDeviceRescueTest-1847572360 tempest-ServerStableDeviceRescueTest-1847572360-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ee587a0-e271-4262-a252-2ccb6c2faecb/disk --force-share --output=json -f qcow2 {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:39:51 user nova-compute[75045]: DEBUG nova.compute.provider_tree [None req-da6e5abb-552e-49ad-821d-db3ab2377b1b tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] Inventory has not changed in ProviderTree for provider: 62ba5f85-c74d-4b58-986e-d4197e813fd7 {{(pid=75045) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 23:39:51 user nova-compute[75045]: DEBUG nova.scheduler.client.report [None req-da6e5abb-552e-49ad-821d-db3ab2377b1b tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] Inventory has not changed for provider 62ba5f85-c74d-4b58-986e-d4197e813fd7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75045) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 23:39:51 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-da6e5abb-552e-49ad-821d-db3ab2377b1b tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.335s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:39:51 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-e98be96f-a20a-4305-86c5-ab2af6ad77aa tempest-ServerStableDeviceRescueTest-1847572360 tempest-ServerStableDeviceRescueTest-1847572360-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ee587a0-e271-4262-a252-2ccb6c2faecb/disk --force-share --output=json -f qcow2" returned: 0 in 0.197s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:39:51 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-e98be96f-a20a-4305-86c5-ab2af6ad77aa tempest-ServerStableDeviceRescueTest-1847572360 tempest-ServerStableDeviceRescueTest-1847572360-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ee587a0-e271-4262-a252-2ccb6c2faecb/disk --force-share --output=json -f qcow2 {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:39:51 user nova-compute[75045]: INFO nova.scheduler.client.report [None req-da6e5abb-552e-49ad-821d-db3ab2377b1b tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] Deleted allocations for instance 0b84f2b1-01a3-4789-bcef-8b7c4334132b
Nov 08 23:39:51 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-da6e5abb-552e-49ad-821d-db3ab2377b1b tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] Lock "0b84f2b1-01a3-4789-bcef-8b7c4334132b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.232s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:39:51 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:39:51 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-e98be96f-a20a-4305-86c5-ab2af6ad77aa tempest-ServerStableDeviceRescueTest-1847572360 tempest-ServerStableDeviceRescueTest-1847572360-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ee587a0-e271-4262-a252-2ccb6c2faecb/disk --force-share --output=json -f qcow2" returned: 0 in 0.190s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:39:51 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-e98be96f-a20a-4305-86c5-ab2af6ad77aa tempest-ServerStableDeviceRescueTest-1847572360 tempest-ServerStableDeviceRescueTest-1847572360-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b59f52a99fff51c56dd1edfb83892fb8f647f2f3 --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:39:51 user nova-compute[75045]: DEBUG nova.compute.manager [req-e55a208d-3fe0-46a9-8c12-f0b8e8b01675 req-4dbd48f6-01fb-4a22-90b3-2b7349cce7dd service nova] [instance: 0b84f2b1-01a3-4789-bcef-8b7c4334132b] Received event network-vif-deleted-c0a20899-be58-4d47-95e2-e129f636162c {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:39:51 user nova-compute[75045]: DEBUG nova.compute.manager [req-755bfccd-d30e-4550-941d-6351f63ea85b req-15212ccd-9d9c-4c72-97f1-2c1bc77c310f service nova] [instance: 0b84f2b1-01a3-4789-bcef-8b7c4334132b] Received event network-vif-plugged-c0a20899-be58-4d47-95e2-e129f636162c {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:39:51 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-755bfccd-d30e-4550-941d-6351f63ea85b req-15212ccd-9d9c-4c72-97f1-2c1bc77c310f service nova] Acquiring lock "0b84f2b1-01a3-4789-bcef-8b7c4334132b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:39:51 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-755bfccd-d30e-4550-941d-6351f63ea85b req-15212ccd-9d9c-4c72-97f1-2c1bc77c310f service nova] Lock "0b84f2b1-01a3-4789-bcef-8b7c4334132b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:39:51 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-755bfccd-d30e-4550-941d-6351f63ea85b req-15212ccd-9d9c-4c72-97f1-2c1bc77c310f service nova] Lock "0b84f2b1-01a3-4789-bcef-8b7c4334132b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:39:51 user nova-compute[75045]: DEBUG nova.compute.manager [req-755bfccd-d30e-4550-941d-6351f63ea85b req-15212ccd-9d9c-4c72-97f1-2c1bc77c310f service nova] [instance: 0b84f2b1-01a3-4789-bcef-8b7c4334132b] No waiting events found dispatching network-vif-plugged-c0a20899-be58-4d47-95e2-e129f636162c {{(pid=75045) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 23:39:51 user nova-compute[75045]: WARNING nova.compute.manager [req-755bfccd-d30e-4550-941d-6351f63ea85b req-15212ccd-9d9c-4c72-97f1-2c1bc77c310f service nova] [instance: 0b84f2b1-01a3-4789-bcef-8b7c4334132b] Received unexpected event network-vif-plugged-c0a20899-be58-4d47-95e2-e129f636162c for instance with vm_state deleted and task_state None.
Nov 08 23:39:51 user nova-compute[75045]: DEBUG nova.compute.manager [req-755bfccd-d30e-4550-941d-6351f63ea85b req-15212ccd-9d9c-4c72-97f1-2c1bc77c310f service nova] [instance: 0b84f2b1-01a3-4789-bcef-8b7c4334132b] Received event network-vif-plugged-c0a20899-be58-4d47-95e2-e129f636162c {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:39:51 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-755bfccd-d30e-4550-941d-6351f63ea85b req-15212ccd-9d9c-4c72-97f1-2c1bc77c310f service nova] Acquiring lock "0b84f2b1-01a3-4789-bcef-8b7c4334132b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:39:51 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-755bfccd-d30e-4550-941d-6351f63ea85b req-15212ccd-9d9c-4c72-97f1-2c1bc77c310f service nova] Lock "0b84f2b1-01a3-4789-bcef-8b7c4334132b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:39:51 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-755bfccd-d30e-4550-941d-6351f63ea85b req-15212ccd-9d9c-4c72-97f1-2c1bc77c310f service nova] Lock "0b84f2b1-01a3-4789-bcef-8b7c4334132b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:39:51 user nova-compute[75045]: DEBUG nova.compute.manager [req-755bfccd-d30e-4550-941d-6351f63ea85b req-15212ccd-9d9c-4c72-97f1-2c1bc77c310f service nova] [instance: 0b84f2b1-01a3-4789-bcef-8b7c4334132b] No waiting events found dispatching network-vif-plugged-c0a20899-be58-4d47-95e2-e129f636162c {{(pid=75045) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 23:39:51 user nova-compute[75045]: WARNING nova.compute.manager [req-755bfccd-d30e-4550-941d-6351f63ea85b req-15212ccd-9d9c-4c72-97f1-2c1bc77c310f service nova] [instance: 0b84f2b1-01a3-4789-bcef-8b7c4334132b] Received unexpected event network-vif-plugged-c0a20899-be58-4d47-95e2-e129f636162c for instance with vm_state deleted and task_state None.
Nov 08 23:39:51 user nova-compute[75045]: DEBUG nova.compute.manager [req-755bfccd-d30e-4550-941d-6351f63ea85b req-15212ccd-9d9c-4c72-97f1-2c1bc77c310f service nova] [instance: 0b84f2b1-01a3-4789-bcef-8b7c4334132b] Received event network-vif-plugged-c0a20899-be58-4d47-95e2-e129f636162c {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:39:51 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-755bfccd-d30e-4550-941d-6351f63ea85b req-15212ccd-9d9c-4c72-97f1-2c1bc77c310f service nova] Acquiring lock "0b84f2b1-01a3-4789-bcef-8b7c4334132b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:39:51 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-755bfccd-d30e-4550-941d-6351f63ea85b req-15212ccd-9d9c-4c72-97f1-2c1bc77c310f service nova] Lock "0b84f2b1-01a3-4789-bcef-8b7c4334132b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:39:51 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-755bfccd-d30e-4550-941d-6351f63ea85b req-15212ccd-9d9c-4c72-97f1-2c1bc77c310f service nova] Lock "0b84f2b1-01a3-4789-bcef-8b7c4334132b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:39:51 user nova-compute[75045]: DEBUG nova.compute.manager [req-755bfccd-d30e-4550-941d-6351f63ea85b req-15212ccd-9d9c-4c72-97f1-2c1bc77c310f service nova] [instance: 0b84f2b1-01a3-4789-bcef-8b7c4334132b] No waiting events found dispatching network-vif-plugged-c0a20899-be58-4d47-95e2-e129f636162c {{(pid=75045) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 23:39:51 user nova-compute[75045]: WARNING nova.compute.manager [req-755bfccd-d30e-4550-941d-6351f63ea85b req-15212ccd-9d9c-4c72-97f1-2c1bc77c310f service nova] [instance: 0b84f2b1-01a3-4789-bcef-8b7c4334132b] Received unexpected event network-vif-plugged-c0a20899-be58-4d47-95e2-e129f636162c for instance with vm_state deleted and task_state None.
Nov 08 23:39:51 user nova-compute[75045]: DEBUG nova.compute.manager [req-755bfccd-d30e-4550-941d-6351f63ea85b req-15212ccd-9d9c-4c72-97f1-2c1bc77c310f service nova] [instance: 0b84f2b1-01a3-4789-bcef-8b7c4334132b] Received event network-vif-unplugged-c0a20899-be58-4d47-95e2-e129f636162c {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:39:51 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-755bfccd-d30e-4550-941d-6351f63ea85b req-15212ccd-9d9c-4c72-97f1-2c1bc77c310f service nova] Acquiring lock "0b84f2b1-01a3-4789-bcef-8b7c4334132b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:39:51 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-755bfccd-d30e-4550-941d-6351f63ea85b req-15212ccd-9d9c-4c72-97f1-2c1bc77c310f service nova] Lock "0b84f2b1-01a3-4789-bcef-8b7c4334132b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:39:51 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-755bfccd-d30e-4550-941d-6351f63ea85b req-15212ccd-9d9c-4c72-97f1-2c1bc77c310f service nova] Lock "0b84f2b1-01a3-4789-bcef-8b7c4334132b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:39:51 user nova-compute[75045]: DEBUG nova.compute.manager [req-755bfccd-d30e-4550-941d-6351f63ea85b req-15212ccd-9d9c-4c72-97f1-2c1bc77c310f service nova] [instance: 0b84f2b1-01a3-4789-bcef-8b7c4334132b] No waiting events found dispatching network-vif-unplugged-c0a20899-be58-4d47-95e2-e129f636162c {{(pid=75045) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 23:39:51 user nova-compute[75045]: WARNING nova.compute.manager [req-755bfccd-d30e-4550-941d-6351f63ea85b req-15212ccd-9d9c-4c72-97f1-2c1bc77c310f service nova] [instance: 0b84f2b1-01a3-4789-bcef-8b7c4334132b] Received unexpected event network-vif-unplugged-c0a20899-be58-4d47-95e2-e129f636162c for instance with vm_state deleted and task_state None.
Nov 08 23:39:51 user nova-compute[75045]: DEBUG nova.compute.manager [req-755bfccd-d30e-4550-941d-6351f63ea85b req-15212ccd-9d9c-4c72-97f1-2c1bc77c310f service nova] [instance: 0b84f2b1-01a3-4789-bcef-8b7c4334132b] Received event network-vif-plugged-c0a20899-be58-4d47-95e2-e129f636162c {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:39:51 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-755bfccd-d30e-4550-941d-6351f63ea85b req-15212ccd-9d9c-4c72-97f1-2c1bc77c310f service nova] Acquiring lock "0b84f2b1-01a3-4789-bcef-8b7c4334132b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:39:51 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-755bfccd-d30e-4550-941d-6351f63ea85b req-15212ccd-9d9c-4c72-97f1-2c1bc77c310f service nova] Lock "0b84f2b1-01a3-4789-bcef-8b7c4334132b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:39:51 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-755bfccd-d30e-4550-941d-6351f63ea85b req-15212ccd-9d9c-4c72-97f1-2c1bc77c310f service nova] Lock "0b84f2b1-01a3-4789-bcef-8b7c4334132b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:39:51 user nova-compute[75045]: DEBUG nova.compute.manager [req-755bfccd-d30e-4550-941d-6351f63ea85b req-15212ccd-9d9c-4c72-97f1-2c1bc77c310f service nova] [instance: 0b84f2b1-01a3-4789-bcef-8b7c4334132b] No waiting events found dispatching network-vif-plugged-c0a20899-be58-4d47-95e2-e129f636162c {{(pid=75045) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 23:39:51 user nova-compute[75045]: WARNING nova.compute.manager [req-755bfccd-d30e-4550-941d-6351f63ea85b req-15212ccd-9d9c-4c72-97f1-2c1bc77c310f service nova] [instance: 0b84f2b1-01a3-4789-bcef-8b7c4334132b] Received unexpected event network-vif-plugged-c0a20899-be58-4d47-95e2-e129f636162c for instance with vm_state deleted and task_state None.
Nov 08 23:39:51 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-e98be96f-a20a-4305-86c5-ab2af6ad77aa tempest-ServerStableDeviceRescueTest-1847572360 tempest-ServerStableDeviceRescueTest-1847572360-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b59f52a99fff51c56dd1edfb83892fb8f647f2f3 --force-share --output=json" returned: 0 in 0.224s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:39:51 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-e98be96f-a20a-4305-86c5-ab2af6ad77aa tempest-ServerStableDeviceRescueTest-1847572360 tempest-ServerStableDeviceRescueTest-1847572360-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b59f52a99fff51c56dd1edfb83892fb8f647f2f3,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpa1tlsjk7/bde0dd3e5f9a4efea81843dda749e1dd.delta 1073741824 {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:39:52 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-e98be96f-a20a-4305-86c5-ab2af6ad77aa tempest-ServerStableDeviceRescueTest-1847572360 tempest-ServerStableDeviceRescueTest-1847572360-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b59f52a99fff51c56dd1edfb83892fb8f647f2f3,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpa1tlsjk7/bde0dd3e5f9a4efea81843dda749e1dd.delta 1073741824" returned: 0 in 0.072s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:39:52 user nova-compute[75045]: INFO nova.virt.libvirt.driver [None req-e98be96f-a20a-4305-86c5-ab2af6ad77aa tempest-ServerStableDeviceRescueTest-1847572360 tempest-ServerStableDeviceRescueTest-1847572360-project-member] [instance: 7ee587a0-e271-4262-a252-2ccb6c2faecb] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 08 23:39:52 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:39:52 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:39:52 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:39:52 user nova-compute[75045]: DEBUG nova.compute.manager [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Starting heal instance info cache {{(pid=75045) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 23:39:52 user nova-compute[75045]: DEBUG nova.compute.manager [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Rebuilding the list of instances to heal {{(pid=75045) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 08 23:39:52 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Acquiring lock "refresh_cache-b5fc7f02-2143-4bcf-92ac-078d5ec10747" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 23:39:52 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Acquired lock "refresh_cache-b5fc7f02-2143-4bcf-92ac-078d5ec10747" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 23:39:52 user nova-compute[75045]: DEBUG nova.network.neutron [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] [instance: b5fc7f02-2143-4bcf-92ac-078d5ec10747] Forcefully refreshing network info cache for instance {{(pid=75045) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 23:39:52 user nova-compute[75045]: DEBUG nova.objects.instance [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Lazy-loading 'info_cache' on Instance uuid b5fc7f02-2143-4bcf-92ac-078d5ec10747 {{(pid=75045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 23:39:52 user nova-compute[75045]: DEBUG nova.virt.libvirt.guest [None req-e98be96f-a20a-4305-86c5-ab2af6ad77aa tempest-ServerStableDeviceRescueTest-1847572360 tempest-ServerStableDeviceRescueTest-1847572360-project-member] COPY block job progress, current cursor: 0 final cursor: 75563008 {{(pid=75045) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 08 23:39:52 user nova-compute[75045]: DEBUG nova.network.neutron [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] [instance: b5fc7f02-2143-4bcf-92ac-078d5ec10747] Updating instance_info_cache with network_info: [{"id": "cde7cd95-3b8b-4980-8abc-be5c221a40ff", "address": "fa:16:3e:2d:09:a7", "network": {"id": "08d1669a-f667-4c79-8e49-0ad183f57046", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1863648032-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bbb640407ef94f568aea892f1834d6d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcde7cd95-3b", "ovs_interfaceid": "cde7cd95-3b8b-4980-8abc-be5c221a40ff", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75045) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 23:39:52 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Releasing lock "refresh_cache-b5fc7f02-2143-4bcf-92ac-078d5ec10747" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 23:39:52 user nova-compute[75045]: DEBUG nova.compute.manager [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] [instance: b5fc7f02-2143-4bcf-92ac-078d5ec10747] Updated the network info_cache for instance {{(pid=75045) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 23:39:52 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:39:52 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:39:52 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:39:52 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:39:52 user nova-compute[75045]: DEBUG nova.compute.manager [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75045) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 23:39:52 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:39:53 user nova-compute[75045]: DEBUG nova.virt.libvirt.guest [None req-e98be96f-a20a-4305-86c5-ab2af6ad77aa tempest-ServerStableDeviceRescueTest-1847572360 tempest-ServerStableDeviceRescueTest-1847572360-project-member] COPY block job progress, current cursor: 75563008 final cursor: 75563008 {{(pid=75045) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 08 23:39:53 user nova-compute[75045]: INFO nova.virt.libvirt.driver [None req-e98be96f-a20a-4305-86c5-ab2af6ad77aa tempest-ServerStableDeviceRescueTest-1847572360 tempest-ServerStableDeviceRescueTest-1847572360-project-member] [instance: 7ee587a0-e271-4262-a252-2ccb6c2faecb] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 08 23:39:53 user nova-compute[75045]: DEBUG nova.privsep.utils [None req-e98be96f-a20a-4305-86c5-ab2af6ad77aa tempest-ServerStableDeviceRescueTest-1847572360 tempest-ServerStableDeviceRescueTest-1847572360-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75045) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 08 23:39:53 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-e98be96f-a20a-4305-86c5-ab2af6ad77aa tempest-ServerStableDeviceRescueTest-1847572360 tempest-ServerStableDeviceRescueTest-1847572360-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpa1tlsjk7/bde0dd3e5f9a4efea81843dda749e1dd.delta /opt/stack/data/nova/instances/snapshots/tmpa1tlsjk7/bde0dd3e5f9a4efea81843dda749e1dd {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:39:53 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-e98be96f-a20a-4305-86c5-ab2af6ad77aa tempest-ServerStableDeviceRescueTest-1847572360 tempest-ServerStableDeviceRescueTest-1847572360-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpa1tlsjk7/bde0dd3e5f9a4efea81843dda749e1dd.delta /opt/stack/data/nova/instances/snapshots/tmpa1tlsjk7/bde0dd3e5f9a4efea81843dda749e1dd" returned: 0 in 0.518s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:39:53 user nova-compute[75045]: INFO nova.virt.libvirt.driver [None req-e98be96f-a20a-4305-86c5-ab2af6ad77aa tempest-ServerStableDeviceRescueTest-1847572360 tempest-ServerStableDeviceRescueTest-1847572360-project-member] [instance: 7ee587a0-e271-4262-a252-2ccb6c2faecb] Snapshot extracted, beginning image upload
Nov 08 23:39:53 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:39:55 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:39:55 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager.update_available_resource {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:39:56 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:39:56 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:39:56 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:39:56 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Auditing locally available compute resources for user (node: user) {{(pid=75045) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 23:39:56 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/244c4cc9-2837-40c9-b4ad-37dc435c9749/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:39:56 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-909fa573-22b0-43cd-810c-a6b0c43492aa tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Acquiring lock "899ae4a7-6932-4f43-a87f-a88cb2ce3cb9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:39:56 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-909fa573-22b0-43cd-810c-a6b0c43492aa tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Lock "899ae4a7-6932-4f43-a87f-a88cb2ce3cb9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.003s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:39:56 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/244c4cc9-2837-40c9-b4ad-37dc435c9749/disk --force-share --output=json" returned: 0 in 0.291s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:39:56 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/244c4cc9-2837-40c9-b4ad-37dc435c9749/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:39:56 user nova-compute[75045]: DEBUG nova.compute.manager [None req-909fa573-22b0-43cd-810c-a6b0c43492aa tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] [instance: 899ae4a7-6932-4f43-a87f-a88cb2ce3cb9] Starting instance... {{(pid=75045) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 23:39:56 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-909fa573-22b0-43cd-810c-a6b0c43492aa tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:39:56 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-909fa573-22b0-43cd-810c-a6b0c43492aa tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:39:56 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-909fa573-22b0-43cd-810c-a6b0c43492aa tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75045) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 23:39:56 user nova-compute[75045]: INFO nova.compute.claims [None req-909fa573-22b0-43cd-810c-a6b0c43492aa tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] [instance: 899ae4a7-6932-4f43-a87f-a88cb2ce3cb9] Claim successful on node user
Nov 08 23:39:56 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:39:56 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/244c4cc9-2837-40c9-b4ad-37dc435c9749/disk --force-share --output=json" returned: 0 in 0.236s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:39:56 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3df54db-78d7-436b-b86a-df3257b170e6/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:39:56 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3df54db-78d7-436b-b86a-df3257b170e6/disk --force-share --output=json" returned: 0 in 0.246s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:39:56 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3df54db-78d7-436b-b86a-df3257b170e6/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:39:57 user nova-compute[75045]: INFO nova.virt.libvirt.driver [None req-e98be96f-a20a-4305-86c5-ab2af6ad77aa tempest-ServerStableDeviceRescueTest-1847572360 tempest-ServerStableDeviceRescueTest-1847572360-project-member] [instance: 7ee587a0-e271-4262-a252-2ccb6c2faecb] Snapshot image upload complete
Nov 08 23:39:57 user nova-compute[75045]: INFO nova.compute.manager [None req-e98be96f-a20a-4305-86c5-ab2af6ad77aa tempest-ServerStableDeviceRescueTest-1847572360 tempest-ServerStableDeviceRescueTest-1847572360-project-member] [instance: 7ee587a0-e271-4262-a252-2ccb6c2faecb] Took 6.07 seconds to snapshot the instance on the hypervisor.
Nov 08 23:39:57 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3df54db-78d7-436b-b86a-df3257b170e6/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:39:57 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ee587a0-e271-4262-a252-2ccb6c2faecb/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:39:57 user nova-compute[75045]: DEBUG nova.compute.provider_tree [None req-909fa573-22b0-43cd-810c-a6b0c43492aa tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Inventory has not changed in ProviderTree for provider: 62ba5f85-c74d-4b58-986e-d4197e813fd7 {{(pid=75045) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 23:39:57 user nova-compute[75045]: DEBUG nova.scheduler.client.report [None req-909fa573-22b0-43cd-810c-a6b0c43492aa tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Inventory has not changed for provider 62ba5f85-c74d-4b58-986e-d4197e813fd7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75045) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 23:39:57 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-909fa573-22b0-43cd-810c-a6b0c43492aa tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.689s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:39:57 user nova-compute[75045]: DEBUG nova.compute.manager [None req-909fa573-22b0-43cd-810c-a6b0c43492aa tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] [instance: 899ae4a7-6932-4f43-a87f-a88cb2ce3cb9] Start building networks asynchronously for instance. {{(pid=75045) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 23:39:57 user nova-compute[75045]: DEBUG nova.compute.manager [None req-909fa573-22b0-43cd-810c-a6b0c43492aa tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] [instance: 899ae4a7-6932-4f43-a87f-a88cb2ce3cb9] Allocating IP information in the background. {{(pid=75045) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 23:39:57 user nova-compute[75045]: DEBUG nova.network.neutron [None req-909fa573-22b0-43cd-810c-a6b0c43492aa tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] [instance: 899ae4a7-6932-4f43-a87f-a88cb2ce3cb9] allocate_for_instance() {{(pid=75045) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 23:39:57 user nova-compute[75045]: INFO nova.virt.libvirt.driver [None req-909fa573-22b0-43cd-810c-a6b0c43492aa tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] [instance: 899ae4a7-6932-4f43-a87f-a88cb2ce3cb9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 23:39:57 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ee587a0-e271-4262-a252-2ccb6c2faecb/disk --force-share --output=json" returned: 0 in 0.240s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:39:57 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ee587a0-e271-4262-a252-2ccb6c2faecb/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:39:57 user nova-compute[75045]: DEBUG nova.compute.manager [None req-909fa573-22b0-43cd-810c-a6b0c43492aa tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] [instance: 899ae4a7-6932-4f43-a87f-a88cb2ce3cb9] Start building block device mappings for instance. {{(pid=75045) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 23:39:57 user nova-compute[75045]: INFO nova.virt.block_device [None req-909fa573-22b0-43cd-810c-a6b0c43492aa tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] [instance: 899ae4a7-6932-4f43-a87f-a88cb2ce3cb9] Booting with volume snapshot 2ef08bd0-985d-4e2c-83bd-87d6c4e08d4a at /dev/vda
Nov 08 23:39:57 user nova-compute[75045]: DEBUG nova.policy [None req-909fa573-22b0-43cd-810c-a6b0c43492aa tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '76c31c64d9594f9cbef7586fafb48721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd59b73851c79473a9c2cdc0a120dfee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75045) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 23:39:57 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ee587a0-e271-4262-a252-2ccb6c2faecb/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:39:57 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78955913-bbab-4b00-bc9b-12116f249d7e/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:39:57 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78955913-bbab-4b00-bc9b-12116f249d7e/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:39:57 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78955913-bbab-4b00-bc9b-12116f249d7e/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:39:58 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78955913-bbab-4b00-bc9b-12116f249d7e/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:39:58 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5fc7f02-2143-4bcf-92ac-078d5ec10747/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:39:58 user nova-compute[75045]: DEBUG nova.network.neutron [None req-909fa573-22b0-43cd-810c-a6b0c43492aa tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] [instance: 899ae4a7-6932-4f43-a87f-a88cb2ce3cb9] Successfully created port: 0ffa225c-305b-4bbe-bae5-215270ecc6b1 {{(pid=75045) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 23:39:58 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5fc7f02-2143-4bcf-92ac-078d5ec10747/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:39:58 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5fc7f02-2143-4bcf-92ac-078d5ec10747/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:39:58 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5fc7f02-2143-4bcf-92ac-078d5ec10747/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:39:58 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/adcffd35-00c7-49db-a72f-d6307a90e123/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:39:58 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/adcffd35-00c7-49db-a72f-d6307a90e123/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:39:58 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/adcffd35-00c7-49db-a72f-d6307a90e123/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:39:58 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/adcffd35-00c7-49db-a72f-d6307a90e123/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:39:58 user nova-compute[75045]: DEBUG nova.network.neutron [None req-909fa573-22b0-43cd-810c-a6b0c43492aa tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] [instance: 899ae4a7-6932-4f43-a87f-a88cb2ce3cb9] Successfully updated port: 0ffa225c-305b-4bbe-bae5-215270ecc6b1 {{(pid=75045) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 23:39:58 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-909fa573-22b0-43cd-810c-a6b0c43492aa tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Acquiring lock "refresh_cache-899ae4a7-6932-4f43-a87f-a88cb2ce3cb9" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 23:39:58 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-909fa573-22b0-43cd-810c-a6b0c43492aa tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Acquired lock "refresh_cache-899ae4a7-6932-4f43-a87f-a88cb2ce3cb9" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 23:39:58 user nova-compute[75045]: DEBUG nova.network.neutron [None req-909fa573-22b0-43cd-810c-a6b0c43492aa tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] [instance: 899ae4a7-6932-4f43-a87f-a88cb2ce3cb9] Building network info cache for instance {{(pid=75045) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 23:39:59 user nova-compute[75045]: DEBUG nova.compute.manager [req-a2bc135f-4b18-47cd-b4b3-24d3f54fe24b req-2bea577f-6298-4cef-afec-730d00bf2b41 service nova] [instance: 899ae4a7-6932-4f43-a87f-a88cb2ce3cb9] Received event network-changed-0ffa225c-305b-4bbe-bae5-215270ecc6b1 {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:39:59 user nova-compute[75045]: DEBUG nova.compute.manager [req-a2bc135f-4b18-47cd-b4b3-24d3f54fe24b req-2bea577f-6298-4cef-afec-730d00bf2b41 service nova] [instance: 899ae4a7-6932-4f43-a87f-a88cb2ce3cb9] Refreshing instance network info cache due to event network-changed-0ffa225c-305b-4bbe-bae5-215270ecc6b1. {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 23:39:59 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-a2bc135f-4b18-47cd-b4b3-24d3f54fe24b req-2bea577f-6298-4cef-afec-730d00bf2b41 service nova] Acquiring lock "refresh_cache-899ae4a7-6932-4f43-a87f-a88cb2ce3cb9" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 23:39:59 user nova-compute[75045]: WARNING nova.virt.libvirt.driver [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 23:39:59 user nova-compute[75045]: WARNING nova.virt.libvirt.driver [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 23:39:59 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Hypervisor/Node resource view: name=user free_ram=8062MB free_disk=25.037181854248047GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75045) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 23:39:59 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:39:59 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:39:59 user nova-compute[75045]: DEBUG nova.network.neutron [None req-909fa573-22b0-43cd-810c-a6b0c43492aa tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] [instance: 899ae4a7-6932-4f43-a87f-a88cb2ce3cb9] Instance cache missing network info. {{(pid=75045) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 23:39:59 user nova-compute[75045]: WARNING nova.virt.libvirt.driver [None req-35b09304-8e9c-44d3-99f8-b99db9aba8ca tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance 78955913-bbab-4b00-bc9b-12116f249d7e is timed out.
Nov 08 23:39:59 user nova-compute[75045]: INFO nova.virt.libvirt.driver [None req-35b09304-8e9c-44d3-99f8-b99db9aba8ca tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] Successfully detached device vdc from instance 78955913-bbab-4b00-bc9b-12116f249d7e from the live domain config.
Nov 08 23:39:59 user nova-compute[75045]: DEBUG nova.virt.libvirt.volume.iscsi [None req-35b09304-8e9c-44d3-99f8-b99db9aba8ca tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] [instance: 78955913-bbab-4b00-bc9b-12116f249d7e] calling os-brick to detach iSCSI Volume {{(pid=75045) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 23:39:59 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-35b09304-8e9c-44d3-99f8-b99db9aba8ca tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1b68210460>, {'target_iqn': 'iqn.2010-10.org.openstack:5c6e98f2-e9be-4c1a-b335-61187862dfec', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rpHAkTqz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=75045) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 23:39:59 user nova-compute[75045]: WARNING os_brick.initiator.connectors.base [None req-35b09304-8e9c-44d3-99f8-b99db9aba8ca tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 23:39:59 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-35b09304-8e9c-44d3-99f8-b99db9aba8ca tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 23:39:59 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-35b09304-8e9c-44d3-99f8-b99db9aba8ca tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 23:39:59 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:39:59 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:39:59 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[8660e384-56c6-4123-a1ff-232ccffe318d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5c6e98f2-e9be-4c1a-b335-61187862dfec\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:39:59 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-35b09304-8e9c-44d3-99f8-b99db9aba8ca tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 23:39:59 user nova-compute[75045]: No targets found.
Nov 08 23:39:59 user nova-compute[75045]: iSNS:
Nov 08 23:39:59 user nova-compute[75045]: No targets found.
Nov 08 23:39:59 user nova-compute[75045]: STATIC:
Nov 08 23:39:59 user nova-compute[75045]: Target: iqn.2010-10.org.openstack:5c6e98f2-e9be-4c1a-b335-61187862dfec
Nov 08 23:39:59 user nova-compute[75045]:         Portal: 172.16.0.220:3260,-1
Nov 08 23:39:59 user nova-compute[75045]:                 Iface Name: default
Nov 08 23:39:59 user nova-compute[75045]: FIRMWARE:
Nov 08 23:39:59 user nova-compute[75045]: No targets found.
Nov 08 23:39:59 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 23:39:59 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-35b09304-8e9c-44d3-99f8-b99db9aba8ca tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 23:39:59 user nova-compute[75045]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 23:39:59 user nova-compute[75045]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75045) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 23:39:59 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-35b09304-8e9c-44d3-99f8-b99db9aba8ca tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5c6e98f2-e9be-4c1a-b335-61187862dfec', 0)] {{(pid=75045) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 23:39:59 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:39:59 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:39:59 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[29fc09d1-38f8-4048-b32c-0d53a736cc98]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5c6e98f2-e9be-4c1a-b335-61187862dfec\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:39:59 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:39:59 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:39:59 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[3050f8ea-24cd-448d-a853-ab8fcef3d133]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c6e98f2-e9be-4c1a-b335-61187862dfec (non-flash)\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:39:59 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Instance b5fc7f02-2143-4bcf-92ac-078d5ec10747 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75045) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 23:39:59 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Instance adcffd35-00c7-49db-a72f-d6307a90e123 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75045) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 23:39:59 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Instance 78955913-bbab-4b00-bc9b-12116f249d7e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75045) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 23:39:59 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Instance 244c4cc9-2837-40c9-b4ad-37dc435c9749 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75045) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 23:39:59 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Instance 7ee587a0-e271-4262-a252-2ccb6c2faecb actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75045) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 23:39:59 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Instance c3df54db-78d7-436b-b86a-df3257b170e6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75045) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 23:39:59 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Instance 899ae4a7-6932-4f43-a87f-a88cb2ce3cb9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75045) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 23:39:59 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=75045) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 23:39:59 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=75045) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 23:39:59 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-35b09304-8e9c-44d3-99f8-b99db9aba8ca tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c6e98f2-e9be-4c1a-b335-61187862dfec (non-flash)
Nov 08 23:39:59 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 23:39:59 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-35b09304-8e9c-44d3-99f8-b99db9aba8ca tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c6e98f2-e9be-4c1a-b335-61187862dfec (non-flash)
Nov 08 23:39:59 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 23:39:59 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-35b09304-8e9c-44d3-99f8-b99db9aba8ca tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1b48210160>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5c6e98f2-e9be-4c1a-b335-61187862dfec'): ({'sdd'}, set())}) {{(pid=75045) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 23:39:59 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-35b09304-8e9c-44d3-99f8-b99db9aba8ca tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] Removing single pathed devices sdd {{(pid=75045) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 23:39:59 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:39:59 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:39:59 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[a944b1de-8a12-41fc-8d2c-a677f839d858]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:39:59 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:39:59 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.024s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:39:59 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[1162b997-6fbc-4753-8ff3-1cc9e93554ce]: (4, ('ok\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:39:59 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-35b09304-8e9c-44d3-99f8-b99db9aba8ca tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] Flushing IO for device /dev/sdd {{(pid=75045) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 23:39:59 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:39:59 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.016s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:39:59 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ebe356f-ad9c-4245-93b6-b393ed035ae9]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:39:59 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-35b09304-8e9c-44d3-99f8-b99db9aba8ca tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75045) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 23:39:59 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:39:59 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.046s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:39:59 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[add3c6e7-fee7-4150-9f6c-b2b6148c7eda]: (4, ('1', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:39:59 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-35b09304-8e9c-44d3-99f8-b99db9aba8ca tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75045) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 23:39:59 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-35b09304-8e9c-44d3-99f8-b99db9aba8ca tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] SCSI volumes sdd have been removed. {{(pid=75045) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 23:39:59 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-35b09304-8e9c-44d3-99f8-b99db9aba8ca tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5c6e98f2-e9be-4c1a-b335-61187862dfec')] {{(pid=75045) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 23:39:59 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c6e98f2-e9be-4c1a-b335-61187862dfec -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:39:59 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c6e98f2-e9be-4c1a-b335-61187862dfec -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.031s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:39:59 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd6bd09d-dde4-4742-a12a-c35c36fab5cc]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:39:59 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-35b09304-8e9c-44d3-99f8-b99db9aba8ca tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:39:59 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c6e98f2-e9be-4c1a-b335-61187862dfec -p 172.16.0.220:3260 --logout {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:39:59 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c6e98f2-e9be-4c1a-b335-61187862dfec -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:39:59 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[0654b190-0190-46b6-90f4-10d27390b651]: (4, ('Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:5c6e98f2-e9be-4c1a-b335-61187862dfec, portal: 172.16.0.220,3260]\nLogout of [sid: 39, target: iqn.2010-10.org.openstack:5c6e98f2-e9be-4c1a-b335-61187862dfec, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:39:59 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-35b09304-8e9c-44d3-99f8-b99db9aba8ca tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:5c6e98f2-e9be-4c1a-b335-61187862dfec, portal: 172.16.0.220,3260]
Nov 08 23:39:59 user nova-compute[75045]: Logout of [sid: 39, target: iqn.2010-10.org.openstack:5c6e98f2-e9be-4c1a-b335-61187862dfec, portal: 172.16.0.220,3260] successful.
Nov 08 23:39:59 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:39:59 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c6e98f2-e9be-4c1a-b335-61187862dfec -p 172.16.0.220:3260 --op delete {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:39:59 user nova-compute[75045]: DEBUG nova.compute.provider_tree [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Inventory has not changed in ProviderTree for provider: 62ba5f85-c74d-4b58-986e-d4197e813fd7 {{(pid=75045) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 23:39:59 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c6e98f2-e9be-4c1a-b335-61187862dfec -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:39:59 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8f6dc47-65ed-4603-8333-1fc6ed74c477]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:39:59 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-35b09304-8e9c-44d3-99f8-b99db9aba8ca tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:39:59 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-35b09304-8e9c-44d3-99f8-b99db9aba8ca tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.339s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 23:39:59 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-35b09304-8e9c-44d3-99f8-b99db9aba8ca tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] <== disconnect_volume: return (340ms) None {{(pid=75045) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 23:39:59 user nova-compute[75045]: DEBUG nova.virt.libvirt.volume.iscsi [None req-35b09304-8e9c-44d3-99f8-b99db9aba8ca tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] [instance: 78955913-bbab-4b00-bc9b-12116f249d7e] Disconnected iSCSI Volume {{(pid=75045) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 23:39:59 user nova-compute[75045]: DEBUG nova.scheduler.client.report [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Inventory has not changed for provider 62ba5f85-c74d-4b58-986e-d4197e813fd7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75045) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 23:39:59 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Compute_service record updated for user:user {{(pid=75045) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 23:39:59 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.455s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:39:59 user nova-compute[75045]: DEBUG nova.network.neutron [None req-909fa573-22b0-43cd-810c-a6b0c43492aa tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] [instance: 899ae4a7-6932-4f43-a87f-a88cb2ce3cb9] Updating instance_info_cache with network_info: [{"id": "0ffa225c-305b-4bbe-bae5-215270ecc6b1", "address": "fa:16:3e:bb:a6:e0", "network": {"id": "4205f899-9865-4c65-8b46-c9a533e9bb45", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-774780781-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d59b73851c79473a9c2cdc0a120dfee0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ffa225c-30", "ovs_interfaceid": "0ffa225c-305b-4bbe-bae5-215270ecc6b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75045) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 23:40:00 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-909fa573-22b0-43cd-810c-a6b0c43492aa tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Releasing lock "refresh_cache-899ae4a7-6932-4f43-a87f-a88cb2ce3cb9" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 23:40:00 user nova-compute[75045]: DEBUG nova.compute.manager [None req-909fa573-22b0-43cd-810c-a6b0c43492aa tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] [instance: 899ae4a7-6932-4f43-a87f-a88cb2ce3cb9] Instance network_info: |[{"id": "0ffa225c-305b-4bbe-bae5-215270ecc6b1", "address": "fa:16:3e:bb:a6:e0", "network": {"id": "4205f899-9865-4c65-8b46-c9a533e9bb45", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-774780781-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d59b73851c79473a9c2cdc0a120dfee0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ffa225c-30", "ovs_interfaceid": "0ffa225c-305b-4bbe-bae5-215270ecc6b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75045) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 23:40:00 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-a2bc135f-4b18-47cd-b4b3-24d3f54fe24b req-2bea577f-6298-4cef-afec-730d00bf2b41 service nova] Acquired lock "refresh_cache-899ae4a7-6932-4f43-a87f-a88cb2ce3cb9" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 23:40:00 user nova-compute[75045]: DEBUG nova.network.neutron [req-a2bc135f-4b18-47cd-b4b3-24d3f54fe24b req-2bea577f-6298-4cef-afec-730d00bf2b41 service nova] [instance: 899ae4a7-6932-4f43-a87f-a88cb2ce3cb9] Refreshing network info cache for port 0ffa225c-305b-4bbe-bae5-215270ecc6b1 {{(pid=75045) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 23:40:00 user nova-compute[75045]: DEBUG nova.network.neutron [req-a2bc135f-4b18-47cd-b4b3-24d3f54fe24b req-2bea577f-6298-4cef-afec-730d00bf2b41 service nova] [instance: 899ae4a7-6932-4f43-a87f-a88cb2ce3cb9] Updated VIF entry in instance network info cache for port 0ffa225c-305b-4bbe-bae5-215270ecc6b1. {{(pid=75045) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 23:40:00 user nova-compute[75045]: DEBUG nova.network.neutron [req-a2bc135f-4b18-47cd-b4b3-24d3f54fe24b req-2bea577f-6298-4cef-afec-730d00bf2b41 service nova] [instance: 899ae4a7-6932-4f43-a87f-a88cb2ce3cb9] Updating instance_info_cache with network_info: [{"id": "0ffa225c-305b-4bbe-bae5-215270ecc6b1", "address": "fa:16:3e:bb:a6:e0", "network": {"id": "4205f899-9865-4c65-8b46-c9a533e9bb45", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-774780781-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d59b73851c79473a9c2cdc0a120dfee0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ffa225c-30", "ovs_interfaceid": "0ffa225c-305b-4bbe-bae5-215270ecc6b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75045) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 23:40:00 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:40:00 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-a2bc135f-4b18-47cd-b4b3-24d3f54fe24b req-2bea577f-6298-4cef-afec-730d00bf2b41 service nova] Releasing lock "refresh_cache-899ae4a7-6932-4f43-a87f-a88cb2ce3cb9" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 23:40:00 user nova-compute[75045]: DEBUG nova.objects.instance [None req-35b09304-8e9c-44d3-99f8-b99db9aba8ca tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] Lazy-loading 'flavor' on Instance uuid 78955913-bbab-4b00-bc9b-12116f249d7e {{(pid=75045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 23:40:00 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-35b09304-8e9c-44d3-99f8-b99db9aba8ca tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] Lock "78955913-bbab-4b00-bc9b-12116f249d7e" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.974s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:40:01 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:40:03 user nova-compute[75045]: DEBUG os_brick.utils [None req-909fa573-22b0-43cd-810c-a6b0c43492aa tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75045) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 23:40:03 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:40:03 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:40:03 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[6867b9c3-df06-46d2-b1f7-3bf33565fd58]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6217bd6e884\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:40:03 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:40:03 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:40:03 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3bd6c99-2423-4d6b-9846-0e0edcd252dd]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:40:03 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:40:03 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:40:03 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bdffb63-f005-4e9a-a7e2-6b21371b77d5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:40:03 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[796bf470-5aaf-4230-adab-d4d9a671784a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:40:03 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-909fa573-22b0-43cd-810c-a6b0c43492aa tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Running cmd (subprocess): nvme version {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:40:03 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-909fa573-22b0-43cd-810c-a6b0c43492aa tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] 'nvme version' failed. Not Retrying. {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 23:40:03 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.nvmeof [None req-909fa573-22b0-43cd-810c-a6b0c43492aa tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] nvme not present on system {{(pid=75045) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 23:40:03 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:40:03 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 23:40:03 user nova-compute[75045]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 23:40:03 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9939507-23a7-48d7-8642-2c2bd978cdaa]: (4, '') {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:40:03 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.lightos [None req-909fa573-22b0-43cd-810c-a6b0c43492aa tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75045) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 23:40:03 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.lightos [None req-909fa573-22b0-43cd-810c-a6b0c43492aa tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75045) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 23:40:03 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.lightos [None req-909fa573-22b0-43cd-810c-a6b0c43492aa tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] LIGHTOS: no hostnqn found. {{(pid=75045) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 23:40:03 user nova-compute[75045]: DEBUG os_brick.utils [None req-909fa573-22b0-43cd-810c-a6b0c43492aa tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6217bd6e884', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75045) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 23:40:03 user nova-compute[75045]: DEBUG nova.virt.block_device [None req-909fa573-22b0-43cd-810c-a6b0c43492aa tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] [instance: 899ae4a7-6932-4f43-a87f-a88cb2ce3cb9] Updating existing volume attachment record: e8aab97a-9591-4411-8bf3-641598f2080b {{(pid=75045) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 23:40:05 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:40:06 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:40:10 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:40:15 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:40:20 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 23:40:21 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:40:25 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:40:26 user nova-compute[75045]: DEBUG nova.compute.manager [None req-909fa573-22b0-43cd-810c-a6b0c43492aa tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] [instance: 899ae4a7-6932-4f43-a87f-a88cb2ce3cb9] Start spawning the instance on the hypervisor. {{(pid=75045) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 23:40:26 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-909fa573-22b0-43cd-810c-a6b0c43492aa tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] [instance: 899ae4a7-6932-4f43-a87f-a88cb2ce3cb9] Creating instance directory {{(pid=75045) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 23:40:26 user nova-compute[75045]: INFO nova.virt.libvirt.driver [None req-909fa573-22b0-43cd-810c-a6b0c43492aa tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] [instance: 899ae4a7-6932-4f43-a87f-a88cb2ce3cb9] Creating image(s)
Nov 08 23:40:26 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-909fa573-22b0-43cd-810c-a6b0c43492aa tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] [instance: 899ae4a7-6932-4f43-a87f-a88cb2ce3cb9] Did not create local disks {{(pid=75045) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 08 23:40:26 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-909fa573-22b0-43cd-810c-a6b0c43492aa tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] [instance: 899ae4a7-6932-4f43-a87f-a88cb2ce3cb9] Ensure instance console log exists: /opt/stack/data/nova/instances/899ae4a7-6932-4f43-a87f-a88cb2ce3cb9/console.log {{(pid=75045) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 23:40:26 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-909fa573-22b0-43cd-810c-a6b0c43492aa tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:40:26 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-909fa573-22b0-43cd-810c-a6b0c43492aa tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:40:26 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-909fa573-22b0-43cd-810c-a6b0c43492aa tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:40:26 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-909fa573-22b0-43cd-810c-a6b0c43492aa tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] [instance: 899ae4a7-6932-4f43-a87f-a88cb2ce3cb9] Start _get_guest_xml network_info=[{"id": "0ffa225c-305b-4bbe-bae5-215270ecc6b1", "address": "fa:16:3e:bb:a6:e0", "network": {"id": "4205f899-9865-4c65-8b46-c9a533e9bb45", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-774780781-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d59b73851c79473a9c2cdc0a120dfee0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ffa225c-30", "ovs_interfaceid": "0ffa225c-305b-4bbe-bae5-215270ecc6b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': True, 'device_type': 'disk', 'attachment_id': 'e8aab97a-9591-4411-8bf3-641598f2080b', 'guest_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:8fae24d0-d1b0-4d8b-912c-78e4faee8bb7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kOnrPmAI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '899ae4a7-6932-4f43-a87f-a88cb2ce3cb9', 'attached_at': '', 'detached_at': '', 'volume_id': '8fae24d0-d1b0-4d8b-912c-78e4faee8bb7', 'serial': '8fae24d0-d1b0-4d8b-912c-78e4faee8bb7'}, 'volume_type': None} {{(pid=75045) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 23:40:26 user nova-compute[75045]: WARNING nova.virt.libvirt.driver [None req-909fa573-22b0-43cd-810c-a6b0c43492aa tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 23:40:26 user nova-compute[75045]: WARNING nova.virt.libvirt.driver [None req-909fa573-22b0-43cd-810c-a6b0c43492aa tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 23:40:26 user nova-compute[75045]: DEBUG nova.virt.libvirt.host [None req-909fa573-22b0-43cd-810c-a6b0c43492aa tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75045) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 23:40:26 user nova-compute[75045]: DEBUG nova.virt.libvirt.host [None req-909fa573-22b0-43cd-810c-a6b0c43492aa tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] CPU controller missing on host. {{(pid=75045) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 23:40:26 user nova-compute[75045]: DEBUG nova.virt.libvirt.host [None req-909fa573-22b0-43cd-810c-a6b0c43492aa tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75045) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 23:40:26 user nova-compute[75045]: DEBUG nova.virt.libvirt.host [None req-909fa573-22b0-43cd-810c-a6b0c43492aa tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] CPU controller found on host. {{(pid=75045) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 23:40:26 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-909fa573-22b0-43cd-810c-a6b0c43492aa tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75045) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 23:40:26 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-909fa573-22b0-43cd-810c-a6b0c43492aa tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T23:11:41Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75045) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 23:40:26 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-909fa573-22b0-43cd-810c-a6b0c43492aa tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Flavor limits 0:0:0 {{(pid=75045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 23:40:26 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-909fa573-22b0-43cd-810c-a6b0c43492aa tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Image limits 0:0:0 {{(pid=75045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 23:40:26 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-909fa573-22b0-43cd-810c-a6b0c43492aa tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Flavor pref 0:0:0 {{(pid=75045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 23:40:26 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-909fa573-22b0-43cd-810c-a6b0c43492aa tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Image pref 0:0:0 {{(pid=75045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 23:40:26 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-909fa573-22b0-43cd-810c-a6b0c43492aa tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 23:40:26 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-909fa573-22b0-43cd-810c-a6b0c43492aa tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75045) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 23:40:26 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-909fa573-22b0-43cd-810c-a6b0c43492aa tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75045) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 23:40:26 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-909fa573-22b0-43cd-810c-a6b0c43492aa tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Got 1 possible topologies {{(pid=75045) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 23:40:26 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-909fa573-22b0-43cd-810c-a6b0c43492aa tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75045) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 23:40:26 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-909fa573-22b0-43cd-810c-a6b0c43492aa tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75045) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 23:40:26 user nova-compute[75045]: DEBUG nova.virt.libvirt.volume.iscsi [None req-909fa573-22b0-43cd-810c-a6b0c43492aa tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] [instance: 899ae4a7-6932-4f43-a87f-a88cb2ce3cb9] Calling os-brick to attach iSCSI Volume {{(pid=75045) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 23:40:26 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-909fa573-22b0-43cd-810c-a6b0c43492aa tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1b68210460>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:8fae24d0-d1b0-4d8b-912c-78e4faee8bb7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kOnrPmAI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75045) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 23:40:26 user nova-compute[75045]: WARNING os_brick.initiator.connectors.base [None req-909fa573-22b0-43cd-810c-a6b0c43492aa tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 23:40:26 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-909fa573-22b0-43cd-810c-a6b0c43492aa tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 23:40:26 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-909fa573-22b0-43cd-810c-a6b0c43492aa tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 23:40:26 user nova-compute[75045]: WARNING os_brick.initiator.connectors.base [None req-909fa573-22b0-43cd-810c-a6b0c43492aa tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 23:40:26 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-909fa573-22b0-43cd-810c-a6b0c43492aa tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8fae24d0-d1b0-4d8b-912c-78e4faee8bb7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 23:40:26 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-909fa573-22b0-43cd-810c-a6b0c43492aa tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8fae24d0-d1b0-4d8b-912c-78e4faee8bb7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 23:40:26 user nova-compute[75045]: INFO os_brick.initiator.connectors.iscsi [None req-909fa573-22b0-43cd-810c-a6b0c43492aa tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 23:40:26 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8fae24d0-d1b0-4d8b-912c-78e4faee8bb7 -p 172.16.0.220:3260 {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:40:26 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8fae24d0-d1b0-4d8b-912c-78e4faee8bb7 -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:40:26 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdc9a86d-bd9a-43f7-8c94-4b5ab65f5fc1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:40:26 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-909fa573-22b0-43cd-810c-a6b0c43492aa tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 23:40:26 user nova-compute[75045]:  {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:40:26 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8fae24d0-d1b0-4d8b-912c-78e4faee8bb7 -p 172.16.0.220:3260 --interface default --op new {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:40:26 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8fae24d0-d1b0-4d8b-912c-78e4faee8bb7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:40:26 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9dd8948-558d-494e-902a-fa6635d3ed79]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8fae24d0-d1b0-4d8b-912c-78e4faee8bb7] added\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:40:26 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-909fa573-22b0-43cd-810c-a6b0c43492aa tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8fae24d0-d1b0-4d8b-912c-78e4faee8bb7] added
Nov 08 23:40:26 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:40:26 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8fae24d0-d1b0-4d8b-912c-78e4faee8bb7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:40:26 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8fae24d0-d1b0-4d8b-912c-78e4faee8bb7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:40:26 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[dedc808f-77e7-4835-a9ab-64373bb1017d]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:40:26 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-909fa573-22b0-43cd-810c-a6b0c43492aa tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:40:26 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8fae24d0-d1b0-4d8b-912c-78e4faee8bb7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:40:26 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8fae24d0-d1b0-4d8b-912c-78e4faee8bb7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:40:26 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2b690f6-f8ac-4aa1-b6dc-799086d811b0]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:40:26 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-909fa573-22b0-43cd-810c-a6b0c43492aa tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:40:26 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8fae24d0-d1b0-4d8b-912c-78e4faee8bb7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kOnrPmAI {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:40:26 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8fae24d0-d1b0-4d8b-912c-78e4faee8bb7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kOnrPmAI" returned: 0 in 0.017s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:40:26 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[7da3fac3-c282-40d9-8cd0-bd7924405911]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:40:26 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-909fa573-22b0-43cd-810c-a6b0c43492aa tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'kOnrPmAI'): stdout= stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:40:26 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8fae24d0-d1b0-4d8b-912c-78e4faee8bb7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:40:26 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8fae24d0-d1b0-4d8b-912c-78e4faee8bb7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:40:26 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[7da01986-d211-41d0-bb45-af9be2aed8ba]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:40:26 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-909fa573-22b0-43cd-810c-a6b0c43492aa tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:40:26 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:40:26 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:40:26 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[6da170a6-bb5c-4f8c-be21-a2e6edf7cda3]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:40:26 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-909fa573-22b0-43cd-810c-a6b0c43492aa tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 08 23:40:26 user nova-compute[75045]:  {{(pid=75045) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 23:40:26 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-909fa573-22b0-43cd-810c-a6b0c43492aa tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 08 23:40:26 user nova-compute[75045]:  {{(pid=75045) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 23:40:26 user nova-compute[75045]: WARNING os_brick.initiator.connectors.iscsi [None req-909fa573-22b0-43cd-810c-a6b0c43492aa tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 08 23:40:26 user nova-compute[75045]: 
Nov 08 23:40:26 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8fae24d0-d1b0-4d8b-912c-78e4faee8bb7 -p 172.16.0.220:3260 --login {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:40:26 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8fae24d0-d1b0-4d8b-912c-78e4faee8bb7 -p 172.16.0.220:3260 --login" returned: 0 in 0.048s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:40:26 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[445c07e0-1538-4dd3-8d58-104ad40fd6e8]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8fae24d0-d1b0-4d8b-912c-78e4faee8bb7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8fae24d0-d1b0-4d8b-912c-78e4faee8bb7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:40:26 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-909fa573-22b0-43cd-810c-a6b0c43492aa tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8fae24d0-d1b0-4d8b-912c-78e4faee8bb7, portal: 172.16.0.220,3260]
Nov 08 23:40:26 user nova-compute[75045]: Login to [iface: default, target: iqn.2010-10.org.openstack:8fae24d0-d1b0-4d8b-912c-78e4faee8bb7, portal: 172.16.0.220,3260] successful.
Nov 08 23:40:26 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:40:26 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8fae24d0-d1b0-4d8b-912c-78e4faee8bb7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:40:26 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8fae24d0-d1b0-4d8b-912c-78e4faee8bb7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:40:26 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[27a45b5a-c125-43ac-b559-faf1c5981e66]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:40:26 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-909fa573-22b0-43cd-810c-a6b0c43492aa tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:40:26 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:40:26 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:40:26 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdf0db4d-8ccd-4956-ba16-752cc6774278]: (4, ('tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fae24d0-d1b0-4d8b-912c-78e4faee8bb7 (non-flash)\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:40:26 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-909fa573-22b0-43cd-810c-a6b0c43492aa tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fae24d0-d1b0-4d8b-912c-78e4faee8bb7 (non-flash)
Nov 08 23:40:26 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 23:40:26 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-909fa573-22b0-43cd-810c-a6b0c43492aa tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] iscsi session list stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fae24d0-d1b0-4d8b-912c-78e4faee8bb7 (non-flash)
Nov 08 23:40:26 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 23:40:26 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-909fa573-22b0-43cd-810c-a6b0c43492aa tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8fae24d0-d1b0-4d8b-912c-78e4faee8bb7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.257s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 23:40:26 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-909fa573-22b0-43cd-810c-a6b0c43492aa tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Connected to 172.16.0.220:3260 {{(pid=75045) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 23:40:26 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-909fa573-22b0-43cd-810c-a6b0c43492aa tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] HCTL ('33', '-', '-', 0) found on session 40 with lun 0 {{(pid=75045) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 23:40:26 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-909fa573-22b0-43cd-810c-a6b0c43492aa tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75045) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 23:40:26 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:40:26 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:40:26 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[20e1ce69-d7b8-46bc-984f-9df80d71c169]: (4, ('- - 0', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:40:26 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-909fa573-22b0-43cd-810c-a6b0c43492aa tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Searching for a device in session 40 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75045) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 23:40:26 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-909fa573-22b0-43cd-810c-a6b0c43492aa tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:8fae24d0-d1b0-4d8b-912c-78e4faee8bb7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kOnrPmAI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75045) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 23:40:27 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-909fa573-22b0-43cd-810c-a6b0c43492aa tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.289s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 23:40:27 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-909fa573-22b0-43cd-810c-a6b0c43492aa tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] <== connect_volume: return (1290ms) {'type': 'block', 'scsi_wwn': '26563343566363466', 'path': '/dev/sdb'} {{(pid=75045) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 23:40:27 user nova-compute[75045]: DEBUG nova.virt.libvirt.volume.iscsi [None req-909fa573-22b0-43cd-810c-a6b0c43492aa tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] [instance: 899ae4a7-6932-4f43-a87f-a88cb2ce3cb9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26563343566363466', 'path': '/dev/sdb'} {{(pid=75045) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 23:40:27 user nova-compute[75045]: DEBUG nova.virt.libvirt.vif [None req-909fa573-22b0-43cd-810c-a6b0c43492aa tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T23:39:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1213755282',display_name='tempest-TestVolumeBootPattern-server-1213755282',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1213755282',id=39,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d59b73851c79473a9c2cdc0a120dfee0',ramdisk_id='',reservation_id='r-1h00qjsi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-650796844',owner_user_name='tempest-TestVolumeBootPattern-650796844-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T23:39:58Z,user_data=None,user_id='76c31c64d9594f9cbef7586fafb48721',uuid=899ae4a7-6932-4f43-a87f-a88cb2ce3cb9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0ffa225c-305b-4bbe-bae5-215270ecc6b1", "address": "fa:16:3e:bb:a6:e0", "network": {"id": "4205f899-9865-4c65-8b46-c9a533e9bb45", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-774780781-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d59b73851c79473a9c2cdc0a120dfee0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ffa225c-30", "ovs_interfaceid": "0ffa225c-305b-4bbe-bae5-215270ecc6b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75045) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 23:40:27 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-909fa573-22b0-43cd-810c-a6b0c43492aa tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Converting VIF {"id": "0ffa225c-305b-4bbe-bae5-215270ecc6b1", "address": "fa:16:3e:bb:a6:e0", "network": {"id": "4205f899-9865-4c65-8b46-c9a533e9bb45", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-774780781-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d59b73851c79473a9c2cdc0a120dfee0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ffa225c-30", "ovs_interfaceid": "0ffa225c-305b-4bbe-bae5-215270ecc6b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 23:40:27 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-909fa573-22b0-43cd-810c-a6b0c43492aa tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bb:a6:e0,bridge_name='br-int',has_traffic_filtering=True,id=0ffa225c-305b-4bbe-bae5-215270ecc6b1,network=Network(4205f899-9865-4c65-8b46-c9a533e9bb45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ffa225c-30') {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 23:40:27 user nova-compute[75045]: DEBUG nova.objects.instance [None req-909fa573-22b0-43cd-810c-a6b0c43492aa tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Lazy-loading 'pci_devices' on Instance uuid 899ae4a7-6932-4f43-a87f-a88cb2ce3cb9 {{(pid=75045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 23:40:27 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-909fa573-22b0-43cd-810c-a6b0c43492aa tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] [instance: 899ae4a7-6932-4f43-a87f-a88cb2ce3cb9] End _get_guest_xml xml=<domain type="kvm">
Nov 08 23:40:27 user nova-compute[75045]:   <uuid>899ae4a7-6932-4f43-a87f-a88cb2ce3cb9</uuid>
Nov 08 23:40:27 user nova-compute[75045]:   <name>instance-00000027</name>
Nov 08 23:40:27 user nova-compute[75045]:   <memory>524288</memory>
Nov 08 23:40:27 user nova-compute[75045]:   <vcpu>1</vcpu>
Nov 08 23:40:27 user nova-compute[75045]:   <metadata>
Nov 08 23:40:27 user nova-compute[75045]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 23:40:27 user nova-compute[75045]:       <nova:package version="0.0.0"/>
Nov 08 23:40:27 user nova-compute[75045]:       <nova:name>tempest-TestVolumeBootPattern-server-1213755282</nova:name>
Nov 08 23:40:27 user nova-compute[75045]:       <nova:creationTime>2023-11-08 23:40:26</nova:creationTime>
Nov 08 23:40:27 user nova-compute[75045]:       <nova:flavor name="m1.tiny">
Nov 08 23:40:27 user nova-compute[75045]:         <nova:memory>512</nova:memory>
Nov 08 23:40:27 user nova-compute[75045]:         <nova:disk>1</nova:disk>
Nov 08 23:40:27 user nova-compute[75045]:         <nova:swap>0</nova:swap>
Nov 08 23:40:27 user nova-compute[75045]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 23:40:27 user nova-compute[75045]:         <nova:vcpus>1</nova:vcpus>
Nov 08 23:40:27 user nova-compute[75045]:       </nova:flavor>
Nov 08 23:40:27 user nova-compute[75045]:       <nova:owner>
Nov 08 23:40:27 user nova-compute[75045]:         <nova:user uuid="76c31c64d9594f9cbef7586fafb48721">tempest-TestVolumeBootPattern-650796844-project-member</nova:user>
Nov 08 23:40:27 user nova-compute[75045]:         <nova:project uuid="d59b73851c79473a9c2cdc0a120dfee0">tempest-TestVolumeBootPattern-650796844</nova:project>
Nov 08 23:40:27 user nova-compute[75045]:       </nova:owner>
Nov 08 23:40:27 user nova-compute[75045]:       <nova:ports>
Nov 08 23:40:27 user nova-compute[75045]:         <nova:port uuid="0ffa225c-305b-4bbe-bae5-215270ecc6b1">
Nov 08 23:40:27 user nova-compute[75045]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 08 23:40:27 user nova-compute[75045]:         </nova:port>
Nov 08 23:40:27 user nova-compute[75045]:       </nova:ports>
Nov 08 23:40:27 user nova-compute[75045]:     </nova:instance>
Nov 08 23:40:27 user nova-compute[75045]:   </metadata>
Nov 08 23:40:27 user nova-compute[75045]:   <sysinfo type="smbios">
Nov 08 23:40:27 user nova-compute[75045]:     <system>
Nov 08 23:40:27 user nova-compute[75045]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 23:40:27 user nova-compute[75045]:       <entry name="product">OpenStack Nova</entry>
Nov 08 23:40:27 user nova-compute[75045]:       <entry name="version">0.0.0</entry>
Nov 08 23:40:27 user nova-compute[75045]:       <entry name="serial">899ae4a7-6932-4f43-a87f-a88cb2ce3cb9</entry>
Nov 08 23:40:27 user nova-compute[75045]:       <entry name="uuid">899ae4a7-6932-4f43-a87f-a88cb2ce3cb9</entry>
Nov 08 23:40:27 user nova-compute[75045]:       <entry name="family">Virtual Machine</entry>
Nov 08 23:40:27 user nova-compute[75045]:     </system>
Nov 08 23:40:27 user nova-compute[75045]:   </sysinfo>
Nov 08 23:40:27 user nova-compute[75045]:   <os>
Nov 08 23:40:27 user nova-compute[75045]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 23:40:27 user nova-compute[75045]:     <boot dev="hd"/>
Nov 08 23:40:27 user nova-compute[75045]:     <smbios mode="sysinfo"/>
Nov 08 23:40:27 user nova-compute[75045]:   </os>
Nov 08 23:40:27 user nova-compute[75045]:   <features>
Nov 08 23:40:27 user nova-compute[75045]:     <acpi/>
Nov 08 23:40:27 user nova-compute[75045]:     <apic/>
Nov 08 23:40:27 user nova-compute[75045]:     <vmcoreinfo/>
Nov 08 23:40:27 user nova-compute[75045]:   </features>
Nov 08 23:40:27 user nova-compute[75045]:   <clock offset="utc">
Nov 08 23:40:27 user nova-compute[75045]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 23:40:27 user nova-compute[75045]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 23:40:27 user nova-compute[75045]:     <timer name="hpet" present="no"/>
Nov 08 23:40:27 user nova-compute[75045]:   </clock>
Nov 08 23:40:27 user nova-compute[75045]:   <cpu mode="custom" match="exact">
Nov 08 23:40:27 user nova-compute[75045]:     <model>Nehalem</model>
Nov 08 23:40:27 user nova-compute[75045]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 23:40:27 user nova-compute[75045]:   </cpu>
Nov 08 23:40:27 user nova-compute[75045]:   <devices>
Nov 08 23:40:27 user nova-compute[75045]:     <disk type="block" device="disk">
Nov 08 23:40:27 user nova-compute[75045]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 23:40:27 user nova-compute[75045]:       <source dev="/dev/sdb"/>
Nov 08 23:40:27 user nova-compute[75045]:       <target dev="vda" bus="virtio"/>
Nov 08 23:40:27 user nova-compute[75045]:       <serial>8fae24d0-d1b0-4d8b-912c-78e4faee8bb7</serial>
Nov 08 23:40:27 user nova-compute[75045]:     </disk>
Nov 08 23:40:27 user nova-compute[75045]:     <interface type="ethernet">
Nov 08 23:40:27 user nova-compute[75045]:       <mac address="fa:16:3e:bb:a6:e0"/>
Nov 08 23:40:27 user nova-compute[75045]:       <model type="virtio"/>
Nov 08 23:40:27 user nova-compute[75045]:       <mtu size="1442"/>
Nov 08 23:40:27 user nova-compute[75045]:       <target dev="tap0ffa225c-30"/>
Nov 08 23:40:27 user nova-compute[75045]:     </interface>
Nov 08 23:40:27 user nova-compute[75045]:     <serial type="pty">
Nov 08 23:40:27 user nova-compute[75045]:       <log file="/opt/stack/data/nova/instances/899ae4a7-6932-4f43-a87f-a88cb2ce3cb9/console.log" append="off"/>
Nov 08 23:40:27 user nova-compute[75045]:     </serial>
Nov 08 23:40:27 user nova-compute[75045]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 23:40:27 user nova-compute[75045]:     <video>
Nov 08 23:40:27 user nova-compute[75045]:       <model type="virtio"/>
Nov 08 23:40:27 user nova-compute[75045]:     </video>
Nov 08 23:40:27 user nova-compute[75045]:     <rng model="virtio">
Nov 08 23:40:27 user nova-compute[75045]:       <backend model="random">/dev/urandom</backend>
Nov 08 23:40:27 user nova-compute[75045]:     </rng>
Nov 08 23:40:27 user nova-compute[75045]:     <controller type="usb" index="0" model="none"/>
Nov 08 23:40:27 user nova-compute[75045]:     <memballoon model="virtio">
Nov 08 23:40:27 user nova-compute[75045]:       <stats period="10"/>
Nov 08 23:40:27 user nova-compute[75045]:     </memballoon>
Nov 08 23:40:27 user nova-compute[75045]:   </devices>
Nov 08 23:40:27 user nova-compute[75045]: </domain>
Nov 08 23:40:27 user nova-compute[75045]:  {{(pid=75045) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 23:40:27 user nova-compute[75045]: DEBUG nova.virt.libvirt.vif [None req-909fa573-22b0-43cd-810c-a6b0c43492aa tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T23:39:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1213755282',display_name='tempest-TestVolumeBootPattern-server-1213755282',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1213755282',id=39,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d59b73851c79473a9c2cdc0a120dfee0',ramdisk_id='',reservation_id='r-1h00qjsi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-650796844',owner_user_name='tempest-TestVolumeBootPattern-650796844-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T23:39:58Z,user_data=None,user_id='76c31c64d9594f9cbef7586fafb48721',uuid=899ae4a7-6932-4f43-a87f-a88cb2ce3cb9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0ffa225c-305b-4bbe-bae5-215270ecc6b1", "address": "fa:16:3e:bb:a6:e0", "network": {"id": "4205f899-9865-4c65-8b46-c9a533e9bb45", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-774780781-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d59b73851c79473a9c2cdc0a120dfee0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ffa225c-30", "ovs_interfaceid": "0ffa225c-305b-4bbe-bae5-215270ecc6b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75045) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 23:40:27 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-909fa573-22b0-43cd-810c-a6b0c43492aa tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Converting VIF {"id": "0ffa225c-305b-4bbe-bae5-215270ecc6b1", "address": "fa:16:3e:bb:a6:e0", "network": {"id": "4205f899-9865-4c65-8b46-c9a533e9bb45", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-774780781-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d59b73851c79473a9c2cdc0a120dfee0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ffa225c-30", "ovs_interfaceid": "0ffa225c-305b-4bbe-bae5-215270ecc6b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 23:40:27 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-909fa573-22b0-43cd-810c-a6b0c43492aa tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bb:a6:e0,bridge_name='br-int',has_traffic_filtering=True,id=0ffa225c-305b-4bbe-bae5-215270ecc6b1,network=Network(4205f899-9865-4c65-8b46-c9a533e9bb45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ffa225c-30') {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 23:40:27 user nova-compute[75045]: DEBUG os_vif [None req-909fa573-22b0-43cd-810c-a6b0c43492aa tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bb:a6:e0,bridge_name='br-int',has_traffic_filtering=True,id=0ffa225c-305b-4bbe-bae5-215270ecc6b1,network=Network(4205f899-9865-4c65-8b46-c9a533e9bb45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ffa225c-30') {{(pid=75045) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 23:40:27 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:40:27 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:40:27 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 23:40:27 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:40:27 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '647f97a4-1dae-51dd-a9c1-c456747167a9', '_type': 'linux-noop'}}, row=False) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:40:27 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:40:27 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:40:27 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:40:27 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0ffa225c-30, may_exist=True, interface_attrs={}) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:40:27 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0ffa225c-30, col_values=(('qos', UUID('794dca45-f07a-44e9-86f3-f1b9b0e776cc')),), if_exists=True) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:40:27 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0ffa225c-30, col_values=(('external_ids', {'iface-id': '0ffa225c-305b-4bbe-bae5-215270ecc6b1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:bb:a6:e0', 'vm-uuid': '899ae4a7-6932-4f43-a87f-a88cb2ce3cb9'}),), if_exists=True) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:40:27 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:40:27 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 23:40:27 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:40:27 user nova-compute[75045]: INFO os_vif [None req-909fa573-22b0-43cd-810c-a6b0c43492aa tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bb:a6:e0,bridge_name='br-int',has_traffic_filtering=True,id=0ffa225c-305b-4bbe-bae5-215270ecc6b1,network=Network(4205f899-9865-4c65-8b46-c9a533e9bb45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ffa225c-30')
Nov 08 23:40:27 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-909fa573-22b0-43cd-810c-a6b0c43492aa tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] No BDM found with device name vda, not building metadata. {{(pid=75045) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 23:40:27 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-909fa573-22b0-43cd-810c-a6b0c43492aa tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] No VIF found with MAC fa:16:3e:bb:a6:e0, not building metadata {{(pid=75045) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 23:40:29 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-9b6ffb89-73e2-4713-9095-b727b0ffec25 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] Acquiring lock "78955913-bbab-4b00-bc9b-12116f249d7e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:40:29 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-9b6ffb89-73e2-4713-9095-b727b0ffec25 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] Lock "78955913-bbab-4b00-bc9b-12116f249d7e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:40:29 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-9b6ffb89-73e2-4713-9095-b727b0ffec25 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] Acquiring lock "78955913-bbab-4b00-bc9b-12116f249d7e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:40:29 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-9b6ffb89-73e2-4713-9095-b727b0ffec25 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] Lock "78955913-bbab-4b00-bc9b-12116f249d7e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:40:29 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-9b6ffb89-73e2-4713-9095-b727b0ffec25 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] Lock "78955913-bbab-4b00-bc9b-12116f249d7e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:40:29 user nova-compute[75045]: INFO nova.compute.manager [None req-9b6ffb89-73e2-4713-9095-b727b0ffec25 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] [instance: 78955913-bbab-4b00-bc9b-12116f249d7e] Terminating instance
Nov 08 23:40:29 user nova-compute[75045]: DEBUG nova.compute.manager [None req-9b6ffb89-73e2-4713-9095-b727b0ffec25 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] [instance: 78955913-bbab-4b00-bc9b-12116f249d7e] Start destroying the instance on the hypervisor. {{(pid=75045) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 23:40:29 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:40:29 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:40:29 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:40:29 user nova-compute[75045]: DEBUG nova.compute.manager [req-0db611a4-ee91-4b42-bff3-424bea5e0e85 req-d018fd06-8f8a-435c-b83a-86b7e5c1c5d4 service nova] [instance: 78955913-bbab-4b00-bc9b-12116f249d7e] Received event network-vif-unplugged-fc66a792-914f-48c4-ae57-cbda1615ff0b {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:40:29 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-0db611a4-ee91-4b42-bff3-424bea5e0e85 req-d018fd06-8f8a-435c-b83a-86b7e5c1c5d4 service nova] Acquiring lock "78955913-bbab-4b00-bc9b-12116f249d7e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:40:29 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-0db611a4-ee91-4b42-bff3-424bea5e0e85 req-d018fd06-8f8a-435c-b83a-86b7e5c1c5d4 service nova] Lock "78955913-bbab-4b00-bc9b-12116f249d7e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:40:29 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-0db611a4-ee91-4b42-bff3-424bea5e0e85 req-d018fd06-8f8a-435c-b83a-86b7e5c1c5d4 service nova] Lock "78955913-bbab-4b00-bc9b-12116f249d7e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:40:29 user nova-compute[75045]: DEBUG nova.compute.manager [req-0db611a4-ee91-4b42-bff3-424bea5e0e85 req-d018fd06-8f8a-435c-b83a-86b7e5c1c5d4 service nova] [instance: 78955913-bbab-4b00-bc9b-12116f249d7e] No waiting events found dispatching network-vif-unplugged-fc66a792-914f-48c4-ae57-cbda1615ff0b {{(pid=75045) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 23:40:29 user nova-compute[75045]: DEBUG nova.compute.manager [req-0db611a4-ee91-4b42-bff3-424bea5e0e85 req-d018fd06-8f8a-435c-b83a-86b7e5c1c5d4 service nova] [instance: 78955913-bbab-4b00-bc9b-12116f249d7e] Received event network-vif-unplugged-fc66a792-914f-48c4-ae57-cbda1615ff0b for instance with task_state deleting. {{(pid=75045) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 23:40:29 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:40:29 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:40:29 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:40:29 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:40:29 user nova-compute[75045]: INFO nova.virt.libvirt.driver [-] [instance: 78955913-bbab-4b00-bc9b-12116f249d7e] Instance destroyed successfully.
Nov 08 23:40:29 user nova-compute[75045]: DEBUG nova.objects.instance [None req-9b6ffb89-73e2-4713-9095-b727b0ffec25 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] Lazy-loading 'resources' on Instance uuid 78955913-bbab-4b00-bc9b-12116f249d7e {{(pid=75045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 23:40:29 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:40:29 user nova-compute[75045]: DEBUG nova.virt.libvirt.vif [None req-9b6ffb89-73e2-4713-9095-b727b0ffec25 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-08T23:33:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1514498655',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1514498655',id=34,image_ref='a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFx298Irz5GXMZkz0H8Ipklwpf+YgHBBRbJWKyrNrzld19ushXoOxyTLKkgNy4UE8867KMerPvCE78DRV+sjIC5+ZqVsJQYtVE98CDOOjfXA2MhCuUN1Cxpvu54Oh9q6/Q==',key_name='tempest-keypair-1615005599',keypairs=<?>,launch_index=0,launched_at=2023-11-08T23:38:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3ad736027d034259a052da3f62bd575f',ramdisk_id='',reservation_id='r-ofqmeskf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1769593098',owner_user_name='tempest-AttachVolumeShelveTestJSON-1769593098-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T23:38:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7a98fe96727741d0b148f3aaa8abf6f1',uuid=78955913-bbab-4b00-bc9b-12116f249d7e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fc66a792-914f-48c4-ae57-cbda1615ff0b", "address": "fa:16:3e:58:00:3d", "network": {"id": "1b10bc53-ef32-4f01-82f6-ed9f95f7e3f2", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-518782773-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.43", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ad736027d034259a052da3f62bd575f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc66a792-91", "ovs_interfaceid": "fc66a792-914f-48c4-ae57-cbda1615ff0b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75045) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 23:40:29 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-9b6ffb89-73e2-4713-9095-b727b0ffec25 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] Converting VIF {"id": "fc66a792-914f-48c4-ae57-cbda1615ff0b", "address": "fa:16:3e:58:00:3d", "network": {"id": "1b10bc53-ef32-4f01-82f6-ed9f95f7e3f2", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-518782773-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.43", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ad736027d034259a052da3f62bd575f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc66a792-91", "ovs_interfaceid": "fc66a792-914f-48c4-ae57-cbda1615ff0b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 23:40:29 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-9b6ffb89-73e2-4713-9095-b727b0ffec25 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:58:00:3d,bridge_name='br-int',has_traffic_filtering=True,id=fc66a792-914f-48c4-ae57-cbda1615ff0b,network=Network(1b10bc53-ef32-4f01-82f6-ed9f95f7e3f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc66a792-91') {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 23:40:29 user nova-compute[75045]: DEBUG os_vif [None req-9b6ffb89-73e2-4713-9095-b727b0ffec25 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:58:00:3d,bridge_name='br-int',has_traffic_filtering=True,id=fc66a792-914f-48c4-ae57-cbda1615ff0b,network=Network(1b10bc53-ef32-4f01-82f6-ed9f95f7e3f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc66a792-91') {{(pid=75045) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 23:40:29 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:40:29 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfc66a792-91, bridge=br-int, if_exists=True) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:40:29 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:40:29 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 23:40:29 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:40:29 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:40:29 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:40:29 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:40:29 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=03025d86-8415-45c6-8695-652dd16cdfe6) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:40:29 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:40:29 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 23:40:29 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:40:29 user nova-compute[75045]: INFO os_vif [None req-9b6ffb89-73e2-4713-9095-b727b0ffec25 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:58:00:3d,bridge_name='br-int',has_traffic_filtering=True,id=fc66a792-914f-48c4-ae57-cbda1615ff0b,network=Network(1b10bc53-ef32-4f01-82f6-ed9f95f7e3f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc66a792-91')
Nov 08 23:40:29 user nova-compute[75045]: INFO nova.virt.libvirt.driver [None req-9b6ffb89-73e2-4713-9095-b727b0ffec25 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] [instance: 78955913-bbab-4b00-bc9b-12116f249d7e] Deleting instance files /opt/stack/data/nova/instances/78955913-bbab-4b00-bc9b-12116f249d7e_del
Nov 08 23:40:29 user nova-compute[75045]: INFO nova.virt.libvirt.driver [None req-9b6ffb89-73e2-4713-9095-b727b0ffec25 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] [instance: 78955913-bbab-4b00-bc9b-12116f249d7e] Deletion of /opt/stack/data/nova/instances/78955913-bbab-4b00-bc9b-12116f249d7e_del complete
Nov 08 23:40:30 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:40:30 user nova-compute[75045]: INFO nova.compute.manager [None req-9b6ffb89-73e2-4713-9095-b727b0ffec25 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] [instance: 78955913-bbab-4b00-bc9b-12116f249d7e] Took 0.95 seconds to destroy the instance on the hypervisor.
Nov 08 23:40:30 user nova-compute[75045]: DEBUG oslo.service.loopingcall [None req-9b6ffb89-73e2-4713-9095-b727b0ffec25 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75045) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 23:40:30 user nova-compute[75045]: DEBUG nova.compute.manager [-] [instance: 78955913-bbab-4b00-bc9b-12116f249d7e] Deallocating network for instance {{(pid=75045) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 23:40:30 user nova-compute[75045]: DEBUG nova.network.neutron [-] [instance: 78955913-bbab-4b00-bc9b-12116f249d7e] deallocate_for_instance() {{(pid=75045) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 23:40:30 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:40:30 user nova-compute[75045]: DEBUG nova.network.neutron [-] [instance: 78955913-bbab-4b00-bc9b-12116f249d7e] Updating instance_info_cache with network_info: [] {{(pid=75045) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 23:40:30 user nova-compute[75045]: DEBUG nova.compute.manager [req-73d3189d-386f-4915-96b3-813c9b0cac4b req-c38ed09f-0d49-4ed5-b043-98cbad7a8644 service nova] [instance: 78955913-bbab-4b00-bc9b-12116f249d7e] Received event network-vif-deleted-fc66a792-914f-48c4-ae57-cbda1615ff0b {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:40:30 user nova-compute[75045]: INFO nova.compute.manager [req-73d3189d-386f-4915-96b3-813c9b0cac4b req-c38ed09f-0d49-4ed5-b043-98cbad7a8644 service nova] [instance: 78955913-bbab-4b00-bc9b-12116f249d7e] Neutron deleted interface fc66a792-914f-48c4-ae57-cbda1615ff0b; detaching it from the instance and deleting it from the info cache
Nov 08 23:40:30 user nova-compute[75045]: DEBUG nova.network.neutron [req-73d3189d-386f-4915-96b3-813c9b0cac4b req-c38ed09f-0d49-4ed5-b043-98cbad7a8644 service nova] [instance: 78955913-bbab-4b00-bc9b-12116f249d7e] Updating instance_info_cache with network_info: [] {{(pid=75045) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 23:40:30 user nova-compute[75045]: INFO nova.compute.manager [-] [instance: 78955913-bbab-4b00-bc9b-12116f249d7e] Took 0.78 seconds to deallocate network for instance.
Nov 08 23:40:30 user nova-compute[75045]: DEBUG nova.compute.manager [req-73d3189d-386f-4915-96b3-813c9b0cac4b req-c38ed09f-0d49-4ed5-b043-98cbad7a8644 service nova] [instance: 78955913-bbab-4b00-bc9b-12116f249d7e] Detach interface failed, port_id=fc66a792-914f-48c4-ae57-cbda1615ff0b, reason: Instance 78955913-bbab-4b00-bc9b-12116f249d7e could not be found. {{(pid=75045) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 08 23:40:30 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-9b6ffb89-73e2-4713-9095-b727b0ffec25 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:40:30 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-9b6ffb89-73e2-4713-9095-b727b0ffec25 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:40:31 user nova-compute[75045]: DEBUG nova.compute.provider_tree [None req-9b6ffb89-73e2-4713-9095-b727b0ffec25 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] Inventory has not changed in ProviderTree for provider: 62ba5f85-c74d-4b58-986e-d4197e813fd7 {{(pid=75045) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 23:40:31 user nova-compute[75045]: DEBUG nova.scheduler.client.report [None req-9b6ffb89-73e2-4713-9095-b727b0ffec25 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] Inventory has not changed for provider 62ba5f85-c74d-4b58-986e-d4197e813fd7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75045) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 23:40:31 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-9b6ffb89-73e2-4713-9095-b727b0ffec25 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.256s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:40:31 user nova-compute[75045]: INFO nova.scheduler.client.report [None req-9b6ffb89-73e2-4713-9095-b727b0ffec25 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] Deleted allocations for instance 78955913-bbab-4b00-bc9b-12116f249d7e
Nov 08 23:40:31 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-9b6ffb89-73e2-4713-9095-b727b0ffec25 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] Lock "78955913-bbab-4b00-bc9b-12116f249d7e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.176s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:40:31 user nova-compute[75045]: DEBUG nova.compute.manager [req-87014974-d09a-485d-9bb1-cc6da45f926e req-f7248606-9dcb-4ce3-9f08-e779e979596e service nova] [instance: 78955913-bbab-4b00-bc9b-12116f249d7e] Received event network-vif-plugged-fc66a792-914f-48c4-ae57-cbda1615ff0b {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:40:31 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-87014974-d09a-485d-9bb1-cc6da45f926e req-f7248606-9dcb-4ce3-9f08-e779e979596e service nova] Acquiring lock "78955913-bbab-4b00-bc9b-12116f249d7e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:40:31 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-87014974-d09a-485d-9bb1-cc6da45f926e req-f7248606-9dcb-4ce3-9f08-e779e979596e service nova] Lock "78955913-bbab-4b00-bc9b-12116f249d7e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:40:31 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-87014974-d09a-485d-9bb1-cc6da45f926e req-f7248606-9dcb-4ce3-9f08-e779e979596e service nova] Lock "78955913-bbab-4b00-bc9b-12116f249d7e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:40:31 user nova-compute[75045]: DEBUG nova.compute.manager [req-87014974-d09a-485d-9bb1-cc6da45f926e req-f7248606-9dcb-4ce3-9f08-e779e979596e service nova] [instance: 78955913-bbab-4b00-bc9b-12116f249d7e] No waiting events found dispatching network-vif-plugged-fc66a792-914f-48c4-ae57-cbda1615ff0b {{(pid=75045) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 23:40:31 user nova-compute[75045]: WARNING nova.compute.manager [req-87014974-d09a-485d-9bb1-cc6da45f926e req-f7248606-9dcb-4ce3-9f08-e779e979596e service nova] [instance: 78955913-bbab-4b00-bc9b-12116f249d7e] Received unexpected event network-vif-plugged-fc66a792-914f-48c4-ae57-cbda1615ff0b for instance with vm_state deleted and task_state None.
Nov 08 23:40:31 user nova-compute[75045]: DEBUG nova.compute.manager [req-87014974-d09a-485d-9bb1-cc6da45f926e req-f7248606-9dcb-4ce3-9f08-e779e979596e service nova] [instance: 899ae4a7-6932-4f43-a87f-a88cb2ce3cb9] Received event network-vif-plugged-0ffa225c-305b-4bbe-bae5-215270ecc6b1 {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:40:31 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-87014974-d09a-485d-9bb1-cc6da45f926e req-f7248606-9dcb-4ce3-9f08-e779e979596e service nova] Acquiring lock "899ae4a7-6932-4f43-a87f-a88cb2ce3cb9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:40:31 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-87014974-d09a-485d-9bb1-cc6da45f926e req-f7248606-9dcb-4ce3-9f08-e779e979596e service nova] Lock "899ae4a7-6932-4f43-a87f-a88cb2ce3cb9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:40:31 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-87014974-d09a-485d-9bb1-cc6da45f926e req-f7248606-9dcb-4ce3-9f08-e779e979596e service nova] Lock "899ae4a7-6932-4f43-a87f-a88cb2ce3cb9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:40:31 user nova-compute[75045]: DEBUG nova.compute.manager [req-87014974-d09a-485d-9bb1-cc6da45f926e req-f7248606-9dcb-4ce3-9f08-e779e979596e service nova] [instance: 899ae4a7-6932-4f43-a87f-a88cb2ce3cb9] No waiting events found dispatching network-vif-plugged-0ffa225c-305b-4bbe-bae5-215270ecc6b1 {{(pid=75045) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 23:40:31 user nova-compute[75045]: WARNING nova.compute.manager [req-87014974-d09a-485d-9bb1-cc6da45f926e req-f7248606-9dcb-4ce3-9f08-e779e979596e service nova] [instance: 899ae4a7-6932-4f43-a87f-a88cb2ce3cb9] Received unexpected event network-vif-plugged-0ffa225c-305b-4bbe-bae5-215270ecc6b1 for instance with vm_state building and task_state spawning.
Nov 08 23:40:31 user nova-compute[75045]: DEBUG nova.compute.manager [req-87014974-d09a-485d-9bb1-cc6da45f926e req-f7248606-9dcb-4ce3-9f08-e779e979596e service nova] [instance: 899ae4a7-6932-4f43-a87f-a88cb2ce3cb9] Received event network-vif-plugged-0ffa225c-305b-4bbe-bae5-215270ecc6b1 {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:40:31 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-87014974-d09a-485d-9bb1-cc6da45f926e req-f7248606-9dcb-4ce3-9f08-e779e979596e service nova] Acquiring lock "899ae4a7-6932-4f43-a87f-a88cb2ce3cb9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:40:31 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-87014974-d09a-485d-9bb1-cc6da45f926e req-f7248606-9dcb-4ce3-9f08-e779e979596e service nova] Lock "899ae4a7-6932-4f43-a87f-a88cb2ce3cb9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:40:31 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-87014974-d09a-485d-9bb1-cc6da45f926e req-f7248606-9dcb-4ce3-9f08-e779e979596e service nova] Lock "899ae4a7-6932-4f43-a87f-a88cb2ce3cb9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:40:31 user nova-compute[75045]: DEBUG nova.compute.manager [req-87014974-d09a-485d-9bb1-cc6da45f926e req-f7248606-9dcb-4ce3-9f08-e779e979596e service nova] [instance: 899ae4a7-6932-4f43-a87f-a88cb2ce3cb9] No waiting events found dispatching network-vif-plugged-0ffa225c-305b-4bbe-bae5-215270ecc6b1 {{(pid=75045) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 23:40:31 user nova-compute[75045]: WARNING nova.compute.manager [req-87014974-d09a-485d-9bb1-cc6da45f926e req-f7248606-9dcb-4ce3-9f08-e779e979596e service nova] [instance: 899ae4a7-6932-4f43-a87f-a88cb2ce3cb9] Received unexpected event network-vif-plugged-0ffa225c-305b-4bbe-bae5-215270ecc6b1 for instance with vm_state building and task_state spawning.
Nov 08 23:40:31 user nova-compute[75045]: DEBUG nova.compute.manager [req-87014974-d09a-485d-9bb1-cc6da45f926e req-f7248606-9dcb-4ce3-9f08-e779e979596e service nova] [instance: 78955913-bbab-4b00-bc9b-12116f249d7e] Received event network-vif-plugged-fc66a792-914f-48c4-ae57-cbda1615ff0b {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:40:31 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-87014974-d09a-485d-9bb1-cc6da45f926e req-f7248606-9dcb-4ce3-9f08-e779e979596e service nova] Acquiring lock "78955913-bbab-4b00-bc9b-12116f249d7e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:40:31 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-87014974-d09a-485d-9bb1-cc6da45f926e req-f7248606-9dcb-4ce3-9f08-e779e979596e service nova] Lock "78955913-bbab-4b00-bc9b-12116f249d7e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:40:31 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-87014974-d09a-485d-9bb1-cc6da45f926e req-f7248606-9dcb-4ce3-9f08-e779e979596e service nova] Lock "78955913-bbab-4b00-bc9b-12116f249d7e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:40:31 user nova-compute[75045]: DEBUG nova.compute.manager [req-87014974-d09a-485d-9bb1-cc6da45f926e req-f7248606-9dcb-4ce3-9f08-e779e979596e service nova] [instance: 78955913-bbab-4b00-bc9b-12116f249d7e] No waiting events found dispatching network-vif-plugged-fc66a792-914f-48c4-ae57-cbda1615ff0b {{(pid=75045) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 23:40:31 user nova-compute[75045]: WARNING nova.compute.manager [req-87014974-d09a-485d-9bb1-cc6da45f926e req-f7248606-9dcb-4ce3-9f08-e779e979596e service nova] [instance: 78955913-bbab-4b00-bc9b-12116f249d7e] Received unexpected event network-vif-plugged-fc66a792-914f-48c4-ae57-cbda1615ff0b for instance with vm_state deleted and task_state None.
Nov 08 23:40:31 user nova-compute[75045]: DEBUG nova.compute.manager [req-87014974-d09a-485d-9bb1-cc6da45f926e req-f7248606-9dcb-4ce3-9f08-e779e979596e service nova] [instance: 78955913-bbab-4b00-bc9b-12116f249d7e] Received event network-vif-plugged-fc66a792-914f-48c4-ae57-cbda1615ff0b {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:40:31 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-87014974-d09a-485d-9bb1-cc6da45f926e req-f7248606-9dcb-4ce3-9f08-e779e979596e service nova] Acquiring lock "78955913-bbab-4b00-bc9b-12116f249d7e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:40:31 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-87014974-d09a-485d-9bb1-cc6da45f926e req-f7248606-9dcb-4ce3-9f08-e779e979596e service nova] Lock "78955913-bbab-4b00-bc9b-12116f249d7e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:40:31 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-87014974-d09a-485d-9bb1-cc6da45f926e req-f7248606-9dcb-4ce3-9f08-e779e979596e service nova] Lock "78955913-bbab-4b00-bc9b-12116f249d7e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:40:31 user nova-compute[75045]: DEBUG nova.compute.manager [req-87014974-d09a-485d-9bb1-cc6da45f926e req-f7248606-9dcb-4ce3-9f08-e779e979596e service nova] [instance: 78955913-bbab-4b00-bc9b-12116f249d7e] No waiting events found dispatching network-vif-plugged-fc66a792-914f-48c4-ae57-cbda1615ff0b {{(pid=75045) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 23:40:31 user nova-compute[75045]: WARNING nova.compute.manager [req-87014974-d09a-485d-9bb1-cc6da45f926e req-f7248606-9dcb-4ce3-9f08-e779e979596e service nova] [instance: 78955913-bbab-4b00-bc9b-12116f249d7e] Received unexpected event network-vif-plugged-fc66a792-914f-48c4-ae57-cbda1615ff0b for instance with vm_state deleted and task_state None.
Nov 08 23:40:31 user nova-compute[75045]: DEBUG nova.compute.manager [req-87014974-d09a-485d-9bb1-cc6da45f926e req-f7248606-9dcb-4ce3-9f08-e779e979596e service nova] [instance: 78955913-bbab-4b00-bc9b-12116f249d7e] Received event network-vif-unplugged-fc66a792-914f-48c4-ae57-cbda1615ff0b {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:40:31 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-87014974-d09a-485d-9bb1-cc6da45f926e req-f7248606-9dcb-4ce3-9f08-e779e979596e service nova] Acquiring lock "78955913-bbab-4b00-bc9b-12116f249d7e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:40:31 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-87014974-d09a-485d-9bb1-cc6da45f926e req-f7248606-9dcb-4ce3-9f08-e779e979596e service nova] Lock "78955913-bbab-4b00-bc9b-12116f249d7e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:40:31 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-87014974-d09a-485d-9bb1-cc6da45f926e req-f7248606-9dcb-4ce3-9f08-e779e979596e service nova] Lock "78955913-bbab-4b00-bc9b-12116f249d7e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:40:31 user nova-compute[75045]: DEBUG nova.compute.manager [req-87014974-d09a-485d-9bb1-cc6da45f926e req-f7248606-9dcb-4ce3-9f08-e779e979596e service nova] [instance: 78955913-bbab-4b00-bc9b-12116f249d7e] No waiting events found dispatching network-vif-unplugged-fc66a792-914f-48c4-ae57-cbda1615ff0b {{(pid=75045) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 23:40:31 user nova-compute[75045]: WARNING nova.compute.manager [req-87014974-d09a-485d-9bb1-cc6da45f926e req-f7248606-9dcb-4ce3-9f08-e779e979596e service nova] [instance: 78955913-bbab-4b00-bc9b-12116f249d7e] Received unexpected event network-vif-unplugged-fc66a792-914f-48c4-ae57-cbda1615ff0b for instance with vm_state deleted and task_state None.
Nov 08 23:40:31 user nova-compute[75045]: DEBUG nova.compute.manager [req-87014974-d09a-485d-9bb1-cc6da45f926e req-f7248606-9dcb-4ce3-9f08-e779e979596e service nova] [instance: 78955913-bbab-4b00-bc9b-12116f249d7e] Received event network-vif-plugged-fc66a792-914f-48c4-ae57-cbda1615ff0b {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:40:31 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-87014974-d09a-485d-9bb1-cc6da45f926e req-f7248606-9dcb-4ce3-9f08-e779e979596e service nova] Acquiring lock "78955913-bbab-4b00-bc9b-12116f249d7e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:40:31 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-87014974-d09a-485d-9bb1-cc6da45f926e req-f7248606-9dcb-4ce3-9f08-e779e979596e service nova] Lock "78955913-bbab-4b00-bc9b-12116f249d7e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:40:31 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-87014974-d09a-485d-9bb1-cc6da45f926e req-f7248606-9dcb-4ce3-9f08-e779e979596e service nova] Lock "78955913-bbab-4b00-bc9b-12116f249d7e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:40:31 user nova-compute[75045]: DEBUG nova.compute.manager [req-87014974-d09a-485d-9bb1-cc6da45f926e req-f7248606-9dcb-4ce3-9f08-e779e979596e service nova] [instance: 78955913-bbab-4b00-bc9b-12116f249d7e] No waiting events found dispatching network-vif-plugged-fc66a792-914f-48c4-ae57-cbda1615ff0b {{(pid=75045) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 23:40:31 user nova-compute[75045]: WARNING nova.compute.manager [req-87014974-d09a-485d-9bb1-cc6da45f926e req-f7248606-9dcb-4ce3-9f08-e779e979596e service nova] [instance: 78955913-bbab-4b00-bc9b-12116f249d7e] Received unexpected event network-vif-plugged-fc66a792-914f-48c4-ae57-cbda1615ff0b for instance with vm_state deleted and task_state None.
Nov 08 23:40:31 user nova-compute[75045]: DEBUG nova.compute.manager [None req-909fa573-22b0-43cd-810c-a6b0c43492aa tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] [instance: 899ae4a7-6932-4f43-a87f-a88cb2ce3cb9] Instance event wait completed in 0 seconds for  {{(pid=75045) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 23:40:31 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-909fa573-22b0-43cd-810c-a6b0c43492aa tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] [instance: 899ae4a7-6932-4f43-a87f-a88cb2ce3cb9] Guest created on hypervisor {{(pid=75045) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 23:40:31 user nova-compute[75045]: INFO nova.virt.libvirt.driver [-] [instance: 899ae4a7-6932-4f43-a87f-a88cb2ce3cb9] Instance spawned successfully.
Nov 08 23:40:31 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-909fa573-22b0-43cd-810c-a6b0c43492aa tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] [instance: 899ae4a7-6932-4f43-a87f-a88cb2ce3cb9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75045) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 23:40:31 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-909fa573-22b0-43cd-810c-a6b0c43492aa tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] [instance: 899ae4a7-6932-4f43-a87f-a88cb2ce3cb9] Found default for hw_cdrom_bus of ide {{(pid=75045) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 23:40:31 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-909fa573-22b0-43cd-810c-a6b0c43492aa tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] [instance: 899ae4a7-6932-4f43-a87f-a88cb2ce3cb9] Found default for hw_disk_bus of virtio {{(pid=75045) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 23:40:31 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-909fa573-22b0-43cd-810c-a6b0c43492aa tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] [instance: 899ae4a7-6932-4f43-a87f-a88cb2ce3cb9] Found default for hw_input_bus of None {{(pid=75045) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 23:40:31 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-909fa573-22b0-43cd-810c-a6b0c43492aa tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] [instance: 899ae4a7-6932-4f43-a87f-a88cb2ce3cb9] Found default for hw_pointer_model of None {{(pid=75045) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 23:40:31 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-909fa573-22b0-43cd-810c-a6b0c43492aa tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] [instance: 899ae4a7-6932-4f43-a87f-a88cb2ce3cb9] Found default for hw_video_model of virtio {{(pid=75045) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 23:40:31 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-909fa573-22b0-43cd-810c-a6b0c43492aa tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] [instance: 899ae4a7-6932-4f43-a87f-a88cb2ce3cb9] Found default for hw_vif_model of virtio {{(pid=75045) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 23:40:31 user nova-compute[75045]: INFO nova.compute.manager [None req-909fa573-22b0-43cd-810c-a6b0c43492aa tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] [instance: 899ae4a7-6932-4f43-a87f-a88cb2ce3cb9] Took 5.23 seconds to spawn the instance on the hypervisor.
Nov 08 23:40:31 user nova-compute[75045]: DEBUG nova.compute.manager [None req-909fa573-22b0-43cd-810c-a6b0c43492aa tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] [instance: 899ae4a7-6932-4f43-a87f-a88cb2ce3cb9] Checking state {{(pid=75045) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 23:40:31 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:40:31 user nova-compute[75045]: INFO nova.compute.manager [None req-909fa573-22b0-43cd-810c-a6b0c43492aa tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] [instance: 899ae4a7-6932-4f43-a87f-a88cb2ce3cb9] Took 35.21 seconds to build instance.
Nov 08 23:40:31 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-909fa573-22b0-43cd-810c-a6b0c43492aa tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Lock "899ae4a7-6932-4f43-a87f-a88cb2ce3cb9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 35.383s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:40:34 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:40:39 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:40:39 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-a7262fd9-3017-480e-9dde-9fe1fd64f247 tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] Acquiring lock "b5fc7f02-2143-4bcf-92ac-078d5ec10747" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:40:39 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-a7262fd9-3017-480e-9dde-9fe1fd64f247 tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] Lock "b5fc7f02-2143-4bcf-92ac-078d5ec10747" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:40:39 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-a7262fd9-3017-480e-9dde-9fe1fd64f247 tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] Acquiring lock "b5fc7f02-2143-4bcf-92ac-078d5ec10747-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:40:39 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-a7262fd9-3017-480e-9dde-9fe1fd64f247 tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] Lock "b5fc7f02-2143-4bcf-92ac-078d5ec10747-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:40:39 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-a7262fd9-3017-480e-9dde-9fe1fd64f247 tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] Lock "b5fc7f02-2143-4bcf-92ac-078d5ec10747-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:40:39 user nova-compute[75045]: INFO nova.compute.manager [None req-a7262fd9-3017-480e-9dde-9fe1fd64f247 tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] [instance: b5fc7f02-2143-4bcf-92ac-078d5ec10747] Terminating instance
Nov 08 23:40:39 user nova-compute[75045]: DEBUG nova.compute.manager [None req-a7262fd9-3017-480e-9dde-9fe1fd64f247 tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] [instance: b5fc7f02-2143-4bcf-92ac-078d5ec10747] Start destroying the instance on the hypervisor. {{(pid=75045) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 23:40:40 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:40:40 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:40:40 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:40:40 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:40:40 user nova-compute[75045]: DEBUG nova.compute.manager [req-b9511ea9-5da4-4938-b308-e567087b3ff3 req-17c256cb-9cbb-4c42-9c2e-08f47ff977eb service nova] [instance: b5fc7f02-2143-4bcf-92ac-078d5ec10747] Received event network-vif-unplugged-cde7cd95-3b8b-4980-8abc-be5c221a40ff {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:40:40 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-b9511ea9-5da4-4938-b308-e567087b3ff3 req-17c256cb-9cbb-4c42-9c2e-08f47ff977eb service nova] Acquiring lock "b5fc7f02-2143-4bcf-92ac-078d5ec10747-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:40:40 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-b9511ea9-5da4-4938-b308-e567087b3ff3 req-17c256cb-9cbb-4c42-9c2e-08f47ff977eb service nova] Lock "b5fc7f02-2143-4bcf-92ac-078d5ec10747-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:40:40 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-b9511ea9-5da4-4938-b308-e567087b3ff3 req-17c256cb-9cbb-4c42-9c2e-08f47ff977eb service nova] Lock "b5fc7f02-2143-4bcf-92ac-078d5ec10747-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:40:40 user nova-compute[75045]: DEBUG nova.compute.manager [req-b9511ea9-5da4-4938-b308-e567087b3ff3 req-17c256cb-9cbb-4c42-9c2e-08f47ff977eb service nova] [instance: b5fc7f02-2143-4bcf-92ac-078d5ec10747] No waiting events found dispatching network-vif-unplugged-cde7cd95-3b8b-4980-8abc-be5c221a40ff {{(pid=75045) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 23:40:40 user nova-compute[75045]: DEBUG nova.compute.manager [req-b9511ea9-5da4-4938-b308-e567087b3ff3 req-17c256cb-9cbb-4c42-9c2e-08f47ff977eb service nova] [instance: b5fc7f02-2143-4bcf-92ac-078d5ec10747] Received event network-vif-unplugged-cde7cd95-3b8b-4980-8abc-be5c221a40ff for instance with task_state deleting. {{(pid=75045) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 23:40:40 user nova-compute[75045]: INFO nova.virt.libvirt.driver [-] [instance: b5fc7f02-2143-4bcf-92ac-078d5ec10747] Instance destroyed successfully.
Nov 08 23:40:40 user nova-compute[75045]: DEBUG nova.objects.instance [None req-a7262fd9-3017-480e-9dde-9fe1fd64f247 tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] Lazy-loading 'resources' on Instance uuid b5fc7f02-2143-4bcf-92ac-078d5ec10747 {{(pid=75045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 23:40:40 user nova-compute[75045]: DEBUG nova.virt.libvirt.vif [None req-a7262fd9-3017-480e-9dde-9fe1fd64f247 tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T23:22:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1199401266',display_name='tempest-ServerRescueNegativeTestJSON-server-1199401266',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1199401266',id=19,image_ref='a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-08T23:27:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bbb640407ef94f568aea892f1834d6d1',ramdisk_id='',reservation_id='r-h0qi02cc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-187452128',owner_user_name='tempest-ServerRescueNegativeTestJSON-187452128-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T23:29:28Z,user_data=None,user_id='f16e465ffb49488db3de445a473fd77a',uuid=b5fc7f02-2143-4bcf-92ac-078d5ec10747,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cde7cd95-3b8b-4980-8abc-be5c221a40ff", "address": "fa:16:3e:2d:09:a7", "network": {"id": "08d1669a-f667-4c79-8e49-0ad183f57046", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1863648032-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bbb640407ef94f568aea892f1834d6d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcde7cd95-3b", "ovs_interfaceid": "cde7cd95-3b8b-4980-8abc-be5c221a40ff", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75045) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 23:40:40 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-a7262fd9-3017-480e-9dde-9fe1fd64f247 tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] Converting VIF {"id": "cde7cd95-3b8b-4980-8abc-be5c221a40ff", "address": "fa:16:3e:2d:09:a7", "network": {"id": "08d1669a-f667-4c79-8e49-0ad183f57046", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1863648032-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bbb640407ef94f568aea892f1834d6d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcde7cd95-3b", "ovs_interfaceid": "cde7cd95-3b8b-4980-8abc-be5c221a40ff", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 23:40:40 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-a7262fd9-3017-480e-9dde-9fe1fd64f247 tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2d:09:a7,bridge_name='br-int',has_traffic_filtering=True,id=cde7cd95-3b8b-4980-8abc-be5c221a40ff,network=Network(08d1669a-f667-4c79-8e49-0ad183f57046),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcde7cd95-3b') {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 23:40:40 user nova-compute[75045]: DEBUG os_vif [None req-a7262fd9-3017-480e-9dde-9fe1fd64f247 tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:2d:09:a7,bridge_name='br-int',has_traffic_filtering=True,id=cde7cd95-3b8b-4980-8abc-be5c221a40ff,network=Network(08d1669a-f667-4c79-8e49-0ad183f57046),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcde7cd95-3b') {{(pid=75045) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 23:40:40 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:40:40 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapcde7cd95-3b, bridge=br-int, if_exists=True) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:40:40 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:40:40 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 23:40:40 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:40:40 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d06cfe41-7432-4e6f-ae2a-16511360a1ea) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:40:40 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:40:40 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:40:40 user nova-compute[75045]: INFO os_vif [None req-a7262fd9-3017-480e-9dde-9fe1fd64f247 tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:2d:09:a7,bridge_name='br-int',has_traffic_filtering=True,id=cde7cd95-3b8b-4980-8abc-be5c221a40ff,network=Network(08d1669a-f667-4c79-8e49-0ad183f57046),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcde7cd95-3b')
Nov 08 23:40:40 user nova-compute[75045]: INFO nova.virt.libvirt.driver [None req-a7262fd9-3017-480e-9dde-9fe1fd64f247 tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] [instance: b5fc7f02-2143-4bcf-92ac-078d5ec10747] Deleting instance files /opt/stack/data/nova/instances/b5fc7f02-2143-4bcf-92ac-078d5ec10747_del
Nov 08 23:40:40 user nova-compute[75045]: INFO nova.virt.libvirt.driver [None req-a7262fd9-3017-480e-9dde-9fe1fd64f247 tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] [instance: b5fc7f02-2143-4bcf-92ac-078d5ec10747] Deletion of /opt/stack/data/nova/instances/b5fc7f02-2143-4bcf-92ac-078d5ec10747_del complete
Nov 08 23:40:40 user nova-compute[75045]: INFO nova.compute.manager [None req-a7262fd9-3017-480e-9dde-9fe1fd64f247 tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] [instance: b5fc7f02-2143-4bcf-92ac-078d5ec10747] Took 0.68 seconds to destroy the instance on the hypervisor.
Nov 08 23:40:40 user nova-compute[75045]: DEBUG oslo.service.loopingcall [None req-a7262fd9-3017-480e-9dde-9fe1fd64f247 tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75045) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 23:40:40 user nova-compute[75045]: DEBUG nova.compute.manager [-] [instance: b5fc7f02-2143-4bcf-92ac-078d5ec10747] Deallocating network for instance {{(pid=75045) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 23:40:40 user nova-compute[75045]: DEBUG nova.network.neutron [-] [instance: b5fc7f02-2143-4bcf-92ac-078d5ec10747] deallocate_for_instance() {{(pid=75045) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 23:40:41 user nova-compute[75045]: DEBUG nova.network.neutron [-] [instance: b5fc7f02-2143-4bcf-92ac-078d5ec10747] Updating instance_info_cache with network_info: [] {{(pid=75045) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 23:40:41 user nova-compute[75045]: INFO nova.compute.manager [-] [instance: b5fc7f02-2143-4bcf-92ac-078d5ec10747] Took 0.58 seconds to deallocate network for instance.
Nov 08 23:40:41 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-a7262fd9-3017-480e-9dde-9fe1fd64f247 tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:40:41 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-a7262fd9-3017-480e-9dde-9fe1fd64f247 tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:40:41 user nova-compute[75045]: DEBUG nova.compute.provider_tree [None req-a7262fd9-3017-480e-9dde-9fe1fd64f247 tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] Inventory has not changed in ProviderTree for provider: 62ba5f85-c74d-4b58-986e-d4197e813fd7 {{(pid=75045) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 23:40:41 user nova-compute[75045]: DEBUG nova.scheduler.client.report [None req-a7262fd9-3017-480e-9dde-9fe1fd64f247 tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] Inventory has not changed for provider 62ba5f85-c74d-4b58-986e-d4197e813fd7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75045) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 23:40:41 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-a7262fd9-3017-480e-9dde-9fe1fd64f247 tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.233s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:40:41 user nova-compute[75045]: INFO nova.scheduler.client.report [None req-a7262fd9-3017-480e-9dde-9fe1fd64f247 tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] Deleted allocations for instance b5fc7f02-2143-4bcf-92ac-078d5ec10747
Nov 08 23:40:41 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-a7262fd9-3017-480e-9dde-9fe1fd64f247 tempest-ServerRescueNegativeTestJSON-187452128 tempest-ServerRescueNegativeTestJSON-187452128-project-member] Lock "b5fc7f02-2143-4bcf-92ac-078d5ec10747" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.699s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:40:42 user nova-compute[75045]: DEBUG nova.compute.manager [req-a13582d1-2b6b-4029-8864-a6486895d39c req-782fc451-07a0-48af-9c6c-3f9c9430bbce service nova] [instance: b5fc7f02-2143-4bcf-92ac-078d5ec10747] Received event network-vif-plugged-cde7cd95-3b8b-4980-8abc-be5c221a40ff {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:40:42 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-a13582d1-2b6b-4029-8864-a6486895d39c req-782fc451-07a0-48af-9c6c-3f9c9430bbce service nova] Acquiring lock "b5fc7f02-2143-4bcf-92ac-078d5ec10747-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:40:42 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-a13582d1-2b6b-4029-8864-a6486895d39c req-782fc451-07a0-48af-9c6c-3f9c9430bbce service nova] Lock "b5fc7f02-2143-4bcf-92ac-078d5ec10747-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:40:42 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-a13582d1-2b6b-4029-8864-a6486895d39c req-782fc451-07a0-48af-9c6c-3f9c9430bbce service nova] Lock "b5fc7f02-2143-4bcf-92ac-078d5ec10747-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:40:42 user nova-compute[75045]: DEBUG nova.compute.manager [req-a13582d1-2b6b-4029-8864-a6486895d39c req-782fc451-07a0-48af-9c6c-3f9c9430bbce service nova] [instance: b5fc7f02-2143-4bcf-92ac-078d5ec10747] No waiting events found dispatching network-vif-plugged-cde7cd95-3b8b-4980-8abc-be5c221a40ff {{(pid=75045) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 23:40:42 user nova-compute[75045]: WARNING nova.compute.manager [req-a13582d1-2b6b-4029-8864-a6486895d39c req-782fc451-07a0-48af-9c6c-3f9c9430bbce service nova] [instance: b5fc7f02-2143-4bcf-92ac-078d5ec10747] Received unexpected event network-vif-plugged-cde7cd95-3b8b-4980-8abc-be5c221a40ff for instance with vm_state deleted and task_state None.
Nov 08 23:40:42 user nova-compute[75045]: DEBUG nova.compute.manager [req-a13582d1-2b6b-4029-8864-a6486895d39c req-782fc451-07a0-48af-9c6c-3f9c9430bbce service nova] [instance: b5fc7f02-2143-4bcf-92ac-078d5ec10747] Received event network-vif-deleted-cde7cd95-3b8b-4980-8abc-be5c221a40ff {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:40:45 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:40:46 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:40:49 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-a871793f-a2e1-49c6-b85e-1c873ddb616b tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] Acquiring lock "18c197c4-3000-41b1-83bc-1a781744d539" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:40:49 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-a871793f-a2e1-49c6-b85e-1c873ddb616b tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] Lock "18c197c4-3000-41b1-83bc-1a781744d539" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:40:49 user nova-compute[75045]: DEBUG nova.compute.manager [None req-a871793f-a2e1-49c6-b85e-1c873ddb616b tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] [instance: 18c197c4-3000-41b1-83bc-1a781744d539] Starting instance... {{(pid=75045) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 23:40:49 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-a871793f-a2e1-49c6-b85e-1c873ddb616b tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:40:49 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-a871793f-a2e1-49c6-b85e-1c873ddb616b tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:40:49 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-a871793f-a2e1-49c6-b85e-1c873ddb616b tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75045) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 23:40:49 user nova-compute[75045]: INFO nova.compute.claims [None req-a871793f-a2e1-49c6-b85e-1c873ddb616b tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] [instance: 18c197c4-3000-41b1-83bc-1a781744d539] Claim successful on node user
Nov 08 23:40:49 user nova-compute[75045]: DEBUG nova.compute.provider_tree [None req-a871793f-a2e1-49c6-b85e-1c873ddb616b tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] Inventory has not changed in ProviderTree for provider: 62ba5f85-c74d-4b58-986e-d4197e813fd7 {{(pid=75045) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 23:40:49 user nova-compute[75045]: DEBUG nova.scheduler.client.report [None req-a871793f-a2e1-49c6-b85e-1c873ddb616b tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] Inventory has not changed for provider 62ba5f85-c74d-4b58-986e-d4197e813fd7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75045) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 23:40:49 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-a871793f-a2e1-49c6-b85e-1c873ddb616b tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.288s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:40:49 user nova-compute[75045]: DEBUG nova.compute.manager [None req-a871793f-a2e1-49c6-b85e-1c873ddb616b tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] [instance: 18c197c4-3000-41b1-83bc-1a781744d539] Start building networks asynchronously for instance. {{(pid=75045) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 23:40:49 user nova-compute[75045]: DEBUG nova.compute.manager [None req-a871793f-a2e1-49c6-b85e-1c873ddb616b tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] [instance: 18c197c4-3000-41b1-83bc-1a781744d539] Allocating IP information in the background. {{(pid=75045) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 23:40:49 user nova-compute[75045]: DEBUG nova.network.neutron [None req-a871793f-a2e1-49c6-b85e-1c873ddb616b tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] [instance: 18c197c4-3000-41b1-83bc-1a781744d539] allocate_for_instance() {{(pid=75045) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 23:40:49 user nova-compute[75045]: INFO nova.virt.libvirt.driver [None req-a871793f-a2e1-49c6-b85e-1c873ddb616b tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] [instance: 18c197c4-3000-41b1-83bc-1a781744d539] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 23:40:49 user nova-compute[75045]: DEBUG nova.compute.manager [None req-a871793f-a2e1-49c6-b85e-1c873ddb616b tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] [instance: 18c197c4-3000-41b1-83bc-1a781744d539] Start building block device mappings for instance. {{(pid=75045) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 23:40:49 user nova-compute[75045]: DEBUG nova.policy [None req-a871793f-a2e1-49c6-b85e-1c873ddb616b tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a46e4d0d14c44ec6945c3ce972031a35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f374e5f34c3464fb6f1f82f5d836c57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75045) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 23:40:49 user nova-compute[75045]: DEBUG nova.compute.manager [None req-a871793f-a2e1-49c6-b85e-1c873ddb616b tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] [instance: 18c197c4-3000-41b1-83bc-1a781744d539] Start spawning the instance on the hypervisor. {{(pid=75045) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 23:40:49 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-a871793f-a2e1-49c6-b85e-1c873ddb616b tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] [instance: 18c197c4-3000-41b1-83bc-1a781744d539] Creating instance directory {{(pid=75045) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 23:40:49 user nova-compute[75045]: INFO nova.virt.libvirt.driver [None req-a871793f-a2e1-49c6-b85e-1c873ddb616b tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] [instance: 18c197c4-3000-41b1-83bc-1a781744d539] Creating image(s)
Nov 08 23:40:49 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-a871793f-a2e1-49c6-b85e-1c873ddb616b tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] Acquiring lock "/opt/stack/data/nova/instances/18c197c4-3000-41b1-83bc-1a781744d539/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:40:49 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-a871793f-a2e1-49c6-b85e-1c873ddb616b tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] Lock "/opt/stack/data/nova/instances/18c197c4-3000-41b1-83bc-1a781744d539/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:40:49 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-a871793f-a2e1-49c6-b85e-1c873ddb616b tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] Lock "/opt/stack/data/nova/instances/18c197c4-3000-41b1-83bc-1a781744d539/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:40:49 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-a871793f-a2e1-49c6-b85e-1c873ddb616b tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b59f52a99fff51c56dd1edfb83892fb8f647f2f3 --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:40:50 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-a871793f-a2e1-49c6-b85e-1c873ddb616b tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b59f52a99fff51c56dd1edfb83892fb8f647f2f3 --force-share --output=json" returned: 0 in 0.190s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:40:50 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-a871793f-a2e1-49c6-b85e-1c873ddb616b tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] Acquiring lock "b59f52a99fff51c56dd1edfb83892fb8f647f2f3" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:40:50 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-a871793f-a2e1-49c6-b85e-1c873ddb616b tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] Lock "b59f52a99fff51c56dd1edfb83892fb8f647f2f3" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:40:50 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-a871793f-a2e1-49c6-b85e-1c873ddb616b tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b59f52a99fff51c56dd1edfb83892fb8f647f2f3 --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:40:50 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-a871793f-a2e1-49c6-b85e-1c873ddb616b tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b59f52a99fff51c56dd1edfb83892fb8f647f2f3 --force-share --output=json" returned: 0 in 0.187s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:40:50 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-a871793f-a2e1-49c6-b85e-1c873ddb616b tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b59f52a99fff51c56dd1edfb83892fb8f647f2f3,backing_fmt=raw /opt/stack/data/nova/instances/18c197c4-3000-41b1-83bc-1a781744d539/disk 1073741824 {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:40:50 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-a871793f-a2e1-49c6-b85e-1c873ddb616b tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b59f52a99fff51c56dd1edfb83892fb8f647f2f3,backing_fmt=raw /opt/stack/data/nova/instances/18c197c4-3000-41b1-83bc-1a781744d539/disk 1073741824" returned: 0 in 0.050s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:40:50 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-a871793f-a2e1-49c6-b85e-1c873ddb616b tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] Lock "b59f52a99fff51c56dd1edfb83892fb8f647f2f3" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.244s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:40:50 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-a871793f-a2e1-49c6-b85e-1c873ddb616b tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b59f52a99fff51c56dd1edfb83892fb8f647f2f3 --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:40:50 user nova-compute[75045]: DEBUG nova.network.neutron [None req-a871793f-a2e1-49c6-b85e-1c873ddb616b tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] [instance: 18c197c4-3000-41b1-83bc-1a781744d539] Successfully created port: d4920cf3-7fe0-47b8-8152-ffbf84b286f3 {{(pid=75045) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 23:40:50 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-a871793f-a2e1-49c6-b85e-1c873ddb616b tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b59f52a99fff51c56dd1edfb83892fb8f647f2f3 --force-share --output=json" returned: 0 in 0.179s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:40:50 user nova-compute[75045]: DEBUG nova.virt.disk.api [None req-a871793f-a2e1-49c6-b85e-1c873ddb616b tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] Checking if we can resize image /opt/stack/data/nova/instances/18c197c4-3000-41b1-83bc-1a781744d539/disk. size=1073741824 {{(pid=75045) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 23:40:50 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-a871793f-a2e1-49c6-b85e-1c873ddb616b tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18c197c4-3000-41b1-83bc-1a781744d539/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:40:50 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:40:50 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-a871793f-a2e1-49c6-b85e-1c873ddb616b tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18c197c4-3000-41b1-83bc-1a781744d539/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:40:50 user nova-compute[75045]: DEBUG nova.virt.disk.api [None req-a871793f-a2e1-49c6-b85e-1c873ddb616b tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] Cannot resize image /opt/stack/data/nova/instances/18c197c4-3000-41b1-83bc-1a781744d539/disk to a smaller size. {{(pid=75045) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 08 23:40:50 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-a871793f-a2e1-49c6-b85e-1c873ddb616b tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] [instance: 18c197c4-3000-41b1-83bc-1a781744d539] Created local disks {{(pid=75045) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 23:40:50 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-a871793f-a2e1-49c6-b85e-1c873ddb616b tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] [instance: 18c197c4-3000-41b1-83bc-1a781744d539] Ensure instance console log exists: /opt/stack/data/nova/instances/18c197c4-3000-41b1-83bc-1a781744d539/console.log {{(pid=75045) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 23:40:50 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-a871793f-a2e1-49c6-b85e-1c873ddb616b tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:40:50 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-a871793f-a2e1-49c6-b85e-1c873ddb616b tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:40:50 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-a871793f-a2e1-49c6-b85e-1c873ddb616b tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:40:51 user nova-compute[75045]: DEBUG nova.network.neutron [None req-a871793f-a2e1-49c6-b85e-1c873ddb616b tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] [instance: 18c197c4-3000-41b1-83bc-1a781744d539] Successfully updated port: d4920cf3-7fe0-47b8-8152-ffbf84b286f3 {{(pid=75045) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 23:40:51 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-a871793f-a2e1-49c6-b85e-1c873ddb616b tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] Acquiring lock "refresh_cache-18c197c4-3000-41b1-83bc-1a781744d539" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 23:40:51 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-a871793f-a2e1-49c6-b85e-1c873ddb616b tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] Acquired lock "refresh_cache-18c197c4-3000-41b1-83bc-1a781744d539" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 23:40:51 user nova-compute[75045]: DEBUG nova.network.neutron [None req-a871793f-a2e1-49c6-b85e-1c873ddb616b tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] [instance: 18c197c4-3000-41b1-83bc-1a781744d539] Building network info cache for instance {{(pid=75045) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 23:40:51 user nova-compute[75045]: DEBUG nova.compute.manager [req-657a8712-fec1-4987-b3cd-1c075b166808 req-2dd89057-0d0d-4396-8a0d-1ce6fd58213f service nova] [instance: 18c197c4-3000-41b1-83bc-1a781744d539] Received event network-changed-d4920cf3-7fe0-47b8-8152-ffbf84b286f3 {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:40:51 user nova-compute[75045]: DEBUG nova.compute.manager [req-657a8712-fec1-4987-b3cd-1c075b166808 req-2dd89057-0d0d-4396-8a0d-1ce6fd58213f service nova] [instance: 18c197c4-3000-41b1-83bc-1a781744d539] Refreshing instance network info cache due to event network-changed-d4920cf3-7fe0-47b8-8152-ffbf84b286f3. {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 23:40:51 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-657a8712-fec1-4987-b3cd-1c075b166808 req-2dd89057-0d0d-4396-8a0d-1ce6fd58213f service nova] Acquiring lock "refresh_cache-18c197c4-3000-41b1-83bc-1a781744d539" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 23:40:51 user nova-compute[75045]: DEBUG nova.network.neutron [None req-a871793f-a2e1-49c6-b85e-1c873ddb616b tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] [instance: 18c197c4-3000-41b1-83bc-1a781744d539] Instance cache missing network info. {{(pid=75045) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 23:40:51 user nova-compute[75045]: DEBUG nova.network.neutron [None req-a871793f-a2e1-49c6-b85e-1c873ddb616b tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] [instance: 18c197c4-3000-41b1-83bc-1a781744d539] Updating instance_info_cache with network_info: [{"id": "d4920cf3-7fe0-47b8-8152-ffbf84b286f3", "address": "fa:16:3e:1a:51:25", "network": {"id": "ec929af3-f098-4338-943c-d13305d4d555", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-208938347-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f374e5f34c3464fb6f1f82f5d836c57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4920cf3-7f", "ovs_interfaceid": "d4920cf3-7fe0-47b8-8152-ffbf84b286f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75045) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 23:40:51 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-a871793f-a2e1-49c6-b85e-1c873ddb616b tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] Releasing lock "refresh_cache-18c197c4-3000-41b1-83bc-1a781744d539" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 23:40:51 user nova-compute[75045]: DEBUG nova.compute.manager [None req-a871793f-a2e1-49c6-b85e-1c873ddb616b tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] [instance: 18c197c4-3000-41b1-83bc-1a781744d539] Instance network_info: |[{"id": "d4920cf3-7fe0-47b8-8152-ffbf84b286f3", "address": "fa:16:3e:1a:51:25", "network": {"id": "ec929af3-f098-4338-943c-d13305d4d555", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-208938347-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f374e5f34c3464fb6f1f82f5d836c57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4920cf3-7f", "ovs_interfaceid": "d4920cf3-7fe0-47b8-8152-ffbf84b286f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75045) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 23:40:51 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-657a8712-fec1-4987-b3cd-1c075b166808 req-2dd89057-0d0d-4396-8a0d-1ce6fd58213f service nova] Acquired lock "refresh_cache-18c197c4-3000-41b1-83bc-1a781744d539" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 23:40:51 user nova-compute[75045]: DEBUG nova.network.neutron [req-657a8712-fec1-4987-b3cd-1c075b166808 req-2dd89057-0d0d-4396-8a0d-1ce6fd58213f service nova] [instance: 18c197c4-3000-41b1-83bc-1a781744d539] Refreshing network info cache for port d4920cf3-7fe0-47b8-8152-ffbf84b286f3 {{(pid=75045) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 23:40:51 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-a871793f-a2e1-49c6-b85e-1c873ddb616b tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] [instance: 18c197c4-3000-41b1-83bc-1a781744d539] Start _get_guest_xml network_info=[{"id": "d4920cf3-7fe0-47b8-8152-ffbf84b286f3", "address": "fa:16:3e:1a:51:25", "network": {"id": "ec929af3-f098-4338-943c-d13305d4d555", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-208938347-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f374e5f34c3464fb6f1f82f5d836c57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4920cf3-7f", "ovs_interfaceid": "d4920cf3-7fe0-47b8-8152-ffbf84b286f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T23:11:54Z,direct_url=<?>,disk_format='qcow2',id=a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b1beba2cc4e7465ea249e2225fb494dc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T23:11:56Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'disk_bus': 'virtio', 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': 'a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75045) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 23:40:51 user nova-compute[75045]: WARNING nova.virt.libvirt.driver [None req-a871793f-a2e1-49c6-b85e-1c873ddb616b tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 23:40:51 user nova-compute[75045]: WARNING nova.virt.libvirt.driver [None req-a871793f-a2e1-49c6-b85e-1c873ddb616b tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 23:40:51 user nova-compute[75045]: DEBUG nova.virt.libvirt.host [None req-a871793f-a2e1-49c6-b85e-1c873ddb616b tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75045) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 23:40:51 user nova-compute[75045]: DEBUG nova.virt.libvirt.host [None req-a871793f-a2e1-49c6-b85e-1c873ddb616b tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] CPU controller missing on host. {{(pid=75045) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 23:40:51 user nova-compute[75045]: DEBUG nova.virt.libvirt.host [None req-a871793f-a2e1-49c6-b85e-1c873ddb616b tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75045) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 23:40:51 user nova-compute[75045]: DEBUG nova.virt.libvirt.host [None req-a871793f-a2e1-49c6-b85e-1c873ddb616b tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] CPU controller found on host. {{(pid=75045) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 23:40:51 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-a871793f-a2e1-49c6-b85e-1c873ddb616b tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75045) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 23:40:51 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-a871793f-a2e1-49c6-b85e-1c873ddb616b tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T23:11:41Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T23:11:54Z,direct_url=<?>,disk_format='qcow2',id=a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b1beba2cc4e7465ea249e2225fb494dc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T23:11:56Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75045) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 23:40:51 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-a871793f-a2e1-49c6-b85e-1c873ddb616b tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] Flavor limits 0:0:0 {{(pid=75045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 23:40:51 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-a871793f-a2e1-49c6-b85e-1c873ddb616b tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] Image limits 0:0:0 {{(pid=75045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 23:40:51 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-a871793f-a2e1-49c6-b85e-1c873ddb616b tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] Flavor pref 0:0:0 {{(pid=75045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 23:40:51 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-a871793f-a2e1-49c6-b85e-1c873ddb616b tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] Image pref 0:0:0 {{(pid=75045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 23:40:51 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-a871793f-a2e1-49c6-b85e-1c873ddb616b tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 23:40:51 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-a871793f-a2e1-49c6-b85e-1c873ddb616b tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75045) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 23:40:51 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-a871793f-a2e1-49c6-b85e-1c873ddb616b tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75045) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 23:40:51 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-a871793f-a2e1-49c6-b85e-1c873ddb616b tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] Got 1 possible topologies {{(pid=75045) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 23:40:51 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-a871793f-a2e1-49c6-b85e-1c873ddb616b tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75045) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 23:40:51 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-a871793f-a2e1-49c6-b85e-1c873ddb616b tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75045) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 23:40:51 user nova-compute[75045]: DEBUG nova.virt.libvirt.vif [None req-a871793f-a2e1-49c6-b85e-1c873ddb616b tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T23:40:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1233696084',display_name='tempest-VolumesSnapshotTestJSON-instance-1233696084',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1233696084',id=40,image_ref='a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCS4z4QBFYKoXHC/wFU3UjpMZeNuyhOfm9DXpNFYEZInpn0lJvXKfCpKbXSDCVrdREuVhBjtgx20kiTIr8mHzBSymT7p0sC/HW0d1V8zjS+EyY+Krdm7eqFhYovhMGtWdA==',key_name='tempest-keypair-1067954917',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4f374e5f34c3464fb6f1f82f5d836c57',ramdisk_id='',reservation_id='r-qhv710p5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-814421851',owner_user_name='tempest-VolumesSnapshotTestJSON-814421851-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T23:40:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a46e4d0d14c44ec6945c3ce972031a35',uuid=18c197c4-3000-41b1-83bc-1a781744d539,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d4920cf3-7fe0-47b8-8152-ffbf84b286f3", "address": "fa:16:3e:1a:51:25", "network": {"id": "ec929af3-f098-4338-943c-d13305d4d555", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-208938347-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f374e5f34c3464fb6f1f82f5d836c57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4920cf3-7f", "ovs_interfaceid": "d4920cf3-7fe0-47b8-8152-ffbf84b286f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75045) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 23:40:51 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-a871793f-a2e1-49c6-b85e-1c873ddb616b tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] Converting VIF {"id": "d4920cf3-7fe0-47b8-8152-ffbf84b286f3", "address": "fa:16:3e:1a:51:25", "network": {"id": "ec929af3-f098-4338-943c-d13305d4d555", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-208938347-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f374e5f34c3464fb6f1f82f5d836c57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4920cf3-7f", "ovs_interfaceid": "d4920cf3-7fe0-47b8-8152-ffbf84b286f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 23:40:51 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-a871793f-a2e1-49c6-b85e-1c873ddb616b tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1a:51:25,bridge_name='br-int',has_traffic_filtering=True,id=d4920cf3-7fe0-47b8-8152-ffbf84b286f3,network=Network(ec929af3-f098-4338-943c-d13305d4d555),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd4920cf3-7f') {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 23:40:51 user nova-compute[75045]: DEBUG nova.objects.instance [None req-a871793f-a2e1-49c6-b85e-1c873ddb616b tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] Lazy-loading 'pci_devices' on Instance uuid 18c197c4-3000-41b1-83bc-1a781744d539 {{(pid=75045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 23:40:51 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-a871793f-a2e1-49c6-b85e-1c873ddb616b tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] [instance: 18c197c4-3000-41b1-83bc-1a781744d539] End _get_guest_xml xml=<domain type="kvm">
Nov 08 23:40:51 user nova-compute[75045]:   <uuid>18c197c4-3000-41b1-83bc-1a781744d539</uuid>
Nov 08 23:40:51 user nova-compute[75045]:   <name>instance-00000028</name>
Nov 08 23:40:51 user nova-compute[75045]:   <memory>524288</memory>
Nov 08 23:40:51 user nova-compute[75045]:   <vcpu>1</vcpu>
Nov 08 23:40:51 user nova-compute[75045]:   <metadata>
Nov 08 23:40:51 user nova-compute[75045]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 23:40:51 user nova-compute[75045]:       <nova:package version="0.0.0"/>
Nov 08 23:40:51 user nova-compute[75045]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-1233696084</nova:name>
Nov 08 23:40:51 user nova-compute[75045]:       <nova:creationTime>2023-11-08 23:40:51</nova:creationTime>
Nov 08 23:40:51 user nova-compute[75045]:       <nova:flavor name="m1.tiny">
Nov 08 23:40:51 user nova-compute[75045]:         <nova:memory>512</nova:memory>
Nov 08 23:40:51 user nova-compute[75045]:         <nova:disk>1</nova:disk>
Nov 08 23:40:51 user nova-compute[75045]:         <nova:swap>0</nova:swap>
Nov 08 23:40:51 user nova-compute[75045]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 23:40:51 user nova-compute[75045]:         <nova:vcpus>1</nova:vcpus>
Nov 08 23:40:51 user nova-compute[75045]:       </nova:flavor>
Nov 08 23:40:51 user nova-compute[75045]:       <nova:owner>
Nov 08 23:40:51 user nova-compute[75045]:         <nova:user uuid="a46e4d0d14c44ec6945c3ce972031a35">tempest-VolumesSnapshotTestJSON-814421851-project-member</nova:user>
Nov 08 23:40:51 user nova-compute[75045]:         <nova:project uuid="4f374e5f34c3464fb6f1f82f5d836c57">tempest-VolumesSnapshotTestJSON-814421851</nova:project>
Nov 08 23:40:51 user nova-compute[75045]:       </nova:owner>
Nov 08 23:40:51 user nova-compute[75045]:       <nova:root type="image" uuid="a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb"/>
Nov 08 23:40:51 user nova-compute[75045]:       <nova:ports>
Nov 08 23:40:51 user nova-compute[75045]:         <nova:port uuid="d4920cf3-7fe0-47b8-8152-ffbf84b286f3">
Nov 08 23:40:51 user nova-compute[75045]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 08 23:40:51 user nova-compute[75045]:         </nova:port>
Nov 08 23:40:51 user nova-compute[75045]:       </nova:ports>
Nov 08 23:40:51 user nova-compute[75045]:     </nova:instance>
Nov 08 23:40:51 user nova-compute[75045]:   </metadata>
Nov 08 23:40:51 user nova-compute[75045]:   <sysinfo type="smbios">
Nov 08 23:40:51 user nova-compute[75045]:     <system>
Nov 08 23:40:51 user nova-compute[75045]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 23:40:51 user nova-compute[75045]:       <entry name="product">OpenStack Nova</entry>
Nov 08 23:40:51 user nova-compute[75045]:       <entry name="version">0.0.0</entry>
Nov 08 23:40:51 user nova-compute[75045]:       <entry name="serial">18c197c4-3000-41b1-83bc-1a781744d539</entry>
Nov 08 23:40:51 user nova-compute[75045]:       <entry name="uuid">18c197c4-3000-41b1-83bc-1a781744d539</entry>
Nov 08 23:40:51 user nova-compute[75045]:       <entry name="family">Virtual Machine</entry>
Nov 08 23:40:51 user nova-compute[75045]:     </system>
Nov 08 23:40:51 user nova-compute[75045]:   </sysinfo>
Nov 08 23:40:51 user nova-compute[75045]:   <os>
Nov 08 23:40:51 user nova-compute[75045]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 23:40:51 user nova-compute[75045]:     <boot dev="hd"/>
Nov 08 23:40:51 user nova-compute[75045]:     <smbios mode="sysinfo"/>
Nov 08 23:40:51 user nova-compute[75045]:   </os>
Nov 08 23:40:51 user nova-compute[75045]:   <features>
Nov 08 23:40:51 user nova-compute[75045]:     <acpi/>
Nov 08 23:40:51 user nova-compute[75045]:     <apic/>
Nov 08 23:40:51 user nova-compute[75045]:     <vmcoreinfo/>
Nov 08 23:40:51 user nova-compute[75045]:   </features>
Nov 08 23:40:51 user nova-compute[75045]:   <clock offset="utc">
Nov 08 23:40:51 user nova-compute[75045]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 23:40:51 user nova-compute[75045]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 23:40:51 user nova-compute[75045]:     <timer name="hpet" present="no"/>
Nov 08 23:40:51 user nova-compute[75045]:   </clock>
Nov 08 23:40:51 user nova-compute[75045]:   <cpu mode="custom" match="exact">
Nov 08 23:40:51 user nova-compute[75045]:     <model>Nehalem</model>
Nov 08 23:40:51 user nova-compute[75045]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 23:40:51 user nova-compute[75045]:   </cpu>
Nov 08 23:40:51 user nova-compute[75045]:   <devices>
Nov 08 23:40:51 user nova-compute[75045]:     <disk type="file" device="disk">
Nov 08 23:40:51 user nova-compute[75045]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 23:40:51 user nova-compute[75045]:       <source file="/opt/stack/data/nova/instances/18c197c4-3000-41b1-83bc-1a781744d539/disk"/>
Nov 08 23:40:51 user nova-compute[75045]:       <target dev="vda" bus="virtio"/>
Nov 08 23:40:51 user nova-compute[75045]:     </disk>
Nov 08 23:40:51 user nova-compute[75045]:     <interface type="ethernet">
Nov 08 23:40:51 user nova-compute[75045]:       <mac address="fa:16:3e:1a:51:25"/>
Nov 08 23:40:51 user nova-compute[75045]:       <model type="virtio"/>
Nov 08 23:40:51 user nova-compute[75045]:       <mtu size="1442"/>
Nov 08 23:40:51 user nova-compute[75045]:       <target dev="tapd4920cf3-7f"/>
Nov 08 23:40:51 user nova-compute[75045]:     </interface>
Nov 08 23:40:51 user nova-compute[75045]:     <serial type="pty">
Nov 08 23:40:51 user nova-compute[75045]:       <log file="/opt/stack/data/nova/instances/18c197c4-3000-41b1-83bc-1a781744d539/console.log" append="off"/>
Nov 08 23:40:51 user nova-compute[75045]:     </serial>
Nov 08 23:40:51 user nova-compute[75045]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 23:40:51 user nova-compute[75045]:     <video>
Nov 08 23:40:51 user nova-compute[75045]:       <model type="virtio"/>
Nov 08 23:40:51 user nova-compute[75045]:     </video>
Nov 08 23:40:51 user nova-compute[75045]:     <rng model="virtio">
Nov 08 23:40:51 user nova-compute[75045]:       <backend model="random">/dev/urandom</backend>
Nov 08 23:40:51 user nova-compute[75045]:     </rng>
Nov 08 23:40:51 user nova-compute[75045]:     <controller type="usb" index="0" model="none"/>
Nov 08 23:40:51 user nova-compute[75045]:     <memballoon model="virtio">
Nov 08 23:40:51 user nova-compute[75045]:       <stats period="10"/>
Nov 08 23:40:51 user nova-compute[75045]:     </memballoon>
Nov 08 23:40:51 user nova-compute[75045]:   </devices>
Nov 08 23:40:51 user nova-compute[75045]: </domain>
Nov 08 23:40:51 user nova-compute[75045]:  {{(pid=75045) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 23:40:51 user nova-compute[75045]: DEBUG nova.virt.libvirt.vif [None req-a871793f-a2e1-49c6-b85e-1c873ddb616b tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T23:40:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1233696084',display_name='tempest-VolumesSnapshotTestJSON-instance-1233696084',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1233696084',id=40,image_ref='a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCS4z4QBFYKoXHC/wFU3UjpMZeNuyhOfm9DXpNFYEZInpn0lJvXKfCpKbXSDCVrdREuVhBjtgx20kiTIr8mHzBSymT7p0sC/HW0d1V8zjS+EyY+Krdm7eqFhYovhMGtWdA==',key_name='tempest-keypair-1067954917',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4f374e5f34c3464fb6f1f82f5d836c57',ramdisk_id='',reservation_id='r-qhv710p5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-814421851',owner_user_name='tempest-VolumesSnapshotTestJSON-814421851-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T23:40:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a46e4d0d14c44ec6945c3ce972031a35',uuid=18c197c4-3000-41b1-83bc-1a781744d539,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d4920cf3-7fe0-47b8-8152-ffbf84b286f3", "address": "fa:16:3e:1a:51:25", "network": {"id": "ec929af3-f098-4338-943c-d13305d4d555", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-208938347-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f374e5f34c3464fb6f1f82f5d836c57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4920cf3-7f", "ovs_interfaceid": "d4920cf3-7fe0-47b8-8152-ffbf84b286f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75045) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 23:40:51 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-a871793f-a2e1-49c6-b85e-1c873ddb616b tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] Converting VIF {"id": "d4920cf3-7fe0-47b8-8152-ffbf84b286f3", "address": "fa:16:3e:1a:51:25", "network": {"id": "ec929af3-f098-4338-943c-d13305d4d555", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-208938347-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f374e5f34c3464fb6f1f82f5d836c57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4920cf3-7f", "ovs_interfaceid": "d4920cf3-7fe0-47b8-8152-ffbf84b286f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 23:40:51 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-a871793f-a2e1-49c6-b85e-1c873ddb616b tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1a:51:25,bridge_name='br-int',has_traffic_filtering=True,id=d4920cf3-7fe0-47b8-8152-ffbf84b286f3,network=Network(ec929af3-f098-4338-943c-d13305d4d555),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd4920cf3-7f') {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 23:40:51 user nova-compute[75045]: DEBUG os_vif [None req-a871793f-a2e1-49c6-b85e-1c873ddb616b tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1a:51:25,bridge_name='br-int',has_traffic_filtering=True,id=d4920cf3-7fe0-47b8-8152-ffbf84b286f3,network=Network(ec929af3-f098-4338-943c-d13305d4d555),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd4920cf3-7f') {{(pid=75045) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 23:40:51 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:40:51 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:40:51 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 23:40:51 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:40:51 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3373b965-3a43-5363-b352-7004962a3030', '_type': 'linux-noop'}}, row=False) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:40:51 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:40:51 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:40:51 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:40:51 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd4920cf3-7f, may_exist=True, interface_attrs={}) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:40:51 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd4920cf3-7f, col_values=(('qos', UUID('20ea0ebc-2d6c-4724-aa33-f4c806f4f811')),), if_exists=True) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:40:51 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd4920cf3-7f, col_values=(('external_ids', {'iface-id': 'd4920cf3-7fe0-47b8-8152-ffbf84b286f3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1a:51:25', 'vm-uuid': '18c197c4-3000-41b1-83bc-1a781744d539'}),), if_exists=True) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:40:51 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 23:40:51 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:40:51 user nova-compute[75045]: INFO os_vif [None req-a871793f-a2e1-49c6-b85e-1c873ddb616b tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1a:51:25,bridge_name='br-int',has_traffic_filtering=True,id=d4920cf3-7fe0-47b8-8152-ffbf84b286f3,network=Network(ec929af3-f098-4338-943c-d13305d4d555),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd4920cf3-7f')
Nov 08 23:40:51 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-a871793f-a2e1-49c6-b85e-1c873ddb616b tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] No BDM found with device name vda, not building metadata. {{(pid=75045) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 23:40:51 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-a871793f-a2e1-49c6-b85e-1c873ddb616b tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] No VIF found with MAC fa:16:3e:1a:51:25, not building metadata {{(pid=75045) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 23:40:51 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:40:51 user nova-compute[75045]: DEBUG nova.network.neutron [req-657a8712-fec1-4987-b3cd-1c075b166808 req-2dd89057-0d0d-4396-8a0d-1ce6fd58213f service nova] [instance: 18c197c4-3000-41b1-83bc-1a781744d539] Updated VIF entry in instance network info cache for port d4920cf3-7fe0-47b8-8152-ffbf84b286f3. {{(pid=75045) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 23:40:51 user nova-compute[75045]: DEBUG nova.network.neutron [req-657a8712-fec1-4987-b3cd-1c075b166808 req-2dd89057-0d0d-4396-8a0d-1ce6fd58213f service nova] [instance: 18c197c4-3000-41b1-83bc-1a781744d539] Updating instance_info_cache with network_info: [{"id": "d4920cf3-7fe0-47b8-8152-ffbf84b286f3", "address": "fa:16:3e:1a:51:25", "network": {"id": "ec929af3-f098-4338-943c-d13305d4d555", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-208938347-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f374e5f34c3464fb6f1f82f5d836c57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4920cf3-7f", "ovs_interfaceid": "d4920cf3-7fe0-47b8-8152-ffbf84b286f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75045) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 23:40:51 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-657a8712-fec1-4987-b3cd-1c075b166808 req-2dd89057-0d0d-4396-8a0d-1ce6fd58213f service nova] Releasing lock "refresh_cache-18c197c4-3000-41b1-83bc-1a781744d539" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 23:40:52 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:40:52 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:40:52 user nova-compute[75045]: DEBUG nova.compute.manager [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Starting heal instance info cache {{(pid=75045) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 23:40:52 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Acquiring lock "refresh_cache-adcffd35-00c7-49db-a72f-d6307a90e123" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 23:40:52 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Acquired lock "refresh_cache-adcffd35-00c7-49db-a72f-d6307a90e123" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 23:40:52 user nova-compute[75045]: DEBUG nova.network.neutron [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] [instance: adcffd35-00c7-49db-a72f-d6307a90e123] Forcefully refreshing network info cache for instance {{(pid=75045) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 23:40:52 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:40:52 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:40:52 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:40:53 user nova-compute[75045]: DEBUG nova.compute.manager [req-58592b16-68bd-48b3-ab2f-196e3b3b8c24 req-96ca8058-835f-494f-af8d-46c03109e9c7 service nova] [instance: 18c197c4-3000-41b1-83bc-1a781744d539] Received event network-vif-plugged-d4920cf3-7fe0-47b8-8152-ffbf84b286f3 {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:40:53 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-58592b16-68bd-48b3-ab2f-196e3b3b8c24 req-96ca8058-835f-494f-af8d-46c03109e9c7 service nova] Acquiring lock "18c197c4-3000-41b1-83bc-1a781744d539-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:40:53 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-58592b16-68bd-48b3-ab2f-196e3b3b8c24 req-96ca8058-835f-494f-af8d-46c03109e9c7 service nova] Lock "18c197c4-3000-41b1-83bc-1a781744d539-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:40:53 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-58592b16-68bd-48b3-ab2f-196e3b3b8c24 req-96ca8058-835f-494f-af8d-46c03109e9c7 service nova] Lock "18c197c4-3000-41b1-83bc-1a781744d539-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:40:53 user nova-compute[75045]: DEBUG nova.compute.manager [req-58592b16-68bd-48b3-ab2f-196e3b3b8c24 req-96ca8058-835f-494f-af8d-46c03109e9c7 service nova] [instance: 18c197c4-3000-41b1-83bc-1a781744d539] No waiting events found dispatching network-vif-plugged-d4920cf3-7fe0-47b8-8152-ffbf84b286f3 {{(pid=75045) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 23:40:53 user nova-compute[75045]: WARNING nova.compute.manager [req-58592b16-68bd-48b3-ab2f-196e3b3b8c24 req-96ca8058-835f-494f-af8d-46c03109e9c7 service nova] [instance: 18c197c4-3000-41b1-83bc-1a781744d539] Received unexpected event network-vif-plugged-d4920cf3-7fe0-47b8-8152-ffbf84b286f3 for instance with vm_state building and task_state spawning.
Nov 08 23:40:53 user nova-compute[75045]: DEBUG nova.network.neutron [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] [instance: adcffd35-00c7-49db-a72f-d6307a90e123] Updating instance_info_cache with network_info: [{"id": "cbed987e-37ab-4cb9-b01a-ecad76d98f21", "address": "fa:16:3e:60:a2:7b", "network": {"id": "fe74884d-c24e-4be8-b45a-eb825b3563a3", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1344943603-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.6", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3343bcd412b54ef0bcfed8be47b0353a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbed987e-37", "ovs_interfaceid": "cbed987e-37ab-4cb9-b01a-ecad76d98f21", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75045) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 23:40:53 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Releasing lock "refresh_cache-adcffd35-00c7-49db-a72f-d6307a90e123" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 23:40:53 user nova-compute[75045]: DEBUG nova.compute.manager [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] [instance: adcffd35-00c7-49db-a72f-d6307a90e123] Updated the network info_cache for instance {{(pid=75045) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 23:40:53 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:40:53 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:40:53 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:40:53 user nova-compute[75045]: DEBUG nova.compute.manager [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75045) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 23:40:53 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:40:53 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:40:53 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:40:53 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:40:53 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:40:53 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:40:53 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:40:55 user nova-compute[75045]: DEBUG nova.compute.manager [None req-a871793f-a2e1-49c6-b85e-1c873ddb616b tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] [instance: 18c197c4-3000-41b1-83bc-1a781744d539] Instance event wait completed in 0 seconds for  {{(pid=75045) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 23:40:55 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-a871793f-a2e1-49c6-b85e-1c873ddb616b tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] [instance: 18c197c4-3000-41b1-83bc-1a781744d539] Guest created on hypervisor {{(pid=75045) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 23:40:55 user nova-compute[75045]: INFO nova.virt.libvirt.driver [-] [instance: 18c197c4-3000-41b1-83bc-1a781744d539] Instance spawned successfully.
Nov 08 23:40:55 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-a871793f-a2e1-49c6-b85e-1c873ddb616b tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] [instance: 18c197c4-3000-41b1-83bc-1a781744d539] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75045) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 23:40:55 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-a871793f-a2e1-49c6-b85e-1c873ddb616b tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] [instance: 18c197c4-3000-41b1-83bc-1a781744d539] Found default for hw_cdrom_bus of ide {{(pid=75045) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 23:40:55 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-a871793f-a2e1-49c6-b85e-1c873ddb616b tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] [instance: 18c197c4-3000-41b1-83bc-1a781744d539] Found default for hw_disk_bus of virtio {{(pid=75045) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 23:40:55 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-a871793f-a2e1-49c6-b85e-1c873ddb616b tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] [instance: 18c197c4-3000-41b1-83bc-1a781744d539] Found default for hw_input_bus of None {{(pid=75045) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 23:40:55 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-a871793f-a2e1-49c6-b85e-1c873ddb616b tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] [instance: 18c197c4-3000-41b1-83bc-1a781744d539] Found default for hw_pointer_model of None {{(pid=75045) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 23:40:55 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-a871793f-a2e1-49c6-b85e-1c873ddb616b tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] [instance: 18c197c4-3000-41b1-83bc-1a781744d539] Found default for hw_video_model of virtio {{(pid=75045) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 23:40:55 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-a871793f-a2e1-49c6-b85e-1c873ddb616b tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] [instance: 18c197c4-3000-41b1-83bc-1a781744d539] Found default for hw_vif_model of virtio {{(pid=75045) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 23:40:55 user nova-compute[75045]: DEBUG nova.compute.manager [req-8e4cdf73-8d49-457d-95eb-69bd086086f2 req-69ad3171-1505-44c1-8878-40b720ffdcc5 service nova] [instance: 18c197c4-3000-41b1-83bc-1a781744d539] Received event network-vif-plugged-d4920cf3-7fe0-47b8-8152-ffbf84b286f3 {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:40:55 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-8e4cdf73-8d49-457d-95eb-69bd086086f2 req-69ad3171-1505-44c1-8878-40b720ffdcc5 service nova] Acquiring lock "18c197c4-3000-41b1-83bc-1a781744d539-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:40:55 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-8e4cdf73-8d49-457d-95eb-69bd086086f2 req-69ad3171-1505-44c1-8878-40b720ffdcc5 service nova] Lock "18c197c4-3000-41b1-83bc-1a781744d539-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:40:55 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-8e4cdf73-8d49-457d-95eb-69bd086086f2 req-69ad3171-1505-44c1-8878-40b720ffdcc5 service nova] Lock "18c197c4-3000-41b1-83bc-1a781744d539-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:40:55 user nova-compute[75045]: DEBUG nova.compute.manager [req-8e4cdf73-8d49-457d-95eb-69bd086086f2 req-69ad3171-1505-44c1-8878-40b720ffdcc5 service nova] [instance: 18c197c4-3000-41b1-83bc-1a781744d539] No waiting events found dispatching network-vif-plugged-d4920cf3-7fe0-47b8-8152-ffbf84b286f3 {{(pid=75045) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 23:40:55 user nova-compute[75045]: WARNING nova.compute.manager [req-8e4cdf73-8d49-457d-95eb-69bd086086f2 req-69ad3171-1505-44c1-8878-40b720ffdcc5 service nova] [instance: 18c197c4-3000-41b1-83bc-1a781744d539] Received unexpected event network-vif-plugged-d4920cf3-7fe0-47b8-8152-ffbf84b286f3 for instance with vm_state building and task_state spawning.
Nov 08 23:40:55 user nova-compute[75045]: INFO nova.compute.manager [None req-a871793f-a2e1-49c6-b85e-1c873ddb616b tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] [instance: 18c197c4-3000-41b1-83bc-1a781744d539] Took 5.47 seconds to spawn the instance on the hypervisor.
Nov 08 23:40:55 user nova-compute[75045]: DEBUG nova.compute.manager [None req-a871793f-a2e1-49c6-b85e-1c873ddb616b tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] [instance: 18c197c4-3000-41b1-83bc-1a781744d539] Checking state {{(pid=75045) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 23:40:55 user nova-compute[75045]: INFO nova.compute.manager [None req-a871793f-a2e1-49c6-b85e-1c873ddb616b tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] [instance: 18c197c4-3000-41b1-83bc-1a781744d539] Took 6.10 seconds to build instance.
Nov 08 23:40:55 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-a871793f-a2e1-49c6-b85e-1c873ddb616b tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] Lock "18c197c4-3000-41b1-83bc-1a781744d539" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.200s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:40:55 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:40:56 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:40:56 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:40:56 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager.update_available_resource {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:40:56 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:40:56 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:40:56 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:40:56 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Auditing locally available compute resources for user (node: user) {{(pid=75045) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 23:40:57 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/244c4cc9-2837-40c9-b4ad-37dc435c9749/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:40:57 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/244c4cc9-2837-40c9-b4ad-37dc435c9749/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:40:57 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/244c4cc9-2837-40c9-b4ad-37dc435c9749/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:40:57 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/244c4cc9-2837-40c9-b4ad-37dc435c9749/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:40:57 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75045) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 23:40:57 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3df54db-78d7-436b-b86a-df3257b170e6/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:40:57 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3df54db-78d7-436b-b86a-df3257b170e6/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:40:57 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3df54db-78d7-436b-b86a-df3257b170e6/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:40:57 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3df54db-78d7-436b-b86a-df3257b170e6/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:40:57 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ee587a0-e271-4262-a252-2ccb6c2faecb/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:40:58 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ee587a0-e271-4262-a252-2ccb6c2faecb/disk --force-share --output=json" returned: 0 in 0.245s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:40:58 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ee587a0-e271-4262-a252-2ccb6c2faecb/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:40:58 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ee587a0-e271-4262-a252-2ccb6c2faecb/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:40:58 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18c197c4-3000-41b1-83bc-1a781744d539/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:40:58 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18c197c4-3000-41b1-83bc-1a781744d539/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:40:58 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18c197c4-3000-41b1-83bc-1a781744d539/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:40:58 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18c197c4-3000-41b1-83bc-1a781744d539/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:40:58 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/adcffd35-00c7-49db-a72f-d6307a90e123/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:40:58 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/adcffd35-00c7-49db-a72f-d6307a90e123/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:40:58 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/adcffd35-00c7-49db-a72f-d6307a90e123/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:40:59 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/adcffd35-00c7-49db-a72f-d6307a90e123/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:40:59 user nova-compute[75045]: WARNING nova.virt.libvirt.driver [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 23:40:59 user nova-compute[75045]: WARNING nova.virt.libvirt.driver [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 23:40:59 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Hypervisor/Node resource view: name=user free_ram=8128MB free_disk=25.088882446289062GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75045) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 23:40:59 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:40:59 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:40:59 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Instance adcffd35-00c7-49db-a72f-d6307a90e123 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75045) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 23:40:59 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Instance 244c4cc9-2837-40c9-b4ad-37dc435c9749 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75045) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 23:40:59 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Instance 7ee587a0-e271-4262-a252-2ccb6c2faecb actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75045) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 23:40:59 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Instance c3df54db-78d7-436b-b86a-df3257b170e6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75045) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 23:40:59 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Instance 899ae4a7-6932-4f43-a87f-a88cb2ce3cb9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75045) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 23:40:59 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Instance 18c197c4-3000-41b1-83bc-1a781744d539 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75045) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 23:40:59 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=75045) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 23:40:59 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=75045) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 23:40:59 user nova-compute[75045]: DEBUG nova.compute.provider_tree [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Inventory has not changed in ProviderTree for provider: 62ba5f85-c74d-4b58-986e-d4197e813fd7 {{(pid=75045) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 23:40:59 user nova-compute[75045]: DEBUG nova.scheduler.client.report [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Inventory has not changed for provider 62ba5f85-c74d-4b58-986e-d4197e813fd7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75045) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 23:40:59 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Compute_service record updated for user:user {{(pid=75045) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 23:40:59 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.365s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:41:01 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:41:01 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:41:06 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:41:11 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 23:41:11 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 23:41:11 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75045) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 23:41:11 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75045) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 23:41:11 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75045) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 23:41:11 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:41:11 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:41:13 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-3def43d3-206f-442c-b61c-d322c6f58e23 tempest-ServersNegativeTestJSON-1185286380 tempest-ServersNegativeTestJSON-1185286380-project-member] Acquiring lock "c3df54db-78d7-436b-b86a-df3257b170e6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:41:13 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-3def43d3-206f-442c-b61c-d322c6f58e23 tempest-ServersNegativeTestJSON-1185286380 tempest-ServersNegativeTestJSON-1185286380-project-member] Lock "c3df54db-78d7-436b-b86a-df3257b170e6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:41:13 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-3def43d3-206f-442c-b61c-d322c6f58e23 tempest-ServersNegativeTestJSON-1185286380 tempest-ServersNegativeTestJSON-1185286380-project-member] Acquiring lock "c3df54db-78d7-436b-b86a-df3257b170e6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:41:13 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-3def43d3-206f-442c-b61c-d322c6f58e23 tempest-ServersNegativeTestJSON-1185286380 tempest-ServersNegativeTestJSON-1185286380-project-member] Lock "c3df54db-78d7-436b-b86a-df3257b170e6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:41:13 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-3def43d3-206f-442c-b61c-d322c6f58e23 tempest-ServersNegativeTestJSON-1185286380 tempest-ServersNegativeTestJSON-1185286380-project-member] Lock "c3df54db-78d7-436b-b86a-df3257b170e6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:41:13 user nova-compute[75045]: INFO nova.compute.manager [None req-3def43d3-206f-442c-b61c-d322c6f58e23 tempest-ServersNegativeTestJSON-1185286380 tempest-ServersNegativeTestJSON-1185286380-project-member] [instance: c3df54db-78d7-436b-b86a-df3257b170e6] Terminating instance
Nov 08 23:41:13 user nova-compute[75045]: DEBUG nova.compute.manager [None req-3def43d3-206f-442c-b61c-d322c6f58e23 tempest-ServersNegativeTestJSON-1185286380 tempest-ServersNegativeTestJSON-1185286380-project-member] [instance: c3df54db-78d7-436b-b86a-df3257b170e6] Start destroying the instance on the hypervisor. {{(pid=75045) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 23:41:13 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:41:13 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:41:14 user nova-compute[75045]: DEBUG nova.compute.manager [req-829af830-330a-476e-b2dc-af93780e07b8 req-da34a80c-ed30-480e-9fc0-6bbf2b641d99 service nova] [instance: c3df54db-78d7-436b-b86a-df3257b170e6] Received event network-vif-unplugged-ebefec6f-8abb-429a-90dd-8a6995ad4625 {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:41:14 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-829af830-330a-476e-b2dc-af93780e07b8 req-da34a80c-ed30-480e-9fc0-6bbf2b641d99 service nova] Acquiring lock "c3df54db-78d7-436b-b86a-df3257b170e6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:41:14 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-829af830-330a-476e-b2dc-af93780e07b8 req-da34a80c-ed30-480e-9fc0-6bbf2b641d99 service nova] Lock "c3df54db-78d7-436b-b86a-df3257b170e6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:41:14 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-829af830-330a-476e-b2dc-af93780e07b8 req-da34a80c-ed30-480e-9fc0-6bbf2b641d99 service nova] Lock "c3df54db-78d7-436b-b86a-df3257b170e6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:41:14 user nova-compute[75045]: DEBUG nova.compute.manager [req-829af830-330a-476e-b2dc-af93780e07b8 req-da34a80c-ed30-480e-9fc0-6bbf2b641d99 service nova] [instance: c3df54db-78d7-436b-b86a-df3257b170e6] No waiting events found dispatching network-vif-unplugged-ebefec6f-8abb-429a-90dd-8a6995ad4625 {{(pid=75045) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 23:41:14 user nova-compute[75045]: DEBUG nova.compute.manager [req-829af830-330a-476e-b2dc-af93780e07b8 req-da34a80c-ed30-480e-9fc0-6bbf2b641d99 service nova] [instance: c3df54db-78d7-436b-b86a-df3257b170e6] Received event network-vif-unplugged-ebefec6f-8abb-429a-90dd-8a6995ad4625 for instance with task_state deleting. {{(pid=75045) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 23:41:14 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:41:14 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:41:14 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:41:14 user nova-compute[75045]: INFO nova.virt.libvirt.driver [-] [instance: c3df54db-78d7-436b-b86a-df3257b170e6] Instance destroyed successfully.
Nov 08 23:41:14 user nova-compute[75045]: DEBUG nova.objects.instance [None req-3def43d3-206f-442c-b61c-d322c6f58e23 tempest-ServersNegativeTestJSON-1185286380 tempest-ServersNegativeTestJSON-1185286380-project-member] Lazy-loading 'resources' on Instance uuid c3df54db-78d7-436b-b86a-df3257b170e6 {{(pid=75045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 23:41:14 user nova-compute[75045]: DEBUG nova.virt.libvirt.vif [None req-3def43d3-206f-442c-b61c-d322c6f58e23 tempest-ServersNegativeTestJSON-1185286380 tempest-ServersNegativeTestJSON-1185286380-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T23:39:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1982442390',display_name='tempest-ServersNegativeTestJSON-server-1982442390',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1982442390',id=38,image_ref='a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-08T23:39:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='61c8f99e9d284b51bbf7bbf6bdfb8662',ramdisk_id='',reservation_id='r-r2fmzdht',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-1185286380',owner_user_name='tempest-ServersNegativeTestJSON-1185286380-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T23:39:30Z,user_data=None,user_id='43c4b404522b424b8e23b2b5687a7821',uuid=c3df54db-78d7-436b-b86a-df3257b170e6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ebefec6f-8abb-429a-90dd-8a6995ad4625", "address": "fa:16:3e:37:87:58", "network": {"id": "eac8b567-0d31-42ec-b05d-2ca251612286", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1889897935-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "61c8f99e9d284b51bbf7bbf6bdfb8662", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebefec6f-8a", "ovs_interfaceid": "ebefec6f-8abb-429a-90dd-8a6995ad4625", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75045) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 23:41:14 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-3def43d3-206f-442c-b61c-d322c6f58e23 tempest-ServersNegativeTestJSON-1185286380 tempest-ServersNegativeTestJSON-1185286380-project-member] Converting VIF {"id": "ebefec6f-8abb-429a-90dd-8a6995ad4625", "address": "fa:16:3e:37:87:58", "network": {"id": "eac8b567-0d31-42ec-b05d-2ca251612286", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1889897935-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "61c8f99e9d284b51bbf7bbf6bdfb8662", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebefec6f-8a", "ovs_interfaceid": "ebefec6f-8abb-429a-90dd-8a6995ad4625", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 23:41:14 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-3def43d3-206f-442c-b61c-d322c6f58e23 tempest-ServersNegativeTestJSON-1185286380 tempest-ServersNegativeTestJSON-1185286380-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:37:87:58,bridge_name='br-int',has_traffic_filtering=True,id=ebefec6f-8abb-429a-90dd-8a6995ad4625,network=Network(eac8b567-0d31-42ec-b05d-2ca251612286),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapebefec6f-8a') {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 23:41:14 user nova-compute[75045]: DEBUG os_vif [None req-3def43d3-206f-442c-b61c-d322c6f58e23 tempest-ServersNegativeTestJSON-1185286380 tempest-ServersNegativeTestJSON-1185286380-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:37:87:58,bridge_name='br-int',has_traffic_filtering=True,id=ebefec6f-8abb-429a-90dd-8a6995ad4625,network=Network(eac8b567-0d31-42ec-b05d-2ca251612286),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapebefec6f-8a') {{(pid=75045) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 23:41:14 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:41:14 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapebefec6f-8a, bridge=br-int, if_exists=True) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:41:14 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:41:14 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 23:41:14 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:41:14 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5a2d12d0-998d-4c03-9a51-5c26288ffb9d) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:41:14 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:41:14 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 23:41:14 user nova-compute[75045]: INFO os_vif [None req-3def43d3-206f-442c-b61c-d322c6f58e23 tempest-ServersNegativeTestJSON-1185286380 tempest-ServersNegativeTestJSON-1185286380-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:37:87:58,bridge_name='br-int',has_traffic_filtering=True,id=ebefec6f-8abb-429a-90dd-8a6995ad4625,network=Network(eac8b567-0d31-42ec-b05d-2ca251612286),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapebefec6f-8a')
Nov 08 23:41:14 user nova-compute[75045]: INFO nova.virt.libvirt.driver [None req-3def43d3-206f-442c-b61c-d322c6f58e23 tempest-ServersNegativeTestJSON-1185286380 tempest-ServersNegativeTestJSON-1185286380-project-member] [instance: c3df54db-78d7-436b-b86a-df3257b170e6] Deleting instance files /opt/stack/data/nova/instances/c3df54db-78d7-436b-b86a-df3257b170e6_del
Nov 08 23:41:14 user nova-compute[75045]: INFO nova.virt.libvirt.driver [None req-3def43d3-206f-442c-b61c-d322c6f58e23 tempest-ServersNegativeTestJSON-1185286380 tempest-ServersNegativeTestJSON-1185286380-project-member] [instance: c3df54db-78d7-436b-b86a-df3257b170e6] Deletion of /opt/stack/data/nova/instances/c3df54db-78d7-436b-b86a-df3257b170e6_del complete
Nov 08 23:41:14 user nova-compute[75045]: INFO nova.compute.manager [None req-3def43d3-206f-442c-b61c-d322c6f58e23 tempest-ServersNegativeTestJSON-1185286380 tempest-ServersNegativeTestJSON-1185286380-project-member] [instance: c3df54db-78d7-436b-b86a-df3257b170e6] Took 0.67 seconds to destroy the instance on the hypervisor.
Nov 08 23:41:14 user nova-compute[75045]: DEBUG oslo.service.loopingcall [None req-3def43d3-206f-442c-b61c-d322c6f58e23 tempest-ServersNegativeTestJSON-1185286380 tempest-ServersNegativeTestJSON-1185286380-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75045) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 23:41:14 user nova-compute[75045]: DEBUG nova.compute.manager [-] [instance: c3df54db-78d7-436b-b86a-df3257b170e6] Deallocating network for instance {{(pid=75045) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 23:41:14 user nova-compute[75045]: DEBUG nova.network.neutron [-] [instance: c3df54db-78d7-436b-b86a-df3257b170e6] deallocate_for_instance() {{(pid=75045) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 23:41:14 user nova-compute[75045]: DEBUG nova.network.neutron [-] [instance: c3df54db-78d7-436b-b86a-df3257b170e6] Updating instance_info_cache with network_info: [] {{(pid=75045) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 23:41:15 user nova-compute[75045]: INFO nova.compute.manager [-] [instance: c3df54db-78d7-436b-b86a-df3257b170e6] Took 0.46 seconds to deallocate network for instance.
Nov 08 23:41:15 user nova-compute[75045]: DEBUG nova.compute.manager [req-30368dfa-6d2c-4acf-b90d-026219797381 req-450a14a6-80cb-4978-9b59-35a91fabe40a service nova] [instance: c3df54db-78d7-436b-b86a-df3257b170e6] Received event network-vif-deleted-ebefec6f-8abb-429a-90dd-8a6995ad4625 {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:41:15 user nova-compute[75045]: INFO nova.compute.manager [req-30368dfa-6d2c-4acf-b90d-026219797381 req-450a14a6-80cb-4978-9b59-35a91fabe40a service nova] [instance: c3df54db-78d7-436b-b86a-df3257b170e6] Neutron deleted interface ebefec6f-8abb-429a-90dd-8a6995ad4625; detaching it from the instance and deleting it from the info cache
Nov 08 23:41:15 user nova-compute[75045]: DEBUG nova.network.neutron [req-30368dfa-6d2c-4acf-b90d-026219797381 req-450a14a6-80cb-4978-9b59-35a91fabe40a service nova] [instance: c3df54db-78d7-436b-b86a-df3257b170e6] Updating instance_info_cache with network_info: [] {{(pid=75045) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 23:41:15 user nova-compute[75045]: DEBUG nova.compute.manager [req-30368dfa-6d2c-4acf-b90d-026219797381 req-450a14a6-80cb-4978-9b59-35a91fabe40a service nova] [instance: c3df54db-78d7-436b-b86a-df3257b170e6] Detach interface failed, port_id=ebefec6f-8abb-429a-90dd-8a6995ad4625, reason: Instance c3df54db-78d7-436b-b86a-df3257b170e6 could not be found. {{(pid=75045) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 08 23:41:15 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-3def43d3-206f-442c-b61c-d322c6f58e23 tempest-ServersNegativeTestJSON-1185286380 tempest-ServersNegativeTestJSON-1185286380-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:41:15 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-3def43d3-206f-442c-b61c-d322c6f58e23 tempest-ServersNegativeTestJSON-1185286380 tempest-ServersNegativeTestJSON-1185286380-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:41:15 user nova-compute[75045]: DEBUG nova.compute.provider_tree [None req-3def43d3-206f-442c-b61c-d322c6f58e23 tempest-ServersNegativeTestJSON-1185286380 tempest-ServersNegativeTestJSON-1185286380-project-member] Inventory has not changed in ProviderTree for provider: 62ba5f85-c74d-4b58-986e-d4197e813fd7 {{(pid=75045) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 23:41:15 user nova-compute[75045]: DEBUG nova.scheduler.client.report [None req-3def43d3-206f-442c-b61c-d322c6f58e23 tempest-ServersNegativeTestJSON-1185286380 tempest-ServersNegativeTestJSON-1185286380-project-member] Inventory has not changed for provider 62ba5f85-c74d-4b58-986e-d4197e813fd7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75045) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 23:41:15 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-3def43d3-206f-442c-b61c-d322c6f58e23 tempest-ServersNegativeTestJSON-1185286380 tempest-ServersNegativeTestJSON-1185286380-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.223s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:41:15 user nova-compute[75045]: INFO nova.scheduler.client.report [None req-3def43d3-206f-442c-b61c-d322c6f58e23 tempest-ServersNegativeTestJSON-1185286380 tempest-ServersNegativeTestJSON-1185286380-project-member] Deleted allocations for instance c3df54db-78d7-436b-b86a-df3257b170e6
Nov 08 23:41:15 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-3def43d3-206f-442c-b61c-d322c6f58e23 tempest-ServersNegativeTestJSON-1185286380 tempest-ServersNegativeTestJSON-1185286380-project-member] Lock "c3df54db-78d7-436b-b86a-df3257b170e6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.569s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:41:16 user nova-compute[75045]: DEBUG nova.compute.manager [req-85158013-1f93-4881-a551-52664292da13 req-2e5dd44a-05ea-43c8-9f4c-cc058ff9b8cc service nova] [instance: c3df54db-78d7-436b-b86a-df3257b170e6] Received event network-vif-plugged-ebefec6f-8abb-429a-90dd-8a6995ad4625 {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:41:16 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-85158013-1f93-4881-a551-52664292da13 req-2e5dd44a-05ea-43c8-9f4c-cc058ff9b8cc service nova] Acquiring lock "c3df54db-78d7-436b-b86a-df3257b170e6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:41:16 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-85158013-1f93-4881-a551-52664292da13 req-2e5dd44a-05ea-43c8-9f4c-cc058ff9b8cc service nova] Lock "c3df54db-78d7-436b-b86a-df3257b170e6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:41:16 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-85158013-1f93-4881-a551-52664292da13 req-2e5dd44a-05ea-43c8-9f4c-cc058ff9b8cc service nova] Lock "c3df54db-78d7-436b-b86a-df3257b170e6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:41:16 user nova-compute[75045]: DEBUG nova.compute.manager [req-85158013-1f93-4881-a551-52664292da13 req-2e5dd44a-05ea-43c8-9f4c-cc058ff9b8cc service nova] [instance: c3df54db-78d7-436b-b86a-df3257b170e6] No waiting events found dispatching network-vif-plugged-ebefec6f-8abb-429a-90dd-8a6995ad4625 {{(pid=75045) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 23:41:16 user nova-compute[75045]: WARNING nova.compute.manager [req-85158013-1f93-4881-a551-52664292da13 req-2e5dd44a-05ea-43c8-9f4c-cc058ff9b8cc service nova] [instance: c3df54db-78d7-436b-b86a-df3257b170e6] Received unexpected event network-vif-plugged-ebefec6f-8abb-429a-90dd-8a6995ad4625 for instance with vm_state deleted and task_state None.
Nov 08 23:41:16 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:41:19 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:41:21 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:41:22 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-065cd1a9-cec6-46bc-ae76-b2ee5a59e863 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] Acquiring lock "584e3043-addf-41f7-a3cd-de51c229af72" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:41:22 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-065cd1a9-cec6-46bc-ae76-b2ee5a59e863 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] Lock "584e3043-addf-41f7-a3cd-de51c229af72" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:41:22 user nova-compute[75045]: DEBUG nova.compute.manager [None req-065cd1a9-cec6-46bc-ae76-b2ee5a59e863 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] [instance: 584e3043-addf-41f7-a3cd-de51c229af72] Starting instance... {{(pid=75045) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 23:41:22 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-065cd1a9-cec6-46bc-ae76-b2ee5a59e863 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:41:22 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-065cd1a9-cec6-46bc-ae76-b2ee5a59e863 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:41:22 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-065cd1a9-cec6-46bc-ae76-b2ee5a59e863 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75045) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 23:41:22 user nova-compute[75045]: INFO nova.compute.claims [None req-065cd1a9-cec6-46bc-ae76-b2ee5a59e863 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] [instance: 584e3043-addf-41f7-a3cd-de51c229af72] Claim successful on node user
Nov 08 23:41:23 user nova-compute[75045]: DEBUG nova.compute.provider_tree [None req-065cd1a9-cec6-46bc-ae76-b2ee5a59e863 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] Inventory has not changed in ProviderTree for provider: 62ba5f85-c74d-4b58-986e-d4197e813fd7 {{(pid=75045) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 23:41:23 user nova-compute[75045]: DEBUG nova.scheduler.client.report [None req-065cd1a9-cec6-46bc-ae76-b2ee5a59e863 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] Inventory has not changed for provider 62ba5f85-c74d-4b58-986e-d4197e813fd7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75045) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 23:41:23 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-065cd1a9-cec6-46bc-ae76-b2ee5a59e863 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.353s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:41:23 user nova-compute[75045]: DEBUG nova.compute.manager [None req-065cd1a9-cec6-46bc-ae76-b2ee5a59e863 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] [instance: 584e3043-addf-41f7-a3cd-de51c229af72] Start building networks asynchronously for instance. {{(pid=75045) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 23:41:23 user nova-compute[75045]: DEBUG nova.compute.manager [None req-065cd1a9-cec6-46bc-ae76-b2ee5a59e863 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] [instance: 584e3043-addf-41f7-a3cd-de51c229af72] Allocating IP information in the background. {{(pid=75045) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 23:41:23 user nova-compute[75045]: DEBUG nova.network.neutron [None req-065cd1a9-cec6-46bc-ae76-b2ee5a59e863 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] [instance: 584e3043-addf-41f7-a3cd-de51c229af72] allocate_for_instance() {{(pid=75045) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 23:41:23 user nova-compute[75045]: INFO nova.virt.libvirt.driver [None req-065cd1a9-cec6-46bc-ae76-b2ee5a59e863 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] [instance: 584e3043-addf-41f7-a3cd-de51c229af72] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 23:41:23 user nova-compute[75045]: DEBUG nova.compute.manager [None req-065cd1a9-cec6-46bc-ae76-b2ee5a59e863 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] [instance: 584e3043-addf-41f7-a3cd-de51c229af72] Start building block device mappings for instance. {{(pid=75045) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 23:41:23 user nova-compute[75045]: DEBUG nova.policy [None req-065cd1a9-cec6-46bc-ae76-b2ee5a59e863 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7a98fe96727741d0b148f3aaa8abf6f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ad736027d034259a052da3f62bd575f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75045) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 23:41:23 user nova-compute[75045]: DEBUG nova.compute.manager [None req-065cd1a9-cec6-46bc-ae76-b2ee5a59e863 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] [instance: 584e3043-addf-41f7-a3cd-de51c229af72] Start spawning the instance on the hypervisor. {{(pid=75045) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 23:41:23 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-065cd1a9-cec6-46bc-ae76-b2ee5a59e863 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] [instance: 584e3043-addf-41f7-a3cd-de51c229af72] Creating instance directory {{(pid=75045) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 23:41:23 user nova-compute[75045]: INFO nova.virt.libvirt.driver [None req-065cd1a9-cec6-46bc-ae76-b2ee5a59e863 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] [instance: 584e3043-addf-41f7-a3cd-de51c229af72] Creating image(s)
Nov 08 23:41:23 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-065cd1a9-cec6-46bc-ae76-b2ee5a59e863 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] Acquiring lock "/opt/stack/data/nova/instances/584e3043-addf-41f7-a3cd-de51c229af72/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:41:23 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-065cd1a9-cec6-46bc-ae76-b2ee5a59e863 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] Lock "/opt/stack/data/nova/instances/584e3043-addf-41f7-a3cd-de51c229af72/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:41:23 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-065cd1a9-cec6-46bc-ae76-b2ee5a59e863 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] Lock "/opt/stack/data/nova/instances/584e3043-addf-41f7-a3cd-de51c229af72/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:41:23 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-065cd1a9-cec6-46bc-ae76-b2ee5a59e863 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b59f52a99fff51c56dd1edfb83892fb8f647f2f3 --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:41:23 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-065cd1a9-cec6-46bc-ae76-b2ee5a59e863 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b59f52a99fff51c56dd1edfb83892fb8f647f2f3 --force-share --output=json" returned: 0 in 0.194s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:41:23 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-065cd1a9-cec6-46bc-ae76-b2ee5a59e863 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] Acquiring lock "b59f52a99fff51c56dd1edfb83892fb8f647f2f3" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:41:23 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-065cd1a9-cec6-46bc-ae76-b2ee5a59e863 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] Lock "b59f52a99fff51c56dd1edfb83892fb8f647f2f3" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:41:23 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-065cd1a9-cec6-46bc-ae76-b2ee5a59e863 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b59f52a99fff51c56dd1edfb83892fb8f647f2f3 --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:41:23 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-065cd1a9-cec6-46bc-ae76-b2ee5a59e863 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b59f52a99fff51c56dd1edfb83892fb8f647f2f3 --force-share --output=json" returned: 0 in 0.176s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:41:23 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-065cd1a9-cec6-46bc-ae76-b2ee5a59e863 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b59f52a99fff51c56dd1edfb83892fb8f647f2f3,backing_fmt=raw /opt/stack/data/nova/instances/584e3043-addf-41f7-a3cd-de51c229af72/disk 1073741824 {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:41:23 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-065cd1a9-cec6-46bc-ae76-b2ee5a59e863 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b59f52a99fff51c56dd1edfb83892fb8f647f2f3,backing_fmt=raw /opt/stack/data/nova/instances/584e3043-addf-41f7-a3cd-de51c229af72/disk 1073741824" returned: 0 in 0.051s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:41:23 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-065cd1a9-cec6-46bc-ae76-b2ee5a59e863 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] Lock "b59f52a99fff51c56dd1edfb83892fb8f647f2f3" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.234s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:41:23 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-065cd1a9-cec6-46bc-ae76-b2ee5a59e863 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b59f52a99fff51c56dd1edfb83892fb8f647f2f3 --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:41:24 user nova-compute[75045]: DEBUG nova.network.neutron [None req-065cd1a9-cec6-46bc-ae76-b2ee5a59e863 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] [instance: 584e3043-addf-41f7-a3cd-de51c229af72] Successfully created port: 8b02e567-10f8-4153-88a4-9ce005c1fff3 {{(pid=75045) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 23:41:24 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-065cd1a9-cec6-46bc-ae76-b2ee5a59e863 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b59f52a99fff51c56dd1edfb83892fb8f647f2f3 --force-share --output=json" returned: 0 in 0.197s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:41:24 user nova-compute[75045]: DEBUG nova.virt.disk.api [None req-065cd1a9-cec6-46bc-ae76-b2ee5a59e863 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] Checking if we can resize image /opt/stack/data/nova/instances/584e3043-addf-41f7-a3cd-de51c229af72/disk. size=1073741824 {{(pid=75045) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 23:41:24 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-065cd1a9-cec6-46bc-ae76-b2ee5a59e863 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/584e3043-addf-41f7-a3cd-de51c229af72/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:41:24 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-065cd1a9-cec6-46bc-ae76-b2ee5a59e863 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/584e3043-addf-41f7-a3cd-de51c229af72/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:41:24 user nova-compute[75045]: DEBUG nova.virt.disk.api [None req-065cd1a9-cec6-46bc-ae76-b2ee5a59e863 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] Cannot resize image /opt/stack/data/nova/instances/584e3043-addf-41f7-a3cd-de51c229af72/disk to a smaller size. {{(pid=75045) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 08 23:41:24 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-065cd1a9-cec6-46bc-ae76-b2ee5a59e863 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] [instance: 584e3043-addf-41f7-a3cd-de51c229af72] Created local disks {{(pid=75045) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 23:41:24 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-065cd1a9-cec6-46bc-ae76-b2ee5a59e863 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] [instance: 584e3043-addf-41f7-a3cd-de51c229af72] Ensure instance console log exists: /opt/stack/data/nova/instances/584e3043-addf-41f7-a3cd-de51c229af72/console.log {{(pid=75045) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 23:41:24 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-065cd1a9-cec6-46bc-ae76-b2ee5a59e863 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:41:24 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-065cd1a9-cec6-46bc-ae76-b2ee5a59e863 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:41:24 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-065cd1a9-cec6-46bc-ae76-b2ee5a59e863 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:41:24 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:41:25 user nova-compute[75045]: DEBUG nova.network.neutron [None req-065cd1a9-cec6-46bc-ae76-b2ee5a59e863 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] [instance: 584e3043-addf-41f7-a3cd-de51c229af72] Successfully updated port: 8b02e567-10f8-4153-88a4-9ce005c1fff3 {{(pid=75045) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 23:41:25 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-065cd1a9-cec6-46bc-ae76-b2ee5a59e863 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] Acquiring lock "refresh_cache-584e3043-addf-41f7-a3cd-de51c229af72" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 23:41:25 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-065cd1a9-cec6-46bc-ae76-b2ee5a59e863 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] Acquired lock "refresh_cache-584e3043-addf-41f7-a3cd-de51c229af72" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 23:41:25 user nova-compute[75045]: DEBUG nova.network.neutron [None req-065cd1a9-cec6-46bc-ae76-b2ee5a59e863 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] [instance: 584e3043-addf-41f7-a3cd-de51c229af72] Building network info cache for instance {{(pid=75045) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 23:41:25 user nova-compute[75045]: DEBUG nova.compute.manager [req-025ac302-1ff8-4084-8183-d71c7db6e4a6 req-08553d46-049b-430b-8aa6-effb3449be92 service nova] [instance: 584e3043-addf-41f7-a3cd-de51c229af72] Received event network-changed-8b02e567-10f8-4153-88a4-9ce005c1fff3 {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:41:25 user nova-compute[75045]: DEBUG nova.compute.manager [req-025ac302-1ff8-4084-8183-d71c7db6e4a6 req-08553d46-049b-430b-8aa6-effb3449be92 service nova] [instance: 584e3043-addf-41f7-a3cd-de51c229af72] Refreshing instance network info cache due to event network-changed-8b02e567-10f8-4153-88a4-9ce005c1fff3. {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 23:41:25 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-025ac302-1ff8-4084-8183-d71c7db6e4a6 req-08553d46-049b-430b-8aa6-effb3449be92 service nova] Acquiring lock "refresh_cache-584e3043-addf-41f7-a3cd-de51c229af72" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 23:41:25 user nova-compute[75045]: DEBUG nova.network.neutron [None req-065cd1a9-cec6-46bc-ae76-b2ee5a59e863 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] [instance: 584e3043-addf-41f7-a3cd-de51c229af72] Instance cache missing network info. {{(pid=75045) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 23:41:25 user nova-compute[75045]: DEBUG nova.network.neutron [None req-065cd1a9-cec6-46bc-ae76-b2ee5a59e863 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] [instance: 584e3043-addf-41f7-a3cd-de51c229af72] Updating instance_info_cache with network_info: [{"id": "8b02e567-10f8-4153-88a4-9ce005c1fff3", "address": "fa:16:3e:fe:a0:87", "network": {"id": "1b10bc53-ef32-4f01-82f6-ed9f95f7e3f2", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-518782773-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ad736027d034259a052da3f62bd575f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b02e567-10", "ovs_interfaceid": "8b02e567-10f8-4153-88a4-9ce005c1fff3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75045) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 23:41:25 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-065cd1a9-cec6-46bc-ae76-b2ee5a59e863 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] Releasing lock "refresh_cache-584e3043-addf-41f7-a3cd-de51c229af72" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 23:41:25 user nova-compute[75045]: DEBUG nova.compute.manager [None req-065cd1a9-cec6-46bc-ae76-b2ee5a59e863 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] [instance: 584e3043-addf-41f7-a3cd-de51c229af72] Instance network_info: |[{"id": "8b02e567-10f8-4153-88a4-9ce005c1fff3", "address": "fa:16:3e:fe:a0:87", "network": {"id": "1b10bc53-ef32-4f01-82f6-ed9f95f7e3f2", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-518782773-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ad736027d034259a052da3f62bd575f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b02e567-10", "ovs_interfaceid": "8b02e567-10f8-4153-88a4-9ce005c1fff3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75045) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 23:41:25 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-025ac302-1ff8-4084-8183-d71c7db6e4a6 req-08553d46-049b-430b-8aa6-effb3449be92 service nova] Acquired lock "refresh_cache-584e3043-addf-41f7-a3cd-de51c229af72" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 23:41:25 user nova-compute[75045]: DEBUG nova.network.neutron [req-025ac302-1ff8-4084-8183-d71c7db6e4a6 req-08553d46-049b-430b-8aa6-effb3449be92 service nova] [instance: 584e3043-addf-41f7-a3cd-de51c229af72] Refreshing network info cache for port 8b02e567-10f8-4153-88a4-9ce005c1fff3 {{(pid=75045) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 23:41:25 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-065cd1a9-cec6-46bc-ae76-b2ee5a59e863 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] [instance: 584e3043-addf-41f7-a3cd-de51c229af72] Start _get_guest_xml network_info=[{"id": "8b02e567-10f8-4153-88a4-9ce005c1fff3", "address": "fa:16:3e:fe:a0:87", "network": {"id": "1b10bc53-ef32-4f01-82f6-ed9f95f7e3f2", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-518782773-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ad736027d034259a052da3f62bd575f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b02e567-10", "ovs_interfaceid": "8b02e567-10f8-4153-88a4-9ce005c1fff3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T23:11:54Z,direct_url=<?>,disk_format='qcow2',id=a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b1beba2cc4e7465ea249e2225fb494dc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T23:11:56Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'disk_bus': 'virtio', 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': 'a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75045) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 23:41:25 user nova-compute[75045]: WARNING nova.virt.libvirt.driver [None req-065cd1a9-cec6-46bc-ae76-b2ee5a59e863 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 23:41:25 user nova-compute[75045]: WARNING nova.virt.libvirt.driver [None req-065cd1a9-cec6-46bc-ae76-b2ee5a59e863 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 23:41:25 user nova-compute[75045]: DEBUG nova.virt.libvirt.host [None req-065cd1a9-cec6-46bc-ae76-b2ee5a59e863 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75045) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 23:41:25 user nova-compute[75045]: DEBUG nova.virt.libvirt.host [None req-065cd1a9-cec6-46bc-ae76-b2ee5a59e863 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] CPU controller missing on host. {{(pid=75045) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 23:41:25 user nova-compute[75045]: DEBUG nova.virt.libvirt.host [None req-065cd1a9-cec6-46bc-ae76-b2ee5a59e863 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75045) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 23:41:25 user nova-compute[75045]: DEBUG nova.virt.libvirt.host [None req-065cd1a9-cec6-46bc-ae76-b2ee5a59e863 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] CPU controller found on host. {{(pid=75045) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 23:41:25 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-065cd1a9-cec6-46bc-ae76-b2ee5a59e863 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75045) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 23:41:25 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-065cd1a9-cec6-46bc-ae76-b2ee5a59e863 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T23:11:41Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T23:11:54Z,direct_url=<?>,disk_format='qcow2',id=a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b1beba2cc4e7465ea249e2225fb494dc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T23:11:56Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75045) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 23:41:25 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-065cd1a9-cec6-46bc-ae76-b2ee5a59e863 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] Flavor limits 0:0:0 {{(pid=75045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 23:41:25 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-065cd1a9-cec6-46bc-ae76-b2ee5a59e863 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] Image limits 0:0:0 {{(pid=75045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 23:41:25 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-065cd1a9-cec6-46bc-ae76-b2ee5a59e863 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] Flavor pref 0:0:0 {{(pid=75045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 23:41:25 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-065cd1a9-cec6-46bc-ae76-b2ee5a59e863 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] Image pref 0:0:0 {{(pid=75045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 23:41:25 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-065cd1a9-cec6-46bc-ae76-b2ee5a59e863 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 23:41:25 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-065cd1a9-cec6-46bc-ae76-b2ee5a59e863 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75045) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 23:41:25 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-065cd1a9-cec6-46bc-ae76-b2ee5a59e863 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75045) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 23:41:25 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-065cd1a9-cec6-46bc-ae76-b2ee5a59e863 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] Got 1 possible topologies {{(pid=75045) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 23:41:25 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-065cd1a9-cec6-46bc-ae76-b2ee5a59e863 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75045) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 23:41:25 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-065cd1a9-cec6-46bc-ae76-b2ee5a59e863 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75045) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 23:41:25 user nova-compute[75045]: DEBUG nova.virt.libvirt.vif [None req-065cd1a9-cec6-46bc-ae76-b2ee5a59e863 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T23:41:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1201717535',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1201717535',id=41,image_ref='a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDL1Zv99L0Ha9EsCvyr90S90UX2vsiydtiEaWXdaK/WLI6o5JNyURd/0lbHKvXBXdKY02fMl7do4Nh25Fg22RCADhjGB98OjA7zj1WOLqsNETfEin1geBvs6wFI4MnRzYA==',key_name='tempest-keypair-2053037695',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3ad736027d034259a052da3f62bd575f',ramdisk_id='',reservation_id='r-km2oh92z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1769593098',owner_user_name='tempest-AttachVolumeShelveTestJSON-1769593098-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T23:41:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7a98fe96727741d0b148f3aaa8abf6f1',uuid=584e3043-addf-41f7-a3cd-de51c229af72,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8b02e567-10f8-4153-88a4-9ce005c1fff3", "address": "fa:16:3e:fe:a0:87", "network": {"id": "1b10bc53-ef32-4f01-82f6-ed9f95f7e3f2", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-518782773-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ad736027d034259a052da3f62bd575f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b02e567-10", "ovs_interfaceid": "8b02e567-10f8-4153-88a4-9ce005c1fff3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75045) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 23:41:25 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-065cd1a9-cec6-46bc-ae76-b2ee5a59e863 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] Converting VIF {"id": "8b02e567-10f8-4153-88a4-9ce005c1fff3", "address": "fa:16:3e:fe:a0:87", "network": {"id": "1b10bc53-ef32-4f01-82f6-ed9f95f7e3f2", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-518782773-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ad736027d034259a052da3f62bd575f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b02e567-10", "ovs_interfaceid": "8b02e567-10f8-4153-88a4-9ce005c1fff3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 23:41:25 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-065cd1a9-cec6-46bc-ae76-b2ee5a59e863 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fe:a0:87,bridge_name='br-int',has_traffic_filtering=True,id=8b02e567-10f8-4153-88a4-9ce005c1fff3,network=Network(1b10bc53-ef32-4f01-82f6-ed9f95f7e3f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b02e567-10') {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 23:41:25 user nova-compute[75045]: DEBUG nova.objects.instance [None req-065cd1a9-cec6-46bc-ae76-b2ee5a59e863 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] Lazy-loading 'pci_devices' on Instance uuid 584e3043-addf-41f7-a3cd-de51c229af72 {{(pid=75045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 23:41:25 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-065cd1a9-cec6-46bc-ae76-b2ee5a59e863 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] [instance: 584e3043-addf-41f7-a3cd-de51c229af72] End _get_guest_xml xml=<domain type="kvm">
Nov 08 23:41:25 user nova-compute[75045]:   <uuid>584e3043-addf-41f7-a3cd-de51c229af72</uuid>
Nov 08 23:41:25 user nova-compute[75045]:   <name>instance-00000029</name>
Nov 08 23:41:25 user nova-compute[75045]:   <memory>524288</memory>
Nov 08 23:41:25 user nova-compute[75045]:   <vcpu>1</vcpu>
Nov 08 23:41:25 user nova-compute[75045]:   <metadata>
Nov 08 23:41:25 user nova-compute[75045]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 23:41:25 user nova-compute[75045]:       <nova:package version="0.0.0"/>
Nov 08 23:41:25 user nova-compute[75045]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1201717535</nova:name>
Nov 08 23:41:25 user nova-compute[75045]:       <nova:creationTime>2023-11-08 23:41:25</nova:creationTime>
Nov 08 23:41:25 user nova-compute[75045]:       <nova:flavor name="m1.tiny">
Nov 08 23:41:25 user nova-compute[75045]:         <nova:memory>512</nova:memory>
Nov 08 23:41:25 user nova-compute[75045]:         <nova:disk>1</nova:disk>
Nov 08 23:41:25 user nova-compute[75045]:         <nova:swap>0</nova:swap>
Nov 08 23:41:25 user nova-compute[75045]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 23:41:25 user nova-compute[75045]:         <nova:vcpus>1</nova:vcpus>
Nov 08 23:41:25 user nova-compute[75045]:       </nova:flavor>
Nov 08 23:41:25 user nova-compute[75045]:       <nova:owner>
Nov 08 23:41:25 user nova-compute[75045]:         <nova:user uuid="7a98fe96727741d0b148f3aaa8abf6f1">tempest-AttachVolumeShelveTestJSON-1769593098-project-member</nova:user>
Nov 08 23:41:25 user nova-compute[75045]:         <nova:project uuid="3ad736027d034259a052da3f62bd575f">tempest-AttachVolumeShelveTestJSON-1769593098</nova:project>
Nov 08 23:41:25 user nova-compute[75045]:       </nova:owner>
Nov 08 23:41:25 user nova-compute[75045]:       <nova:root type="image" uuid="a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb"/>
Nov 08 23:41:25 user nova-compute[75045]:       <nova:ports>
Nov 08 23:41:25 user nova-compute[75045]:         <nova:port uuid="8b02e567-10f8-4153-88a4-9ce005c1fff3">
Nov 08 23:41:25 user nova-compute[75045]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 08 23:41:25 user nova-compute[75045]:         </nova:port>
Nov 08 23:41:25 user nova-compute[75045]:       </nova:ports>
Nov 08 23:41:25 user nova-compute[75045]:     </nova:instance>
Nov 08 23:41:25 user nova-compute[75045]:   </metadata>
Nov 08 23:41:25 user nova-compute[75045]:   <sysinfo type="smbios">
Nov 08 23:41:25 user nova-compute[75045]:     <system>
Nov 08 23:41:25 user nova-compute[75045]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 23:41:25 user nova-compute[75045]:       <entry name="product">OpenStack Nova</entry>
Nov 08 23:41:25 user nova-compute[75045]:       <entry name="version">0.0.0</entry>
Nov 08 23:41:25 user nova-compute[75045]:       <entry name="serial">584e3043-addf-41f7-a3cd-de51c229af72</entry>
Nov 08 23:41:25 user nova-compute[75045]:       <entry name="uuid">584e3043-addf-41f7-a3cd-de51c229af72</entry>
Nov 08 23:41:25 user nova-compute[75045]:       <entry name="family">Virtual Machine</entry>
Nov 08 23:41:25 user nova-compute[75045]:     </system>
Nov 08 23:41:25 user nova-compute[75045]:   </sysinfo>
Nov 08 23:41:25 user nova-compute[75045]:   <os>
Nov 08 23:41:25 user nova-compute[75045]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 23:41:25 user nova-compute[75045]:     <boot dev="hd"/>
Nov 08 23:41:25 user nova-compute[75045]:     <smbios mode="sysinfo"/>
Nov 08 23:41:25 user nova-compute[75045]:   </os>
Nov 08 23:41:25 user nova-compute[75045]:   <features>
Nov 08 23:41:25 user nova-compute[75045]:     <acpi/>
Nov 08 23:41:25 user nova-compute[75045]:     <apic/>
Nov 08 23:41:25 user nova-compute[75045]:     <vmcoreinfo/>
Nov 08 23:41:25 user nova-compute[75045]:   </features>
Nov 08 23:41:25 user nova-compute[75045]:   <clock offset="utc">
Nov 08 23:41:25 user nova-compute[75045]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 23:41:25 user nova-compute[75045]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 23:41:25 user nova-compute[75045]:     <timer name="hpet" present="no"/>
Nov 08 23:41:25 user nova-compute[75045]:   </clock>
Nov 08 23:41:25 user nova-compute[75045]:   <cpu mode="custom" match="exact">
Nov 08 23:41:25 user nova-compute[75045]:     <model>Nehalem</model>
Nov 08 23:41:25 user nova-compute[75045]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 23:41:25 user nova-compute[75045]:   </cpu>
Nov 08 23:41:25 user nova-compute[75045]:   <devices>
Nov 08 23:41:25 user nova-compute[75045]:     <disk type="file" device="disk">
Nov 08 23:41:25 user nova-compute[75045]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 23:41:25 user nova-compute[75045]:       <source file="/opt/stack/data/nova/instances/584e3043-addf-41f7-a3cd-de51c229af72/disk"/>
Nov 08 23:41:25 user nova-compute[75045]:       <target dev="vda" bus="virtio"/>
Nov 08 23:41:25 user nova-compute[75045]:     </disk>
Nov 08 23:41:25 user nova-compute[75045]:     <interface type="ethernet">
Nov 08 23:41:25 user nova-compute[75045]:       <mac address="fa:16:3e:fe:a0:87"/>
Nov 08 23:41:25 user nova-compute[75045]:       <model type="virtio"/>
Nov 08 23:41:25 user nova-compute[75045]:       <mtu size="1442"/>
Nov 08 23:41:25 user nova-compute[75045]:       <target dev="tap8b02e567-10"/>
Nov 08 23:41:25 user nova-compute[75045]:     </interface>
Nov 08 23:41:25 user nova-compute[75045]:     <serial type="pty">
Nov 08 23:41:25 user nova-compute[75045]:       <log file="/opt/stack/data/nova/instances/584e3043-addf-41f7-a3cd-de51c229af72/console.log" append="off"/>
Nov 08 23:41:25 user nova-compute[75045]:     </serial>
Nov 08 23:41:25 user nova-compute[75045]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 23:41:25 user nova-compute[75045]:     <video>
Nov 08 23:41:25 user nova-compute[75045]:       <model type="virtio"/>
Nov 08 23:41:25 user nova-compute[75045]:     </video>
Nov 08 23:41:25 user nova-compute[75045]:     <rng model="virtio">
Nov 08 23:41:25 user nova-compute[75045]:       <backend model="random">/dev/urandom</backend>
Nov 08 23:41:25 user nova-compute[75045]:     </rng>
Nov 08 23:41:25 user nova-compute[75045]:     <controller type="usb" index="0" model="none"/>
Nov 08 23:41:25 user nova-compute[75045]:     <memballoon model="virtio">
Nov 08 23:41:25 user nova-compute[75045]:       <stats period="10"/>
Nov 08 23:41:25 user nova-compute[75045]:     </memballoon>
Nov 08 23:41:25 user nova-compute[75045]:   </devices>
Nov 08 23:41:25 user nova-compute[75045]: </domain>
Nov 08 23:41:25 user nova-compute[75045]:  {{(pid=75045) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 23:41:25 user nova-compute[75045]: DEBUG nova.virt.libvirt.vif [None req-065cd1a9-cec6-46bc-ae76-b2ee5a59e863 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T23:41:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1201717535',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1201717535',id=41,image_ref='a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDL1Zv99L0Ha9EsCvyr90S90UX2vsiydtiEaWXdaK/WLI6o5JNyURd/0lbHKvXBXdKY02fMl7do4Nh25Fg22RCADhjGB98OjA7zj1WOLqsNETfEin1geBvs6wFI4MnRzYA==',key_name='tempest-keypair-2053037695',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3ad736027d034259a052da3f62bd575f',ramdisk_id='',reservation_id='r-km2oh92z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1769593098',owner_user_name='tempest-AttachVolumeShelveTestJSON-1769593098-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T23:41:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7a98fe96727741d0b148f3aaa8abf6f1',uuid=584e3043-addf-41f7-a3cd-de51c229af72,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8b02e567-10f8-4153-88a4-9ce005c1fff3", "address": "fa:16:3e:fe:a0:87", "network": {"id": "1b10bc53-ef32-4f01-82f6-ed9f95f7e3f2", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-518782773-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ad736027d034259a052da3f62bd575f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b02e567-10", "ovs_interfaceid": "8b02e567-10f8-4153-88a4-9ce005c1fff3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75045) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 23:41:25 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-065cd1a9-cec6-46bc-ae76-b2ee5a59e863 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] Converting VIF {"id": "8b02e567-10f8-4153-88a4-9ce005c1fff3", "address": "fa:16:3e:fe:a0:87", "network": {"id": "1b10bc53-ef32-4f01-82f6-ed9f95f7e3f2", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-518782773-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ad736027d034259a052da3f62bd575f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b02e567-10", "ovs_interfaceid": "8b02e567-10f8-4153-88a4-9ce005c1fff3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 23:41:25 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-065cd1a9-cec6-46bc-ae76-b2ee5a59e863 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fe:a0:87,bridge_name='br-int',has_traffic_filtering=True,id=8b02e567-10f8-4153-88a4-9ce005c1fff3,network=Network(1b10bc53-ef32-4f01-82f6-ed9f95f7e3f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b02e567-10') {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 23:41:25 user nova-compute[75045]: DEBUG os_vif [None req-065cd1a9-cec6-46bc-ae76-b2ee5a59e863 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fe:a0:87,bridge_name='br-int',has_traffic_filtering=True,id=8b02e567-10f8-4153-88a4-9ce005c1fff3,network=Network(1b10bc53-ef32-4f01-82f6-ed9f95f7e3f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b02e567-10') {{(pid=75045) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 23:41:25 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:41:25 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:41:25 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 23:41:25 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:41:25 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ee08f0b3-7c08-52fe-86dc-ae05846add95', '_type': 'linux-noop'}}, row=False) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:41:25 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:41:25 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:41:25 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:41:25 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8b02e567-10, may_exist=True, interface_attrs={}) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:41:25 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8b02e567-10, col_values=(('qos', UUID('e66230b8-25e5-4c73-b8a8-3ee89d544ffa')),), if_exists=True) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:41:25 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8b02e567-10, col_values=(('external_ids', {'iface-id': '8b02e567-10f8-4153-88a4-9ce005c1fff3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fe:a0:87', 'vm-uuid': '584e3043-addf-41f7-a3cd-de51c229af72'}),), if_exists=True) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:41:25 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:41:25 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 23:41:25 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:41:25 user nova-compute[75045]: INFO os_vif [None req-065cd1a9-cec6-46bc-ae76-b2ee5a59e863 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fe:a0:87,bridge_name='br-int',has_traffic_filtering=True,id=8b02e567-10f8-4153-88a4-9ce005c1fff3,network=Network(1b10bc53-ef32-4f01-82f6-ed9f95f7e3f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b02e567-10')
Nov 08 23:41:25 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-065cd1a9-cec6-46bc-ae76-b2ee5a59e863 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] No BDM found with device name vda, not building metadata. {{(pid=75045) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 23:41:25 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-065cd1a9-cec6-46bc-ae76-b2ee5a59e863 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] No VIF found with MAC fa:16:3e:fe:a0:87, not building metadata {{(pid=75045) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 23:41:25 user nova-compute[75045]: DEBUG nova.network.neutron [req-025ac302-1ff8-4084-8183-d71c7db6e4a6 req-08553d46-049b-430b-8aa6-effb3449be92 service nova] [instance: 584e3043-addf-41f7-a3cd-de51c229af72] Updated VIF entry in instance network info cache for port 8b02e567-10f8-4153-88a4-9ce005c1fff3. {{(pid=75045) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 23:41:25 user nova-compute[75045]: DEBUG nova.network.neutron [req-025ac302-1ff8-4084-8183-d71c7db6e4a6 req-08553d46-049b-430b-8aa6-effb3449be92 service nova] [instance: 584e3043-addf-41f7-a3cd-de51c229af72] Updating instance_info_cache with network_info: [{"id": "8b02e567-10f8-4153-88a4-9ce005c1fff3", "address": "fa:16:3e:fe:a0:87", "network": {"id": "1b10bc53-ef32-4f01-82f6-ed9f95f7e3f2", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-518782773-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ad736027d034259a052da3f62bd575f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b02e567-10", "ovs_interfaceid": "8b02e567-10f8-4153-88a4-9ce005c1fff3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75045) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 23:41:25 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-025ac302-1ff8-4084-8183-d71c7db6e4a6 req-08553d46-049b-430b-8aa6-effb3449be92 service nova] Releasing lock "refresh_cache-584e3043-addf-41f7-a3cd-de51c229af72" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 23:41:26 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:41:26 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:41:26 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:41:26 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:41:27 user nova-compute[75045]: DEBUG nova.compute.manager [req-72542164-01df-49d9-a7e4-c1b53744a360 req-2b28d5b4-bbf3-4784-bec7-f3badfa4525b service nova] [instance: 584e3043-addf-41f7-a3cd-de51c229af72] Received event network-vif-plugged-8b02e567-10f8-4153-88a4-9ce005c1fff3 {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:41:27 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-72542164-01df-49d9-a7e4-c1b53744a360 req-2b28d5b4-bbf3-4784-bec7-f3badfa4525b service nova] Acquiring lock "584e3043-addf-41f7-a3cd-de51c229af72-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:41:27 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-72542164-01df-49d9-a7e4-c1b53744a360 req-2b28d5b4-bbf3-4784-bec7-f3badfa4525b service nova] Lock "584e3043-addf-41f7-a3cd-de51c229af72-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:41:27 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-72542164-01df-49d9-a7e4-c1b53744a360 req-2b28d5b4-bbf3-4784-bec7-f3badfa4525b service nova] Lock "584e3043-addf-41f7-a3cd-de51c229af72-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:41:27 user nova-compute[75045]: DEBUG nova.compute.manager [req-72542164-01df-49d9-a7e4-c1b53744a360 req-2b28d5b4-bbf3-4784-bec7-f3badfa4525b service nova] [instance: 584e3043-addf-41f7-a3cd-de51c229af72] No waiting events found dispatching network-vif-plugged-8b02e567-10f8-4153-88a4-9ce005c1fff3 {{(pid=75045) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 23:41:27 user nova-compute[75045]: WARNING nova.compute.manager [req-72542164-01df-49d9-a7e4-c1b53744a360 req-2b28d5b4-bbf3-4784-bec7-f3badfa4525b service nova] [instance: 584e3043-addf-41f7-a3cd-de51c229af72] Received unexpected event network-vif-plugged-8b02e567-10f8-4153-88a4-9ce005c1fff3 for instance with vm_state building and task_state spawning.
Nov 08 23:41:27 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:41:27 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:41:27 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:41:29 user nova-compute[75045]: DEBUG nova.compute.manager [None req-065cd1a9-cec6-46bc-ae76-b2ee5a59e863 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] [instance: 584e3043-addf-41f7-a3cd-de51c229af72] Instance event wait completed in 0 seconds for  {{(pid=75045) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 23:41:29 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-065cd1a9-cec6-46bc-ae76-b2ee5a59e863 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] [instance: 584e3043-addf-41f7-a3cd-de51c229af72] Guest created on hypervisor {{(pid=75045) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 23:41:29 user nova-compute[75045]: INFO nova.virt.libvirt.driver [-] [instance: 584e3043-addf-41f7-a3cd-de51c229af72] Instance spawned successfully.
Nov 08 23:41:29 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-065cd1a9-cec6-46bc-ae76-b2ee5a59e863 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] [instance: 584e3043-addf-41f7-a3cd-de51c229af72] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75045) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 23:41:29 user nova-compute[75045]: DEBUG nova.compute.manager [req-07c5ef14-70c6-4d9c-a375-a5afa7d1c770 req-2e740f27-bf79-49e6-8e92-347a3e3ae74f service nova] [instance: 584e3043-addf-41f7-a3cd-de51c229af72] Received event network-vif-plugged-8b02e567-10f8-4153-88a4-9ce005c1fff3 {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:41:29 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-07c5ef14-70c6-4d9c-a375-a5afa7d1c770 req-2e740f27-bf79-49e6-8e92-347a3e3ae74f service nova] Acquiring lock "584e3043-addf-41f7-a3cd-de51c229af72-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:41:29 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-07c5ef14-70c6-4d9c-a375-a5afa7d1c770 req-2e740f27-bf79-49e6-8e92-347a3e3ae74f service nova] Lock "584e3043-addf-41f7-a3cd-de51c229af72-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:41:29 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-07c5ef14-70c6-4d9c-a375-a5afa7d1c770 req-2e740f27-bf79-49e6-8e92-347a3e3ae74f service nova] Lock "584e3043-addf-41f7-a3cd-de51c229af72-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:41:29 user nova-compute[75045]: DEBUG nova.compute.manager [req-07c5ef14-70c6-4d9c-a375-a5afa7d1c770 req-2e740f27-bf79-49e6-8e92-347a3e3ae74f service nova] [instance: 584e3043-addf-41f7-a3cd-de51c229af72] No waiting events found dispatching network-vif-plugged-8b02e567-10f8-4153-88a4-9ce005c1fff3 {{(pid=75045) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 23:41:29 user nova-compute[75045]: WARNING nova.compute.manager [req-07c5ef14-70c6-4d9c-a375-a5afa7d1c770 req-2e740f27-bf79-49e6-8e92-347a3e3ae74f service nova] [instance: 584e3043-addf-41f7-a3cd-de51c229af72] Received unexpected event network-vif-plugged-8b02e567-10f8-4153-88a4-9ce005c1fff3 for instance with vm_state building and task_state spawning.
Nov 08 23:41:29 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-065cd1a9-cec6-46bc-ae76-b2ee5a59e863 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] [instance: 584e3043-addf-41f7-a3cd-de51c229af72] Found default for hw_cdrom_bus of ide {{(pid=75045) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 23:41:29 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-065cd1a9-cec6-46bc-ae76-b2ee5a59e863 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] [instance: 584e3043-addf-41f7-a3cd-de51c229af72] Found default for hw_disk_bus of virtio {{(pid=75045) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 23:41:29 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-065cd1a9-cec6-46bc-ae76-b2ee5a59e863 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] [instance: 584e3043-addf-41f7-a3cd-de51c229af72] Found default for hw_input_bus of None {{(pid=75045) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 23:41:29 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-065cd1a9-cec6-46bc-ae76-b2ee5a59e863 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] [instance: 584e3043-addf-41f7-a3cd-de51c229af72] Found default for hw_pointer_model of None {{(pid=75045) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 23:41:29 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-065cd1a9-cec6-46bc-ae76-b2ee5a59e863 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] [instance: 584e3043-addf-41f7-a3cd-de51c229af72] Found default for hw_video_model of virtio {{(pid=75045) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 23:41:29 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-065cd1a9-cec6-46bc-ae76-b2ee5a59e863 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] [instance: 584e3043-addf-41f7-a3cd-de51c229af72] Found default for hw_vif_model of virtio {{(pid=75045) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 23:41:29 user nova-compute[75045]: INFO nova.compute.manager [None req-065cd1a9-cec6-46bc-ae76-b2ee5a59e863 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] [instance: 584e3043-addf-41f7-a3cd-de51c229af72] Took 5.92 seconds to spawn the instance on the hypervisor.
Nov 08 23:41:29 user nova-compute[75045]: DEBUG nova.compute.manager [None req-065cd1a9-cec6-46bc-ae76-b2ee5a59e863 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] [instance: 584e3043-addf-41f7-a3cd-de51c229af72] Checking state {{(pid=75045) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 23:41:29 user nova-compute[75045]: INFO nova.compute.manager [None req-065cd1a9-cec6-46bc-ae76-b2ee5a59e863 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] [instance: 584e3043-addf-41f7-a3cd-de51c229af72] Took 6.63 seconds to build instance.
Nov 08 23:41:29 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-065cd1a9-cec6-46bc-ae76-b2ee5a59e863 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] Lock "584e3043-addf-41f7-a3cd-de51c229af72" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.745s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:41:30 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:41:31 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:41:32 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:41:35 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:41:38 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:41:40 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:41:40 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:41:41 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:41:42 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-012777e1-8101-4b1f-b735-792dc1f928c7 tempest-ServerStableDeviceRescueTest-1847572360 tempest-ServerStableDeviceRescueTest-1847572360-project-member] Acquiring lock "7ee587a0-e271-4262-a252-2ccb6c2faecb" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:41:42 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-012777e1-8101-4b1f-b735-792dc1f928c7 tempest-ServerStableDeviceRescueTest-1847572360 tempest-ServerStableDeviceRescueTest-1847572360-project-member] Lock "7ee587a0-e271-4262-a252-2ccb6c2faecb" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:41:42 user nova-compute[75045]: DEBUG nova.objects.instance [None req-012777e1-8101-4b1f-b735-792dc1f928c7 tempest-ServerStableDeviceRescueTest-1847572360 tempest-ServerStableDeviceRescueTest-1847572360-project-member] Lazy-loading 'flavor' on Instance uuid 7ee587a0-e271-4262-a252-2ccb6c2faecb {{(pid=75045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 23:41:42 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-012777e1-8101-4b1f-b735-792dc1f928c7 tempest-ServerStableDeviceRescueTest-1847572360 tempest-ServerStableDeviceRescueTest-1847572360-project-member] Lock "7ee587a0-e271-4262-a252-2ccb6c2faecb" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.072s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:41:42 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-012777e1-8101-4b1f-b735-792dc1f928c7 tempest-ServerStableDeviceRescueTest-1847572360 tempest-ServerStableDeviceRescueTest-1847572360-project-member] Acquiring lock "7ee587a0-e271-4262-a252-2ccb6c2faecb" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:41:42 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-012777e1-8101-4b1f-b735-792dc1f928c7 tempest-ServerStableDeviceRescueTest-1847572360 tempest-ServerStableDeviceRescueTest-1847572360-project-member] Lock "7ee587a0-e271-4262-a252-2ccb6c2faecb" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:41:42 user nova-compute[75045]: INFO nova.compute.manager [None req-012777e1-8101-4b1f-b735-792dc1f928c7 tempest-ServerStableDeviceRescueTest-1847572360 tempest-ServerStableDeviceRescueTest-1847572360-project-member] [instance: 7ee587a0-e271-4262-a252-2ccb6c2faecb] Attaching volume 7bd77e85-94b5-49aa-8412-c200279e0748 to /dev/vdb
Nov 08 23:41:43 user nova-compute[75045]: DEBUG os_brick.utils [None req-012777e1-8101-4b1f-b735-792dc1f928c7 tempest-ServerStableDeviceRescueTest-1847572360 tempest-ServerStableDeviceRescueTest-1847572360-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75045) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 23:41:43 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:41:43 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:41:43 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f8f9de4-7398-4486-8183-6f17453095a0]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6217bd6e884\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:41:43 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:41:43 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:41:43 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[02aab76d-5992-4049-9155-e055ea83927c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:41:43 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:41:43 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:41:43 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[25dbf82c-c0d5-4366-9a66-0eae4051f2c1]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:41:43 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[5266bf9e-d07e-4ed0-94cb-c0521358c39c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:41:43 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-012777e1-8101-4b1f-b735-792dc1f928c7 tempest-ServerStableDeviceRescueTest-1847572360 tempest-ServerStableDeviceRescueTest-1847572360-project-member] Running cmd (subprocess): nvme version {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:41:43 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-012777e1-8101-4b1f-b735-792dc1f928c7 tempest-ServerStableDeviceRescueTest-1847572360 tempest-ServerStableDeviceRescueTest-1847572360-project-member] 'nvme version' failed. Not Retrying. {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 23:41:43 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.nvmeof [None req-012777e1-8101-4b1f-b735-792dc1f928c7 tempest-ServerStableDeviceRescueTest-1847572360 tempest-ServerStableDeviceRescueTest-1847572360-project-member] nvme not present on system {{(pid=75045) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 23:41:43 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:41:43 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 23:41:43 user nova-compute[75045]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 23:41:43 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[07830202-204c-4296-9e50-5108666e085e]: (4, '') {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:41:43 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.lightos [None req-012777e1-8101-4b1f-b735-792dc1f928c7 tempest-ServerStableDeviceRescueTest-1847572360 tempest-ServerStableDeviceRescueTest-1847572360-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75045) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 23:41:43 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.lightos [None req-012777e1-8101-4b1f-b735-792dc1f928c7 tempest-ServerStableDeviceRescueTest-1847572360 tempest-ServerStableDeviceRescueTest-1847572360-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75045) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 23:41:43 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.lightos [None req-012777e1-8101-4b1f-b735-792dc1f928c7 tempest-ServerStableDeviceRescueTest-1847572360 tempest-ServerStableDeviceRescueTest-1847572360-project-member] LIGHTOS: no hostnqn found. {{(pid=75045) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 23:41:43 user nova-compute[75045]: DEBUG os_brick.utils [None req-012777e1-8101-4b1f-b735-792dc1f928c7 tempest-ServerStableDeviceRescueTest-1847572360 tempest-ServerStableDeviceRescueTest-1847572360-project-member] <== get_connector_properties: return (147ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6217bd6e884', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75045) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 23:41:43 user nova-compute[75045]: DEBUG nova.virt.block_device [None req-012777e1-8101-4b1f-b735-792dc1f928c7 tempest-ServerStableDeviceRescueTest-1847572360 tempest-ServerStableDeviceRescueTest-1847572360-project-member] [instance: 7ee587a0-e271-4262-a252-2ccb6c2faecb] Updating existing volume attachment record: ca592629-0c62-4b63-9a6d-288dee039b90 {{(pid=75045) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 23:41:44 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-118ab336-a6f7-4fe1-857c-8674be13b0db tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Acquiring lock "0b413c71-c13a-4fea-91c4-f6b1953d54c6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:41:44 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-118ab336-a6f7-4fe1-857c-8674be13b0db tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Lock "0b413c71-c13a-4fea-91c4-f6b1953d54c6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:41:44 user nova-compute[75045]: DEBUG nova.compute.manager [None req-118ab336-a6f7-4fe1-857c-8674be13b0db tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] [instance: 0b413c71-c13a-4fea-91c4-f6b1953d54c6] Starting instance... {{(pid=75045) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 23:41:44 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-118ab336-a6f7-4fe1-857c-8674be13b0db tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:41:44 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-118ab336-a6f7-4fe1-857c-8674be13b0db tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:41:44 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-118ab336-a6f7-4fe1-857c-8674be13b0db tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75045) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 23:41:44 user nova-compute[75045]: INFO nova.compute.claims [None req-118ab336-a6f7-4fe1-857c-8674be13b0db tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] [instance: 0b413c71-c13a-4fea-91c4-f6b1953d54c6] Claim successful on node user
Nov 08 23:41:44 user nova-compute[75045]: DEBUG nova.compute.provider_tree [None req-118ab336-a6f7-4fe1-857c-8674be13b0db tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Inventory has not changed in ProviderTree for provider: 62ba5f85-c74d-4b58-986e-d4197e813fd7 {{(pid=75045) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 23:41:44 user nova-compute[75045]: DEBUG nova.scheduler.client.report [None req-118ab336-a6f7-4fe1-857c-8674be13b0db tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Inventory has not changed for provider 62ba5f85-c74d-4b58-986e-d4197e813fd7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75045) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 23:41:44 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-118ab336-a6f7-4fe1-857c-8674be13b0db tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.539s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:41:44 user nova-compute[75045]: DEBUG nova.compute.manager [None req-118ab336-a6f7-4fe1-857c-8674be13b0db tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] [instance: 0b413c71-c13a-4fea-91c4-f6b1953d54c6] Start building networks asynchronously for instance. {{(pid=75045) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 23:41:44 user nova-compute[75045]: DEBUG nova.compute.manager [None req-118ab336-a6f7-4fe1-857c-8674be13b0db tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] [instance: 0b413c71-c13a-4fea-91c4-f6b1953d54c6] Allocating IP information in the background. {{(pid=75045) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 23:41:44 user nova-compute[75045]: DEBUG nova.network.neutron [None req-118ab336-a6f7-4fe1-857c-8674be13b0db tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] [instance: 0b413c71-c13a-4fea-91c4-f6b1953d54c6] allocate_for_instance() {{(pid=75045) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 23:41:44 user nova-compute[75045]: INFO nova.virt.libvirt.driver [None req-118ab336-a6f7-4fe1-857c-8674be13b0db tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] [instance: 0b413c71-c13a-4fea-91c4-f6b1953d54c6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 23:41:44 user nova-compute[75045]: DEBUG nova.compute.manager [None req-118ab336-a6f7-4fe1-857c-8674be13b0db tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] [instance: 0b413c71-c13a-4fea-91c4-f6b1953d54c6] Start building block device mappings for instance. {{(pid=75045) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 23:41:44 user nova-compute[75045]: DEBUG nova.policy [None req-118ab336-a6f7-4fe1-857c-8674be13b0db tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1e3647ad15a24f1584685f9340eae5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8be85d72bc440899f3ccb64b923e90e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75045) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 23:41:45 user nova-compute[75045]: DEBUG nova.compute.manager [None req-118ab336-a6f7-4fe1-857c-8674be13b0db tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] [instance: 0b413c71-c13a-4fea-91c4-f6b1953d54c6] Start spawning the instance on the hypervisor. {{(pid=75045) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 23:41:45 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-118ab336-a6f7-4fe1-857c-8674be13b0db tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] [instance: 0b413c71-c13a-4fea-91c4-f6b1953d54c6] Creating instance directory {{(pid=75045) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 23:41:45 user nova-compute[75045]: INFO nova.virt.libvirt.driver [None req-118ab336-a6f7-4fe1-857c-8674be13b0db tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] [instance: 0b413c71-c13a-4fea-91c4-f6b1953d54c6] Creating image(s)
Nov 08 23:41:45 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-118ab336-a6f7-4fe1-857c-8674be13b0db tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Acquiring lock "/opt/stack/data/nova/instances/0b413c71-c13a-4fea-91c4-f6b1953d54c6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:41:45 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-118ab336-a6f7-4fe1-857c-8674be13b0db tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Lock "/opt/stack/data/nova/instances/0b413c71-c13a-4fea-91c4-f6b1953d54c6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:41:45 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-118ab336-a6f7-4fe1-857c-8674be13b0db tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Lock "/opt/stack/data/nova/instances/0b413c71-c13a-4fea-91c4-f6b1953d54c6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:41:45 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-118ab336-a6f7-4fe1-857c-8674be13b0db tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b59f52a99fff51c56dd1edfb83892fb8f647f2f3 --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:41:45 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-118ab336-a6f7-4fe1-857c-8674be13b0db tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b59f52a99fff51c56dd1edfb83892fb8f647f2f3 --force-share --output=json" returned: 0 in 0.198s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:41:45 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-118ab336-a6f7-4fe1-857c-8674be13b0db tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Acquiring lock "b59f52a99fff51c56dd1edfb83892fb8f647f2f3" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:41:45 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-118ab336-a6f7-4fe1-857c-8674be13b0db tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Lock "b59f52a99fff51c56dd1edfb83892fb8f647f2f3" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:41:45 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-118ab336-a6f7-4fe1-857c-8674be13b0db tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b59f52a99fff51c56dd1edfb83892fb8f647f2f3 --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:41:45 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-118ab336-a6f7-4fe1-857c-8674be13b0db tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b59f52a99fff51c56dd1edfb83892fb8f647f2f3 --force-share --output=json" returned: 0 in 0.170s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:41:45 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-118ab336-a6f7-4fe1-857c-8674be13b0db tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b59f52a99fff51c56dd1edfb83892fb8f647f2f3,backing_fmt=raw /opt/stack/data/nova/instances/0b413c71-c13a-4fea-91c4-f6b1953d54c6/disk 1073741824 {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:41:45 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-118ab336-a6f7-4fe1-857c-8674be13b0db tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b59f52a99fff51c56dd1edfb83892fb8f647f2f3,backing_fmt=raw /opt/stack/data/nova/instances/0b413c71-c13a-4fea-91c4-f6b1953d54c6/disk 1073741824" returned: 0 in 0.070s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:41:45 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-118ab336-a6f7-4fe1-857c-8674be13b0db tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Lock "b59f52a99fff51c56dd1edfb83892fb8f647f2f3" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.249s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:41:45 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-118ab336-a6f7-4fe1-857c-8674be13b0db tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b59f52a99fff51c56dd1edfb83892fb8f647f2f3 --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:41:45 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:41:45 user nova-compute[75045]: DEBUG nova.network.neutron [None req-118ab336-a6f7-4fe1-857c-8674be13b0db tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] [instance: 0b413c71-c13a-4fea-91c4-f6b1953d54c6] Successfully created port: 166cceb4-9b95-4bdd-a3ad-b6aad94dfed0 {{(pid=75045) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 23:41:45 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-118ab336-a6f7-4fe1-857c-8674be13b0db tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b59f52a99fff51c56dd1edfb83892fb8f647f2f3 --force-share --output=json" returned: 0 in 0.181s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:41:45 user nova-compute[75045]: DEBUG nova.virt.disk.api [None req-118ab336-a6f7-4fe1-857c-8674be13b0db tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0b413c71-c13a-4fea-91c4-f6b1953d54c6/disk. size=1073741824 {{(pid=75045) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 23:41:45 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-118ab336-a6f7-4fe1-857c-8674be13b0db tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b413c71-c13a-4fea-91c4-f6b1953d54c6/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:41:45 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-118ab336-a6f7-4fe1-857c-8674be13b0db tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b413c71-c13a-4fea-91c4-f6b1953d54c6/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:41:45 user nova-compute[75045]: DEBUG nova.virt.disk.api [None req-118ab336-a6f7-4fe1-857c-8674be13b0db tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Cannot resize image /opt/stack/data/nova/instances/0b413c71-c13a-4fea-91c4-f6b1953d54c6/disk to a smaller size. {{(pid=75045) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 08 23:41:45 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-118ab336-a6f7-4fe1-857c-8674be13b0db tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] [instance: 0b413c71-c13a-4fea-91c4-f6b1953d54c6] Created local disks {{(pid=75045) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 23:41:45 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-118ab336-a6f7-4fe1-857c-8674be13b0db tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] [instance: 0b413c71-c13a-4fea-91c4-f6b1953d54c6] Ensure instance console log exists: /opt/stack/data/nova/instances/0b413c71-c13a-4fea-91c4-f6b1953d54c6/console.log {{(pid=75045) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 23:41:45 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-118ab336-a6f7-4fe1-857c-8674be13b0db tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:41:45 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-118ab336-a6f7-4fe1-857c-8674be13b0db tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:41:45 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-118ab336-a6f7-4fe1-857c-8674be13b0db tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:41:46 user nova-compute[75045]: DEBUG nova.network.neutron [None req-118ab336-a6f7-4fe1-857c-8674be13b0db tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] [instance: 0b413c71-c13a-4fea-91c4-f6b1953d54c6] Successfully updated port: 166cceb4-9b95-4bdd-a3ad-b6aad94dfed0 {{(pid=75045) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 23:41:46 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-118ab336-a6f7-4fe1-857c-8674be13b0db tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Acquiring lock "refresh_cache-0b413c71-c13a-4fea-91c4-f6b1953d54c6" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 23:41:46 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-118ab336-a6f7-4fe1-857c-8674be13b0db tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Acquired lock "refresh_cache-0b413c71-c13a-4fea-91c4-f6b1953d54c6" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 23:41:46 user nova-compute[75045]: DEBUG nova.network.neutron [None req-118ab336-a6f7-4fe1-857c-8674be13b0db tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] [instance: 0b413c71-c13a-4fea-91c4-f6b1953d54c6] Building network info cache for instance {{(pid=75045) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 23:41:46 user nova-compute[75045]: DEBUG nova.compute.manager [req-56545ff8-026e-435c-986c-d3dc72d98bd9 req-06a08d58-8a2a-405d-a19d-63449b064744 service nova] [instance: 0b413c71-c13a-4fea-91c4-f6b1953d54c6] Received event network-changed-166cceb4-9b95-4bdd-a3ad-b6aad94dfed0 {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:41:46 user nova-compute[75045]: DEBUG nova.compute.manager [req-56545ff8-026e-435c-986c-d3dc72d98bd9 req-06a08d58-8a2a-405d-a19d-63449b064744 service nova] [instance: 0b413c71-c13a-4fea-91c4-f6b1953d54c6] Refreshing instance network info cache due to event network-changed-166cceb4-9b95-4bdd-a3ad-b6aad94dfed0. {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 23:41:46 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-56545ff8-026e-435c-986c-d3dc72d98bd9 req-06a08d58-8a2a-405d-a19d-63449b064744 service nova] Acquiring lock "refresh_cache-0b413c71-c13a-4fea-91c4-f6b1953d54c6" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 23:41:46 user nova-compute[75045]: DEBUG nova.network.neutron [None req-118ab336-a6f7-4fe1-857c-8674be13b0db tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] [instance: 0b413c71-c13a-4fea-91c4-f6b1953d54c6] Instance cache missing network info. {{(pid=75045) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 23:41:46 user nova-compute[75045]: DEBUG nova.network.neutron [None req-118ab336-a6f7-4fe1-857c-8674be13b0db tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] [instance: 0b413c71-c13a-4fea-91c4-f6b1953d54c6] Updating instance_info_cache with network_info: [{"id": "166cceb4-9b95-4bdd-a3ad-b6aad94dfed0", "address": "fa:16:3e:17:84:3d", "network": {"id": "e31c3d41-e46f-4c74-8ef5-8243a391dde8", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-856540424-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c8be85d72bc440899f3ccb64b923e90e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap166cceb4-9b", "ovs_interfaceid": "166cceb4-9b95-4bdd-a3ad-b6aad94dfed0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75045) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 23:41:46 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-118ab336-a6f7-4fe1-857c-8674be13b0db tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Releasing lock "refresh_cache-0b413c71-c13a-4fea-91c4-f6b1953d54c6" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 23:41:46 user nova-compute[75045]: DEBUG nova.compute.manager [None req-118ab336-a6f7-4fe1-857c-8674be13b0db tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] [instance: 0b413c71-c13a-4fea-91c4-f6b1953d54c6] Instance network_info: |[{"id": "166cceb4-9b95-4bdd-a3ad-b6aad94dfed0", "address": "fa:16:3e:17:84:3d", "network": {"id": "e31c3d41-e46f-4c74-8ef5-8243a391dde8", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-856540424-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c8be85d72bc440899f3ccb64b923e90e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap166cceb4-9b", "ovs_interfaceid": "166cceb4-9b95-4bdd-a3ad-b6aad94dfed0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75045) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 23:41:46 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-56545ff8-026e-435c-986c-d3dc72d98bd9 req-06a08d58-8a2a-405d-a19d-63449b064744 service nova] Acquired lock "refresh_cache-0b413c71-c13a-4fea-91c4-f6b1953d54c6" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 23:41:46 user nova-compute[75045]: DEBUG nova.network.neutron [req-56545ff8-026e-435c-986c-d3dc72d98bd9 req-06a08d58-8a2a-405d-a19d-63449b064744 service nova] [instance: 0b413c71-c13a-4fea-91c4-f6b1953d54c6] Refreshing network info cache for port 166cceb4-9b95-4bdd-a3ad-b6aad94dfed0 {{(pid=75045) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 23:41:46 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-118ab336-a6f7-4fe1-857c-8674be13b0db tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] [instance: 0b413c71-c13a-4fea-91c4-f6b1953d54c6] Start _get_guest_xml network_info=[{"id": "166cceb4-9b95-4bdd-a3ad-b6aad94dfed0", "address": "fa:16:3e:17:84:3d", "network": {"id": "e31c3d41-e46f-4c74-8ef5-8243a391dde8", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-856540424-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c8be85d72bc440899f3ccb64b923e90e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap166cceb4-9b", "ovs_interfaceid": "166cceb4-9b95-4bdd-a3ad-b6aad94dfed0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T23:11:54Z,direct_url=<?>,disk_format='qcow2',id=a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b1beba2cc4e7465ea249e2225fb494dc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T23:11:56Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'disk_bus': 'virtio', 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': 'a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75045) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 23:41:46 user nova-compute[75045]: WARNING nova.virt.libvirt.driver [None req-118ab336-a6f7-4fe1-857c-8674be13b0db tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 23:41:46 user nova-compute[75045]: WARNING nova.virt.libvirt.driver [None req-118ab336-a6f7-4fe1-857c-8674be13b0db tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 23:41:46 user nova-compute[75045]: DEBUG nova.virt.libvirt.host [None req-118ab336-a6f7-4fe1-857c-8674be13b0db tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75045) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 23:41:46 user nova-compute[75045]: DEBUG nova.virt.libvirt.host [None req-118ab336-a6f7-4fe1-857c-8674be13b0db tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] CPU controller missing on host. {{(pid=75045) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 23:41:46 user nova-compute[75045]: DEBUG nova.virt.libvirt.host [None req-118ab336-a6f7-4fe1-857c-8674be13b0db tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75045) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 23:41:46 user nova-compute[75045]: DEBUG nova.virt.libvirt.host [None req-118ab336-a6f7-4fe1-857c-8674be13b0db tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] CPU controller found on host. {{(pid=75045) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 23:41:46 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-118ab336-a6f7-4fe1-857c-8674be13b0db tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75045) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 23:41:46 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-118ab336-a6f7-4fe1-857c-8674be13b0db tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T23:11:41Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T23:11:54Z,direct_url=<?>,disk_format='qcow2',id=a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b1beba2cc4e7465ea249e2225fb494dc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T23:11:56Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75045) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 23:41:46 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-118ab336-a6f7-4fe1-857c-8674be13b0db tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Flavor limits 0:0:0 {{(pid=75045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 23:41:46 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-118ab336-a6f7-4fe1-857c-8674be13b0db tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Image limits 0:0:0 {{(pid=75045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 23:41:46 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-118ab336-a6f7-4fe1-857c-8674be13b0db tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Flavor pref 0:0:0 {{(pid=75045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 23:41:46 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-118ab336-a6f7-4fe1-857c-8674be13b0db tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Image pref 0:0:0 {{(pid=75045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 23:41:46 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-118ab336-a6f7-4fe1-857c-8674be13b0db tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 23:41:46 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-118ab336-a6f7-4fe1-857c-8674be13b0db tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75045) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 23:41:46 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-118ab336-a6f7-4fe1-857c-8674be13b0db tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75045) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 23:41:46 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-118ab336-a6f7-4fe1-857c-8674be13b0db tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Got 1 possible topologies {{(pid=75045) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 23:41:46 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-118ab336-a6f7-4fe1-857c-8674be13b0db tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75045) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 23:41:46 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-118ab336-a6f7-4fe1-857c-8674be13b0db tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75045) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 23:41:46 user nova-compute[75045]: DEBUG nova.virt.libvirt.vif [None req-118ab336-a6f7-4fe1-857c-8674be13b0db tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T23:41:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1115991455',display_name='tempest-AttachVolumeTestJSON-server-1115991455',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1115991455',id=42,image_ref='a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDP62TKuY3xQeSwtOVfapZleQ+Udsdwyg62rL9eK489WlMG5ccA/qQJy7H2wra4KXAElLeGxPHWcXNl9vwyU6pMJ292WwpOYwEUeIcXde3ufxVUWLY5U6GVW+3+zkZGZTw==',key_name='tempest-keypair-777988029',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c8be85d72bc440899f3ccb64b923e90e',ramdisk_id='',reservation_id='r-m3eq8ay7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1852573580',owner_user_name='tempest-AttachVolumeTestJSON-1852573580-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T23:41:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1e3647ad15a24f1584685f9340eae5bd',uuid=0b413c71-c13a-4fea-91c4-f6b1953d54c6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "166cceb4-9b95-4bdd-a3ad-b6aad94dfed0", "address": "fa:16:3e:17:84:3d", "network": {"id": "e31c3d41-e46f-4c74-8ef5-8243a391dde8", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-856540424-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c8be85d72bc440899f3ccb64b923e90e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap166cceb4-9b", "ovs_interfaceid": "166cceb4-9b95-4bdd-a3ad-b6aad94dfed0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75045) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 23:41:46 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-118ab336-a6f7-4fe1-857c-8674be13b0db tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Converting VIF {"id": "166cceb4-9b95-4bdd-a3ad-b6aad94dfed0", "address": "fa:16:3e:17:84:3d", "network": {"id": "e31c3d41-e46f-4c74-8ef5-8243a391dde8", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-856540424-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c8be85d72bc440899f3ccb64b923e90e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap166cceb4-9b", "ovs_interfaceid": "166cceb4-9b95-4bdd-a3ad-b6aad94dfed0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 23:41:46 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-118ab336-a6f7-4fe1-857c-8674be13b0db tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:17:84:3d,bridge_name='br-int',has_traffic_filtering=True,id=166cceb4-9b95-4bdd-a3ad-b6aad94dfed0,network=Network(e31c3d41-e46f-4c74-8ef5-8243a391dde8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap166cceb4-9b') {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 23:41:46 user nova-compute[75045]: DEBUG nova.objects.instance [None req-118ab336-a6f7-4fe1-857c-8674be13b0db tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Lazy-loading 'pci_devices' on Instance uuid 0b413c71-c13a-4fea-91c4-f6b1953d54c6 {{(pid=75045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 23:41:46 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-118ab336-a6f7-4fe1-857c-8674be13b0db tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] [instance: 0b413c71-c13a-4fea-91c4-f6b1953d54c6] End _get_guest_xml xml=<domain type="kvm">
Nov 08 23:41:46 user nova-compute[75045]:   <uuid>0b413c71-c13a-4fea-91c4-f6b1953d54c6</uuid>
Nov 08 23:41:46 user nova-compute[75045]:   <name>instance-0000002a</name>
Nov 08 23:41:46 user nova-compute[75045]:   <memory>524288</memory>
Nov 08 23:41:46 user nova-compute[75045]:   <vcpu>1</vcpu>
Nov 08 23:41:46 user nova-compute[75045]:   <metadata>
Nov 08 23:41:46 user nova-compute[75045]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 23:41:46 user nova-compute[75045]:       <nova:package version="0.0.0"/>
Nov 08 23:41:46 user nova-compute[75045]:       <nova:name>tempest-AttachVolumeTestJSON-server-1115991455</nova:name>
Nov 08 23:41:46 user nova-compute[75045]:       <nova:creationTime>2023-11-08 23:41:46</nova:creationTime>
Nov 08 23:41:46 user nova-compute[75045]:       <nova:flavor name="m1.tiny">
Nov 08 23:41:46 user nova-compute[75045]:         <nova:memory>512</nova:memory>
Nov 08 23:41:46 user nova-compute[75045]:         <nova:disk>1</nova:disk>
Nov 08 23:41:46 user nova-compute[75045]:         <nova:swap>0</nova:swap>
Nov 08 23:41:46 user nova-compute[75045]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 23:41:46 user nova-compute[75045]:         <nova:vcpus>1</nova:vcpus>
Nov 08 23:41:46 user nova-compute[75045]:       </nova:flavor>
Nov 08 23:41:46 user nova-compute[75045]:       <nova:owner>
Nov 08 23:41:46 user nova-compute[75045]:         <nova:user uuid="1e3647ad15a24f1584685f9340eae5bd">tempest-AttachVolumeTestJSON-1852573580-project-member</nova:user>
Nov 08 23:41:46 user nova-compute[75045]:         <nova:project uuid="c8be85d72bc440899f3ccb64b923e90e">tempest-AttachVolumeTestJSON-1852573580</nova:project>
Nov 08 23:41:46 user nova-compute[75045]:       </nova:owner>
Nov 08 23:41:46 user nova-compute[75045]:       <nova:root type="image" uuid="a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb"/>
Nov 08 23:41:46 user nova-compute[75045]:       <nova:ports>
Nov 08 23:41:46 user nova-compute[75045]:         <nova:port uuid="166cceb4-9b95-4bdd-a3ad-b6aad94dfed0">
Nov 08 23:41:46 user nova-compute[75045]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 08 23:41:46 user nova-compute[75045]:         </nova:port>
Nov 08 23:41:46 user nova-compute[75045]:       </nova:ports>
Nov 08 23:41:46 user nova-compute[75045]:     </nova:instance>
Nov 08 23:41:46 user nova-compute[75045]:   </metadata>
Nov 08 23:41:46 user nova-compute[75045]:   <sysinfo type="smbios">
Nov 08 23:41:46 user nova-compute[75045]:     <system>
Nov 08 23:41:46 user nova-compute[75045]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 23:41:46 user nova-compute[75045]:       <entry name="product">OpenStack Nova</entry>
Nov 08 23:41:46 user nova-compute[75045]:       <entry name="version">0.0.0</entry>
Nov 08 23:41:46 user nova-compute[75045]:       <entry name="serial">0b413c71-c13a-4fea-91c4-f6b1953d54c6</entry>
Nov 08 23:41:46 user nova-compute[75045]:       <entry name="uuid">0b413c71-c13a-4fea-91c4-f6b1953d54c6</entry>
Nov 08 23:41:46 user nova-compute[75045]:       <entry name="family">Virtual Machine</entry>
Nov 08 23:41:46 user nova-compute[75045]:     </system>
Nov 08 23:41:46 user nova-compute[75045]:   </sysinfo>
Nov 08 23:41:46 user nova-compute[75045]:   <os>
Nov 08 23:41:46 user nova-compute[75045]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 23:41:46 user nova-compute[75045]:     <boot dev="hd"/>
Nov 08 23:41:46 user nova-compute[75045]:     <smbios mode="sysinfo"/>
Nov 08 23:41:46 user nova-compute[75045]:   </os>
Nov 08 23:41:46 user nova-compute[75045]:   <features>
Nov 08 23:41:46 user nova-compute[75045]:     <acpi/>
Nov 08 23:41:46 user nova-compute[75045]:     <apic/>
Nov 08 23:41:46 user nova-compute[75045]:     <vmcoreinfo/>
Nov 08 23:41:46 user nova-compute[75045]:   </features>
Nov 08 23:41:46 user nova-compute[75045]:   <clock offset="utc">
Nov 08 23:41:46 user nova-compute[75045]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 23:41:46 user nova-compute[75045]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 23:41:46 user nova-compute[75045]:     <timer name="hpet" present="no"/>
Nov 08 23:41:46 user nova-compute[75045]:   </clock>
Nov 08 23:41:46 user nova-compute[75045]:   <cpu mode="custom" match="exact">
Nov 08 23:41:46 user nova-compute[75045]:     <model>Nehalem</model>
Nov 08 23:41:46 user nova-compute[75045]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 23:41:46 user nova-compute[75045]:   </cpu>
Nov 08 23:41:46 user nova-compute[75045]:   <devices>
Nov 08 23:41:46 user nova-compute[75045]:     <disk type="file" device="disk">
Nov 08 23:41:46 user nova-compute[75045]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 23:41:46 user nova-compute[75045]:       <source file="/opt/stack/data/nova/instances/0b413c71-c13a-4fea-91c4-f6b1953d54c6/disk"/>
Nov 08 23:41:46 user nova-compute[75045]:       <target dev="vda" bus="virtio"/>
Nov 08 23:41:46 user nova-compute[75045]:     </disk>
Nov 08 23:41:46 user nova-compute[75045]:     <interface type="ethernet">
Nov 08 23:41:46 user nova-compute[75045]:       <mac address="fa:16:3e:17:84:3d"/>
Nov 08 23:41:46 user nova-compute[75045]:       <model type="virtio"/>
Nov 08 23:41:46 user nova-compute[75045]:       <mtu size="1442"/>
Nov 08 23:41:46 user nova-compute[75045]:       <target dev="tap166cceb4-9b"/>
Nov 08 23:41:46 user nova-compute[75045]:     </interface>
Nov 08 23:41:46 user nova-compute[75045]:     <serial type="pty">
Nov 08 23:41:46 user nova-compute[75045]:       <log file="/opt/stack/data/nova/instances/0b413c71-c13a-4fea-91c4-f6b1953d54c6/console.log" append="off"/>
Nov 08 23:41:46 user nova-compute[75045]:     </serial>
Nov 08 23:41:46 user nova-compute[75045]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 23:41:46 user nova-compute[75045]:     <video>
Nov 08 23:41:46 user nova-compute[75045]:       <model type="virtio"/>
Nov 08 23:41:46 user nova-compute[75045]:     </video>
Nov 08 23:41:46 user nova-compute[75045]:     <rng model="virtio">
Nov 08 23:41:46 user nova-compute[75045]:       <backend model="random">/dev/urandom</backend>
Nov 08 23:41:46 user nova-compute[75045]:     </rng>
Nov 08 23:41:46 user nova-compute[75045]:     <controller type="usb" index="0" model="none"/>
Nov 08 23:41:46 user nova-compute[75045]:     <memballoon model="virtio">
Nov 08 23:41:46 user nova-compute[75045]:       <stats period="10"/>
Nov 08 23:41:46 user nova-compute[75045]:     </memballoon>
Nov 08 23:41:46 user nova-compute[75045]:   </devices>
Nov 08 23:41:46 user nova-compute[75045]: </domain>
Nov 08 23:41:46 user nova-compute[75045]:  {{(pid=75045) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 23:41:46 user nova-compute[75045]: DEBUG nova.virt.libvirt.vif [None req-118ab336-a6f7-4fe1-857c-8674be13b0db tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T23:41:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1115991455',display_name='tempest-AttachVolumeTestJSON-server-1115991455',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1115991455',id=42,image_ref='a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDP62TKuY3xQeSwtOVfapZleQ+Udsdwyg62rL9eK489WlMG5ccA/qQJy7H2wra4KXAElLeGxPHWcXNl9vwyU6pMJ292WwpOYwEUeIcXde3ufxVUWLY5U6GVW+3+zkZGZTw==',key_name='tempest-keypair-777988029',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c8be85d72bc440899f3ccb64b923e90e',ramdisk_id='',reservation_id='r-m3eq8ay7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1852573580',owner_user_name='tempest-AttachVolumeTestJSON-1852573580-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T23:41:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1e3647ad15a24f1584685f9340eae5bd',uuid=0b413c71-c13a-4fea-91c4-f6b1953d54c6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "166cceb4-9b95-4bdd-a3ad-b6aad94dfed0", "address": "fa:16:3e:17:84:3d", "network": {"id": "e31c3d41-e46f-4c74-8ef5-8243a391dde8", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-856540424-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c8be85d72bc440899f3ccb64b923e90e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap166cceb4-9b", "ovs_interfaceid": "166cceb4-9b95-4bdd-a3ad-b6aad94dfed0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75045) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 23:41:46 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-118ab336-a6f7-4fe1-857c-8674be13b0db tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Converting VIF {"id": "166cceb4-9b95-4bdd-a3ad-b6aad94dfed0", "address": "fa:16:3e:17:84:3d", "network": {"id": "e31c3d41-e46f-4c74-8ef5-8243a391dde8", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-856540424-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c8be85d72bc440899f3ccb64b923e90e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap166cceb4-9b", "ovs_interfaceid": "166cceb4-9b95-4bdd-a3ad-b6aad94dfed0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 23:41:46 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-118ab336-a6f7-4fe1-857c-8674be13b0db tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:17:84:3d,bridge_name='br-int',has_traffic_filtering=True,id=166cceb4-9b95-4bdd-a3ad-b6aad94dfed0,network=Network(e31c3d41-e46f-4c74-8ef5-8243a391dde8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap166cceb4-9b') {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 23:41:46 user nova-compute[75045]: DEBUG os_vif [None req-118ab336-a6f7-4fe1-857c-8674be13b0db tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:17:84:3d,bridge_name='br-int',has_traffic_filtering=True,id=166cceb4-9b95-4bdd-a3ad-b6aad94dfed0,network=Network(e31c3d41-e46f-4c74-8ef5-8243a391dde8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap166cceb4-9b') {{(pid=75045) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 23:41:46 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:41:46 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:41:46 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 23:41:46 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:41:46 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '51e287f5-9b55-532a-b2f3-73adf8fe8b59', '_type': 'linux-noop'}}, row=False) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:41:46 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:41:46 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:41:46 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:41:46 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap166cceb4-9b, may_exist=True, interface_attrs={}) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:41:46 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap166cceb4-9b, col_values=(('qos', UUID('d7ba1166-974e-4358-a604-d9966c553998')),), if_exists=True) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:41:46 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap166cceb4-9b, col_values=(('external_ids', {'iface-id': '166cceb4-9b95-4bdd-a3ad-b6aad94dfed0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:17:84:3d', 'vm-uuid': '0b413c71-c13a-4fea-91c4-f6b1953d54c6'}),), if_exists=True) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:41:46 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:41:46 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 23:41:46 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:41:46 user nova-compute[75045]: INFO os_vif [None req-118ab336-a6f7-4fe1-857c-8674be13b0db tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:17:84:3d,bridge_name='br-int',has_traffic_filtering=True,id=166cceb4-9b95-4bdd-a3ad-b6aad94dfed0,network=Network(e31c3d41-e46f-4c74-8ef5-8243a391dde8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap166cceb4-9b')
Nov 08 23:41:46 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:41:46 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-118ab336-a6f7-4fe1-857c-8674be13b0db tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] No BDM found with device name vda, not building metadata. {{(pid=75045) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 23:41:46 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-118ab336-a6f7-4fe1-857c-8674be13b0db tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] No VIF found with MAC fa:16:3e:17:84:3d, not building metadata {{(pid=75045) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 23:41:46 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-645c6c79-656d-488e-8047-b55439fd76a7 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Acquiring lock "899ae4a7-6932-4f43-a87f-a88cb2ce3cb9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:41:46 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-645c6c79-656d-488e-8047-b55439fd76a7 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Lock "899ae4a7-6932-4f43-a87f-a88cb2ce3cb9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:41:47 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-645c6c79-656d-488e-8047-b55439fd76a7 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Acquiring lock "899ae4a7-6932-4f43-a87f-a88cb2ce3cb9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:41:47 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-645c6c79-656d-488e-8047-b55439fd76a7 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Lock "899ae4a7-6932-4f43-a87f-a88cb2ce3cb9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:41:47 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-645c6c79-656d-488e-8047-b55439fd76a7 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Lock "899ae4a7-6932-4f43-a87f-a88cb2ce3cb9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:41:47 user nova-compute[75045]: INFO nova.compute.manager [None req-645c6c79-656d-488e-8047-b55439fd76a7 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] [instance: 899ae4a7-6932-4f43-a87f-a88cb2ce3cb9] Terminating instance
Nov 08 23:41:47 user nova-compute[75045]: DEBUG nova.network.neutron [req-56545ff8-026e-435c-986c-d3dc72d98bd9 req-06a08d58-8a2a-405d-a19d-63449b064744 service nova] [instance: 0b413c71-c13a-4fea-91c4-f6b1953d54c6] Updated VIF entry in instance network info cache for port 166cceb4-9b95-4bdd-a3ad-b6aad94dfed0. {{(pid=75045) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 23:41:47 user nova-compute[75045]: DEBUG nova.network.neutron [req-56545ff8-026e-435c-986c-d3dc72d98bd9 req-06a08d58-8a2a-405d-a19d-63449b064744 service nova] [instance: 0b413c71-c13a-4fea-91c4-f6b1953d54c6] Updating instance_info_cache with network_info: [{"id": "166cceb4-9b95-4bdd-a3ad-b6aad94dfed0", "address": "fa:16:3e:17:84:3d", "network": {"id": "e31c3d41-e46f-4c74-8ef5-8243a391dde8", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-856540424-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c8be85d72bc440899f3ccb64b923e90e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap166cceb4-9b", "ovs_interfaceid": "166cceb4-9b95-4bdd-a3ad-b6aad94dfed0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75045) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 23:41:47 user nova-compute[75045]: DEBUG nova.compute.manager [None req-645c6c79-656d-488e-8047-b55439fd76a7 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] [instance: 899ae4a7-6932-4f43-a87f-a88cb2ce3cb9] Start destroying the instance on the hypervisor. {{(pid=75045) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 23:41:47 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-56545ff8-026e-435c-986c-d3dc72d98bd9 req-06a08d58-8a2a-405d-a19d-63449b064744 service nova] Releasing lock "refresh_cache-0b413c71-c13a-4fea-91c4-f6b1953d54c6" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 23:41:47 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:41:47 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:41:47 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:41:47 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:41:47 user nova-compute[75045]: DEBUG nova.compute.manager [req-7819b374-4b6b-44a4-afa3-b4324d927df0 req-d7024c72-a4f9-4309-8e0e-b1a5318fac70 service nova] [instance: 899ae4a7-6932-4f43-a87f-a88cb2ce3cb9] Received event network-vif-unplugged-0ffa225c-305b-4bbe-bae5-215270ecc6b1 {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:41:47 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-7819b374-4b6b-44a4-afa3-b4324d927df0 req-d7024c72-a4f9-4309-8e0e-b1a5318fac70 service nova] Acquiring lock "899ae4a7-6932-4f43-a87f-a88cb2ce3cb9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:41:47 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-7819b374-4b6b-44a4-afa3-b4324d927df0 req-d7024c72-a4f9-4309-8e0e-b1a5318fac70 service nova] Lock "899ae4a7-6932-4f43-a87f-a88cb2ce3cb9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:41:47 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-7819b374-4b6b-44a4-afa3-b4324d927df0 req-d7024c72-a4f9-4309-8e0e-b1a5318fac70 service nova] Lock "899ae4a7-6932-4f43-a87f-a88cb2ce3cb9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.003s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:41:47 user nova-compute[75045]: DEBUG nova.compute.manager [req-7819b374-4b6b-44a4-afa3-b4324d927df0 req-d7024c72-a4f9-4309-8e0e-b1a5318fac70 service nova] [instance: 899ae4a7-6932-4f43-a87f-a88cb2ce3cb9] No waiting events found dispatching network-vif-unplugged-0ffa225c-305b-4bbe-bae5-215270ecc6b1 {{(pid=75045) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 23:41:47 user nova-compute[75045]: DEBUG nova.compute.manager [req-7819b374-4b6b-44a4-afa3-b4324d927df0 req-d7024c72-a4f9-4309-8e0e-b1a5318fac70 service nova] [instance: 899ae4a7-6932-4f43-a87f-a88cb2ce3cb9] Received event network-vif-unplugged-0ffa225c-305b-4bbe-bae5-215270ecc6b1 for instance with task_state deleting. {{(pid=75045) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 23:41:48 user nova-compute[75045]: INFO nova.virt.libvirt.driver [-] [instance: 899ae4a7-6932-4f43-a87f-a88cb2ce3cb9] Instance destroyed successfully.
Nov 08 23:41:48 user nova-compute[75045]: DEBUG nova.objects.instance [None req-645c6c79-656d-488e-8047-b55439fd76a7 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Lazy-loading 'resources' on Instance uuid 899ae4a7-6932-4f43-a87f-a88cb2ce3cb9 {{(pid=75045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 23:41:48 user nova-compute[75045]: DEBUG nova.virt.libvirt.vif [None req-645c6c79-656d-488e-8047-b55439fd76a7 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T23:39:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1213755282',display_name='tempest-TestVolumeBootPattern-server-1213755282',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1213755282',id=39,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-08T23:40:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d59b73851c79473a9c2cdc0a120dfee0',ramdisk_id='',reservation_id='r-1h00qjsi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-650796844',owner_user_name='tempest-TestVolumeBootPattern-650796844-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T23:40:32Z,user_data=None,user_id='76c31c64d9594f9cbef7586fafb48721',uuid=899ae4a7-6932-4f43-a87f-a88cb2ce3cb9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0ffa225c-305b-4bbe-bae5-215270ecc6b1", "address": "fa:16:3e:bb:a6:e0", "network": {"id": "4205f899-9865-4c65-8b46-c9a533e9bb45", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-774780781-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d59b73851c79473a9c2cdc0a120dfee0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ffa225c-30", "ovs_interfaceid": "0ffa225c-305b-4bbe-bae5-215270ecc6b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75045) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 23:41:48 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-645c6c79-656d-488e-8047-b55439fd76a7 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Converting VIF {"id": "0ffa225c-305b-4bbe-bae5-215270ecc6b1", "address": "fa:16:3e:bb:a6:e0", "network": {"id": "4205f899-9865-4c65-8b46-c9a533e9bb45", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-774780781-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d59b73851c79473a9c2cdc0a120dfee0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ffa225c-30", "ovs_interfaceid": "0ffa225c-305b-4bbe-bae5-215270ecc6b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 23:41:48 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-645c6c79-656d-488e-8047-b55439fd76a7 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bb:a6:e0,bridge_name='br-int',has_traffic_filtering=True,id=0ffa225c-305b-4bbe-bae5-215270ecc6b1,network=Network(4205f899-9865-4c65-8b46-c9a533e9bb45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ffa225c-30') {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 23:41:48 user nova-compute[75045]: DEBUG os_vif [None req-645c6c79-656d-488e-8047-b55439fd76a7 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bb:a6:e0,bridge_name='br-int',has_traffic_filtering=True,id=0ffa225c-305b-4bbe-bae5-215270ecc6b1,network=Network(4205f899-9865-4c65-8b46-c9a533e9bb45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ffa225c-30') {{(pid=75045) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 23:41:48 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:41:48 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0ffa225c-30, bridge=br-int, if_exists=True) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:41:48 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:41:48 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 23:41:48 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:41:48 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:41:48 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=794dca45-f07a-44e9-86f3-f1b9b0e776cc) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:41:48 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:41:48 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 23:41:48 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:41:48 user nova-compute[75045]: INFO os_vif [None req-645c6c79-656d-488e-8047-b55439fd76a7 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bb:a6:e0,bridge_name='br-int',has_traffic_filtering=True,id=0ffa225c-305b-4bbe-bae5-215270ecc6b1,network=Network(4205f899-9865-4c65-8b46-c9a533e9bb45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ffa225c-30')
Nov 08 23:41:48 user nova-compute[75045]: DEBUG nova.virt.libvirt.volume.iscsi [None req-645c6c79-656d-488e-8047-b55439fd76a7 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] [instance: 899ae4a7-6932-4f43-a87f-a88cb2ce3cb9] calling os-brick to detach iSCSI Volume {{(pid=75045) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 23:41:48 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-645c6c79-656d-488e-8047-b55439fd76a7 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1b68210460>, {'target_iqn': 'iqn.2010-10.org.openstack:8fae24d0-d1b0-4d8b-912c-78e4faee8bb7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kOnrPmAI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75045) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 23:41:48 user nova-compute[75045]: WARNING os_brick.initiator.connectors.base [None req-645c6c79-656d-488e-8047-b55439fd76a7 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 23:41:48 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-645c6c79-656d-488e-8047-b55439fd76a7 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 23:41:48 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-645c6c79-656d-488e-8047-b55439fd76a7 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 23:41:48 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:41:48 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:41:48 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[782361ea-968f-49ef-8d48-fd0d5afd7cf9]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8fae24d0-d1b0-4d8b-912c-78e4faee8bb7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:41:48 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:41:48 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-645c6c79-656d-488e-8047-b55439fd76a7 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 23:41:48 user nova-compute[75045]: No targets found.
Nov 08 23:41:48 user nova-compute[75045]: iSNS:
Nov 08 23:41:48 user nova-compute[75045]: No targets found.
Nov 08 23:41:48 user nova-compute[75045]: STATIC:
Nov 08 23:41:48 user nova-compute[75045]: Target: iqn.2010-10.org.openstack:8fae24d0-d1b0-4d8b-912c-78e4faee8bb7
Nov 08 23:41:48 user nova-compute[75045]:         Portal: 172.16.0.220:3260,-1
Nov 08 23:41:48 user nova-compute[75045]:                 Iface Name: default
Nov 08 23:41:48 user nova-compute[75045]: FIRMWARE:
Nov 08 23:41:48 user nova-compute[75045]: No targets found.
Nov 08 23:41:48 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 23:41:48 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-645c6c79-656d-488e-8047-b55439fd76a7 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 23:41:48 user nova-compute[75045]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 23:41:48 user nova-compute[75045]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75045) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 23:41:48 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-645c6c79-656d-488e-8047-b55439fd76a7 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8fae24d0-d1b0-4d8b-912c-78e4faee8bb7', 0)] {{(pid=75045) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 23:41:48 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:41:48 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:41:48 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[d55590ff-9318-49c5-9aa7-ffa49970fcee]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8fae24d0-d1b0-4d8b-912c-78e4faee8bb7\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:41:48 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:41:48 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:41:48 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd44aaaa-6b5a-4adc-b2c8-c0bd9df328d3]: (4, ('tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fae24d0-d1b0-4d8b-912c-78e4faee8bb7 (non-flash)\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:41:48 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-645c6c79-656d-488e-8047-b55439fd76a7 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fae24d0-d1b0-4d8b-912c-78e4faee8bb7 (non-flash)
Nov 08 23:41:48 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 23:41:48 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-645c6c79-656d-488e-8047-b55439fd76a7 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] iscsi session list stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fae24d0-d1b0-4d8b-912c-78e4faee8bb7 (non-flash)
Nov 08 23:41:48 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 23:41:48 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-645c6c79-656d-488e-8047-b55439fd76a7 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1b6826bd00>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8fae24d0-d1b0-4d8b-912c-78e4faee8bb7'): ({'sdb'}, set())}) {{(pid=75045) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 23:41:48 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-645c6c79-656d-488e-8047-b55439fd76a7 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Removing single pathed devices sdb {{(pid=75045) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 23:41:48 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:41:48 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:41:48 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[ede94492-7dd4-446d-b4bf-a4f5f8345350]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:41:48 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:41:48 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.022s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:41:48 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[543f577d-03b9-44ce-a09f-46585827edf5]: (4, ('ok\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:41:48 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-645c6c79-656d-488e-8047-b55439fd76a7 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Flushing IO for device /dev/sdb {{(pid=75045) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 23:41:48 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:41:48 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:41:48 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3f20bdb-161c-4b82-a999-24067fd9d1ad]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:41:48 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-645c6c79-656d-488e-8047-b55439fd76a7 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75045) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 23:41:48 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:41:48 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.048s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:41:48 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab52d1a8-aa4b-4624-b5fb-2b85504cabea]: (4, ('1', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:41:48 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-645c6c79-656d-488e-8047-b55439fd76a7 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75045) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 23:41:48 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-645c6c79-656d-488e-8047-b55439fd76a7 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] SCSI volumes sdb have been removed. {{(pid=75045) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 23:41:48 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-645c6c79-656d-488e-8047-b55439fd76a7 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8fae24d0-d1b0-4d8b-912c-78e4faee8bb7')] {{(pid=75045) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 23:41:48 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8fae24d0-d1b0-4d8b-912c-78e4faee8bb7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:41:48 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8fae24d0-d1b0-4d8b-912c-78e4faee8bb7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:41:48 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[183b8feb-cf8c-4457-861b-7e4d65656708]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:41:48 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-645c6c79-656d-488e-8047-b55439fd76a7 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:41:48 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8fae24d0-d1b0-4d8b-912c-78e4faee8bb7 -p 172.16.0.220:3260 --logout {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:41:48 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:41:48 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8fae24d0-d1b0-4d8b-912c-78e4faee8bb7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.073s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:41:48 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fbeaf77-57a0-416e-ad14-eba3951b8fe0]: (4, ('Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:8fae24d0-d1b0-4d8b-912c-78e4faee8bb7, portal: 172.16.0.220,3260]\nLogout of [sid: 40, target: iqn.2010-10.org.openstack:8fae24d0-d1b0-4d8b-912c-78e4faee8bb7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:41:48 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-645c6c79-656d-488e-8047-b55439fd76a7 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:8fae24d0-d1b0-4d8b-912c-78e4faee8bb7, portal: 172.16.0.220,3260]
Nov 08 23:41:48 user nova-compute[75045]: Logout of [sid: 40, target: iqn.2010-10.org.openstack:8fae24d0-d1b0-4d8b-912c-78e4faee8bb7, portal: 172.16.0.220,3260] successful.
Nov 08 23:41:48 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:41:48 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:41:48 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:41:48 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8fae24d0-d1b0-4d8b-912c-78e4faee8bb7 -p 172.16.0.220:3260 --op delete {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:41:48 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8fae24d0-d1b0-4d8b-912c-78e4faee8bb7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:41:48 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[12546a41-2c25-4269-acf2-ca0f61f2b990]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:41:48 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-645c6c79-656d-488e-8047-b55439fd76a7 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:41:48 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-645c6c79-656d-488e-8047-b55439fd76a7 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.343s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 23:41:48 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-645c6c79-656d-488e-8047-b55439fd76a7 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] <== disconnect_volume: return (344ms) None {{(pid=75045) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 23:41:48 user nova-compute[75045]: DEBUG nova.virt.libvirt.volume.iscsi [None req-645c6c79-656d-488e-8047-b55439fd76a7 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] [instance: 899ae4a7-6932-4f43-a87f-a88cb2ce3cb9] Disconnected iSCSI Volume {{(pid=75045) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 23:41:48 user nova-compute[75045]: INFO nova.virt.libvirt.driver [None req-645c6c79-656d-488e-8047-b55439fd76a7 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] [instance: 899ae4a7-6932-4f43-a87f-a88cb2ce3cb9] Deleting instance files /opt/stack/data/nova/instances/899ae4a7-6932-4f43-a87f-a88cb2ce3cb9_del
Nov 08 23:41:48 user nova-compute[75045]: INFO nova.virt.libvirt.driver [None req-645c6c79-656d-488e-8047-b55439fd76a7 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] [instance: 899ae4a7-6932-4f43-a87f-a88cb2ce3cb9] Deletion of /opt/stack/data/nova/instances/899ae4a7-6932-4f43-a87f-a88cb2ce3cb9_del complete
Nov 08 23:41:48 user nova-compute[75045]: INFO nova.compute.manager [None req-645c6c79-656d-488e-8047-b55439fd76a7 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] [instance: 899ae4a7-6932-4f43-a87f-a88cb2ce3cb9] Took 1.60 seconds to destroy the instance on the hypervisor.
Nov 08 23:41:48 user nova-compute[75045]: DEBUG oslo.service.loopingcall [None req-645c6c79-656d-488e-8047-b55439fd76a7 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75045) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 23:41:48 user nova-compute[75045]: DEBUG nova.compute.manager [-] [instance: 899ae4a7-6932-4f43-a87f-a88cb2ce3cb9] Deallocating network for instance {{(pid=75045) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 23:41:48 user nova-compute[75045]: DEBUG nova.network.neutron [-] [instance: 899ae4a7-6932-4f43-a87f-a88cb2ce3cb9] deallocate_for_instance() {{(pid=75045) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 23:41:49 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:41:49 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:41:49 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:41:49 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:41:49 user nova-compute[75045]: DEBUG nova.network.neutron [-] [instance: 899ae4a7-6932-4f43-a87f-a88cb2ce3cb9] Updating instance_info_cache with network_info: [] {{(pid=75045) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 23:41:49 user nova-compute[75045]: INFO nova.compute.manager [-] [instance: 899ae4a7-6932-4f43-a87f-a88cb2ce3cb9] Took 0.89 seconds to deallocate network for instance.
Nov 08 23:41:49 user nova-compute[75045]: DEBUG nova.compute.manager [req-9789e573-0c36-4798-baf5-9d128bb229d0 req-fceccec0-7d87-4126-9c06-9653cc7e3337 service nova] [instance: 899ae4a7-6932-4f43-a87f-a88cb2ce3cb9] Received event network-vif-deleted-0ffa225c-305b-4bbe-bae5-215270ecc6b1 {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:41:49 user nova-compute[75045]: INFO nova.compute.manager [req-9789e573-0c36-4798-baf5-9d128bb229d0 req-fceccec0-7d87-4126-9c06-9653cc7e3337 service nova] [instance: 899ae4a7-6932-4f43-a87f-a88cb2ce3cb9] Neutron deleted interface 0ffa225c-305b-4bbe-bae5-215270ecc6b1; detaching it from the instance and deleting it from the info cache
Nov 08 23:41:49 user nova-compute[75045]: DEBUG nova.network.neutron [req-9789e573-0c36-4798-baf5-9d128bb229d0 req-fceccec0-7d87-4126-9c06-9653cc7e3337 service nova] [instance: 899ae4a7-6932-4f43-a87f-a88cb2ce3cb9] Updating instance_info_cache with network_info: [] {{(pid=75045) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 23:41:49 user nova-compute[75045]: DEBUG nova.compute.manager [req-9789e573-0c36-4798-baf5-9d128bb229d0 req-fceccec0-7d87-4126-9c06-9653cc7e3337 service nova] [instance: 899ae4a7-6932-4f43-a87f-a88cb2ce3cb9] Detach interface failed, port_id=0ffa225c-305b-4bbe-bae5-215270ecc6b1, reason: Instance 899ae4a7-6932-4f43-a87f-a88cb2ce3cb9 could not be found. {{(pid=75045) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 08 23:41:49 user nova-compute[75045]: DEBUG nova.compute.manager [req-5e94f031-d65d-40fc-89d6-e788d06e6db9 req-1652430e-bf06-427b-86ab-7c93688d15cd service nova] [instance: 899ae4a7-6932-4f43-a87f-a88cb2ce3cb9] Received event network-vif-plugged-0ffa225c-305b-4bbe-bae5-215270ecc6b1 {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:41:49 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-5e94f031-d65d-40fc-89d6-e788d06e6db9 req-1652430e-bf06-427b-86ab-7c93688d15cd service nova] Acquiring lock "899ae4a7-6932-4f43-a87f-a88cb2ce3cb9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:41:49 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-5e94f031-d65d-40fc-89d6-e788d06e6db9 req-1652430e-bf06-427b-86ab-7c93688d15cd service nova] Lock "899ae4a7-6932-4f43-a87f-a88cb2ce3cb9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:41:49 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-5e94f031-d65d-40fc-89d6-e788d06e6db9 req-1652430e-bf06-427b-86ab-7c93688d15cd service nova] Lock "899ae4a7-6932-4f43-a87f-a88cb2ce3cb9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:41:49 user nova-compute[75045]: DEBUG nova.compute.manager [req-5e94f031-d65d-40fc-89d6-e788d06e6db9 req-1652430e-bf06-427b-86ab-7c93688d15cd service nova] [instance: 899ae4a7-6932-4f43-a87f-a88cb2ce3cb9] No waiting events found dispatching network-vif-plugged-0ffa225c-305b-4bbe-bae5-215270ecc6b1 {{(pid=75045) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 23:41:49 user nova-compute[75045]: WARNING nova.compute.manager [req-5e94f031-d65d-40fc-89d6-e788d06e6db9 req-1652430e-bf06-427b-86ab-7c93688d15cd service nova] [instance: 899ae4a7-6932-4f43-a87f-a88cb2ce3cb9] Received unexpected event network-vif-plugged-0ffa225c-305b-4bbe-bae5-215270ecc6b1 for instance with vm_state active and task_state deleting.
Nov 08 23:41:49 user nova-compute[75045]: DEBUG nova.compute.manager [req-5e94f031-d65d-40fc-89d6-e788d06e6db9 req-1652430e-bf06-427b-86ab-7c93688d15cd service nova] [instance: 0b413c71-c13a-4fea-91c4-f6b1953d54c6] Received event network-vif-plugged-166cceb4-9b95-4bdd-a3ad-b6aad94dfed0 {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:41:49 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-5e94f031-d65d-40fc-89d6-e788d06e6db9 req-1652430e-bf06-427b-86ab-7c93688d15cd service nova] Acquiring lock "0b413c71-c13a-4fea-91c4-f6b1953d54c6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:41:49 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-5e94f031-d65d-40fc-89d6-e788d06e6db9 req-1652430e-bf06-427b-86ab-7c93688d15cd service nova] Lock "0b413c71-c13a-4fea-91c4-f6b1953d54c6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:41:49 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-5e94f031-d65d-40fc-89d6-e788d06e6db9 req-1652430e-bf06-427b-86ab-7c93688d15cd service nova] Lock "0b413c71-c13a-4fea-91c4-f6b1953d54c6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:41:49 user nova-compute[75045]: DEBUG nova.compute.manager [req-5e94f031-d65d-40fc-89d6-e788d06e6db9 req-1652430e-bf06-427b-86ab-7c93688d15cd service nova] [instance: 0b413c71-c13a-4fea-91c4-f6b1953d54c6] No waiting events found dispatching network-vif-plugged-166cceb4-9b95-4bdd-a3ad-b6aad94dfed0 {{(pid=75045) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 23:41:49 user nova-compute[75045]: WARNING nova.compute.manager [req-5e94f031-d65d-40fc-89d6-e788d06e6db9 req-1652430e-bf06-427b-86ab-7c93688d15cd service nova] [instance: 0b413c71-c13a-4fea-91c4-f6b1953d54c6] Received unexpected event network-vif-plugged-166cceb4-9b95-4bdd-a3ad-b6aad94dfed0 for instance with vm_state building and task_state spawning.
Nov 08 23:41:49 user nova-compute[75045]: DEBUG nova.compute.manager [req-5e94f031-d65d-40fc-89d6-e788d06e6db9 req-1652430e-bf06-427b-86ab-7c93688d15cd service nova] [instance: 0b413c71-c13a-4fea-91c4-f6b1953d54c6] Received event network-vif-plugged-166cceb4-9b95-4bdd-a3ad-b6aad94dfed0 {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:41:49 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-5e94f031-d65d-40fc-89d6-e788d06e6db9 req-1652430e-bf06-427b-86ab-7c93688d15cd service nova] Acquiring lock "0b413c71-c13a-4fea-91c4-f6b1953d54c6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:41:49 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-5e94f031-d65d-40fc-89d6-e788d06e6db9 req-1652430e-bf06-427b-86ab-7c93688d15cd service nova] Lock "0b413c71-c13a-4fea-91c4-f6b1953d54c6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:41:49 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-5e94f031-d65d-40fc-89d6-e788d06e6db9 req-1652430e-bf06-427b-86ab-7c93688d15cd service nova] Lock "0b413c71-c13a-4fea-91c4-f6b1953d54c6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:41:49 user nova-compute[75045]: DEBUG nova.compute.manager [req-5e94f031-d65d-40fc-89d6-e788d06e6db9 req-1652430e-bf06-427b-86ab-7c93688d15cd service nova] [instance: 0b413c71-c13a-4fea-91c4-f6b1953d54c6] No waiting events found dispatching network-vif-plugged-166cceb4-9b95-4bdd-a3ad-b6aad94dfed0 {{(pid=75045) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 23:41:49 user nova-compute[75045]: WARNING nova.compute.manager [req-5e94f031-d65d-40fc-89d6-e788d06e6db9 req-1652430e-bf06-427b-86ab-7c93688d15cd service nova] [instance: 0b413c71-c13a-4fea-91c4-f6b1953d54c6] Received unexpected event network-vif-plugged-166cceb4-9b95-4bdd-a3ad-b6aad94dfed0 for instance with vm_state building and task_state spawning.
Nov 08 23:41:50 user nova-compute[75045]: INFO nova.compute.manager [None req-645c6c79-656d-488e-8047-b55439fd76a7 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] [instance: 899ae4a7-6932-4f43-a87f-a88cb2ce3cb9] Took 0.95 seconds to detach 1 volumes for instance.
Nov 08 23:41:50 user nova-compute[75045]: DEBUG nova.compute.manager [None req-645c6c79-656d-488e-8047-b55439fd76a7 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] [instance: 899ae4a7-6932-4f43-a87f-a88cb2ce3cb9] Deleting volume: 8fae24d0-d1b0-4d8b-912c-78e4faee8bb7 {{(pid=75045) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 08 23:41:50 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-645c6c79-656d-488e-8047-b55439fd76a7 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:41:50 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-645c6c79-656d-488e-8047-b55439fd76a7 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:41:50 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:41:50 user nova-compute[75045]: DEBUG nova.compute.manager [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Starting heal instance info cache {{(pid=75045) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 23:41:50 user nova-compute[75045]: DEBUG nova.compute.manager [None req-118ab336-a6f7-4fe1-857c-8674be13b0db tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] [instance: 0b413c71-c13a-4fea-91c4-f6b1953d54c6] Instance event wait completed in 0 seconds for  {{(pid=75045) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 23:41:50 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-118ab336-a6f7-4fe1-857c-8674be13b0db tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] [instance: 0b413c71-c13a-4fea-91c4-f6b1953d54c6] Guest created on hypervisor {{(pid=75045) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 23:41:50 user nova-compute[75045]: INFO nova.virt.libvirt.driver [-] [instance: 0b413c71-c13a-4fea-91c4-f6b1953d54c6] Instance spawned successfully.
Nov 08 23:41:50 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-118ab336-a6f7-4fe1-857c-8674be13b0db tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] [instance: 0b413c71-c13a-4fea-91c4-f6b1953d54c6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75045) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 23:41:50 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-118ab336-a6f7-4fe1-857c-8674be13b0db tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] [instance: 0b413c71-c13a-4fea-91c4-f6b1953d54c6] Found default for hw_cdrom_bus of ide {{(pid=75045) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 23:41:50 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-118ab336-a6f7-4fe1-857c-8674be13b0db tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] [instance: 0b413c71-c13a-4fea-91c4-f6b1953d54c6] Found default for hw_disk_bus of virtio {{(pid=75045) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 23:41:50 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-118ab336-a6f7-4fe1-857c-8674be13b0db tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] [instance: 0b413c71-c13a-4fea-91c4-f6b1953d54c6] Found default for hw_input_bus of None {{(pid=75045) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 23:41:50 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-118ab336-a6f7-4fe1-857c-8674be13b0db tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] [instance: 0b413c71-c13a-4fea-91c4-f6b1953d54c6] Found default for hw_pointer_model of None {{(pid=75045) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 23:41:50 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-118ab336-a6f7-4fe1-857c-8674be13b0db tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] [instance: 0b413c71-c13a-4fea-91c4-f6b1953d54c6] Found default for hw_video_model of virtio {{(pid=75045) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 23:41:50 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-118ab336-a6f7-4fe1-857c-8674be13b0db tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] [instance: 0b413c71-c13a-4fea-91c4-f6b1953d54c6] Found default for hw_vif_model of virtio {{(pid=75045) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 23:41:50 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Acquiring lock "refresh_cache-244c4cc9-2837-40c9-b4ad-37dc435c9749" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 23:41:50 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Acquired lock "refresh_cache-244c4cc9-2837-40c9-b4ad-37dc435c9749" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 23:41:50 user nova-compute[75045]: DEBUG nova.network.neutron [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] [instance: 244c4cc9-2837-40c9-b4ad-37dc435c9749] Forcefully refreshing network info cache for instance {{(pid=75045) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 23:41:50 user nova-compute[75045]: DEBUG nova.compute.provider_tree [None req-645c6c79-656d-488e-8047-b55439fd76a7 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Inventory has not changed in ProviderTree for provider: 62ba5f85-c74d-4b58-986e-d4197e813fd7 {{(pid=75045) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 23:41:50 user nova-compute[75045]: INFO nova.compute.manager [None req-118ab336-a6f7-4fe1-857c-8674be13b0db tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] [instance: 0b413c71-c13a-4fea-91c4-f6b1953d54c6] Took 5.80 seconds to spawn the instance on the hypervisor.
Nov 08 23:41:50 user nova-compute[75045]: DEBUG nova.compute.manager [None req-118ab336-a6f7-4fe1-857c-8674be13b0db tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] [instance: 0b413c71-c13a-4fea-91c4-f6b1953d54c6] Checking state {{(pid=75045) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 23:41:50 user nova-compute[75045]: DEBUG nova.scheduler.client.report [None req-645c6c79-656d-488e-8047-b55439fd76a7 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Inventory has not changed for provider 62ba5f85-c74d-4b58-986e-d4197e813fd7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75045) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 23:41:50 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-645c6c79-656d-488e-8047-b55439fd76a7 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.314s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:41:50 user nova-compute[75045]: INFO nova.compute.manager [None req-118ab336-a6f7-4fe1-857c-8674be13b0db tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] [instance: 0b413c71-c13a-4fea-91c4-f6b1953d54c6] Took 6.75 seconds to build instance.
Nov 08 23:41:50 user nova-compute[75045]: INFO nova.scheduler.client.report [None req-645c6c79-656d-488e-8047-b55439fd76a7 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Deleted allocations for instance 899ae4a7-6932-4f43-a87f-a88cb2ce3cb9
Nov 08 23:41:50 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-118ab336-a6f7-4fe1-857c-8674be13b0db tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Lock "0b413c71-c13a-4fea-91c4-f6b1953d54c6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.847s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:41:51 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-645c6c79-656d-488e-8047-b55439fd76a7 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Lock "899ae4a7-6932-4f43-a87f-a88cb2ce3cb9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.084s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:41:51 user nova-compute[75045]: DEBUG nova.network.neutron [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] [instance: 244c4cc9-2837-40c9-b4ad-37dc435c9749] Updating instance_info_cache with network_info: [{"id": "a5a35e2b-77b5-4f76-a70a-0088652c0420", "address": "fa:16:3e:9f:19:4e", "network": {"id": "eac8b567-0d31-42ec-b05d-2ca251612286", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1889897935-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "61c8f99e9d284b51bbf7bbf6bdfb8662", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5a35e2b-77", "ovs_interfaceid": "a5a35e2b-77b5-4f76-a70a-0088652c0420", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75045) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 23:41:51 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Releasing lock "refresh_cache-244c4cc9-2837-40c9-b4ad-37dc435c9749" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 23:41:51 user nova-compute[75045]: DEBUG nova.compute.manager [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] [instance: 244c4cc9-2837-40c9-b4ad-37dc435c9749] Updated the network info_cache for instance {{(pid=75045) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 23:41:51 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:41:51 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:41:51 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:41:51 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:41:51 user nova-compute[75045]: DEBUG nova.compute.manager [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75045) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 23:41:53 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:41:54 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:41:54 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:41:54 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:41:55 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:41:55 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:41:56 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:41:57 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:41:58 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:41:58 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager.update_available_resource {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:41:59 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:41:59 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:41:59 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:41:59 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Auditing locally available compute resources for user (node: user) {{(pid=75045) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 23:41:59 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/244c4cc9-2837-40c9-b4ad-37dc435c9749/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:41:59 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/244c4cc9-2837-40c9-b4ad-37dc435c9749/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:41:59 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/244c4cc9-2837-40c9-b4ad-37dc435c9749/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:41:59 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/244c4cc9-2837-40c9-b4ad-37dc435c9749/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:41:59 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ee587a0-e271-4262-a252-2ccb6c2faecb/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:41:59 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ee587a0-e271-4262-a252-2ccb6c2faecb/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:41:59 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ee587a0-e271-4262-a252-2ccb6c2faecb/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:41:59 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ee587a0-e271-4262-a252-2ccb6c2faecb/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:41:59 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18c197c4-3000-41b1-83bc-1a781744d539/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:42:00 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18c197c4-3000-41b1-83bc-1a781744d539/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:42:00 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18c197c4-3000-41b1-83bc-1a781744d539/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:42:00 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18c197c4-3000-41b1-83bc-1a781744d539/disk --force-share --output=json" returned: 0 in 0.234s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:42:00 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/584e3043-addf-41f7-a3cd-de51c229af72/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:42:00 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/584e3043-addf-41f7-a3cd-de51c229af72/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:42:00 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/584e3043-addf-41f7-a3cd-de51c229af72/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:42:00 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/584e3043-addf-41f7-a3cd-de51c229af72/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:42:00 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b413c71-c13a-4fea-91c4-f6b1953d54c6/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:42:01 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b413c71-c13a-4fea-91c4-f6b1953d54c6/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:42:01 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b413c71-c13a-4fea-91c4-f6b1953d54c6/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:42:01 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b413c71-c13a-4fea-91c4-f6b1953d54c6/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:42:01 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/adcffd35-00c7-49db-a72f-d6307a90e123/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:42:01 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/adcffd35-00c7-49db-a72f-d6307a90e123/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:42:01 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/adcffd35-00c7-49db-a72f-d6307a90e123/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:42:01 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/adcffd35-00c7-49db-a72f-d6307a90e123/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:42:02 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:42:02 user nova-compute[75045]: WARNING nova.virt.libvirt.driver [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 23:42:02 user nova-compute[75045]: WARNING nova.virt.libvirt.driver [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 23:42:02 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Hypervisor/Node resource view: name=user free_ram=8017MB free_disk=25.040878295898438GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75045) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 23:42:02 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:42:02 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:42:02 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Instance adcffd35-00c7-49db-a72f-d6307a90e123 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75045) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 23:42:02 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Instance 244c4cc9-2837-40c9-b4ad-37dc435c9749 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75045) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 23:42:02 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Instance 7ee587a0-e271-4262-a252-2ccb6c2faecb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75045) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 23:42:02 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Instance 18c197c4-3000-41b1-83bc-1a781744d539 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75045) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 23:42:02 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Instance 584e3043-addf-41f7-a3cd-de51c229af72 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75045) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 23:42:02 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Instance 0b413c71-c13a-4fea-91c4-f6b1953d54c6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75045) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 23:42:02 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=75045) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 23:42:02 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=75045) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 23:42:02 user nova-compute[75045]: DEBUG nova.scheduler.client.report [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Refreshing inventories for resource provider 62ba5f85-c74d-4b58-986e-d4197e813fd7 {{(pid=75045) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 08 23:42:02 user nova-compute[75045]: DEBUG nova.scheduler.client.report [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Updating ProviderTree inventory for provider 62ba5f85-c74d-4b58-986e-d4197e813fd7 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75045) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 08 23:42:02 user nova-compute[75045]: DEBUG nova.compute.provider_tree [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Updating inventory in ProviderTree for provider 62ba5f85-c74d-4b58-986e-d4197e813fd7 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75045) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 08 23:42:02 user nova-compute[75045]: DEBUG nova.scheduler.client.report [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Refreshing aggregate associations for resource provider 62ba5f85-c74d-4b58-986e-d4197e813fd7, aggregates: None {{(pid=75045) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 08 23:42:02 user nova-compute[75045]: DEBUG nova.scheduler.client.report [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Refreshing trait associations for resource provider 62ba5f85-c74d-4b58-986e-d4197e813fd7, traits: COMPUTE_STORAGE_BUS_SCSI,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_TRUSTED_CERTS,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_VIRTIO,HW_CPU_X86_SSSE3,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_FDC,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_RESCUE_BFV,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSE2,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN {{(pid=75045) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 08 23:42:02 user nova-compute[75045]: DEBUG nova.compute.provider_tree [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Inventory has not changed in ProviderTree for provider: 62ba5f85-c74d-4b58-986e-d4197e813fd7 {{(pid=75045) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 23:42:02 user nova-compute[75045]: DEBUG nova.scheduler.client.report [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Inventory has not changed for provider 62ba5f85-c74d-4b58-986e-d4197e813fd7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75045) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 23:42:02 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Compute_service record updated for user:user {{(pid=75045) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 23:42:02 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.645s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:42:02 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:42:02 user nova-compute[75045]: DEBUG nova.compute.manager [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Cleaning up deleted instances {{(pid=75045) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 08 23:42:02 user nova-compute[75045]: DEBUG nova.compute.manager [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] There are 0 instances to clean {{(pid=75045) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 08 23:42:03 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:42:05 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:42:05 user nova-compute[75045]: DEBUG nova.compute.manager [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Cleaning up deleted instances with incomplete migration  {{(pid=75045) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 08 23:42:06 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:42:08 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:42:11 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:42:13 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:42:16 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:42:18 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:42:21 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:42:23 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:42:28 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 23:42:29 user nova-compute[75045]: DEBUG nova.virt.libvirt.volume.iscsi [None req-012777e1-8101-4b1f-b735-792dc1f928c7 tempest-ServerStableDeviceRescueTest-1847572360 tempest-ServerStableDeviceRescueTest-1847572360-project-member] [instance: 7ee587a0-e271-4262-a252-2ccb6c2faecb] Calling os-brick to attach iSCSI Volume {{(pid=75045) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 23:42:29 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-012777e1-8101-4b1f-b735-792dc1f928c7 tempest-ServerStableDeviceRescueTest-1847572360 tempest-ServerStableDeviceRescueTest-1847572360-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1b68210460>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:7bd77e85-94b5-49aa-8412-c200279e0748', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'deTXjCzh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75045) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 23:42:29 user nova-compute[75045]: WARNING os_brick.initiator.connectors.base [None req-012777e1-8101-4b1f-b735-792dc1f928c7 tempest-ServerStableDeviceRescueTest-1847572360 tempest-ServerStableDeviceRescueTest-1847572360-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 23:42:29 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-012777e1-8101-4b1f-b735-792dc1f928c7 tempest-ServerStableDeviceRescueTest-1847572360 tempest-ServerStableDeviceRescueTest-1847572360-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 23:42:29 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-012777e1-8101-4b1f-b735-792dc1f928c7 tempest-ServerStableDeviceRescueTest-1847572360 tempest-ServerStableDeviceRescueTest-1847572360-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 23:42:29 user nova-compute[75045]: WARNING os_brick.initiator.connectors.base [None req-012777e1-8101-4b1f-b735-792dc1f928c7 tempest-ServerStableDeviceRescueTest-1847572360 tempest-ServerStableDeviceRescueTest-1847572360-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 23:42:29 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-012777e1-8101-4b1f-b735-792dc1f928c7 tempest-ServerStableDeviceRescueTest-1847572360 tempest-ServerStableDeviceRescueTest-1847572360-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7bd77e85-94b5-49aa-8412-c200279e0748" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 23:42:29 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-012777e1-8101-4b1f-b735-792dc1f928c7 tempest-ServerStableDeviceRescueTest-1847572360 tempest-ServerStableDeviceRescueTest-1847572360-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7bd77e85-94b5-49aa-8412-c200279e0748" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 23:42:29 user nova-compute[75045]: INFO os_brick.initiator.connectors.iscsi [None req-012777e1-8101-4b1f-b735-792dc1f928c7 tempest-ServerStableDeviceRescueTest-1847572360 tempest-ServerStableDeviceRescueTest-1847572360-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 23:42:29 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7bd77e85-94b5-49aa-8412-c200279e0748 -p 172.16.0.220:3260 {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:42:29 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7bd77e85-94b5-49aa-8412-c200279e0748 -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:42:29 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6070127-dc7e-4ee0-96dc-8f6a554e931d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:42:29 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-012777e1-8101-4b1f-b735-792dc1f928c7 tempest-ServerStableDeviceRescueTest-1847572360 tempest-ServerStableDeviceRescueTest-1847572360-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 23:42:29 user nova-compute[75045]:  {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:42:29 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7bd77e85-94b5-49aa-8412-c200279e0748 -p 172.16.0.220:3260 --interface default --op new {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:42:29 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7bd77e85-94b5-49aa-8412-c200279e0748 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:42:29 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcdaf4fb-403e-4383-88b8-ee2e805740d6]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7bd77e85-94b5-49aa-8412-c200279e0748] added\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:42:29 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-012777e1-8101-4b1f-b735-792dc1f928c7 tempest-ServerStableDeviceRescueTest-1847572360 tempest-ServerStableDeviceRescueTest-1847572360-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7bd77e85-94b5-49aa-8412-c200279e0748] added
Nov 08 23:42:29 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:42:29 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7bd77e85-94b5-49aa-8412-c200279e0748 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:42:29 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7bd77e85-94b5-49aa-8412-c200279e0748 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:42:29 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[05ee6e5c-b05e-4da5-8d1d-c86bf9e6a848]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:42:29 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-012777e1-8101-4b1f-b735-792dc1f928c7 tempest-ServerStableDeviceRescueTest-1847572360 tempest-ServerStableDeviceRescueTest-1847572360-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:42:29 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7bd77e85-94b5-49aa-8412-c200279e0748 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:42:29 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7bd77e85-94b5-49aa-8412-c200279e0748 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:42:29 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[656438ff-85ee-4686-a48f-0b5dfea3fcef]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:42:29 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-012777e1-8101-4b1f-b735-792dc1f928c7 tempest-ServerStableDeviceRescueTest-1847572360 tempest-ServerStableDeviceRescueTest-1847572360-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:42:29 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7bd77e85-94b5-49aa-8412-c200279e0748 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v deTXjCzh {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:42:29 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7bd77e85-94b5-49aa-8412-c200279e0748 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v deTXjCzh" returned: 0 in 0.018s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:42:29 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[afba7a28-6b49-45a9-ab94-d4a6ef4ac72c]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:42:29 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-012777e1-8101-4b1f-b735-792dc1f928c7 tempest-ServerStableDeviceRescueTest-1847572360 tempest-ServerStableDeviceRescueTest-1847572360-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'deTXjCzh'): stdout= stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:42:29 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7bd77e85-94b5-49aa-8412-c200279e0748 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:42:29 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7bd77e85-94b5-49aa-8412-c200279e0748 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:42:29 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[d50d7df5-bd90-4b15-b747-38d33d223810]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:42:29 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-012777e1-8101-4b1f-b735-792dc1f928c7 tempest-ServerStableDeviceRescueTest-1847572360 tempest-ServerStableDeviceRescueTest-1847572360-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:42:29 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:42:29 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:42:29 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1d47452-64cd-4e14-8a48-c142a395babd]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:42:29 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-012777e1-8101-4b1f-b735-792dc1f928c7 tempest-ServerStableDeviceRescueTest-1847572360 tempest-ServerStableDeviceRescueTest-1847572360-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 08 23:42:29 user nova-compute[75045]:  {{(pid=75045) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 23:42:29 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-012777e1-8101-4b1f-b735-792dc1f928c7 tempest-ServerStableDeviceRescueTest-1847572360 tempest-ServerStableDeviceRescueTest-1847572360-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 08 23:42:29 user nova-compute[75045]:  {{(pid=75045) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 23:42:29 user nova-compute[75045]: WARNING os_brick.initiator.connectors.iscsi [None req-012777e1-8101-4b1f-b735-792dc1f928c7 tempest-ServerStableDeviceRescueTest-1847572360 tempest-ServerStableDeviceRescueTest-1847572360-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 08 23:42:29 user nova-compute[75045]: 
Nov 08 23:42:29 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7bd77e85-94b5-49aa-8412-c200279e0748 -p 172.16.0.220:3260 --login {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:42:29 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7bd77e85-94b5-49aa-8412-c200279e0748 -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:42:29 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[d762332c-983b-4909-b224-0580d68ff9d5]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7bd77e85-94b5-49aa-8412-c200279e0748, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7bd77e85-94b5-49aa-8412-c200279e0748, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:42:29 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-012777e1-8101-4b1f-b735-792dc1f928c7 tempest-ServerStableDeviceRescueTest-1847572360 tempest-ServerStableDeviceRescueTest-1847572360-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7bd77e85-94b5-49aa-8412-c200279e0748, portal: 172.16.0.220,3260]
Nov 08 23:42:29 user nova-compute[75045]: Login to [iface: default, target: iqn.2010-10.org.openstack:7bd77e85-94b5-49aa-8412-c200279e0748, portal: 172.16.0.220,3260] successful.
Nov 08 23:42:29 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:42:29 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7bd77e85-94b5-49aa-8412-c200279e0748 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:42:29 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7bd77e85-94b5-49aa-8412-c200279e0748 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.128s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:42:29 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[f95f0482-81b4-4d2e-b1cb-5d8778079022]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:42:29 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-012777e1-8101-4b1f-b735-792dc1f928c7 tempest-ServerStableDeviceRescueTest-1847572360 tempest-ServerStableDeviceRescueTest-1847572360-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:42:29 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:42:29 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:42:29 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[488c7ca0-ad14-4faf-808c-3a992a789b9a]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7bd77e85-94b5-49aa-8412-c200279e0748 (non-flash)\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:42:29 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-012777e1-8101-4b1f-b735-792dc1f928c7 tempest-ServerStableDeviceRescueTest-1847572360 tempest-ServerStableDeviceRescueTest-1847572360-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7bd77e85-94b5-49aa-8412-c200279e0748 (non-flash)
Nov 08 23:42:29 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 23:42:29 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-012777e1-8101-4b1f-b735-792dc1f928c7 tempest-ServerStableDeviceRescueTest-1847572360 tempest-ServerStableDeviceRescueTest-1847572360-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7bd77e85-94b5-49aa-8412-c200279e0748 (non-flash)
Nov 08 23:42:29 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 23:42:29 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-012777e1-8101-4b1f-b735-792dc1f928c7 tempest-ServerStableDeviceRescueTest-1847572360 tempest-ServerStableDeviceRescueTest-1847572360-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7bd77e85-94b5-49aa-8412-c200279e0748" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.374s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 23:42:29 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-012777e1-8101-4b1f-b735-792dc1f928c7 tempest-ServerStableDeviceRescueTest-1847572360 tempest-ServerStableDeviceRescueTest-1847572360-project-member] Connected to 172.16.0.220:3260 {{(pid=75045) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 23:42:29 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-012777e1-8101-4b1f-b735-792dc1f928c7 tempest-ServerStableDeviceRescueTest-1847572360 tempest-ServerStableDeviceRescueTest-1847572360-project-member] HCTL ('33', '-', '-', 0) found on session 41 with lun 0 {{(pid=75045) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 23:42:29 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-012777e1-8101-4b1f-b735-792dc1f928c7 tempest-ServerStableDeviceRescueTest-1847572360 tempest-ServerStableDeviceRescueTest-1847572360-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75045) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 23:42:29 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:42:29 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.015s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:42:29 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3673567-e95d-4db7-ad7e-7ce7b9135872]: (4, ('- - 0', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:42:29 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-012777e1-8101-4b1f-b735-792dc1f928c7 tempest-ServerStableDeviceRescueTest-1847572360 tempest-ServerStableDeviceRescueTest-1847572360-project-member] Searching for a device in session 41 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75045) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 23:42:29 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-012777e1-8101-4b1f-b735-792dc1f928c7 tempest-ServerStableDeviceRescueTest-1847572360 tempest-ServerStableDeviceRescueTest-1847572360-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:7bd77e85-94b5-49aa-8412-c200279e0748', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'deTXjCzh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75045) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 23:42:30 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-012777e1-8101-4b1f-b735-792dc1f928c7 tempest-ServerStableDeviceRescueTest-1847572360 tempest-ServerStableDeviceRescueTest-1847572360-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.406s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 23:42:30 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-012777e1-8101-4b1f-b735-792dc1f928c7 tempest-ServerStableDeviceRescueTest-1847572360 tempest-ServerStableDeviceRescueTest-1847572360-project-member] <== connect_volume: return (1407ms) {'type': 'block', 'scsi_wwn': '23962666166376162', 'path': '/dev/sdb'} {{(pid=75045) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 23:42:30 user nova-compute[75045]: DEBUG nova.virt.libvirt.volume.iscsi [None req-012777e1-8101-4b1f-b735-792dc1f928c7 tempest-ServerStableDeviceRescueTest-1847572360 tempest-ServerStableDeviceRescueTest-1847572360-project-member] [instance: 7ee587a0-e271-4262-a252-2ccb6c2faecb] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23962666166376162', 'path': '/dev/sdb'} {{(pid=75045) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 23:42:30 user nova-compute[75045]: DEBUG nova.objects.instance [None req-012777e1-8101-4b1f-b735-792dc1f928c7 tempest-ServerStableDeviceRescueTest-1847572360 tempest-ServerStableDeviceRescueTest-1847572360-project-member] Lazy-loading 'flavor' on Instance uuid 7ee587a0-e271-4262-a252-2ccb6c2faecb {{(pid=75045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 23:42:30 user nova-compute[75045]: DEBUG nova.virt.libvirt.guest [None req-012777e1-8101-4b1f-b735-792dc1f928c7 tempest-ServerStableDeviceRescueTest-1847572360 tempest-ServerStableDeviceRescueTest-1847572360-project-member] attach device xml: <disk type="block" device="disk">
Nov 08 23:42:30 user nova-compute[75045]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 23:42:30 user nova-compute[75045]:   <source dev="/dev/sdb"/>
Nov 08 23:42:30 user nova-compute[75045]:   <target dev="vdb" bus="virtio"/>
Nov 08 23:42:30 user nova-compute[75045]:   <serial>7bd77e85-94b5-49aa-8412-c200279e0748</serial>
Nov 08 23:42:30 user nova-compute[75045]: </disk>
Nov 08 23:42:30 user nova-compute[75045]:  {{(pid=75045) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 08 23:42:31 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-012777e1-8101-4b1f-b735-792dc1f928c7 tempest-ServerStableDeviceRescueTest-1847572360 tempest-ServerStableDeviceRescueTest-1847572360-project-member] No BDM found with device name vda, not building metadata. {{(pid=75045) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 23:42:31 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-012777e1-8101-4b1f-b735-792dc1f928c7 tempest-ServerStableDeviceRescueTest-1847572360 tempest-ServerStableDeviceRescueTest-1847572360-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75045) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 23:42:31 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-012777e1-8101-4b1f-b735-792dc1f928c7 tempest-ServerStableDeviceRescueTest-1847572360 tempest-ServerStableDeviceRescueTest-1847572360-project-member] No VIF found with MAC fa:16:3e:03:88:6d, not building metadata {{(pid=75045) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 23:42:31 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-012777e1-8101-4b1f-b735-792dc1f928c7 tempest-ServerStableDeviceRescueTest-1847572360 tempest-ServerStableDeviceRescueTest-1847572360-project-member] Lock "7ee587a0-e271-4262-a252-2ccb6c2faecb" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 48.501s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:42:32 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._sync_power_states {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:42:32 user nova-compute[75045]: DEBUG nova.compute.manager [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Triggering sync for uuid adcffd35-00c7-49db-a72f-d6307a90e123 {{(pid=75045) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 08 23:42:32 user nova-compute[75045]: DEBUG nova.compute.manager [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Triggering sync for uuid 244c4cc9-2837-40c9-b4ad-37dc435c9749 {{(pid=75045) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 08 23:42:32 user nova-compute[75045]: DEBUG nova.compute.manager [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Triggering sync for uuid 7ee587a0-e271-4262-a252-2ccb6c2faecb {{(pid=75045) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 08 23:42:32 user nova-compute[75045]: DEBUG nova.compute.manager [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Triggering sync for uuid 18c197c4-3000-41b1-83bc-1a781744d539 {{(pid=75045) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 08 23:42:32 user nova-compute[75045]: DEBUG nova.compute.manager [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Triggering sync for uuid 584e3043-addf-41f7-a3cd-de51c229af72 {{(pid=75045) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 08 23:42:32 user nova-compute[75045]: DEBUG nova.compute.manager [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Triggering sync for uuid 0b413c71-c13a-4fea-91c4-f6b1953d54c6 {{(pid=75045) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 08 23:42:32 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Acquiring lock "adcffd35-00c7-49db-a72f-d6307a90e123" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:42:32 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Lock "adcffd35-00c7-49db-a72f-d6307a90e123" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:42:32 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Acquiring lock "244c4cc9-2837-40c9-b4ad-37dc435c9749" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:42:32 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Lock "244c4cc9-2837-40c9-b4ad-37dc435c9749" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:42:32 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Acquiring lock "7ee587a0-e271-4262-a252-2ccb6c2faecb" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:42:32 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Lock "7ee587a0-e271-4262-a252-2ccb6c2faecb" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:42:32 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Acquiring lock "18c197c4-3000-41b1-83bc-1a781744d539" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:42:32 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Lock "18c197c4-3000-41b1-83bc-1a781744d539" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:42:32 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Acquiring lock "584e3043-addf-41f7-a3cd-de51c229af72" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:42:32 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Lock "584e3043-addf-41f7-a3cd-de51c229af72" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:42:32 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Acquiring lock "0b413c71-c13a-4fea-91c4-f6b1953d54c6" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:42:32 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Lock "0b413c71-c13a-4fea-91c4-f6b1953d54c6" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:42:32 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Lock "adcffd35-00c7-49db-a72f-d6307a90e123" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.037s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:42:32 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Lock "7ee587a0-e271-4262-a252-2ccb6c2faecb" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.037s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:42:32 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Lock "244c4cc9-2837-40c9-b4ad-37dc435c9749" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.041s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:42:32 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Lock "584e3043-addf-41f7-a3cd-de51c229af72" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.046s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:42:32 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Lock "0b413c71-c13a-4fea-91c4-f6b1953d54c6" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.048s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:42:32 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Lock "18c197c4-3000-41b1-83bc-1a781744d539" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.051s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:42:32 user nova-compute[75045]: INFO nova.compute.manager [None req-be60315d-af48-481b-a8ea-adfde268af25 tempest-ServerStableDeviceRescueTest-1847572360 tempest-ServerStableDeviceRescueTest-1847572360-project-member] [instance: 7ee587a0-e271-4262-a252-2ccb6c2faecb] Rescuing
Nov 08 23:42:32 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-be60315d-af48-481b-a8ea-adfde268af25 tempest-ServerStableDeviceRescueTest-1847572360 tempest-ServerStableDeviceRescueTest-1847572360-project-member] Acquiring lock "refresh_cache-7ee587a0-e271-4262-a252-2ccb6c2faecb" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 23:42:32 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-be60315d-af48-481b-a8ea-adfde268af25 tempest-ServerStableDeviceRescueTest-1847572360 tempest-ServerStableDeviceRescueTest-1847572360-project-member] Acquired lock "refresh_cache-7ee587a0-e271-4262-a252-2ccb6c2faecb" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 23:42:32 user nova-compute[75045]: DEBUG nova.network.neutron [None req-be60315d-af48-481b-a8ea-adfde268af25 tempest-ServerStableDeviceRescueTest-1847572360 tempest-ServerStableDeviceRescueTest-1847572360-project-member] [instance: 7ee587a0-e271-4262-a252-2ccb6c2faecb] Building network info cache for instance {{(pid=75045) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 23:42:33 user nova-compute[75045]: DEBUG nova.network.neutron [None req-be60315d-af48-481b-a8ea-adfde268af25 tempest-ServerStableDeviceRescueTest-1847572360 tempest-ServerStableDeviceRescueTest-1847572360-project-member] [instance: 7ee587a0-e271-4262-a252-2ccb6c2faecb] Updating instance_info_cache with network_info: [{"id": "0b911e0a-0c01-4296-b269-f52ee68772f9", "address": "fa:16:3e:03:88:6d", "network": {"id": "3fc25e49-b987-4fe7-9c28-6a18b689a411", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1301325538-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.217", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4760b2fb18b44e26bfbca6bf16aea581", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b911e0a-0c", "ovs_interfaceid": "0b911e0a-0c01-4296-b269-f52ee68772f9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75045) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 23:42:33 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-be60315d-af48-481b-a8ea-adfde268af25 tempest-ServerStableDeviceRescueTest-1847572360 tempest-ServerStableDeviceRescueTest-1847572360-project-member] Releasing lock "refresh_cache-7ee587a0-e271-4262-a252-2ccb6c2faecb" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 23:42:33 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 23:42:33 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:42:33 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:42:33 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:42:33 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:42:33 user nova-compute[75045]: DEBUG nova.compute.manager [req-7bfeac5d-0f03-4074-aead-7e6fbda61162 req-ee16e75a-1538-4119-b413-af6fac58d403 service nova] [instance: 7ee587a0-e271-4262-a252-2ccb6c2faecb] Received event network-vif-unplugged-0b911e0a-0c01-4296-b269-f52ee68772f9 {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:42:33 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-7bfeac5d-0f03-4074-aead-7e6fbda61162 req-ee16e75a-1538-4119-b413-af6fac58d403 service nova] Acquiring lock "7ee587a0-e271-4262-a252-2ccb6c2faecb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:42:33 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-7bfeac5d-0f03-4074-aead-7e6fbda61162 req-ee16e75a-1538-4119-b413-af6fac58d403 service nova] Lock "7ee587a0-e271-4262-a252-2ccb6c2faecb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:42:33 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-7bfeac5d-0f03-4074-aead-7e6fbda61162 req-ee16e75a-1538-4119-b413-af6fac58d403 service nova] Lock "7ee587a0-e271-4262-a252-2ccb6c2faecb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:42:33 user nova-compute[75045]: DEBUG nova.compute.manager [req-7bfeac5d-0f03-4074-aead-7e6fbda61162 req-ee16e75a-1538-4119-b413-af6fac58d403 service nova] [instance: 7ee587a0-e271-4262-a252-2ccb6c2faecb] No waiting events found dispatching network-vif-unplugged-0b911e0a-0c01-4296-b269-f52ee68772f9 {{(pid=75045) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 23:42:33 user nova-compute[75045]: WARNING nova.compute.manager [req-7bfeac5d-0f03-4074-aead-7e6fbda61162 req-ee16e75a-1538-4119-b413-af6fac58d403 service nova] [instance: 7ee587a0-e271-4262-a252-2ccb6c2faecb] Received unexpected event network-vif-unplugged-0b911e0a-0c01-4296-b269-f52ee68772f9 for instance with vm_state active and task_state rescuing.
Nov 08 23:42:33 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:42:33 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:42:33 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:42:33 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:42:33 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:42:34 user nova-compute[75045]: INFO nova.virt.libvirt.driver [-] [instance: 7ee587a0-e271-4262-a252-2ccb6c2faecb] Instance destroyed successfully.
Nov 08 23:42:34 user nova-compute[75045]: INFO nova.virt.libvirt.driver [None req-be60315d-af48-481b-a8ea-adfde268af25 tempest-ServerStableDeviceRescueTest-1847572360 tempest-ServerStableDeviceRescueTest-1847572360-project-member] [instance: 7ee587a0-e271-4262-a252-2ccb6c2faecb] Attempting a stable device rescue
Nov 08 23:42:34 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:42:34 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-be60315d-af48-481b-a8ea-adfde268af25 tempest-ServerStableDeviceRescueTest-1847572360 tempest-ServerStableDeviceRescueTest-1847572360-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} {{(pid=75045) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 08 23:42:34 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-be60315d-af48-481b-a8ea-adfde268af25 tempest-ServerStableDeviceRescueTest-1847572360 tempest-ServerStableDeviceRescueTest-1847572360-project-member] [instance: 7ee587a0-e271-4262-a252-2ccb6c2faecb] Instance directory exists: not creating {{(pid=75045) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 08 23:42:34 user nova-compute[75045]: INFO nova.virt.libvirt.driver [None req-be60315d-af48-481b-a8ea-adfde268af25 tempest-ServerStableDeviceRescueTest-1847572360 tempest-ServerStableDeviceRescueTest-1847572360-project-member] [instance: 7ee587a0-e271-4262-a252-2ccb6c2faecb] Creating image(s)
Nov 08 23:42:34 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-be60315d-af48-481b-a8ea-adfde268af25 tempest-ServerStableDeviceRescueTest-1847572360 tempest-ServerStableDeviceRescueTest-1847572360-project-member] Acquiring lock "/opt/stack/data/nova/instances/7ee587a0-e271-4262-a252-2ccb6c2faecb/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:42:34 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-be60315d-af48-481b-a8ea-adfde268af25 tempest-ServerStableDeviceRescueTest-1847572360 tempest-ServerStableDeviceRescueTest-1847572360-project-member] Lock "/opt/stack/data/nova/instances/7ee587a0-e271-4262-a252-2ccb6c2faecb/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:42:34 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-be60315d-af48-481b-a8ea-adfde268af25 tempest-ServerStableDeviceRescueTest-1847572360 tempest-ServerStableDeviceRescueTest-1847572360-project-member] Lock "/opt/stack/data/nova/instances/7ee587a0-e271-4262-a252-2ccb6c2faecb/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:42:34 user nova-compute[75045]: DEBUG nova.objects.instance [None req-be60315d-af48-481b-a8ea-adfde268af25 tempest-ServerStableDeviceRescueTest-1847572360 tempest-ServerStableDeviceRescueTest-1847572360-project-member] Lazy-loading 'trusted_certs' on Instance uuid 7ee587a0-e271-4262-a252-2ccb6c2faecb {{(pid=75045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 23:42:34 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-be60315d-af48-481b-a8ea-adfde268af25 tempest-ServerStableDeviceRescueTest-1847572360 tempest-ServerStableDeviceRescueTest-1847572360-project-member] Acquiring lock "369f126ab7c81df11aa9b3a6a382ee286861cd79" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:42:34 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-be60315d-af48-481b-a8ea-adfde268af25 tempest-ServerStableDeviceRescueTest-1847572360 tempest-ServerStableDeviceRescueTest-1847572360-project-member] Lock "369f126ab7c81df11aa9b3a6a382ee286861cd79" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:42:35 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-be60315d-af48-481b-a8ea-adfde268af25 tempest-ServerStableDeviceRescueTest-1847572360 tempest-ServerStableDeviceRescueTest-1847572360-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/369f126ab7c81df11aa9b3a6a382ee286861cd79.part --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:42:35 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:42:35 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-be60315d-af48-481b-a8ea-adfde268af25 tempest-ServerStableDeviceRescueTest-1847572360 tempest-ServerStableDeviceRescueTest-1847572360-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/369f126ab7c81df11aa9b3a6a382ee286861cd79.part --force-share --output=json" returned: 0 in 0.177s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:42:35 user nova-compute[75045]: DEBUG nova.virt.images [None req-be60315d-af48-481b-a8ea-adfde268af25 tempest-ServerStableDeviceRescueTest-1847572360 tempest-ServerStableDeviceRescueTest-1847572360-project-member] 212450bd-7bd9-4d15-a960-605d674c135d was qcow2, converting to raw {{(pid=75045) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 08 23:42:35 user nova-compute[75045]: DEBUG nova.privsep.utils [None req-be60315d-af48-481b-a8ea-adfde268af25 tempest-ServerStableDeviceRescueTest-1847572360 tempest-ServerStableDeviceRescueTest-1847572360-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75045) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 08 23:42:35 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-be60315d-af48-481b-a8ea-adfde268af25 tempest-ServerStableDeviceRescueTest-1847572360 tempest-ServerStableDeviceRescueTest-1847572360-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/369f126ab7c81df11aa9b3a6a382ee286861cd79.part /opt/stack/data/nova/instances/_base/369f126ab7c81df11aa9b3a6a382ee286861cd79.converted {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:42:35 user nova-compute[75045]: DEBUG nova.compute.manager [req-c3b6e909-de5a-44de-b39a-4850c283374d req-20dcab01-70a1-4894-ad9e-aea8b1965e72 service nova] [instance: 7ee587a0-e271-4262-a252-2ccb6c2faecb] Received event network-vif-plugged-0b911e0a-0c01-4296-b269-f52ee68772f9 {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:42:35 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-c3b6e909-de5a-44de-b39a-4850c283374d req-20dcab01-70a1-4894-ad9e-aea8b1965e72 service nova] Acquiring lock "7ee587a0-e271-4262-a252-2ccb6c2faecb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:42:35 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-c3b6e909-de5a-44de-b39a-4850c283374d req-20dcab01-70a1-4894-ad9e-aea8b1965e72 service nova] Lock "7ee587a0-e271-4262-a252-2ccb6c2faecb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.015s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:42:35 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-c3b6e909-de5a-44de-b39a-4850c283374d req-20dcab01-70a1-4894-ad9e-aea8b1965e72 service nova] Lock "7ee587a0-e271-4262-a252-2ccb6c2faecb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:42:35 user nova-compute[75045]: DEBUG nova.compute.manager [req-c3b6e909-de5a-44de-b39a-4850c283374d req-20dcab01-70a1-4894-ad9e-aea8b1965e72 service nova] [instance: 7ee587a0-e271-4262-a252-2ccb6c2faecb] No waiting events found dispatching network-vif-plugged-0b911e0a-0c01-4296-b269-f52ee68772f9 {{(pid=75045) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 23:42:35 user nova-compute[75045]: WARNING nova.compute.manager [req-c3b6e909-de5a-44de-b39a-4850c283374d req-20dcab01-70a1-4894-ad9e-aea8b1965e72 service nova] [instance: 7ee587a0-e271-4262-a252-2ccb6c2faecb] Received unexpected event network-vif-plugged-0b911e0a-0c01-4296-b269-f52ee68772f9 for instance with vm_state active and task_state rescuing.
Nov 08 23:42:35 user nova-compute[75045]: DEBUG nova.compute.manager [req-c3b6e909-de5a-44de-b39a-4850c283374d req-20dcab01-70a1-4894-ad9e-aea8b1965e72 service nova] [instance: 7ee587a0-e271-4262-a252-2ccb6c2faecb] Received event network-vif-plugged-0b911e0a-0c01-4296-b269-f52ee68772f9 {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:42:35 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-c3b6e909-de5a-44de-b39a-4850c283374d req-20dcab01-70a1-4894-ad9e-aea8b1965e72 service nova] Acquiring lock "7ee587a0-e271-4262-a252-2ccb6c2faecb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:42:35 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-c3b6e909-de5a-44de-b39a-4850c283374d req-20dcab01-70a1-4894-ad9e-aea8b1965e72 service nova] Lock "7ee587a0-e271-4262-a252-2ccb6c2faecb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:42:35 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-c3b6e909-de5a-44de-b39a-4850c283374d req-20dcab01-70a1-4894-ad9e-aea8b1965e72 service nova] Lock "7ee587a0-e271-4262-a252-2ccb6c2faecb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:42:35 user nova-compute[75045]: DEBUG nova.compute.manager [req-c3b6e909-de5a-44de-b39a-4850c283374d req-20dcab01-70a1-4894-ad9e-aea8b1965e72 service nova] [instance: 7ee587a0-e271-4262-a252-2ccb6c2faecb] No waiting events found dispatching network-vif-plugged-0b911e0a-0c01-4296-b269-f52ee68772f9 {{(pid=75045) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 23:42:35 user nova-compute[75045]: WARNING nova.compute.manager [req-c3b6e909-de5a-44de-b39a-4850c283374d req-20dcab01-70a1-4894-ad9e-aea8b1965e72 service nova] [instance: 7ee587a0-e271-4262-a252-2ccb6c2faecb] Received unexpected event network-vif-plugged-0b911e0a-0c01-4296-b269-f52ee68772f9 for instance with vm_state active and task_state rescuing.
Nov 08 23:42:35 user nova-compute[75045]: DEBUG nova.compute.manager [req-c3b6e909-de5a-44de-b39a-4850c283374d req-20dcab01-70a1-4894-ad9e-aea8b1965e72 service nova] [instance: 7ee587a0-e271-4262-a252-2ccb6c2faecb] Received event network-vif-plugged-0b911e0a-0c01-4296-b269-f52ee68772f9 {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:42:35 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-c3b6e909-de5a-44de-b39a-4850c283374d req-20dcab01-70a1-4894-ad9e-aea8b1965e72 service nova] Acquiring lock "7ee587a0-e271-4262-a252-2ccb6c2faecb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:42:35 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-c3b6e909-de5a-44de-b39a-4850c283374d req-20dcab01-70a1-4894-ad9e-aea8b1965e72 service nova] Lock "7ee587a0-e271-4262-a252-2ccb6c2faecb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:42:35 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-c3b6e909-de5a-44de-b39a-4850c283374d req-20dcab01-70a1-4894-ad9e-aea8b1965e72 service nova] Lock "7ee587a0-e271-4262-a252-2ccb6c2faecb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:42:35 user nova-compute[75045]: DEBUG nova.compute.manager [req-c3b6e909-de5a-44de-b39a-4850c283374d req-20dcab01-70a1-4894-ad9e-aea8b1965e72 service nova] [instance: 7ee587a0-e271-4262-a252-2ccb6c2faecb] No waiting events found dispatching network-vif-plugged-0b911e0a-0c01-4296-b269-f52ee68772f9 {{(pid=75045) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 23:42:35 user nova-compute[75045]: WARNING nova.compute.manager [req-c3b6e909-de5a-44de-b39a-4850c283374d req-20dcab01-70a1-4894-ad9e-aea8b1965e72 service nova] [instance: 7ee587a0-e271-4262-a252-2ccb6c2faecb] Received unexpected event network-vif-plugged-0b911e0a-0c01-4296-b269-f52ee68772f9 for instance with vm_state active and task_state rescuing.
Nov 08 23:42:35 user nova-compute[75045]: DEBUG nova.compute.manager [req-c3b6e909-de5a-44de-b39a-4850c283374d req-20dcab01-70a1-4894-ad9e-aea8b1965e72 service nova] [instance: 7ee587a0-e271-4262-a252-2ccb6c2faecb] Received event network-vif-unplugged-0b911e0a-0c01-4296-b269-f52ee68772f9 {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:42:35 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-c3b6e909-de5a-44de-b39a-4850c283374d req-20dcab01-70a1-4894-ad9e-aea8b1965e72 service nova] Acquiring lock "7ee587a0-e271-4262-a252-2ccb6c2faecb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:42:35 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-c3b6e909-de5a-44de-b39a-4850c283374d req-20dcab01-70a1-4894-ad9e-aea8b1965e72 service nova] Lock "7ee587a0-e271-4262-a252-2ccb6c2faecb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:42:35 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-c3b6e909-de5a-44de-b39a-4850c283374d req-20dcab01-70a1-4894-ad9e-aea8b1965e72 service nova] Lock "7ee587a0-e271-4262-a252-2ccb6c2faecb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:42:35 user nova-compute[75045]: DEBUG nova.compute.manager [req-c3b6e909-de5a-44de-b39a-4850c283374d req-20dcab01-70a1-4894-ad9e-aea8b1965e72 service nova] [instance: 7ee587a0-e271-4262-a252-2ccb6c2faecb] No waiting events found dispatching network-vif-unplugged-0b911e0a-0c01-4296-b269-f52ee68772f9 {{(pid=75045) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 23:42:35 user nova-compute[75045]: WARNING nova.compute.manager [req-c3b6e909-de5a-44de-b39a-4850c283374d req-20dcab01-70a1-4894-ad9e-aea8b1965e72 service nova] [instance: 7ee587a0-e271-4262-a252-2ccb6c2faecb] Received unexpected event network-vif-unplugged-0b911e0a-0c01-4296-b269-f52ee68772f9 for instance with vm_state active and task_state rescuing.
Nov 08 23:42:35 user nova-compute[75045]: DEBUG nova.compute.manager [req-c3b6e909-de5a-44de-b39a-4850c283374d req-20dcab01-70a1-4894-ad9e-aea8b1965e72 service nova] [instance: 7ee587a0-e271-4262-a252-2ccb6c2faecb] Received event network-vif-plugged-0b911e0a-0c01-4296-b269-f52ee68772f9 {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:42:35 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-c3b6e909-de5a-44de-b39a-4850c283374d req-20dcab01-70a1-4894-ad9e-aea8b1965e72 service nova] Acquiring lock "7ee587a0-e271-4262-a252-2ccb6c2faecb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:42:35 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-c3b6e909-de5a-44de-b39a-4850c283374d req-20dcab01-70a1-4894-ad9e-aea8b1965e72 service nova] Lock "7ee587a0-e271-4262-a252-2ccb6c2faecb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:42:35 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-c3b6e909-de5a-44de-b39a-4850c283374d req-20dcab01-70a1-4894-ad9e-aea8b1965e72 service nova] Lock "7ee587a0-e271-4262-a252-2ccb6c2faecb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:42:35 user nova-compute[75045]: DEBUG nova.compute.manager [req-c3b6e909-de5a-44de-b39a-4850c283374d req-20dcab01-70a1-4894-ad9e-aea8b1965e72 service nova] [instance: 7ee587a0-e271-4262-a252-2ccb6c2faecb] No waiting events found dispatching network-vif-plugged-0b911e0a-0c01-4296-b269-f52ee68772f9 {{(pid=75045) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 23:42:35 user nova-compute[75045]: WARNING nova.compute.manager [req-c3b6e909-de5a-44de-b39a-4850c283374d req-20dcab01-70a1-4894-ad9e-aea8b1965e72 service nova] [instance: 7ee587a0-e271-4262-a252-2ccb6c2faecb] Received unexpected event network-vif-plugged-0b911e0a-0c01-4296-b269-f52ee68772f9 for instance with vm_state active and task_state rescuing.
Nov 08 23:42:35 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-be60315d-af48-481b-a8ea-adfde268af25 tempest-ServerStableDeviceRescueTest-1847572360 tempest-ServerStableDeviceRescueTest-1847572360-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/369f126ab7c81df11aa9b3a6a382ee286861cd79.part /opt/stack/data/nova/instances/_base/369f126ab7c81df11aa9b3a6a382ee286861cd79.converted" returned: 0 in 0.413s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:42:35 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-be60315d-af48-481b-a8ea-adfde268af25 tempest-ServerStableDeviceRescueTest-1847572360 tempest-ServerStableDeviceRescueTest-1847572360-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/369f126ab7c81df11aa9b3a6a382ee286861cd79.converted --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:42:35 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-be60315d-af48-481b-a8ea-adfde268af25 tempest-ServerStableDeviceRescueTest-1847572360 tempest-ServerStableDeviceRescueTest-1847572360-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/369f126ab7c81df11aa9b3a6a382ee286861cd79.converted --force-share --output=json" returned: 0 in 0.174s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:42:35 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-be60315d-af48-481b-a8ea-adfde268af25 tempest-ServerStableDeviceRescueTest-1847572360 tempest-ServerStableDeviceRescueTest-1847572360-project-member] Lock "369f126ab7c81df11aa9b3a6a382ee286861cd79" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.727s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:42:35 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-be60315d-af48-481b-a8ea-adfde268af25 tempest-ServerStableDeviceRescueTest-1847572360 tempest-ServerStableDeviceRescueTest-1847572360-project-member] Acquiring lock "369f126ab7c81df11aa9b3a6a382ee286861cd79" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:42:35 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-be60315d-af48-481b-a8ea-adfde268af25 tempest-ServerStableDeviceRescueTest-1847572360 tempest-ServerStableDeviceRescueTest-1847572360-project-member] Lock "369f126ab7c81df11aa9b3a6a382ee286861cd79" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:42:35 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-be60315d-af48-481b-a8ea-adfde268af25 tempest-ServerStableDeviceRescueTest-1847572360 tempest-ServerStableDeviceRescueTest-1847572360-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/369f126ab7c81df11aa9b3a6a382ee286861cd79 --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:42:36 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-be60315d-af48-481b-a8ea-adfde268af25 tempest-ServerStableDeviceRescueTest-1847572360 tempest-ServerStableDeviceRescueTest-1847572360-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/369f126ab7c81df11aa9b3a6a382ee286861cd79 --force-share --output=json" returned: 0 in 0.190s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:42:36 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-be60315d-af48-481b-a8ea-adfde268af25 tempest-ServerStableDeviceRescueTest-1847572360 tempest-ServerStableDeviceRescueTest-1847572360-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/369f126ab7c81df11aa9b3a6a382ee286861cd79,backing_fmt=raw /opt/stack/data/nova/instances/7ee587a0-e271-4262-a252-2ccb6c2faecb/disk.rescue {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:42:36 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-be60315d-af48-481b-a8ea-adfde268af25 tempest-ServerStableDeviceRescueTest-1847572360 tempest-ServerStableDeviceRescueTest-1847572360-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/369f126ab7c81df11aa9b3a6a382ee286861cd79,backing_fmt=raw /opt/stack/data/nova/instances/7ee587a0-e271-4262-a252-2ccb6c2faecb/disk.rescue" returned: 0 in 0.048s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:42:36 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-be60315d-af48-481b-a8ea-adfde268af25 tempest-ServerStableDeviceRescueTest-1847572360 tempest-ServerStableDeviceRescueTest-1847572360-project-member] Lock "369f126ab7c81df11aa9b3a6a382ee286861cd79" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.245s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:42:36 user nova-compute[75045]: DEBUG nova.objects.instance [None req-be60315d-af48-481b-a8ea-adfde268af25 tempest-ServerStableDeviceRescueTest-1847572360 tempest-ServerStableDeviceRescueTest-1847572360-project-member] Lazy-loading 'migration_context' on Instance uuid 7ee587a0-e271-4262-a252-2ccb6c2faecb {{(pid=75045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 23:42:36 user nova-compute[75045]: DEBUG nova.objects.base [None req-be60315d-af48-481b-a8ea-adfde268af25 tempest-ServerStableDeviceRescueTest-1847572360 tempest-ServerStableDeviceRescueTest-1847572360-project-member] Object Instance<7ee587a0-e271-4262-a252-2ccb6c2faecb> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75045) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 23:42:36 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-be60315d-af48-481b-a8ea-adfde268af25 tempest-ServerStableDeviceRescueTest-1847572360 tempest-ServerStableDeviceRescueTest-1847572360-project-member] [instance: 7ee587a0-e271-4262-a252-2ccb6c2faecb] Created local disks {{(pid=75045) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 23:42:36 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-be60315d-af48-481b-a8ea-adfde268af25 tempest-ServerStableDeviceRescueTest-1847572360 tempest-ServerStableDeviceRescueTest-1847572360-project-member] [instance: 7ee587a0-e271-4262-a252-2ccb6c2faecb] Start _get_guest_xml network_info=[{"id": "0b911e0a-0c01-4296-b269-f52ee68772f9", "address": "fa:16:3e:03:88:6d", "network": {"id": "3fc25e49-b987-4fe7-9c28-6a18b689a411", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1301325538-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.217", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1301325538-network", "vif_mac": "fa:16:3e:03:88:6d"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4760b2fb18b44e26bfbca6bf16aea581", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b911e0a-0c", "ovs_interfaceid": "0b911e0a-0c01-4296-b269-f52ee68772f9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T23:11:54Z,direct_url=<?>,disk_format='qcow2',id=a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b1beba2cc4e7465ea249e2225fb494dc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T23:11:56Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '212450bd-7bd9-4d15-a960-605d674c135d', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'disk_bus': 'virtio', 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': 'a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb'}], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'device_type': 'disk', 'attachment_id': 'ca592629-0c62-4b63-9a6d-288dee039b90', 'guest_format': None, 'disk_bus': 'virtio', 'boot_index': None, 'mount_device': '/dev/vdb', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:7bd77e85-94b5-49aa-8412-c200279e0748', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'deTXjCzh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': '7ee587a0-e271-4262-a252-2ccb6c2faecb', 'attached_at': '', 'detached_at': '', 'volume_id': '7bd77e85-94b5-49aa-8412-c200279e0748', 'serial': '7bd77e85-94b5-49aa-8412-c200279e0748'}, 'volume_type': None} {{(pid=75045) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 23:42:36 user nova-compute[75045]: DEBUG nova.objects.instance [None req-be60315d-af48-481b-a8ea-adfde268af25 tempest-ServerStableDeviceRescueTest-1847572360 tempest-ServerStableDeviceRescueTest-1847572360-project-member] Lazy-loading 'resources' on Instance uuid 7ee587a0-e271-4262-a252-2ccb6c2faecb {{(pid=75045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 23:42:36 user nova-compute[75045]: DEBUG nova.objects.base [None req-be60315d-af48-481b-a8ea-adfde268af25 tempest-ServerStableDeviceRescueTest-1847572360 tempest-ServerStableDeviceRescueTest-1847572360-project-member] Object Instance<7ee587a0-e271-4262-a252-2ccb6c2faecb> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75045) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 23:42:36 user nova-compute[75045]: DEBUG nova.objects.instance [None req-be60315d-af48-481b-a8ea-adfde268af25 tempest-ServerStableDeviceRescueTest-1847572360 tempest-ServerStableDeviceRescueTest-1847572360-project-member] Lazy-loading 'numa_topology' on Instance uuid 7ee587a0-e271-4262-a252-2ccb6c2faecb {{(pid=75045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 23:42:36 user nova-compute[75045]: DEBUG nova.objects.base [None req-be60315d-af48-481b-a8ea-adfde268af25 tempest-ServerStableDeviceRescueTest-1847572360 tempest-ServerStableDeviceRescueTest-1847572360-project-member] Object Instance<7ee587a0-e271-4262-a252-2ccb6c2faecb> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75045) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 23:42:36 user nova-compute[75045]: WARNING nova.virt.libvirt.driver [None req-be60315d-af48-481b-a8ea-adfde268af25 tempest-ServerStableDeviceRescueTest-1847572360 tempest-ServerStableDeviceRescueTest-1847572360-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 23:42:36 user nova-compute[75045]: WARNING nova.virt.libvirt.driver [None req-be60315d-af48-481b-a8ea-adfde268af25 tempest-ServerStableDeviceRescueTest-1847572360 tempest-ServerStableDeviceRescueTest-1847572360-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 23:42:36 user nova-compute[75045]: DEBUG nova.virt.libvirt.host [None req-be60315d-af48-481b-a8ea-adfde268af25 tempest-ServerStableDeviceRescueTest-1847572360 tempest-ServerStableDeviceRescueTest-1847572360-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75045) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 23:42:36 user nova-compute[75045]: DEBUG nova.virt.libvirt.host [None req-be60315d-af48-481b-a8ea-adfde268af25 tempest-ServerStableDeviceRescueTest-1847572360 tempest-ServerStableDeviceRescueTest-1847572360-project-member] CPU controller missing on host. {{(pid=75045) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 23:42:36 user nova-compute[75045]: DEBUG nova.virt.libvirt.host [None req-be60315d-af48-481b-a8ea-adfde268af25 tempest-ServerStableDeviceRescueTest-1847572360 tempest-ServerStableDeviceRescueTest-1847572360-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75045) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 23:42:36 user nova-compute[75045]: DEBUG nova.virt.libvirt.host [None req-be60315d-af48-481b-a8ea-adfde268af25 tempest-ServerStableDeviceRescueTest-1847572360 tempest-ServerStableDeviceRescueTest-1847572360-project-member] CPU controller found on host. {{(pid=75045) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 23:42:36 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-be60315d-af48-481b-a8ea-adfde268af25 tempest-ServerStableDeviceRescueTest-1847572360 tempest-ServerStableDeviceRescueTest-1847572360-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75045) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 23:42:36 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-be60315d-af48-481b-a8ea-adfde268af25 tempest-ServerStableDeviceRescueTest-1847572360 tempest-ServerStableDeviceRescueTest-1847572360-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T23:11:41Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T23:11:54Z,direct_url=<?>,disk_format='qcow2',id=a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b1beba2cc4e7465ea249e2225fb494dc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T23:11:56Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75045) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 23:42:36 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-be60315d-af48-481b-a8ea-adfde268af25 tempest-ServerStableDeviceRescueTest-1847572360 tempest-ServerStableDeviceRescueTest-1847572360-project-member] Flavor limits 0:0:0 {{(pid=75045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 23:42:36 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-be60315d-af48-481b-a8ea-adfde268af25 tempest-ServerStableDeviceRescueTest-1847572360 tempest-ServerStableDeviceRescueTest-1847572360-project-member] Image limits 0:0:0 {{(pid=75045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 23:42:36 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-be60315d-af48-481b-a8ea-adfde268af25 tempest-ServerStableDeviceRescueTest-1847572360 tempest-ServerStableDeviceRescueTest-1847572360-project-member] Flavor pref 0:0:0 {{(pid=75045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 23:42:36 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-be60315d-af48-481b-a8ea-adfde268af25 tempest-ServerStableDeviceRescueTest-1847572360 tempest-ServerStableDeviceRescueTest-1847572360-project-member] Image pref 0:0:0 {{(pid=75045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 23:42:36 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-be60315d-af48-481b-a8ea-adfde268af25 tempest-ServerStableDeviceRescueTest-1847572360 tempest-ServerStableDeviceRescueTest-1847572360-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 23:42:36 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-be60315d-af48-481b-a8ea-adfde268af25 tempest-ServerStableDeviceRescueTest-1847572360 tempest-ServerStableDeviceRescueTest-1847572360-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75045) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 23:42:36 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-be60315d-af48-481b-a8ea-adfde268af25 tempest-ServerStableDeviceRescueTest-1847572360 tempest-ServerStableDeviceRescueTest-1847572360-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75045) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 23:42:36 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-be60315d-af48-481b-a8ea-adfde268af25 tempest-ServerStableDeviceRescueTest-1847572360 tempest-ServerStableDeviceRescueTest-1847572360-project-member] Got 1 possible topologies {{(pid=75045) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 23:42:36 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-be60315d-af48-481b-a8ea-adfde268af25 tempest-ServerStableDeviceRescueTest-1847572360 tempest-ServerStableDeviceRescueTest-1847572360-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75045) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 23:42:36 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-be60315d-af48-481b-a8ea-adfde268af25 tempest-ServerStableDeviceRescueTest-1847572360 tempest-ServerStableDeviceRescueTest-1847572360-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75045) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 23:42:36 user nova-compute[75045]: DEBUG nova.objects.instance [None req-be60315d-af48-481b-a8ea-adfde268af25 tempest-ServerStableDeviceRescueTest-1847572360 tempest-ServerStableDeviceRescueTest-1847572360-project-member] Lazy-loading 'vcpu_model' on Instance uuid 7ee587a0-e271-4262-a252-2ccb6c2faecb {{(pid=75045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 23:42:36 user nova-compute[75045]: DEBUG nova.objects.base [None req-be60315d-af48-481b-a8ea-adfde268af25 tempest-ServerStableDeviceRescueTest-1847572360 tempest-ServerStableDeviceRescueTest-1847572360-project-member] Object Instance<7ee587a0-e271-4262-a252-2ccb6c2faecb> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75045) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 23:42:36 user nova-compute[75045]: DEBUG nova.virt.libvirt.volume.iscsi [None req-be60315d-af48-481b-a8ea-adfde268af25 tempest-ServerStableDeviceRescueTest-1847572360 tempest-ServerStableDeviceRescueTest-1847572360-project-member] [instance: 7ee587a0-e271-4262-a252-2ccb6c2faecb] Calling os-brick to attach iSCSI Volume {{(pid=75045) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 23:42:36 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-be60315d-af48-481b-a8ea-adfde268af25 tempest-ServerStableDeviceRescueTest-1847572360 tempest-ServerStableDeviceRescueTest-1847572360-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1b68210460>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:7bd77e85-94b5-49aa-8412-c200279e0748', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'deTXjCzh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75045) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 23:42:36 user nova-compute[75045]: WARNING os_brick.initiator.connectors.base [None req-be60315d-af48-481b-a8ea-adfde268af25 tempest-ServerStableDeviceRescueTest-1847572360 tempest-ServerStableDeviceRescueTest-1847572360-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 23:42:36 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-be60315d-af48-481b-a8ea-adfde268af25 tempest-ServerStableDeviceRescueTest-1847572360 tempest-ServerStableDeviceRescueTest-1847572360-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 23:42:36 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-be60315d-af48-481b-a8ea-adfde268af25 tempest-ServerStableDeviceRescueTest-1847572360 tempest-ServerStableDeviceRescueTest-1847572360-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 23:42:36 user nova-compute[75045]: WARNING os_brick.initiator.connectors.base [None req-be60315d-af48-481b-a8ea-adfde268af25 tempest-ServerStableDeviceRescueTest-1847572360 tempest-ServerStableDeviceRescueTest-1847572360-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 23:42:36 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-be60315d-af48-481b-a8ea-adfde268af25 tempest-ServerStableDeviceRescueTest-1847572360 tempest-ServerStableDeviceRescueTest-1847572360-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7bd77e85-94b5-49aa-8412-c200279e0748" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 23:42:36 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-be60315d-af48-481b-a8ea-adfde268af25 tempest-ServerStableDeviceRescueTest-1847572360 tempest-ServerStableDeviceRescueTest-1847572360-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7bd77e85-94b5-49aa-8412-c200279e0748" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 23:42:36 user nova-compute[75045]: INFO os_brick.initiator.connectors.iscsi [None req-be60315d-af48-481b-a8ea-adfde268af25 tempest-ServerStableDeviceRescueTest-1847572360 tempest-ServerStableDeviceRescueTest-1847572360-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 23:42:36 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7bd77e85-94b5-49aa-8412-c200279e0748 -p 172.16.0.220:3260 {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:42:36 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7bd77e85-94b5-49aa-8412-c200279e0748 -p 172.16.0.220:3260" returned: 0 in 0.019s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:42:36 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[76a3c579-a7c7-496b-88e3-2ddef6f3f9eb]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:7bd77e85-94b5-49aa-8412-c200279e0748\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = deTXjCzh\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:42:36 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-be60315d-af48-481b-a8ea-adfde268af25 tempest-ServerStableDeviceRescueTest-1847572360 tempest-ServerStableDeviceRescueTest-1847572360-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Nov 08 23:42:36 user nova-compute[75045]: node.name = iqn.2010-10.org.openstack:7bd77e85-94b5-49aa-8412-c200279e0748
Nov 08 23:42:36 user nova-compute[75045]: node.tpgt = -1
Nov 08 23:42:36 user nova-compute[75045]: node.startup = automatic
Nov 08 23:42:36 user nova-compute[75045]: node.leading_login = No
Nov 08 23:42:36 user nova-compute[75045]: iface.iscsi_ifacename = default
Nov 08 23:42:36 user nova-compute[75045]: iface.net_ifacename = <empty>
Nov 08 23:42:36 user nova-compute[75045]: iface.ipaddress = <empty>
Nov 08 23:42:36 user nova-compute[75045]: iface.prefix_len = 0
Nov 08 23:42:36 user nova-compute[75045]: iface.hwaddress = <empty>
Nov 08 23:42:36 user nova-compute[75045]: iface.transport_name = tcp
Nov 08 23:42:36 user nova-compute[75045]: iface.initiatorname = <empty>
Nov 08 23:42:36 user nova-compute[75045]: iface.state = <empty>
Nov 08 23:42:36 user nova-compute[75045]: iface.vlan_id = 0
Nov 08 23:42:36 user nova-compute[75045]: iface.vlan_priority = 0
Nov 08 23:42:36 user nova-compute[75045]: iface.vlan_state = <empty>
Nov 08 23:42:36 user nova-compute[75045]: iface.iface_num = 0
Nov 08 23:42:36 user nova-compute[75045]: iface.mtu = 0
Nov 08 23:42:36 user nova-compute[75045]: iface.port = 0
Nov 08 23:42:36 user nova-compute[75045]: iface.bootproto = <empty>
Nov 08 23:42:36 user nova-compute[75045]: iface.subnet_mask = <empty>
Nov 08 23:42:36 user nova-compute[75045]: iface.gateway = <empty>
Nov 08 23:42:36 user nova-compute[75045]: iface.dhcp_alt_client_id_state = <empty>
Nov 08 23:42:36 user nova-compute[75045]: iface.dhcp_alt_client_id = <empty>
Nov 08 23:42:36 user nova-compute[75045]: iface.dhcp_dns = <empty>
Nov 08 23:42:36 user nova-compute[75045]: iface.dhcp_learn_iqn = <empty>
Nov 08 23:42:36 user nova-compute[75045]: iface.dhcp_req_vendor_id_state = <empty>
Nov 08 23:42:36 user nova-compute[75045]: iface.dhcp_vendor_id_state = <empty>
Nov 08 23:42:36 user nova-compute[75045]: iface.dhcp_vendor_id = <empty>
Nov 08 23:42:36 user nova-compute[75045]: iface.dhcp_slp_da = <empty>
Nov 08 23:42:36 user nova-compute[75045]: iface.fragmentation = <empty>
Nov 08 23:42:36 user nova-compute[75045]: iface.gratuitous_arp = <empty>
Nov 08 23:42:36 user nova-compute[75045]: iface.incoming_forwarding = <empty>
Nov 08 23:42:36 user nova-compute[75045]: iface.tos_state = <empty>
Nov 08 23:42:36 user nova-compute[75045]: iface.tos = 0
Nov 08 23:42:36 user nova-compute[75045]: iface.ttl = 0
Nov 08 23:42:36 user nova-compute[75045]: iface.delayed_ack = <empty>
Nov 08 23:42:36 user nova-compute[75045]: iface.tcp_nagle = <empty>
Nov 08 23:42:36 user nova-compute[75045]: iface.tcp_wsf_state = <empty>
Nov 08 23:42:36 user nova-compute[75045]: iface.tcp_wsf = 0
Nov 08 23:42:36 user nova-compute[75045]: iface.tcp_timer_scale = 0
Nov 08 23:42:36 user nova-compute[75045]: iface.tcp_timestamp = <empty>
Nov 08 23:42:36 user nova-compute[75045]: iface.redirect = <empty>
Nov 08 23:42:36 user nova-compute[75045]: iface.def_task_mgmt_timeout = 0
Nov 08 23:42:36 user nova-compute[75045]: iface.header_digest = <empty>
Nov 08 23:42:36 user nova-compute[75045]: iface.data_digest = <empty>
Nov 08 23:42:36 user nova-compute[75045]: iface.immediate_data = <empty>
Nov 08 23:42:36 user nova-compute[75045]: iface.initial_r2t = <empty>
Nov 08 23:42:36 user nova-compute[75045]: iface.data_seq_inorder = <empty>
Nov 08 23:42:36 user nova-compute[75045]: iface.data_pdu_inorder = <empty>
Nov 08 23:42:36 user nova-compute[75045]: iface.erl = 0
Nov 08 23:42:36 user nova-compute[75045]: iface.max_receive_data_len = 0
Nov 08 23:42:36 user nova-compute[75045]: iface.first_burst_len = 0
Nov 08 23:42:36 user nova-compute[75045]: iface.max_outstanding_r2t = 0
Nov 08 23:42:36 user nova-compute[75045]: iface.max_burst_len = 0
Nov 08 23:42:36 user nova-compute[75045]: iface.chap_auth = <empty>
Nov 08 23:42:36 user nova-compute[75045]: iface.bidi_chap = <empty>
Nov 08 23:42:36 user nova-compute[75045]: iface.strict_login_compliance = <empty>
Nov 08 23:42:36 user nova-compute[75045]: iface.discovery_auth = <empty>
Nov 08 23:42:36 user nova-compute[75045]: iface.discovery_logout = <empty>
Nov 08 23:42:36 user nova-compute[75045]: node.discovery_address = <empty>
Nov 08 23:42:36 user nova-compute[75045]: node.discovery_port = 0
Nov 08 23:42:36 user nova-compute[75045]: node.discovery_type = static
Nov 08 23:42:36 user nova-compute[75045]: node.session.initial_cmdsn = 0
Nov 08 23:42:36 user nova-compute[75045]: node.session.initial_login_retry_max = 8
Nov 08 23:42:36 user nova-compute[75045]: node.session.xmit_thread_priority = -20
Nov 08 23:42:36 user nova-compute[75045]: node.session.cmds_max = 128
Nov 08 23:42:36 user nova-compute[75045]: node.session.queue_depth = 32
Nov 08 23:42:36 user nova-compute[75045]: node.session.nr_sessions = 1
Nov 08 23:42:36 user nova-compute[75045]: node.session.auth.authmethod = CHAP
Nov 08 23:42:36 user nova-compute[75045]: node.session.auth.username = deTXjCzh
Nov 08 23:42:36 user nova-compute[75045]: node.session.auth.password = ***
Nov 08 23:42:36 user nova-compute[75045]: node.session.auth.username_in = <empty>
Nov 08 23:42:36 user nova-compute[75045]: node.session.auth.password_in = <empty>
Nov 08 23:42:36 user nova-compute[75045]: node.session.auth.chap_algs = MD5
Nov 08 23:42:36 user nova-compute[75045]: node.session.timeo.replacement_timeout = 120
Nov 08 23:42:36 user nova-compute[75045]: node.session.err_timeo.abort_timeout = 15
Nov 08 23:42:36 user nova-compute[75045]: node.session.err_timeo.lu_reset_timeout = 30
Nov 08 23:42:36 user nova-compute[75045]: node.session.err_timeo.tgt_reset_timeout = 30
Nov 08 23:42:36 user nova-compute[75045]: node.session.err_timeo.host_reset_timeout = 60
Nov 08 23:42:36 user nova-compute[75045]: node.session.iscsi.FastAbort = Yes
Nov 08 23:42:36 user nova-compute[75045]: node.session.iscsi.InitialR2T = No
Nov 08 23:42:36 user nova-compute[75045]: node.session.iscsi.ImmediateData = Yes
Nov 08 23:42:36 user nova-compute[75045]: node.session.iscsi.FirstBurstLength = 262144
Nov 08 23:42:36 user nova-compute[75045]: node.session.iscsi.MaxBurstLength = 16776192
Nov 08 23:42:36 user nova-compute[75045]: node.session.iscsi.DefaultTime2Retain = 0
Nov 08 23:42:36 user nova-compute[75045]: node.session.iscsi.DefaultTime2Wait = 2
Nov 08 23:42:36 user nova-compute[75045]: node.session.iscsi.MaxConnections = 1
Nov 08 23:42:36 user nova-compute[75045]: node.session.iscsi.MaxOutstandingR2T = 1
Nov 08 23:42:36 user nova-compute[75045]: node.session.iscsi.ERL = 0
Nov 08 23:42:36 user nova-compute[75045]: node.session.scan = manual
Nov 08 23:42:36 user nova-compute[75045]: node.session.reopen_max = 0
Nov 08 23:42:36 user nova-compute[75045]: node.conn[0].address = 172.16.0.220
Nov 08 23:42:36 user nova-compute[75045]: node.conn[0].port = 3260
Nov 08 23:42:36 user nova-compute[75045]: node.conn[0].startup = manual
Nov 08 23:42:36 user nova-compute[75045]: node.conn[0].tcp.window_size = 524288
Nov 08 23:42:36 user nova-compute[75045]: node.conn[0].tcp.type_of_service = 0
Nov 08 23:42:36 user nova-compute[75045]: node.conn[0].timeo.logout_timeout = 15
Nov 08 23:42:36 user nova-compute[75045]: node.conn[0].timeo.login_timeout = 15
Nov 08 23:42:36 user nova-compute[75045]: node.conn[0].timeo.auth_timeout = 45
Nov 08 23:42:36 user nova-compute[75045]: node.conn[0].timeo.noop_out_interval = 5
Nov 08 23:42:36 user nova-compute[75045]: node.conn[0].timeo.noop_out_timeout = 5
Nov 08 23:42:36 user nova-compute[75045]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Nov 08 23:42:36 user nova-compute[75045]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Nov 08 23:42:36 user nova-compute[75045]: node.conn[0].iscsi.HeaderDigest = None
Nov 08 23:42:36 user nova-compute[75045]: node.conn[0].iscsi.DataDigest = None
Nov 08 23:42:36 user nova-compute[75045]: node.conn[0].iscsi.IFMarker = No
Nov 08 23:42:36 user nova-compute[75045]: node.conn[0].iscsi.OFMarker = No
Nov 08 23:42:36 user nova-compute[75045]: # END RECORD
Nov 08 23:42:36 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:42:36 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7bd77e85-94b5-49aa-8412-c200279e0748 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:42:36 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7bd77e85-94b5-49aa-8412-c200279e0748 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:42:36 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[9acd0174-4687-4287-8f62-4ca27e2c2213]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:42:36 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-be60315d-af48-481b-a8ea-adfde268af25 tempest-ServerStableDeviceRescueTest-1847572360 tempest-ServerStableDeviceRescueTest-1847572360-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:42:36 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7bd77e85-94b5-49aa-8412-c200279e0748 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:42:36 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7bd77e85-94b5-49aa-8412-c200279e0748 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:42:36 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[07394c62-da39-4e7d-a03a-66e8bd6d531f]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:42:36 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-be60315d-af48-481b-a8ea-adfde268af25 tempest-ServerStableDeviceRescueTest-1847572360 tempest-ServerStableDeviceRescueTest-1847572360-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:42:36 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7bd77e85-94b5-49aa-8412-c200279e0748 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v deTXjCzh {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:42:36 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7bd77e85-94b5-49aa-8412-c200279e0748 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v deTXjCzh" returned: 0 in 0.020s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:42:36 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[82a1f988-a262-4611-806f-c9ebdc13fbb3]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:42:36 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-be60315d-af48-481b-a8ea-adfde268af25 tempest-ServerStableDeviceRescueTest-1847572360 tempest-ServerStableDeviceRescueTest-1847572360-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'deTXjCzh'): stdout= stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:42:36 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7bd77e85-94b5-49aa-8412-c200279e0748 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:42:36 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7bd77e85-94b5-49aa-8412-c200279e0748 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:42:36 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3a3ec24-5892-4dda-8be8-b2c09d1aea0c]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:42:36 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-be60315d-af48-481b-a8ea-adfde268af25 tempest-ServerStableDeviceRescueTest-1847572360 tempest-ServerStableDeviceRescueTest-1847572360-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:42:36 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:42:36 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:42:36 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[83b3495f-28aa-4013-9505-49fa2958c665]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7bd77e85-94b5-49aa-8412-c200279e0748 (non-flash)\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:42:36 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-be60315d-af48-481b-a8ea-adfde268af25 tempest-ServerStableDeviceRescueTest-1847572360 tempest-ServerStableDeviceRescueTest-1847572360-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7bd77e85-94b5-49aa-8412-c200279e0748 (non-flash)
Nov 08 23:42:36 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 23:42:36 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-be60315d-af48-481b-a8ea-adfde268af25 tempest-ServerStableDeviceRescueTest-1847572360 tempest-ServerStableDeviceRescueTest-1847572360-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7bd77e85-94b5-49aa-8412-c200279e0748 (non-flash)
Nov 08 23:42:36 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 23:42:36 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-be60315d-af48-481b-a8ea-adfde268af25 tempest-ServerStableDeviceRescueTest-1847572360 tempest-ServerStableDeviceRescueTest-1847572360-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7bd77e85-94b5-49aa-8412-c200279e0748" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.141s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 23:42:36 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-be60315d-af48-481b-a8ea-adfde268af25 tempest-ServerStableDeviceRescueTest-1847572360 tempest-ServerStableDeviceRescueTest-1847572360-project-member] Connected to 172.16.0.220:3260 {{(pid=75045) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 23:42:36 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-be60315d-af48-481b-a8ea-adfde268af25 tempest-ServerStableDeviceRescueTest-1847572360 tempest-ServerStableDeviceRescueTest-1847572360-project-member] HCTL ('33', '0', '0', 0) found on session 41 with lun 0 {{(pid=75045) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 23:42:36 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-be60315d-af48-481b-a8ea-adfde268af25 tempest-ServerStableDeviceRescueTest-1847572360 tempest-ServerStableDeviceRescueTest-1847572360-project-member] Scanning host 33 c: 0, t: 0, l: 0) {{(pid=75045) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 23:42:36 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:42:36 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.013s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:42:36 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2434e81-f69f-464e-a547-c872633298cc]: (4, ('0 0 0', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:42:36 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-be60315d-af48-481b-a8ea-adfde268af25 tempest-ServerStableDeviceRescueTest-1847572360 tempest-ServerStableDeviceRescueTest-1847572360-project-member] Searching for a device in session 41 and hctl ('33', '0', '0', 0) yield: sdb {{(pid=75045) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 23:42:36 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-be60315d-af48-481b-a8ea-adfde268af25 tempest-ServerStableDeviceRescueTest-1847572360 tempest-ServerStableDeviceRescueTest-1847572360-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:7bd77e85-94b5-49aa-8412-c200279e0748', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'deTXjCzh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75045) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 23:42:36 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-be60315d-af48-481b-a8ea-adfde268af25 tempest-ServerStableDeviceRescueTest-1847572360 tempest-ServerStableDeviceRescueTest-1847572360-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.164s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 23:42:36 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-be60315d-af48-481b-a8ea-adfde268af25 tempest-ServerStableDeviceRescueTest-1847572360 tempest-ServerStableDeviceRescueTest-1847572360-project-member] <== connect_volume: return (166ms) {'type': 'block', 'scsi_wwn': '23962666166376162', 'path': '/dev/sdb'} {{(pid=75045) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 23:42:36 user nova-compute[75045]: DEBUG nova.virt.libvirt.volume.iscsi [None req-be60315d-af48-481b-a8ea-adfde268af25 tempest-ServerStableDeviceRescueTest-1847572360 tempest-ServerStableDeviceRescueTest-1847572360-project-member] [instance: 7ee587a0-e271-4262-a252-2ccb6c2faecb] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23962666166376162', 'path': '/dev/sdb'} {{(pid=75045) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 23:42:36 user nova-compute[75045]: DEBUG nova.virt.libvirt.vif [None req-be60315d-af48-481b-a8ea-adfde268af25 tempest-ServerStableDeviceRescueTest-1847572360 tempest-ServerStableDeviceRescueTest-1847572360-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T23:37:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-511845209',display_name='tempest-ServerStableDeviceRescueTest-server-511845209',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-511845209',id=37,image_ref='a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAazcJf6mPhnLZhu/TEEbRcKRzviHLHtM5RAFvtylVUl63QLHMszWdrsWATDs55dIdfOMRrB/jSYqTaEgUtPxK3t+z/n2SQh/8lXWD+YRF2sDlrMunls4XYUnke1aho+/Q==',key_name='tempest-keypair-1152195583',keypairs=<?>,launch_index=0,launched_at=2023-11-08T23:38:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4760b2fb18b44e26bfbca6bf16aea581',ramdisk_id='',reservation_id='r-wv3hsg4l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-1847572360',owner_user_name='tempest-ServerStableDeviceRescueTest-1847572360-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T23:39:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='49cdaaab1d134721a522900af5e12d8a',uuid=7ee587a0-e271-4262-a252-2ccb6c2faecb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0b911e0a-0c01-4296-b269-f52ee68772f9", "address": "fa:16:3e:03:88:6d", "network": {"id": "3fc25e49-b987-4fe7-9c28-6a18b689a411", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1301325538-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.217", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1301325538-network", "vif_mac": "fa:16:3e:03:88:6d"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4760b2fb18b44e26bfbca6bf16aea581", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b911e0a-0c", "ovs_interfaceid": "0b911e0a-0c01-4296-b269-f52ee68772f9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75045) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 23:42:36 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-be60315d-af48-481b-a8ea-adfde268af25 tempest-ServerStableDeviceRescueTest-1847572360 tempest-ServerStableDeviceRescueTest-1847572360-project-member] Converting VIF {"id": "0b911e0a-0c01-4296-b269-f52ee68772f9", "address": "fa:16:3e:03:88:6d", "network": {"id": "3fc25e49-b987-4fe7-9c28-6a18b689a411", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1301325538-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.217", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1301325538-network", "vif_mac": "fa:16:3e:03:88:6d"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4760b2fb18b44e26bfbca6bf16aea581", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b911e0a-0c", "ovs_interfaceid": "0b911e0a-0c01-4296-b269-f52ee68772f9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 23:42:36 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-be60315d-af48-481b-a8ea-adfde268af25 tempest-ServerStableDeviceRescueTest-1847572360 tempest-ServerStableDeviceRescueTest-1847572360-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:03:88:6d,bridge_name='br-int',has_traffic_filtering=True,id=0b911e0a-0c01-4296-b269-f52ee68772f9,network=Network(3fc25e49-b987-4fe7-9c28-6a18b689a411),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b911e0a-0c') {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 23:42:36 user nova-compute[75045]: DEBUG nova.objects.instance [None req-be60315d-af48-481b-a8ea-adfde268af25 tempest-ServerStableDeviceRescueTest-1847572360 tempest-ServerStableDeviceRescueTest-1847572360-project-member] Lazy-loading 'pci_devices' on Instance uuid 7ee587a0-e271-4262-a252-2ccb6c2faecb {{(pid=75045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 23:42:36 user nova-compute[75045]: DEBUG nova.objects.base [None req-be60315d-af48-481b-a8ea-adfde268af25 tempest-ServerStableDeviceRescueTest-1847572360 tempest-ServerStableDeviceRescueTest-1847572360-project-member] Object Instance<7ee587a0-e271-4262-a252-2ccb6c2faecb> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75045) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 23:42:36 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-be60315d-af48-481b-a8ea-adfde268af25 tempest-ServerStableDeviceRescueTest-1847572360 tempest-ServerStableDeviceRescueTest-1847572360-project-member] [instance: 7ee587a0-e271-4262-a252-2ccb6c2faecb] End _get_guest_xml xml=<domain type="kvm">
Nov 08 23:42:36 user nova-compute[75045]:   <uuid>7ee587a0-e271-4262-a252-2ccb6c2faecb</uuid>
Nov 08 23:42:36 user nova-compute[75045]:   <name>instance-00000025</name>
Nov 08 23:42:36 user nova-compute[75045]:   <memory>524288</memory>
Nov 08 23:42:36 user nova-compute[75045]:   <vcpu>1</vcpu>
Nov 08 23:42:36 user nova-compute[75045]:   <metadata>
Nov 08 23:42:36 user nova-compute[75045]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 23:42:36 user nova-compute[75045]:       <nova:package version="0.0.0"/>
Nov 08 23:42:36 user nova-compute[75045]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-511845209</nova:name>
Nov 08 23:42:36 user nova-compute[75045]:       <nova:creationTime>2023-11-08 23:42:36</nova:creationTime>
Nov 08 23:42:36 user nova-compute[75045]:       <nova:flavor name="m1.tiny">
Nov 08 23:42:36 user nova-compute[75045]:         <nova:memory>512</nova:memory>
Nov 08 23:42:36 user nova-compute[75045]:         <nova:disk>1</nova:disk>
Nov 08 23:42:36 user nova-compute[75045]:         <nova:swap>0</nova:swap>
Nov 08 23:42:36 user nova-compute[75045]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 23:42:36 user nova-compute[75045]:         <nova:vcpus>1</nova:vcpus>
Nov 08 23:42:36 user nova-compute[75045]:       </nova:flavor>
Nov 08 23:42:36 user nova-compute[75045]:       <nova:owner>
Nov 08 23:42:36 user nova-compute[75045]:         <nova:user uuid="49cdaaab1d134721a522900af5e12d8a">tempest-ServerStableDeviceRescueTest-1847572360-project-member</nova:user>
Nov 08 23:42:36 user nova-compute[75045]:         <nova:project uuid="4760b2fb18b44e26bfbca6bf16aea581">tempest-ServerStableDeviceRescueTest-1847572360</nova:project>
Nov 08 23:42:36 user nova-compute[75045]:       </nova:owner>
Nov 08 23:42:36 user nova-compute[75045]:       <nova:root type="image" uuid="a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb"/>
Nov 08 23:42:36 user nova-compute[75045]:       <nova:ports>
Nov 08 23:42:36 user nova-compute[75045]:         <nova:port uuid="0b911e0a-0c01-4296-b269-f52ee68772f9">
Nov 08 23:42:36 user nova-compute[75045]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 08 23:42:36 user nova-compute[75045]:         </nova:port>
Nov 08 23:42:36 user nova-compute[75045]:       </nova:ports>
Nov 08 23:42:36 user nova-compute[75045]:     </nova:instance>
Nov 08 23:42:36 user nova-compute[75045]:   </metadata>
Nov 08 23:42:36 user nova-compute[75045]:   <sysinfo type="smbios">
Nov 08 23:42:36 user nova-compute[75045]:     <system>
Nov 08 23:42:36 user nova-compute[75045]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 23:42:36 user nova-compute[75045]:       <entry name="product">OpenStack Nova</entry>
Nov 08 23:42:36 user nova-compute[75045]:       <entry name="version">0.0.0</entry>
Nov 08 23:42:36 user nova-compute[75045]:       <entry name="serial">7ee587a0-e271-4262-a252-2ccb6c2faecb</entry>
Nov 08 23:42:36 user nova-compute[75045]:       <entry name="uuid">7ee587a0-e271-4262-a252-2ccb6c2faecb</entry>
Nov 08 23:42:36 user nova-compute[75045]:       <entry name="family">Virtual Machine</entry>
Nov 08 23:42:36 user nova-compute[75045]:     </system>
Nov 08 23:42:36 user nova-compute[75045]:   </sysinfo>
Nov 08 23:42:36 user nova-compute[75045]:   <os>
Nov 08 23:42:36 user nova-compute[75045]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 23:42:36 user nova-compute[75045]:     <smbios mode="sysinfo"/>
Nov 08 23:42:36 user nova-compute[75045]:   </os>
Nov 08 23:42:36 user nova-compute[75045]:   <features>
Nov 08 23:42:36 user nova-compute[75045]:     <acpi/>
Nov 08 23:42:36 user nova-compute[75045]:     <apic/>
Nov 08 23:42:36 user nova-compute[75045]:     <vmcoreinfo/>
Nov 08 23:42:36 user nova-compute[75045]:   </features>
Nov 08 23:42:36 user nova-compute[75045]:   <clock offset="utc">
Nov 08 23:42:36 user nova-compute[75045]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 23:42:36 user nova-compute[75045]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 23:42:36 user nova-compute[75045]:     <timer name="hpet" present="no"/>
Nov 08 23:42:36 user nova-compute[75045]:   </clock>
Nov 08 23:42:36 user nova-compute[75045]:   <cpu mode="custom" match="exact">
Nov 08 23:42:36 user nova-compute[75045]:     <model>Nehalem</model>
Nov 08 23:42:36 user nova-compute[75045]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 23:42:36 user nova-compute[75045]:   </cpu>
Nov 08 23:42:36 user nova-compute[75045]:   <devices>
Nov 08 23:42:36 user nova-compute[75045]:     <disk type="file" device="disk">
Nov 08 23:42:36 user nova-compute[75045]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 23:42:36 user nova-compute[75045]:       <source file="/opt/stack/data/nova/instances/7ee587a0-e271-4262-a252-2ccb6c2faecb/disk"/>
Nov 08 23:42:36 user nova-compute[75045]:       <target dev="vda" bus="virtio"/>
Nov 08 23:42:36 user nova-compute[75045]:     </disk>
Nov 08 23:42:36 user nova-compute[75045]:     <disk type="block" device="disk">
Nov 08 23:42:36 user nova-compute[75045]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 23:42:36 user nova-compute[75045]:       <source dev="/dev/sdb"/>
Nov 08 23:42:36 user nova-compute[75045]:       <target dev="vdb" bus="virtio"/>
Nov 08 23:42:36 user nova-compute[75045]:       <serial>7bd77e85-94b5-49aa-8412-c200279e0748</serial>
Nov 08 23:42:36 user nova-compute[75045]:     </disk>
Nov 08 23:42:36 user nova-compute[75045]:     <disk type="file" device="disk">
Nov 08 23:42:36 user nova-compute[75045]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 23:42:36 user nova-compute[75045]:       <source file="/opt/stack/data/nova/instances/7ee587a0-e271-4262-a252-2ccb6c2faecb/disk.rescue"/>
Nov 08 23:42:36 user nova-compute[75045]:       <target dev="vdc" bus="virtio"/>
Nov 08 23:42:36 user nova-compute[75045]:       <boot order="1"/>
Nov 08 23:42:36 user nova-compute[75045]:     </disk>
Nov 08 23:42:36 user nova-compute[75045]:     <interface type="ethernet">
Nov 08 23:42:36 user nova-compute[75045]:       <mac address="fa:16:3e:03:88:6d"/>
Nov 08 23:42:36 user nova-compute[75045]:       <model type="virtio"/>
Nov 08 23:42:36 user nova-compute[75045]:       <mtu size="1442"/>
Nov 08 23:42:36 user nova-compute[75045]:       <target dev="tap0b911e0a-0c"/>
Nov 08 23:42:36 user nova-compute[75045]:     </interface>
Nov 08 23:42:36 user nova-compute[75045]:     <serial type="pty">
Nov 08 23:42:36 user nova-compute[75045]:       <log file="/opt/stack/data/nova/instances/7ee587a0-e271-4262-a252-2ccb6c2faecb/console.log" append="off"/>
Nov 08 23:42:36 user nova-compute[75045]:     </serial>
Nov 08 23:42:36 user nova-compute[75045]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 23:42:36 user nova-compute[75045]:     <video>
Nov 08 23:42:36 user nova-compute[75045]:       <model type="virtio"/>
Nov 08 23:42:36 user nova-compute[75045]:     </video>
Nov 08 23:42:36 user nova-compute[75045]:     <rng model="virtio">
Nov 08 23:42:36 user nova-compute[75045]:       <backend model="random">/dev/urandom</backend>
Nov 08 23:42:36 user nova-compute[75045]:     </rng>
Nov 08 23:42:36 user nova-compute[75045]:     <controller type="usb" index="0" model="none"/>
Nov 08 23:42:36 user nova-compute[75045]:     <memballoon model="virtio">
Nov 08 23:42:36 user nova-compute[75045]:       <stats period="10"/>
Nov 08 23:42:36 user nova-compute[75045]:     </memballoon>
Nov 08 23:42:36 user nova-compute[75045]:   </devices>
Nov 08 23:42:36 user nova-compute[75045]: </domain>
Nov 08 23:42:36 user nova-compute[75045]:  {{(pid=75045) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 23:42:36 user nova-compute[75045]: INFO nova.virt.libvirt.driver [-] [instance: 7ee587a0-e271-4262-a252-2ccb6c2faecb] Instance destroyed successfully.
Nov 08 23:42:36 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-be60315d-af48-481b-a8ea-adfde268af25 tempest-ServerStableDeviceRescueTest-1847572360 tempest-ServerStableDeviceRescueTest-1847572360-project-member] No BDM found with device name vda, not building metadata. {{(pid=75045) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 23:42:36 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-be60315d-af48-481b-a8ea-adfde268af25 tempest-ServerStableDeviceRescueTest-1847572360 tempest-ServerStableDeviceRescueTest-1847572360-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75045) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 23:42:36 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-be60315d-af48-481b-a8ea-adfde268af25 tempest-ServerStableDeviceRescueTest-1847572360 tempest-ServerStableDeviceRescueTest-1847572360-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75045) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 23:42:36 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-be60315d-af48-481b-a8ea-adfde268af25 tempest-ServerStableDeviceRescueTest-1847572360 tempest-ServerStableDeviceRescueTest-1847572360-project-member] No VIF found with MAC fa:16:3e:03:88:6d, not building metadata {{(pid=75045) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 23:42:37 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:42:37 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:42:37 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:42:37 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:42:38 user nova-compute[75045]: DEBUG nova.compute.manager [req-c45108f9-f5f6-45ac-a533-ed93b82077f3 req-37922014-876a-4e22-bd0b-86de26ab25fc service nova] [instance: 7ee587a0-e271-4262-a252-2ccb6c2faecb] Received event network-vif-plugged-0b911e0a-0c01-4296-b269-f52ee68772f9 {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:42:38 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-c45108f9-f5f6-45ac-a533-ed93b82077f3 req-37922014-876a-4e22-bd0b-86de26ab25fc service nova] Acquiring lock "7ee587a0-e271-4262-a252-2ccb6c2faecb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:42:38 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-c45108f9-f5f6-45ac-a533-ed93b82077f3 req-37922014-876a-4e22-bd0b-86de26ab25fc service nova] Lock "7ee587a0-e271-4262-a252-2ccb6c2faecb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:42:38 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-c45108f9-f5f6-45ac-a533-ed93b82077f3 req-37922014-876a-4e22-bd0b-86de26ab25fc service nova] Lock "7ee587a0-e271-4262-a252-2ccb6c2faecb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:42:38 user nova-compute[75045]: DEBUG nova.compute.manager [req-c45108f9-f5f6-45ac-a533-ed93b82077f3 req-37922014-876a-4e22-bd0b-86de26ab25fc service nova] [instance: 7ee587a0-e271-4262-a252-2ccb6c2faecb] No waiting events found dispatching network-vif-plugged-0b911e0a-0c01-4296-b269-f52ee68772f9 {{(pid=75045) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 23:42:38 user nova-compute[75045]: WARNING nova.compute.manager [req-c45108f9-f5f6-45ac-a533-ed93b82077f3 req-37922014-876a-4e22-bd0b-86de26ab25fc service nova] [instance: 7ee587a0-e271-4262-a252-2ccb6c2faecb] Received unexpected event network-vif-plugged-0b911e0a-0c01-4296-b269-f52ee68772f9 for instance with vm_state active and task_state rescuing.
Nov 08 23:42:38 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:42:38 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:42:38 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:42:40 user nova-compute[75045]: DEBUG nova.compute.manager [req-ce73aeeb-bc70-4122-b27b-cef7ec1597db req-52defb4c-9654-4d87-ab0f-c48d0e5bbf35 service nova] [instance: 7ee587a0-e271-4262-a252-2ccb6c2faecb] Received event network-vif-plugged-0b911e0a-0c01-4296-b269-f52ee68772f9 {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:42:40 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-ce73aeeb-bc70-4122-b27b-cef7ec1597db req-52defb4c-9654-4d87-ab0f-c48d0e5bbf35 service nova] Acquiring lock "7ee587a0-e271-4262-a252-2ccb6c2faecb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:42:40 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-ce73aeeb-bc70-4122-b27b-cef7ec1597db req-52defb4c-9654-4d87-ab0f-c48d0e5bbf35 service nova] Lock "7ee587a0-e271-4262-a252-2ccb6c2faecb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:42:40 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-ce73aeeb-bc70-4122-b27b-cef7ec1597db req-52defb4c-9654-4d87-ab0f-c48d0e5bbf35 service nova] Lock "7ee587a0-e271-4262-a252-2ccb6c2faecb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:42:40 user nova-compute[75045]: DEBUG nova.compute.manager [req-ce73aeeb-bc70-4122-b27b-cef7ec1597db req-52defb4c-9654-4d87-ab0f-c48d0e5bbf35 service nova] [instance: 7ee587a0-e271-4262-a252-2ccb6c2faecb] No waiting events found dispatching network-vif-plugged-0b911e0a-0c01-4296-b269-f52ee68772f9 {{(pid=75045) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 23:42:40 user nova-compute[75045]: WARNING nova.compute.manager [req-ce73aeeb-bc70-4122-b27b-cef7ec1597db req-52defb4c-9654-4d87-ab0f-c48d0e5bbf35 service nova] [instance: 7ee587a0-e271-4262-a252-2ccb6c2faecb] Received unexpected event network-vif-plugged-0b911e0a-0c01-4296-b269-f52ee68772f9 for instance with vm_state active and task_state rescuing.
Nov 08 23:42:40 user nova-compute[75045]: DEBUG nova.compute.manager [req-a5d33a0f-9bf8-4981-baa8-fc262ffbd901 req-2f8ddfa4-b76d-449a-89cf-776cd0975045 service nova] [instance: 18c197c4-3000-41b1-83bc-1a781744d539] Received event network-changed-d4920cf3-7fe0-47b8-8152-ffbf84b286f3 {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:42:40 user nova-compute[75045]: DEBUG nova.compute.manager [req-a5d33a0f-9bf8-4981-baa8-fc262ffbd901 req-2f8ddfa4-b76d-449a-89cf-776cd0975045 service nova] [instance: 18c197c4-3000-41b1-83bc-1a781744d539] Refreshing instance network info cache due to event network-changed-d4920cf3-7fe0-47b8-8152-ffbf84b286f3. {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 23:42:40 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-a5d33a0f-9bf8-4981-baa8-fc262ffbd901 req-2f8ddfa4-b76d-449a-89cf-776cd0975045 service nova] Acquiring lock "refresh_cache-18c197c4-3000-41b1-83bc-1a781744d539" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 23:42:40 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-a5d33a0f-9bf8-4981-baa8-fc262ffbd901 req-2f8ddfa4-b76d-449a-89cf-776cd0975045 service nova] Acquired lock "refresh_cache-18c197c4-3000-41b1-83bc-1a781744d539" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 23:42:40 user nova-compute[75045]: DEBUG nova.network.neutron [req-a5d33a0f-9bf8-4981-baa8-fc262ffbd901 req-2f8ddfa4-b76d-449a-89cf-776cd0975045 service nova] [instance: 18c197c4-3000-41b1-83bc-1a781744d539] Refreshing network info cache for port d4920cf3-7fe0-47b8-8152-ffbf84b286f3 {{(pid=75045) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 23:42:40 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-1e665a3a-b717-4eca-a6eb-81026a2d55d9 tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] Acquiring lock "18c197c4-3000-41b1-83bc-1a781744d539" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:42:40 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-1e665a3a-b717-4eca-a6eb-81026a2d55d9 tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] Lock "18c197c4-3000-41b1-83bc-1a781744d539" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:42:40 user nova-compute[75045]: DEBUG nova.compute.manager [None req-be60315d-af48-481b-a8ea-adfde268af25 tempest-ServerStableDeviceRescueTest-1847572360 tempest-ServerStableDeviceRescueTest-1847572360-project-member] [instance: 7ee587a0-e271-4262-a252-2ccb6c2faecb] Checking state {{(pid=75045) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 23:42:40 user nova-compute[75045]: DEBUG nova.objects.instance [None req-1e665a3a-b717-4eca-a6eb-81026a2d55d9 tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] Lazy-loading 'flavor' on Instance uuid 18c197c4-3000-41b1-83bc-1a781744d539 {{(pid=75045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 23:42:40 user nova-compute[75045]: INFO nova.virt.libvirt.driver [None req-1e665a3a-b717-4eca-a6eb-81026a2d55d9 tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] [instance: 18c197c4-3000-41b1-83bc-1a781744d539] Ignoring supplied device name: /dev/vdb
Nov 08 23:42:40 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-1e665a3a-b717-4eca-a6eb-81026a2d55d9 tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] Lock "18c197c4-3000-41b1-83bc-1a781744d539" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.054s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:42:40 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-1e665a3a-b717-4eca-a6eb-81026a2d55d9 tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] Acquiring lock "18c197c4-3000-41b1-83bc-1a781744d539" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:42:40 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-1e665a3a-b717-4eca-a6eb-81026a2d55d9 tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] Lock "18c197c4-3000-41b1-83bc-1a781744d539" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:42:40 user nova-compute[75045]: INFO nova.compute.manager [None req-1e665a3a-b717-4eca-a6eb-81026a2d55d9 tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] [instance: 18c197c4-3000-41b1-83bc-1a781744d539] Attaching volume e4186be2-8695-4a3d-a986-2ea74ec001f7 to /dev/vdb
Nov 08 23:42:40 user nova-compute[75045]: DEBUG nova.network.neutron [req-a5d33a0f-9bf8-4981-baa8-fc262ffbd901 req-2f8ddfa4-b76d-449a-89cf-776cd0975045 service nova] [instance: 18c197c4-3000-41b1-83bc-1a781744d539] Updated VIF entry in instance network info cache for port d4920cf3-7fe0-47b8-8152-ffbf84b286f3. {{(pid=75045) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 23:42:40 user nova-compute[75045]: DEBUG nova.network.neutron [req-a5d33a0f-9bf8-4981-baa8-fc262ffbd901 req-2f8ddfa4-b76d-449a-89cf-776cd0975045 service nova] [instance: 18c197c4-3000-41b1-83bc-1a781744d539] Updating instance_info_cache with network_info: [{"id": "d4920cf3-7fe0-47b8-8152-ffbf84b286f3", "address": "fa:16:3e:1a:51:25", "network": {"id": "ec929af3-f098-4338-943c-d13305d4d555", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-208938347-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.142", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f374e5f34c3464fb6f1f82f5d836c57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4920cf3-7f", "ovs_interfaceid": "d4920cf3-7fe0-47b8-8152-ffbf84b286f3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75045) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 23:42:40 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-a5d33a0f-9bf8-4981-baa8-fc262ffbd901 req-2f8ddfa4-b76d-449a-89cf-776cd0975045 service nova] Releasing lock "refresh_cache-18c197c4-3000-41b1-83bc-1a781744d539" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 23:42:40 user nova-compute[75045]: DEBUG os_brick.utils [None req-1e665a3a-b717-4eca-a6eb-81026a2d55d9 tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75045) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 23:42:40 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:42:40 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:42:40 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0219e2f-4a27-4dba-8835-56a712a9de31]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6217bd6e884\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:42:40 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:42:40 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:42:40 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a3eacf2-de82-46bc-ada6-113bad38cae6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:42:40 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:42:40 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:42:40 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[038139fe-e539-4fbe-9636-f4c26efeeb75]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:42:40 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[92b46c8b-83a3-4af2-85af-dfc05278c98b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:42:40 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-1e665a3a-b717-4eca-a6eb-81026a2d55d9 tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] Running cmd (subprocess): nvme version {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:42:40 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-1e665a3a-b717-4eca-a6eb-81026a2d55d9 tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] 'nvme version' failed. Not Retrying. {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 23:42:40 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1e665a3a-b717-4eca-a6eb-81026a2d55d9 tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] nvme not present on system {{(pid=75045) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 23:42:40 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:42:40 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 23:42:40 user nova-compute[75045]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 23:42:40 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c8c23dc-19e9-45d1-9fab-60dea5911e35]: (4, '') {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:42:40 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.lightos [None req-1e665a3a-b717-4eca-a6eb-81026a2d55d9 tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75045) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 23:42:40 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.lightos [None req-1e665a3a-b717-4eca-a6eb-81026a2d55d9 tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75045) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 23:42:40 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.lightos [None req-1e665a3a-b717-4eca-a6eb-81026a2d55d9 tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] LIGHTOS: no hostnqn found. {{(pid=75045) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 23:42:40 user nova-compute[75045]: DEBUG os_brick.utils [None req-1e665a3a-b717-4eca-a6eb-81026a2d55d9 tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6217bd6e884', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75045) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 23:42:40 user nova-compute[75045]: DEBUG nova.virt.block_device [None req-1e665a3a-b717-4eca-a6eb-81026a2d55d9 tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] [instance: 18c197c4-3000-41b1-83bc-1a781744d539] Updating existing volume attachment record: 22e5fc6c-8746-4dd5-b8ac-dd92762ef734 {{(pid=75045) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 23:42:41 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:42:43 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:42:46 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:42:48 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:42:51 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:42:51 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:42:51 user nova-compute[75045]: DEBUG nova.compute.manager [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Starting heal instance info cache {{(pid=75045) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 23:42:51 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Acquiring lock "refresh_cache-7ee587a0-e271-4262-a252-2ccb6c2faecb" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 23:42:51 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Acquired lock "refresh_cache-7ee587a0-e271-4262-a252-2ccb6c2faecb" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 23:42:51 user nova-compute[75045]: DEBUG nova.network.neutron [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] [instance: 7ee587a0-e271-4262-a252-2ccb6c2faecb] Forcefully refreshing network info cache for instance {{(pid=75045) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 23:42:51 user nova-compute[75045]: DEBUG nova.network.neutron [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] [instance: 7ee587a0-e271-4262-a252-2ccb6c2faecb] Updating instance_info_cache with network_info: [{"id": "0b911e0a-0c01-4296-b269-f52ee68772f9", "address": "fa:16:3e:03:88:6d", "network": {"id": "3fc25e49-b987-4fe7-9c28-6a18b689a411", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1301325538-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.217", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4760b2fb18b44e26bfbca6bf16aea581", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b911e0a-0c", "ovs_interfaceid": "0b911e0a-0c01-4296-b269-f52ee68772f9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75045) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 23:42:51 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Releasing lock "refresh_cache-7ee587a0-e271-4262-a252-2ccb6c2faecb" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 23:42:51 user nova-compute[75045]: DEBUG nova.compute.manager [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] [instance: 7ee587a0-e271-4262-a252-2ccb6c2faecb] Updated the network info_cache for instance {{(pid=75045) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 23:42:51 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:42:51 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:42:51 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:42:51 user nova-compute[75045]: DEBUG nova.compute.manager [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75045) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 23:42:53 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:42:53 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:42:55 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:42:56 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:42:56 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:42:56 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:42:58 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:42:59 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-8498bd32-46e1-4bda-9ac5-f8b083919774 tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] Acquiring lock "adcffd35-00c7-49db-a72f-d6307a90e123" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:42:59 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-8498bd32-46e1-4bda-9ac5-f8b083919774 tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] Lock "adcffd35-00c7-49db-a72f-d6307a90e123" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:42:59 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-8498bd32-46e1-4bda-9ac5-f8b083919774 tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] Acquiring lock "adcffd35-00c7-49db-a72f-d6307a90e123-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:42:59 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-8498bd32-46e1-4bda-9ac5-f8b083919774 tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] Lock "adcffd35-00c7-49db-a72f-d6307a90e123-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:42:59 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-8498bd32-46e1-4bda-9ac5-f8b083919774 tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] Lock "adcffd35-00c7-49db-a72f-d6307a90e123-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:42:59 user nova-compute[75045]: INFO nova.compute.manager [None req-8498bd32-46e1-4bda-9ac5-f8b083919774 tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] [instance: adcffd35-00c7-49db-a72f-d6307a90e123] Terminating instance
Nov 08 23:42:59 user nova-compute[75045]: DEBUG nova.compute.manager [None req-8498bd32-46e1-4bda-9ac5-f8b083919774 tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] [instance: adcffd35-00c7-49db-a72f-d6307a90e123] Start destroying the instance on the hypervisor. {{(pid=75045) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 23:42:59 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:42:59 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:42:59 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:42:59 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:42:59 user nova-compute[75045]: DEBUG nova.compute.manager [req-7c5bb4c4-3fda-4dd0-bcbe-4cf3e6d0a2a4 req-f99ec6fa-cb08-41d1-bbb6-ce22eef2699b service nova] [instance: adcffd35-00c7-49db-a72f-d6307a90e123] Received event network-vif-unplugged-cbed987e-37ab-4cb9-b01a-ecad76d98f21 {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:42:59 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-7c5bb4c4-3fda-4dd0-bcbe-4cf3e6d0a2a4 req-f99ec6fa-cb08-41d1-bbb6-ce22eef2699b service nova] Acquiring lock "adcffd35-00c7-49db-a72f-d6307a90e123-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:42:59 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-7c5bb4c4-3fda-4dd0-bcbe-4cf3e6d0a2a4 req-f99ec6fa-cb08-41d1-bbb6-ce22eef2699b service nova] Lock "adcffd35-00c7-49db-a72f-d6307a90e123-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:42:59 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-7c5bb4c4-3fda-4dd0-bcbe-4cf3e6d0a2a4 req-f99ec6fa-cb08-41d1-bbb6-ce22eef2699b service nova] Lock "adcffd35-00c7-49db-a72f-d6307a90e123-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:42:59 user nova-compute[75045]: DEBUG nova.compute.manager [req-7c5bb4c4-3fda-4dd0-bcbe-4cf3e6d0a2a4 req-f99ec6fa-cb08-41d1-bbb6-ce22eef2699b service nova] [instance: adcffd35-00c7-49db-a72f-d6307a90e123] No waiting events found dispatching network-vif-unplugged-cbed987e-37ab-4cb9-b01a-ecad76d98f21 {{(pid=75045) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 23:42:59 user nova-compute[75045]: DEBUG nova.compute.manager [req-7c5bb4c4-3fda-4dd0-bcbe-4cf3e6d0a2a4 req-f99ec6fa-cb08-41d1-bbb6-ce22eef2699b service nova] [instance: adcffd35-00c7-49db-a72f-d6307a90e123] Received event network-vif-unplugged-cbed987e-37ab-4cb9-b01a-ecad76d98f21 for instance with task_state deleting. {{(pid=75045) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 23:42:59 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager.update_available_resource {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:43:00 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:43:00 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:43:00 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:43:00 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Auditing locally available compute resources for user (node: user) {{(pid=75045) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 23:43:00 user nova-compute[75045]: INFO nova.virt.libvirt.driver [-] [instance: adcffd35-00c7-49db-a72f-d6307a90e123] Instance destroyed successfully.
Nov 08 23:43:00 user nova-compute[75045]: DEBUG nova.objects.instance [None req-8498bd32-46e1-4bda-9ac5-f8b083919774 tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] Lazy-loading 'resources' on Instance uuid adcffd35-00c7-49db-a72f-d6307a90e123 {{(pid=75045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 23:43:00 user nova-compute[75045]: DEBUG nova.virt.libvirt.vif [None req-8498bd32-46e1-4bda-9ac5-f8b083919774 tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T23:29:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-679600955',display_name='tempest-SnapshotDataIntegrityTests-server-679600955',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-679600955',id=31,image_ref='a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIQiQ5McVMUsuajSlNFyiLCOJOofQ184ZeKfgDdK3pBrjfJHke9lU+vRmmftUX5aq91DdnXslLdaxaMVCn7b2hQ0ESMX2nngBrh1EzEtdrUvWhQHat46Qybgh1ClDmffOw==',key_name='tempest-keypair-393985914',keypairs=<?>,launch_index=0,launched_at=2023-11-08T23:29:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3343bcd412b54ef0bcfed8be47b0353a',ramdisk_id='',reservation_id='r-g2ye9oyo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-1590008619',owner_user_name='tempest-SnapshotDataIntegrityTests-1590008619-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T23:29:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c0292fa663704c6884ccf77fdcd6c5bc',uuid=adcffd35-00c7-49db-a72f-d6307a90e123,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cbed987e-37ab-4cb9-b01a-ecad76d98f21", "address": "fa:16:3e:60:a2:7b", "network": {"id": "fe74884d-c24e-4be8-b45a-eb825b3563a3", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1344943603-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.6", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3343bcd412b54ef0bcfed8be47b0353a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbed987e-37", "ovs_interfaceid": "cbed987e-37ab-4cb9-b01a-ecad76d98f21", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75045) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 23:43:00 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-8498bd32-46e1-4bda-9ac5-f8b083919774 tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] Converting VIF {"id": "cbed987e-37ab-4cb9-b01a-ecad76d98f21", "address": "fa:16:3e:60:a2:7b", "network": {"id": "fe74884d-c24e-4be8-b45a-eb825b3563a3", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1344943603-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.6", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3343bcd412b54ef0bcfed8be47b0353a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbed987e-37", "ovs_interfaceid": "cbed987e-37ab-4cb9-b01a-ecad76d98f21", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 23:43:00 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-8498bd32-46e1-4bda-9ac5-f8b083919774 tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:60:a2:7b,bridge_name='br-int',has_traffic_filtering=True,id=cbed987e-37ab-4cb9-b01a-ecad76d98f21,network=Network(fe74884d-c24e-4be8-b45a-eb825b3563a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcbed987e-37') {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 23:43:00 user nova-compute[75045]: DEBUG os_vif [None req-8498bd32-46e1-4bda-9ac5-f8b083919774 tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:60:a2:7b,bridge_name='br-int',has_traffic_filtering=True,id=cbed987e-37ab-4cb9-b01a-ecad76d98f21,network=Network(fe74884d-c24e-4be8-b45a-eb825b3563a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcbed987e-37') {{(pid=75045) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 23:43:00 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:43:00 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapcbed987e-37, bridge=br-int, if_exists=True) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:43:00 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:43:00 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 23:43:00 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:43:00 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c34ecd12-b881-4042-999f-819bf766cb6f) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:43:00 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:43:00 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:43:00 user nova-compute[75045]: INFO os_vif [None req-8498bd32-46e1-4bda-9ac5-f8b083919774 tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:60:a2:7b,bridge_name='br-int',has_traffic_filtering=True,id=cbed987e-37ab-4cb9-b01a-ecad76d98f21,network=Network(fe74884d-c24e-4be8-b45a-eb825b3563a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcbed987e-37')
Nov 08 23:43:00 user nova-compute[75045]: INFO nova.virt.libvirt.driver [None req-8498bd32-46e1-4bda-9ac5-f8b083919774 tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] [instance: adcffd35-00c7-49db-a72f-d6307a90e123] Deleting instance files /opt/stack/data/nova/instances/adcffd35-00c7-49db-a72f-d6307a90e123_del
Nov 08 23:43:00 user nova-compute[75045]: INFO nova.virt.libvirt.driver [None req-8498bd32-46e1-4bda-9ac5-f8b083919774 tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] [instance: adcffd35-00c7-49db-a72f-d6307a90e123] Deletion of /opt/stack/data/nova/instances/adcffd35-00c7-49db-a72f-d6307a90e123_del complete
Nov 08 23:43:00 user nova-compute[75045]: INFO nova.compute.manager [None req-8498bd32-46e1-4bda-9ac5-f8b083919774 tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] [instance: adcffd35-00c7-49db-a72f-d6307a90e123] Took 0.94 seconds to destroy the instance on the hypervisor.
Nov 08 23:43:00 user nova-compute[75045]: DEBUG oslo.service.loopingcall [None req-8498bd32-46e1-4bda-9ac5-f8b083919774 tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75045) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 23:43:00 user nova-compute[75045]: DEBUG nova.compute.manager [-] [instance: adcffd35-00c7-49db-a72f-d6307a90e123] Deallocating network for instance {{(pid=75045) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 23:43:00 user nova-compute[75045]: DEBUG nova.network.neutron [-] [instance: adcffd35-00c7-49db-a72f-d6307a90e123] deallocate_for_instance() {{(pid=75045) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 23:43:00 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/244c4cc9-2837-40c9-b4ad-37dc435c9749/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:43:00 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/244c4cc9-2837-40c9-b4ad-37dc435c9749/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:43:00 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/244c4cc9-2837-40c9-b4ad-37dc435c9749/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:43:00 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/244c4cc9-2837-40c9-b4ad-37dc435c9749/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:43:00 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ee587a0-e271-4262-a252-2ccb6c2faecb/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:43:00 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ee587a0-e271-4262-a252-2ccb6c2faecb/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:43:00 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ee587a0-e271-4262-a252-2ccb6c2faecb/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:43:01 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ee587a0-e271-4262-a252-2ccb6c2faecb/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:43:01 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75045) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 23:43:01 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ee587a0-e271-4262-a252-2ccb6c2faecb/disk.rescue --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:43:01 user nova-compute[75045]: DEBUG nova.network.neutron [-] [instance: adcffd35-00c7-49db-a72f-d6307a90e123] Updating instance_info_cache with network_info: [] {{(pid=75045) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 23:43:01 user nova-compute[75045]: INFO nova.compute.manager [-] [instance: adcffd35-00c7-49db-a72f-d6307a90e123] Took 0.99 seconds to deallocate network for instance.
Nov 08 23:43:01 user nova-compute[75045]: DEBUG nova.compute.manager [req-5ebc62f5-370d-4da6-8337-0569f55b67ce req-de188c7b-7552-42b1-81b8-4a8486667f47 service nova] [instance: adcffd35-00c7-49db-a72f-d6307a90e123] Received event network-vif-deleted-cbed987e-37ab-4cb9-b01a-ecad76d98f21 {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:43:01 user nova-compute[75045]: INFO nova.compute.manager [req-5ebc62f5-370d-4da6-8337-0569f55b67ce req-de188c7b-7552-42b1-81b8-4a8486667f47 service nova] [instance: adcffd35-00c7-49db-a72f-d6307a90e123] Neutron deleted interface cbed987e-37ab-4cb9-b01a-ecad76d98f21; detaching it from the instance and deleting it from the info cache
Nov 08 23:43:01 user nova-compute[75045]: DEBUG nova.network.neutron [req-5ebc62f5-370d-4da6-8337-0569f55b67ce req-de188c7b-7552-42b1-81b8-4a8486667f47 service nova] [instance: adcffd35-00c7-49db-a72f-d6307a90e123] Updating instance_info_cache with network_info: [] {{(pid=75045) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 23:43:01 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ee587a0-e271-4262-a252-2ccb6c2faecb/disk.rescue --force-share --output=json" returned: 0 in 0.198s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:43:01 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ee587a0-e271-4262-a252-2ccb6c2faecb/disk.rescue --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:43:01 user nova-compute[75045]: DEBUG nova.compute.manager [req-5ebc62f5-370d-4da6-8337-0569f55b67ce req-de188c7b-7552-42b1-81b8-4a8486667f47 service nova] [instance: adcffd35-00c7-49db-a72f-d6307a90e123] Detach interface failed, port_id=cbed987e-37ab-4cb9-b01a-ecad76d98f21, reason: Instance adcffd35-00c7-49db-a72f-d6307a90e123 could not be found. {{(pid=75045) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 08 23:43:01 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-8498bd32-46e1-4bda-9ac5-f8b083919774 tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:43:01 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-8498bd32-46e1-4bda-9ac5-f8b083919774 tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:43:01 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ee587a0-e271-4262-a252-2ccb6c2faecb/disk.rescue --force-share --output=json" returned: 0 in 0.210s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:43:01 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18c197c4-3000-41b1-83bc-1a781744d539/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:43:01 user nova-compute[75045]: DEBUG nova.compute.provider_tree [None req-8498bd32-46e1-4bda-9ac5-f8b083919774 tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] Inventory has not changed in ProviderTree for provider: 62ba5f85-c74d-4b58-986e-d4197e813fd7 {{(pid=75045) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 23:43:01 user nova-compute[75045]: DEBUG nova.scheduler.client.report [None req-8498bd32-46e1-4bda-9ac5-f8b083919774 tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] Inventory has not changed for provider 62ba5f85-c74d-4b58-986e-d4197e813fd7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75045) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 23:43:01 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-8498bd32-46e1-4bda-9ac5-f8b083919774 tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.324s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:43:01 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18c197c4-3000-41b1-83bc-1a781744d539/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:43:01 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18c197c4-3000-41b1-83bc-1a781744d539/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:43:01 user nova-compute[75045]: INFO nova.scheduler.client.report [None req-8498bd32-46e1-4bda-9ac5-f8b083919774 tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] Deleted allocations for instance adcffd35-00c7-49db-a72f-d6307a90e123
Nov 08 23:43:01 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:43:01 user nova-compute[75045]: DEBUG nova.compute.manager [req-b450da72-b8a8-4d9c-bc4f-8d72ce059edb req-97e7f20b-488c-487a-8d5c-d7bbf119b683 service nova] [instance: adcffd35-00c7-49db-a72f-d6307a90e123] Received event network-vif-plugged-cbed987e-37ab-4cb9-b01a-ecad76d98f21 {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:43:01 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-b450da72-b8a8-4d9c-bc4f-8d72ce059edb req-97e7f20b-488c-487a-8d5c-d7bbf119b683 service nova] Acquiring lock "adcffd35-00c7-49db-a72f-d6307a90e123-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:43:01 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-b450da72-b8a8-4d9c-bc4f-8d72ce059edb req-97e7f20b-488c-487a-8d5c-d7bbf119b683 service nova] Lock "adcffd35-00c7-49db-a72f-d6307a90e123-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:43:01 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-b450da72-b8a8-4d9c-bc4f-8d72ce059edb req-97e7f20b-488c-487a-8d5c-d7bbf119b683 service nova] Lock "adcffd35-00c7-49db-a72f-d6307a90e123-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:43:01 user nova-compute[75045]: DEBUG nova.compute.manager [req-b450da72-b8a8-4d9c-bc4f-8d72ce059edb req-97e7f20b-488c-487a-8d5c-d7bbf119b683 service nova] [instance: adcffd35-00c7-49db-a72f-d6307a90e123] No waiting events found dispatching network-vif-plugged-cbed987e-37ab-4cb9-b01a-ecad76d98f21 {{(pid=75045) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 23:43:01 user nova-compute[75045]: WARNING nova.compute.manager [req-b450da72-b8a8-4d9c-bc4f-8d72ce059edb req-97e7f20b-488c-487a-8d5c-d7bbf119b683 service nova] [instance: adcffd35-00c7-49db-a72f-d6307a90e123] Received unexpected event network-vif-plugged-cbed987e-37ab-4cb9-b01a-ecad76d98f21 for instance with vm_state deleted and task_state None.
Nov 08 23:43:01 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-8498bd32-46e1-4bda-9ac5-f8b083919774 tempest-SnapshotDataIntegrityTests-1590008619 tempest-SnapshotDataIntegrityTests-1590008619-project-member] Lock "adcffd35-00c7-49db-a72f-d6307a90e123" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.567s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:43:01 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18c197c4-3000-41b1-83bc-1a781744d539/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:43:01 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/584e3043-addf-41f7-a3cd-de51c229af72/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:43:02 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/584e3043-addf-41f7-a3cd-de51c229af72/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:43:02 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/584e3043-addf-41f7-a3cd-de51c229af72/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:43:02 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/584e3043-addf-41f7-a3cd-de51c229af72/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:43:02 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b413c71-c13a-4fea-91c4-f6b1953d54c6/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:43:02 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b413c71-c13a-4fea-91c4-f6b1953d54c6/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:43:02 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b413c71-c13a-4fea-91c4-f6b1953d54c6/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:43:02 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b413c71-c13a-4fea-91c4-f6b1953d54c6/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:43:02 user nova-compute[75045]: WARNING nova.virt.libvirt.driver [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Error from libvirt while getting description of instance-0000001f: [Error Code 42] Domain not found: no domain with matching uuid 'adcffd35-00c7-49db-a72f-d6307a90e123' (instance-0000001f): libvirt.libvirtError: Domain not found: no domain with matching uuid 'adcffd35-00c7-49db-a72f-d6307a90e123' (instance-0000001f)
Nov 08 23:43:03 user nova-compute[75045]: WARNING nova.virt.libvirt.driver [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 23:43:03 user nova-compute[75045]: WARNING nova.virt.libvirt.driver [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 23:43:03 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Hypervisor/Node resource view: name=user free_ram=8160MB free_disk=24.90732192993164GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75045) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 23:43:03 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:43:03 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:43:03 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Instance 244c4cc9-2837-40c9-b4ad-37dc435c9749 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75045) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 23:43:03 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Instance 7ee587a0-e271-4262-a252-2ccb6c2faecb actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75045) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 23:43:03 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Instance 18c197c4-3000-41b1-83bc-1a781744d539 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75045) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 23:43:03 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Instance 584e3043-addf-41f7-a3cd-de51c229af72 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75045) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 23:43:03 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Instance 0b413c71-c13a-4fea-91c4-f6b1953d54c6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75045) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 23:43:03 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=75045) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 23:43:03 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=75045) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 23:43:03 user nova-compute[75045]: DEBUG nova.compute.provider_tree [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Inventory has not changed in ProviderTree for provider: 62ba5f85-c74d-4b58-986e-d4197e813fd7 {{(pid=75045) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 23:43:03 user nova-compute[75045]: DEBUG nova.scheduler.client.report [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Inventory has not changed for provider 62ba5f85-c74d-4b58-986e-d4197e813fd7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75045) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 23:43:03 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Compute_service record updated for user:user {{(pid=75045) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 23:43:03 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.364s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:43:05 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:43:05 user nova-compute[75045]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1e665a3a-b717-4eca-a6eb-81026a2d55d9 tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] [instance: 18c197c4-3000-41b1-83bc-1a781744d539] Calling os-brick to attach iSCSI Volume {{(pid=75045) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 23:43:05 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e665a3a-b717-4eca-a6eb-81026a2d55d9 tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1b68210460>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e4186be2-8695-4a3d-a986-2ea74ec001f7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GopxYWbz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75045) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 23:43:05 user nova-compute[75045]: WARNING os_brick.initiator.connectors.base [None req-1e665a3a-b717-4eca-a6eb-81026a2d55d9 tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 23:43:05 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-1e665a3a-b717-4eca-a6eb-81026a2d55d9 tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 23:43:05 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-1e665a3a-b717-4eca-a6eb-81026a2d55d9 tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 23:43:05 user nova-compute[75045]: WARNING os_brick.initiator.connectors.base [None req-1e665a3a-b717-4eca-a6eb-81026a2d55d9 tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 23:43:05 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-1e665a3a-b717-4eca-a6eb-81026a2d55d9 tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e4186be2-8695-4a3d-a986-2ea74ec001f7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 23:43:05 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-1e665a3a-b717-4eca-a6eb-81026a2d55d9 tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e4186be2-8695-4a3d-a986-2ea74ec001f7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 23:43:05 user nova-compute[75045]: INFO os_brick.initiator.connectors.iscsi [None req-1e665a3a-b717-4eca-a6eb-81026a2d55d9 tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 23:43:05 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4186be2-8695-4a3d-a986-2ea74ec001f7 -p 172.16.0.220:3260 {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:43:05 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4186be2-8695-4a3d-a986-2ea74ec001f7 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:43:05 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[e361e284-3f02-4b3a-9875-c1c2bb0b70e9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:43:05 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e665a3a-b717-4eca-a6eb-81026a2d55d9 tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 23:43:05 user nova-compute[75045]:  {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:43:05 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4186be2-8695-4a3d-a986-2ea74ec001f7 -p 172.16.0.220:3260 --interface default --op new {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:43:05 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4186be2-8695-4a3d-a986-2ea74ec001f7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:43:05 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[05b37015-40f0-43f3-8dad-60902f6124a0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e4186be2-8695-4a3d-a986-2ea74ec001f7] added\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:43:05 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e665a3a-b717-4eca-a6eb-81026a2d55d9 tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e4186be2-8695-4a3d-a986-2ea74ec001f7] added
Nov 08 23:43:05 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:43:05 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4186be2-8695-4a3d-a986-2ea74ec001f7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:43:05 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4186be2-8695-4a3d-a986-2ea74ec001f7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:43:05 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0a32dab-d517-42b8-ba27-9d1bf95206a6]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:43:05 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e665a3a-b717-4eca-a6eb-81026a2d55d9 tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:43:05 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4186be2-8695-4a3d-a986-2ea74ec001f7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:43:05 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4186be2-8695-4a3d-a986-2ea74ec001f7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:43:05 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[512a3113-c733-4501-96b7-a64fcc6ab823]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:43:05 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e665a3a-b717-4eca-a6eb-81026a2d55d9 tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:43:05 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4186be2-8695-4a3d-a986-2ea74ec001f7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GopxYWbz {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:43:05 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4186be2-8695-4a3d-a986-2ea74ec001f7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GopxYWbz" returned: 0 in 0.018s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:43:05 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[065ad837-6282-49df-9a75-7e509c137a73]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:43:05 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e665a3a-b717-4eca-a6eb-81026a2d55d9 tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'GopxYWbz'): stdout= stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:43:05 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4186be2-8695-4a3d-a986-2ea74ec001f7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:43:05 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4186be2-8695-4a3d-a986-2ea74ec001f7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:43:05 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[46764d12-5e65-48b3-a22f-894bf3a75ee6]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:43:05 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e665a3a-b717-4eca-a6eb-81026a2d55d9 tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:43:05 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:43:05 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:43:05 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e1c8d2d-ebe5-4cdd-99c9-24dd302919c2]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7bd77e85-94b5-49aa-8412-c200279e0748 (non-flash)\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:43:05 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e665a3a-b717-4eca-a6eb-81026a2d55d9 tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7bd77e85-94b5-49aa-8412-c200279e0748 (non-flash)
Nov 08 23:43:05 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 23:43:05 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e665a3a-b717-4eca-a6eb-81026a2d55d9 tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7bd77e85-94b5-49aa-8412-c200279e0748 (non-flash)
Nov 08 23:43:05 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 23:43:05 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4186be2-8695-4a3d-a986-2ea74ec001f7 -p 172.16.0.220:3260 --login {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:43:05 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4186be2-8695-4a3d-a986-2ea74ec001f7 -p 172.16.0.220:3260 --login" returned: 0 in 0.051s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:43:05 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[30e3869b-c88f-4765-bb0d-b19754aa3087]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e4186be2-8695-4a3d-a986-2ea74ec001f7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e4186be2-8695-4a3d-a986-2ea74ec001f7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:43:05 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e665a3a-b717-4eca-a6eb-81026a2d55d9 tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e4186be2-8695-4a3d-a986-2ea74ec001f7, portal: 172.16.0.220,3260]
Nov 08 23:43:05 user nova-compute[75045]: Login to [iface: default, target: iqn.2010-10.org.openstack:e4186be2-8695-4a3d-a986-2ea74ec001f7, portal: 172.16.0.220,3260] successful.
Nov 08 23:43:05 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:43:05 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4186be2-8695-4a3d-a986-2ea74ec001f7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:43:05 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4186be2-8695-4a3d-a986-2ea74ec001f7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:43:05 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[29464e7f-9eaa-4523-88ad-d4b2321c8d0b]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:43:05 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e665a3a-b717-4eca-a6eb-81026a2d55d9 tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:43:05 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:43:05 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:43:05 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed15991a-a7df-4ddf-bdf5-f9787135d844]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7bd77e85-94b5-49aa-8412-c200279e0748 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4186be2-8695-4a3d-a986-2ea74ec001f7 (non-flash)\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:43:05 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e665a3a-b717-4eca-a6eb-81026a2d55d9 tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7bd77e85-94b5-49aa-8412-c200279e0748 (non-flash)
Nov 08 23:43:05 user nova-compute[75045]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4186be2-8695-4a3d-a986-2ea74ec001f7 (non-flash)
Nov 08 23:43:05 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 23:43:05 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e665a3a-b717-4eca-a6eb-81026a2d55d9 tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7bd77e85-94b5-49aa-8412-c200279e0748 (non-flash)
Nov 08 23:43:05 user nova-compute[75045]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4186be2-8695-4a3d-a986-2ea74ec001f7 (non-flash)
Nov 08 23:43:05 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 23:43:05 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-1e665a3a-b717-4eca-a6eb-81026a2d55d9 tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e4186be2-8695-4a3d-a986-2ea74ec001f7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.264s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 23:43:05 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e665a3a-b717-4eca-a6eb-81026a2d55d9 tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] Connected to 172.16.0.220:3260 {{(pid=75045) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 23:43:05 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-1e665a3a-b717-4eca-a6eb-81026a2d55d9 tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] HCTL ('34', '-', '-', 0) found on session 42 with lun 0 {{(pid=75045) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 23:43:05 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-1e665a3a-b717-4eca-a6eb-81026a2d55d9 tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75045) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 23:43:05 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:43:05 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:43:05 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c3f2bf9-4618-4f46-8203-1cf30cd1d2a7]: (4, ('- - 0', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:43:05 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-1e665a3a-b717-4eca-a6eb-81026a2d55d9 tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] Searching for a device in session 42 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75045) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 23:43:05 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e665a3a-b717-4eca-a6eb-81026a2d55d9 tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:e4186be2-8695-4a3d-a986-2ea74ec001f7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GopxYWbz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75045) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 23:43:06 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-1e665a3a-b717-4eca-a6eb-81026a2d55d9 tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.300s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 23:43:06 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e665a3a-b717-4eca-a6eb-81026a2d55d9 tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] <== connect_volume: return (1304ms) {'type': 'block', 'scsi_wwn': '26431363635366631', 'path': '/dev/sdc'} {{(pid=75045) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 23:43:06 user nova-compute[75045]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1e665a3a-b717-4eca-a6eb-81026a2d55d9 tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] [instance: 18c197c4-3000-41b1-83bc-1a781744d539] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26431363635366631', 'path': '/dev/sdc'} {{(pid=75045) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 23:43:06 user nova-compute[75045]: DEBUG nova.objects.instance [None req-1e665a3a-b717-4eca-a6eb-81026a2d55d9 tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] Lazy-loading 'flavor' on Instance uuid 18c197c4-3000-41b1-83bc-1a781744d539 {{(pid=75045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 23:43:06 user nova-compute[75045]: DEBUG nova.virt.libvirt.guest [None req-1e665a3a-b717-4eca-a6eb-81026a2d55d9 tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] attach device xml: <disk type="block" device="disk">
Nov 08 23:43:06 user nova-compute[75045]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 23:43:06 user nova-compute[75045]:   <source dev="/dev/sdc"/>
Nov 08 23:43:06 user nova-compute[75045]:   <target dev="vdb" bus="virtio"/>
Nov 08 23:43:06 user nova-compute[75045]:   <serial>e4186be2-8695-4a3d-a986-2ea74ec001f7</serial>
Nov 08 23:43:06 user nova-compute[75045]: </disk>
Nov 08 23:43:06 user nova-compute[75045]:  {{(pid=75045) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 08 23:43:06 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:43:07 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-1e665a3a-b717-4eca-a6eb-81026a2d55d9 tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] No BDM found with device name vda, not building metadata. {{(pid=75045) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 23:43:07 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-1e665a3a-b717-4eca-a6eb-81026a2d55d9 tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75045) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 23:43:07 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-1e665a3a-b717-4eca-a6eb-81026a2d55d9 tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] No VIF found with MAC fa:16:3e:1a:51:25, not building metadata {{(pid=75045) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 23:43:07 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-1e665a3a-b717-4eca-a6eb-81026a2d55d9 tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] Lock "18c197c4-3000-41b1-83bc-1a781744d539" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 26.633s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:43:10 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:43:11 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:43:14 user nova-compute[75045]: DEBUG nova.compute.manager [req-aad901e8-f969-4a6e-a090-2ce2b97ac77c req-f065471f-f5e7-4820-82a7-3d9744d4157c service nova] [instance: 584e3043-addf-41f7-a3cd-de51c229af72] Received event network-changed-8b02e567-10f8-4153-88a4-9ce005c1fff3 {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:43:14 user nova-compute[75045]: DEBUG nova.compute.manager [req-aad901e8-f969-4a6e-a090-2ce2b97ac77c req-f065471f-f5e7-4820-82a7-3d9744d4157c service nova] [instance: 584e3043-addf-41f7-a3cd-de51c229af72] Refreshing instance network info cache due to event network-changed-8b02e567-10f8-4153-88a4-9ce005c1fff3. {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 23:43:14 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-aad901e8-f969-4a6e-a090-2ce2b97ac77c req-f065471f-f5e7-4820-82a7-3d9744d4157c service nova] Acquiring lock "refresh_cache-584e3043-addf-41f7-a3cd-de51c229af72" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 23:43:14 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-aad901e8-f969-4a6e-a090-2ce2b97ac77c req-f065471f-f5e7-4820-82a7-3d9744d4157c service nova] Acquired lock "refresh_cache-584e3043-addf-41f7-a3cd-de51c229af72" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 23:43:14 user nova-compute[75045]: DEBUG nova.network.neutron [req-aad901e8-f969-4a6e-a090-2ce2b97ac77c req-f065471f-f5e7-4820-82a7-3d9744d4157c service nova] [instance: 584e3043-addf-41f7-a3cd-de51c229af72] Refreshing network info cache for port 8b02e567-10f8-4153-88a4-9ce005c1fff3 {{(pid=75045) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 23:43:14 user nova-compute[75045]: DEBUG nova.network.neutron [req-aad901e8-f969-4a6e-a090-2ce2b97ac77c req-f065471f-f5e7-4820-82a7-3d9744d4157c service nova] [instance: 584e3043-addf-41f7-a3cd-de51c229af72] Updated VIF entry in instance network info cache for port 8b02e567-10f8-4153-88a4-9ce005c1fff3. {{(pid=75045) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 23:43:14 user nova-compute[75045]: DEBUG nova.network.neutron [req-aad901e8-f969-4a6e-a090-2ce2b97ac77c req-f065471f-f5e7-4820-82a7-3d9744d4157c service nova] [instance: 584e3043-addf-41f7-a3cd-de51c229af72] Updating instance_info_cache with network_info: [{"id": "8b02e567-10f8-4153-88a4-9ce005c1fff3", "address": "fa:16:3e:fe:a0:87", "network": {"id": "1b10bc53-ef32-4f01-82f6-ed9f95f7e3f2", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-518782773-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.123", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ad736027d034259a052da3f62bd575f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b02e567-10", "ovs_interfaceid": "8b02e567-10f8-4153-88a4-9ce005c1fff3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75045) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 23:43:14 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-aad901e8-f969-4a6e-a090-2ce2b97ac77c req-f065471f-f5e7-4820-82a7-3d9744d4157c service nova] Releasing lock "refresh_cache-584e3043-addf-41f7-a3cd-de51c229af72" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 23:43:15 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:43:16 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:43:20 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:43:21 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-4ea4f431-8202-479e-98e4-41ad55823c80 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] Acquiring lock "584e3043-addf-41f7-a3cd-de51c229af72" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:43:21 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-4ea4f431-8202-479e-98e4-41ad55823c80 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] Lock "584e3043-addf-41f7-a3cd-de51c229af72" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:43:21 user nova-compute[75045]: INFO nova.compute.manager [None req-4ea4f431-8202-479e-98e4-41ad55823c80 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] [instance: 584e3043-addf-41f7-a3cd-de51c229af72] Shelving
Nov 08 23:43:21 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:43:21 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:43:21 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:43:21 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:43:21 user nova-compute[75045]: DEBUG nova.compute.manager [req-fc07cd8d-ffd2-486d-98aa-ef0c8913307e req-0d36c887-99da-41bf-9f3e-5ab613572066 service nova] [instance: 584e3043-addf-41f7-a3cd-de51c229af72] Received event network-vif-unplugged-8b02e567-10f8-4153-88a4-9ce005c1fff3 {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:43:21 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-fc07cd8d-ffd2-486d-98aa-ef0c8913307e req-0d36c887-99da-41bf-9f3e-5ab613572066 service nova] Acquiring lock "584e3043-addf-41f7-a3cd-de51c229af72-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:43:21 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-fc07cd8d-ffd2-486d-98aa-ef0c8913307e req-0d36c887-99da-41bf-9f3e-5ab613572066 service nova] Lock "584e3043-addf-41f7-a3cd-de51c229af72-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:43:21 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-fc07cd8d-ffd2-486d-98aa-ef0c8913307e req-0d36c887-99da-41bf-9f3e-5ab613572066 service nova] Lock "584e3043-addf-41f7-a3cd-de51c229af72-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:43:21 user nova-compute[75045]: DEBUG nova.compute.manager [req-fc07cd8d-ffd2-486d-98aa-ef0c8913307e req-0d36c887-99da-41bf-9f3e-5ab613572066 service nova] [instance: 584e3043-addf-41f7-a3cd-de51c229af72] No waiting events found dispatching network-vif-unplugged-8b02e567-10f8-4153-88a4-9ce005c1fff3 {{(pid=75045) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 23:43:21 user nova-compute[75045]: WARNING nova.compute.manager [req-fc07cd8d-ffd2-486d-98aa-ef0c8913307e req-0d36c887-99da-41bf-9f3e-5ab613572066 service nova] [instance: 584e3043-addf-41f7-a3cd-de51c229af72] Received unexpected event network-vif-unplugged-8b02e567-10f8-4153-88a4-9ce005c1fff3 for instance with vm_state active and task_state shelving.
Nov 08 23:43:21 user nova-compute[75045]: INFO nova.virt.libvirt.driver [-] [instance: 584e3043-addf-41f7-a3cd-de51c229af72] Instance destroyed successfully.
Nov 08 23:43:21 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:43:21 user nova-compute[75045]: INFO nova.virt.libvirt.driver [None req-4ea4f431-8202-479e-98e4-41ad55823c80 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] [instance: 584e3043-addf-41f7-a3cd-de51c229af72] Beginning cold snapshot process
Nov 08 23:43:21 user nova-compute[75045]: DEBUG nova.privsep.utils [None req-4ea4f431-8202-479e-98e4-41ad55823c80 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75045) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 08 23:43:21 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-4ea4f431-8202-479e-98e4-41ad55823c80 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/584e3043-addf-41f7-a3cd-de51c229af72/disk /opt/stack/data/nova/instances/snapshots/tmph8kooisg/d149f0f3ba5244b4a3ead06d15de25be {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:43:22 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-4ea4f431-8202-479e-98e4-41ad55823c80 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/584e3043-addf-41f7-a3cd-de51c229af72/disk /opt/stack/data/nova/instances/snapshots/tmph8kooisg/d149f0f3ba5244b4a3ead06d15de25be" returned: 0 in 0.615s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:43:22 user nova-compute[75045]: INFO nova.virt.libvirt.driver [None req-4ea4f431-8202-479e-98e4-41ad55823c80 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] [instance: 584e3043-addf-41f7-a3cd-de51c229af72] Snapshot extracted, beginning image upload
Nov 08 23:43:23 user nova-compute[75045]: DEBUG nova.compute.manager [req-6fa204f1-3c40-424e-ba91-4c42796af90d req-1449cc5a-38d5-4aa6-ba9d-3d9bfc652974 service nova] [instance: 584e3043-addf-41f7-a3cd-de51c229af72] Received event network-vif-plugged-8b02e567-10f8-4153-88a4-9ce005c1fff3 {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:43:23 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-6fa204f1-3c40-424e-ba91-4c42796af90d req-1449cc5a-38d5-4aa6-ba9d-3d9bfc652974 service nova] Acquiring lock "584e3043-addf-41f7-a3cd-de51c229af72-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:43:23 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-6fa204f1-3c40-424e-ba91-4c42796af90d req-1449cc5a-38d5-4aa6-ba9d-3d9bfc652974 service nova] Lock "584e3043-addf-41f7-a3cd-de51c229af72-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:43:23 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-6fa204f1-3c40-424e-ba91-4c42796af90d req-1449cc5a-38d5-4aa6-ba9d-3d9bfc652974 service nova] Lock "584e3043-addf-41f7-a3cd-de51c229af72-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:43:23 user nova-compute[75045]: DEBUG nova.compute.manager [req-6fa204f1-3c40-424e-ba91-4c42796af90d req-1449cc5a-38d5-4aa6-ba9d-3d9bfc652974 service nova] [instance: 584e3043-addf-41f7-a3cd-de51c229af72] No waiting events found dispatching network-vif-plugged-8b02e567-10f8-4153-88a4-9ce005c1fff3 {{(pid=75045) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 23:43:23 user nova-compute[75045]: WARNING nova.compute.manager [req-6fa204f1-3c40-424e-ba91-4c42796af90d req-1449cc5a-38d5-4aa6-ba9d-3d9bfc652974 service nova] [instance: 584e3043-addf-41f7-a3cd-de51c229af72] Received unexpected event network-vif-plugged-8b02e567-10f8-4153-88a4-9ce005c1fff3 for instance with vm_state active and task_state shelving_image_uploading.
Nov 08 23:43:25 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:43:25 user nova-compute[75045]: INFO nova.virt.libvirt.driver [None req-4ea4f431-8202-479e-98e4-41ad55823c80 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] [instance: 584e3043-addf-41f7-a3cd-de51c229af72] Snapshot image upload complete
Nov 08 23:43:25 user nova-compute[75045]: DEBUG nova.compute.manager [None req-4ea4f431-8202-479e-98e4-41ad55823c80 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] [instance: 584e3043-addf-41f7-a3cd-de51c229af72] Checking state {{(pid=75045) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 23:43:25 user nova-compute[75045]: INFO nova.compute.manager [None req-4ea4f431-8202-479e-98e4-41ad55823c80 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] [instance: 584e3043-addf-41f7-a3cd-de51c229af72] Shelve offloading
Nov 08 23:43:25 user nova-compute[75045]: INFO nova.virt.libvirt.driver [-] [instance: 584e3043-addf-41f7-a3cd-de51c229af72] Instance destroyed successfully.
Nov 08 23:43:25 user nova-compute[75045]: DEBUG nova.compute.manager [None req-4ea4f431-8202-479e-98e4-41ad55823c80 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] [instance: 584e3043-addf-41f7-a3cd-de51c229af72] Checking state {{(pid=75045) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 23:43:25 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-4ea4f431-8202-479e-98e4-41ad55823c80 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] Acquiring lock "refresh_cache-584e3043-addf-41f7-a3cd-de51c229af72" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 23:43:25 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-4ea4f431-8202-479e-98e4-41ad55823c80 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] Acquired lock "refresh_cache-584e3043-addf-41f7-a3cd-de51c229af72" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 23:43:25 user nova-compute[75045]: DEBUG nova.network.neutron [None req-4ea4f431-8202-479e-98e4-41ad55823c80 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] [instance: 584e3043-addf-41f7-a3cd-de51c229af72] Building network info cache for instance {{(pid=75045) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 23:43:25 user nova-compute[75045]: DEBUG nova.network.neutron [None req-4ea4f431-8202-479e-98e4-41ad55823c80 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] [instance: 584e3043-addf-41f7-a3cd-de51c229af72] Updating instance_info_cache with network_info: [{"id": "8b02e567-10f8-4153-88a4-9ce005c1fff3", "address": "fa:16:3e:fe:a0:87", "network": {"id": "1b10bc53-ef32-4f01-82f6-ed9f95f7e3f2", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-518782773-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.123", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ad736027d034259a052da3f62bd575f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b02e567-10", "ovs_interfaceid": "8b02e567-10f8-4153-88a4-9ce005c1fff3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75045) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 23:43:25 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-4ea4f431-8202-479e-98e4-41ad55823c80 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] Releasing lock "refresh_cache-584e3043-addf-41f7-a3cd-de51c229af72" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 23:43:26 user nova-compute[75045]: INFO nova.virt.libvirt.driver [-] [instance: 584e3043-addf-41f7-a3cd-de51c229af72] Instance destroyed successfully.
Nov 08 23:43:26 user nova-compute[75045]: DEBUG nova.objects.instance [None req-4ea4f431-8202-479e-98e4-41ad55823c80 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] Lazy-loading 'resources' on Instance uuid 584e3043-addf-41f7-a3cd-de51c229af72 {{(pid=75045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 23:43:26 user nova-compute[75045]: DEBUG nova.virt.libvirt.vif [None req-4ea4f431-8202-479e-98e4-41ad55823c80 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T23:41:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1201717535',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1201717535',id=41,image_ref='a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDL1Zv99L0Ha9EsCvyr90S90UX2vsiydtiEaWXdaK/WLI6o5JNyURd/0lbHKvXBXdKY02fMl7do4Nh25Fg22RCADhjGB98OjA7zj1WOLqsNETfEin1geBvs6wFI4MnRzYA==',key_name='tempest-keypair-2053037695',keypairs=<?>,launch_index=0,launched_at=2023-11-08T23:41:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='3ad736027d034259a052da3f62bd575f',ramdisk_id='',reservation_id='r-km2oh92z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1769593098',owner_user_name='tempest-AttachVolumeShelveTestJSON-1769593098-project-member',shelved_at='2023-11-08T23:43:25.340455',shelved_host='user',shelved_image_id='75c4ea21-95a9-41b4-97c8-ebe2c3667c78'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T23:43:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7a98fe96727741d0b148f3aaa8abf6f1',uuid=584e3043-addf-41f7-a3cd-de51c229af72,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "8b02e567-10f8-4153-88a4-9ce005c1fff3", "address": "fa:16:3e:fe:a0:87", "network": {"id": "1b10bc53-ef32-4f01-82f6-ed9f95f7e3f2", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-518782773-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.123", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ad736027d034259a052da3f62bd575f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b02e567-10", "ovs_interfaceid": "8b02e567-10f8-4153-88a4-9ce005c1fff3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75045) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 23:43:26 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-4ea4f431-8202-479e-98e4-41ad55823c80 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] Converting VIF {"id": "8b02e567-10f8-4153-88a4-9ce005c1fff3", "address": "fa:16:3e:fe:a0:87", "network": {"id": "1b10bc53-ef32-4f01-82f6-ed9f95f7e3f2", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-518782773-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.123", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ad736027d034259a052da3f62bd575f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b02e567-10", "ovs_interfaceid": "8b02e567-10f8-4153-88a4-9ce005c1fff3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 23:43:26 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-4ea4f431-8202-479e-98e4-41ad55823c80 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fe:a0:87,bridge_name='br-int',has_traffic_filtering=True,id=8b02e567-10f8-4153-88a4-9ce005c1fff3,network=Network(1b10bc53-ef32-4f01-82f6-ed9f95f7e3f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b02e567-10') {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 23:43:26 user nova-compute[75045]: DEBUG os_vif [None req-4ea4f431-8202-479e-98e4-41ad55823c80 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fe:a0:87,bridge_name='br-int',has_traffic_filtering=True,id=8b02e567-10f8-4153-88a4-9ce005c1fff3,network=Network(1b10bc53-ef32-4f01-82f6-ed9f95f7e3f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b02e567-10') {{(pid=75045) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 23:43:26 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:43:26 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8b02e567-10, bridge=br-int, if_exists=True) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:43:26 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:43:26 user nova-compute[75045]: DEBUG nova.compute.manager [req-18eb40da-2648-471a-ab83-1f8367323b78 req-d979b2f4-d332-4223-bed5-f0205918060e service nova] [instance: 584e3043-addf-41f7-a3cd-de51c229af72] Received event network-changed-8b02e567-10f8-4153-88a4-9ce005c1fff3 {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:43:26 user nova-compute[75045]: DEBUG nova.compute.manager [req-18eb40da-2648-471a-ab83-1f8367323b78 req-d979b2f4-d332-4223-bed5-f0205918060e service nova] [instance: 584e3043-addf-41f7-a3cd-de51c229af72] Refreshing instance network info cache due to event network-changed-8b02e567-10f8-4153-88a4-9ce005c1fff3. {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 23:43:26 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-18eb40da-2648-471a-ab83-1f8367323b78 req-d979b2f4-d332-4223-bed5-f0205918060e service nova] Acquiring lock "refresh_cache-584e3043-addf-41f7-a3cd-de51c229af72" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 23:43:26 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-18eb40da-2648-471a-ab83-1f8367323b78 req-d979b2f4-d332-4223-bed5-f0205918060e service nova] Acquired lock "refresh_cache-584e3043-addf-41f7-a3cd-de51c229af72" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 23:43:26 user nova-compute[75045]: DEBUG nova.network.neutron [req-18eb40da-2648-471a-ab83-1f8367323b78 req-d979b2f4-d332-4223-bed5-f0205918060e service nova] [instance: 584e3043-addf-41f7-a3cd-de51c229af72] Refreshing network info cache for port 8b02e567-10f8-4153-88a4-9ce005c1fff3 {{(pid=75045) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 23:43:26 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 23:43:26 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:43:26 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e66230b8-25e5-4c73-b8a8-3ee89d544ffa) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:43:26 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:43:26 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 23:43:26 user nova-compute[75045]: INFO os_vif [None req-4ea4f431-8202-479e-98e4-41ad55823c80 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fe:a0:87,bridge_name='br-int',has_traffic_filtering=True,id=8b02e567-10f8-4153-88a4-9ce005c1fff3,network=Network(1b10bc53-ef32-4f01-82f6-ed9f95f7e3f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b02e567-10')
Nov 08 23:43:26 user nova-compute[75045]: INFO nova.virt.libvirt.driver [None req-4ea4f431-8202-479e-98e4-41ad55823c80 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] [instance: 584e3043-addf-41f7-a3cd-de51c229af72] Deleting instance files /opt/stack/data/nova/instances/584e3043-addf-41f7-a3cd-de51c229af72_del
Nov 08 23:43:26 user nova-compute[75045]: INFO nova.virt.libvirt.driver [None req-4ea4f431-8202-479e-98e4-41ad55823c80 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] [instance: 584e3043-addf-41f7-a3cd-de51c229af72] Deletion of /opt/stack/data/nova/instances/584e3043-addf-41f7-a3cd-de51c229af72_del complete
Nov 08 23:43:26 user nova-compute[75045]: INFO nova.scheduler.client.report [None req-4ea4f431-8202-479e-98e4-41ad55823c80 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] Deleted allocations for instance 584e3043-addf-41f7-a3cd-de51c229af72
Nov 08 23:43:26 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-4ea4f431-8202-479e-98e4-41ad55823c80 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:43:26 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-4ea4f431-8202-479e-98e4-41ad55823c80 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:43:26 user nova-compute[75045]: DEBUG nova.objects.instance [None req-4ea4f431-8202-479e-98e4-41ad55823c80 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] Lazy-loading 'numa_topology' on Instance uuid 584e3043-addf-41f7-a3cd-de51c229af72 {{(pid=75045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 23:43:26 user nova-compute[75045]: DEBUG nova.objects.base [None req-4ea4f431-8202-479e-98e4-41ad55823c80 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] Object Instance<584e3043-addf-41f7-a3cd-de51c229af72> lazy-loaded attributes: resources,numa_topology {{(pid=75045) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 23:43:26 user nova-compute[75045]: DEBUG nova.compute.provider_tree [None req-4ea4f431-8202-479e-98e4-41ad55823c80 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] Inventory has not changed in ProviderTree for provider: 62ba5f85-c74d-4b58-986e-d4197e813fd7 {{(pid=75045) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 23:43:26 user nova-compute[75045]: DEBUG nova.scheduler.client.report [None req-4ea4f431-8202-479e-98e4-41ad55823c80 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] Inventory has not changed for provider 62ba5f85-c74d-4b58-986e-d4197e813fd7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75045) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 23:43:26 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-4ea4f431-8202-479e-98e4-41ad55823c80 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.224s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:43:26 user nova-compute[75045]: DEBUG nova.network.neutron [req-18eb40da-2648-471a-ab83-1f8367323b78 req-d979b2f4-d332-4223-bed5-f0205918060e service nova] [instance: 584e3043-addf-41f7-a3cd-de51c229af72] Updated VIF entry in instance network info cache for port 8b02e567-10f8-4153-88a4-9ce005c1fff3. {{(pid=75045) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 23:43:26 user nova-compute[75045]: DEBUG nova.network.neutron [req-18eb40da-2648-471a-ab83-1f8367323b78 req-d979b2f4-d332-4223-bed5-f0205918060e service nova] [instance: 584e3043-addf-41f7-a3cd-de51c229af72] Updating instance_info_cache with network_info: [{"id": "8b02e567-10f8-4153-88a4-9ce005c1fff3", "address": "fa:16:3e:fe:a0:87", "network": {"id": "1b10bc53-ef32-4f01-82f6-ed9f95f7e3f2", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-518782773-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.123", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ad736027d034259a052da3f62bd575f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap8b02e567-10", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75045) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 23:43:27 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-18eb40da-2648-471a-ab83-1f8367323b78 req-d979b2f4-d332-4223-bed5-f0205918060e service nova] Releasing lock "refresh_cache-584e3043-addf-41f7-a3cd-de51c229af72" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 23:43:27 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-4ea4f431-8202-479e-98e4-41ad55823c80 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] Lock "584e3043-addf-41f7-a3cd-de51c229af72" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 5.849s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:43:31 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:43:31 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:43:34 user nova-compute[75045]: DEBUG nova.compute.manager [req-59d591aa-3160-4b83-bf15-f031c95a89ab req-7e941b3e-36c6-4b5a-ae0c-07fdd1dd9372 service nova] [instance: 0b413c71-c13a-4fea-91c4-f6b1953d54c6] Received event network-changed-166cceb4-9b95-4bdd-a3ad-b6aad94dfed0 {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:43:34 user nova-compute[75045]: DEBUG nova.compute.manager [req-59d591aa-3160-4b83-bf15-f031c95a89ab req-7e941b3e-36c6-4b5a-ae0c-07fdd1dd9372 service nova] [instance: 0b413c71-c13a-4fea-91c4-f6b1953d54c6] Refreshing instance network info cache due to event network-changed-166cceb4-9b95-4bdd-a3ad-b6aad94dfed0. {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 23:43:34 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-59d591aa-3160-4b83-bf15-f031c95a89ab req-7e941b3e-36c6-4b5a-ae0c-07fdd1dd9372 service nova] Acquiring lock "refresh_cache-0b413c71-c13a-4fea-91c4-f6b1953d54c6" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 23:43:34 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-59d591aa-3160-4b83-bf15-f031c95a89ab req-7e941b3e-36c6-4b5a-ae0c-07fdd1dd9372 service nova] Acquired lock "refresh_cache-0b413c71-c13a-4fea-91c4-f6b1953d54c6" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 23:43:34 user nova-compute[75045]: DEBUG nova.network.neutron [req-59d591aa-3160-4b83-bf15-f031c95a89ab req-7e941b3e-36c6-4b5a-ae0c-07fdd1dd9372 service nova] [instance: 0b413c71-c13a-4fea-91c4-f6b1953d54c6] Refreshing network info cache for port 166cceb4-9b95-4bdd-a3ad-b6aad94dfed0 {{(pid=75045) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 23:43:35 user nova-compute[75045]: DEBUG nova.network.neutron [req-59d591aa-3160-4b83-bf15-f031c95a89ab req-7e941b3e-36c6-4b5a-ae0c-07fdd1dd9372 service nova] [instance: 0b413c71-c13a-4fea-91c4-f6b1953d54c6] Updated VIF entry in instance network info cache for port 166cceb4-9b95-4bdd-a3ad-b6aad94dfed0. {{(pid=75045) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 23:43:35 user nova-compute[75045]: DEBUG nova.network.neutron [req-59d591aa-3160-4b83-bf15-f031c95a89ab req-7e941b3e-36c6-4b5a-ae0c-07fdd1dd9372 service nova] [instance: 0b413c71-c13a-4fea-91c4-f6b1953d54c6] Updating instance_info_cache with network_info: [{"id": "166cceb4-9b95-4bdd-a3ad-b6aad94dfed0", "address": "fa:16:3e:17:84:3d", "network": {"id": "e31c3d41-e46f-4c74-8ef5-8243a391dde8", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-856540424-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.149", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c8be85d72bc440899f3ccb64b923e90e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap166cceb4-9b", "ovs_interfaceid": "166cceb4-9b95-4bdd-a3ad-b6aad94dfed0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75045) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 23:43:35 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-59d591aa-3160-4b83-bf15-f031c95a89ab req-7e941b3e-36c6-4b5a-ae0c-07fdd1dd9372 service nova] Releasing lock "refresh_cache-0b413c71-c13a-4fea-91c4-f6b1953d54c6" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 23:43:36 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:43:36 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:43:41 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:43:41 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:43:42 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-1891e577-4177-490c-91b5-1150caa8fb68 tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Acquiring lock "0b413c71-c13a-4fea-91c4-f6b1953d54c6" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:43:42 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-1891e577-4177-490c-91b5-1150caa8fb68 tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Lock "0b413c71-c13a-4fea-91c4-f6b1953d54c6" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:43:42 user nova-compute[75045]: DEBUG nova.objects.instance [None req-1891e577-4177-490c-91b5-1150caa8fb68 tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Lazy-loading 'flavor' on Instance uuid 0b413c71-c13a-4fea-91c4-f6b1953d54c6 {{(pid=75045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 23:43:42 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-1891e577-4177-490c-91b5-1150caa8fb68 tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Lock "0b413c71-c13a-4fea-91c4-f6b1953d54c6" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:43:42 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-1891e577-4177-490c-91b5-1150caa8fb68 tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Acquiring lock "0b413c71-c13a-4fea-91c4-f6b1953d54c6" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:43:42 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-1891e577-4177-490c-91b5-1150caa8fb68 tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Lock "0b413c71-c13a-4fea-91c4-f6b1953d54c6" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:43:42 user nova-compute[75045]: INFO nova.compute.manager [None req-1891e577-4177-490c-91b5-1150caa8fb68 tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] [instance: 0b413c71-c13a-4fea-91c4-f6b1953d54c6] Attaching volume adcca529-746a-4b7a-966a-82909ff5b108 to /dev/vdb
Nov 08 23:43:42 user nova-compute[75045]: DEBUG os_brick.utils [None req-1891e577-4177-490c-91b5-1150caa8fb68 tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75045) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 23:43:42 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:43:42 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:43:42 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[80d5305c-27ff-4956-98a6-eafe07893608]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6217bd6e884\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:43:42 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:43:42 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:43:42 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[59eeea8e-b7d4-4f7b-8182-2342dfc97e13]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:43:42 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:43:42 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:43:42 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4d02245-7da2-412b-b093-416700054d21]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:43:42 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b585238-d5b2-43d8-a3ee-a7c57f8f7967]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:43:42 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-1891e577-4177-490c-91b5-1150caa8fb68 tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Running cmd (subprocess): nvme version {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:43:42 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-1891e577-4177-490c-91b5-1150caa8fb68 tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] 'nvme version' failed. Not Retrying. {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 23:43:42 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1891e577-4177-490c-91b5-1150caa8fb68 tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] nvme not present on system {{(pid=75045) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 23:43:42 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:43:42 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 23:43:42 user nova-compute[75045]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 23:43:42 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[602600d4-0251-43a7-8936-7cdbbcb00e9c]: (4, '') {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:43:42 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.lightos [None req-1891e577-4177-490c-91b5-1150caa8fb68 tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75045) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 23:43:42 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.lightos [None req-1891e577-4177-490c-91b5-1150caa8fb68 tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75045) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 23:43:42 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.lightos [None req-1891e577-4177-490c-91b5-1150caa8fb68 tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] LIGHTOS: no hostnqn found. {{(pid=75045) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 23:43:42 user nova-compute[75045]: DEBUG os_brick.utils [None req-1891e577-4177-490c-91b5-1150caa8fb68 tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6217bd6e884', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75045) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 23:43:42 user nova-compute[75045]: DEBUG nova.virt.block_device [None req-1891e577-4177-490c-91b5-1150caa8fb68 tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] [instance: 0b413c71-c13a-4fea-91c4-f6b1953d54c6] Updating existing volume attachment record: 1b49cc46-b794-4963-b239-b912f1e02a33 {{(pid=75045) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 23:43:46 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:43:46 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:43:50 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:43:51 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:43:51 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:43:53 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:43:54 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:43:54 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:43:54 user nova-compute[75045]: DEBUG nova.compute.manager [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Starting heal instance info cache {{(pid=75045) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 23:43:54 user nova-compute[75045]: DEBUG nova.compute.manager [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Didn't find any instances for network info cache update. {{(pid=75045) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 08 23:43:54 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:43:54 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:43:54 user nova-compute[75045]: DEBUG nova.compute.manager [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75045) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 23:43:55 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:43:56 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:43:56 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:43:56 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:43:56 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:43:57 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:43:58 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:44:01 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:44:01 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager.update_available_resource {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:44:02 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:44:02 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:44:02 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:44:02 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Auditing locally available compute resources for user (node: user) {{(pid=75045) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 23:44:02 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/244c4cc9-2837-40c9-b4ad-37dc435c9749/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:44:02 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/244c4cc9-2837-40c9-b4ad-37dc435c9749/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:44:02 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/244c4cc9-2837-40c9-b4ad-37dc435c9749/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:44:02 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-db658084-2baa-4501-b39a-cb96117b5860 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Acquiring lock "37502077-b02b-4f0c-b654-8a6cef607efa" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:44:02 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-db658084-2baa-4501-b39a-cb96117b5860 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Lock "37502077-b02b-4f0c-b654-8a6cef607efa" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:44:02 user nova-compute[75045]: DEBUG nova.compute.manager [None req-db658084-2baa-4501-b39a-cb96117b5860 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] [instance: 37502077-b02b-4f0c-b654-8a6cef607efa] Starting instance... {{(pid=75045) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 23:44:02 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-db658084-2baa-4501-b39a-cb96117b5860 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:44:02 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-db658084-2baa-4501-b39a-cb96117b5860 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:44:02 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/244c4cc9-2837-40c9-b4ad-37dc435c9749/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:44:02 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-db658084-2baa-4501-b39a-cb96117b5860 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75045) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 23:44:02 user nova-compute[75045]: INFO nova.compute.claims [None req-db658084-2baa-4501-b39a-cb96117b5860 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] [instance: 37502077-b02b-4f0c-b654-8a6cef607efa] Claim successful on node user
Nov 08 23:44:02 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ee587a0-e271-4262-a252-2ccb6c2faecb/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:44:02 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ee587a0-e271-4262-a252-2ccb6c2faecb/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:44:02 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ee587a0-e271-4262-a252-2ccb6c2faecb/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:44:02 user nova-compute[75045]: DEBUG nova.compute.provider_tree [None req-db658084-2baa-4501-b39a-cb96117b5860 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Inventory has not changed in ProviderTree for provider: 62ba5f85-c74d-4b58-986e-d4197e813fd7 {{(pid=75045) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 23:44:02 user nova-compute[75045]: DEBUG nova.scheduler.client.report [None req-db658084-2baa-4501-b39a-cb96117b5860 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Inventory has not changed for provider 62ba5f85-c74d-4b58-986e-d4197e813fd7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75045) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 23:44:02 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ee587a0-e271-4262-a252-2ccb6c2faecb/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:44:02 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75045) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 23:44:02 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ee587a0-e271-4262-a252-2ccb6c2faecb/disk.rescue --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:44:02 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-db658084-2baa-4501-b39a-cb96117b5860 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.441s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:44:02 user nova-compute[75045]: DEBUG nova.compute.manager [None req-db658084-2baa-4501-b39a-cb96117b5860 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] [instance: 37502077-b02b-4f0c-b654-8a6cef607efa] Start building networks asynchronously for instance. {{(pid=75045) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 23:44:03 user nova-compute[75045]: DEBUG nova.compute.manager [None req-db658084-2baa-4501-b39a-cb96117b5860 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] [instance: 37502077-b02b-4f0c-b654-8a6cef607efa] Allocating IP information in the background. {{(pid=75045) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 23:44:03 user nova-compute[75045]: DEBUG nova.network.neutron [None req-db658084-2baa-4501-b39a-cb96117b5860 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] [instance: 37502077-b02b-4f0c-b654-8a6cef607efa] allocate_for_instance() {{(pid=75045) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 23:44:03 user nova-compute[75045]: INFO nova.virt.libvirt.driver [None req-db658084-2baa-4501-b39a-cb96117b5860 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] [instance: 37502077-b02b-4f0c-b654-8a6cef607efa] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 23:44:03 user nova-compute[75045]: DEBUG nova.compute.manager [None req-db658084-2baa-4501-b39a-cb96117b5860 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] [instance: 37502077-b02b-4f0c-b654-8a6cef607efa] Start building block device mappings for instance. {{(pid=75045) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 23:44:03 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ee587a0-e271-4262-a252-2ccb6c2faecb/disk.rescue --force-share --output=json" returned: 0 in 0.193s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:44:03 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ee587a0-e271-4262-a252-2ccb6c2faecb/disk.rescue --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:44:03 user nova-compute[75045]: INFO nova.virt.block_device [None req-db658084-2baa-4501-b39a-cb96117b5860 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] [instance: 37502077-b02b-4f0c-b654-8a6cef607efa] Booting with volume 22e58281-41b7-4be2-ace8-0750aa5d18f8 at /dev/vda
Nov 08 23:44:03 user nova-compute[75045]: DEBUG nova.policy [None req-db658084-2baa-4501-b39a-cb96117b5860 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '76c31c64d9594f9cbef7586fafb48721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd59b73851c79473a9c2cdc0a120dfee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75045) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 23:44:03 user nova-compute[75045]: DEBUG os_brick.utils [None req-db658084-2baa-4501-b39a-cb96117b5860 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75045) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 23:44:03 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:44:03 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:44:03 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea0a7bf0-60d2-4e34-a09e-bdd795284e65]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6217bd6e884\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:44:03 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:44:03 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:44:03 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c505d27-98e3-403f-be69-66363df4bbec]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:44:03 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:44:03 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:44:03 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[494c36d3-c5bb-44e0-94df-125ca76f4fa9]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:44:03 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[7574dcbe-9ef1-4d31-8a27-bd920198f200]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:44:03 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-db658084-2baa-4501-b39a-cb96117b5860 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Running cmd (subprocess): nvme version {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:44:03 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-db658084-2baa-4501-b39a-cb96117b5860 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] 'nvme version' failed. Not Retrying. {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 23:44:03 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.nvmeof [None req-db658084-2baa-4501-b39a-cb96117b5860 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] nvme not present on system {{(pid=75045) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 23:44:03 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ee587a0-e271-4262-a252-2ccb6c2faecb/disk.rescue --force-share --output=json" returned: 0 in 0.221s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:44:03 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:44:03 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18c197c4-3000-41b1-83bc-1a781744d539/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:44:03 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 23:44:03 user nova-compute[75045]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 23:44:03 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2efd494-c402-4797-92d8-6eede57e7350]: (4, '') {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:44:03 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.lightos [None req-db658084-2baa-4501-b39a-cb96117b5860 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75045) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 23:44:03 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.lightos [None req-db658084-2baa-4501-b39a-cb96117b5860 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75045) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 23:44:03 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.lightos [None req-db658084-2baa-4501-b39a-cb96117b5860 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] LIGHTOS: no hostnqn found. {{(pid=75045) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 23:44:03 user nova-compute[75045]: DEBUG os_brick.utils [None req-db658084-2baa-4501-b39a-cb96117b5860 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] <== get_connector_properties: return (161ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6217bd6e884', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75045) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 23:44:03 user nova-compute[75045]: DEBUG nova.virt.block_device [None req-db658084-2baa-4501-b39a-cb96117b5860 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] [instance: 37502077-b02b-4f0c-b654-8a6cef607efa] Updating existing volume attachment record: f6ac68b8-346c-41fc-9813-b284935a1047 {{(pid=75045) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 23:44:03 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18c197c4-3000-41b1-83bc-1a781744d539/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:44:03 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18c197c4-3000-41b1-83bc-1a781744d539/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:44:03 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18c197c4-3000-41b1-83bc-1a781744d539/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:44:03 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75045) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 23:44:03 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b413c71-c13a-4fea-91c4-f6b1953d54c6/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:44:03 user nova-compute[75045]: DEBUG nova.network.neutron [None req-db658084-2baa-4501-b39a-cb96117b5860 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] [instance: 37502077-b02b-4f0c-b654-8a6cef607efa] Successfully created port: 30508e27-33e7-40dd-b166-6486da0f0911 {{(pid=75045) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 23:44:03 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b413c71-c13a-4fea-91c4-f6b1953d54c6/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:44:03 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b413c71-c13a-4fea-91c4-f6b1953d54c6/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:44:04 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b413c71-c13a-4fea-91c4-f6b1953d54c6/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:44:04 user nova-compute[75045]: DEBUG nova.network.neutron [None req-db658084-2baa-4501-b39a-cb96117b5860 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] [instance: 37502077-b02b-4f0c-b654-8a6cef607efa] Successfully updated port: 30508e27-33e7-40dd-b166-6486da0f0911 {{(pid=75045) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 23:44:04 user nova-compute[75045]: DEBUG nova.compute.manager [req-38820ff3-2589-4f6c-8904-49e136281243 req-ea5e9130-189e-40f7-98d3-d44de37638d2 service nova] [instance: 37502077-b02b-4f0c-b654-8a6cef607efa] Received event network-changed-30508e27-33e7-40dd-b166-6486da0f0911 {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:44:04 user nova-compute[75045]: DEBUG nova.compute.manager [req-38820ff3-2589-4f6c-8904-49e136281243 req-ea5e9130-189e-40f7-98d3-d44de37638d2 service nova] [instance: 37502077-b02b-4f0c-b654-8a6cef607efa] Refreshing instance network info cache due to event network-changed-30508e27-33e7-40dd-b166-6486da0f0911. {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 23:44:04 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-38820ff3-2589-4f6c-8904-49e136281243 req-ea5e9130-189e-40f7-98d3-d44de37638d2 service nova] Acquiring lock "refresh_cache-37502077-b02b-4f0c-b654-8a6cef607efa" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 23:44:04 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-38820ff3-2589-4f6c-8904-49e136281243 req-ea5e9130-189e-40f7-98d3-d44de37638d2 service nova] Acquired lock "refresh_cache-37502077-b02b-4f0c-b654-8a6cef607efa" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 23:44:04 user nova-compute[75045]: DEBUG nova.network.neutron [req-38820ff3-2589-4f6c-8904-49e136281243 req-ea5e9130-189e-40f7-98d3-d44de37638d2 service nova] [instance: 37502077-b02b-4f0c-b654-8a6cef607efa] Refreshing network info cache for port 30508e27-33e7-40dd-b166-6486da0f0911 {{(pid=75045) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 23:44:04 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-db658084-2baa-4501-b39a-cb96117b5860 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Acquiring lock "refresh_cache-37502077-b02b-4f0c-b654-8a6cef607efa" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 23:44:04 user nova-compute[75045]: WARNING nova.virt.libvirt.driver [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 23:44:04 user nova-compute[75045]: WARNING nova.virt.libvirt.driver [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 23:44:04 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Hypervisor/Node resource view: name=user free_ram=8453MB free_disk=24.9078369140625GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75045) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 23:44:04 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:44:04 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:44:04 user nova-compute[75045]: DEBUG nova.network.neutron [req-38820ff3-2589-4f6c-8904-49e136281243 req-ea5e9130-189e-40f7-98d3-d44de37638d2 service nova] [instance: 37502077-b02b-4f0c-b654-8a6cef607efa] Instance cache missing network info. {{(pid=75045) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 23:44:04 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Instance 244c4cc9-2837-40c9-b4ad-37dc435c9749 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75045) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 23:44:04 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Instance 7ee587a0-e271-4262-a252-2ccb6c2faecb actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75045) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 23:44:04 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Instance 18c197c4-3000-41b1-83bc-1a781744d539 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75045) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 23:44:04 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Instance 0b413c71-c13a-4fea-91c4-f6b1953d54c6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75045) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 23:44:04 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Instance 37502077-b02b-4f0c-b654-8a6cef607efa actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75045) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 23:44:04 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=75045) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 23:44:04 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=75045) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 23:44:04 user nova-compute[75045]: DEBUG nova.network.neutron [req-38820ff3-2589-4f6c-8904-49e136281243 req-ea5e9130-189e-40f7-98d3-d44de37638d2 service nova] [instance: 37502077-b02b-4f0c-b654-8a6cef607efa] Updating instance_info_cache with network_info: [] {{(pid=75045) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 23:44:04 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-38820ff3-2589-4f6c-8904-49e136281243 req-ea5e9130-189e-40f7-98d3-d44de37638d2 service nova] Releasing lock "refresh_cache-37502077-b02b-4f0c-b654-8a6cef607efa" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 23:44:04 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-db658084-2baa-4501-b39a-cb96117b5860 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Acquired lock "refresh_cache-37502077-b02b-4f0c-b654-8a6cef607efa" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 23:44:04 user nova-compute[75045]: DEBUG nova.network.neutron [None req-db658084-2baa-4501-b39a-cb96117b5860 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] [instance: 37502077-b02b-4f0c-b654-8a6cef607efa] Building network info cache for instance {{(pid=75045) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 23:44:04 user nova-compute[75045]: DEBUG nova.compute.provider_tree [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Inventory has not changed in ProviderTree for provider: 62ba5f85-c74d-4b58-986e-d4197e813fd7 {{(pid=75045) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 23:44:04 user nova-compute[75045]: DEBUG nova.scheduler.client.report [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Inventory has not changed for provider 62ba5f85-c74d-4b58-986e-d4197e813fd7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75045) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 23:44:04 user nova-compute[75045]: DEBUG nova.network.neutron [None req-db658084-2baa-4501-b39a-cb96117b5860 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] [instance: 37502077-b02b-4f0c-b654-8a6cef607efa] Instance cache missing network info. {{(pid=75045) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 23:44:04 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Compute_service record updated for user:user {{(pid=75045) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 23:44:04 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.331s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:44:05 user nova-compute[75045]: DEBUG nova.network.neutron [None req-db658084-2baa-4501-b39a-cb96117b5860 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] [instance: 37502077-b02b-4f0c-b654-8a6cef607efa] Updating instance_info_cache with network_info: [{"id": "30508e27-33e7-40dd-b166-6486da0f0911", "address": "fa:16:3e:3d:90:bb", "network": {"id": "4205f899-9865-4c65-8b46-c9a533e9bb45", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-774780781-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d59b73851c79473a9c2cdc0a120dfee0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30508e27-33", "ovs_interfaceid": "30508e27-33e7-40dd-b166-6486da0f0911", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75045) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 23:44:05 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-db658084-2baa-4501-b39a-cb96117b5860 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Releasing lock "refresh_cache-37502077-b02b-4f0c-b654-8a6cef607efa" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 23:44:05 user nova-compute[75045]: DEBUG nova.compute.manager [None req-db658084-2baa-4501-b39a-cb96117b5860 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] [instance: 37502077-b02b-4f0c-b654-8a6cef607efa] Instance network_info: |[{"id": "30508e27-33e7-40dd-b166-6486da0f0911", "address": "fa:16:3e:3d:90:bb", "network": {"id": "4205f899-9865-4c65-8b46-c9a533e9bb45", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-774780781-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d59b73851c79473a9c2cdc0a120dfee0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30508e27-33", "ovs_interfaceid": "30508e27-33e7-40dd-b166-6486da0f0911", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75045) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 23:44:06 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:44:06 user nova-compute[75045]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1891e577-4177-490c-91b5-1150caa8fb68 tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] [instance: 0b413c71-c13a-4fea-91c4-f6b1953d54c6] Calling os-brick to attach iSCSI Volume {{(pid=75045) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 23:44:06 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-1891e577-4177-490c-91b5-1150caa8fb68 tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1b68210460>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:adcca529-746a-4b7a-966a-82909ff5b108', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'abIqSyev', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75045) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 23:44:06 user nova-compute[75045]: WARNING os_brick.initiator.connectors.base [None req-1891e577-4177-490c-91b5-1150caa8fb68 tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 23:44:06 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-1891e577-4177-490c-91b5-1150caa8fb68 tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 23:44:06 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-1891e577-4177-490c-91b5-1150caa8fb68 tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 23:44:06 user nova-compute[75045]: WARNING os_brick.initiator.connectors.base [None req-1891e577-4177-490c-91b5-1150caa8fb68 tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 23:44:06 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-1891e577-4177-490c-91b5-1150caa8fb68 tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:adcca529-746a-4b7a-966a-82909ff5b108" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 23:44:06 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-1891e577-4177-490c-91b5-1150caa8fb68 tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:adcca529-746a-4b7a-966a-82909ff5b108" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 23:44:06 user nova-compute[75045]: INFO os_brick.initiator.connectors.iscsi [None req-1891e577-4177-490c-91b5-1150caa8fb68 tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 23:44:06 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:adcca529-746a-4b7a-966a-82909ff5b108 -p 172.16.0.220:3260 {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:44:06 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:adcca529-746a-4b7a-966a-82909ff5b108 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:44:06 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[58d21c8c-103b-4564-b7ee-8a47eb5303e8]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:44:06 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-1891e577-4177-490c-91b5-1150caa8fb68 tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 23:44:06 user nova-compute[75045]:  {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:44:06 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:adcca529-746a-4b7a-966a-82909ff5b108 -p 172.16.0.220:3260 --interface default --op new {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:44:06 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:adcca529-746a-4b7a-966a-82909ff5b108 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:44:06 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ec86513-4495-4802-94a2-2a0d0e161091]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:adcca529-746a-4b7a-966a-82909ff5b108] added\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:44:06 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-1891e577-4177-490c-91b5-1150caa8fb68 tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:adcca529-746a-4b7a-966a-82909ff5b108] added
Nov 08 23:44:06 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:44:06 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:adcca529-746a-4b7a-966a-82909ff5b108 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:44:06 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:adcca529-746a-4b7a-966a-82909ff5b108 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:44:06 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[14135bcb-4570-45c7-8878-6463fea52f82]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:44:06 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-1891e577-4177-490c-91b5-1150caa8fb68 tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:44:06 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:adcca529-746a-4b7a-966a-82909ff5b108 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:44:06 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:adcca529-746a-4b7a-966a-82909ff5b108 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:44:06 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[08691f07-e1f6-4052-84ff-a916a419c173]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:44:06 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-1891e577-4177-490c-91b5-1150caa8fb68 tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:44:06 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:adcca529-746a-4b7a-966a-82909ff5b108 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v abIqSyev {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:44:06 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:adcca529-746a-4b7a-966a-82909ff5b108 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v abIqSyev" returned: 0 in 0.018s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:44:06 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[c08cfed4-63d9-4193-aa93-a7e09275c106]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:44:06 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-1891e577-4177-490c-91b5-1150caa8fb68 tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'abIqSyev'): stdout= stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:44:06 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:adcca529-746a-4b7a-966a-82909ff5b108 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:44:06 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:adcca529-746a-4b7a-966a-82909ff5b108 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:44:06 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4ce907b-3045-4ca7-900e-a58370cb0aeb]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:44:06 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-1891e577-4177-490c-91b5-1150caa8fb68 tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:44:06 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:44:06 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:44:06 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[10fc1685-ec1a-4b2c-80d2-ee157e4c06ab]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7bd77e85-94b5-49aa-8412-c200279e0748 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4186be2-8695-4a3d-a986-2ea74ec001f7 (non-flash)\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:44:06 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-1891e577-4177-490c-91b5-1150caa8fb68 tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7bd77e85-94b5-49aa-8412-c200279e0748 (non-flash)
Nov 08 23:44:06 user nova-compute[75045]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4186be2-8695-4a3d-a986-2ea74ec001f7 (non-flash)
Nov 08 23:44:06 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 23:44:06 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-1891e577-4177-490c-91b5-1150caa8fb68 tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7bd77e85-94b5-49aa-8412-c200279e0748 (non-flash)
Nov 08 23:44:06 user nova-compute[75045]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4186be2-8695-4a3d-a986-2ea74ec001f7 (non-flash)
Nov 08 23:44:06 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 23:44:06 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:adcca529-746a-4b7a-966a-82909ff5b108 -p 172.16.0.220:3260 --login {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:44:06 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:44:07 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:adcca529-746a-4b7a-966a-82909ff5b108 -p 172.16.0.220:3260 --login" returned: 0 in 1.055s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:44:07 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[b980f045-2665-40ba-b007-1d4cd6c0a035]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:adcca529-746a-4b7a-966a-82909ff5b108, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:adcca529-746a-4b7a-966a-82909ff5b108, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:44:07 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-1891e577-4177-490c-91b5-1150caa8fb68 tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:adcca529-746a-4b7a-966a-82909ff5b108, portal: 172.16.0.220,3260]
Nov 08 23:44:07 user nova-compute[75045]: Login to [iface: default, target: iqn.2010-10.org.openstack:adcca529-746a-4b7a-966a-82909ff5b108, portal: 172.16.0.220,3260] successful.
Nov 08 23:44:07 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:44:07 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:adcca529-746a-4b7a-966a-82909ff5b108 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:44:07 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:adcca529-746a-4b7a-966a-82909ff5b108 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:44:07 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[7be2d5f8-c6e9-41ca-ad9d-39aed5543bea]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:44:07 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-1891e577-4177-490c-91b5-1150caa8fb68 tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:44:07 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:44:07 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:44:07 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[82734757-ad88-46d5-a603-dbc76b9e748b]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7bd77e85-94b5-49aa-8412-c200279e0748 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4186be2-8695-4a3d-a986-2ea74ec001f7 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:adcca529-746a-4b7a-966a-82909ff5b108 (non-flash)\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:44:07 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-1891e577-4177-490c-91b5-1150caa8fb68 tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7bd77e85-94b5-49aa-8412-c200279e0748 (non-flash)
Nov 08 23:44:07 user nova-compute[75045]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4186be2-8695-4a3d-a986-2ea74ec001f7 (non-flash)
Nov 08 23:44:07 user nova-compute[75045]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:adcca529-746a-4b7a-966a-82909ff5b108 (non-flash)
Nov 08 23:44:07 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 23:44:07 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-1891e577-4177-490c-91b5-1150caa8fb68 tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7bd77e85-94b5-49aa-8412-c200279e0748 (non-flash)
Nov 08 23:44:07 user nova-compute[75045]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4186be2-8695-4a3d-a986-2ea74ec001f7 (non-flash)
Nov 08 23:44:07 user nova-compute[75045]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:adcca529-746a-4b7a-966a-82909ff5b108 (non-flash)
Nov 08 23:44:07 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 23:44:07 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-1891e577-4177-490c-91b5-1150caa8fb68 tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:adcca529-746a-4b7a-966a-82909ff5b108" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.262s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 23:44:07 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-1891e577-4177-490c-91b5-1150caa8fb68 tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Connected to 172.16.0.220:3260 {{(pid=75045) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 23:44:07 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-1891e577-4177-490c-91b5-1150caa8fb68 tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] HCTL ('35', '-', '-', 0) found on session 43 with lun 0 {{(pid=75045) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 23:44:07 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-1891e577-4177-490c-91b5-1150caa8fb68 tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75045) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 23:44:07 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:44:07 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.019s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:44:07 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[c252f821-19a9-4bdf-b354-823ee3db056d]: (4, ('- - 0', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:44:07 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-1891e577-4177-490c-91b5-1150caa8fb68 tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Searching for a device in session 43 and hctl ['35', '*', '*', 0] yield: None {{(pid=75045) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 23:44:08 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-1891e577-4177-490c-91b5-1150caa8fb68 tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Searching for a device in session 43 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75045) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 23:44:08 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-1891e577-4177-490c-91b5-1150caa8fb68 tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:adcca529-746a-4b7a-966a-82909ff5b108', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'abIqSyev', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75045) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 23:44:08 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-1891e577-4177-490c-91b5-1150caa8fb68 tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.297s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 23:44:08 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-1891e577-4177-490c-91b5-1150caa8fb68 tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] <== connect_volume: return (2298ms) {'type': 'block', 'scsi_wwn': '23531366439363266', 'path': '/dev/sdd'} {{(pid=75045) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 23:44:08 user nova-compute[75045]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1891e577-4177-490c-91b5-1150caa8fb68 tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] [instance: 0b413c71-c13a-4fea-91c4-f6b1953d54c6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23531366439363266', 'path': '/dev/sdd'} {{(pid=75045) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 23:44:08 user nova-compute[75045]: DEBUG nova.objects.instance [None req-1891e577-4177-490c-91b5-1150caa8fb68 tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Lazy-loading 'flavor' on Instance uuid 0b413c71-c13a-4fea-91c4-f6b1953d54c6 {{(pid=75045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 23:44:08 user nova-compute[75045]: DEBUG nova.virt.libvirt.guest [None req-1891e577-4177-490c-91b5-1150caa8fb68 tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] attach device xml: <disk type="block" device="disk">
Nov 08 23:44:08 user nova-compute[75045]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 23:44:08 user nova-compute[75045]:   <source dev="/dev/sdd"/>
Nov 08 23:44:08 user nova-compute[75045]:   <target dev="vdb" bus="virtio"/>
Nov 08 23:44:08 user nova-compute[75045]:   <serial>adcca529-746a-4b7a-966a-82909ff5b108</serial>
Nov 08 23:44:08 user nova-compute[75045]: </disk>
Nov 08 23:44:08 user nova-compute[75045]:  {{(pid=75045) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 08 23:44:09 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-1891e577-4177-490c-91b5-1150caa8fb68 tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] No BDM found with device name vda, not building metadata. {{(pid=75045) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 23:44:09 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-1891e577-4177-490c-91b5-1150caa8fb68 tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75045) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 23:44:09 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-1891e577-4177-490c-91b5-1150caa8fb68 tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] No VIF found with MAC fa:16:3e:17:84:3d, not building metadata {{(pid=75045) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 23:44:09 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-1891e577-4177-490c-91b5-1150caa8fb68 tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Lock "0b413c71-c13a-4fea-91c4-f6b1953d54c6" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 27.169s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:44:10 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-9545213b-77be-4169-9376-b5f2d5c345f9 tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Acquiring lock "0b413c71-c13a-4fea-91c4-f6b1953d54c6" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:44:10 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-9545213b-77be-4169-9376-b5f2d5c345f9 tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Lock "0b413c71-c13a-4fea-91c4-f6b1953d54c6" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:44:10 user nova-compute[75045]: DEBUG nova.compute.manager [None req-9545213b-77be-4169-9376-b5f2d5c345f9 tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] [instance: 0b413c71-c13a-4fea-91c4-f6b1953d54c6] Checking state {{(pid=75045) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 23:44:10 user nova-compute[75045]: DEBUG nova.compute.manager [None req-9545213b-77be-4169-9376-b5f2d5c345f9 tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] [instance: 0b413c71-c13a-4fea-91c4-f6b1953d54c6] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=75045) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3358}}
Nov 08 23:44:10 user nova-compute[75045]: DEBUG nova.objects.instance [None req-9545213b-77be-4169-9376-b5f2d5c345f9 tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Lazy-loading 'flavor' on Instance uuid 0b413c71-c13a-4fea-91c4-f6b1953d54c6 {{(pid=75045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 23:44:10 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:44:10 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:44:10 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:44:10 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:44:10 user nova-compute[75045]: DEBUG nova.compute.manager [req-61eee6d1-6ab6-4171-8f33-b8a80cc4cb8c req-8c22b88e-cf61-4d42-915d-4726fdb56e41 service nova] [instance: 0b413c71-c13a-4fea-91c4-f6b1953d54c6] Received event network-vif-unplugged-166cceb4-9b95-4bdd-a3ad-b6aad94dfed0 {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:44:10 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-61eee6d1-6ab6-4171-8f33-b8a80cc4cb8c req-8c22b88e-cf61-4d42-915d-4726fdb56e41 service nova] Acquiring lock "0b413c71-c13a-4fea-91c4-f6b1953d54c6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:44:10 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-61eee6d1-6ab6-4171-8f33-b8a80cc4cb8c req-8c22b88e-cf61-4d42-915d-4726fdb56e41 service nova] Lock "0b413c71-c13a-4fea-91c4-f6b1953d54c6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:44:10 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-61eee6d1-6ab6-4171-8f33-b8a80cc4cb8c req-8c22b88e-cf61-4d42-915d-4726fdb56e41 service nova] Lock "0b413c71-c13a-4fea-91c4-f6b1953d54c6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:44:10 user nova-compute[75045]: DEBUG nova.compute.manager [req-61eee6d1-6ab6-4171-8f33-b8a80cc4cb8c req-8c22b88e-cf61-4d42-915d-4726fdb56e41 service nova] [instance: 0b413c71-c13a-4fea-91c4-f6b1953d54c6] No waiting events found dispatching network-vif-unplugged-166cceb4-9b95-4bdd-a3ad-b6aad94dfed0 {{(pid=75045) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 23:44:10 user nova-compute[75045]: WARNING nova.compute.manager [req-61eee6d1-6ab6-4171-8f33-b8a80cc4cb8c req-8c22b88e-cf61-4d42-915d-4726fdb56e41 service nova] [instance: 0b413c71-c13a-4fea-91c4-f6b1953d54c6] Received unexpected event network-vif-unplugged-166cceb4-9b95-4bdd-a3ad-b6aad94dfed0 for instance with vm_state active and task_state powering-off.
Nov 08 23:44:10 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:44:10 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:44:10 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:44:10 user nova-compute[75045]: INFO nova.virt.libvirt.driver [-] [instance: 0b413c71-c13a-4fea-91c4-f6b1953d54c6] Instance destroyed successfully.
Nov 08 23:44:10 user nova-compute[75045]: DEBUG nova.compute.manager [None req-9545213b-77be-4169-9376-b5f2d5c345f9 tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] [instance: 0b413c71-c13a-4fea-91c4-f6b1953d54c6] Checking state {{(pid=75045) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 23:44:11 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-9545213b-77be-4169-9376-b5f2d5c345f9 tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Lock "0b413c71-c13a-4fea-91c4-f6b1953d54c6" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.993s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:44:11 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:44:11 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:44:11 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:44:11 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:44:11 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:44:11 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:44:11 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:44:11 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:44:12 user nova-compute[75045]: DEBUG nova.compute.manager [req-5f745cfb-482a-4e45-9954-34e2010e4862 req-7e0359b9-13a5-4396-a29f-7b6e8f4d39a7 service nova] [instance: 0b413c71-c13a-4fea-91c4-f6b1953d54c6] Received event network-vif-plugged-166cceb4-9b95-4bdd-a3ad-b6aad94dfed0 {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:44:12 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-5f745cfb-482a-4e45-9954-34e2010e4862 req-7e0359b9-13a5-4396-a29f-7b6e8f4d39a7 service nova] Acquiring lock "0b413c71-c13a-4fea-91c4-f6b1953d54c6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:44:12 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-5f745cfb-482a-4e45-9954-34e2010e4862 req-7e0359b9-13a5-4396-a29f-7b6e8f4d39a7 service nova] Lock "0b413c71-c13a-4fea-91c4-f6b1953d54c6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:44:12 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-5f745cfb-482a-4e45-9954-34e2010e4862 req-7e0359b9-13a5-4396-a29f-7b6e8f4d39a7 service nova] Lock "0b413c71-c13a-4fea-91c4-f6b1953d54c6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:44:12 user nova-compute[75045]: DEBUG nova.compute.manager [req-5f745cfb-482a-4e45-9954-34e2010e4862 req-7e0359b9-13a5-4396-a29f-7b6e8f4d39a7 service nova] [instance: 0b413c71-c13a-4fea-91c4-f6b1953d54c6] No waiting events found dispatching network-vif-plugged-166cceb4-9b95-4bdd-a3ad-b6aad94dfed0 {{(pid=75045) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 23:44:12 user nova-compute[75045]: WARNING nova.compute.manager [req-5f745cfb-482a-4e45-9954-34e2010e4862 req-7e0359b9-13a5-4396-a29f-7b6e8f4d39a7 service nova] [instance: 0b413c71-c13a-4fea-91c4-f6b1953d54c6] Received unexpected event network-vif-plugged-166cceb4-9b95-4bdd-a3ad-b6aad94dfed0 for instance with vm_state stopped and task_state None.
Nov 08 23:44:16 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:44:21 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:44:23 user nova-compute[75045]: INFO nova.compute.manager [None req-8030f83b-d8df-466c-99dc-8c99a7060ac1 tempest-ServerStableDeviceRescueTest-1847572360 tempest-ServerStableDeviceRescueTest-1847572360-project-member] [instance: 7ee587a0-e271-4262-a252-2ccb6c2faecb] Unrescuing
Nov 08 23:44:23 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-8030f83b-d8df-466c-99dc-8c99a7060ac1 tempest-ServerStableDeviceRescueTest-1847572360 tempest-ServerStableDeviceRescueTest-1847572360-project-member] Acquiring lock "refresh_cache-7ee587a0-e271-4262-a252-2ccb6c2faecb" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 23:44:23 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-8030f83b-d8df-466c-99dc-8c99a7060ac1 tempest-ServerStableDeviceRescueTest-1847572360 tempest-ServerStableDeviceRescueTest-1847572360-project-member] Acquired lock "refresh_cache-7ee587a0-e271-4262-a252-2ccb6c2faecb" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 23:44:23 user nova-compute[75045]: DEBUG nova.network.neutron [None req-8030f83b-d8df-466c-99dc-8c99a7060ac1 tempest-ServerStableDeviceRescueTest-1847572360 tempest-ServerStableDeviceRescueTest-1847572360-project-member] [instance: 7ee587a0-e271-4262-a252-2ccb6c2faecb] Building network info cache for instance {{(pid=75045) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 23:44:23 user nova-compute[75045]: DEBUG nova.network.neutron [None req-8030f83b-d8df-466c-99dc-8c99a7060ac1 tempest-ServerStableDeviceRescueTest-1847572360 tempest-ServerStableDeviceRescueTest-1847572360-project-member] [instance: 7ee587a0-e271-4262-a252-2ccb6c2faecb] Updating instance_info_cache with network_info: [{"id": "0b911e0a-0c01-4296-b269-f52ee68772f9", "address": "fa:16:3e:03:88:6d", "network": {"id": "3fc25e49-b987-4fe7-9c28-6a18b689a411", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1301325538-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.217", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4760b2fb18b44e26bfbca6bf16aea581", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b911e0a-0c", "ovs_interfaceid": "0b911e0a-0c01-4296-b269-f52ee68772f9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75045) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 23:44:23 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-8030f83b-d8df-466c-99dc-8c99a7060ac1 tempest-ServerStableDeviceRescueTest-1847572360 tempest-ServerStableDeviceRescueTest-1847572360-project-member] Releasing lock "refresh_cache-7ee587a0-e271-4262-a252-2ccb6c2faecb" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 23:44:23 user nova-compute[75045]: DEBUG nova.objects.instance [None req-8030f83b-d8df-466c-99dc-8c99a7060ac1 tempest-ServerStableDeviceRescueTest-1847572360 tempest-ServerStableDeviceRescueTest-1847572360-project-member] Lazy-loading 'flavor' on Instance uuid 7ee587a0-e271-4262-a252-2ccb6c2faecb {{(pid=75045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 23:44:24 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:44:24 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:44:24 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:44:24 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:44:24 user nova-compute[75045]: DEBUG nova.compute.manager [req-6a08baa2-cd3b-4265-8bbd-b19fa32217b8 req-acc6487b-970f-4644-abd4-3408cdd3ad76 service nova] [instance: 7ee587a0-e271-4262-a252-2ccb6c2faecb] Received event network-vif-unplugged-0b911e0a-0c01-4296-b269-f52ee68772f9 {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:44:24 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-6a08baa2-cd3b-4265-8bbd-b19fa32217b8 req-acc6487b-970f-4644-abd4-3408cdd3ad76 service nova] Acquiring lock "7ee587a0-e271-4262-a252-2ccb6c2faecb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:44:24 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-6a08baa2-cd3b-4265-8bbd-b19fa32217b8 req-acc6487b-970f-4644-abd4-3408cdd3ad76 service nova] Lock "7ee587a0-e271-4262-a252-2ccb6c2faecb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:44:24 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-6a08baa2-cd3b-4265-8bbd-b19fa32217b8 req-acc6487b-970f-4644-abd4-3408cdd3ad76 service nova] Lock "7ee587a0-e271-4262-a252-2ccb6c2faecb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.003s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:44:24 user nova-compute[75045]: DEBUG nova.compute.manager [req-6a08baa2-cd3b-4265-8bbd-b19fa32217b8 req-acc6487b-970f-4644-abd4-3408cdd3ad76 service nova] [instance: 7ee587a0-e271-4262-a252-2ccb6c2faecb] No waiting events found dispatching network-vif-unplugged-0b911e0a-0c01-4296-b269-f52ee68772f9 {{(pid=75045) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 23:44:24 user nova-compute[75045]: WARNING nova.compute.manager [req-6a08baa2-cd3b-4265-8bbd-b19fa32217b8 req-acc6487b-970f-4644-abd4-3408cdd3ad76 service nova] [instance: 7ee587a0-e271-4262-a252-2ccb6c2faecb] Received unexpected event network-vif-unplugged-0b911e0a-0c01-4296-b269-f52ee68772f9 for instance with vm_state rescued and task_state unrescuing.
Nov 08 23:44:24 user nova-compute[75045]: DEBUG nova.compute.manager [req-29580137-fa85-4e3b-ae2c-5909993655e0 req-6d4017c5-67ed-488b-8a77-46b483164b9d service nova] [instance: 7ee587a0-e271-4262-a252-2ccb6c2faecb] Received event network-changed-0b911e0a-0c01-4296-b269-f52ee68772f9 {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:44:24 user nova-compute[75045]: DEBUG nova.compute.manager [req-29580137-fa85-4e3b-ae2c-5909993655e0 req-6d4017c5-67ed-488b-8a77-46b483164b9d service nova] [instance: 7ee587a0-e271-4262-a252-2ccb6c2faecb] Refreshing instance network info cache due to event network-changed-0b911e0a-0c01-4296-b269-f52ee68772f9. {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 23:44:24 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-29580137-fa85-4e3b-ae2c-5909993655e0 req-6d4017c5-67ed-488b-8a77-46b483164b9d service nova] Acquiring lock "refresh_cache-7ee587a0-e271-4262-a252-2ccb6c2faecb" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 23:44:24 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-29580137-fa85-4e3b-ae2c-5909993655e0 req-6d4017c5-67ed-488b-8a77-46b483164b9d service nova] Acquired lock "refresh_cache-7ee587a0-e271-4262-a252-2ccb6c2faecb" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 23:44:24 user nova-compute[75045]: DEBUG nova.network.neutron [req-29580137-fa85-4e3b-ae2c-5909993655e0 req-6d4017c5-67ed-488b-8a77-46b483164b9d service nova] [instance: 7ee587a0-e271-4262-a252-2ccb6c2faecb] Refreshing network info cache for port 0b911e0a-0c01-4296-b269-f52ee68772f9 {{(pid=75045) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 23:44:24 user nova-compute[75045]: INFO nova.virt.libvirt.driver [-] [instance: 7ee587a0-e271-4262-a252-2ccb6c2faecb] Instance destroyed successfully.
Nov 08 23:44:25 user nova-compute[75045]: DEBUG nova.network.neutron [req-29580137-fa85-4e3b-ae2c-5909993655e0 req-6d4017c5-67ed-488b-8a77-46b483164b9d service nova] [instance: 7ee587a0-e271-4262-a252-2ccb6c2faecb] Updated VIF entry in instance network info cache for port 0b911e0a-0c01-4296-b269-f52ee68772f9. {{(pid=75045) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 23:44:25 user nova-compute[75045]: DEBUG nova.network.neutron [req-29580137-fa85-4e3b-ae2c-5909993655e0 req-6d4017c5-67ed-488b-8a77-46b483164b9d service nova] [instance: 7ee587a0-e271-4262-a252-2ccb6c2faecb] Updating instance_info_cache with network_info: [{"id": "0b911e0a-0c01-4296-b269-f52ee68772f9", "address": "fa:16:3e:03:88:6d", "network": {"id": "3fc25e49-b987-4fe7-9c28-6a18b689a411", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1301325538-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.217", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4760b2fb18b44e26bfbca6bf16aea581", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b911e0a-0c", "ovs_interfaceid": "0b911e0a-0c01-4296-b269-f52ee68772f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75045) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 23:44:25 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-29580137-fa85-4e3b-ae2c-5909993655e0 req-6d4017c5-67ed-488b-8a77-46b483164b9d service nova] Releasing lock "refresh_cache-7ee587a0-e271-4262-a252-2ccb6c2faecb" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 23:44:26 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:44:26 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:44:26 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:44:26 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:44:26 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-02c69bbd-03a5-422d-b2e0-183f27cc4088 tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] Acquiring lock "18c197c4-3000-41b1-83bc-1a781744d539" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:44:26 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-02c69bbd-03a5-422d-b2e0-183f27cc4088 tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] Lock "18c197c4-3000-41b1-83bc-1a781744d539" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:44:26 user nova-compute[75045]: INFO nova.compute.manager [None req-02c69bbd-03a5-422d-b2e0-183f27cc4088 tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] [instance: 18c197c4-3000-41b1-83bc-1a781744d539] Detaching volume e4186be2-8695-4a3d-a986-2ea74ec001f7
Nov 08 23:44:26 user nova-compute[75045]: INFO nova.virt.block_device [None req-02c69bbd-03a5-422d-b2e0-183f27cc4088 tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] [instance: 18c197c4-3000-41b1-83bc-1a781744d539] Attempting to driver detach volume e4186be2-8695-4a3d-a986-2ea74ec001f7 from mountpoint /dev/vdb
Nov 08 23:44:26 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-946a737c-e98c-4f9e-9323-425a3350a86d tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] Acquiring lock "18c197c4-3000-41b1-83bc-1a781744d539" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:44:26 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-02c69bbd-03a5-422d-b2e0-183f27cc4088 tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] Attempting to detach device vdb from instance 18c197c4-3000-41b1-83bc-1a781744d539 from the persistent domain config. {{(pid=75045) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 08 23:44:26 user nova-compute[75045]: DEBUG nova.virt.libvirt.guest [None req-02c69bbd-03a5-422d-b2e0-183f27cc4088 tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 23:44:26 user nova-compute[75045]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 23:44:26 user nova-compute[75045]:   <source dev="/dev/sdc"/>
Nov 08 23:44:26 user nova-compute[75045]:   <target dev="vdb" bus="virtio"/>
Nov 08 23:44:26 user nova-compute[75045]:   <serial>e4186be2-8695-4a3d-a986-2ea74ec001f7</serial>
Nov 08 23:44:26 user nova-compute[75045]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 08 23:44:26 user nova-compute[75045]: </disk>
Nov 08 23:44:26 user nova-compute[75045]:  {{(pid=75045) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 23:44:26 user nova-compute[75045]: INFO nova.virt.libvirt.driver [None req-02c69bbd-03a5-422d-b2e0-183f27cc4088 tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] Successfully detached device vdb from instance 18c197c4-3000-41b1-83bc-1a781744d539 from the persistent domain config.
Nov 08 23:44:26 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-02c69bbd-03a5-422d-b2e0-183f27cc4088 tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 18c197c4-3000-41b1-83bc-1a781744d539 from the live domain config. {{(pid=75045) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 08 23:44:26 user nova-compute[75045]: DEBUG nova.virt.libvirt.guest [None req-02c69bbd-03a5-422d-b2e0-183f27cc4088 tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 23:44:26 user nova-compute[75045]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 23:44:26 user nova-compute[75045]:   <source dev="/dev/sdc"/>
Nov 08 23:44:26 user nova-compute[75045]:   <target dev="vdb" bus="virtio"/>
Nov 08 23:44:26 user nova-compute[75045]:   <serial>e4186be2-8695-4a3d-a986-2ea74ec001f7</serial>
Nov 08 23:44:26 user nova-compute[75045]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 08 23:44:26 user nova-compute[75045]: </disk>
Nov 08 23:44:26 user nova-compute[75045]:  {{(pid=75045) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 23:44:26 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:44:26 user nova-compute[75045]: DEBUG nova.compute.manager [req-e8d63de5-c4fd-49ef-bbb6-0c49f4474e38 req-c84e4f21-fb91-4683-bfc9-6966a84f4868 service nova] [instance: 7ee587a0-e271-4262-a252-2ccb6c2faecb] Received event network-vif-plugged-0b911e0a-0c01-4296-b269-f52ee68772f9 {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:44:26 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-e8d63de5-c4fd-49ef-bbb6-0c49f4474e38 req-c84e4f21-fb91-4683-bfc9-6966a84f4868 service nova] Acquiring lock "7ee587a0-e271-4262-a252-2ccb6c2faecb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:44:26 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-e8d63de5-c4fd-49ef-bbb6-0c49f4474e38 req-c84e4f21-fb91-4683-bfc9-6966a84f4868 service nova] Lock "7ee587a0-e271-4262-a252-2ccb6c2faecb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:44:26 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-e8d63de5-c4fd-49ef-bbb6-0c49f4474e38 req-c84e4f21-fb91-4683-bfc9-6966a84f4868 service nova] Lock "7ee587a0-e271-4262-a252-2ccb6c2faecb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:44:26 user nova-compute[75045]: DEBUG nova.compute.manager [req-e8d63de5-c4fd-49ef-bbb6-0c49f4474e38 req-c84e4f21-fb91-4683-bfc9-6966a84f4868 service nova] [instance: 7ee587a0-e271-4262-a252-2ccb6c2faecb] No waiting events found dispatching network-vif-plugged-0b911e0a-0c01-4296-b269-f52ee68772f9 {{(pid=75045) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 23:44:26 user nova-compute[75045]: WARNING nova.compute.manager [req-e8d63de5-c4fd-49ef-bbb6-0c49f4474e38 req-c84e4f21-fb91-4683-bfc9-6966a84f4868 service nova] [instance: 7ee587a0-e271-4262-a252-2ccb6c2faecb] Received unexpected event network-vif-plugged-0b911e0a-0c01-4296-b269-f52ee68772f9 for instance with vm_state rescued and task_state unrescuing.
Nov 08 23:44:26 user nova-compute[75045]: DEBUG nova.compute.manager [req-e8d63de5-c4fd-49ef-bbb6-0c49f4474e38 req-c84e4f21-fb91-4683-bfc9-6966a84f4868 service nova] [instance: 7ee587a0-e271-4262-a252-2ccb6c2faecb] Received event network-vif-plugged-0b911e0a-0c01-4296-b269-f52ee68772f9 {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:44:26 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-e8d63de5-c4fd-49ef-bbb6-0c49f4474e38 req-c84e4f21-fb91-4683-bfc9-6966a84f4868 service nova] Acquiring lock "7ee587a0-e271-4262-a252-2ccb6c2faecb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:44:26 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-e8d63de5-c4fd-49ef-bbb6-0c49f4474e38 req-c84e4f21-fb91-4683-bfc9-6966a84f4868 service nova] Lock "7ee587a0-e271-4262-a252-2ccb6c2faecb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:44:26 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-e8d63de5-c4fd-49ef-bbb6-0c49f4474e38 req-c84e4f21-fb91-4683-bfc9-6966a84f4868 service nova] Lock "7ee587a0-e271-4262-a252-2ccb6c2faecb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:44:26 user nova-compute[75045]: DEBUG nova.compute.manager [req-e8d63de5-c4fd-49ef-bbb6-0c49f4474e38 req-c84e4f21-fb91-4683-bfc9-6966a84f4868 service nova] [instance: 7ee587a0-e271-4262-a252-2ccb6c2faecb] No waiting events found dispatching network-vif-plugged-0b911e0a-0c01-4296-b269-f52ee68772f9 {{(pid=75045) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 23:44:26 user nova-compute[75045]: WARNING nova.compute.manager [req-e8d63de5-c4fd-49ef-bbb6-0c49f4474e38 req-c84e4f21-fb91-4683-bfc9-6966a84f4868 service nova] [instance: 7ee587a0-e271-4262-a252-2ccb6c2faecb] Received unexpected event network-vif-plugged-0b911e0a-0c01-4296-b269-f52ee68772f9 for instance with vm_state rescued and task_state unrescuing.
Nov 08 23:44:26 user nova-compute[75045]: DEBUG nova.compute.manager [req-37511043-50b8-4ef8-90f7-a0a915f9c5f0 req-e5d88f7f-9be4-4ec6-b5d9-3e66d08ba9e6 service nova] [instance: 7ee587a0-e271-4262-a252-2ccb6c2faecb] Received event network-changed-0b911e0a-0c01-4296-b269-f52ee68772f9 {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:44:26 user nova-compute[75045]: DEBUG nova.compute.manager [req-37511043-50b8-4ef8-90f7-a0a915f9c5f0 req-e5d88f7f-9be4-4ec6-b5d9-3e66d08ba9e6 service nova] [instance: 7ee587a0-e271-4262-a252-2ccb6c2faecb] Refreshing instance network info cache due to event network-changed-0b911e0a-0c01-4296-b269-f52ee68772f9. {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 23:44:26 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-37511043-50b8-4ef8-90f7-a0a915f9c5f0 req-e5d88f7f-9be4-4ec6-b5d9-3e66d08ba9e6 service nova] Acquiring lock "refresh_cache-7ee587a0-e271-4262-a252-2ccb6c2faecb" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 23:44:26 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-37511043-50b8-4ef8-90f7-a0a915f9c5f0 req-e5d88f7f-9be4-4ec6-b5d9-3e66d08ba9e6 service nova] Acquired lock "refresh_cache-7ee587a0-e271-4262-a252-2ccb6c2faecb" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 23:44:26 user nova-compute[75045]: DEBUG nova.network.neutron [req-37511043-50b8-4ef8-90f7-a0a915f9c5f0 req-e5d88f7f-9be4-4ec6-b5d9-3e66d08ba9e6 service nova] [instance: 7ee587a0-e271-4262-a252-2ccb6c2faecb] Refreshing network info cache for port 0b911e0a-0c01-4296-b269-f52ee68772f9 {{(pid=75045) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 23:44:26 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:44:26 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:44:26 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:44:26 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-02c69bbd-03a5-422d-b2e0-183f27cc4088 tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 18c197c4-3000-41b1-83bc-1a781744d539 {{(pid=75045) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 08 23:44:26 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:44:26 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:44:26 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:44:27 user nova-compute[75045]: DEBUG nova.network.neutron [req-37511043-50b8-4ef8-90f7-a0a915f9c5f0 req-e5d88f7f-9be4-4ec6-b5d9-3e66d08ba9e6 service nova] [instance: 7ee587a0-e271-4262-a252-2ccb6c2faecb] Updated VIF entry in instance network info cache for port 0b911e0a-0c01-4296-b269-f52ee68772f9. {{(pid=75045) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 23:44:27 user nova-compute[75045]: DEBUG nova.network.neutron [req-37511043-50b8-4ef8-90f7-a0a915f9c5f0 req-e5d88f7f-9be4-4ec6-b5d9-3e66d08ba9e6 service nova] [instance: 7ee587a0-e271-4262-a252-2ccb6c2faecb] Updating instance_info_cache with network_info: [{"id": "0b911e0a-0c01-4296-b269-f52ee68772f9", "address": "fa:16:3e:03:88:6d", "network": {"id": "3fc25e49-b987-4fe7-9c28-6a18b689a411", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1301325538-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.217", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4760b2fb18b44e26bfbca6bf16aea581", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b911e0a-0c", "ovs_interfaceid": "0b911e0a-0c01-4296-b269-f52ee68772f9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75045) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 23:44:27 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-37511043-50b8-4ef8-90f7-a0a915f9c5f0 req-e5d88f7f-9be4-4ec6-b5d9-3e66d08ba9e6 service nova] Releasing lock "refresh_cache-7ee587a0-e271-4262-a252-2ccb6c2faecb" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 23:44:28 user nova-compute[75045]: DEBUG nova.compute.manager [None req-8030f83b-d8df-466c-99dc-8c99a7060ac1 tempest-ServerStableDeviceRescueTest-1847572360 tempest-ServerStableDeviceRescueTest-1847572360-project-member] [instance: 7ee587a0-e271-4262-a252-2ccb6c2faecb] Checking state {{(pid=75045) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 23:44:28 user nova-compute[75045]: DEBUG nova.compute.manager [req-14ad022c-75e0-47e4-a7d7-a198528bdf12 req-cffba189-645b-435a-96d0-77f276d6c635 service nova] [instance: 7ee587a0-e271-4262-a252-2ccb6c2faecb] Received event network-vif-plugged-0b911e0a-0c01-4296-b269-f52ee68772f9 {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:44:28 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-14ad022c-75e0-47e4-a7d7-a198528bdf12 req-cffba189-645b-435a-96d0-77f276d6c635 service nova] Acquiring lock "7ee587a0-e271-4262-a252-2ccb6c2faecb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:44:28 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-14ad022c-75e0-47e4-a7d7-a198528bdf12 req-cffba189-645b-435a-96d0-77f276d6c635 service nova] Lock "7ee587a0-e271-4262-a252-2ccb6c2faecb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:44:28 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-14ad022c-75e0-47e4-a7d7-a198528bdf12 req-cffba189-645b-435a-96d0-77f276d6c635 service nova] Lock "7ee587a0-e271-4262-a252-2ccb6c2faecb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:44:28 user nova-compute[75045]: DEBUG nova.compute.manager [req-14ad022c-75e0-47e4-a7d7-a198528bdf12 req-cffba189-645b-435a-96d0-77f276d6c635 service nova] [instance: 7ee587a0-e271-4262-a252-2ccb6c2faecb] No waiting events found dispatching network-vif-plugged-0b911e0a-0c01-4296-b269-f52ee68772f9 {{(pid=75045) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 23:44:28 user nova-compute[75045]: WARNING nova.compute.manager [req-14ad022c-75e0-47e4-a7d7-a198528bdf12 req-cffba189-645b-435a-96d0-77f276d6c635 service nova] [instance: 7ee587a0-e271-4262-a252-2ccb6c2faecb] Received unexpected event network-vif-plugged-0b911e0a-0c01-4296-b269-f52ee68772f9 for instance with vm_state active and task_state None.
Nov 08 23:44:31 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:44:31 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:44:36 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:44:36 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:44:41 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:44:41 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:44:44 user nova-compute[75045]: DEBUG nova.compute.manager [None req-db658084-2baa-4501-b39a-cb96117b5860 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] [instance: 37502077-b02b-4f0c-b654-8a6cef607efa] Start spawning the instance on the hypervisor. {{(pid=75045) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 23:44:44 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-db658084-2baa-4501-b39a-cb96117b5860 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] [instance: 37502077-b02b-4f0c-b654-8a6cef607efa] Creating instance directory {{(pid=75045) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 23:44:44 user nova-compute[75045]: INFO nova.virt.libvirt.driver [None req-db658084-2baa-4501-b39a-cb96117b5860 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] [instance: 37502077-b02b-4f0c-b654-8a6cef607efa] Creating image(s)
Nov 08 23:44:44 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-db658084-2baa-4501-b39a-cb96117b5860 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] [instance: 37502077-b02b-4f0c-b654-8a6cef607efa] Did not create local disks {{(pid=75045) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 08 23:44:44 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-db658084-2baa-4501-b39a-cb96117b5860 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] [instance: 37502077-b02b-4f0c-b654-8a6cef607efa] Ensure instance console log exists: /opt/stack/data/nova/instances/37502077-b02b-4f0c-b654-8a6cef607efa/console.log {{(pid=75045) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 23:44:44 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-db658084-2baa-4501-b39a-cb96117b5860 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:44:44 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-db658084-2baa-4501-b39a-cb96117b5860 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:44:44 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-db658084-2baa-4501-b39a-cb96117b5860 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:44:44 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-db658084-2baa-4501-b39a-cb96117b5860 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] [instance: 37502077-b02b-4f0c-b654-8a6cef607efa] Start _get_guest_xml network_info=[{"id": "30508e27-33e7-40dd-b166-6486da0f0911", "address": "fa:16:3e:3d:90:bb", "network": {"id": "4205f899-9865-4c65-8b46-c9a533e9bb45", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-774780781-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d59b73851c79473a9c2cdc0a120dfee0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30508e27-33", "ovs_interfaceid": "30508e27-33e7-40dd-b166-6486da0f0911", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': True, 'device_type': 'disk', 'attachment_id': 'f6ac68b8-346c-41fc-9813-b284935a1047', 'guest_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:22e58281-41b7-4be2-ace8-0750aa5d18f8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'THBeGdMN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '37502077-b02b-4f0c-b654-8a6cef607efa', 'attached_at': '', 'detached_at': '', 'volume_id': '22e58281-41b7-4be2-ace8-0750aa5d18f8', 'serial': '22e58281-41b7-4be2-ace8-0750aa5d18f8'}, 'volume_type': None} {{(pid=75045) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 23:44:44 user nova-compute[75045]: WARNING nova.virt.libvirt.driver [None req-db658084-2baa-4501-b39a-cb96117b5860 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 23:44:44 user nova-compute[75045]: WARNING nova.virt.libvirt.driver [None req-db658084-2baa-4501-b39a-cb96117b5860 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 23:44:44 user nova-compute[75045]: DEBUG nova.virt.libvirt.host [None req-db658084-2baa-4501-b39a-cb96117b5860 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75045) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 23:44:44 user nova-compute[75045]: DEBUG nova.virt.libvirt.host [None req-db658084-2baa-4501-b39a-cb96117b5860 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] CPU controller missing on host. {{(pid=75045) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 23:44:44 user nova-compute[75045]: DEBUG nova.virt.libvirt.host [None req-db658084-2baa-4501-b39a-cb96117b5860 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75045) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 23:44:44 user nova-compute[75045]: DEBUG nova.virt.libvirt.host [None req-db658084-2baa-4501-b39a-cb96117b5860 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] CPU controller found on host. {{(pid=75045) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 23:44:44 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-db658084-2baa-4501-b39a-cb96117b5860 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75045) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 23:44:44 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-db658084-2baa-4501-b39a-cb96117b5860 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T23:11:41Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75045) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 23:44:44 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-db658084-2baa-4501-b39a-cb96117b5860 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Flavor limits 0:0:0 {{(pid=75045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 23:44:44 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-db658084-2baa-4501-b39a-cb96117b5860 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Image limits 0:0:0 {{(pid=75045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 23:44:44 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-db658084-2baa-4501-b39a-cb96117b5860 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Flavor pref 0:0:0 {{(pid=75045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 23:44:44 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-db658084-2baa-4501-b39a-cb96117b5860 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Image pref 0:0:0 {{(pid=75045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 23:44:44 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-db658084-2baa-4501-b39a-cb96117b5860 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 23:44:44 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-db658084-2baa-4501-b39a-cb96117b5860 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75045) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 23:44:44 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-db658084-2baa-4501-b39a-cb96117b5860 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75045) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 23:44:44 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-db658084-2baa-4501-b39a-cb96117b5860 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Got 1 possible topologies {{(pid=75045) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 23:44:44 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-db658084-2baa-4501-b39a-cb96117b5860 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75045) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 23:44:44 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-db658084-2baa-4501-b39a-cb96117b5860 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75045) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 23:44:44 user nova-compute[75045]: DEBUG nova.virt.libvirt.volume.iscsi [None req-db658084-2baa-4501-b39a-cb96117b5860 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] [instance: 37502077-b02b-4f0c-b654-8a6cef607efa] Calling os-brick to attach iSCSI Volume {{(pid=75045) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 23:44:44 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-db658084-2baa-4501-b39a-cb96117b5860 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1b68210460>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:22e58281-41b7-4be2-ace8-0750aa5d18f8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'THBeGdMN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75045) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 23:44:44 user nova-compute[75045]: WARNING os_brick.initiator.connectors.base [None req-db658084-2baa-4501-b39a-cb96117b5860 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 23:44:44 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-db658084-2baa-4501-b39a-cb96117b5860 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 23:44:44 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-db658084-2baa-4501-b39a-cb96117b5860 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 23:44:44 user nova-compute[75045]: WARNING os_brick.initiator.connectors.base [None req-db658084-2baa-4501-b39a-cb96117b5860 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 23:44:44 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-db658084-2baa-4501-b39a-cb96117b5860 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:22e58281-41b7-4be2-ace8-0750aa5d18f8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 23:44:44 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-db658084-2baa-4501-b39a-cb96117b5860 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:22e58281-41b7-4be2-ace8-0750aa5d18f8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 23:44:44 user nova-compute[75045]: INFO os_brick.initiator.connectors.iscsi [None req-db658084-2baa-4501-b39a-cb96117b5860 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 23:44:44 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22e58281-41b7-4be2-ace8-0750aa5d18f8 -p 172.16.0.220:3260 {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:44:44 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22e58281-41b7-4be2-ace8-0750aa5d18f8 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:44:44 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2dd7122-73ce-49da-8b96-3b94f08dab6d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:44:44 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-db658084-2baa-4501-b39a-cb96117b5860 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 23:44:44 user nova-compute[75045]:  {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:44:44 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22e58281-41b7-4be2-ace8-0750aa5d18f8 -p 172.16.0.220:3260 --interface default --op new {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:44:44 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22e58281-41b7-4be2-ace8-0750aa5d18f8 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:44:44 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[b76c4a8c-8310-4366-8add-078211f7185c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:22e58281-41b7-4be2-ace8-0750aa5d18f8] added\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:44:44 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-db658084-2baa-4501-b39a-cb96117b5860 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:22e58281-41b7-4be2-ace8-0750aa5d18f8] added
Nov 08 23:44:44 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:44:44 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22e58281-41b7-4be2-ace8-0750aa5d18f8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:44:44 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22e58281-41b7-4be2-ace8-0750aa5d18f8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:44:44 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[b47655bb-38bf-4de8-b225-63367ec7ebc1]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:44:44 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-db658084-2baa-4501-b39a-cb96117b5860 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:44:44 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22e58281-41b7-4be2-ace8-0750aa5d18f8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:44:44 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22e58281-41b7-4be2-ace8-0750aa5d18f8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:44:44 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[31d93ddd-c6fd-4ac8-b7d5-e72f8d34d1d4]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:44:44 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-db658084-2baa-4501-b39a-cb96117b5860 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:44:44 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22e58281-41b7-4be2-ace8-0750aa5d18f8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v THBeGdMN {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:44:44 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22e58281-41b7-4be2-ace8-0750aa5d18f8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v THBeGdMN" returned: 0 in 0.018s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:44:44 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ff921b8-3fa6-4c07-86ec-083db090c79f]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:44:44 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-db658084-2baa-4501-b39a-cb96117b5860 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'THBeGdMN'): stdout= stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:44:44 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22e58281-41b7-4be2-ace8-0750aa5d18f8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:44:44 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22e58281-41b7-4be2-ace8-0750aa5d18f8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:44:44 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[acc450e2-edf5-41fe-b481-f22e28d410b6]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:44:44 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-db658084-2baa-4501-b39a-cb96117b5860 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:44:44 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:44:44 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:44:44 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[66ccc4dd-1b12-4507-9f0a-b9d1f5fd7958]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7bd77e85-94b5-49aa-8412-c200279e0748 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4186be2-8695-4a3d-a986-2ea74ec001f7 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:adcca529-746a-4b7a-966a-82909ff5b108 (non-flash)\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:44:44 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-db658084-2baa-4501-b39a-cb96117b5860 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7bd77e85-94b5-49aa-8412-c200279e0748 (non-flash)
Nov 08 23:44:44 user nova-compute[75045]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4186be2-8695-4a3d-a986-2ea74ec001f7 (non-flash)
Nov 08 23:44:44 user nova-compute[75045]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:adcca529-746a-4b7a-966a-82909ff5b108 (non-flash)
Nov 08 23:44:44 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 23:44:44 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-db658084-2baa-4501-b39a-cb96117b5860 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7bd77e85-94b5-49aa-8412-c200279e0748 (non-flash)
Nov 08 23:44:44 user nova-compute[75045]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4186be2-8695-4a3d-a986-2ea74ec001f7 (non-flash)
Nov 08 23:44:44 user nova-compute[75045]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:adcca529-746a-4b7a-966a-82909ff5b108 (non-flash)
Nov 08 23:44:44 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 23:44:44 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22e58281-41b7-4be2-ace8-0750aa5d18f8 -p 172.16.0.220:3260 --login {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:44:45 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22e58281-41b7-4be2-ace8-0750aa5d18f8 -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:44:45 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[13648b32-2271-4105-83cf-62f7079a5262]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:22e58281-41b7-4be2-ace8-0750aa5d18f8, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:22e58281-41b7-4be2-ace8-0750aa5d18f8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:44:45 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-db658084-2baa-4501-b39a-cb96117b5860 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:22e58281-41b7-4be2-ace8-0750aa5d18f8, portal: 172.16.0.220,3260]
Nov 08 23:44:45 user nova-compute[75045]: Login to [iface: default, target: iqn.2010-10.org.openstack:22e58281-41b7-4be2-ace8-0750aa5d18f8, portal: 172.16.0.220,3260] successful.
Nov 08 23:44:45 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:44:45 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22e58281-41b7-4be2-ace8-0750aa5d18f8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:44:45 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22e58281-41b7-4be2-ace8-0750aa5d18f8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:44:45 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[218795cc-dfa2-4840-94f1-94149d9112f6]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:44:45 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-db658084-2baa-4501-b39a-cb96117b5860 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:44:45 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:44:45 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:44:45 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef549cc5-4f94-4dd1-b27a-a53b821020bf]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7bd77e85-94b5-49aa-8412-c200279e0748 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4186be2-8695-4a3d-a986-2ea74ec001f7 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:adcca529-746a-4b7a-966a-82909ff5b108 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22e58281-41b7-4be2-ace8-0750aa5d18f8 (non-flash)\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:44:45 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-db658084-2baa-4501-b39a-cb96117b5860 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7bd77e85-94b5-49aa-8412-c200279e0748 (non-flash)
Nov 08 23:44:45 user nova-compute[75045]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4186be2-8695-4a3d-a986-2ea74ec001f7 (non-flash)
Nov 08 23:44:45 user nova-compute[75045]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:adcca529-746a-4b7a-966a-82909ff5b108 (non-flash)
Nov 08 23:44:45 user nova-compute[75045]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22e58281-41b7-4be2-ace8-0750aa5d18f8 (non-flash)
Nov 08 23:44:45 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 23:44:45 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-db658084-2baa-4501-b39a-cb96117b5860 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7bd77e85-94b5-49aa-8412-c200279e0748 (non-flash)
Nov 08 23:44:45 user nova-compute[75045]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4186be2-8695-4a3d-a986-2ea74ec001f7 (non-flash)
Nov 08 23:44:45 user nova-compute[75045]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:adcca529-746a-4b7a-966a-82909ff5b108 (non-flash)
Nov 08 23:44:45 user nova-compute[75045]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22e58281-41b7-4be2-ace8-0750aa5d18f8 (non-flash)
Nov 08 23:44:45 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 23:44:45 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-db658084-2baa-4501-b39a-cb96117b5860 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:22e58281-41b7-4be2-ace8-0750aa5d18f8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.278s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 23:44:45 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-db658084-2baa-4501-b39a-cb96117b5860 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Connected to 172.16.0.220:3260 {{(pid=75045) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 23:44:45 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-db658084-2baa-4501-b39a-cb96117b5860 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] HCTL ('36', '-', '-', 0) found on session 44 with lun 0 {{(pid=75045) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 23:44:45 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-db658084-2baa-4501-b39a-cb96117b5860 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75045) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 23:44:45 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:44:45 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.016s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:44:45 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9031aad-d1a2-4e55-b678-fe38505f370a]: (4, ('- - 0', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:44:45 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-db658084-2baa-4501-b39a-cb96117b5860 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Searching for a device in session 44 and hctl ['36', '*', '*', 0] yield: None {{(pid=75045) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 23:44:46 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-db658084-2baa-4501-b39a-cb96117b5860 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Searching for a device in session 44 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75045) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 23:44:46 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-db658084-2baa-4501-b39a-cb96117b5860 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:22e58281-41b7-4be2-ace8-0750aa5d18f8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'THBeGdMN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75045) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 23:44:46 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-db658084-2baa-4501-b39a-cb96117b5860 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.305s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 23:44:46 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-db658084-2baa-4501-b39a-cb96117b5860 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] <== connect_volume: return (1306ms) {'type': 'block', 'scsi_wwn': '26362626633396337', 'path': '/dev/sde'} {{(pid=75045) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 23:44:46 user nova-compute[75045]: DEBUG nova.virt.libvirt.volume.iscsi [None req-db658084-2baa-4501-b39a-cb96117b5860 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] [instance: 37502077-b02b-4f0c-b654-8a6cef607efa] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26362626633396337', 'path': '/dev/sde'} {{(pid=75045) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 23:44:46 user nova-compute[75045]: DEBUG nova.virt.libvirt.vif [None req-db658084-2baa-4501-b39a-cb96117b5860 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T23:44:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-432636096',display_name='tempest-TestVolumeBootPattern-volume-backed-server-432636096',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-432636096',id=43,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKoDGJ+khbbYLLCYIFd7x7Qal7u4qSpybQqSr2M6pczmVCPlMok23C5m6NcCPsn1HshPot5QEhyZNOrON1L7S3RafUlVsJBSzkbwZFRkm/0WbpemKbWCvoxcxsPdAHyswA==',key_name='tempest-keypair-491363734',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d59b73851c79473a9c2cdc0a120dfee0',ramdisk_id='',reservation_id='r-y1ydxuc6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-650796844',owner_user_name='tempest-TestVolumeBootPattern-650796844-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T23:44:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='76c31c64d9594f9cbef7586fafb48721',uuid=37502077-b02b-4f0c-b654-8a6cef607efa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "30508e27-33e7-40dd-b166-6486da0f0911", "address": "fa:16:3e:3d:90:bb", "network": {"id": "4205f899-9865-4c65-8b46-c9a533e9bb45", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-774780781-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d59b73851c79473a9c2cdc0a120dfee0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30508e27-33", "ovs_interfaceid": "30508e27-33e7-40dd-b166-6486da0f0911", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75045) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 23:44:46 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-db658084-2baa-4501-b39a-cb96117b5860 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Converting VIF {"id": "30508e27-33e7-40dd-b166-6486da0f0911", "address": "fa:16:3e:3d:90:bb", "network": {"id": "4205f899-9865-4c65-8b46-c9a533e9bb45", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-774780781-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d59b73851c79473a9c2cdc0a120dfee0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30508e27-33", "ovs_interfaceid": "30508e27-33e7-40dd-b166-6486da0f0911", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 23:44:46 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-db658084-2baa-4501-b39a-cb96117b5860 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3d:90:bb,bridge_name='br-int',has_traffic_filtering=True,id=30508e27-33e7-40dd-b166-6486da0f0911,network=Network(4205f899-9865-4c65-8b46-c9a533e9bb45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap30508e27-33') {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 23:44:46 user nova-compute[75045]: DEBUG nova.objects.instance [None req-db658084-2baa-4501-b39a-cb96117b5860 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Lazy-loading 'pci_devices' on Instance uuid 37502077-b02b-4f0c-b654-8a6cef607efa {{(pid=75045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 23:44:46 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-db658084-2baa-4501-b39a-cb96117b5860 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] [instance: 37502077-b02b-4f0c-b654-8a6cef607efa] End _get_guest_xml xml=<domain type="kvm">
Nov 08 23:44:46 user nova-compute[75045]:   <uuid>37502077-b02b-4f0c-b654-8a6cef607efa</uuid>
Nov 08 23:44:46 user nova-compute[75045]:   <name>instance-0000002b</name>
Nov 08 23:44:46 user nova-compute[75045]:   <memory>524288</memory>
Nov 08 23:44:46 user nova-compute[75045]:   <vcpu>1</vcpu>
Nov 08 23:44:46 user nova-compute[75045]:   <metadata>
Nov 08 23:44:46 user nova-compute[75045]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 23:44:46 user nova-compute[75045]:       <nova:package version="0.0.0"/>
Nov 08 23:44:46 user nova-compute[75045]:       <nova:name>tempest-TestVolumeBootPattern-volume-backed-server-432636096</nova:name>
Nov 08 23:44:46 user nova-compute[75045]:       <nova:creationTime>2023-11-08 23:44:44</nova:creationTime>
Nov 08 23:44:46 user nova-compute[75045]:       <nova:flavor name="m1.tiny">
Nov 08 23:44:46 user nova-compute[75045]:         <nova:memory>512</nova:memory>
Nov 08 23:44:46 user nova-compute[75045]:         <nova:disk>1</nova:disk>
Nov 08 23:44:46 user nova-compute[75045]:         <nova:swap>0</nova:swap>
Nov 08 23:44:46 user nova-compute[75045]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 23:44:46 user nova-compute[75045]:         <nova:vcpus>1</nova:vcpus>
Nov 08 23:44:46 user nova-compute[75045]:       </nova:flavor>
Nov 08 23:44:46 user nova-compute[75045]:       <nova:owner>
Nov 08 23:44:46 user nova-compute[75045]:         <nova:user uuid="76c31c64d9594f9cbef7586fafb48721">tempest-TestVolumeBootPattern-650796844-project-member</nova:user>
Nov 08 23:44:46 user nova-compute[75045]:         <nova:project uuid="d59b73851c79473a9c2cdc0a120dfee0">tempest-TestVolumeBootPattern-650796844</nova:project>
Nov 08 23:44:46 user nova-compute[75045]:       </nova:owner>
Nov 08 23:44:46 user nova-compute[75045]:       <nova:ports>
Nov 08 23:44:46 user nova-compute[75045]:         <nova:port uuid="30508e27-33e7-40dd-b166-6486da0f0911">
Nov 08 23:44:46 user nova-compute[75045]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 08 23:44:46 user nova-compute[75045]:         </nova:port>
Nov 08 23:44:46 user nova-compute[75045]:       </nova:ports>
Nov 08 23:44:46 user nova-compute[75045]:     </nova:instance>
Nov 08 23:44:46 user nova-compute[75045]:   </metadata>
Nov 08 23:44:46 user nova-compute[75045]:   <sysinfo type="smbios">
Nov 08 23:44:46 user nova-compute[75045]:     <system>
Nov 08 23:44:46 user nova-compute[75045]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 23:44:46 user nova-compute[75045]:       <entry name="product">OpenStack Nova</entry>
Nov 08 23:44:46 user nova-compute[75045]:       <entry name="version">0.0.0</entry>
Nov 08 23:44:46 user nova-compute[75045]:       <entry name="serial">37502077-b02b-4f0c-b654-8a6cef607efa</entry>
Nov 08 23:44:46 user nova-compute[75045]:       <entry name="uuid">37502077-b02b-4f0c-b654-8a6cef607efa</entry>
Nov 08 23:44:46 user nova-compute[75045]:       <entry name="family">Virtual Machine</entry>
Nov 08 23:44:46 user nova-compute[75045]:     </system>
Nov 08 23:44:46 user nova-compute[75045]:   </sysinfo>
Nov 08 23:44:46 user nova-compute[75045]:   <os>
Nov 08 23:44:46 user nova-compute[75045]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 23:44:46 user nova-compute[75045]:     <boot dev="hd"/>
Nov 08 23:44:46 user nova-compute[75045]:     <smbios mode="sysinfo"/>
Nov 08 23:44:46 user nova-compute[75045]:   </os>
Nov 08 23:44:46 user nova-compute[75045]:   <features>
Nov 08 23:44:46 user nova-compute[75045]:     <acpi/>
Nov 08 23:44:46 user nova-compute[75045]:     <apic/>
Nov 08 23:44:46 user nova-compute[75045]:     <vmcoreinfo/>
Nov 08 23:44:46 user nova-compute[75045]:   </features>
Nov 08 23:44:46 user nova-compute[75045]:   <clock offset="utc">
Nov 08 23:44:46 user nova-compute[75045]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 23:44:46 user nova-compute[75045]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 23:44:46 user nova-compute[75045]:     <timer name="hpet" present="no"/>
Nov 08 23:44:46 user nova-compute[75045]:   </clock>
Nov 08 23:44:46 user nova-compute[75045]:   <cpu mode="custom" match="exact">
Nov 08 23:44:46 user nova-compute[75045]:     <model>Nehalem</model>
Nov 08 23:44:46 user nova-compute[75045]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 23:44:46 user nova-compute[75045]:   </cpu>
Nov 08 23:44:46 user nova-compute[75045]:   <devices>
Nov 08 23:44:46 user nova-compute[75045]:     <disk type="block" device="disk">
Nov 08 23:44:46 user nova-compute[75045]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 23:44:46 user nova-compute[75045]:       <source dev="/dev/sde"/>
Nov 08 23:44:46 user nova-compute[75045]:       <target dev="vda" bus="virtio"/>
Nov 08 23:44:46 user nova-compute[75045]:       <serial>22e58281-41b7-4be2-ace8-0750aa5d18f8</serial>
Nov 08 23:44:46 user nova-compute[75045]:     </disk>
Nov 08 23:44:46 user nova-compute[75045]:     <interface type="ethernet">
Nov 08 23:44:46 user nova-compute[75045]:       <mac address="fa:16:3e:3d:90:bb"/>
Nov 08 23:44:46 user nova-compute[75045]:       <model type="virtio"/>
Nov 08 23:44:46 user nova-compute[75045]:       <mtu size="1442"/>
Nov 08 23:44:46 user nova-compute[75045]:       <target dev="tap30508e27-33"/>
Nov 08 23:44:46 user nova-compute[75045]:     </interface>
Nov 08 23:44:46 user nova-compute[75045]:     <serial type="pty">
Nov 08 23:44:46 user nova-compute[75045]:       <log file="/opt/stack/data/nova/instances/37502077-b02b-4f0c-b654-8a6cef607efa/console.log" append="off"/>
Nov 08 23:44:46 user nova-compute[75045]:     </serial>
Nov 08 23:44:46 user nova-compute[75045]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 23:44:46 user nova-compute[75045]:     <video>
Nov 08 23:44:46 user nova-compute[75045]:       <model type="virtio"/>
Nov 08 23:44:46 user nova-compute[75045]:     </video>
Nov 08 23:44:46 user nova-compute[75045]:     <rng model="virtio">
Nov 08 23:44:46 user nova-compute[75045]:       <backend model="random">/dev/urandom</backend>
Nov 08 23:44:46 user nova-compute[75045]:     </rng>
Nov 08 23:44:46 user nova-compute[75045]:     <controller type="usb" index="0" model="none"/>
Nov 08 23:44:46 user nova-compute[75045]:     <memballoon model="virtio">
Nov 08 23:44:46 user nova-compute[75045]:       <stats period="10"/>
Nov 08 23:44:46 user nova-compute[75045]:     </memballoon>
Nov 08 23:44:46 user nova-compute[75045]:   </devices>
Nov 08 23:44:46 user nova-compute[75045]: </domain>
Nov 08 23:44:46 user nova-compute[75045]:  {{(pid=75045) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 23:44:46 user nova-compute[75045]: DEBUG nova.virt.libvirt.vif [None req-db658084-2baa-4501-b39a-cb96117b5860 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T23:44:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-432636096',display_name='tempest-TestVolumeBootPattern-volume-backed-server-432636096',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-432636096',id=43,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKoDGJ+khbbYLLCYIFd7x7Qal7u4qSpybQqSr2M6pczmVCPlMok23C5m6NcCPsn1HshPot5QEhyZNOrON1L7S3RafUlVsJBSzkbwZFRkm/0WbpemKbWCvoxcxsPdAHyswA==',key_name='tempest-keypair-491363734',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d59b73851c79473a9c2cdc0a120dfee0',ramdisk_id='',reservation_id='r-y1ydxuc6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-650796844',owner_user_name='tempest-TestVolumeBootPattern-650796844-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T23:44:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='76c31c64d9594f9cbef7586fafb48721',uuid=37502077-b02b-4f0c-b654-8a6cef607efa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "30508e27-33e7-40dd-b166-6486da0f0911", "address": "fa:16:3e:3d:90:bb", "network": {"id": "4205f899-9865-4c65-8b46-c9a533e9bb45", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-774780781-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d59b73851c79473a9c2cdc0a120dfee0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30508e27-33", "ovs_interfaceid": "30508e27-33e7-40dd-b166-6486da0f0911", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75045) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 23:44:46 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-db658084-2baa-4501-b39a-cb96117b5860 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Converting VIF {"id": "30508e27-33e7-40dd-b166-6486da0f0911", "address": "fa:16:3e:3d:90:bb", "network": {"id": "4205f899-9865-4c65-8b46-c9a533e9bb45", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-774780781-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d59b73851c79473a9c2cdc0a120dfee0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30508e27-33", "ovs_interfaceid": "30508e27-33e7-40dd-b166-6486da0f0911", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 23:44:46 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-db658084-2baa-4501-b39a-cb96117b5860 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3d:90:bb,bridge_name='br-int',has_traffic_filtering=True,id=30508e27-33e7-40dd-b166-6486da0f0911,network=Network(4205f899-9865-4c65-8b46-c9a533e9bb45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap30508e27-33') {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 23:44:46 user nova-compute[75045]: DEBUG os_vif [None req-db658084-2baa-4501-b39a-cb96117b5860 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3d:90:bb,bridge_name='br-int',has_traffic_filtering=True,id=30508e27-33e7-40dd-b166-6486da0f0911,network=Network(4205f899-9865-4c65-8b46-c9a533e9bb45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap30508e27-33') {{(pid=75045) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 23:44:46 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:44:46 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:44:46 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 23:44:46 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:44:46 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3343d657-f964-5309-b024-21fd99093589', '_type': 'linux-noop'}}, row=False) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:44:46 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:44:46 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 23:44:46 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:44:46 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:44:46 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap30508e27-33, may_exist=True, interface_attrs={}) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:44:46 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap30508e27-33, col_values=(('qos', UUID('33e9682c-7505-4c2f-b38f-ba3772e4d9e9')),), if_exists=True) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:44:46 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap30508e27-33, col_values=(('external_ids', {'iface-id': '30508e27-33e7-40dd-b166-6486da0f0911', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3d:90:bb', 'vm-uuid': '37502077-b02b-4f0c-b654-8a6cef607efa'}),), if_exists=True) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:44:46 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:44:46 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 23:44:46 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:44:46 user nova-compute[75045]: INFO os_vif [None req-db658084-2baa-4501-b39a-cb96117b5860 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3d:90:bb,bridge_name='br-int',has_traffic_filtering=True,id=30508e27-33e7-40dd-b166-6486da0f0911,network=Network(4205f899-9865-4c65-8b46-c9a533e9bb45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap30508e27-33')
Nov 08 23:44:46 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-db658084-2baa-4501-b39a-cb96117b5860 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] No BDM found with device name vda, not building metadata. {{(pid=75045) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 23:44:46 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-db658084-2baa-4501-b39a-cb96117b5860 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] No VIF found with MAC fa:16:3e:3d:90:bb, not building metadata {{(pid=75045) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 23:44:46 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:44:46 user nova-compute[75045]: WARNING nova.virt.libvirt.driver [None req-02c69bbd-03a5-422d-b2e0-183f27cc4088 tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 18c197c4-3000-41b1-83bc-1a781744d539 is timed out.
Nov 08 23:44:46 user nova-compute[75045]: INFO nova.virt.libvirt.driver [None req-02c69bbd-03a5-422d-b2e0-183f27cc4088 tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] Successfully detached device vdb from instance 18c197c4-3000-41b1-83bc-1a781744d539 from the live domain config.
Nov 08 23:44:46 user nova-compute[75045]: DEBUG nova.virt.libvirt.volume.iscsi [None req-02c69bbd-03a5-422d-b2e0-183f27cc4088 tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] [instance: 18c197c4-3000-41b1-83bc-1a781744d539] calling os-brick to detach iSCSI Volume {{(pid=75045) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 23:44:46 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-02c69bbd-03a5-422d-b2e0-183f27cc4088 tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1b68210460>, {'target_iqn': 'iqn.2010-10.org.openstack:e4186be2-8695-4a3d-a986-2ea74ec001f7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GopxYWbz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75045) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 23:44:46 user nova-compute[75045]: WARNING os_brick.initiator.connectors.base [None req-02c69bbd-03a5-422d-b2e0-183f27cc4088 tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 23:44:46 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-02c69bbd-03a5-422d-b2e0-183f27cc4088 tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 23:44:46 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-02c69bbd-03a5-422d-b2e0-183f27cc4088 tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 23:44:46 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:44:46 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:44:46 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b623418-05b9-482e-b285-a626b6b9b95a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:7bd77e85-94b5-49aa-8412-c200279e0748\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e4186be2-8695-4a3d-a986-2ea74ec001f7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:adcca529-746a-4b7a-966a-82909ff5b108\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:22e58281-41b7-4be2-ace8-0750aa5d18f8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:44:46 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-02c69bbd-03a5-422d-b2e0-183f27cc4088 tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 23:44:46 user nova-compute[75045]: No targets found.
Nov 08 23:44:46 user nova-compute[75045]: iSNS:
Nov 08 23:44:46 user nova-compute[75045]: No targets found.
Nov 08 23:44:46 user nova-compute[75045]: STATIC:
Nov 08 23:44:46 user nova-compute[75045]: Target: iqn.2010-10.org.openstack:7bd77e85-94b5-49aa-8412-c200279e0748
Nov 08 23:44:46 user nova-compute[75045]:         Portal: 172.16.0.220:3260,-1
Nov 08 23:44:46 user nova-compute[75045]:                 Iface Name: default
Nov 08 23:44:46 user nova-compute[75045]: Target: iqn.2010-10.org.openstack:e4186be2-8695-4a3d-a986-2ea74ec001f7
Nov 08 23:44:46 user nova-compute[75045]:         Portal: 172.16.0.220:3260,-1
Nov 08 23:44:46 user nova-compute[75045]:                 Iface Name: default
Nov 08 23:44:46 user nova-compute[75045]: Target: iqn.2010-10.org.openstack:adcca529-746a-4b7a-966a-82909ff5b108
Nov 08 23:44:46 user nova-compute[75045]:         Portal: 172.16.0.220:3260,-1
Nov 08 23:44:46 user nova-compute[75045]:                 Iface Name: default
Nov 08 23:44:46 user nova-compute[75045]: Target: iqn.2010-10.org.openstack:22e58281-41b7-4be2-ace8-0750aa5d18f8
Nov 08 23:44:46 user nova-compute[75045]:         Portal: 172.16.0.220:3260,-1
Nov 08 23:44:46 user nova-compute[75045]:                 Iface Name: default
Nov 08 23:44:46 user nova-compute[75045]: FIRMWARE:
Nov 08 23:44:46 user nova-compute[75045]: No targets found.
Nov 08 23:44:46 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 23:44:46 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-02c69bbd-03a5-422d-b2e0-183f27cc4088 tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 23:44:46 user nova-compute[75045]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 23:44:46 user nova-compute[75045]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75045) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 23:44:46 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-02c69bbd-03a5-422d-b2e0-183f27cc4088 tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e4186be2-8695-4a3d-a986-2ea74ec001f7', 0)] {{(pid=75045) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 23:44:46 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:44:47 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:44:47 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[52ac885e-df56-4129-87a0-280292949e75]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:22e58281-41b7-4be2-ace8-0750aa5d18f8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7bd77e85-94b5-49aa-8412-c200279e0748\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:adcca529-746a-4b7a-966a-82909ff5b108\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e4186be2-8695-4a3d-a986-2ea74ec001f7\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:44:47 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:44:47 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:44:47 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[acb2ab2d-13b5-4771-bc0d-b39fed2e8eca]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7bd77e85-94b5-49aa-8412-c200279e0748 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4186be2-8695-4a3d-a986-2ea74ec001f7 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:adcca529-746a-4b7a-966a-82909ff5b108 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22e58281-41b7-4be2-ace8-0750aa5d18f8 (non-flash)\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:44:47 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-02c69bbd-03a5-422d-b2e0-183f27cc4088 tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7bd77e85-94b5-49aa-8412-c200279e0748 (non-flash)
Nov 08 23:44:47 user nova-compute[75045]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4186be2-8695-4a3d-a986-2ea74ec001f7 (non-flash)
Nov 08 23:44:47 user nova-compute[75045]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:adcca529-746a-4b7a-966a-82909ff5b108 (non-flash)
Nov 08 23:44:47 user nova-compute[75045]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22e58281-41b7-4be2-ace8-0750aa5d18f8 (non-flash)
Nov 08 23:44:47 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 23:44:47 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-02c69bbd-03a5-422d-b2e0-183f27cc4088 tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7bd77e85-94b5-49aa-8412-c200279e0748 (non-flash)
Nov 08 23:44:47 user nova-compute[75045]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4186be2-8695-4a3d-a986-2ea74ec001f7 (non-flash)
Nov 08 23:44:47 user nova-compute[75045]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:adcca529-746a-4b7a-966a-82909ff5b108 (non-flash)
Nov 08 23:44:47 user nova-compute[75045]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22e58281-41b7-4be2-ace8-0750aa5d18f8 (non-flash)
Nov 08 23:44:47 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 23:44:47 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-02c69bbd-03a5-422d-b2e0-183f27cc4088 tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1b482197e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e4186be2-8695-4a3d-a986-2ea74ec001f7'): ({'sdc'}, set())}) {{(pid=75045) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 23:44:47 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-02c69bbd-03a5-422d-b2e0-183f27cc4088 tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] Removing single pathed devices sdc {{(pid=75045) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 23:44:47 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:44:47 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:44:47 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[122418a5-0532-4d11-b9a2-b9e98d97d5f0]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:44:47 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:44:47 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:44:47 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[6df5127f-f463-4931-a5af-9d836e9a26b4]: (4, ('ok\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:44:47 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-02c69bbd-03a5-422d-b2e0-183f27cc4088 tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] Flushing IO for device /dev/sdc {{(pid=75045) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 23:44:47 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:44:47 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.012s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:44:47 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[20ddd25f-6bb4-4247-825f-f03f6b9546ce]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:44:47 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-02c69bbd-03a5-422d-b2e0-183f27cc4088 tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75045) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 23:44:47 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:44:47 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.033s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:44:47 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[89edcf6f-5a4d-4238-8ef7-ec387e40d43c]: (4, ('1', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:44:47 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-02c69bbd-03a5-422d-b2e0-183f27cc4088 tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75045) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 23:44:47 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-02c69bbd-03a5-422d-b2e0-183f27cc4088 tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] SCSI volumes sdc have been removed. {{(pid=75045) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 23:44:47 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-02c69bbd-03a5-422d-b2e0-183f27cc4088 tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e4186be2-8695-4a3d-a986-2ea74ec001f7')] {{(pid=75045) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 23:44:47 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4186be2-8695-4a3d-a986-2ea74ec001f7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:44:47 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4186be2-8695-4a3d-a986-2ea74ec001f7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:44:47 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[033ef4b7-b1a9-4926-90f9-5db2535a4af6]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:44:47 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-02c69bbd-03a5-422d-b2e0-183f27cc4088 tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:44:47 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4186be2-8695-4a3d-a986-2ea74ec001f7 -p 172.16.0.220:3260 --logout {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:44:47 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4186be2-8695-4a3d-a986-2ea74ec001f7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:44:47 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[6354d3fc-96ec-444b-ba21-6869c46f2f03]: (4, ('Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:e4186be2-8695-4a3d-a986-2ea74ec001f7, portal: 172.16.0.220,3260]\nLogout of [sid: 42, target: iqn.2010-10.org.openstack:e4186be2-8695-4a3d-a986-2ea74ec001f7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:44:47 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-02c69bbd-03a5-422d-b2e0-183f27cc4088 tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:e4186be2-8695-4a3d-a986-2ea74ec001f7, portal: 172.16.0.220,3260]
Nov 08 23:44:47 user nova-compute[75045]: Logout of [sid: 42, target: iqn.2010-10.org.openstack:e4186be2-8695-4a3d-a986-2ea74ec001f7, portal: 172.16.0.220,3260] successful.
Nov 08 23:44:47 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:44:47 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4186be2-8695-4a3d-a986-2ea74ec001f7 -p 172.16.0.220:3260 --op delete {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:44:47 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4186be2-8695-4a3d-a986-2ea74ec001f7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:44:47 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f11ab20-3678-4341-856f-7d3f0aa6d614]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:44:47 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-02c69bbd-03a5-422d-b2e0-183f27cc4088 tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:44:47 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-02c69bbd-03a5-422d-b2e0-183f27cc4088 tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.276s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 23:44:47 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-02c69bbd-03a5-422d-b2e0-183f27cc4088 tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] <== disconnect_volume: return (278ms) None {{(pid=75045) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 23:44:47 user nova-compute[75045]: DEBUG nova.virt.libvirt.volume.iscsi [None req-02c69bbd-03a5-422d-b2e0-183f27cc4088 tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] [instance: 18c197c4-3000-41b1-83bc-1a781744d539] Disconnected iSCSI Volume {{(pid=75045) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 23:44:47 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:44:47 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:44:47 user nova-compute[75045]: DEBUG nova.compute.manager [req-9277b460-7f39-49da-b211-ab28d67598ad req-fb8ad098-3874-46bc-8b4d-1262ed31642c service nova] [instance: 37502077-b02b-4f0c-b654-8a6cef607efa] Received event network-vif-plugged-30508e27-33e7-40dd-b166-6486da0f0911 {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:44:47 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-9277b460-7f39-49da-b211-ab28d67598ad req-fb8ad098-3874-46bc-8b4d-1262ed31642c service nova] Acquiring lock "37502077-b02b-4f0c-b654-8a6cef607efa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:44:47 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-9277b460-7f39-49da-b211-ab28d67598ad req-fb8ad098-3874-46bc-8b4d-1262ed31642c service nova] Lock "37502077-b02b-4f0c-b654-8a6cef607efa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:44:47 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-9277b460-7f39-49da-b211-ab28d67598ad req-fb8ad098-3874-46bc-8b4d-1262ed31642c service nova] Lock "37502077-b02b-4f0c-b654-8a6cef607efa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:44:47 user nova-compute[75045]: DEBUG nova.compute.manager [req-9277b460-7f39-49da-b211-ab28d67598ad req-fb8ad098-3874-46bc-8b4d-1262ed31642c service nova] [instance: 37502077-b02b-4f0c-b654-8a6cef607efa] No waiting events found dispatching network-vif-plugged-30508e27-33e7-40dd-b166-6486da0f0911 {{(pid=75045) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 23:44:47 user nova-compute[75045]: WARNING nova.compute.manager [req-9277b460-7f39-49da-b211-ab28d67598ad req-fb8ad098-3874-46bc-8b4d-1262ed31642c service nova] [instance: 37502077-b02b-4f0c-b654-8a6cef607efa] Received unexpected event network-vif-plugged-30508e27-33e7-40dd-b166-6486da0f0911 for instance with vm_state building and task_state spawning.
Nov 08 23:44:48 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:44:48 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:44:48 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:44:48 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:44:48 user nova-compute[75045]: DEBUG nova.objects.instance [None req-02c69bbd-03a5-422d-b2e0-183f27cc4088 tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] Lazy-loading 'flavor' on Instance uuid 18c197c4-3000-41b1-83bc-1a781744d539 {{(pid=75045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 23:44:48 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-02c69bbd-03a5-422d-b2e0-183f27cc4088 tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] Lock "18c197c4-3000-41b1-83bc-1a781744d539" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.965s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:44:48 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-946a737c-e98c-4f9e-9323-425a3350a86d tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] Lock "18c197c4-3000-41b1-83bc-1a781744d539" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 21.817s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:44:48 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-946a737c-e98c-4f9e-9323-425a3350a86d tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] Acquiring lock "18c197c4-3000-41b1-83bc-1a781744d539-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:44:48 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-946a737c-e98c-4f9e-9323-425a3350a86d tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] Lock "18c197c4-3000-41b1-83bc-1a781744d539-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:44:48 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-946a737c-e98c-4f9e-9323-425a3350a86d tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] Lock "18c197c4-3000-41b1-83bc-1a781744d539-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:44:48 user nova-compute[75045]: INFO nova.compute.manager [None req-946a737c-e98c-4f9e-9323-425a3350a86d tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] [instance: 18c197c4-3000-41b1-83bc-1a781744d539] Terminating instance
Nov 08 23:44:48 user nova-compute[75045]: DEBUG nova.compute.manager [None req-946a737c-e98c-4f9e-9323-425a3350a86d tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] [instance: 18c197c4-3000-41b1-83bc-1a781744d539] Start destroying the instance on the hypervisor. {{(pid=75045) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 23:44:48 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:44:48 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:44:48 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:44:48 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:44:48 user nova-compute[75045]: DEBUG nova.compute.manager [req-604e9af5-6860-4808-bc13-5c6a628abd68 req-04bf00e1-09ef-4412-b9b9-50cfd23557f9 service nova] [instance: 18c197c4-3000-41b1-83bc-1a781744d539] Received event network-vif-unplugged-d4920cf3-7fe0-47b8-8152-ffbf84b286f3 {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:44:48 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-604e9af5-6860-4808-bc13-5c6a628abd68 req-04bf00e1-09ef-4412-b9b9-50cfd23557f9 service nova] Acquiring lock "18c197c4-3000-41b1-83bc-1a781744d539-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:44:48 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-604e9af5-6860-4808-bc13-5c6a628abd68 req-04bf00e1-09ef-4412-b9b9-50cfd23557f9 service nova] Lock "18c197c4-3000-41b1-83bc-1a781744d539-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:44:48 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-604e9af5-6860-4808-bc13-5c6a628abd68 req-04bf00e1-09ef-4412-b9b9-50cfd23557f9 service nova] Lock "18c197c4-3000-41b1-83bc-1a781744d539-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:44:48 user nova-compute[75045]: DEBUG nova.compute.manager [req-604e9af5-6860-4808-bc13-5c6a628abd68 req-04bf00e1-09ef-4412-b9b9-50cfd23557f9 service nova] [instance: 18c197c4-3000-41b1-83bc-1a781744d539] No waiting events found dispatching network-vif-unplugged-d4920cf3-7fe0-47b8-8152-ffbf84b286f3 {{(pid=75045) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 23:44:48 user nova-compute[75045]: DEBUG nova.compute.manager [req-604e9af5-6860-4808-bc13-5c6a628abd68 req-04bf00e1-09ef-4412-b9b9-50cfd23557f9 service nova] [instance: 18c197c4-3000-41b1-83bc-1a781744d539] Received event network-vif-unplugged-d4920cf3-7fe0-47b8-8152-ffbf84b286f3 for instance with task_state deleting. {{(pid=75045) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 23:44:49 user nova-compute[75045]: INFO nova.virt.libvirt.driver [-] [instance: 18c197c4-3000-41b1-83bc-1a781744d539] Instance destroyed successfully.
Nov 08 23:44:49 user nova-compute[75045]: DEBUG nova.objects.instance [None req-946a737c-e98c-4f9e-9323-425a3350a86d tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] Lazy-loading 'resources' on Instance uuid 18c197c4-3000-41b1-83bc-1a781744d539 {{(pid=75045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 23:44:49 user nova-compute[75045]: DEBUG nova.virt.libvirt.vif [None req-946a737c-e98c-4f9e-9323-425a3350a86d tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T23:40:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1233696084',display_name='tempest-VolumesSnapshotTestJSON-instance-1233696084',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1233696084',id=40,image_ref='a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCS4z4QBFYKoXHC/wFU3UjpMZeNuyhOfm9DXpNFYEZInpn0lJvXKfCpKbXSDCVrdREuVhBjtgx20kiTIr8mHzBSymT7p0sC/HW0d1V8zjS+EyY+Krdm7eqFhYovhMGtWdA==',key_name='tempest-keypair-1067954917',keypairs=<?>,launch_index=0,launched_at=2023-11-08T23:40:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4f374e5f34c3464fb6f1f82f5d836c57',ramdisk_id='',reservation_id='r-qhv710p5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-814421851',owner_user_name='tempest-VolumesSnapshotTestJSON-814421851-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T23:40:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a46e4d0d14c44ec6945c3ce972031a35',uuid=18c197c4-3000-41b1-83bc-1a781744d539,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d4920cf3-7fe0-47b8-8152-ffbf84b286f3", "address": "fa:16:3e:1a:51:25", "network": {"id": "ec929af3-f098-4338-943c-d13305d4d555", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-208938347-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.142", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f374e5f34c3464fb6f1f82f5d836c57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4920cf3-7f", "ovs_interfaceid": "d4920cf3-7fe0-47b8-8152-ffbf84b286f3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75045) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 23:44:49 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-946a737c-e98c-4f9e-9323-425a3350a86d tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] Converting VIF {"id": "d4920cf3-7fe0-47b8-8152-ffbf84b286f3", "address": "fa:16:3e:1a:51:25", "network": {"id": "ec929af3-f098-4338-943c-d13305d4d555", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-208938347-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.142", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f374e5f34c3464fb6f1f82f5d836c57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4920cf3-7f", "ovs_interfaceid": "d4920cf3-7fe0-47b8-8152-ffbf84b286f3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 23:44:49 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-946a737c-e98c-4f9e-9323-425a3350a86d tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1a:51:25,bridge_name='br-int',has_traffic_filtering=True,id=d4920cf3-7fe0-47b8-8152-ffbf84b286f3,network=Network(ec929af3-f098-4338-943c-d13305d4d555),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd4920cf3-7f') {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 23:44:49 user nova-compute[75045]: DEBUG os_vif [None req-946a737c-e98c-4f9e-9323-425a3350a86d tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:1a:51:25,bridge_name='br-int',has_traffic_filtering=True,id=d4920cf3-7fe0-47b8-8152-ffbf84b286f3,network=Network(ec929af3-f098-4338-943c-d13305d4d555),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd4920cf3-7f') {{(pid=75045) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 23:44:49 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:44:49 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd4920cf3-7f, bridge=br-int, if_exists=True) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:44:49 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:44:49 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 23:44:49 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:44:49 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:44:49 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=20ea0ebc-2d6c-4724-aa33-f4c806f4f811) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:44:49 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:44:49 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 23:44:49 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:44:49 user nova-compute[75045]: INFO os_vif [None req-946a737c-e98c-4f9e-9323-425a3350a86d tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:1a:51:25,bridge_name='br-int',has_traffic_filtering=True,id=d4920cf3-7fe0-47b8-8152-ffbf84b286f3,network=Network(ec929af3-f098-4338-943c-d13305d4d555),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd4920cf3-7f')
Nov 08 23:44:49 user nova-compute[75045]: DEBUG nova.virt.libvirt.volume.iscsi [None req-946a737c-e98c-4f9e-9323-425a3350a86d tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] [instance: 18c197c4-3000-41b1-83bc-1a781744d539] calling os-brick to detach iSCSI Volume {{(pid=75045) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 23:44:49 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-946a737c-e98c-4f9e-9323-425a3350a86d tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1b68210460>, {'target_iqn': 'iqn.2010-10.org.openstack:e4186be2-8695-4a3d-a986-2ea74ec001f7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GopxYWbz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75045) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 23:44:49 user nova-compute[75045]: WARNING os_brick.initiator.connectors.base [None req-946a737c-e98c-4f9e-9323-425a3350a86d tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 23:44:49 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-946a737c-e98c-4f9e-9323-425a3350a86d tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 23:44:49 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-946a737c-e98c-4f9e-9323-425a3350a86d tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 23:44:49 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:44:49 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:44:49 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e7ebb75-0268-495b-99f4-40c014f3b6be]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:7bd77e85-94b5-49aa-8412-c200279e0748\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:adcca529-746a-4b7a-966a-82909ff5b108\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:22e58281-41b7-4be2-ace8-0750aa5d18f8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:44:49 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-946a737c-e98c-4f9e-9323-425a3350a86d tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 23:44:49 user nova-compute[75045]: No targets found.
Nov 08 23:44:49 user nova-compute[75045]: iSNS:
Nov 08 23:44:49 user nova-compute[75045]: No targets found.
Nov 08 23:44:49 user nova-compute[75045]: STATIC:
Nov 08 23:44:49 user nova-compute[75045]: Target: iqn.2010-10.org.openstack:7bd77e85-94b5-49aa-8412-c200279e0748
Nov 08 23:44:49 user nova-compute[75045]:         Portal: 172.16.0.220:3260,-1
Nov 08 23:44:49 user nova-compute[75045]:                 Iface Name: default
Nov 08 23:44:49 user nova-compute[75045]: Target: iqn.2010-10.org.openstack:adcca529-746a-4b7a-966a-82909ff5b108
Nov 08 23:44:49 user nova-compute[75045]:         Portal: 172.16.0.220:3260,-1
Nov 08 23:44:49 user nova-compute[75045]:                 Iface Name: default
Nov 08 23:44:49 user nova-compute[75045]: Target: iqn.2010-10.org.openstack:22e58281-41b7-4be2-ace8-0750aa5d18f8
Nov 08 23:44:49 user nova-compute[75045]:         Portal: 172.16.0.220:3260,-1
Nov 08 23:44:49 user nova-compute[75045]:                 Iface Name: default
Nov 08 23:44:49 user nova-compute[75045]: FIRMWARE:
Nov 08 23:44:49 user nova-compute[75045]: No targets found.
Nov 08 23:44:49 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 23:44:49 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-946a737c-e98c-4f9e-9323-425a3350a86d tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 23:44:49 user nova-compute[75045]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 23:44:49 user nova-compute[75045]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75045) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 23:44:49 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-946a737c-e98c-4f9e-9323-425a3350a86d tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e4186be2-8695-4a3d-a986-2ea74ec001f7', 0)] {{(pid=75045) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 23:44:49 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:44:49 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:44:49 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[29ce0787-7581-4344-bf1f-0832fec5b20f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:22e58281-41b7-4be2-ace8-0750aa5d18f8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7bd77e85-94b5-49aa-8412-c200279e0748\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:adcca529-746a-4b7a-966a-82909ff5b108\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:44:49 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:44:49 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:44:49 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ca655d4-4b18-4b8c-88d0-cf244102983f]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7bd77e85-94b5-49aa-8412-c200279e0748 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:adcca529-746a-4b7a-966a-82909ff5b108 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22e58281-41b7-4be2-ace8-0750aa5d18f8 (non-flash)\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:44:49 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-946a737c-e98c-4f9e-9323-425a3350a86d tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7bd77e85-94b5-49aa-8412-c200279e0748 (non-flash)
Nov 08 23:44:49 user nova-compute[75045]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:adcca529-746a-4b7a-966a-82909ff5b108 (non-flash)
Nov 08 23:44:49 user nova-compute[75045]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22e58281-41b7-4be2-ace8-0750aa5d18f8 (non-flash)
Nov 08 23:44:49 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 23:44:49 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-946a737c-e98c-4f9e-9323-425a3350a86d tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7bd77e85-94b5-49aa-8412-c200279e0748 (non-flash)
Nov 08 23:44:49 user nova-compute[75045]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:adcca529-746a-4b7a-966a-82909ff5b108 (non-flash)
Nov 08 23:44:49 user nova-compute[75045]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22e58281-41b7-4be2-ace8-0750aa5d18f8 (non-flash)
Nov 08 23:44:49 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 23:44:49 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-946a737c-e98c-4f9e-9323-425a3350a86d tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1b484783a0>, {}) {{(pid=75045) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 23:44:49 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-946a737c-e98c-4f9e-9323-425a3350a86d tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] Disconnecting from: [] {{(pid=75045) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 23:44:49 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-946a737c-e98c-4f9e-9323-425a3350a86d tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.073s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 23:44:49 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-946a737c-e98c-4f9e-9323-425a3350a86d tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] <== disconnect_volume: return (74ms) None {{(pid=75045) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 23:44:49 user nova-compute[75045]: DEBUG nova.virt.libvirt.volume.iscsi [None req-946a737c-e98c-4f9e-9323-425a3350a86d tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] [instance: 18c197c4-3000-41b1-83bc-1a781744d539] Disconnected iSCSI Volume {{(pid=75045) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 23:44:49 user nova-compute[75045]: INFO nova.virt.libvirt.driver [None req-946a737c-e98c-4f9e-9323-425a3350a86d tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] [instance: 18c197c4-3000-41b1-83bc-1a781744d539] Deleting instance files /opt/stack/data/nova/instances/18c197c4-3000-41b1-83bc-1a781744d539_del
Nov 08 23:44:49 user nova-compute[75045]: INFO nova.virt.libvirt.driver [None req-946a737c-e98c-4f9e-9323-425a3350a86d tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] [instance: 18c197c4-3000-41b1-83bc-1a781744d539] Deletion of /opt/stack/data/nova/instances/18c197c4-3000-41b1-83bc-1a781744d539_del complete
Nov 08 23:44:49 user nova-compute[75045]: INFO nova.compute.manager [None req-946a737c-e98c-4f9e-9323-425a3350a86d tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] [instance: 18c197c4-3000-41b1-83bc-1a781744d539] Took 0.95 seconds to destroy the instance on the hypervisor.
Nov 08 23:44:49 user nova-compute[75045]: DEBUG oslo.service.loopingcall [None req-946a737c-e98c-4f9e-9323-425a3350a86d tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75045) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 23:44:49 user nova-compute[75045]: DEBUG nova.compute.manager [-] [instance: 18c197c4-3000-41b1-83bc-1a781744d539] Deallocating network for instance {{(pid=75045) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 23:44:49 user nova-compute[75045]: DEBUG nova.network.neutron [-] [instance: 18c197c4-3000-41b1-83bc-1a781744d539] deallocate_for_instance() {{(pid=75045) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 23:44:49 user nova-compute[75045]: DEBUG nova.compute.manager [None req-db658084-2baa-4501-b39a-cb96117b5860 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] [instance: 37502077-b02b-4f0c-b654-8a6cef607efa] Instance event wait completed in 0 seconds for  {{(pid=75045) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 23:44:49 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-db658084-2baa-4501-b39a-cb96117b5860 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] [instance: 37502077-b02b-4f0c-b654-8a6cef607efa] Guest created on hypervisor {{(pid=75045) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 23:44:49 user nova-compute[75045]: INFO nova.virt.libvirt.driver [-] [instance: 37502077-b02b-4f0c-b654-8a6cef607efa] Instance spawned successfully.
Nov 08 23:44:49 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-db658084-2baa-4501-b39a-cb96117b5860 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] [instance: 37502077-b02b-4f0c-b654-8a6cef607efa] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75045) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 23:44:49 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-db658084-2baa-4501-b39a-cb96117b5860 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] [instance: 37502077-b02b-4f0c-b654-8a6cef607efa] Found default for hw_cdrom_bus of ide {{(pid=75045) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 23:44:49 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-db658084-2baa-4501-b39a-cb96117b5860 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] [instance: 37502077-b02b-4f0c-b654-8a6cef607efa] Found default for hw_disk_bus of virtio {{(pid=75045) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 23:44:49 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-db658084-2baa-4501-b39a-cb96117b5860 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] [instance: 37502077-b02b-4f0c-b654-8a6cef607efa] Found default for hw_input_bus of None {{(pid=75045) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 23:44:49 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-db658084-2baa-4501-b39a-cb96117b5860 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] [instance: 37502077-b02b-4f0c-b654-8a6cef607efa] Found default for hw_pointer_model of None {{(pid=75045) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 23:44:49 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-db658084-2baa-4501-b39a-cb96117b5860 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] [instance: 37502077-b02b-4f0c-b654-8a6cef607efa] Found default for hw_video_model of virtio {{(pid=75045) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 23:44:49 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-db658084-2baa-4501-b39a-cb96117b5860 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] [instance: 37502077-b02b-4f0c-b654-8a6cef607efa] Found default for hw_vif_model of virtio {{(pid=75045) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 23:44:49 user nova-compute[75045]: INFO nova.compute.manager [None req-db658084-2baa-4501-b39a-cb96117b5860 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] [instance: 37502077-b02b-4f0c-b654-8a6cef607efa] Took 5.07 seconds to spawn the instance on the hypervisor.
Nov 08 23:44:49 user nova-compute[75045]: DEBUG nova.compute.manager [None req-db658084-2baa-4501-b39a-cb96117b5860 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] [instance: 37502077-b02b-4f0c-b654-8a6cef607efa] Checking state {{(pid=75045) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 23:44:49 user nova-compute[75045]: DEBUG nova.compute.manager [req-6a131144-1251-449b-9b45-75d8f3fda7d3 req-564b4545-7658-4b21-9bad-fe925afb9b82 service nova] [instance: 37502077-b02b-4f0c-b654-8a6cef607efa] Received event network-vif-plugged-30508e27-33e7-40dd-b166-6486da0f0911 {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:44:49 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-6a131144-1251-449b-9b45-75d8f3fda7d3 req-564b4545-7658-4b21-9bad-fe925afb9b82 service nova] Acquiring lock "37502077-b02b-4f0c-b654-8a6cef607efa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:44:49 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-6a131144-1251-449b-9b45-75d8f3fda7d3 req-564b4545-7658-4b21-9bad-fe925afb9b82 service nova] Lock "37502077-b02b-4f0c-b654-8a6cef607efa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:44:49 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-6a131144-1251-449b-9b45-75d8f3fda7d3 req-564b4545-7658-4b21-9bad-fe925afb9b82 service nova] Lock "37502077-b02b-4f0c-b654-8a6cef607efa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:44:49 user nova-compute[75045]: DEBUG nova.compute.manager [req-6a131144-1251-449b-9b45-75d8f3fda7d3 req-564b4545-7658-4b21-9bad-fe925afb9b82 service nova] [instance: 37502077-b02b-4f0c-b654-8a6cef607efa] No waiting events found dispatching network-vif-plugged-30508e27-33e7-40dd-b166-6486da0f0911 {{(pid=75045) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 23:44:49 user nova-compute[75045]: WARNING nova.compute.manager [req-6a131144-1251-449b-9b45-75d8f3fda7d3 req-564b4545-7658-4b21-9bad-fe925afb9b82 service nova] [instance: 37502077-b02b-4f0c-b654-8a6cef607efa] Received unexpected event network-vif-plugged-30508e27-33e7-40dd-b166-6486da0f0911 for instance with vm_state building and task_state spawning.
Nov 08 23:44:49 user nova-compute[75045]: INFO nova.compute.manager [None req-db658084-2baa-4501-b39a-cb96117b5860 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] [instance: 37502077-b02b-4f0c-b654-8a6cef607efa] Took 47.45 seconds to build instance.
Nov 08 23:44:49 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-db658084-2baa-4501-b39a-cb96117b5860 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Lock "37502077-b02b-4f0c-b654-8a6cef607efa" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 47.554s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:44:50 user nova-compute[75045]: DEBUG nova.network.neutron [-] [instance: 18c197c4-3000-41b1-83bc-1a781744d539] Updating instance_info_cache with network_info: [] {{(pid=75045) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 23:44:50 user nova-compute[75045]: INFO nova.compute.manager [-] [instance: 18c197c4-3000-41b1-83bc-1a781744d539] Took 0.84 seconds to deallocate network for instance.
Nov 08 23:44:50 user nova-compute[75045]: WARNING nova.volume.cinder [None req-946a737c-e98c-4f9e-9323-425a3350a86d tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] Attachment 22e5fc6c-8746-4dd5-b8ac-dd92762ef734 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 22e5fc6c-8746-4dd5-b8ac-dd92762ef734. (HTTP 404) (Request-ID: req-2c67a980-50f2-46ee-bad5-9a549ad7746e)
Nov 08 23:44:50 user nova-compute[75045]: INFO nova.compute.manager [None req-946a737c-e98c-4f9e-9323-425a3350a86d tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] [instance: 18c197c4-3000-41b1-83bc-1a781744d539] Took 0.02 seconds to detach 1 volumes for instance.
Nov 08 23:44:50 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-946a737c-e98c-4f9e-9323-425a3350a86d tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:44:50 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-946a737c-e98c-4f9e-9323-425a3350a86d tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:44:50 user nova-compute[75045]: DEBUG nova.compute.provider_tree [None req-946a737c-e98c-4f9e-9323-425a3350a86d tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] Inventory has not changed in ProviderTree for provider: 62ba5f85-c74d-4b58-986e-d4197e813fd7 {{(pid=75045) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 23:44:50 user nova-compute[75045]: DEBUG nova.scheduler.client.report [None req-946a737c-e98c-4f9e-9323-425a3350a86d tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] Inventory has not changed for provider 62ba5f85-c74d-4b58-986e-d4197e813fd7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75045) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 23:44:50 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-946a737c-e98c-4f9e-9323-425a3350a86d tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.209s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:44:50 user nova-compute[75045]: INFO nova.scheduler.client.report [None req-946a737c-e98c-4f9e-9323-425a3350a86d tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] Deleted allocations for instance 18c197c4-3000-41b1-83bc-1a781744d539
Nov 08 23:44:50 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-946a737c-e98c-4f9e-9323-425a3350a86d tempest-VolumesSnapshotTestJSON-814421851 tempest-VolumesSnapshotTestJSON-814421851-project-member] Lock "18c197c4-3000-41b1-83bc-1a781744d539" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.220s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:44:50 user nova-compute[75045]: DEBUG nova.compute.manager [req-4cab9528-ef4d-4e0b-a74b-983e179ccfba req-9326cb44-b4e0-43d2-a146-bb9e67927f4b service nova] [instance: 18c197c4-3000-41b1-83bc-1a781744d539] Received event network-vif-plugged-d4920cf3-7fe0-47b8-8152-ffbf84b286f3 {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:44:50 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-4cab9528-ef4d-4e0b-a74b-983e179ccfba req-9326cb44-b4e0-43d2-a146-bb9e67927f4b service nova] Acquiring lock "18c197c4-3000-41b1-83bc-1a781744d539-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:44:50 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-4cab9528-ef4d-4e0b-a74b-983e179ccfba req-9326cb44-b4e0-43d2-a146-bb9e67927f4b service nova] Lock "18c197c4-3000-41b1-83bc-1a781744d539-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:44:50 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-4cab9528-ef4d-4e0b-a74b-983e179ccfba req-9326cb44-b4e0-43d2-a146-bb9e67927f4b service nova] Lock "18c197c4-3000-41b1-83bc-1a781744d539-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:44:50 user nova-compute[75045]: DEBUG nova.compute.manager [req-4cab9528-ef4d-4e0b-a74b-983e179ccfba req-9326cb44-b4e0-43d2-a146-bb9e67927f4b service nova] [instance: 18c197c4-3000-41b1-83bc-1a781744d539] No waiting events found dispatching network-vif-plugged-d4920cf3-7fe0-47b8-8152-ffbf84b286f3 {{(pid=75045) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 23:44:50 user nova-compute[75045]: WARNING nova.compute.manager [req-4cab9528-ef4d-4e0b-a74b-983e179ccfba req-9326cb44-b4e0-43d2-a146-bb9e67927f4b service nova] [instance: 18c197c4-3000-41b1-83bc-1a781744d539] Received unexpected event network-vif-plugged-d4920cf3-7fe0-47b8-8152-ffbf84b286f3 for instance with vm_state deleted and task_state None.
Nov 08 23:44:51 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:44:51 user nova-compute[75045]: DEBUG nova.compute.manager [req-d12d29a1-aa05-42ac-98b9-47ed432588d3 req-25d63b89-79ab-4631-afe4-7c245d89db44 service nova] [instance: 18c197c4-3000-41b1-83bc-1a781744d539] Received event network-vif-deleted-d4920cf3-7fe0-47b8-8152-ffbf84b286f3 {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:44:53 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:44:53 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:44:53 user nova-compute[75045]: DEBUG nova.compute.manager [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Starting heal instance info cache {{(pid=75045) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 23:44:53 user nova-compute[75045]: DEBUG nova.compute.manager [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Rebuilding the list of instances to heal {{(pid=75045) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 08 23:44:53 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Acquiring lock "refresh_cache-244c4cc9-2837-40c9-b4ad-37dc435c9749" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 23:44:53 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Acquired lock "refresh_cache-244c4cc9-2837-40c9-b4ad-37dc435c9749" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 23:44:53 user nova-compute[75045]: DEBUG nova.network.neutron [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] [instance: 244c4cc9-2837-40c9-b4ad-37dc435c9749] Forcefully refreshing network info cache for instance {{(pid=75045) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 23:44:53 user nova-compute[75045]: DEBUG nova.objects.instance [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Lazy-loading 'info_cache' on Instance uuid 244c4cc9-2837-40c9-b4ad-37dc435c9749 {{(pid=75045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 23:44:54 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:44:54 user nova-compute[75045]: DEBUG nova.network.neutron [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] [instance: 244c4cc9-2837-40c9-b4ad-37dc435c9749] Updating instance_info_cache with network_info: [{"id": "a5a35e2b-77b5-4f76-a70a-0088652c0420", "address": "fa:16:3e:9f:19:4e", "network": {"id": "eac8b567-0d31-42ec-b05d-2ca251612286", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1889897935-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "61c8f99e9d284b51bbf7bbf6bdfb8662", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5a35e2b-77", "ovs_interfaceid": "a5a35e2b-77b5-4f76-a70a-0088652c0420", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75045) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 23:44:54 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Releasing lock "refresh_cache-244c4cc9-2837-40c9-b4ad-37dc435c9749" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 23:44:54 user nova-compute[75045]: DEBUG nova.compute.manager [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] [instance: 244c4cc9-2837-40c9-b4ad-37dc435c9749] Updated the network info_cache for instance {{(pid=75045) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 23:44:54 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:44:54 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:44:54 user nova-compute[75045]: DEBUG nova.compute.manager [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75045) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 23:44:55 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:44:56 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-5b7139a3-8f64-46ae-953c-9026df5caf94 tempest-ServerStableDeviceRescueTest-1847572360 tempest-ServerStableDeviceRescueTest-1847572360-project-member] Acquiring lock "7ee587a0-e271-4262-a252-2ccb6c2faecb" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:44:56 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-5b7139a3-8f64-46ae-953c-9026df5caf94 tempest-ServerStableDeviceRescueTest-1847572360 tempest-ServerStableDeviceRescueTest-1847572360-project-member] Lock "7ee587a0-e271-4262-a252-2ccb6c2faecb" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:44:56 user nova-compute[75045]: INFO nova.compute.manager [None req-5b7139a3-8f64-46ae-953c-9026df5caf94 tempest-ServerStableDeviceRescueTest-1847572360 tempest-ServerStableDeviceRescueTest-1847572360-project-member] [instance: 7ee587a0-e271-4262-a252-2ccb6c2faecb] Detaching volume 7bd77e85-94b5-49aa-8412-c200279e0748
Nov 08 23:44:56 user nova-compute[75045]: INFO nova.virt.block_device [None req-5b7139a3-8f64-46ae-953c-9026df5caf94 tempest-ServerStableDeviceRescueTest-1847572360 tempest-ServerStableDeviceRescueTest-1847572360-project-member] [instance: 7ee587a0-e271-4262-a252-2ccb6c2faecb] Attempting to driver detach volume 7bd77e85-94b5-49aa-8412-c200279e0748 from mountpoint /dev/vdb
Nov 08 23:44:56 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-5b7139a3-8f64-46ae-953c-9026df5caf94 tempest-ServerStableDeviceRescueTest-1847572360 tempest-ServerStableDeviceRescueTest-1847572360-project-member] Attempting to detach device vdb from instance 7ee587a0-e271-4262-a252-2ccb6c2faecb from the persistent domain config. {{(pid=75045) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 08 23:44:56 user nova-compute[75045]: DEBUG nova.virt.libvirt.guest [None req-5b7139a3-8f64-46ae-953c-9026df5caf94 tempest-ServerStableDeviceRescueTest-1847572360 tempest-ServerStableDeviceRescueTest-1847572360-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 23:44:56 user nova-compute[75045]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 23:44:56 user nova-compute[75045]:   <source dev="/dev/sdb"/>
Nov 08 23:44:56 user nova-compute[75045]:   <target dev="vdb" bus="virtio"/>
Nov 08 23:44:56 user nova-compute[75045]:   <serial>7bd77e85-94b5-49aa-8412-c200279e0748</serial>
Nov 08 23:44:56 user nova-compute[75045]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 08 23:44:56 user nova-compute[75045]: </disk>
Nov 08 23:44:56 user nova-compute[75045]:  {{(pid=75045) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 23:44:56 user nova-compute[75045]: INFO nova.virt.libvirt.driver [None req-5b7139a3-8f64-46ae-953c-9026df5caf94 tempest-ServerStableDeviceRescueTest-1847572360 tempest-ServerStableDeviceRescueTest-1847572360-project-member] Successfully detached device vdb from instance 7ee587a0-e271-4262-a252-2ccb6c2faecb from the persistent domain config.
Nov 08 23:44:56 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-5b7139a3-8f64-46ae-953c-9026df5caf94 tempest-ServerStableDeviceRescueTest-1847572360 tempest-ServerStableDeviceRescueTest-1847572360-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 7ee587a0-e271-4262-a252-2ccb6c2faecb from the live domain config. {{(pid=75045) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 08 23:44:56 user nova-compute[75045]: DEBUG nova.virt.libvirt.guest [None req-5b7139a3-8f64-46ae-953c-9026df5caf94 tempest-ServerStableDeviceRescueTest-1847572360 tempest-ServerStableDeviceRescueTest-1847572360-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 23:44:56 user nova-compute[75045]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 23:44:56 user nova-compute[75045]:   <source dev="/dev/sdb"/>
Nov 08 23:44:56 user nova-compute[75045]:   <target dev="vdb" bus="virtio"/>
Nov 08 23:44:56 user nova-compute[75045]:   <serial>7bd77e85-94b5-49aa-8412-c200279e0748</serial>
Nov 08 23:44:56 user nova-compute[75045]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 08 23:44:56 user nova-compute[75045]: </disk>
Nov 08 23:44:56 user nova-compute[75045]:  {{(pid=75045) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 23:44:56 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:44:57 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-5b7139a3-8f64-46ae-953c-9026df5caf94 tempest-ServerStableDeviceRescueTest-1847572360 tempest-ServerStableDeviceRescueTest-1847572360-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 7ee587a0-e271-4262-a252-2ccb6c2faecb {{(pid=75045) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 08 23:44:57 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:44:57 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:44:59 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:44:59 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:45:01 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager.update_available_resource {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:45:01 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:45:01 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:45:01 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:45:01 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Auditing locally available compute resources for user (node: user) {{(pid=75045) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 23:45:02 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/244c4cc9-2837-40c9-b4ad-37dc435c9749/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:45:02 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/244c4cc9-2837-40c9-b4ad-37dc435c9749/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:45:02 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/244c4cc9-2837-40c9-b4ad-37dc435c9749/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:45:02 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/244c4cc9-2837-40c9-b4ad-37dc435c9749/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:45:02 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75045) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 23:45:02 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ee587a0-e271-4262-a252-2ccb6c2faecb/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:45:02 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ee587a0-e271-4262-a252-2ccb6c2faecb/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:45:02 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ee587a0-e271-4262-a252-2ccb6c2faecb/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:45:02 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ee587a0-e271-4262-a252-2ccb6c2faecb/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:45:02 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b413c71-c13a-4fea-91c4-f6b1953d54c6/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:45:03 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b413c71-c13a-4fea-91c4-f6b1953d54c6/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:45:03 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b413c71-c13a-4fea-91c4-f6b1953d54c6/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:45:03 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b413c71-c13a-4fea-91c4-f6b1953d54c6/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:45:03 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75045) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 23:45:03 user nova-compute[75045]: WARNING nova.virt.libvirt.driver [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 23:45:03 user nova-compute[75045]: WARNING nova.virt.libvirt.driver [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 23:45:03 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Hypervisor/Node resource view: name=user free_ram=8449MB free_disk=24.92593765258789GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75045) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 23:45:03 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:45:03 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:45:03 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Instance 244c4cc9-2837-40c9-b4ad-37dc435c9749 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75045) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 23:45:03 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Instance 7ee587a0-e271-4262-a252-2ccb6c2faecb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75045) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 23:45:03 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Instance 0b413c71-c13a-4fea-91c4-f6b1953d54c6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75045) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 23:45:03 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Instance 37502077-b02b-4f0c-b654-8a6cef607efa actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75045) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 23:45:03 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=75045) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 23:45:03 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=75045) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 23:45:03 user nova-compute[75045]: DEBUG nova.compute.provider_tree [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Inventory has not changed in ProviderTree for provider: 62ba5f85-c74d-4b58-986e-d4197e813fd7 {{(pid=75045) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 23:45:03 user nova-compute[75045]: DEBUG nova.scheduler.client.report [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Inventory has not changed for provider 62ba5f85-c74d-4b58-986e-d4197e813fd7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75045) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 23:45:03 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Compute_service record updated for user:user {{(pid=75045) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 23:45:03 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.277s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:45:04 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:45:06 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:45:09 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:45:11 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:45:13 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-f39a2c40-1aff-410d-8974-6e6b822bc324 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] Acquiring lock "584e3043-addf-41f7-a3cd-de51c229af72" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:45:13 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-f39a2c40-1aff-410d-8974-6e6b822bc324 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] Lock "584e3043-addf-41f7-a3cd-de51c229af72" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:45:13 user nova-compute[75045]: INFO nova.compute.manager [None req-f39a2c40-1aff-410d-8974-6e6b822bc324 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] [instance: 584e3043-addf-41f7-a3cd-de51c229af72] Unshelving
Nov 08 23:45:14 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-f39a2c40-1aff-410d-8974-6e6b822bc324 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:45:14 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-f39a2c40-1aff-410d-8974-6e6b822bc324 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:45:14 user nova-compute[75045]: DEBUG nova.objects.instance [None req-f39a2c40-1aff-410d-8974-6e6b822bc324 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] Lazy-loading 'pci_requests' on Instance uuid 584e3043-addf-41f7-a3cd-de51c229af72 {{(pid=75045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 23:45:14 user nova-compute[75045]: DEBUG nova.objects.instance [None req-f39a2c40-1aff-410d-8974-6e6b822bc324 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] Lazy-loading 'numa_topology' on Instance uuid 584e3043-addf-41f7-a3cd-de51c229af72 {{(pid=75045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 23:45:14 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:45:14 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-f39a2c40-1aff-410d-8974-6e6b822bc324 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75045) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 23:45:14 user nova-compute[75045]: INFO nova.compute.claims [None req-f39a2c40-1aff-410d-8974-6e6b822bc324 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] [instance: 584e3043-addf-41f7-a3cd-de51c229af72] Claim successful on node user
Nov 08 23:45:14 user nova-compute[75045]: DEBUG nova.compute.provider_tree [None req-f39a2c40-1aff-410d-8974-6e6b822bc324 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] Inventory has not changed in ProviderTree for provider: 62ba5f85-c74d-4b58-986e-d4197e813fd7 {{(pid=75045) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 23:45:14 user nova-compute[75045]: DEBUG nova.scheduler.client.report [None req-f39a2c40-1aff-410d-8974-6e6b822bc324 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] Inventory has not changed for provider 62ba5f85-c74d-4b58-986e-d4197e813fd7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75045) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 23:45:14 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-f39a2c40-1aff-410d-8974-6e6b822bc324 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.342s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:45:14 user nova-compute[75045]: INFO nova.network.neutron [None req-f39a2c40-1aff-410d-8974-6e6b822bc324 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] [instance: 584e3043-addf-41f7-a3cd-de51c229af72] Updating port 8b02e567-10f8-4153-88a4-9ce005c1fff3 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Nov 08 23:45:14 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:45:15 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-f39a2c40-1aff-410d-8974-6e6b822bc324 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] Acquiring lock "refresh_cache-584e3043-addf-41f7-a3cd-de51c229af72" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 23:45:15 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-f39a2c40-1aff-410d-8974-6e6b822bc324 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] Acquired lock "refresh_cache-584e3043-addf-41f7-a3cd-de51c229af72" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 23:45:15 user nova-compute[75045]: DEBUG nova.network.neutron [None req-f39a2c40-1aff-410d-8974-6e6b822bc324 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] [instance: 584e3043-addf-41f7-a3cd-de51c229af72] Building network info cache for instance {{(pid=75045) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 23:45:15 user nova-compute[75045]: DEBUG nova.compute.manager [req-e517d60b-3bb5-4797-a243-1fbff2e153ef req-52158b7a-6a57-475f-911e-46925793d02b service nova] [instance: 584e3043-addf-41f7-a3cd-de51c229af72] Received event network-changed-8b02e567-10f8-4153-88a4-9ce005c1fff3 {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:45:15 user nova-compute[75045]: DEBUG nova.compute.manager [req-e517d60b-3bb5-4797-a243-1fbff2e153ef req-52158b7a-6a57-475f-911e-46925793d02b service nova] [instance: 584e3043-addf-41f7-a3cd-de51c229af72] Refreshing instance network info cache due to event network-changed-8b02e567-10f8-4153-88a4-9ce005c1fff3. {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 23:45:15 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-e517d60b-3bb5-4797-a243-1fbff2e153ef req-52158b7a-6a57-475f-911e-46925793d02b service nova] Acquiring lock "refresh_cache-584e3043-addf-41f7-a3cd-de51c229af72" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 23:45:16 user nova-compute[75045]: DEBUG nova.network.neutron [None req-f39a2c40-1aff-410d-8974-6e6b822bc324 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] [instance: 584e3043-addf-41f7-a3cd-de51c229af72] Updating instance_info_cache with network_info: [{"id": "8b02e567-10f8-4153-88a4-9ce005c1fff3", "address": "fa:16:3e:fe:a0:87", "network": {"id": "1b10bc53-ef32-4f01-82f6-ed9f95f7e3f2", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-518782773-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.123", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ad736027d034259a052da3f62bd575f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b02e567-10", "ovs_interfaceid": "8b02e567-10f8-4153-88a4-9ce005c1fff3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75045) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 23:45:16 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-f39a2c40-1aff-410d-8974-6e6b822bc324 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] Releasing lock "refresh_cache-584e3043-addf-41f7-a3cd-de51c229af72" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 23:45:16 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-f39a2c40-1aff-410d-8974-6e6b822bc324 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] [instance: 584e3043-addf-41f7-a3cd-de51c229af72] Creating instance directory {{(pid=75045) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 23:45:16 user nova-compute[75045]: INFO nova.virt.libvirt.driver [None req-f39a2c40-1aff-410d-8974-6e6b822bc324 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] [instance: 584e3043-addf-41f7-a3cd-de51c229af72] Creating image(s)
Nov 08 23:45:16 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-f39a2c40-1aff-410d-8974-6e6b822bc324 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] Acquiring lock "/opt/stack/data/nova/instances/584e3043-addf-41f7-a3cd-de51c229af72/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:45:16 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-f39a2c40-1aff-410d-8974-6e6b822bc324 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] Lock "/opt/stack/data/nova/instances/584e3043-addf-41f7-a3cd-de51c229af72/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:45:16 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-f39a2c40-1aff-410d-8974-6e6b822bc324 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] Lock "/opt/stack/data/nova/instances/584e3043-addf-41f7-a3cd-de51c229af72/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.009s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:45:16 user nova-compute[75045]: DEBUG nova.objects.instance [None req-f39a2c40-1aff-410d-8974-6e6b822bc324 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] Lazy-loading 'trusted_certs' on Instance uuid 584e3043-addf-41f7-a3cd-de51c229af72 {{(pid=75045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 23:45:16 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-e517d60b-3bb5-4797-a243-1fbff2e153ef req-52158b7a-6a57-475f-911e-46925793d02b service nova] Acquired lock "refresh_cache-584e3043-addf-41f7-a3cd-de51c229af72" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 23:45:16 user nova-compute[75045]: DEBUG nova.network.neutron [req-e517d60b-3bb5-4797-a243-1fbff2e153ef req-52158b7a-6a57-475f-911e-46925793d02b service nova] [instance: 584e3043-addf-41f7-a3cd-de51c229af72] Refreshing network info cache for port 8b02e567-10f8-4153-88a4-9ce005c1fff3 {{(pid=75045) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 23:45:16 user nova-compute[75045]: DEBUG nova.objects.base [None req-f39a2c40-1aff-410d-8974-6e6b822bc324 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] Object Instance<584e3043-addf-41f7-a3cd-de51c229af72> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=75045) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 23:45:16 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-f39a2c40-1aff-410d-8974-6e6b822bc324 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] Acquiring lock "2d6c1d7f7f6a4d95550ea70183b8136f63691857" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:45:16 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-f39a2c40-1aff-410d-8974-6e6b822bc324 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] Lock "2d6c1d7f7f6a4d95550ea70183b8136f63691857" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:45:17 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-f39a2c40-1aff-410d-8974-6e6b822bc324 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2d6c1d7f7f6a4d95550ea70183b8136f63691857.part --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:45:17 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:45:17 user nova-compute[75045]: WARNING nova.virt.libvirt.driver [None req-5b7139a3-8f64-46ae-953c-9026df5caf94 tempest-ServerStableDeviceRescueTest-1847572360 tempest-ServerStableDeviceRescueTest-1847572360-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 7ee587a0-e271-4262-a252-2ccb6c2faecb is timed out.
Nov 08 23:45:17 user nova-compute[75045]: INFO nova.virt.libvirt.driver [None req-5b7139a3-8f64-46ae-953c-9026df5caf94 tempest-ServerStableDeviceRescueTest-1847572360 tempest-ServerStableDeviceRescueTest-1847572360-project-member] Successfully detached device vdb from instance 7ee587a0-e271-4262-a252-2ccb6c2faecb from the live domain config.
Nov 08 23:45:17 user nova-compute[75045]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5b7139a3-8f64-46ae-953c-9026df5caf94 tempest-ServerStableDeviceRescueTest-1847572360 tempest-ServerStableDeviceRescueTest-1847572360-project-member] [instance: 7ee587a0-e271-4262-a252-2ccb6c2faecb] calling os-brick to detach iSCSI Volume {{(pid=75045) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 23:45:17 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b7139a3-8f64-46ae-953c-9026df5caf94 tempest-ServerStableDeviceRescueTest-1847572360 tempest-ServerStableDeviceRescueTest-1847572360-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1b68210460>, {'target_iqn': 'iqn.2010-10.org.openstack:7bd77e85-94b5-49aa-8412-c200279e0748', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'deTXjCzh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75045) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 23:45:17 user nova-compute[75045]: WARNING os_brick.initiator.connectors.base [None req-5b7139a3-8f64-46ae-953c-9026df5caf94 tempest-ServerStableDeviceRescueTest-1847572360 tempest-ServerStableDeviceRescueTest-1847572360-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 23:45:17 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-5b7139a3-8f64-46ae-953c-9026df5caf94 tempest-ServerStableDeviceRescueTest-1847572360 tempest-ServerStableDeviceRescueTest-1847572360-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 23:45:17 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-5b7139a3-8f64-46ae-953c-9026df5caf94 tempest-ServerStableDeviceRescueTest-1847572360 tempest-ServerStableDeviceRescueTest-1847572360-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 23:45:17 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:45:17 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:45:17 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[77c8530a-3df5-422d-ab16-63f2f1491c10]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:7bd77e85-94b5-49aa-8412-c200279e0748\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:adcca529-746a-4b7a-966a-82909ff5b108\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:22e58281-41b7-4be2-ace8-0750aa5d18f8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:45:17 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b7139a3-8f64-46ae-953c-9026df5caf94 tempest-ServerStableDeviceRescueTest-1847572360 tempest-ServerStableDeviceRescueTest-1847572360-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 23:45:17 user nova-compute[75045]: No targets found.
Nov 08 23:45:17 user nova-compute[75045]: iSNS:
Nov 08 23:45:17 user nova-compute[75045]: No targets found.
Nov 08 23:45:17 user nova-compute[75045]: STATIC:
Nov 08 23:45:17 user nova-compute[75045]: Target: iqn.2010-10.org.openstack:7bd77e85-94b5-49aa-8412-c200279e0748
Nov 08 23:45:17 user nova-compute[75045]:         Portal: 172.16.0.220:3260,-1
Nov 08 23:45:17 user nova-compute[75045]:                 Iface Name: default
Nov 08 23:45:17 user nova-compute[75045]: Target: iqn.2010-10.org.openstack:adcca529-746a-4b7a-966a-82909ff5b108
Nov 08 23:45:17 user nova-compute[75045]:         Portal: 172.16.0.220:3260,-1
Nov 08 23:45:17 user nova-compute[75045]:                 Iface Name: default
Nov 08 23:45:17 user nova-compute[75045]: Target: iqn.2010-10.org.openstack:22e58281-41b7-4be2-ace8-0750aa5d18f8
Nov 08 23:45:17 user nova-compute[75045]:         Portal: 172.16.0.220:3260,-1
Nov 08 23:45:17 user nova-compute[75045]:                 Iface Name: default
Nov 08 23:45:17 user nova-compute[75045]: FIRMWARE:
Nov 08 23:45:17 user nova-compute[75045]: No targets found.
Nov 08 23:45:17 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 23:45:17 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b7139a3-8f64-46ae-953c-9026df5caf94 tempest-ServerStableDeviceRescueTest-1847572360 tempest-ServerStableDeviceRescueTest-1847572360-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 23:45:17 user nova-compute[75045]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 23:45:17 user nova-compute[75045]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75045) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 23:45:17 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b7139a3-8f64-46ae-953c-9026df5caf94 tempest-ServerStableDeviceRescueTest-1847572360 tempest-ServerStableDeviceRescueTest-1847572360-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7bd77e85-94b5-49aa-8412-c200279e0748', 0)] {{(pid=75045) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 23:45:17 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:45:17 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:45:17 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a3ba370-4212-4e6d-a72a-cb64e043c9ea]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:22e58281-41b7-4be2-ace8-0750aa5d18f8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7bd77e85-94b5-49aa-8412-c200279e0748\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:adcca529-746a-4b7a-966a-82909ff5b108\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:45:17 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:45:17 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:45:17 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[61dba8ed-05d7-4f2b-86da-076dd443e327]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7bd77e85-94b5-49aa-8412-c200279e0748 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:adcca529-746a-4b7a-966a-82909ff5b108 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22e58281-41b7-4be2-ace8-0750aa5d18f8 (non-flash)\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:45:17 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b7139a3-8f64-46ae-953c-9026df5caf94 tempest-ServerStableDeviceRescueTest-1847572360 tempest-ServerStableDeviceRescueTest-1847572360-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7bd77e85-94b5-49aa-8412-c200279e0748 (non-flash)
Nov 08 23:45:17 user nova-compute[75045]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:adcca529-746a-4b7a-966a-82909ff5b108 (non-flash)
Nov 08 23:45:17 user nova-compute[75045]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22e58281-41b7-4be2-ace8-0750aa5d18f8 (non-flash)
Nov 08 23:45:17 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 23:45:17 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b7139a3-8f64-46ae-953c-9026df5caf94 tempest-ServerStableDeviceRescueTest-1847572360 tempest-ServerStableDeviceRescueTest-1847572360-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7bd77e85-94b5-49aa-8412-c200279e0748 (non-flash)
Nov 08 23:45:17 user nova-compute[75045]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:adcca529-746a-4b7a-966a-82909ff5b108 (non-flash)
Nov 08 23:45:17 user nova-compute[75045]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22e58281-41b7-4be2-ace8-0750aa5d18f8 (non-flash)
Nov 08 23:45:17 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 23:45:17 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b7139a3-8f64-46ae-953c-9026df5caf94 tempest-ServerStableDeviceRescueTest-1847572360 tempest-ServerStableDeviceRescueTest-1847572360-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1b6856ba30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7bd77e85-94b5-49aa-8412-c200279e0748'): ({'sdb'}, set())}) {{(pid=75045) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 23:45:17 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-5b7139a3-8f64-46ae-953c-9026df5caf94 tempest-ServerStableDeviceRescueTest-1847572360 tempest-ServerStableDeviceRescueTest-1847572360-project-member] Removing single pathed devices sdb {{(pid=75045) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 23:45:17 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:45:17 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-f39a2c40-1aff-410d-8974-6e6b822bc324 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2d6c1d7f7f6a4d95550ea70183b8136f63691857.part --force-share --output=json" returned: 0 in 0.182s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:45:17 user nova-compute[75045]: DEBUG nova.virt.images [None req-f39a2c40-1aff-410d-8974-6e6b822bc324 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] 75c4ea21-95a9-41b4-97c8-ebe2c3667c78 was qcow2, converting to raw {{(pid=75045) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 08 23:45:17 user nova-compute[75045]: DEBUG nova.privsep.utils [None req-f39a2c40-1aff-410d-8974-6e6b822bc324 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75045) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 08 23:45:17 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-f39a2c40-1aff-410d-8974-6e6b822bc324 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/2d6c1d7f7f6a4d95550ea70183b8136f63691857.part /opt/stack/data/nova/instances/_base/2d6c1d7f7f6a4d95550ea70183b8136f63691857.converted {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:45:17 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:45:17 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0732e62-e32c-49d0-a4ef-a3404e3728eb]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:45:17 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:45:17 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.022s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:45:17 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0dd17c6-0c5e-464d-9999-52f8c6328e8a]: (4, ('ok\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:45:17 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-5b7139a3-8f64-46ae-953c-9026df5caf94 tempest-ServerStableDeviceRescueTest-1847572360 tempest-ServerStableDeviceRescueTest-1847572360-project-member] Flushing IO for device /dev/sdb {{(pid=75045) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 23:45:17 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:45:17 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:45:17 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[41611b7d-1683-4109-866c-80521fe7fa6c]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:45:17 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-5b7139a3-8f64-46ae-953c-9026df5caf94 tempest-ServerStableDeviceRescueTest-1847572360 tempest-ServerStableDeviceRescueTest-1847572360-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75045) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 23:45:17 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:45:17 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.051s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:45:17 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f7102ce-825c-4998-ab5b-551449f81035]: (4, ('1', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:45:17 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-5b7139a3-8f64-46ae-953c-9026df5caf94 tempest-ServerStableDeviceRescueTest-1847572360 tempest-ServerStableDeviceRescueTest-1847572360-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75045) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 23:45:17 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-5b7139a3-8f64-46ae-953c-9026df5caf94 tempest-ServerStableDeviceRescueTest-1847572360 tempest-ServerStableDeviceRescueTest-1847572360-project-member] SCSI volumes sdb have been removed. {{(pid=75045) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 23:45:17 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b7139a3-8f64-46ae-953c-9026df5caf94 tempest-ServerStableDeviceRescueTest-1847572360 tempest-ServerStableDeviceRescueTest-1847572360-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7bd77e85-94b5-49aa-8412-c200279e0748')] {{(pid=75045) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 23:45:17 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7bd77e85-94b5-49aa-8412-c200279e0748 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:45:17 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7bd77e85-94b5-49aa-8412-c200279e0748 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.054s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:45:17 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[82fa6ad9-7a18-4065-8fb0-44002d829cad]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:45:17 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b7139a3-8f64-46ae-953c-9026df5caf94 tempest-ServerStableDeviceRescueTest-1847572360 tempest-ServerStableDeviceRescueTest-1847572360-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:45:17 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7bd77e85-94b5-49aa-8412-c200279e0748 -p 172.16.0.220:3260 --logout {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:45:17 user nova-compute[75045]: DEBUG nova.network.neutron [req-e517d60b-3bb5-4797-a243-1fbff2e153ef req-52158b7a-6a57-475f-911e-46925793d02b service nova] [instance: 584e3043-addf-41f7-a3cd-de51c229af72] Updated VIF entry in instance network info cache for port 8b02e567-10f8-4153-88a4-9ce005c1fff3. {{(pid=75045) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 23:45:17 user nova-compute[75045]: DEBUG nova.network.neutron [req-e517d60b-3bb5-4797-a243-1fbff2e153ef req-52158b7a-6a57-475f-911e-46925793d02b service nova] [instance: 584e3043-addf-41f7-a3cd-de51c229af72] Updating instance_info_cache with network_info: [{"id": "8b02e567-10f8-4153-88a4-9ce005c1fff3", "address": "fa:16:3e:fe:a0:87", "network": {"id": "1b10bc53-ef32-4f01-82f6-ed9f95f7e3f2", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-518782773-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.123", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ad736027d034259a052da3f62bd575f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b02e567-10", "ovs_interfaceid": "8b02e567-10f8-4153-88a4-9ce005c1fff3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75045) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 23:45:17 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-e517d60b-3bb5-4797-a243-1fbff2e153ef req-52158b7a-6a57-475f-911e-46925793d02b service nova] Releasing lock "refresh_cache-584e3043-addf-41f7-a3cd-de51c229af72" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 23:45:17 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-f39a2c40-1aff-410d-8974-6e6b822bc324 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/2d6c1d7f7f6a4d95550ea70183b8136f63691857.part /opt/stack/data/nova/instances/_base/2d6c1d7f7f6a4d95550ea70183b8136f63691857.converted" returned: 0 in 0.350s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:45:17 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-f39a2c40-1aff-410d-8974-6e6b822bc324 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2d6c1d7f7f6a4d95550ea70183b8136f63691857.converted --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:45:17 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7bd77e85-94b5-49aa-8412-c200279e0748 -p 172.16.0.220:3260 --logout" returned: 0 in 0.139s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:45:17 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dfb7d81-4437-408f-bf5d-5b7041a32920]: (4, ('Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:7bd77e85-94b5-49aa-8412-c200279e0748, portal: 172.16.0.220,3260]\nLogout of [sid: 41, target: iqn.2010-10.org.openstack:7bd77e85-94b5-49aa-8412-c200279e0748, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:45:17 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b7139a3-8f64-46ae-953c-9026df5caf94 tempest-ServerStableDeviceRescueTest-1847572360 tempest-ServerStableDeviceRescueTest-1847572360-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:7bd77e85-94b5-49aa-8412-c200279e0748, portal: 172.16.0.220,3260]
Nov 08 23:45:17 user nova-compute[75045]: Logout of [sid: 41, target: iqn.2010-10.org.openstack:7bd77e85-94b5-49aa-8412-c200279e0748, portal: 172.16.0.220,3260] successful.
Nov 08 23:45:17 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:45:17 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7bd77e85-94b5-49aa-8412-c200279e0748 -p 172.16.0.220:3260 --op delete {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:45:17 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7bd77e85-94b5-49aa-8412-c200279e0748 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:45:17 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[746788cd-c103-4c4f-8c90-ebe18f1b1ff7]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:45:17 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b7139a3-8f64-46ae-953c-9026df5caf94 tempest-ServerStableDeviceRescueTest-1847572360 tempest-ServerStableDeviceRescueTest-1847572360-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:45:17 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-5b7139a3-8f64-46ae-953c-9026df5caf94 tempest-ServerStableDeviceRescueTest-1847572360 tempest-ServerStableDeviceRescueTest-1847572360-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.549s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 23:45:17 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b7139a3-8f64-46ae-953c-9026df5caf94 tempest-ServerStableDeviceRescueTest-1847572360 tempest-ServerStableDeviceRescueTest-1847572360-project-member] <== disconnect_volume: return (551ms) None {{(pid=75045) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 23:45:17 user nova-compute[75045]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5b7139a3-8f64-46ae-953c-9026df5caf94 tempest-ServerStableDeviceRescueTest-1847572360 tempest-ServerStableDeviceRescueTest-1847572360-project-member] [instance: 7ee587a0-e271-4262-a252-2ccb6c2faecb] Disconnected iSCSI Volume {{(pid=75045) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 23:45:17 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-f39a2c40-1aff-410d-8974-6e6b822bc324 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2d6c1d7f7f6a4d95550ea70183b8136f63691857.converted --force-share --output=json" returned: 0 in 0.194s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:45:17 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-f39a2c40-1aff-410d-8974-6e6b822bc324 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] Lock "2d6c1d7f7f6a4d95550ea70183b8136f63691857" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.796s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:45:17 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-f39a2c40-1aff-410d-8974-6e6b822bc324 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2d6c1d7f7f6a4d95550ea70183b8136f63691857 --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:45:18 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-f39a2c40-1aff-410d-8974-6e6b822bc324 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2d6c1d7f7f6a4d95550ea70183b8136f63691857 --force-share --output=json" returned: 0 in 0.191s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:45:18 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-f39a2c40-1aff-410d-8974-6e6b822bc324 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] Acquiring lock "2d6c1d7f7f6a4d95550ea70183b8136f63691857" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:45:18 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-f39a2c40-1aff-410d-8974-6e6b822bc324 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] Lock "2d6c1d7f7f6a4d95550ea70183b8136f63691857" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:45:18 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-f39a2c40-1aff-410d-8974-6e6b822bc324 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2d6c1d7f7f6a4d95550ea70183b8136f63691857 --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:45:18 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-f39a2c40-1aff-410d-8974-6e6b822bc324 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2d6c1d7f7f6a4d95550ea70183b8136f63691857 --force-share --output=json" returned: 0 in 0.213s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:45:18 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-f39a2c40-1aff-410d-8974-6e6b822bc324 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2d6c1d7f7f6a4d95550ea70183b8136f63691857,backing_fmt=raw /opt/stack/data/nova/instances/584e3043-addf-41f7-a3cd-de51c229af72/disk 1073741824 {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:45:18 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-f39a2c40-1aff-410d-8974-6e6b822bc324 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2d6c1d7f7f6a4d95550ea70183b8136f63691857,backing_fmt=raw /opt/stack/data/nova/instances/584e3043-addf-41f7-a3cd-de51c229af72/disk 1073741824" returned: 0 in 0.055s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:45:18 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-f39a2c40-1aff-410d-8974-6e6b822bc324 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] Lock "2d6c1d7f7f6a4d95550ea70183b8136f63691857" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.276s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:45:18 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-f39a2c40-1aff-410d-8974-6e6b822bc324 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2d6c1d7f7f6a4d95550ea70183b8136f63691857 --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:45:18 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-f39a2c40-1aff-410d-8974-6e6b822bc324 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2d6c1d7f7f6a4d95550ea70183b8136f63691857 --force-share --output=json" returned: 0 in 0.195s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:45:18 user nova-compute[75045]: DEBUG nova.objects.instance [None req-f39a2c40-1aff-410d-8974-6e6b822bc324 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] Lazy-loading 'migration_context' on Instance uuid 584e3043-addf-41f7-a3cd-de51c229af72 {{(pid=75045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 23:45:18 user nova-compute[75045]: DEBUG nova.objects.base [None req-f39a2c40-1aff-410d-8974-6e6b822bc324 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] Object Instance<584e3043-addf-41f7-a3cd-de51c229af72> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=75045) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 23:45:18 user nova-compute[75045]: INFO nova.virt.libvirt.driver [None req-f39a2c40-1aff-410d-8974-6e6b822bc324 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] [instance: 584e3043-addf-41f7-a3cd-de51c229af72] Rebasing disk image.
Nov 08 23:45:18 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-f39a2c40-1aff-410d-8974-6e6b822bc324 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b59f52a99fff51c56dd1edfb83892fb8f647f2f3 --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:45:18 user nova-compute[75045]: DEBUG nova.objects.instance [None req-5b7139a3-8f64-46ae-953c-9026df5caf94 tempest-ServerStableDeviceRescueTest-1847572360 tempest-ServerStableDeviceRescueTest-1847572360-project-member] Lazy-loading 'flavor' on Instance uuid 7ee587a0-e271-4262-a252-2ccb6c2faecb {{(pid=75045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 23:45:18 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-5b7139a3-8f64-46ae-953c-9026df5caf94 tempest-ServerStableDeviceRescueTest-1847572360 tempest-ServerStableDeviceRescueTest-1847572360-project-member] Lock "7ee587a0-e271-4262-a252-2ccb6c2faecb" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.105s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:45:18 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-f39a2c40-1aff-410d-8974-6e6b822bc324 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b59f52a99fff51c56dd1edfb83892fb8f647f2f3 --force-share --output=json" returned: 0 in 0.181s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:45:18 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-f39a2c40-1aff-410d-8974-6e6b822bc324 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/b59f52a99fff51c56dd1edfb83892fb8f647f2f3 -F raw /opt/stack/data/nova/instances/584e3043-addf-41f7-a3cd-de51c229af72/disk {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:45:19 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:45:20 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-f39a2c40-1aff-410d-8974-6e6b822bc324 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/b59f52a99fff51c56dd1edfb83892fb8f647f2f3 -F raw /opt/stack/data/nova/instances/584e3043-addf-41f7-a3cd-de51c229af72/disk" returned: 0 in 2.067s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:45:20 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-f39a2c40-1aff-410d-8974-6e6b822bc324 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] [instance: 584e3043-addf-41f7-a3cd-de51c229af72] Created local disks {{(pid=75045) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 23:45:20 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-f39a2c40-1aff-410d-8974-6e6b822bc324 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] [instance: 584e3043-addf-41f7-a3cd-de51c229af72] Ensure instance console log exists: /opt/stack/data/nova/instances/584e3043-addf-41f7-a3cd-de51c229af72/console.log {{(pid=75045) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 23:45:20 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-f39a2c40-1aff-410d-8974-6e6b822bc324 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:45:20 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-f39a2c40-1aff-410d-8974-6e6b822bc324 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:45:20 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-f39a2c40-1aff-410d-8974-6e6b822bc324 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:45:20 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-f39a2c40-1aff-410d-8974-6e6b822bc324 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] [instance: 584e3043-addf-41f7-a3cd-de51c229af72] Start _get_guest_xml network_info=[{"id": "8b02e567-10f8-4153-88a4-9ce005c1fff3", "address": "fa:16:3e:fe:a0:87", "network": {"id": "1b10bc53-ef32-4f01-82f6-ed9f95f7e3f2", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-518782773-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.123", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ad736027d034259a052da3f62bd575f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b02e567-10", "ovs_interfaceid": "8b02e567-10f8-4153-88a4-9ce005c1fff3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='5c7e7688c0c6a61c57512d0208a64a78',container_format='bare',created_at=2023-11-08T23:43:21Z,direct_url=<?>,disk_format='qcow2',id=75c4ea21-95a9-41b4-97c8-ebe2c3667c78,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1201717535-shelved',owner='3ad736027d034259a052da3f62bd575f',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-08T23:43:25Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'disk_bus': 'virtio', 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': 'a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75045) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 23:45:20 user nova-compute[75045]: WARNING nova.virt.libvirt.driver [None req-f39a2c40-1aff-410d-8974-6e6b822bc324 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 23:45:20 user nova-compute[75045]: WARNING nova.virt.libvirt.driver [None req-f39a2c40-1aff-410d-8974-6e6b822bc324 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 23:45:20 user nova-compute[75045]: DEBUG nova.virt.libvirt.host [None req-f39a2c40-1aff-410d-8974-6e6b822bc324 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75045) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 23:45:20 user nova-compute[75045]: DEBUG nova.virt.libvirt.host [None req-f39a2c40-1aff-410d-8974-6e6b822bc324 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] CPU controller missing on host. {{(pid=75045) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 23:45:20 user nova-compute[75045]: DEBUG nova.virt.libvirt.host [None req-f39a2c40-1aff-410d-8974-6e6b822bc324 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75045) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 23:45:20 user nova-compute[75045]: DEBUG nova.virt.libvirt.host [None req-f39a2c40-1aff-410d-8974-6e6b822bc324 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] CPU controller found on host. {{(pid=75045) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 23:45:20 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-f39a2c40-1aff-410d-8974-6e6b822bc324 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75045) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 23:45:20 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-f39a2c40-1aff-410d-8974-6e6b822bc324 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T23:11:41Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='5c7e7688c0c6a61c57512d0208a64a78',container_format='bare',created_at=2023-11-08T23:43:21Z,direct_url=<?>,disk_format='qcow2',id=75c4ea21-95a9-41b4-97c8-ebe2c3667c78,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1201717535-shelved',owner='3ad736027d034259a052da3f62bd575f',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-08T23:43:25Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75045) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 23:45:20 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-f39a2c40-1aff-410d-8974-6e6b822bc324 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] Flavor limits 0:0:0 {{(pid=75045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 23:45:20 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-f39a2c40-1aff-410d-8974-6e6b822bc324 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] Image limits 0:0:0 {{(pid=75045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 23:45:20 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-f39a2c40-1aff-410d-8974-6e6b822bc324 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] Flavor pref 0:0:0 {{(pid=75045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 23:45:20 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-f39a2c40-1aff-410d-8974-6e6b822bc324 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] Image pref 0:0:0 {{(pid=75045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 23:45:20 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-f39a2c40-1aff-410d-8974-6e6b822bc324 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 23:45:20 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-f39a2c40-1aff-410d-8974-6e6b822bc324 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75045) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 23:45:20 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-f39a2c40-1aff-410d-8974-6e6b822bc324 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75045) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 23:45:20 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-f39a2c40-1aff-410d-8974-6e6b822bc324 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] Got 1 possible topologies {{(pid=75045) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 23:45:20 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-f39a2c40-1aff-410d-8974-6e6b822bc324 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75045) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 23:45:20 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-f39a2c40-1aff-410d-8974-6e6b822bc324 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75045) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 23:45:20 user nova-compute[75045]: DEBUG nova.objects.instance [None req-f39a2c40-1aff-410d-8974-6e6b822bc324 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] Lazy-loading 'vcpu_model' on Instance uuid 584e3043-addf-41f7-a3cd-de51c229af72 {{(pid=75045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 23:45:20 user nova-compute[75045]: DEBUG nova.objects.base [None req-f39a2c40-1aff-410d-8974-6e6b822bc324 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] Object Instance<584e3043-addf-41f7-a3cd-de51c229af72> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=75045) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 23:45:20 user nova-compute[75045]: DEBUG nova.virt.libvirt.vif [None req-f39a2c40-1aff-410d-8974-6e6b822bc324 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-08T23:41:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1201717535',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1201717535',id=41,image_ref='75c4ea21-95a9-41b4-97c8-ebe2c3667c78',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-2053037695',keypairs=<?>,launch_index=0,launched_at=2023-11-08T23:41:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='3ad736027d034259a052da3f62bd575f',ramdisk_id='',reservation_id='r-km2oh92z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1769593098',owner_user_name='tempest-AttachVolumeShelveTestJSON-1769593098-project-member',shelved_at='2023-11-08T23:43:25.340455',shelved_host='user',shelved_image_id='75c4ea21-95a9-41b4-97c8-ebe2c3667c78'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T23:45:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7a98fe96727741d0b148f3aaa8abf6f1',uuid=584e3043-addf-41f7-a3cd-de51c229af72,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "8b02e567-10f8-4153-88a4-9ce005c1fff3", "address": "fa:16:3e:fe:a0:87", "network": {"id": "1b10bc53-ef32-4f01-82f6-ed9f95f7e3f2", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-518782773-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.123", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ad736027d034259a052da3f62bd575f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b02e567-10", "ovs_interfaceid": "8b02e567-10f8-4153-88a4-9ce005c1fff3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75045) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 23:45:20 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-f39a2c40-1aff-410d-8974-6e6b822bc324 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] Converting VIF {"id": "8b02e567-10f8-4153-88a4-9ce005c1fff3", "address": "fa:16:3e:fe:a0:87", "network": {"id": "1b10bc53-ef32-4f01-82f6-ed9f95f7e3f2", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-518782773-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.123", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ad736027d034259a052da3f62bd575f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b02e567-10", "ovs_interfaceid": "8b02e567-10f8-4153-88a4-9ce005c1fff3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 23:45:20 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-f39a2c40-1aff-410d-8974-6e6b822bc324 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fe:a0:87,bridge_name='br-int',has_traffic_filtering=True,id=8b02e567-10f8-4153-88a4-9ce005c1fff3,network=Network(1b10bc53-ef32-4f01-82f6-ed9f95f7e3f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b02e567-10') {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 23:45:20 user nova-compute[75045]: DEBUG nova.objects.instance [None req-f39a2c40-1aff-410d-8974-6e6b822bc324 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] Lazy-loading 'pci_devices' on Instance uuid 584e3043-addf-41f7-a3cd-de51c229af72 {{(pid=75045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 23:45:20 user nova-compute[75045]: DEBUG nova.objects.base [None req-f39a2c40-1aff-410d-8974-6e6b822bc324 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] Object Instance<584e3043-addf-41f7-a3cd-de51c229af72> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=75045) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 23:45:20 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-f39a2c40-1aff-410d-8974-6e6b822bc324 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] [instance: 584e3043-addf-41f7-a3cd-de51c229af72] End _get_guest_xml xml=<domain type="kvm">
Nov 08 23:45:20 user nova-compute[75045]:   <uuid>584e3043-addf-41f7-a3cd-de51c229af72</uuid>
Nov 08 23:45:20 user nova-compute[75045]:   <name>instance-00000029</name>
Nov 08 23:45:20 user nova-compute[75045]:   <memory>524288</memory>
Nov 08 23:45:20 user nova-compute[75045]:   <vcpu>1</vcpu>
Nov 08 23:45:20 user nova-compute[75045]:   <metadata>
Nov 08 23:45:20 user nova-compute[75045]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 23:45:20 user nova-compute[75045]:       <nova:package version="0.0.0"/>
Nov 08 23:45:20 user nova-compute[75045]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1201717535</nova:name>
Nov 08 23:45:20 user nova-compute[75045]:       <nova:creationTime>2023-11-08 23:45:20</nova:creationTime>
Nov 08 23:45:20 user nova-compute[75045]:       <nova:flavor name="m1.tiny">
Nov 08 23:45:20 user nova-compute[75045]:         <nova:memory>512</nova:memory>
Nov 08 23:45:20 user nova-compute[75045]:         <nova:disk>1</nova:disk>
Nov 08 23:45:20 user nova-compute[75045]:         <nova:swap>0</nova:swap>
Nov 08 23:45:20 user nova-compute[75045]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 23:45:20 user nova-compute[75045]:         <nova:vcpus>1</nova:vcpus>
Nov 08 23:45:20 user nova-compute[75045]:       </nova:flavor>
Nov 08 23:45:20 user nova-compute[75045]:       <nova:owner>
Nov 08 23:45:20 user nova-compute[75045]:         <nova:user uuid="7a98fe96727741d0b148f3aaa8abf6f1">tempest-AttachVolumeShelveTestJSON-1769593098-project-member</nova:user>
Nov 08 23:45:20 user nova-compute[75045]:         <nova:project uuid="3ad736027d034259a052da3f62bd575f">tempest-AttachVolumeShelveTestJSON-1769593098</nova:project>
Nov 08 23:45:20 user nova-compute[75045]:       </nova:owner>
Nov 08 23:45:20 user nova-compute[75045]:       <nova:root type="image" uuid="75c4ea21-95a9-41b4-97c8-ebe2c3667c78"/>
Nov 08 23:45:20 user nova-compute[75045]:       <nova:ports>
Nov 08 23:45:20 user nova-compute[75045]:         <nova:port uuid="8b02e567-10f8-4153-88a4-9ce005c1fff3">
Nov 08 23:45:20 user nova-compute[75045]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 08 23:45:20 user nova-compute[75045]:         </nova:port>
Nov 08 23:45:20 user nova-compute[75045]:       </nova:ports>
Nov 08 23:45:20 user nova-compute[75045]:     </nova:instance>
Nov 08 23:45:20 user nova-compute[75045]:   </metadata>
Nov 08 23:45:20 user nova-compute[75045]:   <sysinfo type="smbios">
Nov 08 23:45:20 user nova-compute[75045]:     <system>
Nov 08 23:45:20 user nova-compute[75045]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 23:45:20 user nova-compute[75045]:       <entry name="product">OpenStack Nova</entry>
Nov 08 23:45:20 user nova-compute[75045]:       <entry name="version">0.0.0</entry>
Nov 08 23:45:20 user nova-compute[75045]:       <entry name="serial">584e3043-addf-41f7-a3cd-de51c229af72</entry>
Nov 08 23:45:20 user nova-compute[75045]:       <entry name="uuid">584e3043-addf-41f7-a3cd-de51c229af72</entry>
Nov 08 23:45:20 user nova-compute[75045]:       <entry name="family">Virtual Machine</entry>
Nov 08 23:45:20 user nova-compute[75045]:     </system>
Nov 08 23:45:20 user nova-compute[75045]:   </sysinfo>
Nov 08 23:45:20 user nova-compute[75045]:   <os>
Nov 08 23:45:20 user nova-compute[75045]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 23:45:20 user nova-compute[75045]:     <boot dev="hd"/>
Nov 08 23:45:20 user nova-compute[75045]:     <smbios mode="sysinfo"/>
Nov 08 23:45:20 user nova-compute[75045]:   </os>
Nov 08 23:45:20 user nova-compute[75045]:   <features>
Nov 08 23:45:20 user nova-compute[75045]:     <acpi/>
Nov 08 23:45:20 user nova-compute[75045]:     <apic/>
Nov 08 23:45:20 user nova-compute[75045]:     <vmcoreinfo/>
Nov 08 23:45:20 user nova-compute[75045]:   </features>
Nov 08 23:45:20 user nova-compute[75045]:   <clock offset="utc">
Nov 08 23:45:20 user nova-compute[75045]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 23:45:20 user nova-compute[75045]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 23:45:20 user nova-compute[75045]:     <timer name="hpet" present="no"/>
Nov 08 23:45:20 user nova-compute[75045]:   </clock>
Nov 08 23:45:20 user nova-compute[75045]:   <cpu mode="custom" match="exact">
Nov 08 23:45:20 user nova-compute[75045]:     <model>Nehalem</model>
Nov 08 23:45:20 user nova-compute[75045]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 23:45:20 user nova-compute[75045]:   </cpu>
Nov 08 23:45:20 user nova-compute[75045]:   <devices>
Nov 08 23:45:20 user nova-compute[75045]:     <disk type="file" device="disk">
Nov 08 23:45:20 user nova-compute[75045]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 23:45:20 user nova-compute[75045]:       <source file="/opt/stack/data/nova/instances/584e3043-addf-41f7-a3cd-de51c229af72/disk"/>
Nov 08 23:45:20 user nova-compute[75045]:       <target dev="vda" bus="virtio"/>
Nov 08 23:45:20 user nova-compute[75045]:     </disk>
Nov 08 23:45:20 user nova-compute[75045]:     <interface type="ethernet">
Nov 08 23:45:20 user nova-compute[75045]:       <mac address="fa:16:3e:fe:a0:87"/>
Nov 08 23:45:20 user nova-compute[75045]:       <model type="virtio"/>
Nov 08 23:45:20 user nova-compute[75045]:       <mtu size="1442"/>
Nov 08 23:45:20 user nova-compute[75045]:       <target dev="tap8b02e567-10"/>
Nov 08 23:45:20 user nova-compute[75045]:     </interface>
Nov 08 23:45:20 user nova-compute[75045]:     <serial type="pty">
Nov 08 23:45:20 user nova-compute[75045]:       <log file="/opt/stack/data/nova/instances/584e3043-addf-41f7-a3cd-de51c229af72/console.log" append="off"/>
Nov 08 23:45:20 user nova-compute[75045]:     </serial>
Nov 08 23:45:20 user nova-compute[75045]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 23:45:20 user nova-compute[75045]:     <video>
Nov 08 23:45:20 user nova-compute[75045]:       <model type="virtio"/>
Nov 08 23:45:20 user nova-compute[75045]:     </video>
Nov 08 23:45:20 user nova-compute[75045]:     <rng model="virtio">
Nov 08 23:45:20 user nova-compute[75045]:       <backend model="random">/dev/urandom</backend>
Nov 08 23:45:20 user nova-compute[75045]:     </rng>
Nov 08 23:45:20 user nova-compute[75045]:     <controller type="usb" index="0" model="none"/>
Nov 08 23:45:20 user nova-compute[75045]:     <memballoon model="virtio">
Nov 08 23:45:20 user nova-compute[75045]:       <stats period="10"/>
Nov 08 23:45:20 user nova-compute[75045]:     </memballoon>
Nov 08 23:45:20 user nova-compute[75045]:   </devices>
Nov 08 23:45:20 user nova-compute[75045]: </domain>
Nov 08 23:45:20 user nova-compute[75045]:  {{(pid=75045) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 23:45:20 user nova-compute[75045]: DEBUG nova.virt.libvirt.vif [None req-f39a2c40-1aff-410d-8974-6e6b822bc324 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-08T23:41:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1201717535',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1201717535',id=41,image_ref='75c4ea21-95a9-41b4-97c8-ebe2c3667c78',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-2053037695',keypairs=<?>,launch_index=0,launched_at=2023-11-08T23:41:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='3ad736027d034259a052da3f62bd575f',ramdisk_id='',reservation_id='r-km2oh92z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1769593098',owner_user_name='tempest-AttachVolumeShelveTestJSON-1769593098-project-member',shelved_at='2023-11-08T23:43:25.340455',shelved_host='user',shelved_image_id='75c4ea21-95a9-41b4-97c8-ebe2c3667c78'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T23:45:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7a98fe96727741d0b148f3aaa8abf6f1',uuid=584e3043-addf-41f7-a3cd-de51c229af72,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "8b02e567-10f8-4153-88a4-9ce005c1fff3", "address": "fa:16:3e:fe:a0:87", "network": {"id": "1b10bc53-ef32-4f01-82f6-ed9f95f7e3f2", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-518782773-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.123", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ad736027d034259a052da3f62bd575f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b02e567-10", "ovs_interfaceid": "8b02e567-10f8-4153-88a4-9ce005c1fff3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75045) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 23:45:20 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-f39a2c40-1aff-410d-8974-6e6b822bc324 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] Converting VIF {"id": "8b02e567-10f8-4153-88a4-9ce005c1fff3", "address": "fa:16:3e:fe:a0:87", "network": {"id": "1b10bc53-ef32-4f01-82f6-ed9f95f7e3f2", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-518782773-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.123", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ad736027d034259a052da3f62bd575f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b02e567-10", "ovs_interfaceid": "8b02e567-10f8-4153-88a4-9ce005c1fff3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 23:45:20 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-f39a2c40-1aff-410d-8974-6e6b822bc324 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fe:a0:87,bridge_name='br-int',has_traffic_filtering=True,id=8b02e567-10f8-4153-88a4-9ce005c1fff3,network=Network(1b10bc53-ef32-4f01-82f6-ed9f95f7e3f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b02e567-10') {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 23:45:20 user nova-compute[75045]: DEBUG os_vif [None req-f39a2c40-1aff-410d-8974-6e6b822bc324 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fe:a0:87,bridge_name='br-int',has_traffic_filtering=True,id=8b02e567-10f8-4153-88a4-9ce005c1fff3,network=Network(1b10bc53-ef32-4f01-82f6-ed9f95f7e3f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b02e567-10') {{(pid=75045) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 23:45:20 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:45:20 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:45:20 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 23:45:20 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:45:20 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ee08f0b3-7c08-52fe-86dc-ae05846add95', '_type': 'linux-noop'}}, row=False) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:45:20 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:45:20 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 23:45:20 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:45:20 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:45:20 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8b02e567-10, may_exist=True, interface_attrs={}) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:45:20 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8b02e567-10, col_values=(('qos', UUID('95cb90bd-1286-44eb-adc6-963c7bb084c4')),), if_exists=True) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:45:20 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8b02e567-10, col_values=(('external_ids', {'iface-id': '8b02e567-10f8-4153-88a4-9ce005c1fff3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fe:a0:87', 'vm-uuid': '584e3043-addf-41f7-a3cd-de51c229af72'}),), if_exists=True) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:45:20 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:45:20 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 23:45:20 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:45:20 user nova-compute[75045]: INFO os_vif [None req-f39a2c40-1aff-410d-8974-6e6b822bc324 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fe:a0:87,bridge_name='br-int',has_traffic_filtering=True,id=8b02e567-10f8-4153-88a4-9ce005c1fff3,network=Network(1b10bc53-ef32-4f01-82f6-ed9f95f7e3f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b02e567-10')
Nov 08 23:45:21 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-f39a2c40-1aff-410d-8974-6e6b822bc324 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] No BDM found with device name vda, not building metadata. {{(pid=75045) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 23:45:21 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-f39a2c40-1aff-410d-8974-6e6b822bc324 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] No VIF found with MAC fa:16:3e:fe:a0:87, not building metadata {{(pid=75045) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 23:45:21 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:45:22 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:45:22 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:45:22 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:45:22 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:45:22 user nova-compute[75045]: DEBUG nova.compute.manager [req-679fd62d-90fb-4419-a6ea-9664db65ba31 req-df128d4f-4903-4043-bcd3-384a918879a9 service nova] [instance: 584e3043-addf-41f7-a3cd-de51c229af72] Received event network-vif-plugged-8b02e567-10f8-4153-88a4-9ce005c1fff3 {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:45:22 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-679fd62d-90fb-4419-a6ea-9664db65ba31 req-df128d4f-4903-4043-bcd3-384a918879a9 service nova] Acquiring lock "584e3043-addf-41f7-a3cd-de51c229af72-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:45:22 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-679fd62d-90fb-4419-a6ea-9664db65ba31 req-df128d4f-4903-4043-bcd3-384a918879a9 service nova] Lock "584e3043-addf-41f7-a3cd-de51c229af72-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:45:22 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-679fd62d-90fb-4419-a6ea-9664db65ba31 req-df128d4f-4903-4043-bcd3-384a918879a9 service nova] Lock "584e3043-addf-41f7-a3cd-de51c229af72-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:45:22 user nova-compute[75045]: DEBUG nova.compute.manager [req-679fd62d-90fb-4419-a6ea-9664db65ba31 req-df128d4f-4903-4043-bcd3-384a918879a9 service nova] [instance: 584e3043-addf-41f7-a3cd-de51c229af72] No waiting events found dispatching network-vif-plugged-8b02e567-10f8-4153-88a4-9ce005c1fff3 {{(pid=75045) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 23:45:22 user nova-compute[75045]: WARNING nova.compute.manager [req-679fd62d-90fb-4419-a6ea-9664db65ba31 req-df128d4f-4903-4043-bcd3-384a918879a9 service nova] [instance: 584e3043-addf-41f7-a3cd-de51c229af72] Received unexpected event network-vif-plugged-8b02e567-10f8-4153-88a4-9ce005c1fff3 for instance with vm_state shelved_offloaded and task_state spawning.
Nov 08 23:45:22 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:45:22 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:45:22 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:45:23 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:45:23 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:45:24 user nova-compute[75045]: DEBUG nova.compute.manager [req-00731f68-a882-4a59-973f-28d3ed2f5834 req-575ed76a-8eb5-48bb-b38b-da1d64223db0 service nova] [instance: 584e3043-addf-41f7-a3cd-de51c229af72] Received event network-vif-plugged-8b02e567-10f8-4153-88a4-9ce005c1fff3 {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:45:24 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-00731f68-a882-4a59-973f-28d3ed2f5834 req-575ed76a-8eb5-48bb-b38b-da1d64223db0 service nova] Acquiring lock "584e3043-addf-41f7-a3cd-de51c229af72-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:45:24 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-00731f68-a882-4a59-973f-28d3ed2f5834 req-575ed76a-8eb5-48bb-b38b-da1d64223db0 service nova] Lock "584e3043-addf-41f7-a3cd-de51c229af72-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:45:24 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-00731f68-a882-4a59-973f-28d3ed2f5834 req-575ed76a-8eb5-48bb-b38b-da1d64223db0 service nova] Lock "584e3043-addf-41f7-a3cd-de51c229af72-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:45:24 user nova-compute[75045]: DEBUG nova.compute.manager [req-00731f68-a882-4a59-973f-28d3ed2f5834 req-575ed76a-8eb5-48bb-b38b-da1d64223db0 service nova] [instance: 584e3043-addf-41f7-a3cd-de51c229af72] No waiting events found dispatching network-vif-plugged-8b02e567-10f8-4153-88a4-9ce005c1fff3 {{(pid=75045) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 23:45:24 user nova-compute[75045]: WARNING nova.compute.manager [req-00731f68-a882-4a59-973f-28d3ed2f5834 req-575ed76a-8eb5-48bb-b38b-da1d64223db0 service nova] [instance: 584e3043-addf-41f7-a3cd-de51c229af72] Received unexpected event network-vif-plugged-8b02e567-10f8-4153-88a4-9ce005c1fff3 for instance with vm_state shelved_offloaded and task_state spawning.
Nov 08 23:45:24 user nova-compute[75045]: DEBUG nova.compute.manager [None req-f39a2c40-1aff-410d-8974-6e6b822bc324 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] [instance: 584e3043-addf-41f7-a3cd-de51c229af72] Instance event wait completed in 0 seconds for  {{(pid=75045) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 23:45:24 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-f39a2c40-1aff-410d-8974-6e6b822bc324 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] [instance: 584e3043-addf-41f7-a3cd-de51c229af72] Guest created on hypervisor {{(pid=75045) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 23:45:24 user nova-compute[75045]: INFO nova.virt.libvirt.driver [-] [instance: 584e3043-addf-41f7-a3cd-de51c229af72] Instance spawned successfully.
Nov 08 23:45:24 user nova-compute[75045]: DEBUG nova.compute.manager [None req-f39a2c40-1aff-410d-8974-6e6b822bc324 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] [instance: 584e3043-addf-41f7-a3cd-de51c229af72] Checking state {{(pid=75045) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 23:45:25 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-f39a2c40-1aff-410d-8974-6e6b822bc324 tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] Lock "584e3043-addf-41f7-a3cd-de51c229af72" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 11.173s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:45:25 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:45:26 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:45:30 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:45:35 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:45:40 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 23:45:40 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 23:45:40 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75045) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 23:45:40 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75045) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 23:45:40 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:45:40 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75045) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 23:45:41 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:45:45 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:45:46 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:45:47 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-63c5a7d5-84fd-4f65-8583-21dfc4c743a1 tempest-ServerStableDeviceRescueTest-1847572360 tempest-ServerStableDeviceRescueTest-1847572360-project-member] Acquiring lock "7ee587a0-e271-4262-a252-2ccb6c2faecb" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:45:47 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-63c5a7d5-84fd-4f65-8583-21dfc4c743a1 tempest-ServerStableDeviceRescueTest-1847572360 tempest-ServerStableDeviceRescueTest-1847572360-project-member] Lock "7ee587a0-e271-4262-a252-2ccb6c2faecb" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:45:47 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-63c5a7d5-84fd-4f65-8583-21dfc4c743a1 tempest-ServerStableDeviceRescueTest-1847572360 tempest-ServerStableDeviceRescueTest-1847572360-project-member] Acquiring lock "7ee587a0-e271-4262-a252-2ccb6c2faecb-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:45:47 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-63c5a7d5-84fd-4f65-8583-21dfc4c743a1 tempest-ServerStableDeviceRescueTest-1847572360 tempest-ServerStableDeviceRescueTest-1847572360-project-member] Lock "7ee587a0-e271-4262-a252-2ccb6c2faecb-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:45:47 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-63c5a7d5-84fd-4f65-8583-21dfc4c743a1 tempest-ServerStableDeviceRescueTest-1847572360 tempest-ServerStableDeviceRescueTest-1847572360-project-member] Lock "7ee587a0-e271-4262-a252-2ccb6c2faecb-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:45:47 user nova-compute[75045]: INFO nova.compute.manager [None req-63c5a7d5-84fd-4f65-8583-21dfc4c743a1 tempest-ServerStableDeviceRescueTest-1847572360 tempest-ServerStableDeviceRescueTest-1847572360-project-member] [instance: 7ee587a0-e271-4262-a252-2ccb6c2faecb] Terminating instance
Nov 08 23:45:47 user nova-compute[75045]: DEBUG nova.compute.manager [None req-63c5a7d5-84fd-4f65-8583-21dfc4c743a1 tempest-ServerStableDeviceRescueTest-1847572360 tempest-ServerStableDeviceRescueTest-1847572360-project-member] [instance: 7ee587a0-e271-4262-a252-2ccb6c2faecb] Start destroying the instance on the hypervisor. {{(pid=75045) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 23:45:47 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:45:47 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:45:47 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:45:47 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:45:47 user nova-compute[75045]: DEBUG nova.compute.manager [req-562eca4c-85d9-4010-b358-08dd0acb4d92 req-a879c019-cbf4-4a4d-8673-6f5660326692 service nova] [instance: 7ee587a0-e271-4262-a252-2ccb6c2faecb] Received event network-vif-unplugged-0b911e0a-0c01-4296-b269-f52ee68772f9 {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:45:47 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-562eca4c-85d9-4010-b358-08dd0acb4d92 req-a879c019-cbf4-4a4d-8673-6f5660326692 service nova] Acquiring lock "7ee587a0-e271-4262-a252-2ccb6c2faecb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:45:47 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-562eca4c-85d9-4010-b358-08dd0acb4d92 req-a879c019-cbf4-4a4d-8673-6f5660326692 service nova] Lock "7ee587a0-e271-4262-a252-2ccb6c2faecb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:45:47 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-562eca4c-85d9-4010-b358-08dd0acb4d92 req-a879c019-cbf4-4a4d-8673-6f5660326692 service nova] Lock "7ee587a0-e271-4262-a252-2ccb6c2faecb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:45:47 user nova-compute[75045]: DEBUG nova.compute.manager [req-562eca4c-85d9-4010-b358-08dd0acb4d92 req-a879c019-cbf4-4a4d-8673-6f5660326692 service nova] [instance: 7ee587a0-e271-4262-a252-2ccb6c2faecb] No waiting events found dispatching network-vif-unplugged-0b911e0a-0c01-4296-b269-f52ee68772f9 {{(pid=75045) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 23:45:47 user nova-compute[75045]: DEBUG nova.compute.manager [req-562eca4c-85d9-4010-b358-08dd0acb4d92 req-a879c019-cbf4-4a4d-8673-6f5660326692 service nova] [instance: 7ee587a0-e271-4262-a252-2ccb6c2faecb] Received event network-vif-unplugged-0b911e0a-0c01-4296-b269-f52ee68772f9 for instance with task_state deleting. {{(pid=75045) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 23:45:48 user nova-compute[75045]: INFO nova.virt.libvirt.driver [-] [instance: 7ee587a0-e271-4262-a252-2ccb6c2faecb] Instance destroyed successfully.
Nov 08 23:45:48 user nova-compute[75045]: DEBUG nova.objects.instance [None req-63c5a7d5-84fd-4f65-8583-21dfc4c743a1 tempest-ServerStableDeviceRescueTest-1847572360 tempest-ServerStableDeviceRescueTest-1847572360-project-member] Lazy-loading 'resources' on Instance uuid 7ee587a0-e271-4262-a252-2ccb6c2faecb {{(pid=75045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 23:45:48 user nova-compute[75045]: DEBUG nova.virt.libvirt.vif [None req-63c5a7d5-84fd-4f65-8583-21dfc4c743a1 tempest-ServerStableDeviceRescueTest-1847572360 tempest-ServerStableDeviceRescueTest-1847572360-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T23:37:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-511845209',display_name='tempest-ServerStableDeviceRescueTest-server-511845209',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-511845209',id=37,image_ref='a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAazcJf6mPhnLZhu/TEEbRcKRzviHLHtM5RAFvtylVUl63QLHMszWdrsWATDs55dIdfOMRrB/jSYqTaEgUtPxK3t+z/n2SQh/8lXWD+YRF2sDlrMunls4XYUnke1aho+/Q==',key_name='tempest-keypair-1152195583',keypairs=<?>,launch_index=0,launched_at=2023-11-08T23:42:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4760b2fb18b44e26bfbca6bf16aea581',ramdisk_id='',reservation_id='r-wv3hsg4l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-1847572360',owner_user_name='tempest-ServerStableDeviceRescueTest-1847572360-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T23:44:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='49cdaaab1d134721a522900af5e12d8a',uuid=7ee587a0-e271-4262-a252-2ccb6c2faecb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0b911e0a-0c01-4296-b269-f52ee68772f9", "address": "fa:16:3e:03:88:6d", "network": {"id": "3fc25e49-b987-4fe7-9c28-6a18b689a411", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1301325538-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.217", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4760b2fb18b44e26bfbca6bf16aea581", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b911e0a-0c", "ovs_interfaceid": "0b911e0a-0c01-4296-b269-f52ee68772f9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75045) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 23:45:48 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-63c5a7d5-84fd-4f65-8583-21dfc4c743a1 tempest-ServerStableDeviceRescueTest-1847572360 tempest-ServerStableDeviceRescueTest-1847572360-project-member] Converting VIF {"id": "0b911e0a-0c01-4296-b269-f52ee68772f9", "address": "fa:16:3e:03:88:6d", "network": {"id": "3fc25e49-b987-4fe7-9c28-6a18b689a411", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1301325538-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.217", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4760b2fb18b44e26bfbca6bf16aea581", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b911e0a-0c", "ovs_interfaceid": "0b911e0a-0c01-4296-b269-f52ee68772f9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 23:45:48 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-63c5a7d5-84fd-4f65-8583-21dfc4c743a1 tempest-ServerStableDeviceRescueTest-1847572360 tempest-ServerStableDeviceRescueTest-1847572360-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:03:88:6d,bridge_name='br-int',has_traffic_filtering=True,id=0b911e0a-0c01-4296-b269-f52ee68772f9,network=Network(3fc25e49-b987-4fe7-9c28-6a18b689a411),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b911e0a-0c') {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 23:45:48 user nova-compute[75045]: DEBUG os_vif [None req-63c5a7d5-84fd-4f65-8583-21dfc4c743a1 tempest-ServerStableDeviceRescueTest-1847572360 tempest-ServerStableDeviceRescueTest-1847572360-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:03:88:6d,bridge_name='br-int',has_traffic_filtering=True,id=0b911e0a-0c01-4296-b269-f52ee68772f9,network=Network(3fc25e49-b987-4fe7-9c28-6a18b689a411),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b911e0a-0c') {{(pid=75045) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 23:45:48 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:45:48 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0b911e0a-0c, bridge=br-int, if_exists=True) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:45:48 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:45:48 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 23:45:48 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:45:48 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:45:48 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=cbcf8865-0d32-4330-9017-54647be1d604) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:45:48 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:45:48 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 23:45:48 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:45:48 user nova-compute[75045]: INFO os_vif [None req-63c5a7d5-84fd-4f65-8583-21dfc4c743a1 tempest-ServerStableDeviceRescueTest-1847572360 tempest-ServerStableDeviceRescueTest-1847572360-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:03:88:6d,bridge_name='br-int',has_traffic_filtering=True,id=0b911e0a-0c01-4296-b269-f52ee68772f9,network=Network(3fc25e49-b987-4fe7-9c28-6a18b689a411),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b911e0a-0c')
Nov 08 23:45:48 user nova-compute[75045]: INFO nova.virt.libvirt.driver [None req-63c5a7d5-84fd-4f65-8583-21dfc4c743a1 tempest-ServerStableDeviceRescueTest-1847572360 tempest-ServerStableDeviceRescueTest-1847572360-project-member] [instance: 7ee587a0-e271-4262-a252-2ccb6c2faecb] Deleting instance files /opt/stack/data/nova/instances/7ee587a0-e271-4262-a252-2ccb6c2faecb_del
Nov 08 23:45:48 user nova-compute[75045]: INFO nova.virt.libvirt.driver [None req-63c5a7d5-84fd-4f65-8583-21dfc4c743a1 tempest-ServerStableDeviceRescueTest-1847572360 tempest-ServerStableDeviceRescueTest-1847572360-project-member] [instance: 7ee587a0-e271-4262-a252-2ccb6c2faecb] Deletion of /opt/stack/data/nova/instances/7ee587a0-e271-4262-a252-2ccb6c2faecb_del complete
Nov 08 23:45:48 user nova-compute[75045]: INFO nova.compute.manager [None req-63c5a7d5-84fd-4f65-8583-21dfc4c743a1 tempest-ServerStableDeviceRescueTest-1847572360 tempest-ServerStableDeviceRescueTest-1847572360-project-member] [instance: 7ee587a0-e271-4262-a252-2ccb6c2faecb] Took 0.89 seconds to destroy the instance on the hypervisor.
Nov 08 23:45:48 user nova-compute[75045]: DEBUG oslo.service.loopingcall [None req-63c5a7d5-84fd-4f65-8583-21dfc4c743a1 tempest-ServerStableDeviceRescueTest-1847572360 tempest-ServerStableDeviceRescueTest-1847572360-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75045) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 23:45:48 user nova-compute[75045]: DEBUG nova.compute.manager [-] [instance: 7ee587a0-e271-4262-a252-2ccb6c2faecb] Deallocating network for instance {{(pid=75045) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 23:45:48 user nova-compute[75045]: DEBUG nova.network.neutron [-] [instance: 7ee587a0-e271-4262-a252-2ccb6c2faecb] deallocate_for_instance() {{(pid=75045) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 23:45:48 user nova-compute[75045]: DEBUG nova.network.neutron [-] [instance: 7ee587a0-e271-4262-a252-2ccb6c2faecb] Updating instance_info_cache with network_info: [] {{(pid=75045) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 23:45:48 user nova-compute[75045]: INFO nova.compute.manager [-] [instance: 7ee587a0-e271-4262-a252-2ccb6c2faecb] Took 0.82 seconds to deallocate network for instance.
Nov 08 23:45:49 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-63c5a7d5-84fd-4f65-8583-21dfc4c743a1 tempest-ServerStableDeviceRescueTest-1847572360 tempest-ServerStableDeviceRescueTest-1847572360-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:45:49 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-63c5a7d5-84fd-4f65-8583-21dfc4c743a1 tempest-ServerStableDeviceRescueTest-1847572360 tempest-ServerStableDeviceRescueTest-1847572360-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:45:49 user nova-compute[75045]: DEBUG nova.compute.provider_tree [None req-63c5a7d5-84fd-4f65-8583-21dfc4c743a1 tempest-ServerStableDeviceRescueTest-1847572360 tempest-ServerStableDeviceRescueTest-1847572360-project-member] Inventory has not changed in ProviderTree for provider: 62ba5f85-c74d-4b58-986e-d4197e813fd7 {{(pid=75045) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 23:45:49 user nova-compute[75045]: DEBUG nova.scheduler.client.report [None req-63c5a7d5-84fd-4f65-8583-21dfc4c743a1 tempest-ServerStableDeviceRescueTest-1847572360 tempest-ServerStableDeviceRescueTest-1847572360-project-member] Inventory has not changed for provider 62ba5f85-c74d-4b58-986e-d4197e813fd7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75045) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 23:45:49 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-63c5a7d5-84fd-4f65-8583-21dfc4c743a1 tempest-ServerStableDeviceRescueTest-1847572360 tempest-ServerStableDeviceRescueTest-1847572360-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.215s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:45:49 user nova-compute[75045]: INFO nova.scheduler.client.report [None req-63c5a7d5-84fd-4f65-8583-21dfc4c743a1 tempest-ServerStableDeviceRescueTest-1847572360 tempest-ServerStableDeviceRescueTest-1847572360-project-member] Deleted allocations for instance 7ee587a0-e271-4262-a252-2ccb6c2faecb
Nov 08 23:45:49 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-63c5a7d5-84fd-4f65-8583-21dfc4c743a1 tempest-ServerStableDeviceRescueTest-1847572360 tempest-ServerStableDeviceRescueTest-1847572360-project-member] Lock "7ee587a0-e271-4262-a252-2ccb6c2faecb" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.110s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:45:49 user nova-compute[75045]: DEBUG nova.compute.manager [req-ffc42259-5a63-41f2-b8e9-2aa8bc0a7388 req-e7cab8dc-4c9f-4bb4-8267-7a7d4742d27a service nova] [instance: 7ee587a0-e271-4262-a252-2ccb6c2faecb] Received event network-vif-plugged-0b911e0a-0c01-4296-b269-f52ee68772f9 {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:45:49 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-ffc42259-5a63-41f2-b8e9-2aa8bc0a7388 req-e7cab8dc-4c9f-4bb4-8267-7a7d4742d27a service nova] Acquiring lock "7ee587a0-e271-4262-a252-2ccb6c2faecb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:45:49 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-ffc42259-5a63-41f2-b8e9-2aa8bc0a7388 req-e7cab8dc-4c9f-4bb4-8267-7a7d4742d27a service nova] Lock "7ee587a0-e271-4262-a252-2ccb6c2faecb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:45:49 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-ffc42259-5a63-41f2-b8e9-2aa8bc0a7388 req-e7cab8dc-4c9f-4bb4-8267-7a7d4742d27a service nova] Lock "7ee587a0-e271-4262-a252-2ccb6c2faecb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:45:49 user nova-compute[75045]: DEBUG nova.compute.manager [req-ffc42259-5a63-41f2-b8e9-2aa8bc0a7388 req-e7cab8dc-4c9f-4bb4-8267-7a7d4742d27a service nova] [instance: 7ee587a0-e271-4262-a252-2ccb6c2faecb] No waiting events found dispatching network-vif-plugged-0b911e0a-0c01-4296-b269-f52ee68772f9 {{(pid=75045) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 23:45:49 user nova-compute[75045]: WARNING nova.compute.manager [req-ffc42259-5a63-41f2-b8e9-2aa8bc0a7388 req-e7cab8dc-4c9f-4bb4-8267-7a7d4742d27a service nova] [instance: 7ee587a0-e271-4262-a252-2ccb6c2faecb] Received unexpected event network-vif-plugged-0b911e0a-0c01-4296-b269-f52ee68772f9 for instance with vm_state deleted and task_state None.
Nov 08 23:45:49 user nova-compute[75045]: DEBUG nova.compute.manager [req-ffc42259-5a63-41f2-b8e9-2aa8bc0a7388 req-e7cab8dc-4c9f-4bb4-8267-7a7d4742d27a service nova] [instance: 7ee587a0-e271-4262-a252-2ccb6c2faecb] Received event network-vif-deleted-0b911e0a-0c01-4296-b269-f52ee68772f9 {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:45:51 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:45:52 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:45:52 user nova-compute[75045]: DEBUG nova.compute.manager [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Starting heal instance info cache {{(pid=75045) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 23:45:52 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Acquiring lock "refresh_cache-0b413c71-c13a-4fea-91c4-f6b1953d54c6" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 23:45:52 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Acquired lock "refresh_cache-0b413c71-c13a-4fea-91c4-f6b1953d54c6" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 23:45:52 user nova-compute[75045]: DEBUG nova.network.neutron [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] [instance: 0b413c71-c13a-4fea-91c4-f6b1953d54c6] Forcefully refreshing network info cache for instance {{(pid=75045) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 23:45:53 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:45:53 user nova-compute[75045]: DEBUG nova.compute.manager [req-2a53bc7b-5fe1-4bc1-a0f4-4a12318d89c6 req-d9395c22-7cac-4b23-aaea-c6400ba60c03 service nova] [instance: 37502077-b02b-4f0c-b654-8a6cef607efa] Received event network-changed-30508e27-33e7-40dd-b166-6486da0f0911 {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:45:53 user nova-compute[75045]: DEBUG nova.compute.manager [req-2a53bc7b-5fe1-4bc1-a0f4-4a12318d89c6 req-d9395c22-7cac-4b23-aaea-c6400ba60c03 service nova] [instance: 37502077-b02b-4f0c-b654-8a6cef607efa] Refreshing instance network info cache due to event network-changed-30508e27-33e7-40dd-b166-6486da0f0911. {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 23:45:53 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-2a53bc7b-5fe1-4bc1-a0f4-4a12318d89c6 req-d9395c22-7cac-4b23-aaea-c6400ba60c03 service nova] Acquiring lock "refresh_cache-37502077-b02b-4f0c-b654-8a6cef607efa" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 23:45:53 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-2a53bc7b-5fe1-4bc1-a0f4-4a12318d89c6 req-d9395c22-7cac-4b23-aaea-c6400ba60c03 service nova] Acquired lock "refresh_cache-37502077-b02b-4f0c-b654-8a6cef607efa" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 23:45:53 user nova-compute[75045]: DEBUG nova.network.neutron [req-2a53bc7b-5fe1-4bc1-a0f4-4a12318d89c6 req-d9395c22-7cac-4b23-aaea-c6400ba60c03 service nova] [instance: 37502077-b02b-4f0c-b654-8a6cef607efa] Refreshing network info cache for port 30508e27-33e7-40dd-b166-6486da0f0911 {{(pid=75045) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 23:45:54 user nova-compute[75045]: DEBUG nova.network.neutron [req-2a53bc7b-5fe1-4bc1-a0f4-4a12318d89c6 req-d9395c22-7cac-4b23-aaea-c6400ba60c03 service nova] [instance: 37502077-b02b-4f0c-b654-8a6cef607efa] Updated VIF entry in instance network info cache for port 30508e27-33e7-40dd-b166-6486da0f0911. {{(pid=75045) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 23:45:54 user nova-compute[75045]: DEBUG nova.network.neutron [req-2a53bc7b-5fe1-4bc1-a0f4-4a12318d89c6 req-d9395c22-7cac-4b23-aaea-c6400ba60c03 service nova] [instance: 37502077-b02b-4f0c-b654-8a6cef607efa] Updating instance_info_cache with network_info: [{"id": "30508e27-33e7-40dd-b166-6486da0f0911", "address": "fa:16:3e:3d:90:bb", "network": {"id": "4205f899-9865-4c65-8b46-c9a533e9bb45", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-774780781-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.170", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d59b73851c79473a9c2cdc0a120dfee0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30508e27-33", "ovs_interfaceid": "30508e27-33e7-40dd-b166-6486da0f0911", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75045) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 23:45:54 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-2a53bc7b-5fe1-4bc1-a0f4-4a12318d89c6 req-d9395c22-7cac-4b23-aaea-c6400ba60c03 service nova] Releasing lock "refresh_cache-37502077-b02b-4f0c-b654-8a6cef607efa" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 23:45:54 user nova-compute[75045]: DEBUG nova.network.neutron [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] [instance: 0b413c71-c13a-4fea-91c4-f6b1953d54c6] Updating instance_info_cache with network_info: [{"id": "166cceb4-9b95-4bdd-a3ad-b6aad94dfed0", "address": "fa:16:3e:17:84:3d", "network": {"id": "e31c3d41-e46f-4c74-8ef5-8243a391dde8", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-856540424-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.149", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c8be85d72bc440899f3ccb64b923e90e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap166cceb4-9b", "ovs_interfaceid": "166cceb4-9b95-4bdd-a3ad-b6aad94dfed0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75045) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 23:45:54 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Releasing lock "refresh_cache-0b413c71-c13a-4fea-91c4-f6b1953d54c6" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 23:45:54 user nova-compute[75045]: DEBUG nova.compute.manager [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] [instance: 0b413c71-c13a-4fea-91c4-f6b1953d54c6] Updated the network info_cache for instance {{(pid=75045) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 23:45:54 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:45:54 user nova-compute[75045]: DEBUG nova.compute.manager [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75045) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 23:45:54 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:45:54 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:45:56 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:45:57 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:45:57 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:45:58 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:45:58 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:45:59 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:46:00 user nova-compute[75045]: DEBUG nova.objects.instance [None req-d410eb2b-2606-43e9-9277-11b0fab2e07a tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Lazy-loading 'flavor' on Instance uuid 0b413c71-c13a-4fea-91c4-f6b1953d54c6 {{(pid=75045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 23:46:00 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-d410eb2b-2606-43e9-9277-11b0fab2e07a tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Acquiring lock "refresh_cache-0b413c71-c13a-4fea-91c4-f6b1953d54c6" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 23:46:00 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-d410eb2b-2606-43e9-9277-11b0fab2e07a tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Acquired lock "refresh_cache-0b413c71-c13a-4fea-91c4-f6b1953d54c6" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 23:46:00 user nova-compute[75045]: DEBUG nova.network.neutron [None req-d410eb2b-2606-43e9-9277-11b0fab2e07a tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] [instance: 0b413c71-c13a-4fea-91c4-f6b1953d54c6] Building network info cache for instance {{(pid=75045) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 23:46:00 user nova-compute[75045]: DEBUG nova.objects.instance [None req-d410eb2b-2606-43e9-9277-11b0fab2e07a tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Lazy-loading 'info_cache' on Instance uuid 0b413c71-c13a-4fea-91c4-f6b1953d54c6 {{(pid=75045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 23:46:00 user nova-compute[75045]: DEBUG nova.objects.base [None req-d410eb2b-2606-43e9-9277-11b0fab2e07a tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Object Instance<0b413c71-c13a-4fea-91c4-f6b1953d54c6> lazy-loaded attributes: flavor,info_cache {{(pid=75045) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 23:46:01 user nova-compute[75045]: DEBUG nova.network.neutron [None req-d410eb2b-2606-43e9-9277-11b0fab2e07a tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] [instance: 0b413c71-c13a-4fea-91c4-f6b1953d54c6] Updating instance_info_cache with network_info: [{"id": "166cceb4-9b95-4bdd-a3ad-b6aad94dfed0", "address": "fa:16:3e:17:84:3d", "network": {"id": "e31c3d41-e46f-4c74-8ef5-8243a391dde8", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-856540424-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.149", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c8be85d72bc440899f3ccb64b923e90e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap166cceb4-9b", "ovs_interfaceid": "166cceb4-9b95-4bdd-a3ad-b6aad94dfed0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75045) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 23:46:01 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-d410eb2b-2606-43e9-9277-11b0fab2e07a tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Releasing lock "refresh_cache-0b413c71-c13a-4fea-91c4-f6b1953d54c6" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 23:46:01 user nova-compute[75045]: INFO nova.virt.libvirt.driver [-] [instance: 0b413c71-c13a-4fea-91c4-f6b1953d54c6] Instance destroyed successfully.
Nov 08 23:46:01 user nova-compute[75045]: DEBUG nova.objects.instance [None req-d410eb2b-2606-43e9-9277-11b0fab2e07a tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Lazy-loading 'resources' on Instance uuid 0b413c71-c13a-4fea-91c4-f6b1953d54c6 {{(pid=75045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 23:46:01 user nova-compute[75045]: DEBUG nova.objects.base [None req-d410eb2b-2606-43e9-9277-11b0fab2e07a tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Object Instance<0b413c71-c13a-4fea-91c4-f6b1953d54c6> lazy-loaded attributes: flavor,info_cache,resources {{(pid=75045) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 23:46:01 user nova-compute[75045]: DEBUG nova.virt.libvirt.vif [None req-d410eb2b-2606-43e9-9277-11b0fab2e07a tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T23:41:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1115991455',display_name='tempest-AttachVolumeTestJSON-server-1115991455',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1115991455',id=42,image_ref='a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDP62TKuY3xQeSwtOVfapZleQ+Udsdwyg62rL9eK489WlMG5ccA/qQJy7H2wra4KXAElLeGxPHWcXNl9vwyU6pMJ292WwpOYwEUeIcXde3ufxVUWLY5U6GVW+3+zkZGZTw==',key_name='tempest-keypair-777988029',keypairs=<?>,launch_index=0,launched_at=2023-11-08T23:41:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='c8be85d72bc440899f3ccb64b923e90e',ramdisk_id='',reservation_id='r-m3eq8ay7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1852573580',owner_user_name='tempest-AttachVolumeTestJSON-1852573580-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T23:44:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1e3647ad15a24f1584685f9340eae5bd',uuid=0b413c71-c13a-4fea-91c4-f6b1953d54c6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "166cceb4-9b95-4bdd-a3ad-b6aad94dfed0", "address": "fa:16:3e:17:84:3d", "network": {"id": "e31c3d41-e46f-4c74-8ef5-8243a391dde8", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-856540424-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.149", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c8be85d72bc440899f3ccb64b923e90e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap166cceb4-9b", "ovs_interfaceid": "166cceb4-9b95-4bdd-a3ad-b6aad94dfed0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75045) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 23:46:01 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-d410eb2b-2606-43e9-9277-11b0fab2e07a tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Converting VIF {"id": "166cceb4-9b95-4bdd-a3ad-b6aad94dfed0", "address": "fa:16:3e:17:84:3d", "network": {"id": "e31c3d41-e46f-4c74-8ef5-8243a391dde8", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-856540424-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.149", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c8be85d72bc440899f3ccb64b923e90e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap166cceb4-9b", "ovs_interfaceid": "166cceb4-9b95-4bdd-a3ad-b6aad94dfed0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 23:46:01 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-d410eb2b-2606-43e9-9277-11b0fab2e07a tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:17:84:3d,bridge_name='br-int',has_traffic_filtering=True,id=166cceb4-9b95-4bdd-a3ad-b6aad94dfed0,network=Network(e31c3d41-e46f-4c74-8ef5-8243a391dde8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap166cceb4-9b') {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 23:46:01 user nova-compute[75045]: DEBUG os_vif [None req-d410eb2b-2606-43e9-9277-11b0fab2e07a tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:17:84:3d,bridge_name='br-int',has_traffic_filtering=True,id=166cceb4-9b95-4bdd-a3ad-b6aad94dfed0,network=Network(e31c3d41-e46f-4c74-8ef5-8243a391dde8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap166cceb4-9b') {{(pid=75045) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 23:46:01 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:46:01 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap166cceb4-9b, bridge=br-int, if_exists=True) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:46:01 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:46:01 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 23:46:01 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:46:01 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d7ba1166-974e-4358-a604-d9966c553998) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:46:01 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:46:01 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:46:01 user nova-compute[75045]: INFO os_vif [None req-d410eb2b-2606-43e9-9277-11b0fab2e07a tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:17:84:3d,bridge_name='br-int',has_traffic_filtering=True,id=166cceb4-9b95-4bdd-a3ad-b6aad94dfed0,network=Network(e31c3d41-e46f-4c74-8ef5-8243a391dde8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap166cceb4-9b')
Nov 08 23:46:01 user nova-compute[75045]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d410eb2b-2606-43e9-9277-11b0fab2e07a tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] [instance: 0b413c71-c13a-4fea-91c4-f6b1953d54c6] calling os-brick to detach iSCSI Volume {{(pid=75045) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 23:46:01 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-d410eb2b-2606-43e9-9277-11b0fab2e07a tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1b68210460>, {'target_iqn': 'iqn.2010-10.org.openstack:adcca529-746a-4b7a-966a-82909ff5b108', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'abIqSyev', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=75045) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 23:46:01 user nova-compute[75045]: WARNING os_brick.initiator.connectors.base [None req-d410eb2b-2606-43e9-9277-11b0fab2e07a tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 23:46:01 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-d410eb2b-2606-43e9-9277-11b0fab2e07a tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 23:46:01 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-d410eb2b-2606-43e9-9277-11b0fab2e07a tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 23:46:01 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:46:01 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:46:01 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed5eacc3-f8f8-45f1-992e-fb9c165d95a3]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:adcca529-746a-4b7a-966a-82909ff5b108\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:22e58281-41b7-4be2-ace8-0750aa5d18f8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:46:01 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-d410eb2b-2606-43e9-9277-11b0fab2e07a tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 23:46:01 user nova-compute[75045]: No targets found.
Nov 08 23:46:01 user nova-compute[75045]: iSNS:
Nov 08 23:46:01 user nova-compute[75045]: No targets found.
Nov 08 23:46:01 user nova-compute[75045]: STATIC:
Nov 08 23:46:01 user nova-compute[75045]: Target: iqn.2010-10.org.openstack:adcca529-746a-4b7a-966a-82909ff5b108
Nov 08 23:46:01 user nova-compute[75045]:         Portal: 172.16.0.220:3260,-1
Nov 08 23:46:01 user nova-compute[75045]:                 Iface Name: default
Nov 08 23:46:01 user nova-compute[75045]: Target: iqn.2010-10.org.openstack:22e58281-41b7-4be2-ace8-0750aa5d18f8
Nov 08 23:46:01 user nova-compute[75045]:         Portal: 172.16.0.220:3260,-1
Nov 08 23:46:01 user nova-compute[75045]:                 Iface Name: default
Nov 08 23:46:01 user nova-compute[75045]: FIRMWARE:
Nov 08 23:46:01 user nova-compute[75045]: No targets found.
Nov 08 23:46:01 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 23:46:01 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-d410eb2b-2606-43e9-9277-11b0fab2e07a tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 23:46:01 user nova-compute[75045]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 23:46:01 user nova-compute[75045]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75045) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 23:46:01 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-d410eb2b-2606-43e9-9277-11b0fab2e07a tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:adcca529-746a-4b7a-966a-82909ff5b108', 0)] {{(pid=75045) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 23:46:01 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:46:01 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:46:01 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[136855a4-856d-41e1-9b42-318031965f5e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:22e58281-41b7-4be2-ace8-0750aa5d18f8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:adcca529-746a-4b7a-966a-82909ff5b108\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:46:01 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:46:01 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:46:01 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[055bc38c-d395-4b3f-a715-07951cad0fad]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:adcca529-746a-4b7a-966a-82909ff5b108 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22e58281-41b7-4be2-ace8-0750aa5d18f8 (non-flash)\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:46:01 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-d410eb2b-2606-43e9-9277-11b0fab2e07a tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:adcca529-746a-4b7a-966a-82909ff5b108 (non-flash)
Nov 08 23:46:01 user nova-compute[75045]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22e58281-41b7-4be2-ace8-0750aa5d18f8 (non-flash)
Nov 08 23:46:01 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 23:46:01 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-d410eb2b-2606-43e9-9277-11b0fab2e07a tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:adcca529-746a-4b7a-966a-82909ff5b108 (non-flash)
Nov 08 23:46:01 user nova-compute[75045]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22e58281-41b7-4be2-ace8-0750aa5d18f8 (non-flash)
Nov 08 23:46:01 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 23:46:01 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-d410eb2b-2606-43e9-9277-11b0fab2e07a tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1b482872e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:adcca529-746a-4b7a-966a-82909ff5b108'): ({'sdd'}, set())}) {{(pid=75045) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 23:46:01 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-d410eb2b-2606-43e9-9277-11b0fab2e07a tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Removing single pathed devices sdd {{(pid=75045) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 23:46:01 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:46:01 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:46:01 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[e09b83b3-44e9-4ae2-afd7-fb6d7e8e695d]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:46:01 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:46:01 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:46:01 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ec2461b-30dc-4686-b8ec-d42f21065ebe]: (4, ('ok\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:46:01 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-d410eb2b-2606-43e9-9277-11b0fab2e07a tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Flushing IO for device /dev/sdd {{(pid=75045) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 23:46:01 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:46:01 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:46:01 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[01e6491b-db63-493a-a55f-11b03e4818f3]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:46:01 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-d410eb2b-2606-43e9-9277-11b0fab2e07a tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75045) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 23:46:01 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:46:01 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.047s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:46:01 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ecbcdc8-d3d8-4fc4-9442-514c454b8f7f]: (4, ('1', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:46:01 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-d410eb2b-2606-43e9-9277-11b0fab2e07a tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75045) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 23:46:01 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-d410eb2b-2606-43e9-9277-11b0fab2e07a tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] SCSI volumes sdd have been removed. {{(pid=75045) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 23:46:01 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-d410eb2b-2606-43e9-9277-11b0fab2e07a tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:adcca529-746a-4b7a-966a-82909ff5b108')] {{(pid=75045) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 23:46:01 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:adcca529-746a-4b7a-966a-82909ff5b108 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:46:01 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:adcca529-746a-4b7a-966a-82909ff5b108 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:46:01 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[79420468-9a78-45e4-8562-cfa00e150ebb]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:46:01 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-d410eb2b-2606-43e9-9277-11b0fab2e07a tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:46:01 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:adcca529-746a-4b7a-966a-82909ff5b108 -p 172.16.0.220:3260 --logout {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:46:01 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:adcca529-746a-4b7a-966a-82909ff5b108 -p 172.16.0.220:3260 --logout" returned: 0 in 0.071s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:46:01 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0c76dde-c78e-4b20-acec-07745cebbcad]: (4, ('Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:adcca529-746a-4b7a-966a-82909ff5b108, portal: 172.16.0.220,3260]\nLogout of [sid: 43, target: iqn.2010-10.org.openstack:adcca529-746a-4b7a-966a-82909ff5b108, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:46:01 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-d410eb2b-2606-43e9-9277-11b0fab2e07a tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:adcca529-746a-4b7a-966a-82909ff5b108, portal: 172.16.0.220,3260]
Nov 08 23:46:01 user nova-compute[75045]: Logout of [sid: 43, target: iqn.2010-10.org.openstack:adcca529-746a-4b7a-966a-82909ff5b108, portal: 172.16.0.220,3260] successful.
Nov 08 23:46:01 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:46:01 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:adcca529-746a-4b7a-966a-82909ff5b108 -p 172.16.0.220:3260 --op delete {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:46:01 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:adcca529-746a-4b7a-966a-82909ff5b108 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:46:01 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[dff8bcb1-21f8-469d-b828-eec59ec4f27b]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:46:01 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-d410eb2b-2606-43e9-9277-11b0fab2e07a tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:46:01 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-d410eb2b-2606-43e9-9277-11b0fab2e07a tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.313s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 23:46:01 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-d410eb2b-2606-43e9-9277-11b0fab2e07a tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] <== disconnect_volume: return (315ms) None {{(pid=75045) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 23:46:01 user nova-compute[75045]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d410eb2b-2606-43e9-9277-11b0fab2e07a tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] [instance: 0b413c71-c13a-4fea-91c4-f6b1953d54c6] Disconnected iSCSI Volume {{(pid=75045) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 23:46:01 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-d410eb2b-2606-43e9-9277-11b0fab2e07a tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] [instance: 0b413c71-c13a-4fea-91c4-f6b1953d54c6] Start _get_guest_xml network_info=[{"id": "166cceb4-9b95-4bdd-a3ad-b6aad94dfed0", "address": "fa:16:3e:17:84:3d", "network": {"id": "e31c3d41-e46f-4c74-8ef5-8243a391dde8", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-856540424-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.149", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c8be85d72bc440899f3ccb64b923e90e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap166cceb4-9b", "ovs_interfaceid": "166cceb4-9b95-4bdd-a3ad-b6aad94dfed0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'disk_bus': 'virtio', 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': 'a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb'}], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'device_type': 'disk', 'attachment_id': '1b49cc46-b794-4963-b239-b912f1e02a33', 'guest_format': None, 'disk_bus': 'virtio', 'boot_index': None, 'mount_device': '/dev/vdb', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:adcca529-746a-4b7a-966a-82909ff5b108', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'abIqSyev', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, 'status': 'reserved', 'instance': '0b413c71-c13a-4fea-91c4-f6b1953d54c6', 'attached_at': '', 'detached_at': '', 'volume_id': 'adcca529-746a-4b7a-966a-82909ff5b108', 'serial': 'adcca529-746a-4b7a-966a-82909ff5b108'}, 'volume_type': None} {{(pid=75045) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 23:46:01 user nova-compute[75045]: DEBUG nova.objects.instance [None req-d410eb2b-2606-43e9-9277-11b0fab2e07a tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Lazy-loading 'numa_topology' on Instance uuid 0b413c71-c13a-4fea-91c4-f6b1953d54c6 {{(pid=75045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 23:46:01 user nova-compute[75045]: DEBUG nova.objects.base [None req-d410eb2b-2606-43e9-9277-11b0fab2e07a tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Object Instance<0b413c71-c13a-4fea-91c4-f6b1953d54c6> lazy-loaded attributes: flavor,info_cache,resources,numa_topology {{(pid=75045) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 23:46:01 user nova-compute[75045]: WARNING nova.virt.libvirt.driver [None req-d410eb2b-2606-43e9-9277-11b0fab2e07a tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 23:46:01 user nova-compute[75045]: WARNING nova.virt.libvirt.driver [None req-d410eb2b-2606-43e9-9277-11b0fab2e07a tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 23:46:01 user nova-compute[75045]: DEBUG nova.virt.libvirt.host [None req-d410eb2b-2606-43e9-9277-11b0fab2e07a tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75045) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 23:46:01 user nova-compute[75045]: DEBUG nova.virt.libvirt.host [None req-d410eb2b-2606-43e9-9277-11b0fab2e07a tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] CPU controller missing on host. {{(pid=75045) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 23:46:01 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:46:01 user nova-compute[75045]: DEBUG nova.virt.libvirt.host [None req-d410eb2b-2606-43e9-9277-11b0fab2e07a tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75045) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 23:46:01 user nova-compute[75045]: DEBUG nova.virt.libvirt.host [None req-d410eb2b-2606-43e9-9277-11b0fab2e07a tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] CPU controller found on host. {{(pid=75045) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 23:46:01 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-d410eb2b-2606-43e9-9277-11b0fab2e07a tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75045) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 23:46:01 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-d410eb2b-2606-43e9-9277-11b0fab2e07a tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T23:11:41Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75045) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 23:46:01 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-d410eb2b-2606-43e9-9277-11b0fab2e07a tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Flavor limits 0:0:0 {{(pid=75045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 23:46:01 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-d410eb2b-2606-43e9-9277-11b0fab2e07a tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Image limits 0:0:0 {{(pid=75045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 23:46:01 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-d410eb2b-2606-43e9-9277-11b0fab2e07a tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Flavor pref 0:0:0 {{(pid=75045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 23:46:01 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-d410eb2b-2606-43e9-9277-11b0fab2e07a tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Image pref 0:0:0 {{(pid=75045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 23:46:01 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-d410eb2b-2606-43e9-9277-11b0fab2e07a tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 23:46:01 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-d410eb2b-2606-43e9-9277-11b0fab2e07a tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75045) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 23:46:01 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-d410eb2b-2606-43e9-9277-11b0fab2e07a tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75045) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 23:46:01 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-d410eb2b-2606-43e9-9277-11b0fab2e07a tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Got 1 possible topologies {{(pid=75045) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 23:46:01 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-d410eb2b-2606-43e9-9277-11b0fab2e07a tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75045) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 23:46:01 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-d410eb2b-2606-43e9-9277-11b0fab2e07a tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75045) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 23:46:01 user nova-compute[75045]: DEBUG nova.objects.instance [None req-d410eb2b-2606-43e9-9277-11b0fab2e07a tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Lazy-loading 'vcpu_model' on Instance uuid 0b413c71-c13a-4fea-91c4-f6b1953d54c6 {{(pid=75045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 23:46:01 user nova-compute[75045]: DEBUG nova.objects.base [None req-d410eb2b-2606-43e9-9277-11b0fab2e07a tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Object Instance<0b413c71-c13a-4fea-91c4-f6b1953d54c6> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model {{(pid=75045) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 23:46:01 user nova-compute[75045]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d410eb2b-2606-43e9-9277-11b0fab2e07a tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] [instance: 0b413c71-c13a-4fea-91c4-f6b1953d54c6] Calling os-brick to attach iSCSI Volume {{(pid=75045) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 23:46:01 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-d410eb2b-2606-43e9-9277-11b0fab2e07a tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1b68210460>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:adcca529-746a-4b7a-966a-82909ff5b108', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'abIqSyev', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75045) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 23:46:01 user nova-compute[75045]: WARNING os_brick.initiator.connectors.base [None req-d410eb2b-2606-43e9-9277-11b0fab2e07a tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 23:46:01 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-d410eb2b-2606-43e9-9277-11b0fab2e07a tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 23:46:01 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-d410eb2b-2606-43e9-9277-11b0fab2e07a tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 23:46:01 user nova-compute[75045]: WARNING os_brick.initiator.connectors.base [None req-d410eb2b-2606-43e9-9277-11b0fab2e07a tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 23:46:01 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-d410eb2b-2606-43e9-9277-11b0fab2e07a tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:adcca529-746a-4b7a-966a-82909ff5b108" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 23:46:01 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-d410eb2b-2606-43e9-9277-11b0fab2e07a tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:adcca529-746a-4b7a-966a-82909ff5b108" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 23:46:01 user nova-compute[75045]: INFO os_brick.initiator.connectors.iscsi [None req-d410eb2b-2606-43e9-9277-11b0fab2e07a tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 23:46:01 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:adcca529-746a-4b7a-966a-82909ff5b108 -p 172.16.0.220:3260 {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:46:01 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:adcca529-746a-4b7a-966a-82909ff5b108 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:46:01 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[0580daf8-b195-41bf-9481-4a79adfb1577]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:46:01 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-d410eb2b-2606-43e9-9277-11b0fab2e07a tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 23:46:01 user nova-compute[75045]:  {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:46:01 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:adcca529-746a-4b7a-966a-82909ff5b108 -p 172.16.0.220:3260 --interface default --op new {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:46:01 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:adcca529-746a-4b7a-966a-82909ff5b108 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:46:01 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba4f5468-d330-42bb-aa01-8daa7a0b2c8f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:adcca529-746a-4b7a-966a-82909ff5b108] added\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:46:01 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-d410eb2b-2606-43e9-9277-11b0fab2e07a tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:adcca529-746a-4b7a-966a-82909ff5b108] added
Nov 08 23:46:01 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:46:01 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:adcca529-746a-4b7a-966a-82909ff5b108 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:46:01 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:adcca529-746a-4b7a-966a-82909ff5b108 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:46:01 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dee2412-ab4d-42a4-85ea-34fd1e17ad88]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:46:01 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-d410eb2b-2606-43e9-9277-11b0fab2e07a tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:46:01 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:adcca529-746a-4b7a-966a-82909ff5b108 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:46:02 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:adcca529-746a-4b7a-966a-82909ff5b108 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:46:02 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[69a79d94-5ce8-4b7c-a67b-d07f994209ed]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:46:02 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-d410eb2b-2606-43e9-9277-11b0fab2e07a tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:46:02 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:adcca529-746a-4b7a-966a-82909ff5b108 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v abIqSyev {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:46:02 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:adcca529-746a-4b7a-966a-82909ff5b108 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v abIqSyev" returned: 0 in 0.022s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:46:02 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[10a7c64b-e9a2-4c89-b80d-e3d33a5ddbd3]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:46:02 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-d410eb2b-2606-43e9-9277-11b0fab2e07a tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'abIqSyev'): stdout= stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:46:02 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:adcca529-746a-4b7a-966a-82909ff5b108 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:46:02 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:adcca529-746a-4b7a-966a-82909ff5b108 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:46:02 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[d12c5eea-8631-466a-a49c-ecbb0659b0a8]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:46:02 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-d410eb2b-2606-43e9-9277-11b0fab2e07a tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:46:02 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:46:02 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:46:02 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[92cf395d-635e-4264-a7bd-02f5aaccf34d]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22e58281-41b7-4be2-ace8-0750aa5d18f8 (non-flash)\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:46:02 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-d410eb2b-2606-43e9-9277-11b0fab2e07a tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22e58281-41b7-4be2-ace8-0750aa5d18f8 (non-flash)
Nov 08 23:46:02 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 23:46:02 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-d410eb2b-2606-43e9-9277-11b0fab2e07a tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22e58281-41b7-4be2-ace8-0750aa5d18f8 (non-flash)
Nov 08 23:46:02 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 23:46:02 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:adcca529-746a-4b7a-966a-82909ff5b108 -p 172.16.0.220:3260 --login {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:46:02 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:adcca529-746a-4b7a-966a-82909ff5b108 -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:46:02 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc555f47-1b91-4621-a9f4-69d4c262f968]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:adcca529-746a-4b7a-966a-82909ff5b108, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:adcca529-746a-4b7a-966a-82909ff5b108, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:46:02 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-d410eb2b-2606-43e9-9277-11b0fab2e07a tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:adcca529-746a-4b7a-966a-82909ff5b108, portal: 172.16.0.220,3260]
Nov 08 23:46:02 user nova-compute[75045]: Login to [iface: default, target: iqn.2010-10.org.openstack:adcca529-746a-4b7a-966a-82909ff5b108, portal: 172.16.0.220,3260] successful.
Nov 08 23:46:02 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:46:02 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:adcca529-746a-4b7a-966a-82909ff5b108 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:46:02 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:adcca529-746a-4b7a-966a-82909ff5b108 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:46:02 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1be88e1-9945-46c1-972d-8494d1186e03]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:46:02 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-d410eb2b-2606-43e9-9277-11b0fab2e07a tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:46:02 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:46:02 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:46:02 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[05f3aea1-fd28-494a-a93d-990fe01bc573]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22e58281-41b7-4be2-ace8-0750aa5d18f8 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:adcca529-746a-4b7a-966a-82909ff5b108 (non-flash)\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:46:02 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-d410eb2b-2606-43e9-9277-11b0fab2e07a tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22e58281-41b7-4be2-ace8-0750aa5d18f8 (non-flash)
Nov 08 23:46:02 user nova-compute[75045]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:adcca529-746a-4b7a-966a-82909ff5b108 (non-flash)
Nov 08 23:46:02 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 23:46:02 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-d410eb2b-2606-43e9-9277-11b0fab2e07a tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22e58281-41b7-4be2-ace8-0750aa5d18f8 (non-flash)
Nov 08 23:46:02 user nova-compute[75045]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:adcca529-746a-4b7a-966a-82909ff5b108 (non-flash)
Nov 08 23:46:02 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 23:46:02 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-d410eb2b-2606-43e9-9277-11b0fab2e07a tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:adcca529-746a-4b7a-966a-82909ff5b108" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.282s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 23:46:02 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-d410eb2b-2606-43e9-9277-11b0fab2e07a tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Connected to 172.16.0.220:3260 {{(pid=75045) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 23:46:02 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-d410eb2b-2606-43e9-9277-11b0fab2e07a tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] HCTL ('33', '-', '-', 0) found on session 45 with lun 0 {{(pid=75045) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 23:46:02 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-d410eb2b-2606-43e9-9277-11b0fab2e07a tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75045) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 23:46:02 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:46:02 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:46:02 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[36566073-5a33-47dd-acf9-fd9868795e3c]: (4, ('- - 0', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:46:02 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-d410eb2b-2606-43e9-9277-11b0fab2e07a tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Searching for a device in session 45 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75045) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 23:46:02 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-d410eb2b-2606-43e9-9277-11b0fab2e07a tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:adcca529-746a-4b7a-966a-82909ff5b108', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'abIqSyev', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75045) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 23:46:03 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-d410eb2b-2606-43e9-9277-11b0fab2e07a tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.313s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 23:46:03 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-d410eb2b-2606-43e9-9277-11b0fab2e07a tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] <== connect_volume: return (1315ms) {'type': 'block', 'scsi_wwn': '23531366439363266', 'path': '/dev/sdb'} {{(pid=75045) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 23:46:03 user nova-compute[75045]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d410eb2b-2606-43e9-9277-11b0fab2e07a tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] [instance: 0b413c71-c13a-4fea-91c4-f6b1953d54c6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23531366439363266', 'path': '/dev/sdb'} {{(pid=75045) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 23:46:03 user nova-compute[75045]: DEBUG nova.virt.libvirt.vif [None req-d410eb2b-2606-43e9-9277-11b0fab2e07a tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T23:41:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1115991455',display_name='tempest-AttachVolumeTestJSON-server-1115991455',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1115991455',id=42,image_ref='a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDP62TKuY3xQeSwtOVfapZleQ+Udsdwyg62rL9eK489WlMG5ccA/qQJy7H2wra4KXAElLeGxPHWcXNl9vwyU6pMJ292WwpOYwEUeIcXde3ufxVUWLY5U6GVW+3+zkZGZTw==',key_name='tempest-keypair-777988029',keypairs=<?>,launch_index=0,launched_at=2023-11-08T23:41:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='c8be85d72bc440899f3ccb64b923e90e',ramdisk_id='',reservation_id='r-m3eq8ay7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1852573580',owner_user_name='tempest-AttachVolumeTestJSON-1852573580-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T23:44:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1e3647ad15a24f1584685f9340eae5bd',uuid=0b413c71-c13a-4fea-91c4-f6b1953d54c6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "166cceb4-9b95-4bdd-a3ad-b6aad94dfed0", "address": "fa:16:3e:17:84:3d", "network": {"id": "e31c3d41-e46f-4c74-8ef5-8243a391dde8", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-856540424-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.149", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c8be85d72bc440899f3ccb64b923e90e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap166cceb4-9b", "ovs_interfaceid": "166cceb4-9b95-4bdd-a3ad-b6aad94dfed0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75045) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 23:46:03 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-d410eb2b-2606-43e9-9277-11b0fab2e07a tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Converting VIF {"id": "166cceb4-9b95-4bdd-a3ad-b6aad94dfed0", "address": "fa:16:3e:17:84:3d", "network": {"id": "e31c3d41-e46f-4c74-8ef5-8243a391dde8", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-856540424-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.149", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c8be85d72bc440899f3ccb64b923e90e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap166cceb4-9b", "ovs_interfaceid": "166cceb4-9b95-4bdd-a3ad-b6aad94dfed0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 23:46:03 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-d410eb2b-2606-43e9-9277-11b0fab2e07a tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:17:84:3d,bridge_name='br-int',has_traffic_filtering=True,id=166cceb4-9b95-4bdd-a3ad-b6aad94dfed0,network=Network(e31c3d41-e46f-4c74-8ef5-8243a391dde8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap166cceb4-9b') {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 23:46:03 user nova-compute[75045]: DEBUG nova.objects.instance [None req-d410eb2b-2606-43e9-9277-11b0fab2e07a tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Lazy-loading 'pci_devices' on Instance uuid 0b413c71-c13a-4fea-91c4-f6b1953d54c6 {{(pid=75045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 23:46:03 user nova-compute[75045]: DEBUG nova.objects.base [None req-d410eb2b-2606-43e9-9277-11b0fab2e07a tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Object Instance<0b413c71-c13a-4fea-91c4-f6b1953d54c6> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices {{(pid=75045) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 23:46:03 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-d410eb2b-2606-43e9-9277-11b0fab2e07a tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] [instance: 0b413c71-c13a-4fea-91c4-f6b1953d54c6] End _get_guest_xml xml=<domain type="kvm">
Nov 08 23:46:03 user nova-compute[75045]:   <uuid>0b413c71-c13a-4fea-91c4-f6b1953d54c6</uuid>
Nov 08 23:46:03 user nova-compute[75045]:   <name>instance-0000002a</name>
Nov 08 23:46:03 user nova-compute[75045]:   <memory>524288</memory>
Nov 08 23:46:03 user nova-compute[75045]:   <vcpu>1</vcpu>
Nov 08 23:46:03 user nova-compute[75045]:   <metadata>
Nov 08 23:46:03 user nova-compute[75045]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 23:46:03 user nova-compute[75045]:       <nova:package version="0.0.0"/>
Nov 08 23:46:03 user nova-compute[75045]:       <nova:name>tempest-AttachVolumeTestJSON-server-1115991455</nova:name>
Nov 08 23:46:03 user nova-compute[75045]:       <nova:creationTime>2023-11-08 23:46:01</nova:creationTime>
Nov 08 23:46:03 user nova-compute[75045]:       <nova:flavor name="m1.tiny">
Nov 08 23:46:03 user nova-compute[75045]:         <nova:memory>512</nova:memory>
Nov 08 23:46:03 user nova-compute[75045]:         <nova:disk>1</nova:disk>
Nov 08 23:46:03 user nova-compute[75045]:         <nova:swap>0</nova:swap>
Nov 08 23:46:03 user nova-compute[75045]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 23:46:03 user nova-compute[75045]:         <nova:vcpus>1</nova:vcpus>
Nov 08 23:46:03 user nova-compute[75045]:       </nova:flavor>
Nov 08 23:46:03 user nova-compute[75045]:       <nova:owner>
Nov 08 23:46:03 user nova-compute[75045]:         <nova:user uuid="1e3647ad15a24f1584685f9340eae5bd">tempest-AttachVolumeTestJSON-1852573580-project-member</nova:user>
Nov 08 23:46:03 user nova-compute[75045]:         <nova:project uuid="c8be85d72bc440899f3ccb64b923e90e">tempest-AttachVolumeTestJSON-1852573580</nova:project>
Nov 08 23:46:03 user nova-compute[75045]:       </nova:owner>
Nov 08 23:46:03 user nova-compute[75045]:       <nova:root type="image" uuid="a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb"/>
Nov 08 23:46:03 user nova-compute[75045]:       <nova:ports>
Nov 08 23:46:03 user nova-compute[75045]:         <nova:port uuid="166cceb4-9b95-4bdd-a3ad-b6aad94dfed0">
Nov 08 23:46:03 user nova-compute[75045]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 08 23:46:03 user nova-compute[75045]:         </nova:port>
Nov 08 23:46:03 user nova-compute[75045]:       </nova:ports>
Nov 08 23:46:03 user nova-compute[75045]:     </nova:instance>
Nov 08 23:46:03 user nova-compute[75045]:   </metadata>
Nov 08 23:46:03 user nova-compute[75045]:   <sysinfo type="smbios">
Nov 08 23:46:03 user nova-compute[75045]:     <system>
Nov 08 23:46:03 user nova-compute[75045]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 23:46:03 user nova-compute[75045]:       <entry name="product">OpenStack Nova</entry>
Nov 08 23:46:03 user nova-compute[75045]:       <entry name="version">0.0.0</entry>
Nov 08 23:46:03 user nova-compute[75045]:       <entry name="serial">0b413c71-c13a-4fea-91c4-f6b1953d54c6</entry>
Nov 08 23:46:03 user nova-compute[75045]:       <entry name="uuid">0b413c71-c13a-4fea-91c4-f6b1953d54c6</entry>
Nov 08 23:46:03 user nova-compute[75045]:       <entry name="family">Virtual Machine</entry>
Nov 08 23:46:03 user nova-compute[75045]:     </system>
Nov 08 23:46:03 user nova-compute[75045]:   </sysinfo>
Nov 08 23:46:03 user nova-compute[75045]:   <os>
Nov 08 23:46:03 user nova-compute[75045]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 23:46:03 user nova-compute[75045]:     <boot dev="hd"/>
Nov 08 23:46:03 user nova-compute[75045]:     <smbios mode="sysinfo"/>
Nov 08 23:46:03 user nova-compute[75045]:   </os>
Nov 08 23:46:03 user nova-compute[75045]:   <features>
Nov 08 23:46:03 user nova-compute[75045]:     <acpi/>
Nov 08 23:46:03 user nova-compute[75045]:     <apic/>
Nov 08 23:46:03 user nova-compute[75045]:     <vmcoreinfo/>
Nov 08 23:46:03 user nova-compute[75045]:   </features>
Nov 08 23:46:03 user nova-compute[75045]:   <clock offset="utc">
Nov 08 23:46:03 user nova-compute[75045]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 23:46:03 user nova-compute[75045]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 23:46:03 user nova-compute[75045]:     <timer name="hpet" present="no"/>
Nov 08 23:46:03 user nova-compute[75045]:   </clock>
Nov 08 23:46:03 user nova-compute[75045]:   <cpu mode="custom" match="exact">
Nov 08 23:46:03 user nova-compute[75045]:     <model>Nehalem</model>
Nov 08 23:46:03 user nova-compute[75045]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 23:46:03 user nova-compute[75045]:   </cpu>
Nov 08 23:46:03 user nova-compute[75045]:   <devices>
Nov 08 23:46:03 user nova-compute[75045]:     <disk type="file" device="disk">
Nov 08 23:46:03 user nova-compute[75045]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 23:46:03 user nova-compute[75045]:       <source file="/opt/stack/data/nova/instances/0b413c71-c13a-4fea-91c4-f6b1953d54c6/disk"/>
Nov 08 23:46:03 user nova-compute[75045]:       <target dev="vda" bus="virtio"/>
Nov 08 23:46:03 user nova-compute[75045]:     </disk>
Nov 08 23:46:03 user nova-compute[75045]:     <disk type="block" device="disk">
Nov 08 23:46:03 user nova-compute[75045]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 23:46:03 user nova-compute[75045]:       <source dev="/dev/sdb"/>
Nov 08 23:46:03 user nova-compute[75045]:       <target dev="vdb" bus="virtio"/>
Nov 08 23:46:03 user nova-compute[75045]:       <serial>adcca529-746a-4b7a-966a-82909ff5b108</serial>
Nov 08 23:46:03 user nova-compute[75045]:     </disk>
Nov 08 23:46:03 user nova-compute[75045]:     <interface type="ethernet">
Nov 08 23:46:03 user nova-compute[75045]:       <mac address="fa:16:3e:17:84:3d"/>
Nov 08 23:46:03 user nova-compute[75045]:       <model type="virtio"/>
Nov 08 23:46:03 user nova-compute[75045]:       <mtu size="1442"/>
Nov 08 23:46:03 user nova-compute[75045]:       <target dev="tap166cceb4-9b"/>
Nov 08 23:46:03 user nova-compute[75045]:     </interface>
Nov 08 23:46:03 user nova-compute[75045]:     <serial type="pty">
Nov 08 23:46:03 user nova-compute[75045]:       <log file="/opt/stack/data/nova/instances/0b413c71-c13a-4fea-91c4-f6b1953d54c6/console.log" append="off"/>
Nov 08 23:46:03 user nova-compute[75045]:     </serial>
Nov 08 23:46:03 user nova-compute[75045]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 23:46:03 user nova-compute[75045]:     <video>
Nov 08 23:46:03 user nova-compute[75045]:       <model type="virtio"/>
Nov 08 23:46:03 user nova-compute[75045]:     </video>
Nov 08 23:46:03 user nova-compute[75045]:     <rng model="virtio">
Nov 08 23:46:03 user nova-compute[75045]:       <backend model="random">/dev/urandom</backend>
Nov 08 23:46:03 user nova-compute[75045]:     </rng>
Nov 08 23:46:03 user nova-compute[75045]:     <controller type="usb" index="0" model="none"/>
Nov 08 23:46:03 user nova-compute[75045]:     <memballoon model="virtio">
Nov 08 23:46:03 user nova-compute[75045]:       <stats period="10"/>
Nov 08 23:46:03 user nova-compute[75045]:     </memballoon>
Nov 08 23:46:03 user nova-compute[75045]:   </devices>
Nov 08 23:46:03 user nova-compute[75045]: </domain>
Nov 08 23:46:03 user nova-compute[75045]:  {{(pid=75045) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 23:46:03 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-d410eb2b-2606-43e9-9277-11b0fab2e07a tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b413c71-c13a-4fea-91c4-f6b1953d54c6/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:46:03 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-d410eb2b-2606-43e9-9277-11b0fab2e07a tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b413c71-c13a-4fea-91c4-f6b1953d54c6/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:46:03 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-d410eb2b-2606-43e9-9277-11b0fab2e07a tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b413c71-c13a-4fea-91c4-f6b1953d54c6/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:46:03 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-d410eb2b-2606-43e9-9277-11b0fab2e07a tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b413c71-c13a-4fea-91c4-f6b1953d54c6/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:46:03 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-d410eb2b-2606-43e9-9277-11b0fab2e07a tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75045) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 23:46:03 user nova-compute[75045]: DEBUG nova.objects.instance [None req-d410eb2b-2606-43e9-9277-11b0fab2e07a tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Lazy-loading 'trusted_certs' on Instance uuid 0b413c71-c13a-4fea-91c4-f6b1953d54c6 {{(pid=75045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 23:46:03 user nova-compute[75045]: DEBUG nova.objects.base [None req-d410eb2b-2606-43e9-9277-11b0fab2e07a tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Object Instance<0b413c71-c13a-4fea-91c4-f6b1953d54c6> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs {{(pid=75045) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 23:46:03 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-d410eb2b-2606-43e9-9277-11b0fab2e07a tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b59f52a99fff51c56dd1edfb83892fb8f647f2f3 --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:46:03 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-d410eb2b-2606-43e9-9277-11b0fab2e07a tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b59f52a99fff51c56dd1edfb83892fb8f647f2f3 --force-share --output=json" returned: 0 in 0.169s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:46:03 user nova-compute[75045]: DEBUG nova.virt.disk.api [None req-d410eb2b-2606-43e9-9277-11b0fab2e07a tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0b413c71-c13a-4fea-91c4-f6b1953d54c6/disk. size=1073741824 {{(pid=75045) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 23:46:03 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-d410eb2b-2606-43e9-9277-11b0fab2e07a tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b413c71-c13a-4fea-91c4-f6b1953d54c6/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:46:03 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:46:03 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager.update_available_resource {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:46:04 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:46:04 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:46:04 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:46:04 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Auditing locally available compute resources for user (node: user) {{(pid=75045) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 23:46:04 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-d410eb2b-2606-43e9-9277-11b0fab2e07a tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b413c71-c13a-4fea-91c4-f6b1953d54c6/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:46:04 user nova-compute[75045]: DEBUG nova.virt.disk.api [None req-d410eb2b-2606-43e9-9277-11b0fab2e07a tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Cannot resize image /opt/stack/data/nova/instances/0b413c71-c13a-4fea-91c4-f6b1953d54c6/disk to a smaller size. {{(pid=75045) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 08 23:46:04 user nova-compute[75045]: DEBUG nova.objects.instance [None req-d410eb2b-2606-43e9-9277-11b0fab2e07a tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Lazy-loading 'migration_context' on Instance uuid 0b413c71-c13a-4fea-91c4-f6b1953d54c6 {{(pid=75045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 23:46:04 user nova-compute[75045]: DEBUG nova.objects.base [None req-d410eb2b-2606-43e9-9277-11b0fab2e07a tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Object Instance<0b413c71-c13a-4fea-91c4-f6b1953d54c6> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=75045) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 23:46:04 user nova-compute[75045]: DEBUG nova.virt.libvirt.vif [None req-d410eb2b-2606-43e9-9277-11b0fab2e07a tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T23:41:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1115991455',display_name='tempest-AttachVolumeTestJSON-server-1115991455',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1115991455',id=42,image_ref='a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDP62TKuY3xQeSwtOVfapZleQ+Udsdwyg62rL9eK489WlMG5ccA/qQJy7H2wra4KXAElLeGxPHWcXNl9vwyU6pMJ292WwpOYwEUeIcXde3ufxVUWLY5U6GVW+3+zkZGZTw==',key_name='tempest-keypair-777988029',keypairs=<?>,launch_index=0,launched_at=2023-11-08T23:41:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='c8be85d72bc440899f3ccb64b923e90e',ramdisk_id='',reservation_id='r-m3eq8ay7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1852573580',owner_user_name='tempest-AttachVolumeTestJSON-1852573580-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T23:44:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1e3647ad15a24f1584685f9340eae5bd',uuid=0b413c71-c13a-4fea-91c4-f6b1953d54c6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "166cceb4-9b95-4bdd-a3ad-b6aad94dfed0", "address": "fa:16:3e:17:84:3d", "network": {"id": "e31c3d41-e46f-4c74-8ef5-8243a391dde8", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-856540424-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.149", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c8be85d72bc440899f3ccb64b923e90e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap166cceb4-9b", "ovs_interfaceid": "166cceb4-9b95-4bdd-a3ad-b6aad94dfed0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75045) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 23:46:04 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-d410eb2b-2606-43e9-9277-11b0fab2e07a tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Converting VIF {"id": "166cceb4-9b95-4bdd-a3ad-b6aad94dfed0", "address": "fa:16:3e:17:84:3d", "network": {"id": "e31c3d41-e46f-4c74-8ef5-8243a391dde8", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-856540424-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.149", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c8be85d72bc440899f3ccb64b923e90e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap166cceb4-9b", "ovs_interfaceid": "166cceb4-9b95-4bdd-a3ad-b6aad94dfed0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 23:46:04 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-d410eb2b-2606-43e9-9277-11b0fab2e07a tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:17:84:3d,bridge_name='br-int',has_traffic_filtering=True,id=166cceb4-9b95-4bdd-a3ad-b6aad94dfed0,network=Network(e31c3d41-e46f-4c74-8ef5-8243a391dde8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap166cceb4-9b') {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 23:46:04 user nova-compute[75045]: DEBUG os_vif [None req-d410eb2b-2606-43e9-9277-11b0fab2e07a tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:17:84:3d,bridge_name='br-int',has_traffic_filtering=True,id=166cceb4-9b95-4bdd-a3ad-b6aad94dfed0,network=Network(e31c3d41-e46f-4c74-8ef5-8243a391dde8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap166cceb4-9b') {{(pid=75045) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 23:46:04 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:46:04 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:46:04 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 23:46:04 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:46:04 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '51e287f5-9b55-532a-b2f3-73adf8fe8b59', '_type': 'linux-noop'}}, row=False) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:46:04 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:46:04 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 23:46:04 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:46:04 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap166cceb4-9b, may_exist=True, interface_attrs={}) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:46:04 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap166cceb4-9b, col_values=(('qos', UUID('f84a1c57-1d2d-4c5f-9d96-f95673b46195')),), if_exists=True) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:46:04 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap166cceb4-9b, col_values=(('external_ids', {'iface-id': '166cceb4-9b95-4bdd-a3ad-b6aad94dfed0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:17:84:3d', 'vm-uuid': '0b413c71-c13a-4fea-91c4-f6b1953d54c6'}),), if_exists=True) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:46:04 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:46:04 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 23:46:04 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:46:04 user nova-compute[75045]: INFO os_vif [None req-d410eb2b-2606-43e9-9277-11b0fab2e07a tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:17:84:3d,bridge_name='br-int',has_traffic_filtering=True,id=166cceb4-9b95-4bdd-a3ad-b6aad94dfed0,network=Network(e31c3d41-e46f-4c74-8ef5-8243a391dde8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap166cceb4-9b')
Nov 08 23:46:04 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75045) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 23:46:04 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/584e3043-addf-41f7-a3cd-de51c229af72/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:46:04 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/584e3043-addf-41f7-a3cd-de51c229af72/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:46:04 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/584e3043-addf-41f7-a3cd-de51c229af72/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:46:04 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/584e3043-addf-41f7-a3cd-de51c229af72/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:46:04 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/244c4cc9-2837-40c9-b4ad-37dc435c9749/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:46:04 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/244c4cc9-2837-40c9-b4ad-37dc435c9749/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:46:04 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/244c4cc9-2837-40c9-b4ad-37dc435c9749/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:46:04 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/244c4cc9-2837-40c9-b4ad-37dc435c9749/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:46:05 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:46:05 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:46:05 user nova-compute[75045]: WARNING nova.virt.libvirt.driver [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 23:46:05 user nova-compute[75045]: WARNING nova.virt.libvirt.driver [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 23:46:05 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Hypervisor/Node resource view: name=user free_ram=8548MB free_disk=25.023414611816406GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75045) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 23:46:05 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:46:05 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:46:05 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Instance 244c4cc9-2837-40c9-b4ad-37dc435c9749 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75045) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 23:46:05 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Instance 0b413c71-c13a-4fea-91c4-f6b1953d54c6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75045) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 23:46:05 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Instance 37502077-b02b-4f0c-b654-8a6cef607efa actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75045) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 23:46:05 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Instance 584e3043-addf-41f7-a3cd-de51c229af72 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75045) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 23:46:05 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=75045) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 23:46:05 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=75045) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 23:46:05 user nova-compute[75045]: DEBUG nova.compute.manager [req-983445c3-26c2-4a74-93af-71f9a81816c5 req-37328772-2d07-465d-8252-8d22e68db956 service nova] [instance: 0b413c71-c13a-4fea-91c4-f6b1953d54c6] Received event network-vif-plugged-166cceb4-9b95-4bdd-a3ad-b6aad94dfed0 {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:46:05 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-983445c3-26c2-4a74-93af-71f9a81816c5 req-37328772-2d07-465d-8252-8d22e68db956 service nova] Acquiring lock "0b413c71-c13a-4fea-91c4-f6b1953d54c6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:46:05 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-983445c3-26c2-4a74-93af-71f9a81816c5 req-37328772-2d07-465d-8252-8d22e68db956 service nova] Lock "0b413c71-c13a-4fea-91c4-f6b1953d54c6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:46:05 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-983445c3-26c2-4a74-93af-71f9a81816c5 req-37328772-2d07-465d-8252-8d22e68db956 service nova] Lock "0b413c71-c13a-4fea-91c4-f6b1953d54c6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:46:05 user nova-compute[75045]: DEBUG nova.compute.manager [req-983445c3-26c2-4a74-93af-71f9a81816c5 req-37328772-2d07-465d-8252-8d22e68db956 service nova] [instance: 0b413c71-c13a-4fea-91c4-f6b1953d54c6] No waiting events found dispatching network-vif-plugged-166cceb4-9b95-4bdd-a3ad-b6aad94dfed0 {{(pid=75045) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 23:46:05 user nova-compute[75045]: WARNING nova.compute.manager [req-983445c3-26c2-4a74-93af-71f9a81816c5 req-37328772-2d07-465d-8252-8d22e68db956 service nova] [instance: 0b413c71-c13a-4fea-91c4-f6b1953d54c6] Received unexpected event network-vif-plugged-166cceb4-9b95-4bdd-a3ad-b6aad94dfed0 for instance with vm_state stopped and task_state powering-on.
Nov 08 23:46:05 user nova-compute[75045]: DEBUG nova.compute.provider_tree [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Inventory has not changed in ProviderTree for provider: 62ba5f85-c74d-4b58-986e-d4197e813fd7 {{(pid=75045) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 23:46:05 user nova-compute[75045]: DEBUG nova.scheduler.client.report [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Inventory has not changed for provider 62ba5f85-c74d-4b58-986e-d4197e813fd7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75045) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 23:46:05 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Compute_service record updated for user:user {{(pid=75045) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 23:46:05 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.385s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:46:06 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:46:06 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:46:06 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:46:06 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:46:07 user nova-compute[75045]: DEBUG nova.compute.manager [None req-d410eb2b-2606-43e9-9277-11b0fab2e07a tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] [instance: 0b413c71-c13a-4fea-91c4-f6b1953d54c6] Instance event wait completed in 0 seconds for  {{(pid=75045) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 23:46:07 user nova-compute[75045]: INFO nova.virt.libvirt.driver [-] [instance: 0b413c71-c13a-4fea-91c4-f6b1953d54c6] Instance rebooted successfully.
Nov 08 23:46:07 user nova-compute[75045]: DEBUG nova.compute.manager [None req-d410eb2b-2606-43e9-9277-11b0fab2e07a tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] [instance: 0b413c71-c13a-4fea-91c4-f6b1953d54c6] Checking state {{(pid=75045) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 23:46:07 user nova-compute[75045]: DEBUG nova.compute.manager [req-6a5222cf-99ce-4439-9358-5983bda00210 req-8be39825-fc06-4eb1-8d0b-4569524aa661 service nova] [instance: 0b413c71-c13a-4fea-91c4-f6b1953d54c6] Received event network-vif-plugged-166cceb4-9b95-4bdd-a3ad-b6aad94dfed0 {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:46:07 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-6a5222cf-99ce-4439-9358-5983bda00210 req-8be39825-fc06-4eb1-8d0b-4569524aa661 service nova] Acquiring lock "0b413c71-c13a-4fea-91c4-f6b1953d54c6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:46:07 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-6a5222cf-99ce-4439-9358-5983bda00210 req-8be39825-fc06-4eb1-8d0b-4569524aa661 service nova] Lock "0b413c71-c13a-4fea-91c4-f6b1953d54c6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:46:07 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-6a5222cf-99ce-4439-9358-5983bda00210 req-8be39825-fc06-4eb1-8d0b-4569524aa661 service nova] Lock "0b413c71-c13a-4fea-91c4-f6b1953d54c6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:46:07 user nova-compute[75045]: DEBUG nova.compute.manager [req-6a5222cf-99ce-4439-9358-5983bda00210 req-8be39825-fc06-4eb1-8d0b-4569524aa661 service nova] [instance: 0b413c71-c13a-4fea-91c4-f6b1953d54c6] No waiting events found dispatching network-vif-plugged-166cceb4-9b95-4bdd-a3ad-b6aad94dfed0 {{(pid=75045) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 23:46:07 user nova-compute[75045]: WARNING nova.compute.manager [req-6a5222cf-99ce-4439-9358-5983bda00210 req-8be39825-fc06-4eb1-8d0b-4569524aa661 service nova] [instance: 0b413c71-c13a-4fea-91c4-f6b1953d54c6] Received unexpected event network-vif-plugged-166cceb4-9b95-4bdd-a3ad-b6aad94dfed0 for instance with vm_state stopped and task_state powering-on.
Nov 08 23:46:09 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:46:09 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-1548c155-2750-4b8a-959c-8e7b0cb959cd tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Acquiring lock "0fb331fa-231e-482e-abfc-df39b13fb33a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:46:09 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-1548c155-2750-4b8a-959c-8e7b0cb959cd tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Lock "0fb331fa-231e-482e-abfc-df39b13fb33a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:46:09 user nova-compute[75045]: DEBUG nova.compute.manager [None req-1548c155-2750-4b8a-959c-8e7b0cb959cd tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] [instance: 0fb331fa-231e-482e-abfc-df39b13fb33a] Starting instance... {{(pid=75045) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 23:46:10 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-1548c155-2750-4b8a-959c-8e7b0cb959cd tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:46:10 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-1548c155-2750-4b8a-959c-8e7b0cb959cd tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:46:10 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-1548c155-2750-4b8a-959c-8e7b0cb959cd tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75045) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 23:46:10 user nova-compute[75045]: INFO nova.compute.claims [None req-1548c155-2750-4b8a-959c-8e7b0cb959cd tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] [instance: 0fb331fa-231e-482e-abfc-df39b13fb33a] Claim successful on node user
Nov 08 23:46:10 user nova-compute[75045]: DEBUG nova.compute.provider_tree [None req-1548c155-2750-4b8a-959c-8e7b0cb959cd tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Inventory has not changed in ProviderTree for provider: 62ba5f85-c74d-4b58-986e-d4197e813fd7 {{(pid=75045) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 23:46:10 user nova-compute[75045]: DEBUG nova.scheduler.client.report [None req-1548c155-2750-4b8a-959c-8e7b0cb959cd tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Inventory has not changed for provider 62ba5f85-c74d-4b58-986e-d4197e813fd7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75045) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 23:46:10 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-1548c155-2750-4b8a-959c-8e7b0cb959cd tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.310s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:46:10 user nova-compute[75045]: DEBUG nova.compute.manager [None req-1548c155-2750-4b8a-959c-8e7b0cb959cd tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] [instance: 0fb331fa-231e-482e-abfc-df39b13fb33a] Start building networks asynchronously for instance. {{(pid=75045) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 23:46:10 user nova-compute[75045]: INFO nova.virt.libvirt.driver [None req-1548c155-2750-4b8a-959c-8e7b0cb959cd tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] [instance: 0fb331fa-231e-482e-abfc-df39b13fb33a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 23:46:10 user nova-compute[75045]: DEBUG nova.compute.manager [None req-1548c155-2750-4b8a-959c-8e7b0cb959cd tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] [instance: 0fb331fa-231e-482e-abfc-df39b13fb33a] Allocating IP information in the background. {{(pid=75045) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 23:46:10 user nova-compute[75045]: DEBUG nova.network.neutron [None req-1548c155-2750-4b8a-959c-8e7b0cb959cd tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] [instance: 0fb331fa-231e-482e-abfc-df39b13fb33a] allocate_for_instance() {{(pid=75045) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 23:46:10 user nova-compute[75045]: DEBUG nova.compute.manager [None req-1548c155-2750-4b8a-959c-8e7b0cb959cd tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] [instance: 0fb331fa-231e-482e-abfc-df39b13fb33a] Start building block device mappings for instance. {{(pid=75045) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 23:46:10 user nova-compute[75045]: DEBUG nova.policy [None req-1548c155-2750-4b8a-959c-8e7b0cb959cd tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '76c31c64d9594f9cbef7586fafb48721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd59b73851c79473a9c2cdc0a120dfee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75045) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 23:46:10 user nova-compute[75045]: INFO nova.virt.block_device [None req-1548c155-2750-4b8a-959c-8e7b0cb959cd tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] [instance: 0fb331fa-231e-482e-abfc-df39b13fb33a] Booting with volume snapshot ea34bc69-ade9-4aff-850d-1a11bd12aa5c at /dev/vda
Nov 08 23:46:11 user nova-compute[75045]: DEBUG nova.network.neutron [None req-1548c155-2750-4b8a-959c-8e7b0cb959cd tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] [instance: 0fb331fa-231e-482e-abfc-df39b13fb33a] Successfully created port: 0c7a4468-f510-4a33-8ee7-d70da98f972b {{(pid=75045) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 23:46:11 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:46:12 user nova-compute[75045]: DEBUG nova.network.neutron [None req-1548c155-2750-4b8a-959c-8e7b0cb959cd tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] [instance: 0fb331fa-231e-482e-abfc-df39b13fb33a] Successfully updated port: 0c7a4468-f510-4a33-8ee7-d70da98f972b {{(pid=75045) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 23:46:12 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-1548c155-2750-4b8a-959c-8e7b0cb959cd tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Acquiring lock "refresh_cache-0fb331fa-231e-482e-abfc-df39b13fb33a" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 23:46:12 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-1548c155-2750-4b8a-959c-8e7b0cb959cd tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Acquired lock "refresh_cache-0fb331fa-231e-482e-abfc-df39b13fb33a" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 23:46:12 user nova-compute[75045]: DEBUG nova.network.neutron [None req-1548c155-2750-4b8a-959c-8e7b0cb959cd tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] [instance: 0fb331fa-231e-482e-abfc-df39b13fb33a] Building network info cache for instance {{(pid=75045) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 23:46:12 user nova-compute[75045]: DEBUG nova.compute.manager [req-1329a8ef-3890-4c96-b583-568b41059ccd req-56d0cc69-6a73-4394-93de-932d9623f8bf service nova] [instance: 0fb331fa-231e-482e-abfc-df39b13fb33a] Received event network-changed-0c7a4468-f510-4a33-8ee7-d70da98f972b {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:46:12 user nova-compute[75045]: DEBUG nova.compute.manager [req-1329a8ef-3890-4c96-b583-568b41059ccd req-56d0cc69-6a73-4394-93de-932d9623f8bf service nova] [instance: 0fb331fa-231e-482e-abfc-df39b13fb33a] Refreshing instance network info cache due to event network-changed-0c7a4468-f510-4a33-8ee7-d70da98f972b. {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 23:46:12 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-1329a8ef-3890-4c96-b583-568b41059ccd req-56d0cc69-6a73-4394-93de-932d9623f8bf service nova] Acquiring lock "refresh_cache-0fb331fa-231e-482e-abfc-df39b13fb33a" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 23:46:12 user nova-compute[75045]: DEBUG nova.network.neutron [None req-1548c155-2750-4b8a-959c-8e7b0cb959cd tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] [instance: 0fb331fa-231e-482e-abfc-df39b13fb33a] Instance cache missing network info. {{(pid=75045) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 23:46:12 user nova-compute[75045]: DEBUG nova.network.neutron [None req-1548c155-2750-4b8a-959c-8e7b0cb959cd tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] [instance: 0fb331fa-231e-482e-abfc-df39b13fb33a] Updating instance_info_cache with network_info: [{"id": "0c7a4468-f510-4a33-8ee7-d70da98f972b", "address": "fa:16:3e:8a:8b:88", "network": {"id": "4205f899-9865-4c65-8b46-c9a533e9bb45", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-774780781-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d59b73851c79473a9c2cdc0a120dfee0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c7a4468-f5", "ovs_interfaceid": "0c7a4468-f510-4a33-8ee7-d70da98f972b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75045) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 23:46:12 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-1548c155-2750-4b8a-959c-8e7b0cb959cd tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Releasing lock "refresh_cache-0fb331fa-231e-482e-abfc-df39b13fb33a" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 23:46:12 user nova-compute[75045]: DEBUG nova.compute.manager [None req-1548c155-2750-4b8a-959c-8e7b0cb959cd tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] [instance: 0fb331fa-231e-482e-abfc-df39b13fb33a] Instance network_info: |[{"id": "0c7a4468-f510-4a33-8ee7-d70da98f972b", "address": "fa:16:3e:8a:8b:88", "network": {"id": "4205f899-9865-4c65-8b46-c9a533e9bb45", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-774780781-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d59b73851c79473a9c2cdc0a120dfee0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c7a4468-f5", "ovs_interfaceid": "0c7a4468-f510-4a33-8ee7-d70da98f972b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75045) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 23:46:12 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-1329a8ef-3890-4c96-b583-568b41059ccd req-56d0cc69-6a73-4394-93de-932d9623f8bf service nova] Acquired lock "refresh_cache-0fb331fa-231e-482e-abfc-df39b13fb33a" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 23:46:12 user nova-compute[75045]: DEBUG nova.network.neutron [req-1329a8ef-3890-4c96-b583-568b41059ccd req-56d0cc69-6a73-4394-93de-932d9623f8bf service nova] [instance: 0fb331fa-231e-482e-abfc-df39b13fb33a] Refreshing network info cache for port 0c7a4468-f510-4a33-8ee7-d70da98f972b {{(pid=75045) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 23:46:12 user nova-compute[75045]: DEBUG nova.network.neutron [req-1329a8ef-3890-4c96-b583-568b41059ccd req-56d0cc69-6a73-4394-93de-932d9623f8bf service nova] [instance: 0fb331fa-231e-482e-abfc-df39b13fb33a] Updated VIF entry in instance network info cache for port 0c7a4468-f510-4a33-8ee7-d70da98f972b. {{(pid=75045) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 23:46:12 user nova-compute[75045]: DEBUG nova.network.neutron [req-1329a8ef-3890-4c96-b583-568b41059ccd req-56d0cc69-6a73-4394-93de-932d9623f8bf service nova] [instance: 0fb331fa-231e-482e-abfc-df39b13fb33a] Updating instance_info_cache with network_info: [{"id": "0c7a4468-f510-4a33-8ee7-d70da98f972b", "address": "fa:16:3e:8a:8b:88", "network": {"id": "4205f899-9865-4c65-8b46-c9a533e9bb45", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-774780781-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d59b73851c79473a9c2cdc0a120dfee0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c7a4468-f5", "ovs_interfaceid": "0c7a4468-f510-4a33-8ee7-d70da98f972b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75045) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 23:46:12 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-1329a8ef-3890-4c96-b583-568b41059ccd req-56d0cc69-6a73-4394-93de-932d9623f8bf service nova] Releasing lock "refresh_cache-0fb331fa-231e-482e-abfc-df39b13fb33a" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 23:46:14 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:46:16 user nova-compute[75045]: DEBUG os_brick.utils [None req-1548c155-2750-4b8a-959c-8e7b0cb959cd tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75045) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 23:46:16 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:46:16 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:46:16 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[05f8c668-ba85-40a3-81e0-1506ec828410]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6217bd6e884\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:46:16 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:46:16 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:46:16 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcc92cad-e1a4-4fb3-aa88-d58d7125df26]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:46:16 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:46:16 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:46:16 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec393729-1298-4a3c-a0b3-6794eaf9b03a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:46:16 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[39c84df9-f211-494f-99ed-e78fab10426b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:46:16 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-1548c155-2750-4b8a-959c-8e7b0cb959cd tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Running cmd (subprocess): nvme version {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:46:16 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-1548c155-2750-4b8a-959c-8e7b0cb959cd tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] 'nvme version' failed. Not Retrying. {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 23:46:16 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1548c155-2750-4b8a-959c-8e7b0cb959cd tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] nvme not present on system {{(pid=75045) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 23:46:16 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:46:16 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 23:46:16 user nova-compute[75045]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 23:46:16 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[f74abb6a-6055-4799-bb29-28a9e2eb81a7]: (4, '') {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:46:16 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.lightos [None req-1548c155-2750-4b8a-959c-8e7b0cb959cd tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75045) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 23:46:16 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.lightos [None req-1548c155-2750-4b8a-959c-8e7b0cb959cd tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75045) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 23:46:16 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.lightos [None req-1548c155-2750-4b8a-959c-8e7b0cb959cd tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] LIGHTOS: no hostnqn found. {{(pid=75045) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 23:46:16 user nova-compute[75045]: DEBUG os_brick.utils [None req-1548c155-2750-4b8a-959c-8e7b0cb959cd tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] <== get_connector_properties: return (114ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6217bd6e884', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75045) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 23:46:16 user nova-compute[75045]: DEBUG nova.virt.block_device [None req-1548c155-2750-4b8a-959c-8e7b0cb959cd tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] [instance: 0fb331fa-231e-482e-abfc-df39b13fb33a] Updating existing volume attachment record: efca7c2a-2c40-4217-bded-f781d85e49c9 {{(pid=75045) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 23:46:19 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 23:46:19 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:46:19 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5004 ms, sending inactivity probe {{(pid=75045) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 23:46:19 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75045) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 23:46:19 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75045) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 23:46:19 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:46:21 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:46:24 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:46:26 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:46:29 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:46:31 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:46:34 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:46:36 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:46:37 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:46:39 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:46:44 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:46:49 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 23:46:49 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 23:46:49 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75045) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 23:46:49 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75045) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 23:46:49 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75045) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 23:46:49 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 23:46:53 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:46:53 user nova-compute[75045]: DEBUG nova.compute.manager [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Starting heal instance info cache {{(pid=75045) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 23:46:53 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Acquiring lock "refresh_cache-37502077-b02b-4f0c-b654-8a6cef607efa" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 23:46:53 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Acquired lock "refresh_cache-37502077-b02b-4f0c-b654-8a6cef607efa" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 23:46:53 user nova-compute[75045]: DEBUG nova.network.neutron [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] [instance: 37502077-b02b-4f0c-b654-8a6cef607efa] Forcefully refreshing network info cache for instance {{(pid=75045) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 23:46:54 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:46:54 user nova-compute[75045]: DEBUG nova.network.neutron [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] [instance: 37502077-b02b-4f0c-b654-8a6cef607efa] Updating instance_info_cache with network_info: [{"id": "30508e27-33e7-40dd-b166-6486da0f0911", "address": "fa:16:3e:3d:90:bb", "network": {"id": "4205f899-9865-4c65-8b46-c9a533e9bb45", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-774780781-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.170", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d59b73851c79473a9c2cdc0a120dfee0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30508e27-33", "ovs_interfaceid": "30508e27-33e7-40dd-b166-6486da0f0911", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75045) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 23:46:54 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Releasing lock "refresh_cache-37502077-b02b-4f0c-b654-8a6cef607efa" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 23:46:54 user nova-compute[75045]: DEBUG nova.compute.manager [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] [instance: 37502077-b02b-4f0c-b654-8a6cef607efa] Updated the network info_cache for instance {{(pid=75045) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 23:46:54 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:46:54 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:46:54 user nova-compute[75045]: DEBUG nova.compute.manager [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75045) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 23:46:55 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:46:58 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:46:59 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 23:46:59 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:46:59 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:47:00 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:47:02 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:47:04 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-aa7f0bec-4d3a-43ee-9fec-6fd4c75bdbaa tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] Acquiring lock "584e3043-addf-41f7-a3cd-de51c229af72" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:47:04 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-aa7f0bec-4d3a-43ee-9fec-6fd4c75bdbaa tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] Lock "584e3043-addf-41f7-a3cd-de51c229af72" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:47:04 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-aa7f0bec-4d3a-43ee-9fec-6fd4c75bdbaa tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] Acquiring lock "584e3043-addf-41f7-a3cd-de51c229af72-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:47:04 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-aa7f0bec-4d3a-43ee-9fec-6fd4c75bdbaa tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] Lock "584e3043-addf-41f7-a3cd-de51c229af72-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:47:04 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-aa7f0bec-4d3a-43ee-9fec-6fd4c75bdbaa tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] Lock "584e3043-addf-41f7-a3cd-de51c229af72-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:47:04 user nova-compute[75045]: INFO nova.compute.manager [None req-aa7f0bec-4d3a-43ee-9fec-6fd4c75bdbaa tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] [instance: 584e3043-addf-41f7-a3cd-de51c229af72] Terminating instance
Nov 08 23:47:04 user nova-compute[75045]: DEBUG nova.compute.manager [None req-aa7f0bec-4d3a-43ee-9fec-6fd4c75bdbaa tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] [instance: 584e3043-addf-41f7-a3cd-de51c229af72] Start destroying the instance on the hypervisor. {{(pid=75045) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 23:47:04 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 23:47:04 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 23:47:04 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75045) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 23:47:04 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75045) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 23:47:04 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75045) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 23:47:04 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:47:04 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:47:04 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:47:04 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:47:04 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:47:04 user nova-compute[75045]: DEBUG nova.compute.manager [req-94bb4f91-cd09-4397-ad2b-126c5e5ad60c req-94cc5203-f049-4107-b116-910c94b3e717 service nova] [instance: 584e3043-addf-41f7-a3cd-de51c229af72] Received event network-vif-unplugged-8b02e567-10f8-4153-88a4-9ce005c1fff3 {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:47:04 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-94bb4f91-cd09-4397-ad2b-126c5e5ad60c req-94cc5203-f049-4107-b116-910c94b3e717 service nova] Acquiring lock "584e3043-addf-41f7-a3cd-de51c229af72-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:47:04 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-94bb4f91-cd09-4397-ad2b-126c5e5ad60c req-94cc5203-f049-4107-b116-910c94b3e717 service nova] Lock "584e3043-addf-41f7-a3cd-de51c229af72-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:47:04 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-94bb4f91-cd09-4397-ad2b-126c5e5ad60c req-94cc5203-f049-4107-b116-910c94b3e717 service nova] Lock "584e3043-addf-41f7-a3cd-de51c229af72-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:47:04 user nova-compute[75045]: DEBUG nova.compute.manager [req-94bb4f91-cd09-4397-ad2b-126c5e5ad60c req-94cc5203-f049-4107-b116-910c94b3e717 service nova] [instance: 584e3043-addf-41f7-a3cd-de51c229af72] No waiting events found dispatching network-vif-unplugged-8b02e567-10f8-4153-88a4-9ce005c1fff3 {{(pid=75045) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 23:47:04 user nova-compute[75045]: DEBUG nova.compute.manager [req-94bb4f91-cd09-4397-ad2b-126c5e5ad60c req-94cc5203-f049-4107-b116-910c94b3e717 service nova] [instance: 584e3043-addf-41f7-a3cd-de51c229af72] Received event network-vif-unplugged-8b02e567-10f8-4153-88a4-9ce005c1fff3 for instance with task_state deleting. {{(pid=75045) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 23:47:04 user nova-compute[75045]: INFO nova.virt.libvirt.driver [-] [instance: 584e3043-addf-41f7-a3cd-de51c229af72] Instance destroyed successfully.
Nov 08 23:47:04 user nova-compute[75045]: DEBUG nova.objects.instance [None req-aa7f0bec-4d3a-43ee-9fec-6fd4c75bdbaa tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] Lazy-loading 'resources' on Instance uuid 584e3043-addf-41f7-a3cd-de51c229af72 {{(pid=75045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 23:47:04 user nova-compute[75045]: DEBUG nova.virt.libvirt.vif [None req-aa7f0bec-4d3a-43ee-9fec-6fd4c75bdbaa tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-08T23:41:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1201717535',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1201717535',id=41,image_ref='a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDL1Zv99L0Ha9EsCvyr90S90UX2vsiydtiEaWXdaK/WLI6o5JNyURd/0lbHKvXBXdKY02fMl7do4Nh25Fg22RCADhjGB98OjA7zj1WOLqsNETfEin1geBvs6wFI4MnRzYA==',key_name='tempest-keypair-2053037695',keypairs=<?>,launch_index=0,launched_at=2023-11-08T23:45:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3ad736027d034259a052da3f62bd575f',ramdisk_id='',reservation_id='r-km2oh92z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1769593098',owner_user_name='tempest-AttachVolumeShelveTestJSON-1769593098-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T23:45:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7a98fe96727741d0b148f3aaa8abf6f1',uuid=584e3043-addf-41f7-a3cd-de51c229af72,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8b02e567-10f8-4153-88a4-9ce005c1fff3", "address": "fa:16:3e:fe:a0:87", "network": {"id": "1b10bc53-ef32-4f01-82f6-ed9f95f7e3f2", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-518782773-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.123", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ad736027d034259a052da3f62bd575f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b02e567-10", "ovs_interfaceid": "8b02e567-10f8-4153-88a4-9ce005c1fff3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75045) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 23:47:04 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-aa7f0bec-4d3a-43ee-9fec-6fd4c75bdbaa tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] Converting VIF {"id": "8b02e567-10f8-4153-88a4-9ce005c1fff3", "address": "fa:16:3e:fe:a0:87", "network": {"id": "1b10bc53-ef32-4f01-82f6-ed9f95f7e3f2", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-518782773-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.123", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ad736027d034259a052da3f62bd575f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b02e567-10", "ovs_interfaceid": "8b02e567-10f8-4153-88a4-9ce005c1fff3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 23:47:04 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-aa7f0bec-4d3a-43ee-9fec-6fd4c75bdbaa tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fe:a0:87,bridge_name='br-int',has_traffic_filtering=True,id=8b02e567-10f8-4153-88a4-9ce005c1fff3,network=Network(1b10bc53-ef32-4f01-82f6-ed9f95f7e3f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b02e567-10') {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 23:47:04 user nova-compute[75045]: DEBUG os_vif [None req-aa7f0bec-4d3a-43ee-9fec-6fd4c75bdbaa tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fe:a0:87,bridge_name='br-int',has_traffic_filtering=True,id=8b02e567-10f8-4153-88a4-9ce005c1fff3,network=Network(1b10bc53-ef32-4f01-82f6-ed9f95f7e3f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b02e567-10') {{(pid=75045) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 23:47:04 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:47:04 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8b02e567-10, bridge=br-int, if_exists=True) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:47:04 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:47:04 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 23:47:04 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:47:04 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=95cb90bd-1286-44eb-adc6-963c7bb084c4) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:47:04 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:47:04 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:47:04 user nova-compute[75045]: INFO os_vif [None req-aa7f0bec-4d3a-43ee-9fec-6fd4c75bdbaa tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fe:a0:87,bridge_name='br-int',has_traffic_filtering=True,id=8b02e567-10f8-4153-88a4-9ce005c1fff3,network=Network(1b10bc53-ef32-4f01-82f6-ed9f95f7e3f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b02e567-10')
Nov 08 23:47:04 user nova-compute[75045]: INFO nova.virt.libvirt.driver [None req-aa7f0bec-4d3a-43ee-9fec-6fd4c75bdbaa tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] [instance: 584e3043-addf-41f7-a3cd-de51c229af72] Deleting instance files /opt/stack/data/nova/instances/584e3043-addf-41f7-a3cd-de51c229af72_del
Nov 08 23:47:04 user nova-compute[75045]: INFO nova.virt.libvirt.driver [None req-aa7f0bec-4d3a-43ee-9fec-6fd4c75bdbaa tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] [instance: 584e3043-addf-41f7-a3cd-de51c229af72] Deletion of /opt/stack/data/nova/instances/584e3043-addf-41f7-a3cd-de51c229af72_del complete
Nov 08 23:47:04 user nova-compute[75045]: INFO nova.compute.manager [None req-aa7f0bec-4d3a-43ee-9fec-6fd4c75bdbaa tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] [instance: 584e3043-addf-41f7-a3cd-de51c229af72] Took 0.90 seconds to destroy the instance on the hypervisor.
Nov 08 23:47:04 user nova-compute[75045]: DEBUG oslo.service.loopingcall [None req-aa7f0bec-4d3a-43ee-9fec-6fd4c75bdbaa tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75045) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 23:47:04 user nova-compute[75045]: DEBUG nova.compute.manager [-] [instance: 584e3043-addf-41f7-a3cd-de51c229af72] Deallocating network for instance {{(pid=75045) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 23:47:04 user nova-compute[75045]: DEBUG nova.network.neutron [-] [instance: 584e3043-addf-41f7-a3cd-de51c229af72] deallocate_for_instance() {{(pid=75045) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 23:47:04 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager.update_available_resource {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:47:05 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:47:05 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:47:05 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:47:05 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Auditing locally available compute resources for user (node: user) {{(pid=75045) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 23:47:05 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75045) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 23:47:05 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/244c4cc9-2837-40c9-b4ad-37dc435c9749/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:47:05 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/244c4cc9-2837-40c9-b4ad-37dc435c9749/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:47:05 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/244c4cc9-2837-40c9-b4ad-37dc435c9749/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:47:05 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/244c4cc9-2837-40c9-b4ad-37dc435c9749/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:47:05 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b413c71-c13a-4fea-91c4-f6b1953d54c6/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:47:05 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b413c71-c13a-4fea-91c4-f6b1953d54c6/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:47:05 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b413c71-c13a-4fea-91c4-f6b1953d54c6/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:47:05 user nova-compute[75045]: DEBUG nova.network.neutron [-] [instance: 584e3043-addf-41f7-a3cd-de51c229af72] Updating instance_info_cache with network_info: [] {{(pid=75045) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 23:47:05 user nova-compute[75045]: DEBUG nova.compute.manager [req-822bad24-0267-412e-979c-554f0aab474b req-11984c31-7466-47a5-bc53-fdf85c6d73fa service nova] [instance: 584e3043-addf-41f7-a3cd-de51c229af72] Received event network-vif-deleted-8b02e567-10f8-4153-88a4-9ce005c1fff3 {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:47:05 user nova-compute[75045]: INFO nova.compute.manager [req-822bad24-0267-412e-979c-554f0aab474b req-11984c31-7466-47a5-bc53-fdf85c6d73fa service nova] [instance: 584e3043-addf-41f7-a3cd-de51c229af72] Neutron deleted interface 8b02e567-10f8-4153-88a4-9ce005c1fff3; detaching it from the instance and deleting it from the info cache
Nov 08 23:47:05 user nova-compute[75045]: DEBUG nova.network.neutron [req-822bad24-0267-412e-979c-554f0aab474b req-11984c31-7466-47a5-bc53-fdf85c6d73fa service nova] [instance: 584e3043-addf-41f7-a3cd-de51c229af72] Updating instance_info_cache with network_info: [] {{(pid=75045) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 23:47:05 user nova-compute[75045]: INFO nova.compute.manager [-] [instance: 584e3043-addf-41f7-a3cd-de51c229af72] Took 0.93 seconds to deallocate network for instance.
Nov 08 23:47:05 user nova-compute[75045]: DEBUG nova.compute.manager [req-822bad24-0267-412e-979c-554f0aab474b req-11984c31-7466-47a5-bc53-fdf85c6d73fa service nova] [instance: 584e3043-addf-41f7-a3cd-de51c229af72] Detach interface failed, port_id=8b02e567-10f8-4153-88a4-9ce005c1fff3, reason: Instance 584e3043-addf-41f7-a3cd-de51c229af72 could not be found. {{(pid=75045) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 08 23:47:05 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b413c71-c13a-4fea-91c4-f6b1953d54c6/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:47:05 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75045) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 23:47:05 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-aa7f0bec-4d3a-43ee-9fec-6fd4c75bdbaa tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:47:05 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-aa7f0bec-4d3a-43ee-9fec-6fd4c75bdbaa tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:47:06 user nova-compute[75045]: DEBUG nova.scheduler.client.report [None req-aa7f0bec-4d3a-43ee-9fec-6fd4c75bdbaa tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] Refreshing inventories for resource provider 62ba5f85-c74d-4b58-986e-d4197e813fd7 {{(pid=75045) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 08 23:47:06 user nova-compute[75045]: WARNING nova.virt.libvirt.driver [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 23:47:06 user nova-compute[75045]: WARNING nova.virt.libvirt.driver [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 23:47:06 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Hypervisor/Node resource view: name=user free_ram=8526MB free_disk=25.048442840576172GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75045) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 23:47:06 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:47:06 user nova-compute[75045]: DEBUG nova.scheduler.client.report [None req-aa7f0bec-4d3a-43ee-9fec-6fd4c75bdbaa tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] Updating ProviderTree inventory for provider 62ba5f85-c74d-4b58-986e-d4197e813fd7 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75045) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 08 23:47:06 user nova-compute[75045]: DEBUG nova.compute.provider_tree [None req-aa7f0bec-4d3a-43ee-9fec-6fd4c75bdbaa tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] Updating inventory in ProviderTree for provider 62ba5f85-c74d-4b58-986e-d4197e813fd7 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75045) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 08 23:47:06 user nova-compute[75045]: DEBUG nova.scheduler.client.report [None req-aa7f0bec-4d3a-43ee-9fec-6fd4c75bdbaa tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] Refreshing aggregate associations for resource provider 62ba5f85-c74d-4b58-986e-d4197e813fd7, aggregates: None {{(pid=75045) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 08 23:47:06 user nova-compute[75045]: DEBUG nova.compute.manager [req-08c44a9b-5482-4ac4-b31a-1392283a1802 req-eaef37c7-243d-4b72-8816-27774945b1f4 service nova] [instance: 584e3043-addf-41f7-a3cd-de51c229af72] Received event network-vif-plugged-8b02e567-10f8-4153-88a4-9ce005c1fff3 {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:47:06 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-08c44a9b-5482-4ac4-b31a-1392283a1802 req-eaef37c7-243d-4b72-8816-27774945b1f4 service nova] Acquiring lock "584e3043-addf-41f7-a3cd-de51c229af72-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:47:06 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-08c44a9b-5482-4ac4-b31a-1392283a1802 req-eaef37c7-243d-4b72-8816-27774945b1f4 service nova] Lock "584e3043-addf-41f7-a3cd-de51c229af72-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:47:06 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-08c44a9b-5482-4ac4-b31a-1392283a1802 req-eaef37c7-243d-4b72-8816-27774945b1f4 service nova] Lock "584e3043-addf-41f7-a3cd-de51c229af72-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:47:06 user nova-compute[75045]: DEBUG nova.compute.manager [req-08c44a9b-5482-4ac4-b31a-1392283a1802 req-eaef37c7-243d-4b72-8816-27774945b1f4 service nova] [instance: 584e3043-addf-41f7-a3cd-de51c229af72] No waiting events found dispatching network-vif-plugged-8b02e567-10f8-4153-88a4-9ce005c1fff3 {{(pid=75045) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 23:47:06 user nova-compute[75045]: WARNING nova.compute.manager [req-08c44a9b-5482-4ac4-b31a-1392283a1802 req-eaef37c7-243d-4b72-8816-27774945b1f4 service nova] [instance: 584e3043-addf-41f7-a3cd-de51c229af72] Received unexpected event network-vif-plugged-8b02e567-10f8-4153-88a4-9ce005c1fff3 for instance with vm_state deleted and task_state None.
Nov 08 23:47:06 user nova-compute[75045]: DEBUG nova.scheduler.client.report [None req-aa7f0bec-4d3a-43ee-9fec-6fd4c75bdbaa tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] Refreshing trait associations for resource provider 62ba5f85-c74d-4b58-986e-d4197e813fd7, traits: COMPUTE_STORAGE_BUS_SCSI,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_TRUSTED_CERTS,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_VIRTIO,HW_CPU_X86_SSSE3,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_FDC,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_RESCUE_BFV,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSE2,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN {{(pid=75045) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 08 23:47:06 user nova-compute[75045]: DEBUG nova.compute.provider_tree [None req-aa7f0bec-4d3a-43ee-9fec-6fd4c75bdbaa tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] Inventory has not changed in ProviderTree for provider: 62ba5f85-c74d-4b58-986e-d4197e813fd7 {{(pid=75045) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 23:47:06 user nova-compute[75045]: DEBUG nova.scheduler.client.report [None req-aa7f0bec-4d3a-43ee-9fec-6fd4c75bdbaa tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] Inventory has not changed for provider 62ba5f85-c74d-4b58-986e-d4197e813fd7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75045) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 23:47:06 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-aa7f0bec-4d3a-43ee-9fec-6fd4c75bdbaa tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.764s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:47:06 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.361s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:47:06 user nova-compute[75045]: INFO nova.scheduler.client.report [None req-aa7f0bec-4d3a-43ee-9fec-6fd4c75bdbaa tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] Deleted allocations for instance 584e3043-addf-41f7-a3cd-de51c229af72
Nov 08 23:47:06 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Instance 244c4cc9-2837-40c9-b4ad-37dc435c9749 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75045) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 23:47:06 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Instance 0b413c71-c13a-4fea-91c4-f6b1953d54c6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75045) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 23:47:06 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Instance 37502077-b02b-4f0c-b654-8a6cef607efa actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75045) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 23:47:06 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Instance 0fb331fa-231e-482e-abfc-df39b13fb33a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75045) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 23:47:06 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=75045) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 23:47:06 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=75045) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 23:47:06 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-aa7f0bec-4d3a-43ee-9fec-6fd4c75bdbaa tempest-AttachVolumeShelveTestJSON-1769593098 tempest-AttachVolumeShelveTestJSON-1769593098-project-member] Lock "584e3043-addf-41f7-a3cd-de51c229af72" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.807s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:47:06 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:47:07 user nova-compute[75045]: DEBUG nova.compute.provider_tree [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Inventory has not changed in ProviderTree for provider: 62ba5f85-c74d-4b58-986e-d4197e813fd7 {{(pid=75045) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 23:47:07 user nova-compute[75045]: DEBUG nova.scheduler.client.report [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Inventory has not changed for provider 62ba5f85-c74d-4b58-986e-d4197e813fd7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75045) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 23:47:07 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Compute_service record updated for user:user {{(pid=75045) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 23:47:07 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.370s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:47:07 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:47:07 user nova-compute[75045]: DEBUG nova.compute.manager [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Cleaning up deleted instances with incomplete migration  {{(pid=75045) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 08 23:47:08 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:47:08 user nova-compute[75045]: DEBUG nova.compute.manager [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Cleaning up deleted instances {{(pid=75045) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 08 23:47:09 user nova-compute[75045]: DEBUG nova.compute.manager [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] There are 0 instances to clean {{(pid=75045) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 08 23:47:09 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:47:14 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:47:14 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:47:19 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 23:47:23 user nova-compute[75045]: DEBUG nova.compute.manager [None req-1548c155-2750-4b8a-959c-8e7b0cb959cd tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] [instance: 0fb331fa-231e-482e-abfc-df39b13fb33a] Start spawning the instance on the hypervisor. {{(pid=75045) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 23:47:23 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-1548c155-2750-4b8a-959c-8e7b0cb959cd tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] [instance: 0fb331fa-231e-482e-abfc-df39b13fb33a] Creating instance directory {{(pid=75045) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 23:47:23 user nova-compute[75045]: INFO nova.virt.libvirt.driver [None req-1548c155-2750-4b8a-959c-8e7b0cb959cd tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] [instance: 0fb331fa-231e-482e-abfc-df39b13fb33a] Creating image(s)
Nov 08 23:47:23 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-1548c155-2750-4b8a-959c-8e7b0cb959cd tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] [instance: 0fb331fa-231e-482e-abfc-df39b13fb33a] Did not create local disks {{(pid=75045) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 08 23:47:23 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-1548c155-2750-4b8a-959c-8e7b0cb959cd tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] [instance: 0fb331fa-231e-482e-abfc-df39b13fb33a] Ensure instance console log exists: /opt/stack/data/nova/instances/0fb331fa-231e-482e-abfc-df39b13fb33a/console.log {{(pid=75045) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 23:47:23 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-1548c155-2750-4b8a-959c-8e7b0cb959cd tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:47:23 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-1548c155-2750-4b8a-959c-8e7b0cb959cd tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:47:23 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-1548c155-2750-4b8a-959c-8e7b0cb959cd tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:47:23 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-1548c155-2750-4b8a-959c-8e7b0cb959cd tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] [instance: 0fb331fa-231e-482e-abfc-df39b13fb33a] Start _get_guest_xml network_info=[{"id": "0c7a4468-f510-4a33-8ee7-d70da98f972b", "address": "fa:16:3e:8a:8b:88", "network": {"id": "4205f899-9865-4c65-8b46-c9a533e9bb45", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-774780781-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d59b73851c79473a9c2cdc0a120dfee0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c7a4468-f5", "ovs_interfaceid": "0c7a4468-f510-4a33-8ee7-d70da98f972b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-11-08T23:45:56Z,direct_url=<?>,disk_format='qcow2',id=cefce088-8eeb-4a07-bada-6e4cf14ac54c,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-1644104506',owner='d59b73851c79473a9c2cdc0a120dfee0',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-11-08T23:45:58Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': True, 'device_type': 'disk', 'attachment_id': 'efca7c2a-2c40-4217-bded-f781d85e49c9', 'guest_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:fc158ccb-5948-41c4-be6c-38c3539a467e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dNYlPWbG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '0fb331fa-231e-482e-abfc-df39b13fb33a', 'attached_at': '', 'detached_at': '', 'volume_id': 'fc158ccb-5948-41c4-be6c-38c3539a467e', 'serial': 'fc158ccb-5948-41c4-be6c-38c3539a467e'}, 'volume_type': None} {{(pid=75045) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 23:47:23 user nova-compute[75045]: WARNING nova.virt.libvirt.driver [None req-1548c155-2750-4b8a-959c-8e7b0cb959cd tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 23:47:23 user nova-compute[75045]: WARNING nova.virt.libvirt.driver [None req-1548c155-2750-4b8a-959c-8e7b0cb959cd tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 23:47:23 user nova-compute[75045]: DEBUG nova.virt.libvirt.host [None req-1548c155-2750-4b8a-959c-8e7b0cb959cd tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75045) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 23:47:23 user nova-compute[75045]: DEBUG nova.virt.libvirt.host [None req-1548c155-2750-4b8a-959c-8e7b0cb959cd tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] CPU controller missing on host. {{(pid=75045) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 23:47:23 user nova-compute[75045]: DEBUG nova.virt.libvirt.host [None req-1548c155-2750-4b8a-959c-8e7b0cb959cd tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75045) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 23:47:23 user nova-compute[75045]: DEBUG nova.virt.libvirt.host [None req-1548c155-2750-4b8a-959c-8e7b0cb959cd tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] CPU controller found on host. {{(pid=75045) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 23:47:23 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-1548c155-2750-4b8a-959c-8e7b0cb959cd tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75045) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 23:47:23 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-1548c155-2750-4b8a-959c-8e7b0cb959cd tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T23:11:41Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-11-08T23:45:56Z,direct_url=<?>,disk_format='qcow2',id=cefce088-8eeb-4a07-bada-6e4cf14ac54c,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-1644104506',owner='d59b73851c79473a9c2cdc0a120dfee0',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-11-08T23:45:58Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75045) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 23:47:23 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-1548c155-2750-4b8a-959c-8e7b0cb959cd tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Flavor limits 0:0:0 {{(pid=75045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 23:47:23 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-1548c155-2750-4b8a-959c-8e7b0cb959cd tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Image limits 0:0:0 {{(pid=75045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 23:47:23 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-1548c155-2750-4b8a-959c-8e7b0cb959cd tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Flavor pref 0:0:0 {{(pid=75045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 23:47:23 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-1548c155-2750-4b8a-959c-8e7b0cb959cd tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Image pref 0:0:0 {{(pid=75045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 23:47:23 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-1548c155-2750-4b8a-959c-8e7b0cb959cd tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 23:47:23 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-1548c155-2750-4b8a-959c-8e7b0cb959cd tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75045) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 23:47:23 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-1548c155-2750-4b8a-959c-8e7b0cb959cd tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75045) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 23:47:23 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-1548c155-2750-4b8a-959c-8e7b0cb959cd tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Got 1 possible topologies {{(pid=75045) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 23:47:23 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-1548c155-2750-4b8a-959c-8e7b0cb959cd tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75045) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 23:47:23 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-1548c155-2750-4b8a-959c-8e7b0cb959cd tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75045) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 23:47:23 user nova-compute[75045]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1548c155-2750-4b8a-959c-8e7b0cb959cd tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] [instance: 0fb331fa-231e-482e-abfc-df39b13fb33a] Calling os-brick to attach iSCSI Volume {{(pid=75045) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 23:47:23 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-1548c155-2750-4b8a-959c-8e7b0cb959cd tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1b68210460>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:fc158ccb-5948-41c4-be6c-38c3539a467e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dNYlPWbG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75045) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 23:47:23 user nova-compute[75045]: WARNING os_brick.initiator.connectors.base [None req-1548c155-2750-4b8a-959c-8e7b0cb959cd tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 23:47:23 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-1548c155-2750-4b8a-959c-8e7b0cb959cd tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 23:47:23 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-1548c155-2750-4b8a-959c-8e7b0cb959cd tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 23:47:23 user nova-compute[75045]: WARNING os_brick.initiator.connectors.base [None req-1548c155-2750-4b8a-959c-8e7b0cb959cd tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 23:47:23 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-1548c155-2750-4b8a-959c-8e7b0cb959cd tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fc158ccb-5948-41c4-be6c-38c3539a467e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 23:47:23 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-1548c155-2750-4b8a-959c-8e7b0cb959cd tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fc158ccb-5948-41c4-be6c-38c3539a467e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 23:47:23 user nova-compute[75045]: INFO os_brick.initiator.connectors.iscsi [None req-1548c155-2750-4b8a-959c-8e7b0cb959cd tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 23:47:23 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc158ccb-5948-41c4-be6c-38c3539a467e -p 172.16.0.220:3260 {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:47:23 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc158ccb-5948-41c4-be6c-38c3539a467e -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:47:23 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[792e8d90-951b-4bfe-bbfd-fb1b4174713d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:47:23 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-1548c155-2750-4b8a-959c-8e7b0cb959cd tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 23:47:23 user nova-compute[75045]:  {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:47:23 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc158ccb-5948-41c4-be6c-38c3539a467e -p 172.16.0.220:3260 --interface default --op new {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:47:23 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc158ccb-5948-41c4-be6c-38c3539a467e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:47:23 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff742b30-4cab-4782-8539-4e8e95f0710d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fc158ccb-5948-41c4-be6c-38c3539a467e] added\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:47:23 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-1548c155-2750-4b8a-959c-8e7b0cb959cd tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fc158ccb-5948-41c4-be6c-38c3539a467e] added
Nov 08 23:47:23 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:47:23 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc158ccb-5948-41c4-be6c-38c3539a467e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:47:23 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc158ccb-5948-41c4-be6c-38c3539a467e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:47:23 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[e57ca0b4-1a42-48e8-b3e1-b74795cb216d]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:47:23 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-1548c155-2750-4b8a-959c-8e7b0cb959cd tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:47:23 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc158ccb-5948-41c4-be6c-38c3539a467e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:47:23 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc158ccb-5948-41c4-be6c-38c3539a467e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:47:23 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcd49eea-e1e7-4600-a23c-aa47bc93e6e2]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:47:23 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-1548c155-2750-4b8a-959c-8e7b0cb959cd tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:47:23 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc158ccb-5948-41c4-be6c-38c3539a467e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dNYlPWbG {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:47:23 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc158ccb-5948-41c4-be6c-38c3539a467e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dNYlPWbG" returned: 0 in 0.018s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:47:23 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d700bdf-8422-47cf-9054-c6a937254593]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:47:23 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-1548c155-2750-4b8a-959c-8e7b0cb959cd tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'dNYlPWbG'): stdout= stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:47:23 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc158ccb-5948-41c4-be6c-38c3539a467e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:47:23 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc158ccb-5948-41c4-be6c-38c3539a467e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:47:23 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[76c584bd-df9e-4111-afb5-95b37bcf3625]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:47:23 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-1548c155-2750-4b8a-959c-8e7b0cb959cd tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:47:23 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:47:23 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:47:23 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[d500fcfb-5c93-41ca-b91d-743161b7f477]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22e58281-41b7-4be2-ace8-0750aa5d18f8 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:adcca529-746a-4b7a-966a-82909ff5b108 (non-flash)\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:47:23 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-1548c155-2750-4b8a-959c-8e7b0cb959cd tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22e58281-41b7-4be2-ace8-0750aa5d18f8 (non-flash)
Nov 08 23:47:23 user nova-compute[75045]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:adcca529-746a-4b7a-966a-82909ff5b108 (non-flash)
Nov 08 23:47:23 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 23:47:23 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-1548c155-2750-4b8a-959c-8e7b0cb959cd tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22e58281-41b7-4be2-ace8-0750aa5d18f8 (non-flash)
Nov 08 23:47:23 user nova-compute[75045]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:adcca529-746a-4b7a-966a-82909ff5b108 (non-flash)
Nov 08 23:47:23 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 23:47:23 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc158ccb-5948-41c4-be6c-38c3539a467e -p 172.16.0.220:3260 --login {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:47:23 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc158ccb-5948-41c4-be6c-38c3539a467e -p 172.16.0.220:3260 --login" returned: 0 in 0.055s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:47:23 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee6e4355-ec38-4536-b040-339addf91053]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:fc158ccb-5948-41c4-be6c-38c3539a467e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:fc158ccb-5948-41c4-be6c-38c3539a467e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:47:23 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-1548c155-2750-4b8a-959c-8e7b0cb959cd tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:fc158ccb-5948-41c4-be6c-38c3539a467e, portal: 172.16.0.220,3260]
Nov 08 23:47:23 user nova-compute[75045]: Login to [iface: default, target: iqn.2010-10.org.openstack:fc158ccb-5948-41c4-be6c-38c3539a467e, portal: 172.16.0.220,3260] successful.
Nov 08 23:47:23 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:47:23 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc158ccb-5948-41c4-be6c-38c3539a467e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:47:23 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc158ccb-5948-41c4-be6c-38c3539a467e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:47:23 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a0c6f97-3731-4871-abe2-9b7ea81e71a1]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:47:23 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-1548c155-2750-4b8a-959c-8e7b0cb959cd tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:47:23 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:47:23 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:47:23 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe509730-2ad2-4f50-b358-c90a8c8bb3e8]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22e58281-41b7-4be2-ace8-0750aa5d18f8 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:adcca529-746a-4b7a-966a-82909ff5b108 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc158ccb-5948-41c4-be6c-38c3539a467e (non-flash)\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:47:23 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-1548c155-2750-4b8a-959c-8e7b0cb959cd tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22e58281-41b7-4be2-ace8-0750aa5d18f8 (non-flash)
Nov 08 23:47:23 user nova-compute[75045]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:adcca529-746a-4b7a-966a-82909ff5b108 (non-flash)
Nov 08 23:47:23 user nova-compute[75045]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc158ccb-5948-41c4-be6c-38c3539a467e (non-flash)
Nov 08 23:47:23 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 23:47:23 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-1548c155-2750-4b8a-959c-8e7b0cb959cd tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22e58281-41b7-4be2-ace8-0750aa5d18f8 (non-flash)
Nov 08 23:47:23 user nova-compute[75045]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:adcca529-746a-4b7a-966a-82909ff5b108 (non-flash)
Nov 08 23:47:23 user nova-compute[75045]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc158ccb-5948-41c4-be6c-38c3539a467e (non-flash)
Nov 08 23:47:23 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 23:47:23 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-1548c155-2750-4b8a-959c-8e7b0cb959cd tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fc158ccb-5948-41c4-be6c-38c3539a467e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.271s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 23:47:23 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-1548c155-2750-4b8a-959c-8e7b0cb959cd tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Connected to 172.16.0.220:3260 {{(pid=75045) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 23:47:23 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-1548c155-2750-4b8a-959c-8e7b0cb959cd tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] HCTL ('34', '-', '-', 0) found on session 46 with lun 0 {{(pid=75045) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 23:47:23 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-1548c155-2750-4b8a-959c-8e7b0cb959cd tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75045) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 23:47:23 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:47:23 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:47:23 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c0ac4d0-ed28-4eda-b80a-34cfd268950b]: (4, ('- - 0', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:47:23 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-1548c155-2750-4b8a-959c-8e7b0cb959cd tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Searching for a device in session 46 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75045) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 23:47:23 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-1548c155-2750-4b8a-959c-8e7b0cb959cd tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:fc158ccb-5948-41c4-be6c-38c3539a467e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dNYlPWbG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75045) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 23:47:24 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-1548c155-2750-4b8a-959c-8e7b0cb959cd tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.310s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 23:47:24 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-1548c155-2750-4b8a-959c-8e7b0cb959cd tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] <== connect_volume: return (1312ms) {'type': 'block', 'scsi_wwn': '26266653734653735', 'path': '/dev/sdc'} {{(pid=75045) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 23:47:24 user nova-compute[75045]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1548c155-2750-4b8a-959c-8e7b0cb959cd tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] [instance: 0fb331fa-231e-482e-abfc-df39b13fb33a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26266653734653735', 'path': '/dev/sdc'} {{(pid=75045) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 23:47:24 user nova-compute[75045]: DEBUG nova.virt.libvirt.vif [None req-1548c155-2750-4b8a-959c-8e7b0cb959cd tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T23:46:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-87023502',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-87023502',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-87023502',id=44,image_ref='cefce088-8eeb-4a07-bada-6e4cf14ac54c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLFajEq90PF+g5mz1f56miiZgoZX79EOzMFlYhJgaLr2Nsy2klw35nVJ5OgI0WTVMZT5GXq0yNz3WuAys4y7PUARSWA9hHR2XqDf4o7nsBq/A1TD7xn9ExZ2aMEHJuwDEQ==',key_name='tempest-keypair-1161830264',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d59b73851c79473a9c2cdc0a120dfee0',ramdisk_id='',reservation_id='r-h0lolso0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-650796844',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-650796844-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-650796844',owner_user_name='tempest-TestVolumeBootPattern-650796844-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T23:46:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='76c31c64d9594f9cbef7586fafb48721',uuid=0fb331fa-231e-482e-abfc-df39b13fb33a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0c7a4468-f510-4a33-8ee7-d70da98f972b", "address": "fa:16:3e:8a:8b:88", "network": {"id": "4205f899-9865-4c65-8b46-c9a533e9bb45", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-774780781-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d59b73851c79473a9c2cdc0a120dfee0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c7a4468-f5", "ovs_interfaceid": "0c7a4468-f510-4a33-8ee7-d70da98f972b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75045) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 23:47:24 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-1548c155-2750-4b8a-959c-8e7b0cb959cd tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Converting VIF {"id": "0c7a4468-f510-4a33-8ee7-d70da98f972b", "address": "fa:16:3e:8a:8b:88", "network": {"id": "4205f899-9865-4c65-8b46-c9a533e9bb45", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-774780781-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d59b73851c79473a9c2cdc0a120dfee0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c7a4468-f5", "ovs_interfaceid": "0c7a4468-f510-4a33-8ee7-d70da98f972b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 23:47:24 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-1548c155-2750-4b8a-959c-8e7b0cb959cd tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8a:8b:88,bridge_name='br-int',has_traffic_filtering=True,id=0c7a4468-f510-4a33-8ee7-d70da98f972b,network=Network(4205f899-9865-4c65-8b46-c9a533e9bb45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0c7a4468-f5') {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 23:47:24 user nova-compute[75045]: DEBUG nova.objects.instance [None req-1548c155-2750-4b8a-959c-8e7b0cb959cd tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Lazy-loading 'pci_devices' on Instance uuid 0fb331fa-231e-482e-abfc-df39b13fb33a {{(pid=75045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 23:47:24 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-1548c155-2750-4b8a-959c-8e7b0cb959cd tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] [instance: 0fb331fa-231e-482e-abfc-df39b13fb33a] End _get_guest_xml xml=<domain type="kvm">
Nov 08 23:47:24 user nova-compute[75045]:   <uuid>0fb331fa-231e-482e-abfc-df39b13fb33a</uuid>
Nov 08 23:47:24 user nova-compute[75045]:   <name>instance-0000002c</name>
Nov 08 23:47:24 user nova-compute[75045]:   <memory>524288</memory>
Nov 08 23:47:24 user nova-compute[75045]:   <vcpu>1</vcpu>
Nov 08 23:47:24 user nova-compute[75045]:   <metadata>
Nov 08 23:47:24 user nova-compute[75045]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 23:47:24 user nova-compute[75045]:       <nova:package version="0.0.0"/>
Nov 08 23:47:24 user nova-compute[75045]:       <nova:name>tempest-TestVolumeBootPattern-image-snapshot-server-87023502</nova:name>
Nov 08 23:47:24 user nova-compute[75045]:       <nova:creationTime>2023-11-08 23:47:23</nova:creationTime>
Nov 08 23:47:24 user nova-compute[75045]:       <nova:flavor name="m1.tiny">
Nov 08 23:47:24 user nova-compute[75045]:         <nova:memory>512</nova:memory>
Nov 08 23:47:24 user nova-compute[75045]:         <nova:disk>1</nova:disk>
Nov 08 23:47:24 user nova-compute[75045]:         <nova:swap>0</nova:swap>
Nov 08 23:47:24 user nova-compute[75045]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 23:47:24 user nova-compute[75045]:         <nova:vcpus>1</nova:vcpus>
Nov 08 23:47:24 user nova-compute[75045]:       </nova:flavor>
Nov 08 23:47:24 user nova-compute[75045]:       <nova:owner>
Nov 08 23:47:24 user nova-compute[75045]:         <nova:user uuid="76c31c64d9594f9cbef7586fafb48721">tempest-TestVolumeBootPattern-650796844-project-member</nova:user>
Nov 08 23:47:24 user nova-compute[75045]:         <nova:project uuid="d59b73851c79473a9c2cdc0a120dfee0">tempest-TestVolumeBootPattern-650796844</nova:project>
Nov 08 23:47:24 user nova-compute[75045]:       </nova:owner>
Nov 08 23:47:24 user nova-compute[75045]:       <nova:root type="image" uuid="cefce088-8eeb-4a07-bada-6e4cf14ac54c"/>
Nov 08 23:47:24 user nova-compute[75045]:       <nova:ports>
Nov 08 23:47:24 user nova-compute[75045]:         <nova:port uuid="0c7a4468-f510-4a33-8ee7-d70da98f972b">
Nov 08 23:47:24 user nova-compute[75045]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 08 23:47:24 user nova-compute[75045]:         </nova:port>
Nov 08 23:47:24 user nova-compute[75045]:       </nova:ports>
Nov 08 23:47:24 user nova-compute[75045]:     </nova:instance>
Nov 08 23:47:24 user nova-compute[75045]:   </metadata>
Nov 08 23:47:24 user nova-compute[75045]:   <sysinfo type="smbios">
Nov 08 23:47:24 user nova-compute[75045]:     <system>
Nov 08 23:47:24 user nova-compute[75045]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 23:47:24 user nova-compute[75045]:       <entry name="product">OpenStack Nova</entry>
Nov 08 23:47:24 user nova-compute[75045]:       <entry name="version">0.0.0</entry>
Nov 08 23:47:24 user nova-compute[75045]:       <entry name="serial">0fb331fa-231e-482e-abfc-df39b13fb33a</entry>
Nov 08 23:47:24 user nova-compute[75045]:       <entry name="uuid">0fb331fa-231e-482e-abfc-df39b13fb33a</entry>
Nov 08 23:47:24 user nova-compute[75045]:       <entry name="family">Virtual Machine</entry>
Nov 08 23:47:24 user nova-compute[75045]:     </system>
Nov 08 23:47:24 user nova-compute[75045]:   </sysinfo>
Nov 08 23:47:24 user nova-compute[75045]:   <os>
Nov 08 23:47:24 user nova-compute[75045]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 23:47:24 user nova-compute[75045]:     <boot dev="hd"/>
Nov 08 23:47:24 user nova-compute[75045]:     <smbios mode="sysinfo"/>
Nov 08 23:47:24 user nova-compute[75045]:   </os>
Nov 08 23:47:24 user nova-compute[75045]:   <features>
Nov 08 23:47:24 user nova-compute[75045]:     <acpi/>
Nov 08 23:47:24 user nova-compute[75045]:     <apic/>
Nov 08 23:47:24 user nova-compute[75045]:     <vmcoreinfo/>
Nov 08 23:47:24 user nova-compute[75045]:   </features>
Nov 08 23:47:24 user nova-compute[75045]:   <clock offset="utc">
Nov 08 23:47:24 user nova-compute[75045]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 23:47:24 user nova-compute[75045]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 23:47:24 user nova-compute[75045]:     <timer name="hpet" present="no"/>
Nov 08 23:47:24 user nova-compute[75045]:   </clock>
Nov 08 23:47:24 user nova-compute[75045]:   <cpu mode="custom" match="exact">
Nov 08 23:47:24 user nova-compute[75045]:     <model>Nehalem</model>
Nov 08 23:47:24 user nova-compute[75045]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 23:47:24 user nova-compute[75045]:   </cpu>
Nov 08 23:47:24 user nova-compute[75045]:   <devices>
Nov 08 23:47:24 user nova-compute[75045]:     <disk type="block" device="disk">
Nov 08 23:47:24 user nova-compute[75045]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 23:47:24 user nova-compute[75045]:       <source dev="/dev/sdc"/>
Nov 08 23:47:24 user nova-compute[75045]:       <target dev="vda" bus="virtio"/>
Nov 08 23:47:24 user nova-compute[75045]:       <serial>fc158ccb-5948-41c4-be6c-38c3539a467e</serial>
Nov 08 23:47:24 user nova-compute[75045]:     </disk>
Nov 08 23:47:24 user nova-compute[75045]:     <interface type="ethernet">
Nov 08 23:47:24 user nova-compute[75045]:       <mac address="fa:16:3e:8a:8b:88"/>
Nov 08 23:47:24 user nova-compute[75045]:       <model type="virtio"/>
Nov 08 23:47:24 user nova-compute[75045]:       <mtu size="1442"/>
Nov 08 23:47:24 user nova-compute[75045]:       <target dev="tap0c7a4468-f5"/>
Nov 08 23:47:24 user nova-compute[75045]:     </interface>
Nov 08 23:47:24 user nova-compute[75045]:     <serial type="pty">
Nov 08 23:47:24 user nova-compute[75045]:       <log file="/opt/stack/data/nova/instances/0fb331fa-231e-482e-abfc-df39b13fb33a/console.log" append="off"/>
Nov 08 23:47:24 user nova-compute[75045]:     </serial>
Nov 08 23:47:24 user nova-compute[75045]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 23:47:24 user nova-compute[75045]:     <video>
Nov 08 23:47:24 user nova-compute[75045]:       <model type="virtio"/>
Nov 08 23:47:24 user nova-compute[75045]:     </video>
Nov 08 23:47:24 user nova-compute[75045]:     <rng model="virtio">
Nov 08 23:47:24 user nova-compute[75045]:       <backend model="random">/dev/urandom</backend>
Nov 08 23:47:24 user nova-compute[75045]:     </rng>
Nov 08 23:47:24 user nova-compute[75045]:     <controller type="usb" index="0" model="none"/>
Nov 08 23:47:24 user nova-compute[75045]:     <memballoon model="virtio">
Nov 08 23:47:24 user nova-compute[75045]:       <stats period="10"/>
Nov 08 23:47:24 user nova-compute[75045]:     </memballoon>
Nov 08 23:47:24 user nova-compute[75045]:   </devices>
Nov 08 23:47:24 user nova-compute[75045]: </domain>
Nov 08 23:47:24 user nova-compute[75045]:  {{(pid=75045) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 23:47:24 user nova-compute[75045]: DEBUG nova.virt.libvirt.vif [None req-1548c155-2750-4b8a-959c-8e7b0cb959cd tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T23:46:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-87023502',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-87023502',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-87023502',id=44,image_ref='cefce088-8eeb-4a07-bada-6e4cf14ac54c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLFajEq90PF+g5mz1f56miiZgoZX79EOzMFlYhJgaLr2Nsy2klw35nVJ5OgI0WTVMZT5GXq0yNz3WuAys4y7PUARSWA9hHR2XqDf4o7nsBq/A1TD7xn9ExZ2aMEHJuwDEQ==',key_name='tempest-keypair-1161830264',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d59b73851c79473a9c2cdc0a120dfee0',ramdisk_id='',reservation_id='r-h0lolso0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-650796844',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-650796844-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-650796844',owner_user_name='tempest-TestVolumeBootPattern-650796844-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T23:46:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='76c31c64d9594f9cbef7586fafb48721',uuid=0fb331fa-231e-482e-abfc-df39b13fb33a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0c7a4468-f510-4a33-8ee7-d70da98f972b", "address": "fa:16:3e:8a:8b:88", "network": {"id": "4205f899-9865-4c65-8b46-c9a533e9bb45", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-774780781-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d59b73851c79473a9c2cdc0a120dfee0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c7a4468-f5", "ovs_interfaceid": "0c7a4468-f510-4a33-8ee7-d70da98f972b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75045) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 23:47:24 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-1548c155-2750-4b8a-959c-8e7b0cb959cd tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Converting VIF {"id": "0c7a4468-f510-4a33-8ee7-d70da98f972b", "address": "fa:16:3e:8a:8b:88", "network": {"id": "4205f899-9865-4c65-8b46-c9a533e9bb45", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-774780781-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d59b73851c79473a9c2cdc0a120dfee0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c7a4468-f5", "ovs_interfaceid": "0c7a4468-f510-4a33-8ee7-d70da98f972b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 23:47:24 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-1548c155-2750-4b8a-959c-8e7b0cb959cd tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8a:8b:88,bridge_name='br-int',has_traffic_filtering=True,id=0c7a4468-f510-4a33-8ee7-d70da98f972b,network=Network(4205f899-9865-4c65-8b46-c9a533e9bb45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0c7a4468-f5') {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 23:47:24 user nova-compute[75045]: DEBUG os_vif [None req-1548c155-2750-4b8a-959c-8e7b0cb959cd tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8a:8b:88,bridge_name='br-int',has_traffic_filtering=True,id=0c7a4468-f510-4a33-8ee7-d70da98f972b,network=Network(4205f899-9865-4c65-8b46-c9a533e9bb45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0c7a4468-f5') {{(pid=75045) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 23:47:24 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:47:24 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:47:24 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 23:47:24 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:47:24 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2ffc2391-76a5-542d-8a70-21ae52c75ef3', '_type': 'linux-noop'}}, row=False) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:47:24 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:47:24 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 23:47:24 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:47:24 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0c7a4468-f5, may_exist=True, interface_attrs={}) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:47:24 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0c7a4468-f5, col_values=(('qos', UUID('d79c085d-43ff-43d9-9ad4-45cdbd718cfa')),), if_exists=True) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:47:24 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0c7a4468-f5, col_values=(('external_ids', {'iface-id': '0c7a4468-f510-4a33-8ee7-d70da98f972b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8a:8b:88', 'vm-uuid': '0fb331fa-231e-482e-abfc-df39b13fb33a'}),), if_exists=True) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:47:24 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:47:24 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 23:47:24 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:47:24 user nova-compute[75045]: INFO os_vif [None req-1548c155-2750-4b8a-959c-8e7b0cb959cd tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8a:8b:88,bridge_name='br-int',has_traffic_filtering=True,id=0c7a4468-f510-4a33-8ee7-d70da98f972b,network=Network(4205f899-9865-4c65-8b46-c9a533e9bb45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0c7a4468-f5')
Nov 08 23:47:24 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-1548c155-2750-4b8a-959c-8e7b0cb959cd tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] No BDM found with device name vda, not building metadata. {{(pid=75045) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 23:47:24 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-1548c155-2750-4b8a-959c-8e7b0cb959cd tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] No VIF found with MAC fa:16:3e:8a:8b:88, not building metadata {{(pid=75045) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 23:47:25 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:47:25 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:47:25 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:47:26 user nova-compute[75045]: DEBUG nova.compute.manager [req-3f5e670d-22b4-4cae-a961-c57db9a291a0 req-159f9813-5502-417c-8b0e-180130c35871 service nova] [instance: 0fb331fa-231e-482e-abfc-df39b13fb33a] Received event network-vif-plugged-0c7a4468-f510-4a33-8ee7-d70da98f972b {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:47:26 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-3f5e670d-22b4-4cae-a961-c57db9a291a0 req-159f9813-5502-417c-8b0e-180130c35871 service nova] Acquiring lock "0fb331fa-231e-482e-abfc-df39b13fb33a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:47:26 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-3f5e670d-22b4-4cae-a961-c57db9a291a0 req-159f9813-5502-417c-8b0e-180130c35871 service nova] Lock "0fb331fa-231e-482e-abfc-df39b13fb33a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:47:26 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-3f5e670d-22b4-4cae-a961-c57db9a291a0 req-159f9813-5502-417c-8b0e-180130c35871 service nova] Lock "0fb331fa-231e-482e-abfc-df39b13fb33a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:47:26 user nova-compute[75045]: DEBUG nova.compute.manager [req-3f5e670d-22b4-4cae-a961-c57db9a291a0 req-159f9813-5502-417c-8b0e-180130c35871 service nova] [instance: 0fb331fa-231e-482e-abfc-df39b13fb33a] No waiting events found dispatching network-vif-plugged-0c7a4468-f510-4a33-8ee7-d70da98f972b {{(pid=75045) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 23:47:26 user nova-compute[75045]: WARNING nova.compute.manager [req-3f5e670d-22b4-4cae-a961-c57db9a291a0 req-159f9813-5502-417c-8b0e-180130c35871 service nova] [instance: 0fb331fa-231e-482e-abfc-df39b13fb33a] Received unexpected event network-vif-plugged-0c7a4468-f510-4a33-8ee7-d70da98f972b for instance with vm_state building and task_state spawning.
Nov 08 23:47:26 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:47:26 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:47:26 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:47:28 user nova-compute[75045]: DEBUG nova.compute.manager [None req-1548c155-2750-4b8a-959c-8e7b0cb959cd tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] [instance: 0fb331fa-231e-482e-abfc-df39b13fb33a] Instance event wait completed in 0 seconds for  {{(pid=75045) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 23:47:28 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-1548c155-2750-4b8a-959c-8e7b0cb959cd tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] [instance: 0fb331fa-231e-482e-abfc-df39b13fb33a] Guest created on hypervisor {{(pid=75045) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 23:47:28 user nova-compute[75045]: INFO nova.virt.libvirt.driver [-] [instance: 0fb331fa-231e-482e-abfc-df39b13fb33a] Instance spawned successfully.
Nov 08 23:47:28 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-1548c155-2750-4b8a-959c-8e7b0cb959cd tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] [instance: 0fb331fa-231e-482e-abfc-df39b13fb33a] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=75045) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 23:47:28 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-1548c155-2750-4b8a-959c-8e7b0cb959cd tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] [instance: 0fb331fa-231e-482e-abfc-df39b13fb33a] Found default for hw_input_bus of None {{(pid=75045) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 23:47:28 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-1548c155-2750-4b8a-959c-8e7b0cb959cd tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] [instance: 0fb331fa-231e-482e-abfc-df39b13fb33a] Found default for hw_pointer_model of None {{(pid=75045) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 23:47:28 user nova-compute[75045]: INFO nova.compute.manager [None req-1548c155-2750-4b8a-959c-8e7b0cb959cd tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] [instance: 0fb331fa-231e-482e-abfc-df39b13fb33a] Took 5.07 seconds to spawn the instance on the hypervisor.
Nov 08 23:47:28 user nova-compute[75045]: DEBUG nova.compute.manager [None req-1548c155-2750-4b8a-959c-8e7b0cb959cd tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] [instance: 0fb331fa-231e-482e-abfc-df39b13fb33a] Checking state {{(pid=75045) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 23:47:28 user nova-compute[75045]: DEBUG nova.compute.manager [req-50383e95-2210-41dc-976b-d8d55a156c51 req-f5c3ec9c-b6ca-465b-9bdc-00113be71207 service nova] [instance: 0fb331fa-231e-482e-abfc-df39b13fb33a] Received event network-vif-plugged-0c7a4468-f510-4a33-8ee7-d70da98f972b {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:47:28 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-50383e95-2210-41dc-976b-d8d55a156c51 req-f5c3ec9c-b6ca-465b-9bdc-00113be71207 service nova] Acquiring lock "0fb331fa-231e-482e-abfc-df39b13fb33a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:47:28 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-50383e95-2210-41dc-976b-d8d55a156c51 req-f5c3ec9c-b6ca-465b-9bdc-00113be71207 service nova] Lock "0fb331fa-231e-482e-abfc-df39b13fb33a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:47:28 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-50383e95-2210-41dc-976b-d8d55a156c51 req-f5c3ec9c-b6ca-465b-9bdc-00113be71207 service nova] Lock "0fb331fa-231e-482e-abfc-df39b13fb33a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:47:28 user nova-compute[75045]: DEBUG nova.compute.manager [req-50383e95-2210-41dc-976b-d8d55a156c51 req-f5c3ec9c-b6ca-465b-9bdc-00113be71207 service nova] [instance: 0fb331fa-231e-482e-abfc-df39b13fb33a] No waiting events found dispatching network-vif-plugged-0c7a4468-f510-4a33-8ee7-d70da98f972b {{(pid=75045) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 23:47:28 user nova-compute[75045]: WARNING nova.compute.manager [req-50383e95-2210-41dc-976b-d8d55a156c51 req-f5c3ec9c-b6ca-465b-9bdc-00113be71207 service nova] [instance: 0fb331fa-231e-482e-abfc-df39b13fb33a] Received unexpected event network-vif-plugged-0c7a4468-f510-4a33-8ee7-d70da98f972b for instance with vm_state building and task_state spawning.
Nov 08 23:47:28 user nova-compute[75045]: INFO nova.compute.manager [None req-1548c155-2750-4b8a-959c-8e7b0cb959cd tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] [instance: 0fb331fa-231e-482e-abfc-df39b13fb33a] Took 78.23 seconds to build instance.
Nov 08 23:47:28 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-1548c155-2750-4b8a-959c-8e7b0cb959cd tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Lock "0fb331fa-231e-482e-abfc-df39b13fb33a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 78.399s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:47:28 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:47:29 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:47:31 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:47:33 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:47:34 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:47:35 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:47:35 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-6c7299ae-ab4f-4491-a276-0c9541f717ca tempest-ServersNegativeTestJSON-1185286380 tempest-ServersNegativeTestJSON-1185286380-project-member] Acquiring lock "244c4cc9-2837-40c9-b4ad-37dc435c9749" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:47:35 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-6c7299ae-ab4f-4491-a276-0c9541f717ca tempest-ServersNegativeTestJSON-1185286380 tempest-ServersNegativeTestJSON-1185286380-project-member] Lock "244c4cc9-2837-40c9-b4ad-37dc435c9749" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:47:35 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-6c7299ae-ab4f-4491-a276-0c9541f717ca tempest-ServersNegativeTestJSON-1185286380 tempest-ServersNegativeTestJSON-1185286380-project-member] Acquiring lock "244c4cc9-2837-40c9-b4ad-37dc435c9749-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:47:35 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-6c7299ae-ab4f-4491-a276-0c9541f717ca tempest-ServersNegativeTestJSON-1185286380 tempest-ServersNegativeTestJSON-1185286380-project-member] Lock "244c4cc9-2837-40c9-b4ad-37dc435c9749-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:47:35 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-6c7299ae-ab4f-4491-a276-0c9541f717ca tempest-ServersNegativeTestJSON-1185286380 tempest-ServersNegativeTestJSON-1185286380-project-member] Lock "244c4cc9-2837-40c9-b4ad-37dc435c9749-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:47:35 user nova-compute[75045]: INFO nova.compute.manager [None req-6c7299ae-ab4f-4491-a276-0c9541f717ca tempest-ServersNegativeTestJSON-1185286380 tempest-ServersNegativeTestJSON-1185286380-project-member] [instance: 244c4cc9-2837-40c9-b4ad-37dc435c9749] Terminating instance
Nov 08 23:47:35 user nova-compute[75045]: DEBUG nova.compute.manager [None req-6c7299ae-ab4f-4491-a276-0c9541f717ca tempest-ServersNegativeTestJSON-1185286380 tempest-ServersNegativeTestJSON-1185286380-project-member] [instance: 244c4cc9-2837-40c9-b4ad-37dc435c9749] Start destroying the instance on the hypervisor. {{(pid=75045) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 23:47:35 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:47:35 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:47:35 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:47:35 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:47:36 user nova-compute[75045]: INFO nova.virt.libvirt.driver [-] [instance: 244c4cc9-2837-40c9-b4ad-37dc435c9749] Instance destroyed successfully.
Nov 08 23:47:36 user nova-compute[75045]: DEBUG nova.objects.instance [None req-6c7299ae-ab4f-4491-a276-0c9541f717ca tempest-ServersNegativeTestJSON-1185286380 tempest-ServersNegativeTestJSON-1185286380-project-member] Lazy-loading 'resources' on Instance uuid 244c4cc9-2837-40c9-b4ad-37dc435c9749 {{(pid=75045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 23:47:36 user nova-compute[75045]: DEBUG nova.virt.libvirt.vif [None req-6c7299ae-ab4f-4491-a276-0c9541f717ca tempest-ServersNegativeTestJSON-1185286380 tempest-ServersNegativeTestJSON-1185286380-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T23:37:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1122899853',display_name='tempest-ServersNegativeTestJSON-server-1122899853',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1122899853',id=36,image_ref='a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-08T23:37:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='61c8f99e9d284b51bbf7bbf6bdfb8662',ramdisk_id='',reservation_id='r-qvqox6rw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-1185286380',owner_user_name='tempest-ServersNegativeTestJSON-1185286380-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T23:37:38Z,user_data=None,user_id='43c4b404522b424b8e23b2b5687a7821',uuid=244c4cc9-2837-40c9-b4ad-37dc435c9749,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a5a35e2b-77b5-4f76-a70a-0088652c0420", "address": "fa:16:3e:9f:19:4e", "network": {"id": "eac8b567-0d31-42ec-b05d-2ca251612286", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1889897935-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "61c8f99e9d284b51bbf7bbf6bdfb8662", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5a35e2b-77", "ovs_interfaceid": "a5a35e2b-77b5-4f76-a70a-0088652c0420", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75045) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 23:47:36 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-6c7299ae-ab4f-4491-a276-0c9541f717ca tempest-ServersNegativeTestJSON-1185286380 tempest-ServersNegativeTestJSON-1185286380-project-member] Converting VIF {"id": "a5a35e2b-77b5-4f76-a70a-0088652c0420", "address": "fa:16:3e:9f:19:4e", "network": {"id": "eac8b567-0d31-42ec-b05d-2ca251612286", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1889897935-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "61c8f99e9d284b51bbf7bbf6bdfb8662", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5a35e2b-77", "ovs_interfaceid": "a5a35e2b-77b5-4f76-a70a-0088652c0420", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 23:47:36 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-6c7299ae-ab4f-4491-a276-0c9541f717ca tempest-ServersNegativeTestJSON-1185286380 tempest-ServersNegativeTestJSON-1185286380-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9f:19:4e,bridge_name='br-int',has_traffic_filtering=True,id=a5a35e2b-77b5-4f76-a70a-0088652c0420,network=Network(eac8b567-0d31-42ec-b05d-2ca251612286),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa5a35e2b-77') {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 23:47:36 user nova-compute[75045]: DEBUG os_vif [None req-6c7299ae-ab4f-4491-a276-0c9541f717ca tempest-ServersNegativeTestJSON-1185286380 tempest-ServersNegativeTestJSON-1185286380-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:9f:19:4e,bridge_name='br-int',has_traffic_filtering=True,id=a5a35e2b-77b5-4f76-a70a-0088652c0420,network=Network(eac8b567-0d31-42ec-b05d-2ca251612286),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa5a35e2b-77') {{(pid=75045) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 23:47:36 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:47:36 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa5a35e2b-77, bridge=br-int, if_exists=True) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:47:36 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 23:47:36 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:47:36 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=88bfd7d5-2720-4bc9-a1e1-ab2a11c6ffff) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:47:36 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:47:36 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 23:47:36 user nova-compute[75045]: INFO os_vif [None req-6c7299ae-ab4f-4491-a276-0c9541f717ca tempest-ServersNegativeTestJSON-1185286380 tempest-ServersNegativeTestJSON-1185286380-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:9f:19:4e,bridge_name='br-int',has_traffic_filtering=True,id=a5a35e2b-77b5-4f76-a70a-0088652c0420,network=Network(eac8b567-0d31-42ec-b05d-2ca251612286),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa5a35e2b-77')
Nov 08 23:47:36 user nova-compute[75045]: INFO nova.virt.libvirt.driver [None req-6c7299ae-ab4f-4491-a276-0c9541f717ca tempest-ServersNegativeTestJSON-1185286380 tempest-ServersNegativeTestJSON-1185286380-project-member] [instance: 244c4cc9-2837-40c9-b4ad-37dc435c9749] Deleting instance files /opt/stack/data/nova/instances/244c4cc9-2837-40c9-b4ad-37dc435c9749_del
Nov 08 23:47:36 user nova-compute[75045]: INFO nova.virt.libvirt.driver [None req-6c7299ae-ab4f-4491-a276-0c9541f717ca tempest-ServersNegativeTestJSON-1185286380 tempest-ServersNegativeTestJSON-1185286380-project-member] [instance: 244c4cc9-2837-40c9-b4ad-37dc435c9749] Deletion of /opt/stack/data/nova/instances/244c4cc9-2837-40c9-b4ad-37dc435c9749_del complete
Nov 08 23:47:36 user nova-compute[75045]: INFO nova.compute.manager [None req-6c7299ae-ab4f-4491-a276-0c9541f717ca tempest-ServersNegativeTestJSON-1185286380 tempest-ServersNegativeTestJSON-1185286380-project-member] [instance: 244c4cc9-2837-40c9-b4ad-37dc435c9749] Took 0.92 seconds to destroy the instance on the hypervisor.
Nov 08 23:47:36 user nova-compute[75045]: DEBUG oslo.service.loopingcall [None req-6c7299ae-ab4f-4491-a276-0c9541f717ca tempest-ServersNegativeTestJSON-1185286380 tempest-ServersNegativeTestJSON-1185286380-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75045) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 23:47:36 user nova-compute[75045]: DEBUG nova.compute.manager [-] [instance: 244c4cc9-2837-40c9-b4ad-37dc435c9749] Deallocating network for instance {{(pid=75045) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 23:47:36 user nova-compute[75045]: DEBUG nova.network.neutron [-] [instance: 244c4cc9-2837-40c9-b4ad-37dc435c9749] deallocate_for_instance() {{(pid=75045) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 23:47:36 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:47:36 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-89bdd3db-f0ed-4666-9d9f-1f3ba8d2d0d4 tempest-VolumesActionsTest-1069895698 tempest-VolumesActionsTest-1069895698-project-member] Acquiring lock "abb7206c-b2e2-4a5a-93a8-f7f16231cf26" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:47:36 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-89bdd3db-f0ed-4666-9d9f-1f3ba8d2d0d4 tempest-VolumesActionsTest-1069895698 tempest-VolumesActionsTest-1069895698-project-member] Lock "abb7206c-b2e2-4a5a-93a8-f7f16231cf26" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:47:37 user nova-compute[75045]: DEBUG nova.compute.manager [None req-89bdd3db-f0ed-4666-9d9f-1f3ba8d2d0d4 tempest-VolumesActionsTest-1069895698 tempest-VolumesActionsTest-1069895698-project-member] [instance: abb7206c-b2e2-4a5a-93a8-f7f16231cf26] Starting instance... {{(pid=75045) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 23:47:37 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-89bdd3db-f0ed-4666-9d9f-1f3ba8d2d0d4 tempest-VolumesActionsTest-1069895698 tempest-VolumesActionsTest-1069895698-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:47:37 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-89bdd3db-f0ed-4666-9d9f-1f3ba8d2d0d4 tempest-VolumesActionsTest-1069895698 tempest-VolumesActionsTest-1069895698-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:47:37 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-89bdd3db-f0ed-4666-9d9f-1f3ba8d2d0d4 tempest-VolumesActionsTest-1069895698 tempest-VolumesActionsTest-1069895698-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75045) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 23:47:37 user nova-compute[75045]: INFO nova.compute.claims [None req-89bdd3db-f0ed-4666-9d9f-1f3ba8d2d0d4 tempest-VolumesActionsTest-1069895698 tempest-VolumesActionsTest-1069895698-project-member] [instance: abb7206c-b2e2-4a5a-93a8-f7f16231cf26] Claim successful on node user
Nov 08 23:47:37 user nova-compute[75045]: DEBUG nova.network.neutron [-] [instance: 244c4cc9-2837-40c9-b4ad-37dc435c9749] Updating instance_info_cache with network_info: [] {{(pid=75045) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 23:47:37 user nova-compute[75045]: INFO nova.compute.manager [-] [instance: 244c4cc9-2837-40c9-b4ad-37dc435c9749] Took 0.53 seconds to deallocate network for instance.
Nov 08 23:47:37 user nova-compute[75045]: DEBUG nova.compute.manager [req-81a0225d-b369-4a92-b6c6-4caeb98fae43 req-438a3d56-823e-4a5f-930b-c67bd8ae9e39 service nova] [instance: 244c4cc9-2837-40c9-b4ad-37dc435c9749] Received event network-vif-deleted-a5a35e2b-77b5-4f76-a70a-0088652c0420 {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:47:37 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-6c7299ae-ab4f-4491-a276-0c9541f717ca tempest-ServersNegativeTestJSON-1185286380 tempest-ServersNegativeTestJSON-1185286380-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:47:37 user nova-compute[75045]: DEBUG nova.compute.provider_tree [None req-89bdd3db-f0ed-4666-9d9f-1f3ba8d2d0d4 tempest-VolumesActionsTest-1069895698 tempest-VolumesActionsTest-1069895698-project-member] Inventory has not changed in ProviderTree for provider: 62ba5f85-c74d-4b58-986e-d4197e813fd7 {{(pid=75045) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 23:47:37 user nova-compute[75045]: DEBUG nova.scheduler.client.report [None req-89bdd3db-f0ed-4666-9d9f-1f3ba8d2d0d4 tempest-VolumesActionsTest-1069895698 tempest-VolumesActionsTest-1069895698-project-member] Inventory has not changed for provider 62ba5f85-c74d-4b58-986e-d4197e813fd7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75045) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 23:47:37 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-89bdd3db-f0ed-4666-9d9f-1f3ba8d2d0d4 tempest-VolumesActionsTest-1069895698 tempest-VolumesActionsTest-1069895698-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.313s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:47:37 user nova-compute[75045]: DEBUG nova.compute.manager [None req-89bdd3db-f0ed-4666-9d9f-1f3ba8d2d0d4 tempest-VolumesActionsTest-1069895698 tempest-VolumesActionsTest-1069895698-project-member] [instance: abb7206c-b2e2-4a5a-93a8-f7f16231cf26] Start building networks asynchronously for instance. {{(pid=75045) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 23:47:37 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-6c7299ae-ab4f-4491-a276-0c9541f717ca tempest-ServersNegativeTestJSON-1185286380 tempest-ServersNegativeTestJSON-1185286380-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.068s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:47:37 user nova-compute[75045]: DEBUG nova.compute.manager [None req-89bdd3db-f0ed-4666-9d9f-1f3ba8d2d0d4 tempest-VolumesActionsTest-1069895698 tempest-VolumesActionsTest-1069895698-project-member] [instance: abb7206c-b2e2-4a5a-93a8-f7f16231cf26] Allocating IP information in the background. {{(pid=75045) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 23:47:37 user nova-compute[75045]: DEBUG nova.network.neutron [None req-89bdd3db-f0ed-4666-9d9f-1f3ba8d2d0d4 tempest-VolumesActionsTest-1069895698 tempest-VolumesActionsTest-1069895698-project-member] [instance: abb7206c-b2e2-4a5a-93a8-f7f16231cf26] allocate_for_instance() {{(pid=75045) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 23:47:37 user nova-compute[75045]: INFO nova.virt.libvirt.driver [None req-89bdd3db-f0ed-4666-9d9f-1f3ba8d2d0d4 tempest-VolumesActionsTest-1069895698 tempest-VolumesActionsTest-1069895698-project-member] [instance: abb7206c-b2e2-4a5a-93a8-f7f16231cf26] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 23:47:37 user nova-compute[75045]: DEBUG nova.compute.manager [None req-89bdd3db-f0ed-4666-9d9f-1f3ba8d2d0d4 tempest-VolumesActionsTest-1069895698 tempest-VolumesActionsTest-1069895698-project-member] [instance: abb7206c-b2e2-4a5a-93a8-f7f16231cf26] Start building block device mappings for instance. {{(pid=75045) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 23:47:37 user nova-compute[75045]: DEBUG nova.policy [None req-89bdd3db-f0ed-4666-9d9f-1f3ba8d2d0d4 tempest-VolumesActionsTest-1069895698 tempest-VolumesActionsTest-1069895698-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1ebe1d42d4a548c59160031fa8bb3c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54a16cf0a668402585c1368907ad70c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75045) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 23:47:37 user nova-compute[75045]: DEBUG nova.compute.provider_tree [None req-6c7299ae-ab4f-4491-a276-0c9541f717ca tempest-ServersNegativeTestJSON-1185286380 tempest-ServersNegativeTestJSON-1185286380-project-member] Inventory has not changed in ProviderTree for provider: 62ba5f85-c74d-4b58-986e-d4197e813fd7 {{(pid=75045) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 23:47:37 user nova-compute[75045]: DEBUG nova.scheduler.client.report [None req-6c7299ae-ab4f-4491-a276-0c9541f717ca tempest-ServersNegativeTestJSON-1185286380 tempest-ServersNegativeTestJSON-1185286380-project-member] Inventory has not changed for provider 62ba5f85-c74d-4b58-986e-d4197e813fd7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75045) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 23:47:37 user nova-compute[75045]: DEBUG nova.compute.manager [None req-89bdd3db-f0ed-4666-9d9f-1f3ba8d2d0d4 tempest-VolumesActionsTest-1069895698 tempest-VolumesActionsTest-1069895698-project-member] [instance: abb7206c-b2e2-4a5a-93a8-f7f16231cf26] Start spawning the instance on the hypervisor. {{(pid=75045) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 23:47:37 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-89bdd3db-f0ed-4666-9d9f-1f3ba8d2d0d4 tempest-VolumesActionsTest-1069895698 tempest-VolumesActionsTest-1069895698-project-member] [instance: abb7206c-b2e2-4a5a-93a8-f7f16231cf26] Creating instance directory {{(pid=75045) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 23:47:37 user nova-compute[75045]: INFO nova.virt.libvirt.driver [None req-89bdd3db-f0ed-4666-9d9f-1f3ba8d2d0d4 tempest-VolumesActionsTest-1069895698 tempest-VolumesActionsTest-1069895698-project-member] [instance: abb7206c-b2e2-4a5a-93a8-f7f16231cf26] Creating image(s)
Nov 08 23:47:37 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-89bdd3db-f0ed-4666-9d9f-1f3ba8d2d0d4 tempest-VolumesActionsTest-1069895698 tempest-VolumesActionsTest-1069895698-project-member] Acquiring lock "/opt/stack/data/nova/instances/abb7206c-b2e2-4a5a-93a8-f7f16231cf26/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:47:37 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-89bdd3db-f0ed-4666-9d9f-1f3ba8d2d0d4 tempest-VolumesActionsTest-1069895698 tempest-VolumesActionsTest-1069895698-project-member] Lock "/opt/stack/data/nova/instances/abb7206c-b2e2-4a5a-93a8-f7f16231cf26/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:47:37 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-89bdd3db-f0ed-4666-9d9f-1f3ba8d2d0d4 tempest-VolumesActionsTest-1069895698 tempest-VolumesActionsTest-1069895698-project-member] Lock "/opt/stack/data/nova/instances/abb7206c-b2e2-4a5a-93a8-f7f16231cf26/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:47:37 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-6c7299ae-ab4f-4491-a276-0c9541f717ca tempest-ServersNegativeTestJSON-1185286380 tempest-ServersNegativeTestJSON-1185286380-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.230s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:47:37 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-89bdd3db-f0ed-4666-9d9f-1f3ba8d2d0d4 tempest-VolumesActionsTest-1069895698 tempest-VolumesActionsTest-1069895698-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b59f52a99fff51c56dd1edfb83892fb8f647f2f3 --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:47:37 user nova-compute[75045]: INFO nova.scheduler.client.report [None req-6c7299ae-ab4f-4491-a276-0c9541f717ca tempest-ServersNegativeTestJSON-1185286380 tempest-ServersNegativeTestJSON-1185286380-project-member] Deleted allocations for instance 244c4cc9-2837-40c9-b4ad-37dc435c9749
Nov 08 23:47:37 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-6c7299ae-ab4f-4491-a276-0c9541f717ca tempest-ServersNegativeTestJSON-1185286380 tempest-ServersNegativeTestJSON-1185286380-project-member] Lock "244c4cc9-2837-40c9-b4ad-37dc435c9749" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:47:37 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-89bdd3db-f0ed-4666-9d9f-1f3ba8d2d0d4 tempest-VolumesActionsTest-1069895698 tempest-VolumesActionsTest-1069895698-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b59f52a99fff51c56dd1edfb83892fb8f647f2f3 --force-share --output=json" returned: 0 in 0.185s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:47:37 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-89bdd3db-f0ed-4666-9d9f-1f3ba8d2d0d4 tempest-VolumesActionsTest-1069895698 tempest-VolumesActionsTest-1069895698-project-member] Acquiring lock "b59f52a99fff51c56dd1edfb83892fb8f647f2f3" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:47:37 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-89bdd3db-f0ed-4666-9d9f-1f3ba8d2d0d4 tempest-VolumesActionsTest-1069895698 tempest-VolumesActionsTest-1069895698-project-member] Lock "b59f52a99fff51c56dd1edfb83892fb8f647f2f3" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:47:37 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-89bdd3db-f0ed-4666-9d9f-1f3ba8d2d0d4 tempest-VolumesActionsTest-1069895698 tempest-VolumesActionsTest-1069895698-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b59f52a99fff51c56dd1edfb83892fb8f647f2f3 --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:47:38 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-89bdd3db-f0ed-4666-9d9f-1f3ba8d2d0d4 tempest-VolumesActionsTest-1069895698 tempest-VolumesActionsTest-1069895698-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b59f52a99fff51c56dd1edfb83892fb8f647f2f3 --force-share --output=json" returned: 0 in 0.210s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:47:38 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-89bdd3db-f0ed-4666-9d9f-1f3ba8d2d0d4 tempest-VolumesActionsTest-1069895698 tempest-VolumesActionsTest-1069895698-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b59f52a99fff51c56dd1edfb83892fb8f647f2f3,backing_fmt=raw /opt/stack/data/nova/instances/abb7206c-b2e2-4a5a-93a8-f7f16231cf26/disk 1073741824 {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:47:38 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:47:38 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-89bdd3db-f0ed-4666-9d9f-1f3ba8d2d0d4 tempest-VolumesActionsTest-1069895698 tempest-VolumesActionsTest-1069895698-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b59f52a99fff51c56dd1edfb83892fb8f647f2f3,backing_fmt=raw /opt/stack/data/nova/instances/abb7206c-b2e2-4a5a-93a8-f7f16231cf26/disk 1073741824" returned: 0 in 0.060s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:47:38 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-89bdd3db-f0ed-4666-9d9f-1f3ba8d2d0d4 tempest-VolumesActionsTest-1069895698 tempest-VolumesActionsTest-1069895698-project-member] Lock "b59f52a99fff51c56dd1edfb83892fb8f647f2f3" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.275s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:47:38 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-89bdd3db-f0ed-4666-9d9f-1f3ba8d2d0d4 tempest-VolumesActionsTest-1069895698 tempest-VolumesActionsTest-1069895698-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b59f52a99fff51c56dd1edfb83892fb8f647f2f3 --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:47:38 user nova-compute[75045]: DEBUG nova.network.neutron [None req-89bdd3db-f0ed-4666-9d9f-1f3ba8d2d0d4 tempest-VolumesActionsTest-1069895698 tempest-VolumesActionsTest-1069895698-project-member] [instance: abb7206c-b2e2-4a5a-93a8-f7f16231cf26] Successfully created port: e534dbaa-36f9-4cdf-86a1-78a17054ab8e {{(pid=75045) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 23:47:38 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-89bdd3db-f0ed-4666-9d9f-1f3ba8d2d0d4 tempest-VolumesActionsTest-1069895698 tempest-VolumesActionsTest-1069895698-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b59f52a99fff51c56dd1edfb83892fb8f647f2f3 --force-share --output=json" returned: 0 in 0.189s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:47:38 user nova-compute[75045]: DEBUG nova.virt.disk.api [None req-89bdd3db-f0ed-4666-9d9f-1f3ba8d2d0d4 tempest-VolumesActionsTest-1069895698 tempest-VolumesActionsTest-1069895698-project-member] Checking if we can resize image /opt/stack/data/nova/instances/abb7206c-b2e2-4a5a-93a8-f7f16231cf26/disk. size=1073741824 {{(pid=75045) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 23:47:38 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-89bdd3db-f0ed-4666-9d9f-1f3ba8d2d0d4 tempest-VolumesActionsTest-1069895698 tempest-VolumesActionsTest-1069895698-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abb7206c-b2e2-4a5a-93a8-f7f16231cf26/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:47:38 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-89bdd3db-f0ed-4666-9d9f-1f3ba8d2d0d4 tempest-VolumesActionsTest-1069895698 tempest-VolumesActionsTest-1069895698-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abb7206c-b2e2-4a5a-93a8-f7f16231cf26/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:47:38 user nova-compute[75045]: DEBUG nova.virt.disk.api [None req-89bdd3db-f0ed-4666-9d9f-1f3ba8d2d0d4 tempest-VolumesActionsTest-1069895698 tempest-VolumesActionsTest-1069895698-project-member] Cannot resize image /opt/stack/data/nova/instances/abb7206c-b2e2-4a5a-93a8-f7f16231cf26/disk to a smaller size. {{(pid=75045) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 08 23:47:38 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-89bdd3db-f0ed-4666-9d9f-1f3ba8d2d0d4 tempest-VolumesActionsTest-1069895698 tempest-VolumesActionsTest-1069895698-project-member] [instance: abb7206c-b2e2-4a5a-93a8-f7f16231cf26] Created local disks {{(pid=75045) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 23:47:38 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-89bdd3db-f0ed-4666-9d9f-1f3ba8d2d0d4 tempest-VolumesActionsTest-1069895698 tempest-VolumesActionsTest-1069895698-project-member] [instance: abb7206c-b2e2-4a5a-93a8-f7f16231cf26] Ensure instance console log exists: /opt/stack/data/nova/instances/abb7206c-b2e2-4a5a-93a8-f7f16231cf26/console.log {{(pid=75045) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 23:47:38 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-89bdd3db-f0ed-4666-9d9f-1f3ba8d2d0d4 tempest-VolumesActionsTest-1069895698 tempest-VolumesActionsTest-1069895698-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:47:38 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-89bdd3db-f0ed-4666-9d9f-1f3ba8d2d0d4 tempest-VolumesActionsTest-1069895698 tempest-VolumesActionsTest-1069895698-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:47:38 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-89bdd3db-f0ed-4666-9d9f-1f3ba8d2d0d4 tempest-VolumesActionsTest-1069895698 tempest-VolumesActionsTest-1069895698-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:47:38 user nova-compute[75045]: DEBUG nova.network.neutron [None req-89bdd3db-f0ed-4666-9d9f-1f3ba8d2d0d4 tempest-VolumesActionsTest-1069895698 tempest-VolumesActionsTest-1069895698-project-member] [instance: abb7206c-b2e2-4a5a-93a8-f7f16231cf26] Successfully updated port: e534dbaa-36f9-4cdf-86a1-78a17054ab8e {{(pid=75045) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 23:47:38 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-89bdd3db-f0ed-4666-9d9f-1f3ba8d2d0d4 tempest-VolumesActionsTest-1069895698 tempest-VolumesActionsTest-1069895698-project-member] Acquiring lock "refresh_cache-abb7206c-b2e2-4a5a-93a8-f7f16231cf26" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 23:47:38 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-89bdd3db-f0ed-4666-9d9f-1f3ba8d2d0d4 tempest-VolumesActionsTest-1069895698 tempest-VolumesActionsTest-1069895698-project-member] Acquired lock "refresh_cache-abb7206c-b2e2-4a5a-93a8-f7f16231cf26" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 23:47:38 user nova-compute[75045]: DEBUG nova.network.neutron [None req-89bdd3db-f0ed-4666-9d9f-1f3ba8d2d0d4 tempest-VolumesActionsTest-1069895698 tempest-VolumesActionsTest-1069895698-project-member] [instance: abb7206c-b2e2-4a5a-93a8-f7f16231cf26] Building network info cache for instance {{(pid=75045) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 23:47:38 user nova-compute[75045]: DEBUG nova.network.neutron [None req-89bdd3db-f0ed-4666-9d9f-1f3ba8d2d0d4 tempest-VolumesActionsTest-1069895698 tempest-VolumesActionsTest-1069895698-project-member] [instance: abb7206c-b2e2-4a5a-93a8-f7f16231cf26] Instance cache missing network info. {{(pid=75045) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 23:47:39 user nova-compute[75045]: DEBUG nova.network.neutron [None req-89bdd3db-f0ed-4666-9d9f-1f3ba8d2d0d4 tempest-VolumesActionsTest-1069895698 tempest-VolumesActionsTest-1069895698-project-member] [instance: abb7206c-b2e2-4a5a-93a8-f7f16231cf26] Updating instance_info_cache with network_info: [{"id": "e534dbaa-36f9-4cdf-86a1-78a17054ab8e", "address": "fa:16:3e:e9:e7:83", "network": {"id": "17bb03f5-be7a-40ac-a446-bf0162682d12", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1668425609-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54a16cf0a668402585c1368907ad70c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape534dbaa-36", "ovs_interfaceid": "e534dbaa-36f9-4cdf-86a1-78a17054ab8e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75045) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 23:47:39 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-89bdd3db-f0ed-4666-9d9f-1f3ba8d2d0d4 tempest-VolumesActionsTest-1069895698 tempest-VolumesActionsTest-1069895698-project-member] Releasing lock "refresh_cache-abb7206c-b2e2-4a5a-93a8-f7f16231cf26" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 23:47:39 user nova-compute[75045]: DEBUG nova.compute.manager [None req-89bdd3db-f0ed-4666-9d9f-1f3ba8d2d0d4 tempest-VolumesActionsTest-1069895698 tempest-VolumesActionsTest-1069895698-project-member] [instance: abb7206c-b2e2-4a5a-93a8-f7f16231cf26] Instance network_info: |[{"id": "e534dbaa-36f9-4cdf-86a1-78a17054ab8e", "address": "fa:16:3e:e9:e7:83", "network": {"id": "17bb03f5-be7a-40ac-a446-bf0162682d12", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1668425609-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54a16cf0a668402585c1368907ad70c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape534dbaa-36", "ovs_interfaceid": "e534dbaa-36f9-4cdf-86a1-78a17054ab8e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75045) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 23:47:39 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-89bdd3db-f0ed-4666-9d9f-1f3ba8d2d0d4 tempest-VolumesActionsTest-1069895698 tempest-VolumesActionsTest-1069895698-project-member] [instance: abb7206c-b2e2-4a5a-93a8-f7f16231cf26] Start _get_guest_xml network_info=[{"id": "e534dbaa-36f9-4cdf-86a1-78a17054ab8e", "address": "fa:16:3e:e9:e7:83", "network": {"id": "17bb03f5-be7a-40ac-a446-bf0162682d12", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1668425609-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54a16cf0a668402585c1368907ad70c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape534dbaa-36", "ovs_interfaceid": "e534dbaa-36f9-4cdf-86a1-78a17054ab8e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T23:11:54Z,direct_url=<?>,disk_format='qcow2',id=a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b1beba2cc4e7465ea249e2225fb494dc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T23:11:56Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'disk_bus': 'virtio', 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': 'a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75045) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 23:47:39 user nova-compute[75045]: WARNING nova.virt.libvirt.driver [None req-89bdd3db-f0ed-4666-9d9f-1f3ba8d2d0d4 tempest-VolumesActionsTest-1069895698 tempest-VolumesActionsTest-1069895698-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 23:47:39 user nova-compute[75045]: WARNING nova.virt.libvirt.driver [None req-89bdd3db-f0ed-4666-9d9f-1f3ba8d2d0d4 tempest-VolumesActionsTest-1069895698 tempest-VolumesActionsTest-1069895698-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 23:47:39 user nova-compute[75045]: DEBUG nova.virt.libvirt.host [None req-89bdd3db-f0ed-4666-9d9f-1f3ba8d2d0d4 tempest-VolumesActionsTest-1069895698 tempest-VolumesActionsTest-1069895698-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75045) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 23:47:39 user nova-compute[75045]: DEBUG nova.virt.libvirt.host [None req-89bdd3db-f0ed-4666-9d9f-1f3ba8d2d0d4 tempest-VolumesActionsTest-1069895698 tempest-VolumesActionsTest-1069895698-project-member] CPU controller missing on host. {{(pid=75045) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 23:47:39 user nova-compute[75045]: DEBUG nova.virt.libvirt.host [None req-89bdd3db-f0ed-4666-9d9f-1f3ba8d2d0d4 tempest-VolumesActionsTest-1069895698 tempest-VolumesActionsTest-1069895698-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75045) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 23:47:39 user nova-compute[75045]: DEBUG nova.virt.libvirt.host [None req-89bdd3db-f0ed-4666-9d9f-1f3ba8d2d0d4 tempest-VolumesActionsTest-1069895698 tempest-VolumesActionsTest-1069895698-project-member] CPU controller found on host. {{(pid=75045) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 23:47:39 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-89bdd3db-f0ed-4666-9d9f-1f3ba8d2d0d4 tempest-VolumesActionsTest-1069895698 tempest-VolumesActionsTest-1069895698-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75045) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 23:47:39 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-89bdd3db-f0ed-4666-9d9f-1f3ba8d2d0d4 tempest-VolumesActionsTest-1069895698 tempest-VolumesActionsTest-1069895698-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T23:11:41Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T23:11:54Z,direct_url=<?>,disk_format='qcow2',id=a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b1beba2cc4e7465ea249e2225fb494dc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T23:11:56Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75045) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 23:47:39 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-89bdd3db-f0ed-4666-9d9f-1f3ba8d2d0d4 tempest-VolumesActionsTest-1069895698 tempest-VolumesActionsTest-1069895698-project-member] Flavor limits 0:0:0 {{(pid=75045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 23:47:39 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-89bdd3db-f0ed-4666-9d9f-1f3ba8d2d0d4 tempest-VolumesActionsTest-1069895698 tempest-VolumesActionsTest-1069895698-project-member] Image limits 0:0:0 {{(pid=75045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 23:47:39 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-89bdd3db-f0ed-4666-9d9f-1f3ba8d2d0d4 tempest-VolumesActionsTest-1069895698 tempest-VolumesActionsTest-1069895698-project-member] Flavor pref 0:0:0 {{(pid=75045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 23:47:39 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-89bdd3db-f0ed-4666-9d9f-1f3ba8d2d0d4 tempest-VolumesActionsTest-1069895698 tempest-VolumesActionsTest-1069895698-project-member] Image pref 0:0:0 {{(pid=75045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 23:47:39 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-89bdd3db-f0ed-4666-9d9f-1f3ba8d2d0d4 tempest-VolumesActionsTest-1069895698 tempest-VolumesActionsTest-1069895698-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 23:47:39 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-89bdd3db-f0ed-4666-9d9f-1f3ba8d2d0d4 tempest-VolumesActionsTest-1069895698 tempest-VolumesActionsTest-1069895698-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75045) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 23:47:39 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-89bdd3db-f0ed-4666-9d9f-1f3ba8d2d0d4 tempest-VolumesActionsTest-1069895698 tempest-VolumesActionsTest-1069895698-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75045) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 23:47:39 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-89bdd3db-f0ed-4666-9d9f-1f3ba8d2d0d4 tempest-VolumesActionsTest-1069895698 tempest-VolumesActionsTest-1069895698-project-member] Got 1 possible topologies {{(pid=75045) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 23:47:39 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-89bdd3db-f0ed-4666-9d9f-1f3ba8d2d0d4 tempest-VolumesActionsTest-1069895698 tempest-VolumesActionsTest-1069895698-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75045) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 23:47:39 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-89bdd3db-f0ed-4666-9d9f-1f3ba8d2d0d4 tempest-VolumesActionsTest-1069895698 tempest-VolumesActionsTest-1069895698-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75045) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 23:47:39 user nova-compute[75045]: DEBUG nova.virt.libvirt.vif [None req-89bdd3db-f0ed-4666-9d9f-1f3ba8d2d0d4 tempest-VolumesActionsTest-1069895698 tempest-VolumesActionsTest-1069895698-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T23:47:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1415690750',display_name='tempest-VolumesActionsTest-instance-1415690750',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1415690750',id=45,image_ref='a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='54a16cf0a668402585c1368907ad70c4',ramdisk_id='',reservation_id='r-8p6mxi24',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1069895698',owner_user_name='tempest-VolumesActionsTest-1069895698-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T23:47:38Z,user_data=None,user_id='1ebe1d42d4a548c59160031fa8bb3c58',uuid=abb7206c-b2e2-4a5a-93a8-f7f16231cf26,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e534dbaa-36f9-4cdf-86a1-78a17054ab8e", "address": "fa:16:3e:e9:e7:83", "network": {"id": "17bb03f5-be7a-40ac-a446-bf0162682d12", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1668425609-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54a16cf0a668402585c1368907ad70c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape534dbaa-36", "ovs_interfaceid": "e534dbaa-36f9-4cdf-86a1-78a17054ab8e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75045) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 23:47:39 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-89bdd3db-f0ed-4666-9d9f-1f3ba8d2d0d4 tempest-VolumesActionsTest-1069895698 tempest-VolumesActionsTest-1069895698-project-member] Converting VIF {"id": "e534dbaa-36f9-4cdf-86a1-78a17054ab8e", "address": "fa:16:3e:e9:e7:83", "network": {"id": "17bb03f5-be7a-40ac-a446-bf0162682d12", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1668425609-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54a16cf0a668402585c1368907ad70c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape534dbaa-36", "ovs_interfaceid": "e534dbaa-36f9-4cdf-86a1-78a17054ab8e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 23:47:39 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-89bdd3db-f0ed-4666-9d9f-1f3ba8d2d0d4 tempest-VolumesActionsTest-1069895698 tempest-VolumesActionsTest-1069895698-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e9:e7:83,bridge_name='br-int',has_traffic_filtering=True,id=e534dbaa-36f9-4cdf-86a1-78a17054ab8e,network=Network(17bb03f5-be7a-40ac-a446-bf0162682d12),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape534dbaa-36') {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 23:47:39 user nova-compute[75045]: DEBUG nova.objects.instance [None req-89bdd3db-f0ed-4666-9d9f-1f3ba8d2d0d4 tempest-VolumesActionsTest-1069895698 tempest-VolumesActionsTest-1069895698-project-member] Lazy-loading 'pci_devices' on Instance uuid abb7206c-b2e2-4a5a-93a8-f7f16231cf26 {{(pid=75045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 23:47:39 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-89bdd3db-f0ed-4666-9d9f-1f3ba8d2d0d4 tempest-VolumesActionsTest-1069895698 tempest-VolumesActionsTest-1069895698-project-member] [instance: abb7206c-b2e2-4a5a-93a8-f7f16231cf26] End _get_guest_xml xml=<domain type="kvm">
Nov 08 23:47:39 user nova-compute[75045]:   <uuid>abb7206c-b2e2-4a5a-93a8-f7f16231cf26</uuid>
Nov 08 23:47:39 user nova-compute[75045]:   <name>instance-0000002d</name>
Nov 08 23:47:39 user nova-compute[75045]:   <memory>524288</memory>
Nov 08 23:47:39 user nova-compute[75045]:   <vcpu>1</vcpu>
Nov 08 23:47:39 user nova-compute[75045]:   <metadata>
Nov 08 23:47:39 user nova-compute[75045]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 23:47:39 user nova-compute[75045]:       <nova:package version="0.0.0"/>
Nov 08 23:47:39 user nova-compute[75045]:       <nova:name>tempest-VolumesActionsTest-instance-1415690750</nova:name>
Nov 08 23:47:39 user nova-compute[75045]:       <nova:creationTime>2023-11-08 23:47:39</nova:creationTime>
Nov 08 23:47:39 user nova-compute[75045]:       <nova:flavor name="m1.tiny">
Nov 08 23:47:39 user nova-compute[75045]:         <nova:memory>512</nova:memory>
Nov 08 23:47:39 user nova-compute[75045]:         <nova:disk>1</nova:disk>
Nov 08 23:47:39 user nova-compute[75045]:         <nova:swap>0</nova:swap>
Nov 08 23:47:39 user nova-compute[75045]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 23:47:39 user nova-compute[75045]:         <nova:vcpus>1</nova:vcpus>
Nov 08 23:47:39 user nova-compute[75045]:       </nova:flavor>
Nov 08 23:47:39 user nova-compute[75045]:       <nova:owner>
Nov 08 23:47:39 user nova-compute[75045]:         <nova:user uuid="1ebe1d42d4a548c59160031fa8bb3c58">tempest-VolumesActionsTest-1069895698-project-member</nova:user>
Nov 08 23:47:39 user nova-compute[75045]:         <nova:project uuid="54a16cf0a668402585c1368907ad70c4">tempest-VolumesActionsTest-1069895698</nova:project>
Nov 08 23:47:39 user nova-compute[75045]:       </nova:owner>
Nov 08 23:47:39 user nova-compute[75045]:       <nova:root type="image" uuid="a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb"/>
Nov 08 23:47:39 user nova-compute[75045]:       <nova:ports>
Nov 08 23:47:39 user nova-compute[75045]:         <nova:port uuid="e534dbaa-36f9-4cdf-86a1-78a17054ab8e">
Nov 08 23:47:39 user nova-compute[75045]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 08 23:47:39 user nova-compute[75045]:         </nova:port>
Nov 08 23:47:39 user nova-compute[75045]:       </nova:ports>
Nov 08 23:47:39 user nova-compute[75045]:     </nova:instance>
Nov 08 23:47:39 user nova-compute[75045]:   </metadata>
Nov 08 23:47:39 user nova-compute[75045]:   <sysinfo type="smbios">
Nov 08 23:47:39 user nova-compute[75045]:     <system>
Nov 08 23:47:39 user nova-compute[75045]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 23:47:39 user nova-compute[75045]:       <entry name="product">OpenStack Nova</entry>
Nov 08 23:47:39 user nova-compute[75045]:       <entry name="version">0.0.0</entry>
Nov 08 23:47:39 user nova-compute[75045]:       <entry name="serial">abb7206c-b2e2-4a5a-93a8-f7f16231cf26</entry>
Nov 08 23:47:39 user nova-compute[75045]:       <entry name="uuid">abb7206c-b2e2-4a5a-93a8-f7f16231cf26</entry>
Nov 08 23:47:39 user nova-compute[75045]:       <entry name="family">Virtual Machine</entry>
Nov 08 23:47:39 user nova-compute[75045]:     </system>
Nov 08 23:47:39 user nova-compute[75045]:   </sysinfo>
Nov 08 23:47:39 user nova-compute[75045]:   <os>
Nov 08 23:47:39 user nova-compute[75045]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 23:47:39 user nova-compute[75045]:     <boot dev="hd"/>
Nov 08 23:47:39 user nova-compute[75045]:     <smbios mode="sysinfo"/>
Nov 08 23:47:39 user nova-compute[75045]:   </os>
Nov 08 23:47:39 user nova-compute[75045]:   <features>
Nov 08 23:47:39 user nova-compute[75045]:     <acpi/>
Nov 08 23:47:39 user nova-compute[75045]:     <apic/>
Nov 08 23:47:39 user nova-compute[75045]:     <vmcoreinfo/>
Nov 08 23:47:39 user nova-compute[75045]:   </features>
Nov 08 23:47:39 user nova-compute[75045]:   <clock offset="utc">
Nov 08 23:47:39 user nova-compute[75045]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 23:47:39 user nova-compute[75045]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 23:47:39 user nova-compute[75045]:     <timer name="hpet" present="no"/>
Nov 08 23:47:39 user nova-compute[75045]:   </clock>
Nov 08 23:47:39 user nova-compute[75045]:   <cpu mode="custom" match="exact">
Nov 08 23:47:39 user nova-compute[75045]:     <model>Nehalem</model>
Nov 08 23:47:39 user nova-compute[75045]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 23:47:39 user nova-compute[75045]:   </cpu>
Nov 08 23:47:39 user nova-compute[75045]:   <devices>
Nov 08 23:47:39 user nova-compute[75045]:     <disk type="file" device="disk">
Nov 08 23:47:39 user nova-compute[75045]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 23:47:39 user nova-compute[75045]:       <source file="/opt/stack/data/nova/instances/abb7206c-b2e2-4a5a-93a8-f7f16231cf26/disk"/>
Nov 08 23:47:39 user nova-compute[75045]:       <target dev="vda" bus="virtio"/>
Nov 08 23:47:39 user nova-compute[75045]:     </disk>
Nov 08 23:47:39 user nova-compute[75045]:     <interface type="ethernet">
Nov 08 23:47:39 user nova-compute[75045]:       <mac address="fa:16:3e:e9:e7:83"/>
Nov 08 23:47:39 user nova-compute[75045]:       <model type="virtio"/>
Nov 08 23:47:39 user nova-compute[75045]:       <mtu size="1442"/>
Nov 08 23:47:39 user nova-compute[75045]:       <target dev="tape534dbaa-36"/>
Nov 08 23:47:39 user nova-compute[75045]:     </interface>
Nov 08 23:47:39 user nova-compute[75045]:     <serial type="pty">
Nov 08 23:47:39 user nova-compute[75045]:       <log file="/opt/stack/data/nova/instances/abb7206c-b2e2-4a5a-93a8-f7f16231cf26/console.log" append="off"/>
Nov 08 23:47:39 user nova-compute[75045]:     </serial>
Nov 08 23:47:39 user nova-compute[75045]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 23:47:39 user nova-compute[75045]:     <video>
Nov 08 23:47:39 user nova-compute[75045]:       <model type="virtio"/>
Nov 08 23:47:39 user nova-compute[75045]:     </video>
Nov 08 23:47:39 user nova-compute[75045]:     <rng model="virtio">
Nov 08 23:47:39 user nova-compute[75045]:       <backend model="random">/dev/urandom</backend>
Nov 08 23:47:39 user nova-compute[75045]:     </rng>
Nov 08 23:47:39 user nova-compute[75045]:     <controller type="usb" index="0" model="none"/>
Nov 08 23:47:39 user nova-compute[75045]:     <memballoon model="virtio">
Nov 08 23:47:39 user nova-compute[75045]:       <stats period="10"/>
Nov 08 23:47:39 user nova-compute[75045]:     </memballoon>
Nov 08 23:47:39 user nova-compute[75045]:   </devices>
Nov 08 23:47:39 user nova-compute[75045]: </domain>
Nov 08 23:47:39 user nova-compute[75045]:  {{(pid=75045) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 23:47:39 user nova-compute[75045]: DEBUG nova.virt.libvirt.vif [None req-89bdd3db-f0ed-4666-9d9f-1f3ba8d2d0d4 tempest-VolumesActionsTest-1069895698 tempest-VolumesActionsTest-1069895698-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T23:47:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1415690750',display_name='tempest-VolumesActionsTest-instance-1415690750',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1415690750',id=45,image_ref='a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='54a16cf0a668402585c1368907ad70c4',ramdisk_id='',reservation_id='r-8p6mxi24',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1069895698',owner_user_name='tempest-VolumesActionsTest-1069895698-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T23:47:38Z,user_data=None,user_id='1ebe1d42d4a548c59160031fa8bb3c58',uuid=abb7206c-b2e2-4a5a-93a8-f7f16231cf26,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e534dbaa-36f9-4cdf-86a1-78a17054ab8e", "address": "fa:16:3e:e9:e7:83", "network": {"id": "17bb03f5-be7a-40ac-a446-bf0162682d12", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1668425609-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54a16cf0a668402585c1368907ad70c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape534dbaa-36", "ovs_interfaceid": "e534dbaa-36f9-4cdf-86a1-78a17054ab8e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75045) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 23:47:39 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-89bdd3db-f0ed-4666-9d9f-1f3ba8d2d0d4 tempest-VolumesActionsTest-1069895698 tempest-VolumesActionsTest-1069895698-project-member] Converting VIF {"id": "e534dbaa-36f9-4cdf-86a1-78a17054ab8e", "address": "fa:16:3e:e9:e7:83", "network": {"id": "17bb03f5-be7a-40ac-a446-bf0162682d12", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1668425609-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54a16cf0a668402585c1368907ad70c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape534dbaa-36", "ovs_interfaceid": "e534dbaa-36f9-4cdf-86a1-78a17054ab8e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 23:47:39 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-89bdd3db-f0ed-4666-9d9f-1f3ba8d2d0d4 tempest-VolumesActionsTest-1069895698 tempest-VolumesActionsTest-1069895698-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e9:e7:83,bridge_name='br-int',has_traffic_filtering=True,id=e534dbaa-36f9-4cdf-86a1-78a17054ab8e,network=Network(17bb03f5-be7a-40ac-a446-bf0162682d12),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape534dbaa-36') {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 23:47:39 user nova-compute[75045]: DEBUG os_vif [None req-89bdd3db-f0ed-4666-9d9f-1f3ba8d2d0d4 tempest-VolumesActionsTest-1069895698 tempest-VolumesActionsTest-1069895698-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e9:e7:83,bridge_name='br-int',has_traffic_filtering=True,id=e534dbaa-36f9-4cdf-86a1-78a17054ab8e,network=Network(17bb03f5-be7a-40ac-a446-bf0162682d12),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape534dbaa-36') {{(pid=75045) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 23:47:39 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:47:39 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:47:39 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 23:47:39 user nova-compute[75045]: DEBUG nova.compute.manager [req-4a8f2400-a7ff-44da-814d-b1d22ad02ba7 req-b2a6ed21-c583-4bf8-9cf2-35a668c9bad3 service nova] [instance: abb7206c-b2e2-4a5a-93a8-f7f16231cf26] Received event network-changed-e534dbaa-36f9-4cdf-86a1-78a17054ab8e {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:47:39 user nova-compute[75045]: DEBUG nova.compute.manager [req-4a8f2400-a7ff-44da-814d-b1d22ad02ba7 req-b2a6ed21-c583-4bf8-9cf2-35a668c9bad3 service nova] [instance: abb7206c-b2e2-4a5a-93a8-f7f16231cf26] Refreshing instance network info cache due to event network-changed-e534dbaa-36f9-4cdf-86a1-78a17054ab8e. {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 23:47:39 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-4a8f2400-a7ff-44da-814d-b1d22ad02ba7 req-b2a6ed21-c583-4bf8-9cf2-35a668c9bad3 service nova] Acquiring lock "refresh_cache-abb7206c-b2e2-4a5a-93a8-f7f16231cf26" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 23:47:39 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-4a8f2400-a7ff-44da-814d-b1d22ad02ba7 req-b2a6ed21-c583-4bf8-9cf2-35a668c9bad3 service nova] Acquired lock "refresh_cache-abb7206c-b2e2-4a5a-93a8-f7f16231cf26" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 23:47:39 user nova-compute[75045]: DEBUG nova.network.neutron [req-4a8f2400-a7ff-44da-814d-b1d22ad02ba7 req-b2a6ed21-c583-4bf8-9cf2-35a668c9bad3 service nova] [instance: abb7206c-b2e2-4a5a-93a8-f7f16231cf26] Refreshing network info cache for port e534dbaa-36f9-4cdf-86a1-78a17054ab8e {{(pid=75045) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 23:47:39 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:47:39 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'fd0c5a68-37ee-5ae3-800d-3927eb9a8ebf', '_type': 'linux-noop'}}, row=False) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:47:39 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:47:39 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 23:47:39 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:47:39 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape534dbaa-36, may_exist=True, interface_attrs={}) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:47:39 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape534dbaa-36, col_values=(('qos', UUID('ee50d828-3f1f-40da-b7bc-d7dbbebdaebe')),), if_exists=True) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:47:39 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape534dbaa-36, col_values=(('external_ids', {'iface-id': 'e534dbaa-36f9-4cdf-86a1-78a17054ab8e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e9:e7:83', 'vm-uuid': 'abb7206c-b2e2-4a5a-93a8-f7f16231cf26'}),), if_exists=True) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:47:39 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:47:39 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 23:47:39 user nova-compute[75045]: INFO os_vif [None req-89bdd3db-f0ed-4666-9d9f-1f3ba8d2d0d4 tempest-VolumesActionsTest-1069895698 tempest-VolumesActionsTest-1069895698-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e9:e7:83,bridge_name='br-int',has_traffic_filtering=True,id=e534dbaa-36f9-4cdf-86a1-78a17054ab8e,network=Network(17bb03f5-be7a-40ac-a446-bf0162682d12),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape534dbaa-36')
Nov 08 23:47:39 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-89bdd3db-f0ed-4666-9d9f-1f3ba8d2d0d4 tempest-VolumesActionsTest-1069895698 tempest-VolumesActionsTest-1069895698-project-member] No BDM found with device name vda, not building metadata. {{(pid=75045) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 23:47:39 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-89bdd3db-f0ed-4666-9d9f-1f3ba8d2d0d4 tempest-VolumesActionsTest-1069895698 tempest-VolumesActionsTest-1069895698-project-member] No VIF found with MAC fa:16:3e:e9:e7:83, not building metadata {{(pid=75045) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 23:47:39 user nova-compute[75045]: DEBUG nova.network.neutron [req-4a8f2400-a7ff-44da-814d-b1d22ad02ba7 req-b2a6ed21-c583-4bf8-9cf2-35a668c9bad3 service nova] [instance: abb7206c-b2e2-4a5a-93a8-f7f16231cf26] Updated VIF entry in instance network info cache for port e534dbaa-36f9-4cdf-86a1-78a17054ab8e. {{(pid=75045) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 23:47:39 user nova-compute[75045]: DEBUG nova.network.neutron [req-4a8f2400-a7ff-44da-814d-b1d22ad02ba7 req-b2a6ed21-c583-4bf8-9cf2-35a668c9bad3 service nova] [instance: abb7206c-b2e2-4a5a-93a8-f7f16231cf26] Updating instance_info_cache with network_info: [{"id": "e534dbaa-36f9-4cdf-86a1-78a17054ab8e", "address": "fa:16:3e:e9:e7:83", "network": {"id": "17bb03f5-be7a-40ac-a446-bf0162682d12", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1668425609-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54a16cf0a668402585c1368907ad70c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape534dbaa-36", "ovs_interfaceid": "e534dbaa-36f9-4cdf-86a1-78a17054ab8e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75045) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 23:47:39 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-4a8f2400-a7ff-44da-814d-b1d22ad02ba7 req-b2a6ed21-c583-4bf8-9cf2-35a668c9bad3 service nova] Releasing lock "refresh_cache-abb7206c-b2e2-4a5a-93a8-f7f16231cf26" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 23:47:40 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:47:40 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:47:40 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:47:41 user nova-compute[75045]: DEBUG nova.compute.manager [req-5e5b46f3-080f-462a-a925-32386ed1d15f req-3c6b0d89-82ae-4f88-a7cc-32a0df82e40f service nova] [instance: abb7206c-b2e2-4a5a-93a8-f7f16231cf26] Received event network-vif-plugged-e534dbaa-36f9-4cdf-86a1-78a17054ab8e {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:47:41 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-5e5b46f3-080f-462a-a925-32386ed1d15f req-3c6b0d89-82ae-4f88-a7cc-32a0df82e40f service nova] Acquiring lock "abb7206c-b2e2-4a5a-93a8-f7f16231cf26-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:47:41 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-5e5b46f3-080f-462a-a925-32386ed1d15f req-3c6b0d89-82ae-4f88-a7cc-32a0df82e40f service nova] Lock "abb7206c-b2e2-4a5a-93a8-f7f16231cf26-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:47:41 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-5e5b46f3-080f-462a-a925-32386ed1d15f req-3c6b0d89-82ae-4f88-a7cc-32a0df82e40f service nova] Lock "abb7206c-b2e2-4a5a-93a8-f7f16231cf26-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:47:41 user nova-compute[75045]: DEBUG nova.compute.manager [req-5e5b46f3-080f-462a-a925-32386ed1d15f req-3c6b0d89-82ae-4f88-a7cc-32a0df82e40f service nova] [instance: abb7206c-b2e2-4a5a-93a8-f7f16231cf26] No waiting events found dispatching network-vif-plugged-e534dbaa-36f9-4cdf-86a1-78a17054ab8e {{(pid=75045) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 23:47:41 user nova-compute[75045]: WARNING nova.compute.manager [req-5e5b46f3-080f-462a-a925-32386ed1d15f req-3c6b0d89-82ae-4f88-a7cc-32a0df82e40f service nova] [instance: abb7206c-b2e2-4a5a-93a8-f7f16231cf26] Received unexpected event network-vif-plugged-e534dbaa-36f9-4cdf-86a1-78a17054ab8e for instance with vm_state building and task_state spawning.
Nov 08 23:47:41 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:47:41 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:47:41 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:47:41 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:47:43 user nova-compute[75045]: DEBUG nova.compute.manager [None req-89bdd3db-f0ed-4666-9d9f-1f3ba8d2d0d4 tempest-VolumesActionsTest-1069895698 tempest-VolumesActionsTest-1069895698-project-member] [instance: abb7206c-b2e2-4a5a-93a8-f7f16231cf26] Instance event wait completed in 0 seconds for  {{(pid=75045) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 23:47:43 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-89bdd3db-f0ed-4666-9d9f-1f3ba8d2d0d4 tempest-VolumesActionsTest-1069895698 tempest-VolumesActionsTest-1069895698-project-member] [instance: abb7206c-b2e2-4a5a-93a8-f7f16231cf26] Guest created on hypervisor {{(pid=75045) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 23:47:43 user nova-compute[75045]: INFO nova.virt.libvirt.driver [-] [instance: abb7206c-b2e2-4a5a-93a8-f7f16231cf26] Instance spawned successfully.
Nov 08 23:47:43 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-89bdd3db-f0ed-4666-9d9f-1f3ba8d2d0d4 tempest-VolumesActionsTest-1069895698 tempest-VolumesActionsTest-1069895698-project-member] [instance: abb7206c-b2e2-4a5a-93a8-f7f16231cf26] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75045) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 23:47:43 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-89bdd3db-f0ed-4666-9d9f-1f3ba8d2d0d4 tempest-VolumesActionsTest-1069895698 tempest-VolumesActionsTest-1069895698-project-member] [instance: abb7206c-b2e2-4a5a-93a8-f7f16231cf26] Found default for hw_cdrom_bus of ide {{(pid=75045) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 23:47:43 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-89bdd3db-f0ed-4666-9d9f-1f3ba8d2d0d4 tempest-VolumesActionsTest-1069895698 tempest-VolumesActionsTest-1069895698-project-member] [instance: abb7206c-b2e2-4a5a-93a8-f7f16231cf26] Found default for hw_disk_bus of virtio {{(pid=75045) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 23:47:43 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-89bdd3db-f0ed-4666-9d9f-1f3ba8d2d0d4 tempest-VolumesActionsTest-1069895698 tempest-VolumesActionsTest-1069895698-project-member] [instance: abb7206c-b2e2-4a5a-93a8-f7f16231cf26] Found default for hw_input_bus of None {{(pid=75045) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 23:47:43 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-89bdd3db-f0ed-4666-9d9f-1f3ba8d2d0d4 tempest-VolumesActionsTest-1069895698 tempest-VolumesActionsTest-1069895698-project-member] [instance: abb7206c-b2e2-4a5a-93a8-f7f16231cf26] Found default for hw_pointer_model of None {{(pid=75045) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 23:47:43 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-89bdd3db-f0ed-4666-9d9f-1f3ba8d2d0d4 tempest-VolumesActionsTest-1069895698 tempest-VolumesActionsTest-1069895698-project-member] [instance: abb7206c-b2e2-4a5a-93a8-f7f16231cf26] Found default for hw_video_model of virtio {{(pid=75045) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 23:47:43 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-89bdd3db-f0ed-4666-9d9f-1f3ba8d2d0d4 tempest-VolumesActionsTest-1069895698 tempest-VolumesActionsTest-1069895698-project-member] [instance: abb7206c-b2e2-4a5a-93a8-f7f16231cf26] Found default for hw_vif_model of virtio {{(pid=75045) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 23:47:43 user nova-compute[75045]: DEBUG nova.compute.manager [req-9c18de8d-8391-4771-896f-c43f47e19ce8 req-f015bbdb-dd32-4fe5-9390-e1cf00e7124c service nova] [instance: abb7206c-b2e2-4a5a-93a8-f7f16231cf26] Received event network-vif-plugged-e534dbaa-36f9-4cdf-86a1-78a17054ab8e {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:47:43 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-9c18de8d-8391-4771-896f-c43f47e19ce8 req-f015bbdb-dd32-4fe5-9390-e1cf00e7124c service nova] Acquiring lock "abb7206c-b2e2-4a5a-93a8-f7f16231cf26-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:47:43 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-9c18de8d-8391-4771-896f-c43f47e19ce8 req-f015bbdb-dd32-4fe5-9390-e1cf00e7124c service nova] Lock "abb7206c-b2e2-4a5a-93a8-f7f16231cf26-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:47:43 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-9c18de8d-8391-4771-896f-c43f47e19ce8 req-f015bbdb-dd32-4fe5-9390-e1cf00e7124c service nova] Lock "abb7206c-b2e2-4a5a-93a8-f7f16231cf26-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:47:43 user nova-compute[75045]: DEBUG nova.compute.manager [req-9c18de8d-8391-4771-896f-c43f47e19ce8 req-f015bbdb-dd32-4fe5-9390-e1cf00e7124c service nova] [instance: abb7206c-b2e2-4a5a-93a8-f7f16231cf26] No waiting events found dispatching network-vif-plugged-e534dbaa-36f9-4cdf-86a1-78a17054ab8e {{(pid=75045) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 23:47:43 user nova-compute[75045]: WARNING nova.compute.manager [req-9c18de8d-8391-4771-896f-c43f47e19ce8 req-f015bbdb-dd32-4fe5-9390-e1cf00e7124c service nova] [instance: abb7206c-b2e2-4a5a-93a8-f7f16231cf26] Received unexpected event network-vif-plugged-e534dbaa-36f9-4cdf-86a1-78a17054ab8e for instance with vm_state building and task_state spawning.
Nov 08 23:47:43 user nova-compute[75045]: INFO nova.compute.manager [None req-89bdd3db-f0ed-4666-9d9f-1f3ba8d2d0d4 tempest-VolumesActionsTest-1069895698 tempest-VolumesActionsTest-1069895698-project-member] [instance: abb7206c-b2e2-4a5a-93a8-f7f16231cf26] Took 5.53 seconds to spawn the instance on the hypervisor.
Nov 08 23:47:43 user nova-compute[75045]: DEBUG nova.compute.manager [None req-89bdd3db-f0ed-4666-9d9f-1f3ba8d2d0d4 tempest-VolumesActionsTest-1069895698 tempest-VolumesActionsTest-1069895698-project-member] [instance: abb7206c-b2e2-4a5a-93a8-f7f16231cf26] Checking state {{(pid=75045) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 23:47:43 user nova-compute[75045]: INFO nova.compute.manager [None req-89bdd3db-f0ed-4666-9d9f-1f3ba8d2d0d4 tempest-VolumesActionsTest-1069895698 tempest-VolumesActionsTest-1069895698-project-member] [instance: abb7206c-b2e2-4a5a-93a8-f7f16231cf26] Took 6.18 seconds to build instance.
Nov 08 23:47:43 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-89bdd3db-f0ed-4666-9d9f-1f3ba8d2d0d4 tempest-VolumesActionsTest-1069895698 tempest-VolumesActionsTest-1069895698-project-member] Lock "abb7206c-b2e2-4a5a-93a8-f7f16231cf26" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.294s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:47:44 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:47:46 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:47:49 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:47:51 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:47:51 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:47:52 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-424f97ca-87a4-4b54-9b56-8f276531dc42 tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Acquiring lock "0b413c71-c13a-4fea-91c4-f6b1953d54c6" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:47:52 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-424f97ca-87a4-4b54-9b56-8f276531dc42 tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Lock "0b413c71-c13a-4fea-91c4-f6b1953d54c6" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:47:52 user nova-compute[75045]: INFO nova.compute.manager [None req-424f97ca-87a4-4b54-9b56-8f276531dc42 tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] [instance: 0b413c71-c13a-4fea-91c4-f6b1953d54c6] Detaching volume adcca529-746a-4b7a-966a-82909ff5b108
Nov 08 23:47:52 user nova-compute[75045]: INFO nova.virt.block_device [None req-424f97ca-87a4-4b54-9b56-8f276531dc42 tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] [instance: 0b413c71-c13a-4fea-91c4-f6b1953d54c6] Attempting to driver detach volume adcca529-746a-4b7a-966a-82909ff5b108 from mountpoint /dev/vdb
Nov 08 23:47:52 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-424f97ca-87a4-4b54-9b56-8f276531dc42 tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Attempting to detach device vdb from instance 0b413c71-c13a-4fea-91c4-f6b1953d54c6 from the persistent domain config. {{(pid=75045) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 08 23:47:52 user nova-compute[75045]: DEBUG nova.virt.libvirt.guest [None req-424f97ca-87a4-4b54-9b56-8f276531dc42 tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 23:47:52 user nova-compute[75045]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 23:47:52 user nova-compute[75045]:   <source dev="/dev/sdb"/>
Nov 08 23:47:52 user nova-compute[75045]:   <target dev="vdb" bus="virtio"/>
Nov 08 23:47:52 user nova-compute[75045]:   <serial>adcca529-746a-4b7a-966a-82909ff5b108</serial>
Nov 08 23:47:52 user nova-compute[75045]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 08 23:47:52 user nova-compute[75045]: </disk>
Nov 08 23:47:52 user nova-compute[75045]:  {{(pid=75045) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 23:47:52 user nova-compute[75045]: INFO nova.virt.libvirt.driver [None req-424f97ca-87a4-4b54-9b56-8f276531dc42 tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Successfully detached device vdb from instance 0b413c71-c13a-4fea-91c4-f6b1953d54c6 from the persistent domain config.
Nov 08 23:47:52 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-424f97ca-87a4-4b54-9b56-8f276531dc42 tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 0b413c71-c13a-4fea-91c4-f6b1953d54c6 from the live domain config. {{(pid=75045) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 08 23:47:52 user nova-compute[75045]: DEBUG nova.virt.libvirt.guest [None req-424f97ca-87a4-4b54-9b56-8f276531dc42 tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 23:47:52 user nova-compute[75045]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 23:47:52 user nova-compute[75045]:   <source dev="/dev/sdb"/>
Nov 08 23:47:52 user nova-compute[75045]:   <target dev="vdb" bus="virtio"/>
Nov 08 23:47:52 user nova-compute[75045]:   <serial>adcca529-746a-4b7a-966a-82909ff5b108</serial>
Nov 08 23:47:52 user nova-compute[75045]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 08 23:47:52 user nova-compute[75045]: </disk>
Nov 08 23:47:52 user nova-compute[75045]:  {{(pid=75045) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 23:47:52 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-424f97ca-87a4-4b54-9b56-8f276531dc42 tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 0b413c71-c13a-4fea-91c4-f6b1953d54c6 {{(pid=75045) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 08 23:47:53 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:47:53 user nova-compute[75045]: DEBUG nova.compute.manager [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Starting heal instance info cache {{(pid=75045) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 23:47:53 user nova-compute[75045]: DEBUG nova.compute.manager [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Rebuilding the list of instances to heal {{(pid=75045) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 08 23:47:54 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Acquiring lock "refresh_cache-0b413c71-c13a-4fea-91c4-f6b1953d54c6" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 23:47:54 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Acquired lock "refresh_cache-0b413c71-c13a-4fea-91c4-f6b1953d54c6" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 23:47:54 user nova-compute[75045]: DEBUG nova.network.neutron [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] [instance: 0b413c71-c13a-4fea-91c4-f6b1953d54c6] Forcefully refreshing network info cache for instance {{(pid=75045) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 23:47:54 user nova-compute[75045]: DEBUG nova.objects.instance [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Lazy-loading 'info_cache' on Instance uuid 0b413c71-c13a-4fea-91c4-f6b1953d54c6 {{(pid=75045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 23:47:54 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:47:54 user nova-compute[75045]: DEBUG nova.network.neutron [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] [instance: 0b413c71-c13a-4fea-91c4-f6b1953d54c6] Updating instance_info_cache with network_info: [{"id": "166cceb4-9b95-4bdd-a3ad-b6aad94dfed0", "address": "fa:16:3e:17:84:3d", "network": {"id": "e31c3d41-e46f-4c74-8ef5-8243a391dde8", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-856540424-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.149", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c8be85d72bc440899f3ccb64b923e90e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap166cceb4-9b", "ovs_interfaceid": "166cceb4-9b95-4bdd-a3ad-b6aad94dfed0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75045) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 23:47:54 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Releasing lock "refresh_cache-0b413c71-c13a-4fea-91c4-f6b1953d54c6" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 23:47:54 user nova-compute[75045]: DEBUG nova.compute.manager [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] [instance: 0b413c71-c13a-4fea-91c4-f6b1953d54c6] Updated the network info_cache for instance {{(pid=75045) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 23:47:55 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:47:55 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:47:55 user nova-compute[75045]: DEBUG nova.compute.manager [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75045) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 23:47:56 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:47:56 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:47:57 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:47:59 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:47:59 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:47:59 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:48:00 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:48:00 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:48:01 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:48:01 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:48:03 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:48:04 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:48:04 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager.update_available_resource {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:48:05 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:48:05 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:48:05 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:48:05 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Auditing locally available compute resources for user (node: user) {{(pid=75045) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 23:48:05 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75045) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 23:48:05 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abb7206c-b2e2-4a5a-93a8-f7f16231cf26/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:48:05 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abb7206c-b2e2-4a5a-93a8-f7f16231cf26/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:48:05 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abb7206c-b2e2-4a5a-93a8-f7f16231cf26/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:48:05 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abb7206c-b2e2-4a5a-93a8-f7f16231cf26/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:48:05 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75045) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 23:48:05 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b413c71-c13a-4fea-91c4-f6b1953d54c6/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:48:05 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b413c71-c13a-4fea-91c4-f6b1953d54c6/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:48:05 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b413c71-c13a-4fea-91c4-f6b1953d54c6/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:48:05 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:48:05 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b413c71-c13a-4fea-91c4-f6b1953d54c6/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:48:06 user nova-compute[75045]: WARNING nova.virt.libvirt.driver [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 23:48:06 user nova-compute[75045]: WARNING nova.virt.libvirt.driver [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 23:48:06 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Hypervisor/Node resource view: name=user free_ram=8355MB free_disk=25.02713394165039GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75045) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 23:48:06 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:48:06 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:48:06 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Instance 0b413c71-c13a-4fea-91c4-f6b1953d54c6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75045) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 23:48:06 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Instance 37502077-b02b-4f0c-b654-8a6cef607efa actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75045) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 23:48:06 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Instance 0fb331fa-231e-482e-abfc-df39b13fb33a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75045) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 23:48:06 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Instance abb7206c-b2e2-4a5a-93a8-f7f16231cf26 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75045) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 23:48:06 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=75045) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 23:48:06 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=75045) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 23:48:06 user nova-compute[75045]: DEBUG nova.compute.provider_tree [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Inventory has not changed in ProviderTree for provider: 62ba5f85-c74d-4b58-986e-d4197e813fd7 {{(pid=75045) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 23:48:06 user nova-compute[75045]: DEBUG nova.scheduler.client.report [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Inventory has not changed for provider 62ba5f85-c74d-4b58-986e-d4197e813fd7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75045) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 23:48:06 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Compute_service record updated for user:user {{(pid=75045) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 23:48:06 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.301s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:48:06 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:48:09 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:48:09 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-5ab8d5a6-8766-43de-ac8c-7de1336324d3 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] Acquiring lock "c7b3eac2-a51b-40e7-a199-66aee8d2da09" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:48:09 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-5ab8d5a6-8766-43de-ac8c-7de1336324d3 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] Lock "c7b3eac2-a51b-40e7-a199-66aee8d2da09" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:48:09 user nova-compute[75045]: DEBUG nova.compute.manager [None req-5ab8d5a6-8766-43de-ac8c-7de1336324d3 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] [instance: c7b3eac2-a51b-40e7-a199-66aee8d2da09] Starting instance... {{(pid=75045) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 23:48:09 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-5ab8d5a6-8766-43de-ac8c-7de1336324d3 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:48:09 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-5ab8d5a6-8766-43de-ac8c-7de1336324d3 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:48:09 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-5ab8d5a6-8766-43de-ac8c-7de1336324d3 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75045) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 23:48:09 user nova-compute[75045]: INFO nova.compute.claims [None req-5ab8d5a6-8766-43de-ac8c-7de1336324d3 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] [instance: c7b3eac2-a51b-40e7-a199-66aee8d2da09] Claim successful on node user
Nov 08 23:48:09 user nova-compute[75045]: DEBUG nova.compute.provider_tree [None req-5ab8d5a6-8766-43de-ac8c-7de1336324d3 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] Inventory has not changed in ProviderTree for provider: 62ba5f85-c74d-4b58-986e-d4197e813fd7 {{(pid=75045) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 23:48:09 user nova-compute[75045]: DEBUG nova.scheduler.client.report [None req-5ab8d5a6-8766-43de-ac8c-7de1336324d3 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] Inventory has not changed for provider 62ba5f85-c74d-4b58-986e-d4197e813fd7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75045) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 23:48:09 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-5ab8d5a6-8766-43de-ac8c-7de1336324d3 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.290s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:48:09 user nova-compute[75045]: DEBUG nova.compute.manager [None req-5ab8d5a6-8766-43de-ac8c-7de1336324d3 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] [instance: c7b3eac2-a51b-40e7-a199-66aee8d2da09] Start building networks asynchronously for instance. {{(pid=75045) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 23:48:10 user nova-compute[75045]: DEBUG nova.compute.manager [None req-5ab8d5a6-8766-43de-ac8c-7de1336324d3 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] [instance: c7b3eac2-a51b-40e7-a199-66aee8d2da09] Allocating IP information in the background. {{(pid=75045) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 23:48:10 user nova-compute[75045]: DEBUG nova.network.neutron [None req-5ab8d5a6-8766-43de-ac8c-7de1336324d3 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] [instance: c7b3eac2-a51b-40e7-a199-66aee8d2da09] allocate_for_instance() {{(pid=75045) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 23:48:10 user nova-compute[75045]: DEBUG nova.policy [None req-5ab8d5a6-8766-43de-ac8c-7de1336324d3 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4ed9cd91d0654f4aa4d620c9f0eb2766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4bfce59008d44fdb5ba91c70f1cf044', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75045) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 23:48:10 user nova-compute[75045]: INFO nova.virt.libvirt.driver [None req-5ab8d5a6-8766-43de-ac8c-7de1336324d3 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] [instance: c7b3eac2-a51b-40e7-a199-66aee8d2da09] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 23:48:10 user nova-compute[75045]: DEBUG nova.compute.manager [None req-5ab8d5a6-8766-43de-ac8c-7de1336324d3 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] [instance: c7b3eac2-a51b-40e7-a199-66aee8d2da09] Start building block device mappings for instance. {{(pid=75045) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 23:48:10 user nova-compute[75045]: DEBUG nova.compute.manager [None req-5ab8d5a6-8766-43de-ac8c-7de1336324d3 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] [instance: c7b3eac2-a51b-40e7-a199-66aee8d2da09] Start spawning the instance on the hypervisor. {{(pid=75045) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 23:48:10 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-5ab8d5a6-8766-43de-ac8c-7de1336324d3 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] [instance: c7b3eac2-a51b-40e7-a199-66aee8d2da09] Creating instance directory {{(pid=75045) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 23:48:10 user nova-compute[75045]: INFO nova.virt.libvirt.driver [None req-5ab8d5a6-8766-43de-ac8c-7de1336324d3 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] [instance: c7b3eac2-a51b-40e7-a199-66aee8d2da09] Creating image(s)
Nov 08 23:48:10 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-5ab8d5a6-8766-43de-ac8c-7de1336324d3 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] Acquiring lock "/opt/stack/data/nova/instances/c7b3eac2-a51b-40e7-a199-66aee8d2da09/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:48:10 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-5ab8d5a6-8766-43de-ac8c-7de1336324d3 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] Lock "/opt/stack/data/nova/instances/c7b3eac2-a51b-40e7-a199-66aee8d2da09/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:48:10 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-5ab8d5a6-8766-43de-ac8c-7de1336324d3 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] Lock "/opt/stack/data/nova/instances/c7b3eac2-a51b-40e7-a199-66aee8d2da09/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:48:10 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-5ab8d5a6-8766-43de-ac8c-7de1336324d3 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] Acquiring lock "2bbd956825794d94fd2176fa0e6b84d8b10a2324" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:48:10 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-5ab8d5a6-8766-43de-ac8c-7de1336324d3 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] Lock "2bbd956825794d94fd2176fa0e6b84d8b10a2324" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:48:10 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-5ab8d5a6-8766-43de-ac8c-7de1336324d3 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2bbd956825794d94fd2176fa0e6b84d8b10a2324.part --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:48:11 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:48:11 user nova-compute[75045]: DEBUG nova.network.neutron [None req-5ab8d5a6-8766-43de-ac8c-7de1336324d3 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] [instance: c7b3eac2-a51b-40e7-a199-66aee8d2da09] Successfully created port: ee3648b5-a27a-401d-8708-e25f28d987da {{(pid=75045) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 23:48:11 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-5ab8d5a6-8766-43de-ac8c-7de1336324d3 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2bbd956825794d94fd2176fa0e6b84d8b10a2324.part --force-share --output=json" returned: 0 in 0.193s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:48:11 user nova-compute[75045]: DEBUG nova.virt.images [None req-5ab8d5a6-8766-43de-ac8c-7de1336324d3 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] f5ffbc98-11a7-4f8a-a6c2-51981767a401 was qcow2, converting to raw {{(pid=75045) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 08 23:48:11 user nova-compute[75045]: DEBUG nova.privsep.utils [None req-5ab8d5a6-8766-43de-ac8c-7de1336324d3 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75045) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 08 23:48:11 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-5ab8d5a6-8766-43de-ac8c-7de1336324d3 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/2bbd956825794d94fd2176fa0e6b84d8b10a2324.part /opt/stack/data/nova/instances/_base/2bbd956825794d94fd2176fa0e6b84d8b10a2324.converted {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:48:11 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-5ab8d5a6-8766-43de-ac8c-7de1336324d3 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/2bbd956825794d94fd2176fa0e6b84d8b10a2324.part /opt/stack/data/nova/instances/_base/2bbd956825794d94fd2176fa0e6b84d8b10a2324.converted" returned: 0 in 0.324s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:48:11 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-5ab8d5a6-8766-43de-ac8c-7de1336324d3 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2bbd956825794d94fd2176fa0e6b84d8b10a2324.converted --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:48:11 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-5ab8d5a6-8766-43de-ac8c-7de1336324d3 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2bbd956825794d94fd2176fa0e6b84d8b10a2324.converted --force-share --output=json" returned: 0 in 0.172s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:48:11 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-5ab8d5a6-8766-43de-ac8c-7de1336324d3 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] Lock "2bbd956825794d94fd2176fa0e6b84d8b10a2324" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.275s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:48:11 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-5ab8d5a6-8766-43de-ac8c-7de1336324d3 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2bbd956825794d94fd2176fa0e6b84d8b10a2324 --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:48:11 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-5ab8d5a6-8766-43de-ac8c-7de1336324d3 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2bbd956825794d94fd2176fa0e6b84d8b10a2324 --force-share --output=json" returned: 0 in 0.170s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:48:11 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-5ab8d5a6-8766-43de-ac8c-7de1336324d3 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] Acquiring lock "2bbd956825794d94fd2176fa0e6b84d8b10a2324" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:48:11 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-5ab8d5a6-8766-43de-ac8c-7de1336324d3 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] Lock "2bbd956825794d94fd2176fa0e6b84d8b10a2324" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:48:11 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-5ab8d5a6-8766-43de-ac8c-7de1336324d3 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2bbd956825794d94fd2176fa0e6b84d8b10a2324 --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:48:11 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:48:12 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-5ab8d5a6-8766-43de-ac8c-7de1336324d3 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2bbd956825794d94fd2176fa0e6b84d8b10a2324 --force-share --output=json" returned: 0 in 0.247s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:48:12 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-5ab8d5a6-8766-43de-ac8c-7de1336324d3 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2bbd956825794d94fd2176fa0e6b84d8b10a2324,backing_fmt=raw /opt/stack/data/nova/instances/c7b3eac2-a51b-40e7-a199-66aee8d2da09/disk 1073741824 {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:48:12 user nova-compute[75045]: DEBUG nova.network.neutron [None req-5ab8d5a6-8766-43de-ac8c-7de1336324d3 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] [instance: c7b3eac2-a51b-40e7-a199-66aee8d2da09] Successfully updated port: ee3648b5-a27a-401d-8708-e25f28d987da {{(pid=75045) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 23:48:12 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-5ab8d5a6-8766-43de-ac8c-7de1336324d3 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2bbd956825794d94fd2176fa0e6b84d8b10a2324,backing_fmt=raw /opt/stack/data/nova/instances/c7b3eac2-a51b-40e7-a199-66aee8d2da09/disk 1073741824" returned: 0 in 0.054s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:48:12 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-5ab8d5a6-8766-43de-ac8c-7de1336324d3 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] Lock "2bbd956825794d94fd2176fa0e6b84d8b10a2324" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.305s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:48:12 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-5ab8d5a6-8766-43de-ac8c-7de1336324d3 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2bbd956825794d94fd2176fa0e6b84d8b10a2324 --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:48:12 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-5ab8d5a6-8766-43de-ac8c-7de1336324d3 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] Acquiring lock "refresh_cache-c7b3eac2-a51b-40e7-a199-66aee8d2da09" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 23:48:12 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-5ab8d5a6-8766-43de-ac8c-7de1336324d3 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] Acquired lock "refresh_cache-c7b3eac2-a51b-40e7-a199-66aee8d2da09" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 23:48:12 user nova-compute[75045]: DEBUG nova.network.neutron [None req-5ab8d5a6-8766-43de-ac8c-7de1336324d3 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] [instance: c7b3eac2-a51b-40e7-a199-66aee8d2da09] Building network info cache for instance {{(pid=75045) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 23:48:12 user nova-compute[75045]: DEBUG nova.compute.manager [req-5eb7efe8-635e-44e3-9b16-d80357639246 req-50da2016-f2f3-409a-bdfd-befdfb9cf2aa service nova] [instance: c7b3eac2-a51b-40e7-a199-66aee8d2da09] Received event network-changed-ee3648b5-a27a-401d-8708-e25f28d987da {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:48:12 user nova-compute[75045]: DEBUG nova.compute.manager [req-5eb7efe8-635e-44e3-9b16-d80357639246 req-50da2016-f2f3-409a-bdfd-befdfb9cf2aa service nova] [instance: c7b3eac2-a51b-40e7-a199-66aee8d2da09] Refreshing instance network info cache due to event network-changed-ee3648b5-a27a-401d-8708-e25f28d987da. {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 23:48:12 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-5eb7efe8-635e-44e3-9b16-d80357639246 req-50da2016-f2f3-409a-bdfd-befdfb9cf2aa service nova] Acquiring lock "refresh_cache-c7b3eac2-a51b-40e7-a199-66aee8d2da09" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 23:48:12 user nova-compute[75045]: DEBUG nova.network.neutron [None req-5ab8d5a6-8766-43de-ac8c-7de1336324d3 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] [instance: c7b3eac2-a51b-40e7-a199-66aee8d2da09] Instance cache missing network info. {{(pid=75045) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 23:48:12 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-5ab8d5a6-8766-43de-ac8c-7de1336324d3 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2bbd956825794d94fd2176fa0e6b84d8b10a2324 --force-share --output=json" returned: 0 in 0.182s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:48:12 user nova-compute[75045]: DEBUG nova.virt.disk.api [None req-5ab8d5a6-8766-43de-ac8c-7de1336324d3 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c7b3eac2-a51b-40e7-a199-66aee8d2da09/disk. size=1073741824 {{(pid=75045) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 23:48:12 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-5ab8d5a6-8766-43de-ac8c-7de1336324d3 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7b3eac2-a51b-40e7-a199-66aee8d2da09/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:48:12 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-5ab8d5a6-8766-43de-ac8c-7de1336324d3 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7b3eac2-a51b-40e7-a199-66aee8d2da09/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:48:12 user nova-compute[75045]: DEBUG nova.virt.disk.api [None req-5ab8d5a6-8766-43de-ac8c-7de1336324d3 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] Cannot resize image /opt/stack/data/nova/instances/c7b3eac2-a51b-40e7-a199-66aee8d2da09/disk to a smaller size. {{(pid=75045) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 08 23:48:12 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-5ab8d5a6-8766-43de-ac8c-7de1336324d3 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] [instance: c7b3eac2-a51b-40e7-a199-66aee8d2da09] Created local disks {{(pid=75045) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 23:48:12 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-5ab8d5a6-8766-43de-ac8c-7de1336324d3 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] [instance: c7b3eac2-a51b-40e7-a199-66aee8d2da09] Ensure instance console log exists: /opt/stack/data/nova/instances/c7b3eac2-a51b-40e7-a199-66aee8d2da09/console.log {{(pid=75045) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 23:48:12 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-5ab8d5a6-8766-43de-ac8c-7de1336324d3 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:48:12 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-5ab8d5a6-8766-43de-ac8c-7de1336324d3 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:48:12 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-5ab8d5a6-8766-43de-ac8c-7de1336324d3 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:48:12 user nova-compute[75045]: DEBUG nova.network.neutron [None req-5ab8d5a6-8766-43de-ac8c-7de1336324d3 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] [instance: c7b3eac2-a51b-40e7-a199-66aee8d2da09] Updating instance_info_cache with network_info: [{"id": "ee3648b5-a27a-401d-8708-e25f28d987da", "address": "fa:16:3e:37:0b:9c", "network": {"id": "fe5f7093-1cdd-465c-97f0-7d7b2dd1fa8a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1755065955-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4bfce59008d44fdb5ba91c70f1cf044", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee3648b5-a2", "ovs_interfaceid": "ee3648b5-a27a-401d-8708-e25f28d987da", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75045) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 23:48:12 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-5ab8d5a6-8766-43de-ac8c-7de1336324d3 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] Releasing lock "refresh_cache-c7b3eac2-a51b-40e7-a199-66aee8d2da09" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 23:48:12 user nova-compute[75045]: DEBUG nova.compute.manager [None req-5ab8d5a6-8766-43de-ac8c-7de1336324d3 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] [instance: c7b3eac2-a51b-40e7-a199-66aee8d2da09] Instance network_info: |[{"id": "ee3648b5-a27a-401d-8708-e25f28d987da", "address": "fa:16:3e:37:0b:9c", "network": {"id": "fe5f7093-1cdd-465c-97f0-7d7b2dd1fa8a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1755065955-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4bfce59008d44fdb5ba91c70f1cf044", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee3648b5-a2", "ovs_interfaceid": "ee3648b5-a27a-401d-8708-e25f28d987da", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75045) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 23:48:12 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-5eb7efe8-635e-44e3-9b16-d80357639246 req-50da2016-f2f3-409a-bdfd-befdfb9cf2aa service nova] Acquired lock "refresh_cache-c7b3eac2-a51b-40e7-a199-66aee8d2da09" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 23:48:12 user nova-compute[75045]: DEBUG nova.network.neutron [req-5eb7efe8-635e-44e3-9b16-d80357639246 req-50da2016-f2f3-409a-bdfd-befdfb9cf2aa service nova] [instance: c7b3eac2-a51b-40e7-a199-66aee8d2da09] Refreshing network info cache for port ee3648b5-a27a-401d-8708-e25f28d987da {{(pid=75045) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 23:48:12 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-5ab8d5a6-8766-43de-ac8c-7de1336324d3 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] [instance: c7b3eac2-a51b-40e7-a199-66aee8d2da09] Start _get_guest_xml network_info=[{"id": "ee3648b5-a27a-401d-8708-e25f28d987da", "address": "fa:16:3e:37:0b:9c", "network": {"id": "fe5f7093-1cdd-465c-97f0-7d7b2dd1fa8a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1755065955-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4bfce59008d44fdb5ba91c70f1cf044", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee3648b5-a2", "ovs_interfaceid": "ee3648b5-a27a-401d-8708-e25f28d987da", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T23:48:07Z,direct_url=<?>,disk_format='qcow2',id=f5ffbc98-11a7-4f8a-a6c2-51981767a401,min_disk=0,min_ram=0,name='tempest-scenario-img--753073091',owner='c4bfce59008d44fdb5ba91c70f1cf044',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T23:48:08Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'disk_bus': 'virtio', 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': 'f5ffbc98-11a7-4f8a-a6c2-51981767a401'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75045) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 23:48:12 user nova-compute[75045]: WARNING nova.virt.libvirt.driver [None req-424f97ca-87a4-4b54-9b56-8f276531dc42 tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 0b413c71-c13a-4fea-91c4-f6b1953d54c6 is timed out.
Nov 08 23:48:12 user nova-compute[75045]: WARNING nova.virt.libvirt.driver [None req-5ab8d5a6-8766-43de-ac8c-7de1336324d3 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 23:48:12 user nova-compute[75045]: WARNING nova.virt.libvirt.driver [None req-5ab8d5a6-8766-43de-ac8c-7de1336324d3 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 23:48:12 user nova-compute[75045]: INFO nova.virt.libvirt.driver [None req-424f97ca-87a4-4b54-9b56-8f276531dc42 tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Successfully detached device vdb from instance 0b413c71-c13a-4fea-91c4-f6b1953d54c6 from the live domain config.
Nov 08 23:48:12 user nova-compute[75045]: DEBUG nova.virt.libvirt.host [None req-5ab8d5a6-8766-43de-ac8c-7de1336324d3 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75045) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 23:48:12 user nova-compute[75045]: DEBUG nova.virt.libvirt.host [None req-5ab8d5a6-8766-43de-ac8c-7de1336324d3 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] CPU controller missing on host. {{(pid=75045) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 23:48:12 user nova-compute[75045]: DEBUG nova.virt.libvirt.volume.iscsi [None req-424f97ca-87a4-4b54-9b56-8f276531dc42 tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] [instance: 0b413c71-c13a-4fea-91c4-f6b1953d54c6] calling os-brick to detach iSCSI Volume {{(pid=75045) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 23:48:12 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-424f97ca-87a4-4b54-9b56-8f276531dc42 tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1b68210460>, {'target_iqn': 'iqn.2010-10.org.openstack:adcca529-746a-4b7a-966a-82909ff5b108', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'abIqSyev', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75045) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 23:48:12 user nova-compute[75045]: WARNING os_brick.initiator.connectors.base [None req-424f97ca-87a4-4b54-9b56-8f276531dc42 tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 23:48:12 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-424f97ca-87a4-4b54-9b56-8f276531dc42 tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 23:48:12 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-424f97ca-87a4-4b54-9b56-8f276531dc42 tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 23:48:12 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:48:12 user nova-compute[75045]: DEBUG nova.virt.libvirt.host [None req-5ab8d5a6-8766-43de-ac8c-7de1336324d3 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75045) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 23:48:12 user nova-compute[75045]: DEBUG nova.virt.libvirt.host [None req-5ab8d5a6-8766-43de-ac8c-7de1336324d3 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] CPU controller found on host. {{(pid=75045) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 23:48:12 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-5ab8d5a6-8766-43de-ac8c-7de1336324d3 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75045) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 23:48:12 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-5ab8d5a6-8766-43de-ac8c-7de1336324d3 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T23:11:41Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T23:48:07Z,direct_url=<?>,disk_format='qcow2',id=f5ffbc98-11a7-4f8a-a6c2-51981767a401,min_disk=0,min_ram=0,name='tempest-scenario-img--753073091',owner='c4bfce59008d44fdb5ba91c70f1cf044',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T23:48:08Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75045) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 23:48:12 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-5ab8d5a6-8766-43de-ac8c-7de1336324d3 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] Flavor limits 0:0:0 {{(pid=75045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 23:48:12 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-5ab8d5a6-8766-43de-ac8c-7de1336324d3 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] Image limits 0:0:0 {{(pid=75045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 23:48:12 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-5ab8d5a6-8766-43de-ac8c-7de1336324d3 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] Flavor pref 0:0:0 {{(pid=75045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 23:48:12 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-5ab8d5a6-8766-43de-ac8c-7de1336324d3 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] Image pref 0:0:0 {{(pid=75045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 23:48:12 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-5ab8d5a6-8766-43de-ac8c-7de1336324d3 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 23:48:12 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-5ab8d5a6-8766-43de-ac8c-7de1336324d3 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75045) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 23:48:12 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-5ab8d5a6-8766-43de-ac8c-7de1336324d3 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75045) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 23:48:12 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-5ab8d5a6-8766-43de-ac8c-7de1336324d3 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] Got 1 possible topologies {{(pid=75045) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 23:48:12 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-5ab8d5a6-8766-43de-ac8c-7de1336324d3 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75045) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 23:48:12 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-5ab8d5a6-8766-43de-ac8c-7de1336324d3 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75045) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 23:48:12 user nova-compute[75045]: DEBUG nova.virt.libvirt.vif [None req-5ab8d5a6-8766-43de-ac8c-7de1336324d3 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T23:48:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1921157809',display_name='tempest-TestMinimumBasicScenario-server-1921157809',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1921157809',id=46,image_ref='f5ffbc98-11a7-4f8a-a6c2-51981767a401',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHecd69gYgaSALnbnoSk8qN0iobdxEqArnmuB2X8R1yl+8miN9+r40m6x9O1njTg8e0tQbpEe+KRfZaDGySkJLV+Zispu3OSLEK+XK2OAmFWBfz0y5wJsz4CCuk3AqcQeQ==',key_name='tempest-TestMinimumBasicScenario-2120728013',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c4bfce59008d44fdb5ba91c70f1cf044',ramdisk_id='',reservation_id='r-3g7sio6l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f5ffbc98-11a7-4f8a-a6c2-51981767a401',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1125576376',owner_user_name='tempest-TestMinimumBasicScenario-1125576376-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T23:48:10Z,user_data=None,user_id='4ed9cd91d0654f4aa4d620c9f0eb2766',uuid=c7b3eac2-a51b-40e7-a199-66aee8d2da09,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ee3648b5-a27a-401d-8708-e25f28d987da", "address": "fa:16:3e:37:0b:9c", "network": {"id": "fe5f7093-1cdd-465c-97f0-7d7b2dd1fa8a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1755065955-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4bfce59008d44fdb5ba91c70f1cf044", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee3648b5-a2", "ovs_interfaceid": "ee3648b5-a27a-401d-8708-e25f28d987da", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75045) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 23:48:12 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-5ab8d5a6-8766-43de-ac8c-7de1336324d3 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] Converting VIF {"id": "ee3648b5-a27a-401d-8708-e25f28d987da", "address": "fa:16:3e:37:0b:9c", "network": {"id": "fe5f7093-1cdd-465c-97f0-7d7b2dd1fa8a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1755065955-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4bfce59008d44fdb5ba91c70f1cf044", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee3648b5-a2", "ovs_interfaceid": "ee3648b5-a27a-401d-8708-e25f28d987da", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 23:48:12 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-5ab8d5a6-8766-43de-ac8c-7de1336324d3 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:37:0b:9c,bridge_name='br-int',has_traffic_filtering=True,id=ee3648b5-a27a-401d-8708-e25f28d987da,network=Network(fe5f7093-1cdd-465c-97f0-7d7b2dd1fa8a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee3648b5-a2') {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 23:48:12 user nova-compute[75045]: DEBUG nova.objects.instance [None req-5ab8d5a6-8766-43de-ac8c-7de1336324d3 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] Lazy-loading 'pci_devices' on Instance uuid c7b3eac2-a51b-40e7-a199-66aee8d2da09 {{(pid=75045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 23:48:12 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:48:12 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3f256f8-11a6-474c-97b7-d10536779f71]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:adcca529-746a-4b7a-966a-82909ff5b108\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:22e58281-41b7-4be2-ace8-0750aa5d18f8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fc158ccb-5948-41c4-be6c-38c3539a467e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:48:12 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-424f97ca-87a4-4b54-9b56-8f276531dc42 tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 23:48:12 user nova-compute[75045]: No targets found.
Nov 08 23:48:12 user nova-compute[75045]: iSNS:
Nov 08 23:48:12 user nova-compute[75045]: No targets found.
Nov 08 23:48:12 user nova-compute[75045]: STATIC:
Nov 08 23:48:12 user nova-compute[75045]: Target: iqn.2010-10.org.openstack:adcca529-746a-4b7a-966a-82909ff5b108
Nov 08 23:48:12 user nova-compute[75045]:         Portal: 172.16.0.220:3260,-1
Nov 08 23:48:12 user nova-compute[75045]:                 Iface Name: default
Nov 08 23:48:12 user nova-compute[75045]: Target: iqn.2010-10.org.openstack:22e58281-41b7-4be2-ace8-0750aa5d18f8
Nov 08 23:48:12 user nova-compute[75045]:         Portal: 172.16.0.220:3260,-1
Nov 08 23:48:12 user nova-compute[75045]:                 Iface Name: default
Nov 08 23:48:12 user nova-compute[75045]: Target: iqn.2010-10.org.openstack:fc158ccb-5948-41c4-be6c-38c3539a467e
Nov 08 23:48:12 user nova-compute[75045]:         Portal: 172.16.0.220:3260,-1
Nov 08 23:48:12 user nova-compute[75045]:                 Iface Name: default
Nov 08 23:48:12 user nova-compute[75045]: FIRMWARE:
Nov 08 23:48:12 user nova-compute[75045]: No targets found.
Nov 08 23:48:12 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 23:48:12 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-424f97ca-87a4-4b54-9b56-8f276531dc42 tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 23:48:12 user nova-compute[75045]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 23:48:12 user nova-compute[75045]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75045) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 23:48:12 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-424f97ca-87a4-4b54-9b56-8f276531dc42 tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:adcca529-746a-4b7a-966a-82909ff5b108', 0)] {{(pid=75045) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 23:48:12 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:48:12 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-5ab8d5a6-8766-43de-ac8c-7de1336324d3 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] [instance: c7b3eac2-a51b-40e7-a199-66aee8d2da09] End _get_guest_xml xml=<domain type="kvm">
Nov 08 23:48:12 user nova-compute[75045]:   <uuid>c7b3eac2-a51b-40e7-a199-66aee8d2da09</uuid>
Nov 08 23:48:12 user nova-compute[75045]:   <name>instance-0000002e</name>
Nov 08 23:48:12 user nova-compute[75045]:   <memory>524288</memory>
Nov 08 23:48:12 user nova-compute[75045]:   <vcpu>1</vcpu>
Nov 08 23:48:12 user nova-compute[75045]:   <metadata>
Nov 08 23:48:12 user nova-compute[75045]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 23:48:12 user nova-compute[75045]:       <nova:package version="0.0.0"/>
Nov 08 23:48:12 user nova-compute[75045]:       <nova:name>tempest-TestMinimumBasicScenario-server-1921157809</nova:name>
Nov 08 23:48:12 user nova-compute[75045]:       <nova:creationTime>2023-11-08 23:48:12</nova:creationTime>
Nov 08 23:48:12 user nova-compute[75045]:       <nova:flavor name="m1.tiny">
Nov 08 23:48:12 user nova-compute[75045]:         <nova:memory>512</nova:memory>
Nov 08 23:48:12 user nova-compute[75045]:         <nova:disk>1</nova:disk>
Nov 08 23:48:12 user nova-compute[75045]:         <nova:swap>0</nova:swap>
Nov 08 23:48:12 user nova-compute[75045]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 23:48:12 user nova-compute[75045]:         <nova:vcpus>1</nova:vcpus>
Nov 08 23:48:12 user nova-compute[75045]:       </nova:flavor>
Nov 08 23:48:12 user nova-compute[75045]:       <nova:owner>
Nov 08 23:48:12 user nova-compute[75045]:         <nova:user uuid="4ed9cd91d0654f4aa4d620c9f0eb2766">tempest-TestMinimumBasicScenario-1125576376-project-member</nova:user>
Nov 08 23:48:12 user nova-compute[75045]:         <nova:project uuid="c4bfce59008d44fdb5ba91c70f1cf044">tempest-TestMinimumBasicScenario-1125576376</nova:project>
Nov 08 23:48:12 user nova-compute[75045]:       </nova:owner>
Nov 08 23:48:12 user nova-compute[75045]:       <nova:root type="image" uuid="f5ffbc98-11a7-4f8a-a6c2-51981767a401"/>
Nov 08 23:48:12 user nova-compute[75045]:       <nova:ports>
Nov 08 23:48:12 user nova-compute[75045]:         <nova:port uuid="ee3648b5-a27a-401d-8708-e25f28d987da">
Nov 08 23:48:12 user nova-compute[75045]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 08 23:48:12 user nova-compute[75045]:         </nova:port>
Nov 08 23:48:12 user nova-compute[75045]:       </nova:ports>
Nov 08 23:48:12 user nova-compute[75045]:     </nova:instance>
Nov 08 23:48:12 user nova-compute[75045]:   </metadata>
Nov 08 23:48:12 user nova-compute[75045]:   <sysinfo type="smbios">
Nov 08 23:48:12 user nova-compute[75045]:     <system>
Nov 08 23:48:12 user nova-compute[75045]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 23:48:12 user nova-compute[75045]:       <entry name="product">OpenStack Nova</entry>
Nov 08 23:48:12 user nova-compute[75045]:       <entry name="version">0.0.0</entry>
Nov 08 23:48:12 user nova-compute[75045]:       <entry name="serial">c7b3eac2-a51b-40e7-a199-66aee8d2da09</entry>
Nov 08 23:48:12 user nova-compute[75045]:       <entry name="uuid">c7b3eac2-a51b-40e7-a199-66aee8d2da09</entry>
Nov 08 23:48:12 user nova-compute[75045]:       <entry name="family">Virtual Machine</entry>
Nov 08 23:48:12 user nova-compute[75045]:     </system>
Nov 08 23:48:12 user nova-compute[75045]:   </sysinfo>
Nov 08 23:48:12 user nova-compute[75045]:   <os>
Nov 08 23:48:12 user nova-compute[75045]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 23:48:12 user nova-compute[75045]:     <boot dev="hd"/>
Nov 08 23:48:12 user nova-compute[75045]:     <smbios mode="sysinfo"/>
Nov 08 23:48:12 user nova-compute[75045]:   </os>
Nov 08 23:48:12 user nova-compute[75045]:   <features>
Nov 08 23:48:12 user nova-compute[75045]:     <acpi/>
Nov 08 23:48:12 user nova-compute[75045]:     <apic/>
Nov 08 23:48:12 user nova-compute[75045]:     <vmcoreinfo/>
Nov 08 23:48:12 user nova-compute[75045]:   </features>
Nov 08 23:48:12 user nova-compute[75045]:   <clock offset="utc">
Nov 08 23:48:12 user nova-compute[75045]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 23:48:12 user nova-compute[75045]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 23:48:12 user nova-compute[75045]:     <timer name="hpet" present="no"/>
Nov 08 23:48:12 user nova-compute[75045]:   </clock>
Nov 08 23:48:12 user nova-compute[75045]:   <cpu mode="custom" match="exact">
Nov 08 23:48:12 user nova-compute[75045]:     <model>Nehalem</model>
Nov 08 23:48:12 user nova-compute[75045]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 23:48:12 user nova-compute[75045]:   </cpu>
Nov 08 23:48:12 user nova-compute[75045]:   <devices>
Nov 08 23:48:12 user nova-compute[75045]:     <disk type="file" device="disk">
Nov 08 23:48:12 user nova-compute[75045]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 23:48:12 user nova-compute[75045]:       <source file="/opt/stack/data/nova/instances/c7b3eac2-a51b-40e7-a199-66aee8d2da09/disk"/>
Nov 08 23:48:12 user nova-compute[75045]:       <target dev="vda" bus="virtio"/>
Nov 08 23:48:12 user nova-compute[75045]:     </disk>
Nov 08 23:48:12 user nova-compute[75045]:     <interface type="ethernet">
Nov 08 23:48:12 user nova-compute[75045]:       <mac address="fa:16:3e:37:0b:9c"/>
Nov 08 23:48:12 user nova-compute[75045]:       <model type="virtio"/>
Nov 08 23:48:12 user nova-compute[75045]:       <mtu size="1442"/>
Nov 08 23:48:12 user nova-compute[75045]:       <target dev="tapee3648b5-a2"/>
Nov 08 23:48:12 user nova-compute[75045]:     </interface>
Nov 08 23:48:12 user nova-compute[75045]:     <serial type="pty">
Nov 08 23:48:12 user nova-compute[75045]:       <log file="/opt/stack/data/nova/instances/c7b3eac2-a51b-40e7-a199-66aee8d2da09/console.log" append="off"/>
Nov 08 23:48:12 user nova-compute[75045]:     </serial>
Nov 08 23:48:12 user nova-compute[75045]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 23:48:12 user nova-compute[75045]:     <video>
Nov 08 23:48:12 user nova-compute[75045]:       <model type="virtio"/>
Nov 08 23:48:12 user nova-compute[75045]:     </video>
Nov 08 23:48:12 user nova-compute[75045]:     <rng model="virtio">
Nov 08 23:48:12 user nova-compute[75045]:       <backend model="random">/dev/urandom</backend>
Nov 08 23:48:12 user nova-compute[75045]:     </rng>
Nov 08 23:48:12 user nova-compute[75045]:     <controller type="usb" index="0" model="none"/>
Nov 08 23:48:12 user nova-compute[75045]:     <memballoon model="virtio">
Nov 08 23:48:12 user nova-compute[75045]:       <stats period="10"/>
Nov 08 23:48:12 user nova-compute[75045]:     </memballoon>
Nov 08 23:48:12 user nova-compute[75045]:   </devices>
Nov 08 23:48:12 user nova-compute[75045]: </domain>
Nov 08 23:48:12 user nova-compute[75045]:  {{(pid=75045) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 23:48:12 user nova-compute[75045]: DEBUG nova.virt.libvirt.vif [None req-5ab8d5a6-8766-43de-ac8c-7de1336324d3 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T23:48:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1921157809',display_name='tempest-TestMinimumBasicScenario-server-1921157809',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1921157809',id=46,image_ref='f5ffbc98-11a7-4f8a-a6c2-51981767a401',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHecd69gYgaSALnbnoSk8qN0iobdxEqArnmuB2X8R1yl+8miN9+r40m6x9O1njTg8e0tQbpEe+KRfZaDGySkJLV+Zispu3OSLEK+XK2OAmFWBfz0y5wJsz4CCuk3AqcQeQ==',key_name='tempest-TestMinimumBasicScenario-2120728013',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c4bfce59008d44fdb5ba91c70f1cf044',ramdisk_id='',reservation_id='r-3g7sio6l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f5ffbc98-11a7-4f8a-a6c2-51981767a401',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1125576376',owner_user_name='tempest-TestMinimumBasicScenario-1125576376-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T23:48:10Z,user_data=None,user_id='4ed9cd91d0654f4aa4d620c9f0eb2766',uuid=c7b3eac2-a51b-40e7-a199-66aee8d2da09,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ee3648b5-a27a-401d-8708-e25f28d987da", "address": "fa:16:3e:37:0b:9c", "network": {"id": "fe5f7093-1cdd-465c-97f0-7d7b2dd1fa8a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1755065955-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4bfce59008d44fdb5ba91c70f1cf044", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee3648b5-a2", "ovs_interfaceid": "ee3648b5-a27a-401d-8708-e25f28d987da", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75045) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 23:48:12 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-5ab8d5a6-8766-43de-ac8c-7de1336324d3 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] Converting VIF {"id": "ee3648b5-a27a-401d-8708-e25f28d987da", "address": "fa:16:3e:37:0b:9c", "network": {"id": "fe5f7093-1cdd-465c-97f0-7d7b2dd1fa8a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1755065955-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4bfce59008d44fdb5ba91c70f1cf044", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee3648b5-a2", "ovs_interfaceid": "ee3648b5-a27a-401d-8708-e25f28d987da", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 23:48:12 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-5ab8d5a6-8766-43de-ac8c-7de1336324d3 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:37:0b:9c,bridge_name='br-int',has_traffic_filtering=True,id=ee3648b5-a27a-401d-8708-e25f28d987da,network=Network(fe5f7093-1cdd-465c-97f0-7d7b2dd1fa8a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee3648b5-a2') {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 23:48:12 user nova-compute[75045]: DEBUG os_vif [None req-5ab8d5a6-8766-43de-ac8c-7de1336324d3 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:37:0b:9c,bridge_name='br-int',has_traffic_filtering=True,id=ee3648b5-a27a-401d-8708-e25f28d987da,network=Network(fe5f7093-1cdd-465c-97f0-7d7b2dd1fa8a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee3648b5-a2') {{(pid=75045) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 23:48:12 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:48:12 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:48:12 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 23:48:12 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:48:12 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4143a020-6b0e-5e9a-acad-dad01c60639d', '_type': 'linux-noop'}}, row=False) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:48:12 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:48:12 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:48:12 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:48:12 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d7e8e52-9432-47ad-b932-00532c6a10d6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:22e58281-41b7-4be2-ace8-0750aa5d18f8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:adcca529-746a-4b7a-966a-82909ff5b108\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fc158ccb-5948-41c4-be6c-38c3539a467e\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:48:12 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:48:12 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapee3648b5-a2, may_exist=True, interface_attrs={}) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:48:12 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapee3648b5-a2, col_values=(('qos', UUID('eab0223d-15c9-4b63-9f2e-d415ab00b167')),), if_exists=True) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:48:12 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapee3648b5-a2, col_values=(('external_ids', {'iface-id': 'ee3648b5-a27a-401d-8708-e25f28d987da', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:37:0b:9c', 'vm-uuid': 'c7b3eac2-a51b-40e7-a199-66aee8d2da09'}),), if_exists=True) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:48:12 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:48:12 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:48:12 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 23:48:12 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:48:12 user nova-compute[75045]: INFO os_vif [None req-5ab8d5a6-8766-43de-ac8c-7de1336324d3 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:37:0b:9c,bridge_name='br-int',has_traffic_filtering=True,id=ee3648b5-a27a-401d-8708-e25f28d987da,network=Network(fe5f7093-1cdd-465c-97f0-7d7b2dd1fa8a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee3648b5-a2')
Nov 08 23:48:12 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:48:12 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[a39b1a3c-e004-47fb-8ca6-d922c2ca728c]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22e58281-41b7-4be2-ace8-0750aa5d18f8 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:adcca529-746a-4b7a-966a-82909ff5b108 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc158ccb-5948-41c4-be6c-38c3539a467e (non-flash)\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:48:12 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-424f97ca-87a4-4b54-9b56-8f276531dc42 tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22e58281-41b7-4be2-ace8-0750aa5d18f8 (non-flash)
Nov 08 23:48:12 user nova-compute[75045]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:adcca529-746a-4b7a-966a-82909ff5b108 (non-flash)
Nov 08 23:48:12 user nova-compute[75045]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc158ccb-5948-41c4-be6c-38c3539a467e (non-flash)
Nov 08 23:48:12 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 23:48:12 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-424f97ca-87a4-4b54-9b56-8f276531dc42 tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22e58281-41b7-4be2-ace8-0750aa5d18f8 (non-flash)
Nov 08 23:48:12 user nova-compute[75045]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:adcca529-746a-4b7a-966a-82909ff5b108 (non-flash)
Nov 08 23:48:12 user nova-compute[75045]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc158ccb-5948-41c4-be6c-38c3539a467e (non-flash)
Nov 08 23:48:12 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 23:48:12 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-424f97ca-87a4-4b54-9b56-8f276531dc42 tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1b48284e50>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:adcca529-746a-4b7a-966a-82909ff5b108'): ({'sdb'}, set())}) {{(pid=75045) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 23:48:12 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-424f97ca-87a4-4b54-9b56-8f276531dc42 tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Removing single pathed devices sdb {{(pid=75045) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 23:48:12 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:48:12 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:48:12 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[c26499e0-9d89-446d-a351-b0c8372ace4b]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:48:12 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:48:12 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:48:12 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ae50f70-3557-4475-989c-1f8ca70cd65e]: (4, ('ok\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:48:12 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-424f97ca-87a4-4b54-9b56-8f276531dc42 tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Flushing IO for device /dev/sdb {{(pid=75045) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 23:48:12 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-5ab8d5a6-8766-43de-ac8c-7de1336324d3 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] No BDM found with device name vda, not building metadata. {{(pid=75045) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 23:48:12 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-5ab8d5a6-8766-43de-ac8c-7de1336324d3 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] No VIF found with MAC fa:16:3e:37:0b:9c, not building metadata {{(pid=75045) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 23:48:12 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:48:12 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:48:12 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c7ea359-572f-4437-893a-311047e48833]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:48:12 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-424f97ca-87a4-4b54-9b56-8f276531dc42 tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75045) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 23:48:12 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:48:12 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.046s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:48:12 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[03224b86-83f6-4eb9-b846-537cd91511a4]: (4, ('1', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:48:12 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-424f97ca-87a4-4b54-9b56-8f276531dc42 tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75045) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 23:48:12 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-424f97ca-87a4-4b54-9b56-8f276531dc42 tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] SCSI volumes sdb have been removed. {{(pid=75045) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 23:48:12 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-424f97ca-87a4-4b54-9b56-8f276531dc42 tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:adcca529-746a-4b7a-966a-82909ff5b108')] {{(pid=75045) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 23:48:12 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:adcca529-746a-4b7a-966a-82909ff5b108 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:48:12 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:adcca529-746a-4b7a-966a-82909ff5b108 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:48:12 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dbe34ea-54ac-4b40-ba2e-22cb2c526fe1]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:48:12 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-424f97ca-87a4-4b54-9b56-8f276531dc42 tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:48:12 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:adcca529-746a-4b7a-966a-82909ff5b108 -p 172.16.0.220:3260 --logout {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:48:12 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:adcca529-746a-4b7a-966a-82909ff5b108 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:48:12 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c0e3581-6a4d-4ecd-9a97-81580c9facf3]: (4, ('Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:adcca529-746a-4b7a-966a-82909ff5b108, portal: 172.16.0.220,3260]\nLogout of [sid: 45, target: iqn.2010-10.org.openstack:adcca529-746a-4b7a-966a-82909ff5b108, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:48:12 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-424f97ca-87a4-4b54-9b56-8f276531dc42 tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:adcca529-746a-4b7a-966a-82909ff5b108, portal: 172.16.0.220,3260]
Nov 08 23:48:12 user nova-compute[75045]: Logout of [sid: 45, target: iqn.2010-10.org.openstack:adcca529-746a-4b7a-966a-82909ff5b108, portal: 172.16.0.220,3260] successful.
Nov 08 23:48:12 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:48:12 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:adcca529-746a-4b7a-966a-82909ff5b108 -p 172.16.0.220:3260 --op delete {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:48:12 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:adcca529-746a-4b7a-966a-82909ff5b108 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:48:12 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd65a327-d27b-4b0f-ae2b-805385fde92b]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:48:12 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-424f97ca-87a4-4b54-9b56-8f276531dc42 tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:48:12 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-424f97ca-87a4-4b54-9b56-8f276531dc42 tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.354s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 23:48:12 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-424f97ca-87a4-4b54-9b56-8f276531dc42 tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] <== disconnect_volume: return (355ms) None {{(pid=75045) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 23:48:12 user nova-compute[75045]: DEBUG nova.virt.libvirt.volume.iscsi [None req-424f97ca-87a4-4b54-9b56-8f276531dc42 tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] [instance: 0b413c71-c13a-4fea-91c4-f6b1953d54c6] Disconnected iSCSI Volume {{(pid=75045) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 23:48:13 user nova-compute[75045]: DEBUG nova.network.neutron [req-5eb7efe8-635e-44e3-9b16-d80357639246 req-50da2016-f2f3-409a-bdfd-befdfb9cf2aa service nova] [instance: c7b3eac2-a51b-40e7-a199-66aee8d2da09] Updated VIF entry in instance network info cache for port ee3648b5-a27a-401d-8708-e25f28d987da. {{(pid=75045) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 23:48:13 user nova-compute[75045]: DEBUG nova.network.neutron [req-5eb7efe8-635e-44e3-9b16-d80357639246 req-50da2016-f2f3-409a-bdfd-befdfb9cf2aa service nova] [instance: c7b3eac2-a51b-40e7-a199-66aee8d2da09] Updating instance_info_cache with network_info: [{"id": "ee3648b5-a27a-401d-8708-e25f28d987da", "address": "fa:16:3e:37:0b:9c", "network": {"id": "fe5f7093-1cdd-465c-97f0-7d7b2dd1fa8a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1755065955-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4bfce59008d44fdb5ba91c70f1cf044", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee3648b5-a2", "ovs_interfaceid": "ee3648b5-a27a-401d-8708-e25f28d987da", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75045) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 23:48:13 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-5eb7efe8-635e-44e3-9b16-d80357639246 req-50da2016-f2f3-409a-bdfd-befdfb9cf2aa service nova] Releasing lock "refresh_cache-c7b3eac2-a51b-40e7-a199-66aee8d2da09" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 23:48:14 user nova-compute[75045]: DEBUG nova.objects.instance [None req-424f97ca-87a4-4b54-9b56-8f276531dc42 tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Lazy-loading 'flavor' on Instance uuid 0b413c71-c13a-4fea-91c4-f6b1953d54c6 {{(pid=75045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 23:48:14 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-424f97ca-87a4-4b54-9b56-8f276531dc42 tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Lock "0b413c71-c13a-4fea-91c4-f6b1953d54c6" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.230s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:48:14 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:48:14 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:48:14 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:48:14 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:48:14 user nova-compute[75045]: DEBUG nova.compute.manager [req-564929bf-6755-41a1-b6e6-309137baf5b6 req-d8ddd657-8799-4d4c-8dbd-e9eb38a19323 service nova] [instance: c7b3eac2-a51b-40e7-a199-66aee8d2da09] Received event network-vif-plugged-ee3648b5-a27a-401d-8708-e25f28d987da {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:48:14 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-564929bf-6755-41a1-b6e6-309137baf5b6 req-d8ddd657-8799-4d4c-8dbd-e9eb38a19323 service nova] Acquiring lock "c7b3eac2-a51b-40e7-a199-66aee8d2da09-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:48:14 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-564929bf-6755-41a1-b6e6-309137baf5b6 req-d8ddd657-8799-4d4c-8dbd-e9eb38a19323 service nova] Lock "c7b3eac2-a51b-40e7-a199-66aee8d2da09-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:48:14 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-564929bf-6755-41a1-b6e6-309137baf5b6 req-d8ddd657-8799-4d4c-8dbd-e9eb38a19323 service nova] Lock "c7b3eac2-a51b-40e7-a199-66aee8d2da09-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:48:14 user nova-compute[75045]: DEBUG nova.compute.manager [req-564929bf-6755-41a1-b6e6-309137baf5b6 req-d8ddd657-8799-4d4c-8dbd-e9eb38a19323 service nova] [instance: c7b3eac2-a51b-40e7-a199-66aee8d2da09] No waiting events found dispatching network-vif-plugged-ee3648b5-a27a-401d-8708-e25f28d987da {{(pid=75045) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 23:48:14 user nova-compute[75045]: WARNING nova.compute.manager [req-564929bf-6755-41a1-b6e6-309137baf5b6 req-d8ddd657-8799-4d4c-8dbd-e9eb38a19323 service nova] [instance: c7b3eac2-a51b-40e7-a199-66aee8d2da09] Received unexpected event network-vif-plugged-ee3648b5-a27a-401d-8708-e25f28d987da for instance with vm_state building and task_state spawning.
Nov 08 23:48:14 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-37a73fa3-c8c8-4b67-93dd-a2a512b1fb5c tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Acquiring lock "0b413c71-c13a-4fea-91c4-f6b1953d54c6" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:48:14 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-37a73fa3-c8c8-4b67-93dd-a2a512b1fb5c tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Lock "0b413c71-c13a-4fea-91c4-f6b1953d54c6" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.002s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:48:14 user nova-compute[75045]: DEBUG nova.compute.manager [None req-37a73fa3-c8c8-4b67-93dd-a2a512b1fb5c tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] [instance: 0b413c71-c13a-4fea-91c4-f6b1953d54c6] Checking state {{(pid=75045) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 23:48:14 user nova-compute[75045]: DEBUG nova.compute.manager [None req-37a73fa3-c8c8-4b67-93dd-a2a512b1fb5c tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] [instance: 0b413c71-c13a-4fea-91c4-f6b1953d54c6] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=75045) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3358}}
Nov 08 23:48:14 user nova-compute[75045]: DEBUG nova.objects.instance [None req-37a73fa3-c8c8-4b67-93dd-a2a512b1fb5c tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Lazy-loading 'flavor' on Instance uuid 0b413c71-c13a-4fea-91c4-f6b1953d54c6 {{(pid=75045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 23:48:14 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:48:14 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:48:15 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:48:15 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:48:15 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:48:15 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:48:15 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:48:15 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:48:15 user nova-compute[75045]: DEBUG nova.compute.manager [req-9466e113-81d8-4c8a-b363-65f62ea35949 req-e8792306-f34b-47b6-b02e-3a08633c2297 service nova] [instance: 0b413c71-c13a-4fea-91c4-f6b1953d54c6] Received event network-vif-unplugged-166cceb4-9b95-4bdd-a3ad-b6aad94dfed0 {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:48:15 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-9466e113-81d8-4c8a-b363-65f62ea35949 req-e8792306-f34b-47b6-b02e-3a08633c2297 service nova] Acquiring lock "0b413c71-c13a-4fea-91c4-f6b1953d54c6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:48:15 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-9466e113-81d8-4c8a-b363-65f62ea35949 req-e8792306-f34b-47b6-b02e-3a08633c2297 service nova] Lock "0b413c71-c13a-4fea-91c4-f6b1953d54c6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:48:15 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-9466e113-81d8-4c8a-b363-65f62ea35949 req-e8792306-f34b-47b6-b02e-3a08633c2297 service nova] Lock "0b413c71-c13a-4fea-91c4-f6b1953d54c6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:48:15 user nova-compute[75045]: DEBUG nova.compute.manager [req-9466e113-81d8-4c8a-b363-65f62ea35949 req-e8792306-f34b-47b6-b02e-3a08633c2297 service nova] [instance: 0b413c71-c13a-4fea-91c4-f6b1953d54c6] No waiting events found dispatching network-vif-unplugged-166cceb4-9b95-4bdd-a3ad-b6aad94dfed0 {{(pid=75045) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 23:48:15 user nova-compute[75045]: WARNING nova.compute.manager [req-9466e113-81d8-4c8a-b363-65f62ea35949 req-e8792306-f34b-47b6-b02e-3a08633c2297 service nova] [instance: 0b413c71-c13a-4fea-91c4-f6b1953d54c6] Received unexpected event network-vif-unplugged-166cceb4-9b95-4bdd-a3ad-b6aad94dfed0 for instance with vm_state active and task_state powering-off.
Nov 08 23:48:15 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:48:15 user nova-compute[75045]: INFO nova.virt.libvirt.driver [-] [instance: 0b413c71-c13a-4fea-91c4-f6b1953d54c6] Instance destroyed successfully.
Nov 08 23:48:15 user nova-compute[75045]: DEBUG nova.compute.manager [None req-37a73fa3-c8c8-4b67-93dd-a2a512b1fb5c tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] [instance: 0b413c71-c13a-4fea-91c4-f6b1953d54c6] Checking state {{(pid=75045) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 23:48:15 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-37a73fa3-c8c8-4b67-93dd-a2a512b1fb5c tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Lock "0b413c71-c13a-4fea-91c4-f6b1953d54c6" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.869s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:48:16 user nova-compute[75045]: DEBUG nova.compute.manager [None req-5ab8d5a6-8766-43de-ac8c-7de1336324d3 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] [instance: c7b3eac2-a51b-40e7-a199-66aee8d2da09] Instance event wait completed in 0 seconds for  {{(pid=75045) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 23:48:16 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-5ab8d5a6-8766-43de-ac8c-7de1336324d3 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] [instance: c7b3eac2-a51b-40e7-a199-66aee8d2da09] Guest created on hypervisor {{(pid=75045) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 23:48:16 user nova-compute[75045]: INFO nova.virt.libvirt.driver [-] [instance: c7b3eac2-a51b-40e7-a199-66aee8d2da09] Instance spawned successfully.
Nov 08 23:48:16 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-5ab8d5a6-8766-43de-ac8c-7de1336324d3 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] [instance: c7b3eac2-a51b-40e7-a199-66aee8d2da09] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75045) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 23:48:16 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-5ab8d5a6-8766-43de-ac8c-7de1336324d3 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] [instance: c7b3eac2-a51b-40e7-a199-66aee8d2da09] Found default for hw_cdrom_bus of ide {{(pid=75045) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 23:48:16 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-5ab8d5a6-8766-43de-ac8c-7de1336324d3 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] [instance: c7b3eac2-a51b-40e7-a199-66aee8d2da09] Found default for hw_disk_bus of virtio {{(pid=75045) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 23:48:16 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-5ab8d5a6-8766-43de-ac8c-7de1336324d3 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] [instance: c7b3eac2-a51b-40e7-a199-66aee8d2da09] Found default for hw_input_bus of None {{(pid=75045) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 23:48:16 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-5ab8d5a6-8766-43de-ac8c-7de1336324d3 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] [instance: c7b3eac2-a51b-40e7-a199-66aee8d2da09] Found default for hw_pointer_model of None {{(pid=75045) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 23:48:16 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-5ab8d5a6-8766-43de-ac8c-7de1336324d3 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] [instance: c7b3eac2-a51b-40e7-a199-66aee8d2da09] Found default for hw_video_model of virtio {{(pid=75045) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 23:48:16 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-5ab8d5a6-8766-43de-ac8c-7de1336324d3 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] [instance: c7b3eac2-a51b-40e7-a199-66aee8d2da09] Found default for hw_vif_model of virtio {{(pid=75045) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 23:48:16 user nova-compute[75045]: DEBUG nova.compute.manager [req-7ebe0f02-6501-4940-ae80-35abb6851781 req-87cf715b-5ffe-4d6b-97c7-963e18af801c service nova] [instance: c7b3eac2-a51b-40e7-a199-66aee8d2da09] Received event network-vif-plugged-ee3648b5-a27a-401d-8708-e25f28d987da {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:48:16 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-7ebe0f02-6501-4940-ae80-35abb6851781 req-87cf715b-5ffe-4d6b-97c7-963e18af801c service nova] Acquiring lock "c7b3eac2-a51b-40e7-a199-66aee8d2da09-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:48:16 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-7ebe0f02-6501-4940-ae80-35abb6851781 req-87cf715b-5ffe-4d6b-97c7-963e18af801c service nova] Lock "c7b3eac2-a51b-40e7-a199-66aee8d2da09-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:48:16 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-7ebe0f02-6501-4940-ae80-35abb6851781 req-87cf715b-5ffe-4d6b-97c7-963e18af801c service nova] Lock "c7b3eac2-a51b-40e7-a199-66aee8d2da09-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:48:16 user nova-compute[75045]: DEBUG nova.compute.manager [req-7ebe0f02-6501-4940-ae80-35abb6851781 req-87cf715b-5ffe-4d6b-97c7-963e18af801c service nova] [instance: c7b3eac2-a51b-40e7-a199-66aee8d2da09] No waiting events found dispatching network-vif-plugged-ee3648b5-a27a-401d-8708-e25f28d987da {{(pid=75045) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 23:48:16 user nova-compute[75045]: WARNING nova.compute.manager [req-7ebe0f02-6501-4940-ae80-35abb6851781 req-87cf715b-5ffe-4d6b-97c7-963e18af801c service nova] [instance: c7b3eac2-a51b-40e7-a199-66aee8d2da09] Received unexpected event network-vif-plugged-ee3648b5-a27a-401d-8708-e25f28d987da for instance with vm_state building and task_state spawning.
Nov 08 23:48:16 user nova-compute[75045]: INFO nova.compute.manager [None req-5ab8d5a6-8766-43de-ac8c-7de1336324d3 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] [instance: c7b3eac2-a51b-40e7-a199-66aee8d2da09] Took 6.24 seconds to spawn the instance on the hypervisor.
Nov 08 23:48:16 user nova-compute[75045]: DEBUG nova.compute.manager [None req-5ab8d5a6-8766-43de-ac8c-7de1336324d3 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] [instance: c7b3eac2-a51b-40e7-a199-66aee8d2da09] Checking state {{(pid=75045) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 23:48:16 user nova-compute[75045]: INFO nova.compute.manager [None req-5ab8d5a6-8766-43de-ac8c-7de1336324d3 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] [instance: c7b3eac2-a51b-40e7-a199-66aee8d2da09] Took 7.08 seconds to build instance.
Nov 08 23:48:16 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-5ab8d5a6-8766-43de-ac8c-7de1336324d3 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] Lock "c7b3eac2-a51b-40e7-a199-66aee8d2da09" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.185s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:48:16 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:48:17 user nova-compute[75045]: DEBUG nova.compute.manager [req-ffa77926-baf1-4e28-b682-ee86bad4a24d req-27822c43-a181-4346-81ed-5d1c0f61c16d service nova] [instance: 0b413c71-c13a-4fea-91c4-f6b1953d54c6] Received event network-vif-plugged-166cceb4-9b95-4bdd-a3ad-b6aad94dfed0 {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:48:17 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-ffa77926-baf1-4e28-b682-ee86bad4a24d req-27822c43-a181-4346-81ed-5d1c0f61c16d service nova] Acquiring lock "0b413c71-c13a-4fea-91c4-f6b1953d54c6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:48:17 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-ffa77926-baf1-4e28-b682-ee86bad4a24d req-27822c43-a181-4346-81ed-5d1c0f61c16d service nova] Lock "0b413c71-c13a-4fea-91c4-f6b1953d54c6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:48:17 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-ffa77926-baf1-4e28-b682-ee86bad4a24d req-27822c43-a181-4346-81ed-5d1c0f61c16d service nova] Lock "0b413c71-c13a-4fea-91c4-f6b1953d54c6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:48:17 user nova-compute[75045]: DEBUG nova.compute.manager [req-ffa77926-baf1-4e28-b682-ee86bad4a24d req-27822c43-a181-4346-81ed-5d1c0f61c16d service nova] [instance: 0b413c71-c13a-4fea-91c4-f6b1953d54c6] No waiting events found dispatching network-vif-plugged-166cceb4-9b95-4bdd-a3ad-b6aad94dfed0 {{(pid=75045) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 23:48:17 user nova-compute[75045]: WARNING nova.compute.manager [req-ffa77926-baf1-4e28-b682-ee86bad4a24d req-27822c43-a181-4346-81ed-5d1c0f61c16d service nova] [instance: 0b413c71-c13a-4fea-91c4-f6b1953d54c6] Received unexpected event network-vif-plugged-166cceb4-9b95-4bdd-a3ad-b6aad94dfed0 for instance with vm_state stopped and task_state None.
Nov 08 23:48:17 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:48:21 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:48:21 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:48:22 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:48:27 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:48:29 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:48:31 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:48:32 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:48:36 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:48:37 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:48:41 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:48:42 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:48:46 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:48:47 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:48:49 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:48:51 user nova-compute[75045]: DEBUG nova.compute.manager [req-7e003c21-e8e8-4c65-b53d-b2d1c35b02db req-ccd91600-8f5c-4acc-93d8-bf2b1de8fa29 service nova] [instance: 0fb331fa-231e-482e-abfc-df39b13fb33a] Received event network-changed-0c7a4468-f510-4a33-8ee7-d70da98f972b {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:48:51 user nova-compute[75045]: DEBUG nova.compute.manager [req-7e003c21-e8e8-4c65-b53d-b2d1c35b02db req-ccd91600-8f5c-4acc-93d8-bf2b1de8fa29 service nova] [instance: 0fb331fa-231e-482e-abfc-df39b13fb33a] Refreshing instance network info cache due to event network-changed-0c7a4468-f510-4a33-8ee7-d70da98f972b. {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 23:48:51 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-7e003c21-e8e8-4c65-b53d-b2d1c35b02db req-ccd91600-8f5c-4acc-93d8-bf2b1de8fa29 service nova] Acquiring lock "refresh_cache-0fb331fa-231e-482e-abfc-df39b13fb33a" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 23:48:51 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-7e003c21-e8e8-4c65-b53d-b2d1c35b02db req-ccd91600-8f5c-4acc-93d8-bf2b1de8fa29 service nova] Acquired lock "refresh_cache-0fb331fa-231e-482e-abfc-df39b13fb33a" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 23:48:51 user nova-compute[75045]: DEBUG nova.network.neutron [req-7e003c21-e8e8-4c65-b53d-b2d1c35b02db req-ccd91600-8f5c-4acc-93d8-bf2b1de8fa29 service nova] [instance: 0fb331fa-231e-482e-abfc-df39b13fb33a] Refreshing network info cache for port 0c7a4468-f510-4a33-8ee7-d70da98f972b {{(pid=75045) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 23:48:51 user nova-compute[75045]: DEBUG nova.network.neutron [req-7e003c21-e8e8-4c65-b53d-b2d1c35b02db req-ccd91600-8f5c-4acc-93d8-bf2b1de8fa29 service nova] [instance: 0fb331fa-231e-482e-abfc-df39b13fb33a] Updated VIF entry in instance network info cache for port 0c7a4468-f510-4a33-8ee7-d70da98f972b. {{(pid=75045) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 23:48:51 user nova-compute[75045]: DEBUG nova.network.neutron [req-7e003c21-e8e8-4c65-b53d-b2d1c35b02db req-ccd91600-8f5c-4acc-93d8-bf2b1de8fa29 service nova] [instance: 0fb331fa-231e-482e-abfc-df39b13fb33a] Updating instance_info_cache with network_info: [{"id": "0c7a4468-f510-4a33-8ee7-d70da98f972b", "address": "fa:16:3e:8a:8b:88", "network": {"id": "4205f899-9865-4c65-8b46-c9a533e9bb45", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-774780781-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.126", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d59b73851c79473a9c2cdc0a120dfee0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c7a4468-f5", "ovs_interfaceid": "0c7a4468-f510-4a33-8ee7-d70da98f972b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75045) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 23:48:51 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:48:51 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-7e003c21-e8e8-4c65-b53d-b2d1c35b02db req-ccd91600-8f5c-4acc-93d8-bf2b1de8fa29 service nova] Releasing lock "refresh_cache-0fb331fa-231e-482e-abfc-df39b13fb33a" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 23:48:52 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-eab35cb1-3d22-4654-94d4-a4a7de24d4d9 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Acquiring lock "0fb331fa-231e-482e-abfc-df39b13fb33a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:48:52 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-eab35cb1-3d22-4654-94d4-a4a7de24d4d9 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Lock "0fb331fa-231e-482e-abfc-df39b13fb33a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:48:52 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-eab35cb1-3d22-4654-94d4-a4a7de24d4d9 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Acquiring lock "0fb331fa-231e-482e-abfc-df39b13fb33a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:48:52 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-eab35cb1-3d22-4654-94d4-a4a7de24d4d9 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Lock "0fb331fa-231e-482e-abfc-df39b13fb33a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:48:52 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-eab35cb1-3d22-4654-94d4-a4a7de24d4d9 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Lock "0fb331fa-231e-482e-abfc-df39b13fb33a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:48:52 user nova-compute[75045]: INFO nova.compute.manager [None req-eab35cb1-3d22-4654-94d4-a4a7de24d4d9 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] [instance: 0fb331fa-231e-482e-abfc-df39b13fb33a] Terminating instance
Nov 08 23:48:52 user nova-compute[75045]: DEBUG nova.compute.manager [None req-eab35cb1-3d22-4654-94d4-a4a7de24d4d9 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] [instance: 0fb331fa-231e-482e-abfc-df39b13fb33a] Start destroying the instance on the hypervisor. {{(pid=75045) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 23:48:52 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:48:52 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:48:52 user nova-compute[75045]: DEBUG nova.compute.manager [req-41485443-37ff-4038-ac69-377c4fa85bed req-d4022658-d958-4852-b5b0-c05c03b8a9c2 service nova] [instance: 0fb331fa-231e-482e-abfc-df39b13fb33a] Received event network-vif-unplugged-0c7a4468-f510-4a33-8ee7-d70da98f972b {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:48:52 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-41485443-37ff-4038-ac69-377c4fa85bed req-d4022658-d958-4852-b5b0-c05c03b8a9c2 service nova] Acquiring lock "0fb331fa-231e-482e-abfc-df39b13fb33a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:48:52 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-41485443-37ff-4038-ac69-377c4fa85bed req-d4022658-d958-4852-b5b0-c05c03b8a9c2 service nova] Lock "0fb331fa-231e-482e-abfc-df39b13fb33a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:48:52 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-41485443-37ff-4038-ac69-377c4fa85bed req-d4022658-d958-4852-b5b0-c05c03b8a9c2 service nova] Lock "0fb331fa-231e-482e-abfc-df39b13fb33a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:48:52 user nova-compute[75045]: DEBUG nova.compute.manager [req-41485443-37ff-4038-ac69-377c4fa85bed req-d4022658-d958-4852-b5b0-c05c03b8a9c2 service nova] [instance: 0fb331fa-231e-482e-abfc-df39b13fb33a] No waiting events found dispatching network-vif-unplugged-0c7a4468-f510-4a33-8ee7-d70da98f972b {{(pid=75045) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 23:48:52 user nova-compute[75045]: DEBUG nova.compute.manager [req-41485443-37ff-4038-ac69-377c4fa85bed req-d4022658-d958-4852-b5b0-c05c03b8a9c2 service nova] [instance: 0fb331fa-231e-482e-abfc-df39b13fb33a] Received event network-vif-unplugged-0c7a4468-f510-4a33-8ee7-d70da98f972b for instance with task_state deleting. {{(pid=75045) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 23:48:52 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:48:52 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:48:52 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:48:52 user nova-compute[75045]: INFO nova.virt.libvirt.driver [-] [instance: 0fb331fa-231e-482e-abfc-df39b13fb33a] Instance destroyed successfully.
Nov 08 23:48:52 user nova-compute[75045]: DEBUG nova.objects.instance [None req-eab35cb1-3d22-4654-94d4-a4a7de24d4d9 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Lazy-loading 'resources' on Instance uuid 0fb331fa-231e-482e-abfc-df39b13fb33a {{(pid=75045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 23:48:52 user nova-compute[75045]: DEBUG nova.virt.libvirt.vif [None req-eab35cb1-3d22-4654-94d4-a4a7de24d4d9 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T23:46:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-87023502',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-87023502',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-87023502',id=44,image_ref='cefce088-8eeb-4a07-bada-6e4cf14ac54c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLFajEq90PF+g5mz1f56miiZgoZX79EOzMFlYhJgaLr2Nsy2klw35nVJ5OgI0WTVMZT5GXq0yNz3WuAys4y7PUARSWA9hHR2XqDf4o7nsBq/A1TD7xn9ExZ2aMEHJuwDEQ==',key_name='tempest-keypair-1161830264',keypairs=<?>,launch_index=0,launched_at=2023-11-08T23:47:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d59b73851c79473a9c2cdc0a120dfee0',ramdisk_id='',reservation_id='r-h0lolso0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-650796844',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-650796844-project-member',image_root_device_name='/dev/vda',owner_project_name='tempest-TestVolumeBootPattern-650796844',owner_user_name='tempest-TestVolumeBootPattern-650796844-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T23:47:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='76c31c64d9594f9cbef7586fafb48721',uuid=0fb331fa-231e-482e-abfc-df39b13fb33a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0c7a4468-f510-4a33-8ee7-d70da98f972b", "address": "fa:16:3e:8a:8b:88", "network": {"id": "4205f899-9865-4c65-8b46-c9a533e9bb45", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-774780781-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.126", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d59b73851c79473a9c2cdc0a120dfee0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c7a4468-f5", "ovs_interfaceid": "0c7a4468-f510-4a33-8ee7-d70da98f972b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75045) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 23:48:52 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-eab35cb1-3d22-4654-94d4-a4a7de24d4d9 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Converting VIF {"id": "0c7a4468-f510-4a33-8ee7-d70da98f972b", "address": "fa:16:3e:8a:8b:88", "network": {"id": "4205f899-9865-4c65-8b46-c9a533e9bb45", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-774780781-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.126", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d59b73851c79473a9c2cdc0a120dfee0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c7a4468-f5", "ovs_interfaceid": "0c7a4468-f510-4a33-8ee7-d70da98f972b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 23:48:52 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-eab35cb1-3d22-4654-94d4-a4a7de24d4d9 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8a:8b:88,bridge_name='br-int',has_traffic_filtering=True,id=0c7a4468-f510-4a33-8ee7-d70da98f972b,network=Network(4205f899-9865-4c65-8b46-c9a533e9bb45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0c7a4468-f5') {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 23:48:52 user nova-compute[75045]: DEBUG os_vif [None req-eab35cb1-3d22-4654-94d4-a4a7de24d4d9 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:8a:8b:88,bridge_name='br-int',has_traffic_filtering=True,id=0c7a4468-f510-4a33-8ee7-d70da98f972b,network=Network(4205f899-9865-4c65-8b46-c9a533e9bb45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0c7a4468-f5') {{(pid=75045) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 23:48:52 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:48:52 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0c7a4468-f5, bridge=br-int, if_exists=True) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:48:52 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:48:52 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 23:48:52 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:48:52 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:48:52 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d79c085d-43ff-43d9-9ad4-45cdbd718cfa) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:48:52 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:48:52 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 23:48:52 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:48:52 user nova-compute[75045]: INFO os_vif [None req-eab35cb1-3d22-4654-94d4-a4a7de24d4d9 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:8a:8b:88,bridge_name='br-int',has_traffic_filtering=True,id=0c7a4468-f510-4a33-8ee7-d70da98f972b,network=Network(4205f899-9865-4c65-8b46-c9a533e9bb45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0c7a4468-f5')
Nov 08 23:48:52 user nova-compute[75045]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eab35cb1-3d22-4654-94d4-a4a7de24d4d9 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] [instance: 0fb331fa-231e-482e-abfc-df39b13fb33a] calling os-brick to detach iSCSI Volume {{(pid=75045) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 23:48:52 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-eab35cb1-3d22-4654-94d4-a4a7de24d4d9 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1b68210460>, {'target_iqn': 'iqn.2010-10.org.openstack:fc158ccb-5948-41c4-be6c-38c3539a467e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dNYlPWbG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75045) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 23:48:52 user nova-compute[75045]: WARNING os_brick.initiator.connectors.base [None req-eab35cb1-3d22-4654-94d4-a4a7de24d4d9 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 23:48:52 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-eab35cb1-3d22-4654-94d4-a4a7de24d4d9 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 23:48:52 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-eab35cb1-3d22-4654-94d4-a4a7de24d4d9 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 23:48:52 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:48:52 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:48:52 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e93546c-62cc-45a7-b0f1-41ea41fa05e9]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:22e58281-41b7-4be2-ace8-0750aa5d18f8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fc158ccb-5948-41c4-be6c-38c3539a467e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:48:52 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-eab35cb1-3d22-4654-94d4-a4a7de24d4d9 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 23:48:52 user nova-compute[75045]: No targets found.
Nov 08 23:48:52 user nova-compute[75045]: iSNS:
Nov 08 23:48:52 user nova-compute[75045]: No targets found.
Nov 08 23:48:52 user nova-compute[75045]: STATIC:
Nov 08 23:48:52 user nova-compute[75045]: Target: iqn.2010-10.org.openstack:22e58281-41b7-4be2-ace8-0750aa5d18f8
Nov 08 23:48:52 user nova-compute[75045]:         Portal: 172.16.0.220:3260,-1
Nov 08 23:48:52 user nova-compute[75045]:                 Iface Name: default
Nov 08 23:48:52 user nova-compute[75045]: Target: iqn.2010-10.org.openstack:fc158ccb-5948-41c4-be6c-38c3539a467e
Nov 08 23:48:52 user nova-compute[75045]:         Portal: 172.16.0.220:3260,-1
Nov 08 23:48:52 user nova-compute[75045]:                 Iface Name: default
Nov 08 23:48:52 user nova-compute[75045]: FIRMWARE:
Nov 08 23:48:52 user nova-compute[75045]: No targets found.
Nov 08 23:48:52 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 23:48:52 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-eab35cb1-3d22-4654-94d4-a4a7de24d4d9 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 23:48:52 user nova-compute[75045]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 23:48:52 user nova-compute[75045]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75045) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 23:48:52 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-eab35cb1-3d22-4654-94d4-a4a7de24d4d9 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fc158ccb-5948-41c4-be6c-38c3539a467e', 0)] {{(pid=75045) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 23:48:52 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:48:52 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:48:52 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2d1aeaf-00fd-498f-880d-2a19835c52cd]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:22e58281-41b7-4be2-ace8-0750aa5d18f8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fc158ccb-5948-41c4-be6c-38c3539a467e\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:48:52 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:48:53 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:48:53 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a70f4e3-4d56-43ec-ab01-3239404e640c]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22e58281-41b7-4be2-ace8-0750aa5d18f8 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc158ccb-5948-41c4-be6c-38c3539a467e (non-flash)\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:48:53 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-eab35cb1-3d22-4654-94d4-a4a7de24d4d9 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22e58281-41b7-4be2-ace8-0750aa5d18f8 (non-flash)
Nov 08 23:48:53 user nova-compute[75045]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc158ccb-5948-41c4-be6c-38c3539a467e (non-flash)
Nov 08 23:48:53 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 23:48:53 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-eab35cb1-3d22-4654-94d4-a4a7de24d4d9 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22e58281-41b7-4be2-ace8-0750aa5d18f8 (non-flash)
Nov 08 23:48:53 user nova-compute[75045]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc158ccb-5948-41c4-be6c-38c3539a467e (non-flash)
Nov 08 23:48:53 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 23:48:53 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-eab35cb1-3d22-4654-94d4-a4a7de24d4d9 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1b683a9870>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fc158ccb-5948-41c4-be6c-38c3539a467e'): ({'sdc'}, set())}) {{(pid=75045) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 23:48:53 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-eab35cb1-3d22-4654-94d4-a4a7de24d4d9 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Removing single pathed devices sdc {{(pid=75045) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 23:48:53 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:48:53 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:48:53 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[85f5bc79-dd72-4a0f-ad3e-debde188b531]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:48:53 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:48:53 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.017s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:48:53 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3367c7b-4051-4694-ac66-936f8dca844d]: (4, ('ok\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:48:53 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-eab35cb1-3d22-4654-94d4-a4a7de24d4d9 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Flushing IO for device /dev/sdc {{(pid=75045) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 23:48:53 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:48:53 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:48:53 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[76bf2bd1-4e69-4f07-8cba-cbf0efc83da5]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:48:53 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-eab35cb1-3d22-4654-94d4-a4a7de24d4d9 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75045) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 23:48:53 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:48:53 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.048s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:48:53 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d04f8ae-c87b-4610-b15b-2697d3cc7548]: (4, ('1', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:48:53 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-eab35cb1-3d22-4654-94d4-a4a7de24d4d9 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75045) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 23:48:53 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-eab35cb1-3d22-4654-94d4-a4a7de24d4d9 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] SCSI volumes sdc have been removed. {{(pid=75045) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 23:48:53 user nova-compute[75045]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-26266653734653735', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_4c7b534a', '/dev/disk/by-id/scsi-1SCST_BIO4c7b534a-bfe74e75f6ede9a9') {{(pid=86132) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 08 23:48:53 user nova-compute[75045]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-26266653734653735
Nov 08 23:48:53 user nova-compute[75045]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-SSCST_BIO_Storage_4c7b534a
Nov 08 23:48:53 user nova-compute[75045]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-1SCST_BIO4c7b534a-bfe74e75f6ede9a9
Nov 08 23:48:53 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[35b25869-f619-4a69-a4c6-701a29240172]: (4, None) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:48:53 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-eab35cb1-3d22-4654-94d4-a4a7de24d4d9 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fc158ccb-5948-41c4-be6c-38c3539a467e')] {{(pid=75045) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 23:48:53 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc158ccb-5948-41c4-be6c-38c3539a467e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:48:53 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc158ccb-5948-41c4-be6c-38c3539a467e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:48:53 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[56c642ba-23da-453b-bbf0-365eab8d1578]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:48:53 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-eab35cb1-3d22-4654-94d4-a4a7de24d4d9 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:48:53 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc158ccb-5948-41c4-be6c-38c3539a467e -p 172.16.0.220:3260 --logout {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:48:53 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc158ccb-5948-41c4-be6c-38c3539a467e -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:48:53 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[a20bb7ea-e5ef-4aaa-9ae7-48b1110d5924]: (4, ('Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:fc158ccb-5948-41c4-be6c-38c3539a467e, portal: 172.16.0.220,3260]\nLogout of [sid: 46, target: iqn.2010-10.org.openstack:fc158ccb-5948-41c4-be6c-38c3539a467e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:48:53 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-eab35cb1-3d22-4654-94d4-a4a7de24d4d9 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:fc158ccb-5948-41c4-be6c-38c3539a467e, portal: 172.16.0.220,3260]
Nov 08 23:48:53 user nova-compute[75045]: Logout of [sid: 46, target: iqn.2010-10.org.openstack:fc158ccb-5948-41c4-be6c-38c3539a467e, portal: 172.16.0.220,3260] successful.
Nov 08 23:48:53 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:48:53 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc158ccb-5948-41c4-be6c-38c3539a467e -p 172.16.0.220:3260 --op delete {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:48:53 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc158ccb-5948-41c4-be6c-38c3539a467e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:48:53 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[4de663a1-6784-45eb-b76d-ecda39b64ac7]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:48:53 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-eab35cb1-3d22-4654-94d4-a4a7de24d4d9 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:48:53 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-eab35cb1-3d22-4654-94d4-a4a7de24d4d9 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.321s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 23:48:53 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-eab35cb1-3d22-4654-94d4-a4a7de24d4d9 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] <== disconnect_volume: return (322ms) None {{(pid=75045) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 23:48:53 user nova-compute[75045]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eab35cb1-3d22-4654-94d4-a4a7de24d4d9 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] [instance: 0fb331fa-231e-482e-abfc-df39b13fb33a] Disconnected iSCSI Volume {{(pid=75045) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 23:48:53 user nova-compute[75045]: INFO nova.virt.libvirt.driver [None req-eab35cb1-3d22-4654-94d4-a4a7de24d4d9 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] [instance: 0fb331fa-231e-482e-abfc-df39b13fb33a] Deleting instance files /opt/stack/data/nova/instances/0fb331fa-231e-482e-abfc-df39b13fb33a_del
Nov 08 23:48:53 user nova-compute[75045]: INFO nova.virt.libvirt.driver [None req-eab35cb1-3d22-4654-94d4-a4a7de24d4d9 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] [instance: 0fb331fa-231e-482e-abfc-df39b13fb33a] Deletion of /opt/stack/data/nova/instances/0fb331fa-231e-482e-abfc-df39b13fb33a_del complete
Nov 08 23:48:53 user nova-compute[75045]: INFO nova.compute.manager [None req-eab35cb1-3d22-4654-94d4-a4a7de24d4d9 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] [instance: 0fb331fa-231e-482e-abfc-df39b13fb33a] Took 1.22 seconds to destroy the instance on the hypervisor.
Nov 08 23:48:53 user nova-compute[75045]: DEBUG oslo.service.loopingcall [None req-eab35cb1-3d22-4654-94d4-a4a7de24d4d9 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75045) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 23:48:53 user nova-compute[75045]: DEBUG nova.compute.manager [-] [instance: 0fb331fa-231e-482e-abfc-df39b13fb33a] Deallocating network for instance {{(pid=75045) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 23:48:53 user nova-compute[75045]: DEBUG nova.network.neutron [-] [instance: 0fb331fa-231e-482e-abfc-df39b13fb33a] deallocate_for_instance() {{(pid=75045) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 23:48:54 user nova-compute[75045]: DEBUG nova.compute.manager [req-6cf2f9b3-4fec-48ee-8505-799ce7f7b19f req-fe0855d4-e761-48bb-b6ab-16d3486bba85 service nova] [instance: 0fb331fa-231e-482e-abfc-df39b13fb33a] Received event network-vif-plugged-0c7a4468-f510-4a33-8ee7-d70da98f972b {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:48:54 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-6cf2f9b3-4fec-48ee-8505-799ce7f7b19f req-fe0855d4-e761-48bb-b6ab-16d3486bba85 service nova] Acquiring lock "0fb331fa-231e-482e-abfc-df39b13fb33a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:48:54 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-6cf2f9b3-4fec-48ee-8505-799ce7f7b19f req-fe0855d4-e761-48bb-b6ab-16d3486bba85 service nova] Lock "0fb331fa-231e-482e-abfc-df39b13fb33a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:48:54 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-6cf2f9b3-4fec-48ee-8505-799ce7f7b19f req-fe0855d4-e761-48bb-b6ab-16d3486bba85 service nova] Lock "0fb331fa-231e-482e-abfc-df39b13fb33a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:48:54 user nova-compute[75045]: DEBUG nova.compute.manager [req-6cf2f9b3-4fec-48ee-8505-799ce7f7b19f req-fe0855d4-e761-48bb-b6ab-16d3486bba85 service nova] [instance: 0fb331fa-231e-482e-abfc-df39b13fb33a] No waiting events found dispatching network-vif-plugged-0c7a4468-f510-4a33-8ee7-d70da98f972b {{(pid=75045) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 23:48:54 user nova-compute[75045]: WARNING nova.compute.manager [req-6cf2f9b3-4fec-48ee-8505-799ce7f7b19f req-fe0855d4-e761-48bb-b6ab-16d3486bba85 service nova] [instance: 0fb331fa-231e-482e-abfc-df39b13fb33a] Received unexpected event network-vif-plugged-0c7a4468-f510-4a33-8ee7-d70da98f972b for instance with vm_state active and task_state deleting.
Nov 08 23:48:54 user nova-compute[75045]: DEBUG nova.network.neutron [-] [instance: 0fb331fa-231e-482e-abfc-df39b13fb33a] Updating instance_info_cache with network_info: [] {{(pid=75045) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 23:48:54 user nova-compute[75045]: INFO nova.compute.manager [-] [instance: 0fb331fa-231e-482e-abfc-df39b13fb33a] Took 1.18 seconds to deallocate network for instance.
Nov 08 23:48:55 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:48:55 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:48:55 user nova-compute[75045]: DEBUG nova.compute.manager [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Starting heal instance info cache {{(pid=75045) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 23:48:56 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Acquiring lock "refresh_cache-37502077-b02b-4f0c-b654-8a6cef607efa" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 23:48:56 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Acquired lock "refresh_cache-37502077-b02b-4f0c-b654-8a6cef607efa" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 23:48:56 user nova-compute[75045]: DEBUG nova.network.neutron [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] [instance: 37502077-b02b-4f0c-b654-8a6cef607efa] Forcefully refreshing network info cache for instance {{(pid=75045) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 23:48:56 user nova-compute[75045]: DEBUG nova.compute.manager [req-5bbfb225-aa21-49cf-a0a9-1eb5f4cc1e3f req-69598fbf-b98f-4714-8b41-f0a9f63ef497 service nova] [instance: 0fb331fa-231e-482e-abfc-df39b13fb33a] Received event network-vif-deleted-0c7a4468-f510-4a33-8ee7-d70da98f972b {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:48:56 user nova-compute[75045]: DEBUG nova.network.neutron [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] [instance: 37502077-b02b-4f0c-b654-8a6cef607efa] Updating instance_info_cache with network_info: [{"id": "30508e27-33e7-40dd-b166-6486da0f0911", "address": "fa:16:3e:3d:90:bb", "network": {"id": "4205f899-9865-4c65-8b46-c9a533e9bb45", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-774780781-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.170", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d59b73851c79473a9c2cdc0a120dfee0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30508e27-33", "ovs_interfaceid": "30508e27-33e7-40dd-b166-6486da0f0911", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75045) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 23:48:56 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Releasing lock "refresh_cache-37502077-b02b-4f0c-b654-8a6cef607efa" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 23:48:56 user nova-compute[75045]: DEBUG nova.compute.manager [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] [instance: 37502077-b02b-4f0c-b654-8a6cef607efa] Updated the network info_cache for instance {{(pid=75045) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 23:48:56 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:48:56 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:48:56 user nova-compute[75045]: DEBUG nova.compute.manager [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75045) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 23:48:57 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:48:57 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:48:59 user nova-compute[75045]: INFO nova.compute.manager [None req-eab35cb1-3d22-4654-94d4-a4a7de24d4d9 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] [instance: 0fb331fa-231e-482e-abfc-df39b13fb33a] Took 5.17 seconds to detach 1 volumes for instance.
Nov 08 23:48:59 user nova-compute[75045]: DEBUG nova.compute.manager [None req-eab35cb1-3d22-4654-94d4-a4a7de24d4d9 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] [instance: 0fb331fa-231e-482e-abfc-df39b13fb33a] Deleting volume: fc158ccb-5948-41c4-be6c-38c3539a467e {{(pid=75045) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 08 23:48:59 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-eab35cb1-3d22-4654-94d4-a4a7de24d4d9 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:48:59 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-eab35cb1-3d22-4654-94d4-a4a7de24d4d9 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:48:59 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:49:00 user nova-compute[75045]: DEBUG nova.compute.provider_tree [None req-eab35cb1-3d22-4654-94d4-a4a7de24d4d9 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Inventory has not changed in ProviderTree for provider: 62ba5f85-c74d-4b58-986e-d4197e813fd7 {{(pid=75045) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 23:49:00 user nova-compute[75045]: DEBUG nova.scheduler.client.report [None req-eab35cb1-3d22-4654-94d4-a4a7de24d4d9 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Inventory has not changed for provider 62ba5f85-c74d-4b58-986e-d4197e813fd7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75045) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 23:49:00 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-eab35cb1-3d22-4654-94d4-a4a7de24d4d9 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.248s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:49:00 user nova-compute[75045]: INFO nova.scheduler.client.report [None req-eab35cb1-3d22-4654-94d4-a4a7de24d4d9 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Deleted allocations for instance 0fb331fa-231e-482e-abfc-df39b13fb33a
Nov 08 23:49:00 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-eab35cb1-3d22-4654-94d4-a4a7de24d4d9 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Lock "0fb331fa-231e-482e-abfc-df39b13fb33a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 8.106s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:49:01 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:49:02 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:49:02 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:49:02 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:49:05 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager.update_available_resource {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:49:06 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:49:06 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:49:06 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:49:06 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Auditing locally available compute resources for user (node: user) {{(pid=75045) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 23:49:06 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75045) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 23:49:06 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7b3eac2-a51b-40e7-a199-66aee8d2da09/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:49:06 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7b3eac2-a51b-40e7-a199-66aee8d2da09/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:49:06 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7b3eac2-a51b-40e7-a199-66aee8d2da09/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:49:06 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7b3eac2-a51b-40e7-a199-66aee8d2da09/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:49:06 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abb7206c-b2e2-4a5a-93a8-f7f16231cf26/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:49:06 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abb7206c-b2e2-4a5a-93a8-f7f16231cf26/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:49:06 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abb7206c-b2e2-4a5a-93a8-f7f16231cf26/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:49:06 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abb7206c-b2e2-4a5a-93a8-f7f16231cf26/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:49:06 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b413c71-c13a-4fea-91c4-f6b1953d54c6/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:49:07 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b413c71-c13a-4fea-91c4-f6b1953d54c6/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:49:07 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b413c71-c13a-4fea-91c4-f6b1953d54c6/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:49:07 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b413c71-c13a-4fea-91c4-f6b1953d54c6/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:49:07 user nova-compute[75045]: WARNING nova.virt.libvirt.driver [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 23:49:07 user nova-compute[75045]: WARNING nova.virt.libvirt.driver [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 23:49:07 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Hypervisor/Node resource view: name=user free_ram=8520MB free_disk=24.93402862548828GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75045) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 23:49:07 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:49:07 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:49:07 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Instance 0b413c71-c13a-4fea-91c4-f6b1953d54c6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75045) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 23:49:07 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Instance 37502077-b02b-4f0c-b654-8a6cef607efa actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75045) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 23:49:07 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Instance abb7206c-b2e2-4a5a-93a8-f7f16231cf26 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75045) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 23:49:07 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Instance c7b3eac2-a51b-40e7-a199-66aee8d2da09 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75045) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 23:49:07 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=75045) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 23:49:07 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=75045) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 23:49:07 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:49:07 user nova-compute[75045]: DEBUG nova.compute.provider_tree [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Inventory has not changed in ProviderTree for provider: 62ba5f85-c74d-4b58-986e-d4197e813fd7 {{(pid=75045) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 23:49:07 user nova-compute[75045]: DEBUG nova.scheduler.client.report [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Inventory has not changed for provider 62ba5f85-c74d-4b58-986e-d4197e813fd7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75045) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 23:49:08 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Compute_service record updated for user:user {{(pid=75045) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 23:49:08 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.321s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:49:12 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 23:49:17 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 23:49:22 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:49:27 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:49:32 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:49:37 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:49:42 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:49:47 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-39e89d4b-450e-4c43-be21-717b9a957db0 tempest-VolumesActionsTest-1069895698 tempest-VolumesActionsTest-1069895698-project-member] Acquiring lock "abb7206c-b2e2-4a5a-93a8-f7f16231cf26" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:49:47 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-39e89d4b-450e-4c43-be21-717b9a957db0 tempest-VolumesActionsTest-1069895698 tempest-VolumesActionsTest-1069895698-project-member] Lock "abb7206c-b2e2-4a5a-93a8-f7f16231cf26" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:49:47 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-39e89d4b-450e-4c43-be21-717b9a957db0 tempest-VolumesActionsTest-1069895698 tempest-VolumesActionsTest-1069895698-project-member] Acquiring lock "abb7206c-b2e2-4a5a-93a8-f7f16231cf26-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:49:47 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-39e89d4b-450e-4c43-be21-717b9a957db0 tempest-VolumesActionsTest-1069895698 tempest-VolumesActionsTest-1069895698-project-member] Lock "abb7206c-b2e2-4a5a-93a8-f7f16231cf26-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:49:47 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-39e89d4b-450e-4c43-be21-717b9a957db0 tempest-VolumesActionsTest-1069895698 tempest-VolumesActionsTest-1069895698-project-member] Lock "abb7206c-b2e2-4a5a-93a8-f7f16231cf26-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:49:47 user nova-compute[75045]: INFO nova.compute.manager [None req-39e89d4b-450e-4c43-be21-717b9a957db0 tempest-VolumesActionsTest-1069895698 tempest-VolumesActionsTest-1069895698-project-member] [instance: abb7206c-b2e2-4a5a-93a8-f7f16231cf26] Terminating instance
Nov 08 23:49:47 user nova-compute[75045]: DEBUG nova.compute.manager [None req-39e89d4b-450e-4c43-be21-717b9a957db0 tempest-VolumesActionsTest-1069895698 tempest-VolumesActionsTest-1069895698-project-member] [instance: abb7206c-b2e2-4a5a-93a8-f7f16231cf26] Start destroying the instance on the hypervisor. {{(pid=75045) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 23:49:47 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:49:47 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:49:47 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:49:47 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:49:47 user nova-compute[75045]: DEBUG nova.compute.manager [req-fb839cdf-0e0e-47d5-9292-bef8dedac130 req-bbc8a814-381d-4a70-95b1-0efa5c980d2d service nova] [instance: abb7206c-b2e2-4a5a-93a8-f7f16231cf26] Received event network-vif-unplugged-e534dbaa-36f9-4cdf-86a1-78a17054ab8e {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:49:47 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-fb839cdf-0e0e-47d5-9292-bef8dedac130 req-bbc8a814-381d-4a70-95b1-0efa5c980d2d service nova] Acquiring lock "abb7206c-b2e2-4a5a-93a8-f7f16231cf26-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:49:47 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-fb839cdf-0e0e-47d5-9292-bef8dedac130 req-bbc8a814-381d-4a70-95b1-0efa5c980d2d service nova] Lock "abb7206c-b2e2-4a5a-93a8-f7f16231cf26-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:49:47 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-fb839cdf-0e0e-47d5-9292-bef8dedac130 req-bbc8a814-381d-4a70-95b1-0efa5c980d2d service nova] Lock "abb7206c-b2e2-4a5a-93a8-f7f16231cf26-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:49:47 user nova-compute[75045]: DEBUG nova.compute.manager [req-fb839cdf-0e0e-47d5-9292-bef8dedac130 req-bbc8a814-381d-4a70-95b1-0efa5c980d2d service nova] [instance: abb7206c-b2e2-4a5a-93a8-f7f16231cf26] No waiting events found dispatching network-vif-unplugged-e534dbaa-36f9-4cdf-86a1-78a17054ab8e {{(pid=75045) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 23:49:47 user nova-compute[75045]: DEBUG nova.compute.manager [req-fb839cdf-0e0e-47d5-9292-bef8dedac130 req-bbc8a814-381d-4a70-95b1-0efa5c980d2d service nova] [instance: abb7206c-b2e2-4a5a-93a8-f7f16231cf26] Received event network-vif-unplugged-e534dbaa-36f9-4cdf-86a1-78a17054ab8e for instance with task_state deleting. {{(pid=75045) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 23:49:47 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:49:47 user nova-compute[75045]: INFO nova.virt.libvirt.driver [-] [instance: abb7206c-b2e2-4a5a-93a8-f7f16231cf26] Instance destroyed successfully.
Nov 08 23:49:47 user nova-compute[75045]: DEBUG nova.objects.instance [None req-39e89d4b-450e-4c43-be21-717b9a957db0 tempest-VolumesActionsTest-1069895698 tempest-VolumesActionsTest-1069895698-project-member] Lazy-loading 'resources' on Instance uuid abb7206c-b2e2-4a5a-93a8-f7f16231cf26 {{(pid=75045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 23:49:47 user nova-compute[75045]: DEBUG nova.virt.libvirt.vif [None req-39e89d4b-450e-4c43-be21-717b9a957db0 tempest-VolumesActionsTest-1069895698 tempest-VolumesActionsTest-1069895698-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T23:47:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1415690750',display_name='tempest-VolumesActionsTest-instance-1415690750',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1415690750',id=45,image_ref='a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-08T23:47:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='54a16cf0a668402585c1368907ad70c4',ramdisk_id='',reservation_id='r-8p6mxi24',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1069895698',owner_user_name='tempest-VolumesActionsTest-1069895698-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T23:47:43Z,user_data=None,user_id='1ebe1d42d4a548c59160031fa8bb3c58',uuid=abb7206c-b2e2-4a5a-93a8-f7f16231cf26,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e534dbaa-36f9-4cdf-86a1-78a17054ab8e", "address": "fa:16:3e:e9:e7:83", "network": {"id": "17bb03f5-be7a-40ac-a446-bf0162682d12", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1668425609-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54a16cf0a668402585c1368907ad70c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape534dbaa-36", "ovs_interfaceid": "e534dbaa-36f9-4cdf-86a1-78a17054ab8e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75045) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 23:49:47 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-39e89d4b-450e-4c43-be21-717b9a957db0 tempest-VolumesActionsTest-1069895698 tempest-VolumesActionsTest-1069895698-project-member] Converting VIF {"id": "e534dbaa-36f9-4cdf-86a1-78a17054ab8e", "address": "fa:16:3e:e9:e7:83", "network": {"id": "17bb03f5-be7a-40ac-a446-bf0162682d12", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1668425609-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54a16cf0a668402585c1368907ad70c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape534dbaa-36", "ovs_interfaceid": "e534dbaa-36f9-4cdf-86a1-78a17054ab8e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 23:49:47 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-39e89d4b-450e-4c43-be21-717b9a957db0 tempest-VolumesActionsTest-1069895698 tempest-VolumesActionsTest-1069895698-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e9:e7:83,bridge_name='br-int',has_traffic_filtering=True,id=e534dbaa-36f9-4cdf-86a1-78a17054ab8e,network=Network(17bb03f5-be7a-40ac-a446-bf0162682d12),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape534dbaa-36') {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 23:49:47 user nova-compute[75045]: DEBUG os_vif [None req-39e89d4b-450e-4c43-be21-717b9a957db0 tempest-VolumesActionsTest-1069895698 tempest-VolumesActionsTest-1069895698-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e9:e7:83,bridge_name='br-int',has_traffic_filtering=True,id=e534dbaa-36f9-4cdf-86a1-78a17054ab8e,network=Network(17bb03f5-be7a-40ac-a446-bf0162682d12),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape534dbaa-36') {{(pid=75045) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 23:49:47 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:49:47 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape534dbaa-36, bridge=br-int, if_exists=True) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:49:47 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 23:49:47 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:49:47 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:49:47 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ee50d828-3f1f-40da-b7bc-d7dbbebdaebe) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:49:47 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:49:47 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 23:49:47 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:49:47 user nova-compute[75045]: INFO os_vif [None req-39e89d4b-450e-4c43-be21-717b9a957db0 tempest-VolumesActionsTest-1069895698 tempest-VolumesActionsTest-1069895698-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e9:e7:83,bridge_name='br-int',has_traffic_filtering=True,id=e534dbaa-36f9-4cdf-86a1-78a17054ab8e,network=Network(17bb03f5-be7a-40ac-a446-bf0162682d12),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape534dbaa-36')
Nov 08 23:49:47 user nova-compute[75045]: INFO nova.virt.libvirt.driver [None req-39e89d4b-450e-4c43-be21-717b9a957db0 tempest-VolumesActionsTest-1069895698 tempest-VolumesActionsTest-1069895698-project-member] [instance: abb7206c-b2e2-4a5a-93a8-f7f16231cf26] Deleting instance files /opt/stack/data/nova/instances/abb7206c-b2e2-4a5a-93a8-f7f16231cf26_del
Nov 08 23:49:47 user nova-compute[75045]: INFO nova.virt.libvirt.driver [None req-39e89d4b-450e-4c43-be21-717b9a957db0 tempest-VolumesActionsTest-1069895698 tempest-VolumesActionsTest-1069895698-project-member] [instance: abb7206c-b2e2-4a5a-93a8-f7f16231cf26] Deletion of /opt/stack/data/nova/instances/abb7206c-b2e2-4a5a-93a8-f7f16231cf26_del complete
Nov 08 23:49:48 user nova-compute[75045]: INFO nova.compute.manager [None req-39e89d4b-450e-4c43-be21-717b9a957db0 tempest-VolumesActionsTest-1069895698 tempest-VolumesActionsTest-1069895698-project-member] [instance: abb7206c-b2e2-4a5a-93a8-f7f16231cf26] Took 1.00 seconds to destroy the instance on the hypervisor.
Nov 08 23:49:48 user nova-compute[75045]: DEBUG oslo.service.loopingcall [None req-39e89d4b-450e-4c43-be21-717b9a957db0 tempest-VolumesActionsTest-1069895698 tempest-VolumesActionsTest-1069895698-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75045) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 23:49:48 user nova-compute[75045]: DEBUG nova.compute.manager [-] [instance: abb7206c-b2e2-4a5a-93a8-f7f16231cf26] Deallocating network for instance {{(pid=75045) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 23:49:48 user nova-compute[75045]: DEBUG nova.network.neutron [-] [instance: abb7206c-b2e2-4a5a-93a8-f7f16231cf26] deallocate_for_instance() {{(pid=75045) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 23:49:48 user nova-compute[75045]: DEBUG nova.network.neutron [-] [instance: abb7206c-b2e2-4a5a-93a8-f7f16231cf26] Updating instance_info_cache with network_info: [] {{(pid=75045) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 23:49:48 user nova-compute[75045]: INFO nova.compute.manager [-] [instance: abb7206c-b2e2-4a5a-93a8-f7f16231cf26] Took 0.64 seconds to deallocate network for instance.
Nov 08 23:49:48 user nova-compute[75045]: DEBUG nova.compute.manager [req-60122095-54e4-4811-aaa4-49ae42d0e5de req-4a327077-d69a-4d64-9e84-0262179d930a service nova] [instance: abb7206c-b2e2-4a5a-93a8-f7f16231cf26] Received event network-vif-deleted-e534dbaa-36f9-4cdf-86a1-78a17054ab8e {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:49:48 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-39e89d4b-450e-4c43-be21-717b9a957db0 tempest-VolumesActionsTest-1069895698 tempest-VolumesActionsTest-1069895698-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:49:48 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-39e89d4b-450e-4c43-be21-717b9a957db0 tempest-VolumesActionsTest-1069895698 tempest-VolumesActionsTest-1069895698-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:49:48 user nova-compute[75045]: DEBUG nova.compute.provider_tree [None req-39e89d4b-450e-4c43-be21-717b9a957db0 tempest-VolumesActionsTest-1069895698 tempest-VolumesActionsTest-1069895698-project-member] Inventory has not changed in ProviderTree for provider: 62ba5f85-c74d-4b58-986e-d4197e813fd7 {{(pid=75045) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 23:49:48 user nova-compute[75045]: DEBUG nova.scheduler.client.report [None req-39e89d4b-450e-4c43-be21-717b9a957db0 tempest-VolumesActionsTest-1069895698 tempest-VolumesActionsTest-1069895698-project-member] Inventory has not changed for provider 62ba5f85-c74d-4b58-986e-d4197e813fd7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75045) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 23:49:48 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-39e89d4b-450e-4c43-be21-717b9a957db0 tempest-VolumesActionsTest-1069895698 tempest-VolumesActionsTest-1069895698-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.202s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:49:48 user nova-compute[75045]: INFO nova.scheduler.client.report [None req-39e89d4b-450e-4c43-be21-717b9a957db0 tempest-VolumesActionsTest-1069895698 tempest-VolumesActionsTest-1069895698-project-member] Deleted allocations for instance abb7206c-b2e2-4a5a-93a8-f7f16231cf26
Nov 08 23:49:49 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-39e89d4b-450e-4c43-be21-717b9a957db0 tempest-VolumesActionsTest-1069895698 tempest-VolumesActionsTest-1069895698-project-member] Lock "abb7206c-b2e2-4a5a-93a8-f7f16231cf26" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.092s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:49:49 user nova-compute[75045]: DEBUG nova.compute.manager [req-4ec5da0a-89dc-4041-8f22-8142602a25a1 req-69f5441e-1d1f-404b-a45c-2f86f7961015 service nova] [instance: abb7206c-b2e2-4a5a-93a8-f7f16231cf26] Received event network-vif-plugged-e534dbaa-36f9-4cdf-86a1-78a17054ab8e {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:49:49 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-4ec5da0a-89dc-4041-8f22-8142602a25a1 req-69f5441e-1d1f-404b-a45c-2f86f7961015 service nova] Acquiring lock "abb7206c-b2e2-4a5a-93a8-f7f16231cf26-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:49:49 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-4ec5da0a-89dc-4041-8f22-8142602a25a1 req-69f5441e-1d1f-404b-a45c-2f86f7961015 service nova] Lock "abb7206c-b2e2-4a5a-93a8-f7f16231cf26-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:49:49 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-4ec5da0a-89dc-4041-8f22-8142602a25a1 req-69f5441e-1d1f-404b-a45c-2f86f7961015 service nova] Lock "abb7206c-b2e2-4a5a-93a8-f7f16231cf26-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:49:49 user nova-compute[75045]: DEBUG nova.compute.manager [req-4ec5da0a-89dc-4041-8f22-8142602a25a1 req-69f5441e-1d1f-404b-a45c-2f86f7961015 service nova] [instance: abb7206c-b2e2-4a5a-93a8-f7f16231cf26] No waiting events found dispatching network-vif-plugged-e534dbaa-36f9-4cdf-86a1-78a17054ab8e {{(pid=75045) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 23:49:49 user nova-compute[75045]: WARNING nova.compute.manager [req-4ec5da0a-89dc-4041-8f22-8142602a25a1 req-69f5441e-1d1f-404b-a45c-2f86f7961015 service nova] [instance: abb7206c-b2e2-4a5a-93a8-f7f16231cf26] Received unexpected event network-vif-plugged-e534dbaa-36f9-4cdf-86a1-78a17054ab8e for instance with vm_state deleted and task_state None.
Nov 08 23:49:52 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:49:57 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:49:59 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:49:59 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:49:59 user nova-compute[75045]: DEBUG nova.compute.manager [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Starting heal instance info cache {{(pid=75045) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 23:49:59 user nova-compute[75045]: DEBUG nova.compute.manager [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Didn't find any instances for network info cache update. {{(pid=75045) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 08 23:49:59 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:49:59 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:49:59 user nova-compute[75045]: DEBUG nova.compute.manager [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75045) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 23:49:59 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-c669ac29-15d4-4180-a7a8-bfff359d44c0 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Acquiring lock "37502077-b02b-4f0c-b654-8a6cef607efa" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:49:59 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-c669ac29-15d4-4180-a7a8-bfff359d44c0 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Lock "37502077-b02b-4f0c-b654-8a6cef607efa" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:49:59 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-c669ac29-15d4-4180-a7a8-bfff359d44c0 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Acquiring lock "37502077-b02b-4f0c-b654-8a6cef607efa-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:49:59 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-c669ac29-15d4-4180-a7a8-bfff359d44c0 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Lock "37502077-b02b-4f0c-b654-8a6cef607efa-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:49:59 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-c669ac29-15d4-4180-a7a8-bfff359d44c0 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Lock "37502077-b02b-4f0c-b654-8a6cef607efa-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:49:59 user nova-compute[75045]: INFO nova.compute.manager [None req-c669ac29-15d4-4180-a7a8-bfff359d44c0 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] [instance: 37502077-b02b-4f0c-b654-8a6cef607efa] Terminating instance
Nov 08 23:49:59 user nova-compute[75045]: DEBUG nova.compute.manager [None req-c669ac29-15d4-4180-a7a8-bfff359d44c0 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] [instance: 37502077-b02b-4f0c-b654-8a6cef607efa] Start destroying the instance on the hypervisor. {{(pid=75045) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 23:49:59 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:49:59 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:49:59 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:49:59 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:49:59 user nova-compute[75045]: DEBUG nova.compute.manager [req-b7d8d4c8-fea3-4ed2-ac81-215c3d1a002b req-fccc19ba-8b6b-46c0-acf1-f521b235f68d service nova] [instance: 37502077-b02b-4f0c-b654-8a6cef607efa] Received event network-vif-unplugged-30508e27-33e7-40dd-b166-6486da0f0911 {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:49:59 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-b7d8d4c8-fea3-4ed2-ac81-215c3d1a002b req-fccc19ba-8b6b-46c0-acf1-f521b235f68d service nova] Acquiring lock "37502077-b02b-4f0c-b654-8a6cef607efa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:49:59 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-b7d8d4c8-fea3-4ed2-ac81-215c3d1a002b req-fccc19ba-8b6b-46c0-acf1-f521b235f68d service nova] Lock "37502077-b02b-4f0c-b654-8a6cef607efa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:49:59 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-b7d8d4c8-fea3-4ed2-ac81-215c3d1a002b req-fccc19ba-8b6b-46c0-acf1-f521b235f68d service nova] Lock "37502077-b02b-4f0c-b654-8a6cef607efa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:49:59 user nova-compute[75045]: DEBUG nova.compute.manager [req-b7d8d4c8-fea3-4ed2-ac81-215c3d1a002b req-fccc19ba-8b6b-46c0-acf1-f521b235f68d service nova] [instance: 37502077-b02b-4f0c-b654-8a6cef607efa] No waiting events found dispatching network-vif-unplugged-30508e27-33e7-40dd-b166-6486da0f0911 {{(pid=75045) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 23:49:59 user nova-compute[75045]: DEBUG nova.compute.manager [req-b7d8d4c8-fea3-4ed2-ac81-215c3d1a002b req-fccc19ba-8b6b-46c0-acf1-f521b235f68d service nova] [instance: 37502077-b02b-4f0c-b654-8a6cef607efa] Received event network-vif-unplugged-30508e27-33e7-40dd-b166-6486da0f0911 for instance with task_state deleting. {{(pid=75045) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 23:49:59 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:50:00 user nova-compute[75045]: INFO nova.virt.libvirt.driver [-] [instance: 37502077-b02b-4f0c-b654-8a6cef607efa] Instance destroyed successfully.
Nov 08 23:50:00 user nova-compute[75045]: DEBUG nova.objects.instance [None req-c669ac29-15d4-4180-a7a8-bfff359d44c0 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Lazy-loading 'resources' on Instance uuid 37502077-b02b-4f0c-b654-8a6cef607efa {{(pid=75045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 23:50:00 user nova-compute[75045]: DEBUG nova.virt.libvirt.vif [None req-c669ac29-15d4-4180-a7a8-bfff359d44c0 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T23:44:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-432636096',display_name='tempest-TestVolumeBootPattern-volume-backed-server-432636096',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-432636096',id=43,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKoDGJ+khbbYLLCYIFd7x7Qal7u4qSpybQqSr2M6pczmVCPlMok23C5m6NcCPsn1HshPot5QEhyZNOrON1L7S3RafUlVsJBSzkbwZFRkm/0WbpemKbWCvoxcxsPdAHyswA==',key_name='tempest-keypair-491363734',keypairs=<?>,launch_index=0,launched_at=2023-11-08T23:44:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d59b73851c79473a9c2cdc0a120dfee0',ramdisk_id='',reservation_id='r-y1ydxuc6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-650796844',owner_user_name='tempest-TestVolumeBootPattern-650796844-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T23:44:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='76c31c64d9594f9cbef7586fafb48721',uuid=37502077-b02b-4f0c-b654-8a6cef607efa,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "30508e27-33e7-40dd-b166-6486da0f0911", "address": "fa:16:3e:3d:90:bb", "network": {"id": "4205f899-9865-4c65-8b46-c9a533e9bb45", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-774780781-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.170", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d59b73851c79473a9c2cdc0a120dfee0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30508e27-33", "ovs_interfaceid": "30508e27-33e7-40dd-b166-6486da0f0911", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75045) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 23:50:00 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-c669ac29-15d4-4180-a7a8-bfff359d44c0 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Converting VIF {"id": "30508e27-33e7-40dd-b166-6486da0f0911", "address": "fa:16:3e:3d:90:bb", "network": {"id": "4205f899-9865-4c65-8b46-c9a533e9bb45", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-774780781-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.170", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d59b73851c79473a9c2cdc0a120dfee0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30508e27-33", "ovs_interfaceid": "30508e27-33e7-40dd-b166-6486da0f0911", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 23:50:00 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-c669ac29-15d4-4180-a7a8-bfff359d44c0 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3d:90:bb,bridge_name='br-int',has_traffic_filtering=True,id=30508e27-33e7-40dd-b166-6486da0f0911,network=Network(4205f899-9865-4c65-8b46-c9a533e9bb45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap30508e27-33') {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 23:50:00 user nova-compute[75045]: DEBUG os_vif [None req-c669ac29-15d4-4180-a7a8-bfff359d44c0 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:3d:90:bb,bridge_name='br-int',has_traffic_filtering=True,id=30508e27-33e7-40dd-b166-6486da0f0911,network=Network(4205f899-9865-4c65-8b46-c9a533e9bb45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap30508e27-33') {{(pid=75045) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 23:50:00 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:50:00 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap30508e27-33, bridge=br-int, if_exists=True) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:50:00 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:50:00 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 23:50:00 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:50:00 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:50:00 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=33e9682c-7505-4c2f-b38f-ba3772e4d9e9) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:50:00 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:50:00 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 23:50:00 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:50:00 user nova-compute[75045]: INFO os_vif [None req-c669ac29-15d4-4180-a7a8-bfff359d44c0 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:3d:90:bb,bridge_name='br-int',has_traffic_filtering=True,id=30508e27-33e7-40dd-b166-6486da0f0911,network=Network(4205f899-9865-4c65-8b46-c9a533e9bb45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap30508e27-33')
Nov 08 23:50:00 user nova-compute[75045]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c669ac29-15d4-4180-a7a8-bfff359d44c0 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] [instance: 37502077-b02b-4f0c-b654-8a6cef607efa] calling os-brick to detach iSCSI Volume {{(pid=75045) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 23:50:00 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-c669ac29-15d4-4180-a7a8-bfff359d44c0 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1b68210460>, {'target_iqn': 'iqn.2010-10.org.openstack:22e58281-41b7-4be2-ace8-0750aa5d18f8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'THBeGdMN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=75045) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 23:50:00 user nova-compute[75045]: WARNING os_brick.initiator.connectors.base [None req-c669ac29-15d4-4180-a7a8-bfff359d44c0 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 23:50:00 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-c669ac29-15d4-4180-a7a8-bfff359d44c0 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 23:50:00 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-c669ac29-15d4-4180-a7a8-bfff359d44c0 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 23:50:00 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:50:00 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:50:00 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4d55f2a-e608-4412-ac3c-c54e23a1fd59]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:22e58281-41b7-4be2-ace8-0750aa5d18f8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:50:00 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-c669ac29-15d4-4180-a7a8-bfff359d44c0 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 23:50:00 user nova-compute[75045]: No targets found.
Nov 08 23:50:00 user nova-compute[75045]: iSNS:
Nov 08 23:50:00 user nova-compute[75045]: No targets found.
Nov 08 23:50:00 user nova-compute[75045]: STATIC:
Nov 08 23:50:00 user nova-compute[75045]: Target: iqn.2010-10.org.openstack:22e58281-41b7-4be2-ace8-0750aa5d18f8
Nov 08 23:50:00 user nova-compute[75045]:         Portal: 172.16.0.220:3260,-1
Nov 08 23:50:00 user nova-compute[75045]:                 Iface Name: default
Nov 08 23:50:00 user nova-compute[75045]: FIRMWARE:
Nov 08 23:50:00 user nova-compute[75045]: No targets found.
Nov 08 23:50:00 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 23:50:00 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-c669ac29-15d4-4180-a7a8-bfff359d44c0 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 23:50:00 user nova-compute[75045]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 23:50:00 user nova-compute[75045]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75045) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 23:50:00 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-c669ac29-15d4-4180-a7a8-bfff359d44c0 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:22e58281-41b7-4be2-ace8-0750aa5d18f8', 0)] {{(pid=75045) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 23:50:00 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:50:00 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:50:00 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[dca51c9a-dc7e-428a-ac3b-b5a76d377d5c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:22e58281-41b7-4be2-ace8-0750aa5d18f8\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:50:00 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:50:00 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:50:00 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0fa9a0d-64fe-48d0-b285-b8a6ecec1b52]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22e58281-41b7-4be2-ace8-0750aa5d18f8 (non-flash)\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:50:00 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-c669ac29-15d4-4180-a7a8-bfff359d44c0 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22e58281-41b7-4be2-ace8-0750aa5d18f8 (non-flash)
Nov 08 23:50:00 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 23:50:00 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-c669ac29-15d4-4180-a7a8-bfff359d44c0 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22e58281-41b7-4be2-ace8-0750aa5d18f8 (non-flash)
Nov 08 23:50:00 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 23:50:00 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-c669ac29-15d4-4180-a7a8-bfff359d44c0 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1b485b0790>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:22e58281-41b7-4be2-ace8-0750aa5d18f8'): ({'sde'}, set())}) {{(pid=75045) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 23:50:00 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-c669ac29-15d4-4180-a7a8-bfff359d44c0 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Removing single pathed devices sde {{(pid=75045) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 23:50:00 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:50:00 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:50:00 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[36757826-1573-4b1c-a0cb-7c6ed9ee271c]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:50:00 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:50:00 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.017s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:50:00 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f1a7166-d16e-4838-9fa8-23c81d3a80f0]: (4, ('ok\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:50:00 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-c669ac29-15d4-4180-a7a8-bfff359d44c0 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Flushing IO for device /dev/sde {{(pid=75045) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 23:50:00 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:50:00 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.012s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:50:00 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[797e39d0-d000-4a7f-a505-48f2ae1cee42]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:50:00 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-c669ac29-15d4-4180-a7a8-bfff359d44c0 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75045) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 23:50:00 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:50:00 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.045s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:50:00 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[48b25a2b-7301-43c6-a469-cfbf67d63608]: (4, ('1', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:50:00 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-c669ac29-15d4-4180-a7a8-bfff359d44c0 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75045) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 23:50:00 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-c669ac29-15d4-4180-a7a8-bfff359d44c0 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] SCSI volumes sde have been removed. {{(pid=75045) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 23:50:00 user nova-compute[75045]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_89098a05', '/dev/disk/by-id/scsi-26362626633396337', '/dev/disk/by-id/scsi-1SCST_BIO89098a05-cbbf39c7f8172790') {{(pid=86132) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 08 23:50:00 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea976ac2-49d5-4afb-bf26-ee908298ffdb]: (4, None) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:50:00 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-c669ac29-15d4-4180-a7a8-bfff359d44c0 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:22e58281-41b7-4be2-ace8-0750aa5d18f8')] {{(pid=75045) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 23:50:00 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22e58281-41b7-4be2-ace8-0750aa5d18f8 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:50:00 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22e58281-41b7-4be2-ace8-0750aa5d18f8 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:50:00 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[66d912f4-0a15-4c01-a141-7b8c550da4cf]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:50:00 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-c669ac29-15d4-4180-a7a8-bfff359d44c0 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:50:00 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22e58281-41b7-4be2-ace8-0750aa5d18f8 -p 172.16.0.220:3260 --logout {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:50:00 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22e58281-41b7-4be2-ace8-0750aa5d18f8 -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:50:00 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[58df1ed8-c4c8-41d5-97b3-e900c649efca]: (4, ('Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:22e58281-41b7-4be2-ace8-0750aa5d18f8, portal: 172.16.0.220,3260]\nLogout of [sid: 44, target: iqn.2010-10.org.openstack:22e58281-41b7-4be2-ace8-0750aa5d18f8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:50:00 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-c669ac29-15d4-4180-a7a8-bfff359d44c0 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:22e58281-41b7-4be2-ace8-0750aa5d18f8, portal: 172.16.0.220,3260]
Nov 08 23:50:00 user nova-compute[75045]: Logout of [sid: 44, target: iqn.2010-10.org.openstack:22e58281-41b7-4be2-ace8-0750aa5d18f8, portal: 172.16.0.220,3260] successful.
Nov 08 23:50:00 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:50:00 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22e58281-41b7-4be2-ace8-0750aa5d18f8 -p 172.16.0.220:3260 --op delete {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:50:00 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22e58281-41b7-4be2-ace8-0750aa5d18f8 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:50:00 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[9de611f4-fc83-4c97-b880-55feec0b9411]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:50:00 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-c669ac29-15d4-4180-a7a8-bfff359d44c0 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:50:00 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-c669ac29-15d4-4180-a7a8-bfff359d44c0 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.302s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 23:50:00 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-c669ac29-15d4-4180-a7a8-bfff359d44c0 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] <== disconnect_volume: return (304ms) None {{(pid=75045) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 23:50:00 user nova-compute[75045]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c669ac29-15d4-4180-a7a8-bfff359d44c0 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] [instance: 37502077-b02b-4f0c-b654-8a6cef607efa] Disconnected iSCSI Volume {{(pid=75045) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 23:50:00 user nova-compute[75045]: INFO nova.virt.libvirt.driver [None req-c669ac29-15d4-4180-a7a8-bfff359d44c0 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] [instance: 37502077-b02b-4f0c-b654-8a6cef607efa] Deleting instance files /opt/stack/data/nova/instances/37502077-b02b-4f0c-b654-8a6cef607efa_del
Nov 08 23:50:00 user nova-compute[75045]: INFO nova.virt.libvirt.driver [None req-c669ac29-15d4-4180-a7a8-bfff359d44c0 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] [instance: 37502077-b02b-4f0c-b654-8a6cef607efa] Deletion of /opt/stack/data/nova/instances/37502077-b02b-4f0c-b654-8a6cef607efa_del complete
Nov 08 23:50:00 user nova-compute[75045]: INFO nova.compute.manager [None req-c669ac29-15d4-4180-a7a8-bfff359d44c0 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] [instance: 37502077-b02b-4f0c-b654-8a6cef607efa] Took 1.22 seconds to destroy the instance on the hypervisor.
Nov 08 23:50:00 user nova-compute[75045]: DEBUG oslo.service.loopingcall [None req-c669ac29-15d4-4180-a7a8-bfff359d44c0 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75045) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 23:50:00 user nova-compute[75045]: DEBUG nova.compute.manager [-] [instance: 37502077-b02b-4f0c-b654-8a6cef607efa] Deallocating network for instance {{(pid=75045) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 23:50:00 user nova-compute[75045]: DEBUG nova.network.neutron [-] [instance: 37502077-b02b-4f0c-b654-8a6cef607efa] deallocate_for_instance() {{(pid=75045) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 23:50:01 user nova-compute[75045]: DEBUG nova.network.neutron [-] [instance: 37502077-b02b-4f0c-b654-8a6cef607efa] Updating instance_info_cache with network_info: [] {{(pid=75045) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 23:50:01 user nova-compute[75045]: INFO nova.compute.manager [-] [instance: 37502077-b02b-4f0c-b654-8a6cef607efa] Took 0.82 seconds to deallocate network for instance.
Nov 08 23:50:01 user nova-compute[75045]: DEBUG nova.compute.manager [req-74da7d99-eb76-4ccd-b0c6-18aba4fdfe5d req-f9621705-68be-4918-af85-80df24eae63b service nova] [instance: 37502077-b02b-4f0c-b654-8a6cef607efa] Received event network-vif-plugged-30508e27-33e7-40dd-b166-6486da0f0911 {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:50:01 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-74da7d99-eb76-4ccd-b0c6-18aba4fdfe5d req-f9621705-68be-4918-af85-80df24eae63b service nova] Acquiring lock "37502077-b02b-4f0c-b654-8a6cef607efa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:50:01 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-74da7d99-eb76-4ccd-b0c6-18aba4fdfe5d req-f9621705-68be-4918-af85-80df24eae63b service nova] Lock "37502077-b02b-4f0c-b654-8a6cef607efa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:50:01 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-74da7d99-eb76-4ccd-b0c6-18aba4fdfe5d req-f9621705-68be-4918-af85-80df24eae63b service nova] Lock "37502077-b02b-4f0c-b654-8a6cef607efa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:50:01 user nova-compute[75045]: DEBUG nova.compute.manager [req-74da7d99-eb76-4ccd-b0c6-18aba4fdfe5d req-f9621705-68be-4918-af85-80df24eae63b service nova] [instance: 37502077-b02b-4f0c-b654-8a6cef607efa] No waiting events found dispatching network-vif-plugged-30508e27-33e7-40dd-b166-6486da0f0911 {{(pid=75045) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 23:50:01 user nova-compute[75045]: WARNING nova.compute.manager [req-74da7d99-eb76-4ccd-b0c6-18aba4fdfe5d req-f9621705-68be-4918-af85-80df24eae63b service nova] [instance: 37502077-b02b-4f0c-b654-8a6cef607efa] Received unexpected event network-vif-plugged-30508e27-33e7-40dd-b166-6486da0f0911 for instance with vm_state active and task_state deleting.
Nov 08 23:50:01 user nova-compute[75045]: DEBUG nova.compute.manager [req-74da7d99-eb76-4ccd-b0c6-18aba4fdfe5d req-f9621705-68be-4918-af85-80df24eae63b service nova] [instance: 37502077-b02b-4f0c-b654-8a6cef607efa] Received event network-vif-deleted-30508e27-33e7-40dd-b166-6486da0f0911 {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:50:02 user nova-compute[75045]: INFO nova.compute.manager [None req-c669ac29-15d4-4180-a7a8-bfff359d44c0 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] [instance: 37502077-b02b-4f0c-b654-8a6cef607efa] Took 0.97 seconds to detach 1 volumes for instance.
Nov 08 23:50:02 user nova-compute[75045]: DEBUG nova.compute.manager [None req-c669ac29-15d4-4180-a7a8-bfff359d44c0 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] [instance: 37502077-b02b-4f0c-b654-8a6cef607efa] Deleting volume: 22e58281-41b7-4be2-ace8-0750aa5d18f8 {{(pid=75045) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 08 23:50:02 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-c669ac29-15d4-4180-a7a8-bfff359d44c0 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:50:02 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-c669ac29-15d4-4180-a7a8-bfff359d44c0 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:50:02 user nova-compute[75045]: DEBUG nova.compute.provider_tree [None req-c669ac29-15d4-4180-a7a8-bfff359d44c0 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Inventory has not changed in ProviderTree for provider: 62ba5f85-c74d-4b58-986e-d4197e813fd7 {{(pid=75045) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 23:50:02 user nova-compute[75045]: DEBUG nova.scheduler.client.report [None req-c669ac29-15d4-4180-a7a8-bfff359d44c0 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Inventory has not changed for provider 62ba5f85-c74d-4b58-986e-d4197e813fd7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75045) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 23:50:02 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-c669ac29-15d4-4180-a7a8-bfff359d44c0 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.166s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:50:02 user nova-compute[75045]: INFO nova.scheduler.client.report [None req-c669ac29-15d4-4180-a7a8-bfff359d44c0 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Deleted allocations for instance 37502077-b02b-4f0c-b654-8a6cef607efa
Nov 08 23:50:02 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-c669ac29-15d4-4180-a7a8-bfff359d44c0 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Lock "37502077-b02b-4f0c-b654-8a6cef607efa" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.421s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:50:02 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:50:03 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:50:03 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:50:04 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-f0a01314-caea-4a29-9f95-183605872a03 tempest-VolumesNegativeTest-1756715703 tempest-VolumesNegativeTest-1756715703-project-member] Acquiring lock "354550b2-9cf4-4a7b-b3c9-c9f3b1a04dea" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:50:04 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-f0a01314-caea-4a29-9f95-183605872a03 tempest-VolumesNegativeTest-1756715703 tempest-VolumesNegativeTest-1756715703-project-member] Lock "354550b2-9cf4-4a7b-b3c9-c9f3b1a04dea" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:50:04 user nova-compute[75045]: DEBUG nova.compute.manager [None req-f0a01314-caea-4a29-9f95-183605872a03 tempest-VolumesNegativeTest-1756715703 tempest-VolumesNegativeTest-1756715703-project-member] [instance: 354550b2-9cf4-4a7b-b3c9-c9f3b1a04dea] Starting instance... {{(pid=75045) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 23:50:04 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-f0a01314-caea-4a29-9f95-183605872a03 tempest-VolumesNegativeTest-1756715703 tempest-VolumesNegativeTest-1756715703-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:50:04 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-f0a01314-caea-4a29-9f95-183605872a03 tempest-VolumesNegativeTest-1756715703 tempest-VolumesNegativeTest-1756715703-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:50:04 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-f0a01314-caea-4a29-9f95-183605872a03 tempest-VolumesNegativeTest-1756715703 tempest-VolumesNegativeTest-1756715703-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75045) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 23:50:04 user nova-compute[75045]: INFO nova.compute.claims [None req-f0a01314-caea-4a29-9f95-183605872a03 tempest-VolumesNegativeTest-1756715703 tempest-VolumesNegativeTest-1756715703-project-member] [instance: 354550b2-9cf4-4a7b-b3c9-c9f3b1a04dea] Claim successful on node user
Nov 08 23:50:04 user nova-compute[75045]: DEBUG nova.compute.provider_tree [None req-f0a01314-caea-4a29-9f95-183605872a03 tempest-VolumesNegativeTest-1756715703 tempest-VolumesNegativeTest-1756715703-project-member] Inventory has not changed in ProviderTree for provider: 62ba5f85-c74d-4b58-986e-d4197e813fd7 {{(pid=75045) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 23:50:04 user nova-compute[75045]: DEBUG nova.scheduler.client.report [None req-f0a01314-caea-4a29-9f95-183605872a03 tempest-VolumesNegativeTest-1756715703 tempest-VolumesNegativeTest-1756715703-project-member] Inventory has not changed for provider 62ba5f85-c74d-4b58-986e-d4197e813fd7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75045) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 23:50:04 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-f0a01314-caea-4a29-9f95-183605872a03 tempest-VolumesNegativeTest-1756715703 tempest-VolumesNegativeTest-1756715703-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.248s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:50:04 user nova-compute[75045]: DEBUG nova.compute.manager [None req-f0a01314-caea-4a29-9f95-183605872a03 tempest-VolumesNegativeTest-1756715703 tempest-VolumesNegativeTest-1756715703-project-member] [instance: 354550b2-9cf4-4a7b-b3c9-c9f3b1a04dea] Start building networks asynchronously for instance. {{(pid=75045) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 23:50:04 user nova-compute[75045]: DEBUG nova.compute.manager [None req-f0a01314-caea-4a29-9f95-183605872a03 tempest-VolumesNegativeTest-1756715703 tempest-VolumesNegativeTest-1756715703-project-member] [instance: 354550b2-9cf4-4a7b-b3c9-c9f3b1a04dea] Allocating IP information in the background. {{(pid=75045) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 23:50:04 user nova-compute[75045]: DEBUG nova.network.neutron [None req-f0a01314-caea-4a29-9f95-183605872a03 tempest-VolumesNegativeTest-1756715703 tempest-VolumesNegativeTest-1756715703-project-member] [instance: 354550b2-9cf4-4a7b-b3c9-c9f3b1a04dea] allocate_for_instance() {{(pid=75045) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 23:50:04 user nova-compute[75045]: INFO nova.virt.libvirt.driver [None req-f0a01314-caea-4a29-9f95-183605872a03 tempest-VolumesNegativeTest-1756715703 tempest-VolumesNegativeTest-1756715703-project-member] [instance: 354550b2-9cf4-4a7b-b3c9-c9f3b1a04dea] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 23:50:04 user nova-compute[75045]: DEBUG nova.compute.manager [None req-f0a01314-caea-4a29-9f95-183605872a03 tempest-VolumesNegativeTest-1756715703 tempest-VolumesNegativeTest-1756715703-project-member] [instance: 354550b2-9cf4-4a7b-b3c9-c9f3b1a04dea] Start building block device mappings for instance. {{(pid=75045) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 23:50:05 user nova-compute[75045]: DEBUG nova.compute.manager [None req-f0a01314-caea-4a29-9f95-183605872a03 tempest-VolumesNegativeTest-1756715703 tempest-VolumesNegativeTest-1756715703-project-member] [instance: 354550b2-9cf4-4a7b-b3c9-c9f3b1a04dea] Start spawning the instance on the hypervisor. {{(pid=75045) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 23:50:05 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-f0a01314-caea-4a29-9f95-183605872a03 tempest-VolumesNegativeTest-1756715703 tempest-VolumesNegativeTest-1756715703-project-member] [instance: 354550b2-9cf4-4a7b-b3c9-c9f3b1a04dea] Creating instance directory {{(pid=75045) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 23:50:05 user nova-compute[75045]: INFO nova.virt.libvirt.driver [None req-f0a01314-caea-4a29-9f95-183605872a03 tempest-VolumesNegativeTest-1756715703 tempest-VolumesNegativeTest-1756715703-project-member] [instance: 354550b2-9cf4-4a7b-b3c9-c9f3b1a04dea] Creating image(s)
Nov 08 23:50:05 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-f0a01314-caea-4a29-9f95-183605872a03 tempest-VolumesNegativeTest-1756715703 tempest-VolumesNegativeTest-1756715703-project-member] Acquiring lock "/opt/stack/data/nova/instances/354550b2-9cf4-4a7b-b3c9-c9f3b1a04dea/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:50:05 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-f0a01314-caea-4a29-9f95-183605872a03 tempest-VolumesNegativeTest-1756715703 tempest-VolumesNegativeTest-1756715703-project-member] Lock "/opt/stack/data/nova/instances/354550b2-9cf4-4a7b-b3c9-c9f3b1a04dea/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:50:05 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-f0a01314-caea-4a29-9f95-183605872a03 tempest-VolumesNegativeTest-1756715703 tempest-VolumesNegativeTest-1756715703-project-member] Lock "/opt/stack/data/nova/instances/354550b2-9cf4-4a7b-b3c9-c9f3b1a04dea/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:50:05 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-f0a01314-caea-4a29-9f95-183605872a03 tempest-VolumesNegativeTest-1756715703 tempest-VolumesNegativeTest-1756715703-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b59f52a99fff51c56dd1edfb83892fb8f647f2f3 --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:50:05 user nova-compute[75045]: DEBUG nova.policy [None req-f0a01314-caea-4a29-9f95-183605872a03 tempest-VolumesNegativeTest-1756715703 tempest-VolumesNegativeTest-1756715703-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a1249c15e72d4bee886afe49003c6e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30f84c7bf2484263b838d689595c8e31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75045) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 23:50:05 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-f0a01314-caea-4a29-9f95-183605872a03 tempest-VolumesNegativeTest-1756715703 tempest-VolumesNegativeTest-1756715703-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b59f52a99fff51c56dd1edfb83892fb8f647f2f3 --force-share --output=json" returned: 0 in 0.180s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:50:05 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-f0a01314-caea-4a29-9f95-183605872a03 tempest-VolumesNegativeTest-1756715703 tempest-VolumesNegativeTest-1756715703-project-member] Acquiring lock "b59f52a99fff51c56dd1edfb83892fb8f647f2f3" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:50:05 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-f0a01314-caea-4a29-9f95-183605872a03 tempest-VolumesNegativeTest-1756715703 tempest-VolumesNegativeTest-1756715703-project-member] Lock "b59f52a99fff51c56dd1edfb83892fb8f647f2f3" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:50:05 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-f0a01314-caea-4a29-9f95-183605872a03 tempest-VolumesNegativeTest-1756715703 tempest-VolumesNegativeTest-1756715703-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b59f52a99fff51c56dd1edfb83892fb8f647f2f3 --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:50:05 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:50:05 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-f0a01314-caea-4a29-9f95-183605872a03 tempest-VolumesNegativeTest-1756715703 tempest-VolumesNegativeTest-1756715703-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b59f52a99fff51c56dd1edfb83892fb8f647f2f3 --force-share --output=json" returned: 0 in 0.215s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:50:05 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-f0a01314-caea-4a29-9f95-183605872a03 tempest-VolumesNegativeTest-1756715703 tempest-VolumesNegativeTest-1756715703-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b59f52a99fff51c56dd1edfb83892fb8f647f2f3,backing_fmt=raw /opt/stack/data/nova/instances/354550b2-9cf4-4a7b-b3c9-c9f3b1a04dea/disk 1073741824 {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:50:05 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-f0a01314-caea-4a29-9f95-183605872a03 tempest-VolumesNegativeTest-1756715703 tempest-VolumesNegativeTest-1756715703-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b59f52a99fff51c56dd1edfb83892fb8f647f2f3,backing_fmt=raw /opt/stack/data/nova/instances/354550b2-9cf4-4a7b-b3c9-c9f3b1a04dea/disk 1073741824" returned: 0 in 0.058s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:50:05 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-f0a01314-caea-4a29-9f95-183605872a03 tempest-VolumesNegativeTest-1756715703 tempest-VolumesNegativeTest-1756715703-project-member] Lock "b59f52a99fff51c56dd1edfb83892fb8f647f2f3" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.280s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:50:05 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-f0a01314-caea-4a29-9f95-183605872a03 tempest-VolumesNegativeTest-1756715703 tempest-VolumesNegativeTest-1756715703-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b59f52a99fff51c56dd1edfb83892fb8f647f2f3 --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:50:05 user nova-compute[75045]: DEBUG nova.objects.instance [None req-c3ddfbc4-8289-44c4-aac6-d5c9ff7d9208 tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Lazy-loading 'flavor' on Instance uuid 0b413c71-c13a-4fea-91c4-f6b1953d54c6 {{(pid=75045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 23:50:05 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-f0a01314-caea-4a29-9f95-183605872a03 tempest-VolumesNegativeTest-1756715703 tempest-VolumesNegativeTest-1756715703-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b59f52a99fff51c56dd1edfb83892fb8f647f2f3 --force-share --output=json" returned: 0 in 0.184s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:50:05 user nova-compute[75045]: DEBUG nova.virt.disk.api [None req-f0a01314-caea-4a29-9f95-183605872a03 tempest-VolumesNegativeTest-1756715703 tempest-VolumesNegativeTest-1756715703-project-member] Checking if we can resize image /opt/stack/data/nova/instances/354550b2-9cf4-4a7b-b3c9-c9f3b1a04dea/disk. size=1073741824 {{(pid=75045) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 23:50:05 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-f0a01314-caea-4a29-9f95-183605872a03 tempest-VolumesNegativeTest-1756715703 tempest-VolumesNegativeTest-1756715703-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/354550b2-9cf4-4a7b-b3c9-c9f3b1a04dea/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:50:05 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-c3ddfbc4-8289-44c4-aac6-d5c9ff7d9208 tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Acquiring lock "refresh_cache-0b413c71-c13a-4fea-91c4-f6b1953d54c6" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 23:50:05 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-c3ddfbc4-8289-44c4-aac6-d5c9ff7d9208 tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Acquired lock "refresh_cache-0b413c71-c13a-4fea-91c4-f6b1953d54c6" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 23:50:05 user nova-compute[75045]: DEBUG nova.network.neutron [None req-c3ddfbc4-8289-44c4-aac6-d5c9ff7d9208 tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] [instance: 0b413c71-c13a-4fea-91c4-f6b1953d54c6] Building network info cache for instance {{(pid=75045) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 23:50:05 user nova-compute[75045]: DEBUG nova.objects.instance [None req-c3ddfbc4-8289-44c4-aac6-d5c9ff7d9208 tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Lazy-loading 'info_cache' on Instance uuid 0b413c71-c13a-4fea-91c4-f6b1953d54c6 {{(pid=75045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 23:50:05 user nova-compute[75045]: DEBUG nova.network.neutron [None req-f0a01314-caea-4a29-9f95-183605872a03 tempest-VolumesNegativeTest-1756715703 tempest-VolumesNegativeTest-1756715703-project-member] [instance: 354550b2-9cf4-4a7b-b3c9-c9f3b1a04dea] Successfully created port: 7667374b-3abb-4fc5-a3cf-8388f2947aa3 {{(pid=75045) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 23:50:05 user nova-compute[75045]: DEBUG nova.objects.base [None req-c3ddfbc4-8289-44c4-aac6-d5c9ff7d9208 tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Object Instance<0b413c71-c13a-4fea-91c4-f6b1953d54c6> lazy-loaded attributes: flavor,info_cache {{(pid=75045) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 23:50:05 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-f0a01314-caea-4a29-9f95-183605872a03 tempest-VolumesNegativeTest-1756715703 tempest-VolumesNegativeTest-1756715703-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/354550b2-9cf4-4a7b-b3c9-c9f3b1a04dea/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:50:05 user nova-compute[75045]: DEBUG nova.virt.disk.api [None req-f0a01314-caea-4a29-9f95-183605872a03 tempest-VolumesNegativeTest-1756715703 tempest-VolumesNegativeTest-1756715703-project-member] Cannot resize image /opt/stack/data/nova/instances/354550b2-9cf4-4a7b-b3c9-c9f3b1a04dea/disk to a smaller size. {{(pid=75045) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 08 23:50:05 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-f0a01314-caea-4a29-9f95-183605872a03 tempest-VolumesNegativeTest-1756715703 tempest-VolumesNegativeTest-1756715703-project-member] [instance: 354550b2-9cf4-4a7b-b3c9-c9f3b1a04dea] Created local disks {{(pid=75045) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 23:50:05 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-f0a01314-caea-4a29-9f95-183605872a03 tempest-VolumesNegativeTest-1756715703 tempest-VolumesNegativeTest-1756715703-project-member] [instance: 354550b2-9cf4-4a7b-b3c9-c9f3b1a04dea] Ensure instance console log exists: /opt/stack/data/nova/instances/354550b2-9cf4-4a7b-b3c9-c9f3b1a04dea/console.log {{(pid=75045) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 23:50:05 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-f0a01314-caea-4a29-9f95-183605872a03 tempest-VolumesNegativeTest-1756715703 tempest-VolumesNegativeTest-1756715703-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:50:05 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-f0a01314-caea-4a29-9f95-183605872a03 tempest-VolumesNegativeTest-1756715703 tempest-VolumesNegativeTest-1756715703-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:50:05 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-f0a01314-caea-4a29-9f95-183605872a03 tempest-VolumesNegativeTest-1756715703 tempest-VolumesNegativeTest-1756715703-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:50:06 user nova-compute[75045]: DEBUG nova.network.neutron [None req-c3ddfbc4-8289-44c4-aac6-d5c9ff7d9208 tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] [instance: 0b413c71-c13a-4fea-91c4-f6b1953d54c6] Updating instance_info_cache with network_info: [{"id": "166cceb4-9b95-4bdd-a3ad-b6aad94dfed0", "address": "fa:16:3e:17:84:3d", "network": {"id": "e31c3d41-e46f-4c74-8ef5-8243a391dde8", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-856540424-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.149", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c8be85d72bc440899f3ccb64b923e90e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap166cceb4-9b", "ovs_interfaceid": "166cceb4-9b95-4bdd-a3ad-b6aad94dfed0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75045) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 23:50:06 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-c3ddfbc4-8289-44c4-aac6-d5c9ff7d9208 tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Releasing lock "refresh_cache-0b413c71-c13a-4fea-91c4-f6b1953d54c6" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 23:50:06 user nova-compute[75045]: INFO nova.virt.libvirt.driver [-] [instance: 0b413c71-c13a-4fea-91c4-f6b1953d54c6] Instance destroyed successfully.
Nov 08 23:50:06 user nova-compute[75045]: DEBUG nova.objects.instance [None req-c3ddfbc4-8289-44c4-aac6-d5c9ff7d9208 tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Lazy-loading 'resources' on Instance uuid 0b413c71-c13a-4fea-91c4-f6b1953d54c6 {{(pid=75045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 23:50:06 user nova-compute[75045]: DEBUG nova.objects.base [None req-c3ddfbc4-8289-44c4-aac6-d5c9ff7d9208 tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Object Instance<0b413c71-c13a-4fea-91c4-f6b1953d54c6> lazy-loaded attributes: flavor,info_cache,resources {{(pid=75045) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 23:50:06 user nova-compute[75045]: DEBUG nova.virt.libvirt.vif [None req-c3ddfbc4-8289-44c4-aac6-d5c9ff7d9208 tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T23:41:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1115991455',display_name='tempest-AttachVolumeTestJSON-server-1115991455',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1115991455',id=42,image_ref='a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDP62TKuY3xQeSwtOVfapZleQ+Udsdwyg62rL9eK489WlMG5ccA/qQJy7H2wra4KXAElLeGxPHWcXNl9vwyU6pMJ292WwpOYwEUeIcXde3ufxVUWLY5U6GVW+3+zkZGZTw==',key_name='tempest-keypair-777988029',keypairs=<?>,launch_index=0,launched_at=2023-11-08T23:41:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='c8be85d72bc440899f3ccb64b923e90e',ramdisk_id='',reservation_id='r-m3eq8ay7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1852573580',owner_user_name='tempest-AttachVolumeTestJSON-1852573580-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T23:48:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1e3647ad15a24f1584685f9340eae5bd',uuid=0b413c71-c13a-4fea-91c4-f6b1953d54c6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "166cceb4-9b95-4bdd-a3ad-b6aad94dfed0", "address": "fa:16:3e:17:84:3d", "network": {"id": "e31c3d41-e46f-4c74-8ef5-8243a391dde8", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-856540424-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.149", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c8be85d72bc440899f3ccb64b923e90e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap166cceb4-9b", "ovs_interfaceid": "166cceb4-9b95-4bdd-a3ad-b6aad94dfed0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75045) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 23:50:06 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-c3ddfbc4-8289-44c4-aac6-d5c9ff7d9208 tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Converting VIF {"id": "166cceb4-9b95-4bdd-a3ad-b6aad94dfed0", "address": "fa:16:3e:17:84:3d", "network": {"id": "e31c3d41-e46f-4c74-8ef5-8243a391dde8", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-856540424-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.149", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c8be85d72bc440899f3ccb64b923e90e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap166cceb4-9b", "ovs_interfaceid": "166cceb4-9b95-4bdd-a3ad-b6aad94dfed0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 23:50:06 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-c3ddfbc4-8289-44c4-aac6-d5c9ff7d9208 tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:17:84:3d,bridge_name='br-int',has_traffic_filtering=True,id=166cceb4-9b95-4bdd-a3ad-b6aad94dfed0,network=Network(e31c3d41-e46f-4c74-8ef5-8243a391dde8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap166cceb4-9b') {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 23:50:06 user nova-compute[75045]: DEBUG os_vif [None req-c3ddfbc4-8289-44c4-aac6-d5c9ff7d9208 tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:17:84:3d,bridge_name='br-int',has_traffic_filtering=True,id=166cceb4-9b95-4bdd-a3ad-b6aad94dfed0,network=Network(e31c3d41-e46f-4c74-8ef5-8243a391dde8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap166cceb4-9b') {{(pid=75045) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 23:50:06 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:50:06 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap166cceb4-9b, bridge=br-int, if_exists=True) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:50:06 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:50:06 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 23:50:06 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:50:06 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f84a1c57-1d2d-4c5f-9d96-f95673b46195) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:50:06 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:50:06 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 23:50:06 user nova-compute[75045]: INFO os_vif [None req-c3ddfbc4-8289-44c4-aac6-d5c9ff7d9208 tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:17:84:3d,bridge_name='br-int',has_traffic_filtering=True,id=166cceb4-9b95-4bdd-a3ad-b6aad94dfed0,network=Network(e31c3d41-e46f-4c74-8ef5-8243a391dde8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap166cceb4-9b')
Nov 08 23:50:06 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-c3ddfbc4-8289-44c4-aac6-d5c9ff7d9208 tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] [instance: 0b413c71-c13a-4fea-91c4-f6b1953d54c6] Start _get_guest_xml network_info=[{"id": "166cceb4-9b95-4bdd-a3ad-b6aad94dfed0", "address": "fa:16:3e:17:84:3d", "network": {"id": "e31c3d41-e46f-4c74-8ef5-8243a391dde8", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-856540424-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.149", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c8be85d72bc440899f3ccb64b923e90e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap166cceb4-9b", "ovs_interfaceid": "166cceb4-9b95-4bdd-a3ad-b6aad94dfed0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'disk_bus': 'virtio', 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': 'a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75045) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 23:50:06 user nova-compute[75045]: DEBUG nova.objects.instance [None req-c3ddfbc4-8289-44c4-aac6-d5c9ff7d9208 tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Lazy-loading 'numa_topology' on Instance uuid 0b413c71-c13a-4fea-91c4-f6b1953d54c6 {{(pid=75045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 23:50:06 user nova-compute[75045]: DEBUG nova.objects.base [None req-c3ddfbc4-8289-44c4-aac6-d5c9ff7d9208 tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Object Instance<0b413c71-c13a-4fea-91c4-f6b1953d54c6> lazy-loaded attributes: flavor,info_cache,resources,numa_topology {{(pid=75045) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 23:50:06 user nova-compute[75045]: WARNING nova.virt.libvirt.driver [None req-c3ddfbc4-8289-44c4-aac6-d5c9ff7d9208 tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 23:50:06 user nova-compute[75045]: WARNING nova.virt.libvirt.driver [None req-c3ddfbc4-8289-44c4-aac6-d5c9ff7d9208 tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 23:50:06 user nova-compute[75045]: DEBUG nova.virt.libvirt.host [None req-c3ddfbc4-8289-44c4-aac6-d5c9ff7d9208 tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75045) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 23:50:06 user nova-compute[75045]: DEBUG nova.virt.libvirt.host [None req-c3ddfbc4-8289-44c4-aac6-d5c9ff7d9208 tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] CPU controller missing on host. {{(pid=75045) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 23:50:06 user nova-compute[75045]: DEBUG nova.virt.libvirt.host [None req-c3ddfbc4-8289-44c4-aac6-d5c9ff7d9208 tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75045) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 23:50:06 user nova-compute[75045]: DEBUG nova.virt.libvirt.host [None req-c3ddfbc4-8289-44c4-aac6-d5c9ff7d9208 tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] CPU controller found on host. {{(pid=75045) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 23:50:06 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-c3ddfbc4-8289-44c4-aac6-d5c9ff7d9208 tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75045) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 23:50:06 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-c3ddfbc4-8289-44c4-aac6-d5c9ff7d9208 tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T23:11:41Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75045) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 23:50:06 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-c3ddfbc4-8289-44c4-aac6-d5c9ff7d9208 tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Flavor limits 0:0:0 {{(pid=75045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 23:50:06 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-c3ddfbc4-8289-44c4-aac6-d5c9ff7d9208 tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Image limits 0:0:0 {{(pid=75045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 23:50:06 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-c3ddfbc4-8289-44c4-aac6-d5c9ff7d9208 tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Flavor pref 0:0:0 {{(pid=75045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 23:50:06 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-c3ddfbc4-8289-44c4-aac6-d5c9ff7d9208 tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Image pref 0:0:0 {{(pid=75045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 23:50:06 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-c3ddfbc4-8289-44c4-aac6-d5c9ff7d9208 tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 23:50:06 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-c3ddfbc4-8289-44c4-aac6-d5c9ff7d9208 tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75045) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 23:50:06 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-c3ddfbc4-8289-44c4-aac6-d5c9ff7d9208 tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75045) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 23:50:06 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-c3ddfbc4-8289-44c4-aac6-d5c9ff7d9208 tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Got 1 possible topologies {{(pid=75045) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 23:50:06 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-c3ddfbc4-8289-44c4-aac6-d5c9ff7d9208 tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75045) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 23:50:06 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-c3ddfbc4-8289-44c4-aac6-d5c9ff7d9208 tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75045) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 23:50:06 user nova-compute[75045]: DEBUG nova.objects.instance [None req-c3ddfbc4-8289-44c4-aac6-d5c9ff7d9208 tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Lazy-loading 'vcpu_model' on Instance uuid 0b413c71-c13a-4fea-91c4-f6b1953d54c6 {{(pid=75045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 23:50:06 user nova-compute[75045]: DEBUG nova.objects.base [None req-c3ddfbc4-8289-44c4-aac6-d5c9ff7d9208 tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Object Instance<0b413c71-c13a-4fea-91c4-f6b1953d54c6> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model {{(pid=75045) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 23:50:06 user nova-compute[75045]: DEBUG nova.virt.libvirt.vif [None req-c3ddfbc4-8289-44c4-aac6-d5c9ff7d9208 tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T23:41:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1115991455',display_name='tempest-AttachVolumeTestJSON-server-1115991455',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1115991455',id=42,image_ref='a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDP62TKuY3xQeSwtOVfapZleQ+Udsdwyg62rL9eK489WlMG5ccA/qQJy7H2wra4KXAElLeGxPHWcXNl9vwyU6pMJ292WwpOYwEUeIcXde3ufxVUWLY5U6GVW+3+zkZGZTw==',key_name='tempest-keypair-777988029',keypairs=<?>,launch_index=0,launched_at=2023-11-08T23:41:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='c8be85d72bc440899f3ccb64b923e90e',ramdisk_id='',reservation_id='r-m3eq8ay7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1852573580',owner_user_name='tempest-AttachVolumeTestJSON-1852573580-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T23:48:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1e3647ad15a24f1584685f9340eae5bd',uuid=0b413c71-c13a-4fea-91c4-f6b1953d54c6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "166cceb4-9b95-4bdd-a3ad-b6aad94dfed0", "address": "fa:16:3e:17:84:3d", "network": {"id": "e31c3d41-e46f-4c74-8ef5-8243a391dde8", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-856540424-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.149", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c8be85d72bc440899f3ccb64b923e90e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap166cceb4-9b", "ovs_interfaceid": "166cceb4-9b95-4bdd-a3ad-b6aad94dfed0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75045) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 23:50:06 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-c3ddfbc4-8289-44c4-aac6-d5c9ff7d9208 tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Converting VIF {"id": "166cceb4-9b95-4bdd-a3ad-b6aad94dfed0", "address": "fa:16:3e:17:84:3d", "network": {"id": "e31c3d41-e46f-4c74-8ef5-8243a391dde8", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-856540424-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.149", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c8be85d72bc440899f3ccb64b923e90e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap166cceb4-9b", "ovs_interfaceid": "166cceb4-9b95-4bdd-a3ad-b6aad94dfed0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 23:50:06 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-c3ddfbc4-8289-44c4-aac6-d5c9ff7d9208 tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:17:84:3d,bridge_name='br-int',has_traffic_filtering=True,id=166cceb4-9b95-4bdd-a3ad-b6aad94dfed0,network=Network(e31c3d41-e46f-4c74-8ef5-8243a391dde8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap166cceb4-9b') {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 23:50:06 user nova-compute[75045]: DEBUG nova.objects.instance [None req-c3ddfbc4-8289-44c4-aac6-d5c9ff7d9208 tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Lazy-loading 'pci_devices' on Instance uuid 0b413c71-c13a-4fea-91c4-f6b1953d54c6 {{(pid=75045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 23:50:06 user nova-compute[75045]: DEBUG nova.network.neutron [None req-f0a01314-caea-4a29-9f95-183605872a03 tempest-VolumesNegativeTest-1756715703 tempest-VolumesNegativeTest-1756715703-project-member] [instance: 354550b2-9cf4-4a7b-b3c9-c9f3b1a04dea] Successfully updated port: 7667374b-3abb-4fc5-a3cf-8388f2947aa3 {{(pid=75045) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 23:50:06 user nova-compute[75045]: DEBUG nova.objects.base [None req-c3ddfbc4-8289-44c4-aac6-d5c9ff7d9208 tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Object Instance<0b413c71-c13a-4fea-91c4-f6b1953d54c6> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices {{(pid=75045) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 23:50:06 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-c3ddfbc4-8289-44c4-aac6-d5c9ff7d9208 tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] [instance: 0b413c71-c13a-4fea-91c4-f6b1953d54c6] End _get_guest_xml xml=<domain type="kvm">
Nov 08 23:50:06 user nova-compute[75045]:   <uuid>0b413c71-c13a-4fea-91c4-f6b1953d54c6</uuid>
Nov 08 23:50:06 user nova-compute[75045]:   <name>instance-0000002a</name>
Nov 08 23:50:06 user nova-compute[75045]:   <memory>524288</memory>
Nov 08 23:50:06 user nova-compute[75045]:   <vcpu>1</vcpu>
Nov 08 23:50:06 user nova-compute[75045]:   <metadata>
Nov 08 23:50:06 user nova-compute[75045]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 23:50:06 user nova-compute[75045]:       <nova:package version="0.0.0"/>
Nov 08 23:50:06 user nova-compute[75045]:       <nova:name>tempest-AttachVolumeTestJSON-server-1115991455</nova:name>
Nov 08 23:50:06 user nova-compute[75045]:       <nova:creationTime>2023-11-08 23:50:06</nova:creationTime>
Nov 08 23:50:06 user nova-compute[75045]:       <nova:flavor name="m1.tiny">
Nov 08 23:50:06 user nova-compute[75045]:         <nova:memory>512</nova:memory>
Nov 08 23:50:06 user nova-compute[75045]:         <nova:disk>1</nova:disk>
Nov 08 23:50:06 user nova-compute[75045]:         <nova:swap>0</nova:swap>
Nov 08 23:50:06 user nova-compute[75045]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 23:50:06 user nova-compute[75045]:         <nova:vcpus>1</nova:vcpus>
Nov 08 23:50:06 user nova-compute[75045]:       </nova:flavor>
Nov 08 23:50:06 user nova-compute[75045]:       <nova:owner>
Nov 08 23:50:06 user nova-compute[75045]:         <nova:user uuid="1e3647ad15a24f1584685f9340eae5bd">tempest-AttachVolumeTestJSON-1852573580-project-member</nova:user>
Nov 08 23:50:06 user nova-compute[75045]:         <nova:project uuid="c8be85d72bc440899f3ccb64b923e90e">tempest-AttachVolumeTestJSON-1852573580</nova:project>
Nov 08 23:50:06 user nova-compute[75045]:       </nova:owner>
Nov 08 23:50:06 user nova-compute[75045]:       <nova:root type="image" uuid="a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb"/>
Nov 08 23:50:06 user nova-compute[75045]:       <nova:ports>
Nov 08 23:50:06 user nova-compute[75045]:         <nova:port uuid="166cceb4-9b95-4bdd-a3ad-b6aad94dfed0">
Nov 08 23:50:06 user nova-compute[75045]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 08 23:50:06 user nova-compute[75045]:         </nova:port>
Nov 08 23:50:06 user nova-compute[75045]:       </nova:ports>
Nov 08 23:50:06 user nova-compute[75045]:     </nova:instance>
Nov 08 23:50:06 user nova-compute[75045]:   </metadata>
Nov 08 23:50:06 user nova-compute[75045]:   <sysinfo type="smbios">
Nov 08 23:50:06 user nova-compute[75045]:     <system>
Nov 08 23:50:06 user nova-compute[75045]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 23:50:06 user nova-compute[75045]:       <entry name="product">OpenStack Nova</entry>
Nov 08 23:50:06 user nova-compute[75045]:       <entry name="version">0.0.0</entry>
Nov 08 23:50:06 user nova-compute[75045]:       <entry name="serial">0b413c71-c13a-4fea-91c4-f6b1953d54c6</entry>
Nov 08 23:50:06 user nova-compute[75045]:       <entry name="uuid">0b413c71-c13a-4fea-91c4-f6b1953d54c6</entry>
Nov 08 23:50:06 user nova-compute[75045]:       <entry name="family">Virtual Machine</entry>
Nov 08 23:50:06 user nova-compute[75045]:     </system>
Nov 08 23:50:06 user nova-compute[75045]:   </sysinfo>
Nov 08 23:50:06 user nova-compute[75045]:   <os>
Nov 08 23:50:06 user nova-compute[75045]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 23:50:06 user nova-compute[75045]:     <boot dev="hd"/>
Nov 08 23:50:06 user nova-compute[75045]:     <smbios mode="sysinfo"/>
Nov 08 23:50:06 user nova-compute[75045]:   </os>
Nov 08 23:50:06 user nova-compute[75045]:   <features>
Nov 08 23:50:06 user nova-compute[75045]:     <acpi/>
Nov 08 23:50:06 user nova-compute[75045]:     <apic/>
Nov 08 23:50:06 user nova-compute[75045]:     <vmcoreinfo/>
Nov 08 23:50:06 user nova-compute[75045]:   </features>
Nov 08 23:50:06 user nova-compute[75045]:   <clock offset="utc">
Nov 08 23:50:06 user nova-compute[75045]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 23:50:06 user nova-compute[75045]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 23:50:06 user nova-compute[75045]:     <timer name="hpet" present="no"/>
Nov 08 23:50:06 user nova-compute[75045]:   </clock>
Nov 08 23:50:06 user nova-compute[75045]:   <cpu mode="custom" match="exact">
Nov 08 23:50:06 user nova-compute[75045]:     <model>Nehalem</model>
Nov 08 23:50:06 user nova-compute[75045]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 23:50:06 user nova-compute[75045]:   </cpu>
Nov 08 23:50:06 user nova-compute[75045]:   <devices>
Nov 08 23:50:06 user nova-compute[75045]:     <disk type="file" device="disk">
Nov 08 23:50:06 user nova-compute[75045]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 23:50:06 user nova-compute[75045]:       <source file="/opt/stack/data/nova/instances/0b413c71-c13a-4fea-91c4-f6b1953d54c6/disk"/>
Nov 08 23:50:06 user nova-compute[75045]:       <target dev="vda" bus="virtio"/>
Nov 08 23:50:06 user nova-compute[75045]:     </disk>
Nov 08 23:50:06 user nova-compute[75045]:     <interface type="ethernet">
Nov 08 23:50:06 user nova-compute[75045]:       <mac address="fa:16:3e:17:84:3d"/>
Nov 08 23:50:06 user nova-compute[75045]:       <model type="virtio"/>
Nov 08 23:50:06 user nova-compute[75045]:       <mtu size="1442"/>
Nov 08 23:50:06 user nova-compute[75045]:       <target dev="tap166cceb4-9b"/>
Nov 08 23:50:06 user nova-compute[75045]:     </interface>
Nov 08 23:50:06 user nova-compute[75045]:     <serial type="pty">
Nov 08 23:50:06 user nova-compute[75045]:       <log file="/opt/stack/data/nova/instances/0b413c71-c13a-4fea-91c4-f6b1953d54c6/console.log" append="off"/>
Nov 08 23:50:06 user nova-compute[75045]:     </serial>
Nov 08 23:50:06 user nova-compute[75045]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 23:50:06 user nova-compute[75045]:     <video>
Nov 08 23:50:06 user nova-compute[75045]:       <model type="virtio"/>
Nov 08 23:50:06 user nova-compute[75045]:     </video>
Nov 08 23:50:06 user nova-compute[75045]:     <rng model="virtio">
Nov 08 23:50:06 user nova-compute[75045]:       <backend model="random">/dev/urandom</backend>
Nov 08 23:50:06 user nova-compute[75045]:     </rng>
Nov 08 23:50:06 user nova-compute[75045]:     <controller type="usb" index="0" model="none"/>
Nov 08 23:50:06 user nova-compute[75045]:     <memballoon model="virtio">
Nov 08 23:50:06 user nova-compute[75045]:       <stats period="10"/>
Nov 08 23:50:06 user nova-compute[75045]:     </memballoon>
Nov 08 23:50:06 user nova-compute[75045]:   </devices>
Nov 08 23:50:06 user nova-compute[75045]: </domain>
Nov 08 23:50:06 user nova-compute[75045]:  {{(pid=75045) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 23:50:06 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-c3ddfbc4-8289-44c4-aac6-d5c9ff7d9208 tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b413c71-c13a-4fea-91c4-f6b1953d54c6/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:50:06 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-f0a01314-caea-4a29-9f95-183605872a03 tempest-VolumesNegativeTest-1756715703 tempest-VolumesNegativeTest-1756715703-project-member] Acquiring lock "refresh_cache-354550b2-9cf4-4a7b-b3c9-c9f3b1a04dea" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 23:50:06 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-f0a01314-caea-4a29-9f95-183605872a03 tempest-VolumesNegativeTest-1756715703 tempest-VolumesNegativeTest-1756715703-project-member] Acquired lock "refresh_cache-354550b2-9cf4-4a7b-b3c9-c9f3b1a04dea" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 23:50:06 user nova-compute[75045]: DEBUG nova.network.neutron [None req-f0a01314-caea-4a29-9f95-183605872a03 tempest-VolumesNegativeTest-1756715703 tempest-VolumesNegativeTest-1756715703-project-member] [instance: 354550b2-9cf4-4a7b-b3c9-c9f3b1a04dea] Building network info cache for instance {{(pid=75045) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 23:50:06 user nova-compute[75045]: DEBUG nova.compute.manager [req-2d7b7cf7-7c07-4d1b-8564-97b034d41973 req-4a76f0be-edef-4dc6-b97e-679920ea94bc service nova] [instance: 354550b2-9cf4-4a7b-b3c9-c9f3b1a04dea] Received event network-changed-7667374b-3abb-4fc5-a3cf-8388f2947aa3 {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:50:06 user nova-compute[75045]: DEBUG nova.compute.manager [req-2d7b7cf7-7c07-4d1b-8564-97b034d41973 req-4a76f0be-edef-4dc6-b97e-679920ea94bc service nova] [instance: 354550b2-9cf4-4a7b-b3c9-c9f3b1a04dea] Refreshing instance network info cache due to event network-changed-7667374b-3abb-4fc5-a3cf-8388f2947aa3. {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 23:50:06 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-2d7b7cf7-7c07-4d1b-8564-97b034d41973 req-4a76f0be-edef-4dc6-b97e-679920ea94bc service nova] Acquiring lock "refresh_cache-354550b2-9cf4-4a7b-b3c9-c9f3b1a04dea" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 23:50:06 user nova-compute[75045]: DEBUG nova.network.neutron [None req-f0a01314-caea-4a29-9f95-183605872a03 tempest-VolumesNegativeTest-1756715703 tempest-VolumesNegativeTest-1756715703-project-member] [instance: 354550b2-9cf4-4a7b-b3c9-c9f3b1a04dea] Instance cache missing network info. {{(pid=75045) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 23:50:06 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-c3ddfbc4-8289-44c4-aac6-d5c9ff7d9208 tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b413c71-c13a-4fea-91c4-f6b1953d54c6/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:50:06 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-c3ddfbc4-8289-44c4-aac6-d5c9ff7d9208 tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b413c71-c13a-4fea-91c4-f6b1953d54c6/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:50:06 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-c3ddfbc4-8289-44c4-aac6-d5c9ff7d9208 tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b413c71-c13a-4fea-91c4-f6b1953d54c6/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:50:06 user nova-compute[75045]: DEBUG nova.objects.instance [None req-c3ddfbc4-8289-44c4-aac6-d5c9ff7d9208 tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Lazy-loading 'trusted_certs' on Instance uuid 0b413c71-c13a-4fea-91c4-f6b1953d54c6 {{(pid=75045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 23:50:06 user nova-compute[75045]: DEBUG nova.objects.base [None req-c3ddfbc4-8289-44c4-aac6-d5c9ff7d9208 tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Object Instance<0b413c71-c13a-4fea-91c4-f6b1953d54c6> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs {{(pid=75045) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 23:50:06 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-c3ddfbc4-8289-44c4-aac6-d5c9ff7d9208 tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b59f52a99fff51c56dd1edfb83892fb8f647f2f3 --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:50:06 user nova-compute[75045]: DEBUG nova.network.neutron [None req-f0a01314-caea-4a29-9f95-183605872a03 tempest-VolumesNegativeTest-1756715703 tempest-VolumesNegativeTest-1756715703-project-member] [instance: 354550b2-9cf4-4a7b-b3c9-c9f3b1a04dea] Updating instance_info_cache with network_info: [{"id": "7667374b-3abb-4fc5-a3cf-8388f2947aa3", "address": "fa:16:3e:25:7e:8e", "network": {"id": "deecb7cd-355d-4c73-93a8-b9251ab6d74e", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.19", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "b1beba2cc4e7465ea249e2225fb494dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7667374b-3a", "ovs_interfaceid": "7667374b-3abb-4fc5-a3cf-8388f2947aa3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75045) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 23:50:06 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager.update_available_resource {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:50:06 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-f0a01314-caea-4a29-9f95-183605872a03 tempest-VolumesNegativeTest-1756715703 tempest-VolumesNegativeTest-1756715703-project-member] Releasing lock "refresh_cache-354550b2-9cf4-4a7b-b3c9-c9f3b1a04dea" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 23:50:06 user nova-compute[75045]: DEBUG nova.compute.manager [None req-f0a01314-caea-4a29-9f95-183605872a03 tempest-VolumesNegativeTest-1756715703 tempest-VolumesNegativeTest-1756715703-project-member] [instance: 354550b2-9cf4-4a7b-b3c9-c9f3b1a04dea] Instance network_info: |[{"id": "7667374b-3abb-4fc5-a3cf-8388f2947aa3", "address": "fa:16:3e:25:7e:8e", "network": {"id": "deecb7cd-355d-4c73-93a8-b9251ab6d74e", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.19", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "b1beba2cc4e7465ea249e2225fb494dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7667374b-3a", "ovs_interfaceid": "7667374b-3abb-4fc5-a3cf-8388f2947aa3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75045) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 23:50:06 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-2d7b7cf7-7c07-4d1b-8564-97b034d41973 req-4a76f0be-edef-4dc6-b97e-679920ea94bc service nova] Acquired lock "refresh_cache-354550b2-9cf4-4a7b-b3c9-c9f3b1a04dea" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 23:50:06 user nova-compute[75045]: DEBUG nova.network.neutron [req-2d7b7cf7-7c07-4d1b-8564-97b034d41973 req-4a76f0be-edef-4dc6-b97e-679920ea94bc service nova] [instance: 354550b2-9cf4-4a7b-b3c9-c9f3b1a04dea] Refreshing network info cache for port 7667374b-3abb-4fc5-a3cf-8388f2947aa3 {{(pid=75045) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 23:50:07 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-f0a01314-caea-4a29-9f95-183605872a03 tempest-VolumesNegativeTest-1756715703 tempest-VolumesNegativeTest-1756715703-project-member] [instance: 354550b2-9cf4-4a7b-b3c9-c9f3b1a04dea] Start _get_guest_xml network_info=[{"id": "7667374b-3abb-4fc5-a3cf-8388f2947aa3", "address": "fa:16:3e:25:7e:8e", "network": {"id": "deecb7cd-355d-4c73-93a8-b9251ab6d74e", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.19", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "b1beba2cc4e7465ea249e2225fb494dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7667374b-3a", "ovs_interfaceid": "7667374b-3abb-4fc5-a3cf-8388f2947aa3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T23:11:54Z,direct_url=<?>,disk_format='qcow2',id=a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b1beba2cc4e7465ea249e2225fb494dc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T23:11:56Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'disk_bus': 'virtio', 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': 'a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75045) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 23:50:07 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:50:07 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:50:07 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:50:07 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Auditing locally available compute resources for user (node: user) {{(pid=75045) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 23:50:07 user nova-compute[75045]: WARNING nova.virt.libvirt.driver [None req-f0a01314-caea-4a29-9f95-183605872a03 tempest-VolumesNegativeTest-1756715703 tempest-VolumesNegativeTest-1756715703-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 23:50:07 user nova-compute[75045]: WARNING nova.virt.libvirt.driver [None req-f0a01314-caea-4a29-9f95-183605872a03 tempest-VolumesNegativeTest-1756715703 tempest-VolumesNegativeTest-1756715703-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 23:50:07 user nova-compute[75045]: DEBUG nova.virt.libvirt.host [None req-f0a01314-caea-4a29-9f95-183605872a03 tempest-VolumesNegativeTest-1756715703 tempest-VolumesNegativeTest-1756715703-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75045) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 23:50:07 user nova-compute[75045]: DEBUG nova.virt.libvirt.host [None req-f0a01314-caea-4a29-9f95-183605872a03 tempest-VolumesNegativeTest-1756715703 tempest-VolumesNegativeTest-1756715703-project-member] CPU controller missing on host. {{(pid=75045) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 23:50:07 user nova-compute[75045]: DEBUG nova.virt.libvirt.host [None req-f0a01314-caea-4a29-9f95-183605872a03 tempest-VolumesNegativeTest-1756715703 tempest-VolumesNegativeTest-1756715703-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75045) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 23:50:07 user nova-compute[75045]: DEBUG nova.virt.libvirt.host [None req-f0a01314-caea-4a29-9f95-183605872a03 tempest-VolumesNegativeTest-1756715703 tempest-VolumesNegativeTest-1756715703-project-member] CPU controller found on host. {{(pid=75045) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 23:50:07 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-f0a01314-caea-4a29-9f95-183605872a03 tempest-VolumesNegativeTest-1756715703 tempest-VolumesNegativeTest-1756715703-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75045) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 23:50:07 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-f0a01314-caea-4a29-9f95-183605872a03 tempest-VolumesNegativeTest-1756715703 tempest-VolumesNegativeTest-1756715703-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T23:11:41Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T23:11:54Z,direct_url=<?>,disk_format='qcow2',id=a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b1beba2cc4e7465ea249e2225fb494dc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T23:11:56Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75045) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 23:50:07 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-f0a01314-caea-4a29-9f95-183605872a03 tempest-VolumesNegativeTest-1756715703 tempest-VolumesNegativeTest-1756715703-project-member] Flavor limits 0:0:0 {{(pid=75045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 23:50:07 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-f0a01314-caea-4a29-9f95-183605872a03 tempest-VolumesNegativeTest-1756715703 tempest-VolumesNegativeTest-1756715703-project-member] Image limits 0:0:0 {{(pid=75045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 23:50:07 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-f0a01314-caea-4a29-9f95-183605872a03 tempest-VolumesNegativeTest-1756715703 tempest-VolumesNegativeTest-1756715703-project-member] Flavor pref 0:0:0 {{(pid=75045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 23:50:07 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-f0a01314-caea-4a29-9f95-183605872a03 tempest-VolumesNegativeTest-1756715703 tempest-VolumesNegativeTest-1756715703-project-member] Image pref 0:0:0 {{(pid=75045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 23:50:07 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-f0a01314-caea-4a29-9f95-183605872a03 tempest-VolumesNegativeTest-1756715703 tempest-VolumesNegativeTest-1756715703-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 23:50:07 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-f0a01314-caea-4a29-9f95-183605872a03 tempest-VolumesNegativeTest-1756715703 tempest-VolumesNegativeTest-1756715703-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75045) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 23:50:07 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-f0a01314-caea-4a29-9f95-183605872a03 tempest-VolumesNegativeTest-1756715703 tempest-VolumesNegativeTest-1756715703-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75045) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 23:50:07 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-f0a01314-caea-4a29-9f95-183605872a03 tempest-VolumesNegativeTest-1756715703 tempest-VolumesNegativeTest-1756715703-project-member] Got 1 possible topologies {{(pid=75045) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 23:50:07 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-f0a01314-caea-4a29-9f95-183605872a03 tempest-VolumesNegativeTest-1756715703 tempest-VolumesNegativeTest-1756715703-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75045) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 23:50:07 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-f0a01314-caea-4a29-9f95-183605872a03 tempest-VolumesNegativeTest-1756715703 tempest-VolumesNegativeTest-1756715703-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75045) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 23:50:07 user nova-compute[75045]: DEBUG nova.virt.libvirt.vif [None req-f0a01314-caea-4a29-9f95-183605872a03 tempest-VolumesNegativeTest-1756715703 tempest-VolumesNegativeTest-1756715703-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T23:50:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-965261517',display_name='tempest-VolumesNegativeTest-instance-965261517',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-965261517',id=47,image_ref='a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='30f84c7bf2484263b838d689595c8e31',ramdisk_id='',reservation_id='r-vcy1s0c3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-1756715703',owner_user_name='tempest-VolumesNegativeTest-1756715703-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T23:50:05Z,user_data=None,user_id='a1249c15e72d4bee886afe49003c6e98',uuid=354550b2-9cf4-4a7b-b3c9-c9f3b1a04dea,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7667374b-3abb-4fc5-a3cf-8388f2947aa3", "address": "fa:16:3e:25:7e:8e", "network": {"id": "deecb7cd-355d-4c73-93a8-b9251ab6d74e", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.19", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "b1beba2cc4e7465ea249e2225fb494dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7667374b-3a", "ovs_interfaceid": "7667374b-3abb-4fc5-a3cf-8388f2947aa3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75045) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 23:50:07 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-f0a01314-caea-4a29-9f95-183605872a03 tempest-VolumesNegativeTest-1756715703 tempest-VolumesNegativeTest-1756715703-project-member] Converting VIF {"id": "7667374b-3abb-4fc5-a3cf-8388f2947aa3", "address": "fa:16:3e:25:7e:8e", "network": {"id": "deecb7cd-355d-4c73-93a8-b9251ab6d74e", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.19", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "b1beba2cc4e7465ea249e2225fb494dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7667374b-3a", "ovs_interfaceid": "7667374b-3abb-4fc5-a3cf-8388f2947aa3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 23:50:07 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-f0a01314-caea-4a29-9f95-183605872a03 tempest-VolumesNegativeTest-1756715703 tempest-VolumesNegativeTest-1756715703-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:25:7e:8e,bridge_name='br-int',has_traffic_filtering=True,id=7667374b-3abb-4fc5-a3cf-8388f2947aa3,network=Network(deecb7cd-355d-4c73-93a8-b9251ab6d74e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7667374b-3a') {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 23:50:07 user nova-compute[75045]: DEBUG nova.objects.instance [None req-f0a01314-caea-4a29-9f95-183605872a03 tempest-VolumesNegativeTest-1756715703 tempest-VolumesNegativeTest-1756715703-project-member] Lazy-loading 'pci_devices' on Instance uuid 354550b2-9cf4-4a7b-b3c9-c9f3b1a04dea {{(pid=75045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 23:50:07 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-c3ddfbc4-8289-44c4-aac6-d5c9ff7d9208 tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b59f52a99fff51c56dd1edfb83892fb8f647f2f3 --force-share --output=json" returned: 0 in 0.203s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:50:07 user nova-compute[75045]: DEBUG nova.virt.disk.api [None req-c3ddfbc4-8289-44c4-aac6-d5c9ff7d9208 tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0b413c71-c13a-4fea-91c4-f6b1953d54c6/disk. size=1073741824 {{(pid=75045) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 23:50:07 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-c3ddfbc4-8289-44c4-aac6-d5c9ff7d9208 tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b413c71-c13a-4fea-91c4-f6b1953d54c6/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:50:07 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-f0a01314-caea-4a29-9f95-183605872a03 tempest-VolumesNegativeTest-1756715703 tempest-VolumesNegativeTest-1756715703-project-member] [instance: 354550b2-9cf4-4a7b-b3c9-c9f3b1a04dea] End _get_guest_xml xml=<domain type="kvm">
Nov 08 23:50:07 user nova-compute[75045]:   <uuid>354550b2-9cf4-4a7b-b3c9-c9f3b1a04dea</uuid>
Nov 08 23:50:07 user nova-compute[75045]:   <name>instance-0000002f</name>
Nov 08 23:50:07 user nova-compute[75045]:   <memory>524288</memory>
Nov 08 23:50:07 user nova-compute[75045]:   <vcpu>1</vcpu>
Nov 08 23:50:07 user nova-compute[75045]:   <metadata>
Nov 08 23:50:07 user nova-compute[75045]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 23:50:07 user nova-compute[75045]:       <nova:package version="0.0.0"/>
Nov 08 23:50:07 user nova-compute[75045]:       <nova:name>tempest-VolumesNegativeTest-instance-965261517</nova:name>
Nov 08 23:50:07 user nova-compute[75045]:       <nova:creationTime>2023-11-08 23:50:07</nova:creationTime>
Nov 08 23:50:07 user nova-compute[75045]:       <nova:flavor name="m1.tiny">
Nov 08 23:50:07 user nova-compute[75045]:         <nova:memory>512</nova:memory>
Nov 08 23:50:07 user nova-compute[75045]:         <nova:disk>1</nova:disk>
Nov 08 23:50:07 user nova-compute[75045]:         <nova:swap>0</nova:swap>
Nov 08 23:50:07 user nova-compute[75045]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 23:50:07 user nova-compute[75045]:         <nova:vcpus>1</nova:vcpus>
Nov 08 23:50:07 user nova-compute[75045]:       </nova:flavor>
Nov 08 23:50:07 user nova-compute[75045]:       <nova:owner>
Nov 08 23:50:07 user nova-compute[75045]:         <nova:user uuid="a1249c15e72d4bee886afe49003c6e98">tempest-VolumesNegativeTest-1756715703-project-member</nova:user>
Nov 08 23:50:07 user nova-compute[75045]:         <nova:project uuid="30f84c7bf2484263b838d689595c8e31">tempest-VolumesNegativeTest-1756715703</nova:project>
Nov 08 23:50:07 user nova-compute[75045]:       </nova:owner>
Nov 08 23:50:07 user nova-compute[75045]:       <nova:root type="image" uuid="a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb"/>
Nov 08 23:50:07 user nova-compute[75045]:       <nova:ports>
Nov 08 23:50:07 user nova-compute[75045]:         <nova:port uuid="7667374b-3abb-4fc5-a3cf-8388f2947aa3">
Nov 08 23:50:07 user nova-compute[75045]:           <nova:ip type="fixed" address="192.168.233.19" ipVersion="4"/>
Nov 08 23:50:07 user nova-compute[75045]:         </nova:port>
Nov 08 23:50:07 user nova-compute[75045]:       </nova:ports>
Nov 08 23:50:07 user nova-compute[75045]:     </nova:instance>
Nov 08 23:50:07 user nova-compute[75045]:   </metadata>
Nov 08 23:50:07 user nova-compute[75045]:   <sysinfo type="smbios">
Nov 08 23:50:07 user nova-compute[75045]:     <system>
Nov 08 23:50:07 user nova-compute[75045]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 23:50:07 user nova-compute[75045]:       <entry name="product">OpenStack Nova</entry>
Nov 08 23:50:07 user nova-compute[75045]:       <entry name="version">0.0.0</entry>
Nov 08 23:50:07 user nova-compute[75045]:       <entry name="serial">354550b2-9cf4-4a7b-b3c9-c9f3b1a04dea</entry>
Nov 08 23:50:07 user nova-compute[75045]:       <entry name="uuid">354550b2-9cf4-4a7b-b3c9-c9f3b1a04dea</entry>
Nov 08 23:50:07 user nova-compute[75045]:       <entry name="family">Virtual Machine</entry>
Nov 08 23:50:07 user nova-compute[75045]:     </system>
Nov 08 23:50:07 user nova-compute[75045]:   </sysinfo>
Nov 08 23:50:07 user nova-compute[75045]:   <os>
Nov 08 23:50:07 user nova-compute[75045]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 23:50:07 user nova-compute[75045]:     <boot dev="hd"/>
Nov 08 23:50:07 user nova-compute[75045]:     <smbios mode="sysinfo"/>
Nov 08 23:50:07 user nova-compute[75045]:   </os>
Nov 08 23:50:07 user nova-compute[75045]:   <features>
Nov 08 23:50:07 user nova-compute[75045]:     <acpi/>
Nov 08 23:50:07 user nova-compute[75045]:     <apic/>
Nov 08 23:50:07 user nova-compute[75045]:     <vmcoreinfo/>
Nov 08 23:50:07 user nova-compute[75045]:   </features>
Nov 08 23:50:07 user nova-compute[75045]:   <clock offset="utc">
Nov 08 23:50:07 user nova-compute[75045]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 23:50:07 user nova-compute[75045]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 23:50:07 user nova-compute[75045]:     <timer name="hpet" present="no"/>
Nov 08 23:50:07 user nova-compute[75045]:   </clock>
Nov 08 23:50:07 user nova-compute[75045]:   <cpu mode="custom" match="exact">
Nov 08 23:50:07 user nova-compute[75045]:     <model>Nehalem</model>
Nov 08 23:50:07 user nova-compute[75045]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 23:50:07 user nova-compute[75045]:   </cpu>
Nov 08 23:50:07 user nova-compute[75045]:   <devices>
Nov 08 23:50:07 user nova-compute[75045]:     <disk type="file" device="disk">
Nov 08 23:50:07 user nova-compute[75045]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 23:50:07 user nova-compute[75045]:       <source file="/opt/stack/data/nova/instances/354550b2-9cf4-4a7b-b3c9-c9f3b1a04dea/disk"/>
Nov 08 23:50:07 user nova-compute[75045]:       <target dev="vda" bus="virtio"/>
Nov 08 23:50:07 user nova-compute[75045]:     </disk>
Nov 08 23:50:07 user nova-compute[75045]:     <interface type="ethernet">
Nov 08 23:50:07 user nova-compute[75045]:       <mac address="fa:16:3e:25:7e:8e"/>
Nov 08 23:50:07 user nova-compute[75045]:       <model type="virtio"/>
Nov 08 23:50:07 user nova-compute[75045]:       <mtu size="1442"/>
Nov 08 23:50:07 user nova-compute[75045]:       <target dev="tap7667374b-3a"/>
Nov 08 23:50:07 user nova-compute[75045]:     </interface>
Nov 08 23:50:07 user nova-compute[75045]:     <serial type="pty">
Nov 08 23:50:07 user nova-compute[75045]:       <log file="/opt/stack/data/nova/instances/354550b2-9cf4-4a7b-b3c9-c9f3b1a04dea/console.log" append="off"/>
Nov 08 23:50:07 user nova-compute[75045]:     </serial>
Nov 08 23:50:07 user nova-compute[75045]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 23:50:07 user nova-compute[75045]:     <video>
Nov 08 23:50:07 user nova-compute[75045]:       <model type="virtio"/>
Nov 08 23:50:07 user nova-compute[75045]:     </video>
Nov 08 23:50:07 user nova-compute[75045]:     <rng model="virtio">
Nov 08 23:50:07 user nova-compute[75045]:       <backend model="random">/dev/urandom</backend>
Nov 08 23:50:07 user nova-compute[75045]:     </rng>
Nov 08 23:50:07 user nova-compute[75045]:     <controller type="usb" index="0" model="none"/>
Nov 08 23:50:07 user nova-compute[75045]:     <memballoon model="virtio">
Nov 08 23:50:07 user nova-compute[75045]:       <stats period="10"/>
Nov 08 23:50:07 user nova-compute[75045]:     </memballoon>
Nov 08 23:50:07 user nova-compute[75045]:   </devices>
Nov 08 23:50:07 user nova-compute[75045]: </domain>
Nov 08 23:50:07 user nova-compute[75045]:  {{(pid=75045) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 23:50:07 user nova-compute[75045]: DEBUG nova.virt.libvirt.vif [None req-f0a01314-caea-4a29-9f95-183605872a03 tempest-VolumesNegativeTest-1756715703 tempest-VolumesNegativeTest-1756715703-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T23:50:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-965261517',display_name='tempest-VolumesNegativeTest-instance-965261517',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-965261517',id=47,image_ref='a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='30f84c7bf2484263b838d689595c8e31',ramdisk_id='',reservation_id='r-vcy1s0c3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-1756715703',owner_user_name='tempest-VolumesNegativeTest-1756715703-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T23:50:05Z,user_data=None,user_id='a1249c15e72d4bee886afe49003c6e98',uuid=354550b2-9cf4-4a7b-b3c9-c9f3b1a04dea,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7667374b-3abb-4fc5-a3cf-8388f2947aa3", "address": "fa:16:3e:25:7e:8e", "network": {"id": "deecb7cd-355d-4c73-93a8-b9251ab6d74e", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.19", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "b1beba2cc4e7465ea249e2225fb494dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7667374b-3a", "ovs_interfaceid": "7667374b-3abb-4fc5-a3cf-8388f2947aa3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75045) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 23:50:07 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-f0a01314-caea-4a29-9f95-183605872a03 tempest-VolumesNegativeTest-1756715703 tempest-VolumesNegativeTest-1756715703-project-member] Converting VIF {"id": "7667374b-3abb-4fc5-a3cf-8388f2947aa3", "address": "fa:16:3e:25:7e:8e", "network": {"id": "deecb7cd-355d-4c73-93a8-b9251ab6d74e", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.19", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "b1beba2cc4e7465ea249e2225fb494dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7667374b-3a", "ovs_interfaceid": "7667374b-3abb-4fc5-a3cf-8388f2947aa3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 23:50:07 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-f0a01314-caea-4a29-9f95-183605872a03 tempest-VolumesNegativeTest-1756715703 tempest-VolumesNegativeTest-1756715703-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:25:7e:8e,bridge_name='br-int',has_traffic_filtering=True,id=7667374b-3abb-4fc5-a3cf-8388f2947aa3,network=Network(deecb7cd-355d-4c73-93a8-b9251ab6d74e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7667374b-3a') {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 23:50:07 user nova-compute[75045]: DEBUG os_vif [None req-f0a01314-caea-4a29-9f95-183605872a03 tempest-VolumesNegativeTest-1756715703 tempest-VolumesNegativeTest-1756715703-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:25:7e:8e,bridge_name='br-int',has_traffic_filtering=True,id=7667374b-3abb-4fc5-a3cf-8388f2947aa3,network=Network(deecb7cd-355d-4c73-93a8-b9251ab6d74e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7667374b-3a') {{(pid=75045) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 23:50:07 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:50:07 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:50:07 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 23:50:07 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:50:07 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3aed0926-8862-585b-b42e-19095aac4129', '_type': 'linux-noop'}}, row=False) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:50:07 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:50:07 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 23:50:07 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:50:07 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7667374b-3a, may_exist=True, interface_attrs={}) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:50:07 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7667374b-3a, col_values=(('qos', UUID('fa4cfe77-1e3f-4dee-9c4b-0aaaad7431a7')),), if_exists=True) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:50:07 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7667374b-3a, col_values=(('external_ids', {'iface-id': '7667374b-3abb-4fc5-a3cf-8388f2947aa3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:25:7e:8e', 'vm-uuid': '354550b2-9cf4-4a7b-b3c9-c9f3b1a04dea'}),), if_exists=True) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:50:07 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:50:07 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 23:50:07 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:50:07 user nova-compute[75045]: INFO os_vif [None req-f0a01314-caea-4a29-9f95-183605872a03 tempest-VolumesNegativeTest-1756715703 tempest-VolumesNegativeTest-1756715703-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:25:7e:8e,bridge_name='br-int',has_traffic_filtering=True,id=7667374b-3abb-4fc5-a3cf-8388f2947aa3,network=Network(deecb7cd-355d-4c73-93a8-b9251ab6d74e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7667374b-3a')
Nov 08 23:50:07 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-f0a01314-caea-4a29-9f95-183605872a03 tempest-VolumesNegativeTest-1756715703 tempest-VolumesNegativeTest-1756715703-project-member] No BDM found with device name vda, not building metadata. {{(pid=75045) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 23:50:07 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-f0a01314-caea-4a29-9f95-183605872a03 tempest-VolumesNegativeTest-1756715703 tempest-VolumesNegativeTest-1756715703-project-member] No VIF found with MAC fa:16:3e:25:7e:8e, not building metadata {{(pid=75045) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 23:50:07 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7b3eac2-a51b-40e7-a199-66aee8d2da09/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:50:07 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-c3ddfbc4-8289-44c4-aac6-d5c9ff7d9208 tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b413c71-c13a-4fea-91c4-f6b1953d54c6/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:50:07 user nova-compute[75045]: DEBUG nova.virt.disk.api [None req-c3ddfbc4-8289-44c4-aac6-d5c9ff7d9208 tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Cannot resize image /opt/stack/data/nova/instances/0b413c71-c13a-4fea-91c4-f6b1953d54c6/disk to a smaller size. {{(pid=75045) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 08 23:50:07 user nova-compute[75045]: DEBUG nova.objects.instance [None req-c3ddfbc4-8289-44c4-aac6-d5c9ff7d9208 tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Lazy-loading 'migration_context' on Instance uuid 0b413c71-c13a-4fea-91c4-f6b1953d54c6 {{(pid=75045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 23:50:07 user nova-compute[75045]: DEBUG nova.objects.base [None req-c3ddfbc4-8289-44c4-aac6-d5c9ff7d9208 tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Object Instance<0b413c71-c13a-4fea-91c4-f6b1953d54c6> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=75045) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 23:50:07 user nova-compute[75045]: DEBUG nova.virt.libvirt.vif [None req-c3ddfbc4-8289-44c4-aac6-d5c9ff7d9208 tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T23:41:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1115991455',display_name='tempest-AttachVolumeTestJSON-server-1115991455',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1115991455',id=42,image_ref='a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDP62TKuY3xQeSwtOVfapZleQ+Udsdwyg62rL9eK489WlMG5ccA/qQJy7H2wra4KXAElLeGxPHWcXNl9vwyU6pMJ292WwpOYwEUeIcXde3ufxVUWLY5U6GVW+3+zkZGZTw==',key_name='tempest-keypair-777988029',keypairs=<?>,launch_index=0,launched_at=2023-11-08T23:41:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='c8be85d72bc440899f3ccb64b923e90e',ramdisk_id='',reservation_id='r-m3eq8ay7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1852573580',owner_user_name='tempest-AttachVolumeTestJSON-1852573580-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T23:48:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1e3647ad15a24f1584685f9340eae5bd',uuid=0b413c71-c13a-4fea-91c4-f6b1953d54c6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "166cceb4-9b95-4bdd-a3ad-b6aad94dfed0", "address": "fa:16:3e:17:84:3d", "network": {"id": "e31c3d41-e46f-4c74-8ef5-8243a391dde8", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-856540424-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.149", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c8be85d72bc440899f3ccb64b923e90e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap166cceb4-9b", "ovs_interfaceid": "166cceb4-9b95-4bdd-a3ad-b6aad94dfed0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75045) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 23:50:07 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-c3ddfbc4-8289-44c4-aac6-d5c9ff7d9208 tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Converting VIF {"id": "166cceb4-9b95-4bdd-a3ad-b6aad94dfed0", "address": "fa:16:3e:17:84:3d", "network": {"id": "e31c3d41-e46f-4c74-8ef5-8243a391dde8", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-856540424-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.149", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c8be85d72bc440899f3ccb64b923e90e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap166cceb4-9b", "ovs_interfaceid": "166cceb4-9b95-4bdd-a3ad-b6aad94dfed0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 23:50:07 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-c3ddfbc4-8289-44c4-aac6-d5c9ff7d9208 tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:17:84:3d,bridge_name='br-int',has_traffic_filtering=True,id=166cceb4-9b95-4bdd-a3ad-b6aad94dfed0,network=Network(e31c3d41-e46f-4c74-8ef5-8243a391dde8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap166cceb4-9b') {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 23:50:07 user nova-compute[75045]: DEBUG os_vif [None req-c3ddfbc4-8289-44c4-aac6-d5c9ff7d9208 tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:17:84:3d,bridge_name='br-int',has_traffic_filtering=True,id=166cceb4-9b95-4bdd-a3ad-b6aad94dfed0,network=Network(e31c3d41-e46f-4c74-8ef5-8243a391dde8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap166cceb4-9b') {{(pid=75045) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 23:50:07 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:50:07 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:50:07 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 23:50:07 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:50:07 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '51e287f5-9b55-532a-b2f3-73adf8fe8b59', '_type': 'linux-noop'}}, row=False) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:50:07 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:50:07 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 23:50:07 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:50:07 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:50:07 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap166cceb4-9b, may_exist=True, interface_attrs={}) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:50:07 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap166cceb4-9b, col_values=(('qos', UUID('d809ad62-5856-4a5c-b35a-ed192a5857ad')),), if_exists=True) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:50:07 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap166cceb4-9b, col_values=(('external_ids', {'iface-id': '166cceb4-9b95-4bdd-a3ad-b6aad94dfed0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:17:84:3d', 'vm-uuid': '0b413c71-c13a-4fea-91c4-f6b1953d54c6'}),), if_exists=True) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:50:07 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 23:50:07 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:50:07 user nova-compute[75045]: INFO os_vif [None req-c3ddfbc4-8289-44c4-aac6-d5c9ff7d9208 tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:17:84:3d,bridge_name='br-int',has_traffic_filtering=True,id=166cceb4-9b95-4bdd-a3ad-b6aad94dfed0,network=Network(e31c3d41-e46f-4c74-8ef5-8243a391dde8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap166cceb4-9b')
Nov 08 23:50:07 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7b3eac2-a51b-40e7-a199-66aee8d2da09/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:50:07 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7b3eac2-a51b-40e7-a199-66aee8d2da09/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:50:07 user nova-compute[75045]: DEBUG nova.network.neutron [req-2d7b7cf7-7c07-4d1b-8564-97b034d41973 req-4a76f0be-edef-4dc6-b97e-679920ea94bc service nova] [instance: 354550b2-9cf4-4a7b-b3c9-c9f3b1a04dea] Updated VIF entry in instance network info cache for port 7667374b-3abb-4fc5-a3cf-8388f2947aa3. {{(pid=75045) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 23:50:07 user nova-compute[75045]: DEBUG nova.network.neutron [req-2d7b7cf7-7c07-4d1b-8564-97b034d41973 req-4a76f0be-edef-4dc6-b97e-679920ea94bc service nova] [instance: 354550b2-9cf4-4a7b-b3c9-c9f3b1a04dea] Updating instance_info_cache with network_info: [{"id": "7667374b-3abb-4fc5-a3cf-8388f2947aa3", "address": "fa:16:3e:25:7e:8e", "network": {"id": "deecb7cd-355d-4c73-93a8-b9251ab6d74e", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.19", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "b1beba2cc4e7465ea249e2225fb494dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7667374b-3a", "ovs_interfaceid": "7667374b-3abb-4fc5-a3cf-8388f2947aa3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75045) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 23:50:07 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-240b2ec1-c2c3-479b-8670-bb703031b971 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] Acquiring lock "c7b3eac2-a51b-40e7-a199-66aee8d2da09" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:50:07 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-240b2ec1-c2c3-479b-8670-bb703031b971 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] Lock "c7b3eac2-a51b-40e7-a199-66aee8d2da09" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:50:07 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-2d7b7cf7-7c07-4d1b-8564-97b034d41973 req-4a76f0be-edef-4dc6-b97e-679920ea94bc service nova] Releasing lock "refresh_cache-354550b2-9cf4-4a7b-b3c9-c9f3b1a04dea" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 23:50:07 user nova-compute[75045]: DEBUG nova.objects.instance [None req-240b2ec1-c2c3-479b-8670-bb703031b971 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] Lazy-loading 'flavor' on Instance uuid c7b3eac2-a51b-40e7-a199-66aee8d2da09 {{(pid=75045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 23:50:07 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-240b2ec1-c2c3-479b-8670-bb703031b971 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] Lock "c7b3eac2-a51b-40e7-a199-66aee8d2da09" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.058s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:50:07 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7b3eac2-a51b-40e7-a199-66aee8d2da09/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:50:12 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:50:12 user nova-compute[75045]: DEBUG nova.compute.manager [None req-c3ddfbc4-8289-44c4-aac6-d5c9ff7d9208 tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] [instance: 0b413c71-c13a-4fea-91c4-f6b1953d54c6] Instance event wait completed in 0 seconds for  {{(pid=75045) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 23:50:12 user nova-compute[75045]: DEBUG nova.compute.manager [None req-f0a01314-caea-4a29-9f95-183605872a03 tempest-VolumesNegativeTest-1756715703 tempest-VolumesNegativeTest-1756715703-project-member] [instance: 354550b2-9cf4-4a7b-b3c9-c9f3b1a04dea] Instance event wait completed in 0 seconds for  {{(pid=75045) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 23:50:12 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-f0a01314-caea-4a29-9f95-183605872a03 tempest-VolumesNegativeTest-1756715703 tempest-VolumesNegativeTest-1756715703-project-member] [instance: 354550b2-9cf4-4a7b-b3c9-c9f3b1a04dea] Guest created on hypervisor {{(pid=75045) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 23:50:12 user nova-compute[75045]: DEBUG nova.compute.manager [req-01f18dc9-f894-4eeb-ae6d-760cfac130a8 req-f27863c5-f2bf-4c2f-a54b-9c8067d26e0e service nova] [instance: 354550b2-9cf4-4a7b-b3c9-c9f3b1a04dea] Received event network-vif-plugged-7667374b-3abb-4fc5-a3cf-8388f2947aa3 {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:50:12 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-01f18dc9-f894-4eeb-ae6d-760cfac130a8 req-f27863c5-f2bf-4c2f-a54b-9c8067d26e0e service nova] Acquiring lock "354550b2-9cf4-4a7b-b3c9-c9f3b1a04dea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:50:12 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-01f18dc9-f894-4eeb-ae6d-760cfac130a8 req-f27863c5-f2bf-4c2f-a54b-9c8067d26e0e service nova] Lock "354550b2-9cf4-4a7b-b3c9-c9f3b1a04dea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:50:12 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-01f18dc9-f894-4eeb-ae6d-760cfac130a8 req-f27863c5-f2bf-4c2f-a54b-9c8067d26e0e service nova] Lock "354550b2-9cf4-4a7b-b3c9-c9f3b1a04dea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:50:12 user nova-compute[75045]: DEBUG nova.compute.manager [req-01f18dc9-f894-4eeb-ae6d-760cfac130a8 req-f27863c5-f2bf-4c2f-a54b-9c8067d26e0e service nova] [instance: 354550b2-9cf4-4a7b-b3c9-c9f3b1a04dea] No waiting events found dispatching network-vif-plugged-7667374b-3abb-4fc5-a3cf-8388f2947aa3 {{(pid=75045) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 23:50:12 user nova-compute[75045]: WARNING nova.compute.manager [req-01f18dc9-f894-4eeb-ae6d-760cfac130a8 req-f27863c5-f2bf-4c2f-a54b-9c8067d26e0e service nova] [instance: 354550b2-9cf4-4a7b-b3c9-c9f3b1a04dea] Received unexpected event network-vif-plugged-7667374b-3abb-4fc5-a3cf-8388f2947aa3 for instance with vm_state building and task_state spawning.
Nov 08 23:50:12 user nova-compute[75045]: DEBUG nova.compute.manager [req-509a288e-f0ca-46c3-93ee-8f80deff870f req-ac73d6bf-cd12-4a30-a5d8-bd801f1ef711 service nova] [instance: 0b413c71-c13a-4fea-91c4-f6b1953d54c6] Received event network-vif-plugged-166cceb4-9b95-4bdd-a3ad-b6aad94dfed0 {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:50:12 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-509a288e-f0ca-46c3-93ee-8f80deff870f req-ac73d6bf-cd12-4a30-a5d8-bd801f1ef711 service nova] Acquiring lock "0b413c71-c13a-4fea-91c4-f6b1953d54c6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:50:12 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-509a288e-f0ca-46c3-93ee-8f80deff870f req-ac73d6bf-cd12-4a30-a5d8-bd801f1ef711 service nova] Lock "0b413c71-c13a-4fea-91c4-f6b1953d54c6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:50:12 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-509a288e-f0ca-46c3-93ee-8f80deff870f req-ac73d6bf-cd12-4a30-a5d8-bd801f1ef711 service nova] Lock "0b413c71-c13a-4fea-91c4-f6b1953d54c6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:50:12 user nova-compute[75045]: DEBUG nova.compute.manager [req-509a288e-f0ca-46c3-93ee-8f80deff870f req-ac73d6bf-cd12-4a30-a5d8-bd801f1ef711 service nova] [instance: 0b413c71-c13a-4fea-91c4-f6b1953d54c6] No waiting events found dispatching network-vif-plugged-166cceb4-9b95-4bdd-a3ad-b6aad94dfed0 {{(pid=75045) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 23:50:12 user nova-compute[75045]: WARNING nova.compute.manager [req-509a288e-f0ca-46c3-93ee-8f80deff870f req-ac73d6bf-cd12-4a30-a5d8-bd801f1ef711 service nova] [instance: 0b413c71-c13a-4fea-91c4-f6b1953d54c6] Received unexpected event network-vif-plugged-166cceb4-9b95-4bdd-a3ad-b6aad94dfed0 for instance with vm_state stopped and task_state powering-on.
Nov 08 23:50:12 user nova-compute[75045]: DEBUG nova.compute.manager [req-3e83bf07-024f-4ab9-b697-af5f46db9fe6 req-b73b174a-7453-4ead-aa19-18e628c39436 service nova] [instance: 354550b2-9cf4-4a7b-b3c9-c9f3b1a04dea] Received event network-vif-plugged-7667374b-3abb-4fc5-a3cf-8388f2947aa3 {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:50:12 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-3e83bf07-024f-4ab9-b697-af5f46db9fe6 req-b73b174a-7453-4ead-aa19-18e628c39436 service nova] Acquiring lock "354550b2-9cf4-4a7b-b3c9-c9f3b1a04dea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:50:12 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-3e83bf07-024f-4ab9-b697-af5f46db9fe6 req-b73b174a-7453-4ead-aa19-18e628c39436 service nova] Lock "354550b2-9cf4-4a7b-b3c9-c9f3b1a04dea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:50:12 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-3e83bf07-024f-4ab9-b697-af5f46db9fe6 req-b73b174a-7453-4ead-aa19-18e628c39436 service nova] Lock "354550b2-9cf4-4a7b-b3c9-c9f3b1a04dea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:50:12 user nova-compute[75045]: DEBUG nova.compute.manager [req-3e83bf07-024f-4ab9-b697-af5f46db9fe6 req-b73b174a-7453-4ead-aa19-18e628c39436 service nova] [instance: 354550b2-9cf4-4a7b-b3c9-c9f3b1a04dea] No waiting events found dispatching network-vif-plugged-7667374b-3abb-4fc5-a3cf-8388f2947aa3 {{(pid=75045) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 23:50:12 user nova-compute[75045]: WARNING nova.compute.manager [req-3e83bf07-024f-4ab9-b697-af5f46db9fe6 req-b73b174a-7453-4ead-aa19-18e628c39436 service nova] [instance: 354550b2-9cf4-4a7b-b3c9-c9f3b1a04dea] Received unexpected event network-vif-plugged-7667374b-3abb-4fc5-a3cf-8388f2947aa3 for instance with vm_state building and task_state spawning.
Nov 08 23:50:12 user nova-compute[75045]: DEBUG nova.compute.manager [req-01b70bc1-97f6-4472-9817-7cbb08295837 req-a51e0d93-b698-4503-8387-d2ab08cd2416 service nova] [instance: 0b413c71-c13a-4fea-91c4-f6b1953d54c6] Received event network-vif-plugged-166cceb4-9b95-4bdd-a3ad-b6aad94dfed0 {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:50:12 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-01b70bc1-97f6-4472-9817-7cbb08295837 req-a51e0d93-b698-4503-8387-d2ab08cd2416 service nova] Acquiring lock "0b413c71-c13a-4fea-91c4-f6b1953d54c6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:50:12 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-01b70bc1-97f6-4472-9817-7cbb08295837 req-a51e0d93-b698-4503-8387-d2ab08cd2416 service nova] Lock "0b413c71-c13a-4fea-91c4-f6b1953d54c6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:50:12 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-01b70bc1-97f6-4472-9817-7cbb08295837 req-a51e0d93-b698-4503-8387-d2ab08cd2416 service nova] Lock "0b413c71-c13a-4fea-91c4-f6b1953d54c6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:50:12 user nova-compute[75045]: DEBUG nova.compute.manager [req-01b70bc1-97f6-4472-9817-7cbb08295837 req-a51e0d93-b698-4503-8387-d2ab08cd2416 service nova] [instance: 0b413c71-c13a-4fea-91c4-f6b1953d54c6] No waiting events found dispatching network-vif-plugged-166cceb4-9b95-4bdd-a3ad-b6aad94dfed0 {{(pid=75045) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 23:50:12 user nova-compute[75045]: WARNING nova.compute.manager [req-01b70bc1-97f6-4472-9817-7cbb08295837 req-a51e0d93-b698-4503-8387-d2ab08cd2416 service nova] [instance: 0b413c71-c13a-4fea-91c4-f6b1953d54c6] Received unexpected event network-vif-plugged-166cceb4-9b95-4bdd-a3ad-b6aad94dfed0 for instance with vm_state stopped and task_state powering-on.
Nov 08 23:50:12 user nova-compute[75045]: INFO nova.virt.libvirt.driver [-] [instance: 0b413c71-c13a-4fea-91c4-f6b1953d54c6] Instance rebooted successfully.
Nov 08 23:50:12 user nova-compute[75045]: DEBUG nova.compute.manager [None req-c3ddfbc4-8289-44c4-aac6-d5c9ff7d9208 tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] [instance: 0b413c71-c13a-4fea-91c4-f6b1953d54c6] Checking state {{(pid=75045) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 23:50:12 user nova-compute[75045]: WARNING nova.virt.libvirt.driver [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 23:50:12 user nova-compute[75045]: WARNING nova.virt.libvirt.driver [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 23:50:12 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Hypervisor/Node resource view: name=user free_ram=8690MB free_disk=24.950149536132812GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75045) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 23:50:12 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:50:12 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:50:12 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-240b2ec1-c2c3-479b-8670-bb703031b971 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] Acquiring lock "c7b3eac2-a51b-40e7-a199-66aee8d2da09" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:50:12 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-240b2ec1-c2c3-479b-8670-bb703031b971 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] Lock "c7b3eac2-a51b-40e7-a199-66aee8d2da09" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:50:12 user nova-compute[75045]: INFO nova.compute.manager [None req-240b2ec1-c2c3-479b-8670-bb703031b971 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] [instance: c7b3eac2-a51b-40e7-a199-66aee8d2da09] Attaching volume ac646643-9cac-4f95-bf27-7156728caf3d to /dev/vdb
Nov 08 23:50:12 user nova-compute[75045]: INFO nova.virt.libvirt.driver [-] [instance: 354550b2-9cf4-4a7b-b3c9-c9f3b1a04dea] Instance spawned successfully.
Nov 08 23:50:12 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-f0a01314-caea-4a29-9f95-183605872a03 tempest-VolumesNegativeTest-1756715703 tempest-VolumesNegativeTest-1756715703-project-member] [instance: 354550b2-9cf4-4a7b-b3c9-c9f3b1a04dea] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75045) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 23:50:12 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-f0a01314-caea-4a29-9f95-183605872a03 tempest-VolumesNegativeTest-1756715703 tempest-VolumesNegativeTest-1756715703-project-member] [instance: 354550b2-9cf4-4a7b-b3c9-c9f3b1a04dea] Found default for hw_cdrom_bus of ide {{(pid=75045) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 23:50:12 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-f0a01314-caea-4a29-9f95-183605872a03 tempest-VolumesNegativeTest-1756715703 tempest-VolumesNegativeTest-1756715703-project-member] [instance: 354550b2-9cf4-4a7b-b3c9-c9f3b1a04dea] Found default for hw_disk_bus of virtio {{(pid=75045) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 23:50:12 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-f0a01314-caea-4a29-9f95-183605872a03 tempest-VolumesNegativeTest-1756715703 tempest-VolumesNegativeTest-1756715703-project-member] [instance: 354550b2-9cf4-4a7b-b3c9-c9f3b1a04dea] Found default for hw_input_bus of None {{(pid=75045) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 23:50:12 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-f0a01314-caea-4a29-9f95-183605872a03 tempest-VolumesNegativeTest-1756715703 tempest-VolumesNegativeTest-1756715703-project-member] [instance: 354550b2-9cf4-4a7b-b3c9-c9f3b1a04dea] Found default for hw_pointer_model of None {{(pid=75045) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 23:50:12 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-f0a01314-caea-4a29-9f95-183605872a03 tempest-VolumesNegativeTest-1756715703 tempest-VolumesNegativeTest-1756715703-project-member] [instance: 354550b2-9cf4-4a7b-b3c9-c9f3b1a04dea] Found default for hw_video_model of virtio {{(pid=75045) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 23:50:12 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-f0a01314-caea-4a29-9f95-183605872a03 tempest-VolumesNegativeTest-1756715703 tempest-VolumesNegativeTest-1756715703-project-member] [instance: 354550b2-9cf4-4a7b-b3c9-c9f3b1a04dea] Found default for hw_vif_model of virtio {{(pid=75045) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 23:50:12 user nova-compute[75045]: DEBUG os_brick.utils [None req-240b2ec1-c2c3-479b-8670-bb703031b971 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75045) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 23:50:12 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:50:12 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:50:12 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[67fea996-3135-474e-9b0a-8a2f09094042]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6217bd6e884\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:50:12 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:50:12 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.023s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:50:12 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[06722ce5-d15b-4a58-b647-132734bcd6c9]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:50:12 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:50:12 user nova-compute[75045]: INFO nova.compute.manager [None req-f0a01314-caea-4a29-9f95-183605872a03 tempest-VolumesNegativeTest-1756715703 tempest-VolumesNegativeTest-1756715703-project-member] [instance: 354550b2-9cf4-4a7b-b3c9-c9f3b1a04dea] Took 7.78 seconds to spawn the instance on the hypervisor.
Nov 08 23:50:12 user nova-compute[75045]: DEBUG nova.compute.manager [None req-f0a01314-caea-4a29-9f95-183605872a03 tempest-VolumesNegativeTest-1756715703 tempest-VolumesNegativeTest-1756715703-project-member] [instance: 354550b2-9cf4-4a7b-b3c9-c9f3b1a04dea] Checking state {{(pid=75045) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 23:50:12 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:50:12 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0889743-501d-4fd4-a514-0069ccb55b83]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:50:12 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae9bf20a-96c7-42cf-a3fc-e7b002714506]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:50:12 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-240b2ec1-c2c3-479b-8670-bb703031b971 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] Running cmd (subprocess): nvme version {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:50:12 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-240b2ec1-c2c3-479b-8670-bb703031b971 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] 'nvme version' failed. Not Retrying. {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 23:50:12 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Instance 0b413c71-c13a-4fea-91c4-f6b1953d54c6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75045) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 23:50:12 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Instance c7b3eac2-a51b-40e7-a199-66aee8d2da09 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75045) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 23:50:12 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Instance 354550b2-9cf4-4a7b-b3c9-c9f3b1a04dea actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75045) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 23:50:12 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=75045) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 23:50:12 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=75045) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 23:50:12 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.nvmeof [None req-240b2ec1-c2c3-479b-8670-bb703031b971 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] nvme not present on system {{(pid=75045) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 23:50:13 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:50:13 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 23:50:13 user nova-compute[75045]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 23:50:13 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[153e68de-22da-4981-9014-cd7fe1fa7687]: (4, '') {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:50:13 user nova-compute[75045]: INFO nova.compute.manager [None req-f0a01314-caea-4a29-9f95-183605872a03 tempest-VolumesNegativeTest-1756715703 tempest-VolumesNegativeTest-1756715703-project-member] [instance: 354550b2-9cf4-4a7b-b3c9-c9f3b1a04dea] Took 8.52 seconds to build instance.
Nov 08 23:50:13 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.lightos [None req-240b2ec1-c2c3-479b-8670-bb703031b971 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75045) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 23:50:13 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.lightos [None req-240b2ec1-c2c3-479b-8670-bb703031b971 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75045) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 23:50:13 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.lightos [None req-240b2ec1-c2c3-479b-8670-bb703031b971 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] LIGHTOS: no hostnqn found. {{(pid=75045) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 23:50:13 user nova-compute[75045]: DEBUG os_brick.utils [None req-240b2ec1-c2c3-479b-8670-bb703031b971 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] <== get_connector_properties: return (299ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6217bd6e884', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75045) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 23:50:13 user nova-compute[75045]: DEBUG nova.virt.block_device [None req-240b2ec1-c2c3-479b-8670-bb703031b971 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] [instance: c7b3eac2-a51b-40e7-a199-66aee8d2da09] Updating existing volume attachment record: 4632ada2-4055-4803-908c-8f447cede8f1 {{(pid=75045) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 23:50:13 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-f0a01314-caea-4a29-9f95-183605872a03 tempest-VolumesNegativeTest-1756715703 tempest-VolumesNegativeTest-1756715703-project-member] Lock "354550b2-9cf4-4a7b-b3c9-c9f3b1a04dea" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.734s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:50:13 user nova-compute[75045]: DEBUG nova.compute.provider_tree [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Inventory has not changed in ProviderTree for provider: 62ba5f85-c74d-4b58-986e-d4197e813fd7 {{(pid=75045) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 23:50:13 user nova-compute[75045]: DEBUG nova.scheduler.client.report [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Inventory has not changed for provider 62ba5f85-c74d-4b58-986e-d4197e813fd7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75045) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 23:50:13 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Compute_service record updated for user:user {{(pid=75045) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 23:50:13 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.710s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:50:15 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:50:16 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:50:17 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:50:22 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 23:50:26 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:50:27 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:50:31 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:50:32 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:50:36 user nova-compute[75045]: DEBUG nova.virt.libvirt.volume.iscsi [None req-240b2ec1-c2c3-479b-8670-bb703031b971 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] [instance: c7b3eac2-a51b-40e7-a199-66aee8d2da09] Calling os-brick to attach iSCSI Volume {{(pid=75045) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 23:50:36 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-240b2ec1-c2c3-479b-8670-bb703031b971 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1b68210460>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ac646643-9cac-4f95-bf27-7156728caf3d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ucbtGIhC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75045) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 23:50:36 user nova-compute[75045]: WARNING os_brick.initiator.connectors.base [None req-240b2ec1-c2c3-479b-8670-bb703031b971 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 23:50:36 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-240b2ec1-c2c3-479b-8670-bb703031b971 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 23:50:36 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-240b2ec1-c2c3-479b-8670-bb703031b971 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 23:50:36 user nova-compute[75045]: WARNING os_brick.initiator.connectors.base [None req-240b2ec1-c2c3-479b-8670-bb703031b971 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 23:50:36 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-240b2ec1-c2c3-479b-8670-bb703031b971 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ac646643-9cac-4f95-bf27-7156728caf3d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 23:50:36 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-240b2ec1-c2c3-479b-8670-bb703031b971 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ac646643-9cac-4f95-bf27-7156728caf3d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 23:50:36 user nova-compute[75045]: INFO os_brick.initiator.connectors.iscsi [None req-240b2ec1-c2c3-479b-8670-bb703031b971 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 23:50:36 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac646643-9cac-4f95-bf27-7156728caf3d -p 172.16.0.220:3260 {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:50:36 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac646643-9cac-4f95-bf27-7156728caf3d -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:50:36 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0183f10-e6eb-4d2e-aaeb-4616c51a93d6]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:50:36 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-240b2ec1-c2c3-479b-8670-bb703031b971 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 23:50:36 user nova-compute[75045]:  {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:50:36 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac646643-9cac-4f95-bf27-7156728caf3d -p 172.16.0.220:3260 --interface default --op new {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:50:36 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac646643-9cac-4f95-bf27-7156728caf3d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:50:36 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[e58c4cd0-6b09-4151-a914-11e467041099]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ac646643-9cac-4f95-bf27-7156728caf3d] added\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:50:36 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-240b2ec1-c2c3-479b-8670-bb703031b971 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ac646643-9cac-4f95-bf27-7156728caf3d] added
Nov 08 23:50:36 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:50:36 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac646643-9cac-4f95-bf27-7156728caf3d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:50:36 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac646643-9cac-4f95-bf27-7156728caf3d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:50:36 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[533dbf93-8816-4708-bb8d-95885f27a1b9]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:50:36 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-240b2ec1-c2c3-479b-8670-bb703031b971 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:50:36 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac646643-9cac-4f95-bf27-7156728caf3d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:50:36 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac646643-9cac-4f95-bf27-7156728caf3d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:50:36 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c19603c-b209-43f2-b451-fb256816b711]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:50:36 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-240b2ec1-c2c3-479b-8670-bb703031b971 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:50:36 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac646643-9cac-4f95-bf27-7156728caf3d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ucbtGIhC {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:50:36 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac646643-9cac-4f95-bf27-7156728caf3d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ucbtGIhC" returned: 0 in 0.021s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:50:36 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[c868b647-27cb-419d-b94f-634923833aaa]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:50:36 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-240b2ec1-c2c3-479b-8670-bb703031b971 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ucbtGIhC'): stdout= stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:50:36 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac646643-9cac-4f95-bf27-7156728caf3d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:50:36 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac646643-9cac-4f95-bf27-7156728caf3d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:50:36 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d2cea1d-c023-4083-bde1-ee81691bdc94]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:50:36 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-240b2ec1-c2c3-479b-8670-bb703031b971 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:50:36 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:50:36 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.018s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:50:36 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7b25208-01e3-4e04-9fb2-a508b7b77b35]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:50:36 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-240b2ec1-c2c3-479b-8670-bb703031b971 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 08 23:50:36 user nova-compute[75045]:  {{(pid=75045) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 23:50:36 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-240b2ec1-c2c3-479b-8670-bb703031b971 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 08 23:50:36 user nova-compute[75045]:  {{(pid=75045) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 23:50:36 user nova-compute[75045]: WARNING os_brick.initiator.connectors.iscsi [None req-240b2ec1-c2c3-479b-8670-bb703031b971 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 08 23:50:36 user nova-compute[75045]: 
Nov 08 23:50:36 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac646643-9cac-4f95-bf27-7156728caf3d -p 172.16.0.220:3260 --login {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:50:36 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac646643-9cac-4f95-bf27-7156728caf3d -p 172.16.0.220:3260 --login" returned: 0 in 0.050s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:50:36 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f149bb6-170f-4c7f-8596-1868b05961bf]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ac646643-9cac-4f95-bf27-7156728caf3d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ac646643-9cac-4f95-bf27-7156728caf3d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:50:36 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-240b2ec1-c2c3-479b-8670-bb703031b971 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ac646643-9cac-4f95-bf27-7156728caf3d, portal: 172.16.0.220,3260]
Nov 08 23:50:36 user nova-compute[75045]: Login to [iface: default, target: iqn.2010-10.org.openstack:ac646643-9cac-4f95-bf27-7156728caf3d, portal: 172.16.0.220,3260] successful.
Nov 08 23:50:36 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:50:36 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac646643-9cac-4f95-bf27-7156728caf3d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:50:36 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac646643-9cac-4f95-bf27-7156728caf3d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:50:36 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccd4ac29-2964-4884-8d87-35800b964512]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:50:36 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-240b2ec1-c2c3-479b-8670-bb703031b971 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:50:36 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:50:36 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:50:36 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[57ce7c88-375f-4198-8f46-f4064f39bbda]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac646643-9cac-4f95-bf27-7156728caf3d (non-flash)\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:50:36 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-240b2ec1-c2c3-479b-8670-bb703031b971 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac646643-9cac-4f95-bf27-7156728caf3d (non-flash)
Nov 08 23:50:36 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 23:50:36 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-240b2ec1-c2c3-479b-8670-bb703031b971 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac646643-9cac-4f95-bf27-7156728caf3d (non-flash)
Nov 08 23:50:36 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 23:50:36 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-240b2ec1-c2c3-479b-8670-bb703031b971 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ac646643-9cac-4f95-bf27-7156728caf3d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.271s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 23:50:36 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-240b2ec1-c2c3-479b-8670-bb703031b971 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] Connected to 172.16.0.220:3260 {{(pid=75045) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 23:50:36 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-240b2ec1-c2c3-479b-8670-bb703031b971 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] HCTL ('33', '-', '-', 0) found on session 47 with lun 0 {{(pid=75045) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 23:50:36 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-240b2ec1-c2c3-479b-8670-bb703031b971 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75045) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 23:50:36 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:50:36 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:50:36 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[02ed9157-6783-44c6-9a2e-3f2feb6e3c43]: (4, ('- - 0', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:50:36 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-240b2ec1-c2c3-479b-8670-bb703031b971 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] Searching for a device in session 47 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75045) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 23:50:36 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-240b2ec1-c2c3-479b-8670-bb703031b971 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:ac646643-9cac-4f95-bf27-7156728caf3d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ucbtGIhC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75045) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 23:50:36 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:50:37 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-240b2ec1-c2c3-479b-8670-bb703031b971 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.303s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 23:50:37 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-240b2ec1-c2c3-479b-8670-bb703031b971 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] <== connect_volume: return (1304ms) {'type': 'block', 'scsi_wwn': '26430386437373639', 'path': '/dev/sdb'} {{(pid=75045) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 23:50:37 user nova-compute[75045]: DEBUG nova.virt.libvirt.volume.iscsi [None req-240b2ec1-c2c3-479b-8670-bb703031b971 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] [instance: c7b3eac2-a51b-40e7-a199-66aee8d2da09] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26430386437373639', 'path': '/dev/sdb'} {{(pid=75045) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 23:50:37 user nova-compute[75045]: DEBUG nova.objects.instance [None req-240b2ec1-c2c3-479b-8670-bb703031b971 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] Lazy-loading 'flavor' on Instance uuid c7b3eac2-a51b-40e7-a199-66aee8d2da09 {{(pid=75045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 23:50:37 user nova-compute[75045]: DEBUG nova.virt.libvirt.guest [None req-240b2ec1-c2c3-479b-8670-bb703031b971 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] attach device xml: <disk type="block" device="disk">
Nov 08 23:50:37 user nova-compute[75045]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 23:50:37 user nova-compute[75045]:   <source dev="/dev/sdb"/>
Nov 08 23:50:37 user nova-compute[75045]:   <target dev="vdb" bus="virtio"/>
Nov 08 23:50:37 user nova-compute[75045]:   <serial>ac646643-9cac-4f95-bf27-7156728caf3d</serial>
Nov 08 23:50:37 user nova-compute[75045]: </disk>
Nov 08 23:50:37 user nova-compute[75045]:  {{(pid=75045) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 08 23:50:37 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:50:38 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-240b2ec1-c2c3-479b-8670-bb703031b971 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] No BDM found with device name vda, not building metadata. {{(pid=75045) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 23:50:38 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-240b2ec1-c2c3-479b-8670-bb703031b971 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75045) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 23:50:38 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-240b2ec1-c2c3-479b-8670-bb703031b971 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] No VIF found with MAC fa:16:3e:37:0b:9c, not building metadata {{(pid=75045) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 23:50:38 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-240b2ec1-c2c3-479b-8670-bb703031b971 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] Lock "c7b3eac2-a51b-40e7-a199-66aee8d2da09" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 25.551s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:50:41 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:50:42 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:50:46 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:50:47 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:50:50 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:50:52 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:50:53 user nova-compute[75045]: DEBUG nova.compute.manager [req-ac1b8ddc-be38-4f2d-a5a7-ab568a1fa218 req-9904ec2c-56dd-480b-a9b6-90a33659a74d service nova] [instance: c7b3eac2-a51b-40e7-a199-66aee8d2da09] Received event network-changed-ee3648b5-a27a-401d-8708-e25f28d987da {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:50:53 user nova-compute[75045]: DEBUG nova.compute.manager [req-ac1b8ddc-be38-4f2d-a5a7-ab568a1fa218 req-9904ec2c-56dd-480b-a9b6-90a33659a74d service nova] [instance: c7b3eac2-a51b-40e7-a199-66aee8d2da09] Refreshing instance network info cache due to event network-changed-ee3648b5-a27a-401d-8708-e25f28d987da. {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 23:50:53 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-ac1b8ddc-be38-4f2d-a5a7-ab568a1fa218 req-9904ec2c-56dd-480b-a9b6-90a33659a74d service nova] Acquiring lock "refresh_cache-c7b3eac2-a51b-40e7-a199-66aee8d2da09" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 23:50:53 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-ac1b8ddc-be38-4f2d-a5a7-ab568a1fa218 req-9904ec2c-56dd-480b-a9b6-90a33659a74d service nova] Acquired lock "refresh_cache-c7b3eac2-a51b-40e7-a199-66aee8d2da09" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 23:50:53 user nova-compute[75045]: DEBUG nova.network.neutron [req-ac1b8ddc-be38-4f2d-a5a7-ab568a1fa218 req-9904ec2c-56dd-480b-a9b6-90a33659a74d service nova] [instance: c7b3eac2-a51b-40e7-a199-66aee8d2da09] Refreshing network info cache for port ee3648b5-a27a-401d-8708-e25f28d987da {{(pid=75045) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 23:50:54 user nova-compute[75045]: DEBUG nova.network.neutron [req-ac1b8ddc-be38-4f2d-a5a7-ab568a1fa218 req-9904ec2c-56dd-480b-a9b6-90a33659a74d service nova] [instance: c7b3eac2-a51b-40e7-a199-66aee8d2da09] Updated VIF entry in instance network info cache for port ee3648b5-a27a-401d-8708-e25f28d987da. {{(pid=75045) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 23:50:54 user nova-compute[75045]: DEBUG nova.network.neutron [req-ac1b8ddc-be38-4f2d-a5a7-ab568a1fa218 req-9904ec2c-56dd-480b-a9b6-90a33659a74d service nova] [instance: c7b3eac2-a51b-40e7-a199-66aee8d2da09] Updating instance_info_cache with network_info: [{"id": "ee3648b5-a27a-401d-8708-e25f28d987da", "address": "fa:16:3e:37:0b:9c", "network": {"id": "fe5f7093-1cdd-465c-97f0-7d7b2dd1fa8a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1755065955-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4bfce59008d44fdb5ba91c70f1cf044", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee3648b5-a2", "ovs_interfaceid": "ee3648b5-a27a-401d-8708-e25f28d987da", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75045) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 23:50:54 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-ac1b8ddc-be38-4f2d-a5a7-ab568a1fa218 req-9904ec2c-56dd-480b-a9b6-90a33659a74d service nova] Releasing lock "refresh_cache-c7b3eac2-a51b-40e7-a199-66aee8d2da09" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 23:50:56 user nova-compute[75045]: DEBUG nova.compute.manager [req-3ee6f441-3ecf-4a03-9e4c-816202b7643d req-09501976-be9a-466d-b57b-c0e35185685d service nova] [instance: c7b3eac2-a51b-40e7-a199-66aee8d2da09] Received event network-changed-ee3648b5-a27a-401d-8708-e25f28d987da {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:50:56 user nova-compute[75045]: DEBUG nova.compute.manager [req-3ee6f441-3ecf-4a03-9e4c-816202b7643d req-09501976-be9a-466d-b57b-c0e35185685d service nova] [instance: c7b3eac2-a51b-40e7-a199-66aee8d2da09] Refreshing instance network info cache due to event network-changed-ee3648b5-a27a-401d-8708-e25f28d987da. {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 23:50:56 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-3ee6f441-3ecf-4a03-9e4c-816202b7643d req-09501976-be9a-466d-b57b-c0e35185685d service nova] Acquiring lock "refresh_cache-c7b3eac2-a51b-40e7-a199-66aee8d2da09" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 23:50:56 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-3ee6f441-3ecf-4a03-9e4c-816202b7643d req-09501976-be9a-466d-b57b-c0e35185685d service nova] Acquired lock "refresh_cache-c7b3eac2-a51b-40e7-a199-66aee8d2da09" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 23:50:56 user nova-compute[75045]: DEBUG nova.network.neutron [req-3ee6f441-3ecf-4a03-9e4c-816202b7643d req-09501976-be9a-466d-b57b-c0e35185685d service nova] [instance: c7b3eac2-a51b-40e7-a199-66aee8d2da09] Refreshing network info cache for port ee3648b5-a27a-401d-8708-e25f28d987da {{(pid=75045) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 23:50:56 user nova-compute[75045]: DEBUG nova.network.neutron [req-3ee6f441-3ecf-4a03-9e4c-816202b7643d req-09501976-be9a-466d-b57b-c0e35185685d service nova] [instance: c7b3eac2-a51b-40e7-a199-66aee8d2da09] Updated VIF entry in instance network info cache for port ee3648b5-a27a-401d-8708-e25f28d987da. {{(pid=75045) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 23:50:56 user nova-compute[75045]: DEBUG nova.network.neutron [req-3ee6f441-3ecf-4a03-9e4c-816202b7643d req-09501976-be9a-466d-b57b-c0e35185685d service nova] [instance: c7b3eac2-a51b-40e7-a199-66aee8d2da09] Updating instance_info_cache with network_info: [{"id": "ee3648b5-a27a-401d-8708-e25f28d987da", "address": "fa:16:3e:37:0b:9c", "network": {"id": "fe5f7093-1cdd-465c-97f0-7d7b2dd1fa8a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1755065955-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4bfce59008d44fdb5ba91c70f1cf044", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee3648b5-a2", "ovs_interfaceid": "ee3648b5-a27a-401d-8708-e25f28d987da", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75045) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 23:50:56 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:50:56 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-3ee6f441-3ecf-4a03-9e4c-816202b7643d req-09501976-be9a-466d-b57b-c0e35185685d service nova] Releasing lock "refresh_cache-c7b3eac2-a51b-40e7-a199-66aee8d2da09" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 23:50:57 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:50:57 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:50:57 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:50:57 user nova-compute[75045]: DEBUG nova.compute.manager [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Starting heal instance info cache {{(pid=75045) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 23:50:57 user nova-compute[75045]: DEBUG nova.compute.manager [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Rebuilding the list of instances to heal {{(pid=75045) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 08 23:50:58 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Acquiring lock "refresh_cache-0b413c71-c13a-4fea-91c4-f6b1953d54c6" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 23:50:58 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Acquired lock "refresh_cache-0b413c71-c13a-4fea-91c4-f6b1953d54c6" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 23:50:58 user nova-compute[75045]: DEBUG nova.network.neutron [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] [instance: 0b413c71-c13a-4fea-91c4-f6b1953d54c6] Forcefully refreshing network info cache for instance {{(pid=75045) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 23:50:58 user nova-compute[75045]: DEBUG nova.objects.instance [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Lazy-loading 'info_cache' on Instance uuid 0b413c71-c13a-4fea-91c4-f6b1953d54c6 {{(pid=75045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 23:50:58 user nova-compute[75045]: DEBUG nova.network.neutron [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] [instance: 0b413c71-c13a-4fea-91c4-f6b1953d54c6] Updating instance_info_cache with network_info: [{"id": "166cceb4-9b95-4bdd-a3ad-b6aad94dfed0", "address": "fa:16:3e:17:84:3d", "network": {"id": "e31c3d41-e46f-4c74-8ef5-8243a391dde8", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-856540424-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.149", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c8be85d72bc440899f3ccb64b923e90e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap166cceb4-9b", "ovs_interfaceid": "166cceb4-9b95-4bdd-a3ad-b6aad94dfed0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75045) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 23:50:58 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Releasing lock "refresh_cache-0b413c71-c13a-4fea-91c4-f6b1953d54c6" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 23:50:58 user nova-compute[75045]: DEBUG nova.compute.manager [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] [instance: 0b413c71-c13a-4fea-91c4-f6b1953d54c6] Updated the network info_cache for instance {{(pid=75045) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 23:50:58 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:50:58 user nova-compute[75045]: DEBUG nova.compute.manager [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75045) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 23:50:58 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:51:01 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:51:01 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:51:02 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:51:03 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:51:04 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:51:05 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:51:07 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 23:51:08 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager.update_available_resource {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:51:08 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:51:08 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:51:08 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:51:08 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Auditing locally available compute resources for user (node: user) {{(pid=75045) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 23:51:09 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/354550b2-9cf4-4a7b-b3c9-c9f3b1a04dea/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:51:09 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/354550b2-9cf4-4a7b-b3c9-c9f3b1a04dea/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:51:09 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/354550b2-9cf4-4a7b-b3c9-c9f3b1a04dea/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:51:09 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/354550b2-9cf4-4a7b-b3c9-c9f3b1a04dea/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:51:09 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7b3eac2-a51b-40e7-a199-66aee8d2da09/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:51:09 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7b3eac2-a51b-40e7-a199-66aee8d2da09/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:51:09 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7b3eac2-a51b-40e7-a199-66aee8d2da09/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:51:09 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7b3eac2-a51b-40e7-a199-66aee8d2da09/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:51:09 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75045) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 23:51:09 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b413c71-c13a-4fea-91c4-f6b1953d54c6/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:51:10 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b413c71-c13a-4fea-91c4-f6b1953d54c6/disk --force-share --output=json" returned: 0 in 0.241s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:51:10 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b413c71-c13a-4fea-91c4-f6b1953d54c6/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:51:10 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b413c71-c13a-4fea-91c4-f6b1953d54c6/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:51:10 user nova-compute[75045]: WARNING nova.virt.libvirt.driver [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 23:51:10 user nova-compute[75045]: WARNING nova.virt.libvirt.driver [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 23:51:10 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Hypervisor/Node resource view: name=user free_ram=8494MB free_disk=24.91732406616211GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75045) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 23:51:10 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:51:10 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:51:10 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Instance 0b413c71-c13a-4fea-91c4-f6b1953d54c6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75045) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 23:51:10 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Instance c7b3eac2-a51b-40e7-a199-66aee8d2da09 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75045) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 23:51:10 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Instance 354550b2-9cf4-4a7b-b3c9-c9f3b1a04dea actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75045) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 23:51:10 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=75045) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 23:51:10 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=75045) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 23:51:10 user nova-compute[75045]: DEBUG nova.compute.provider_tree [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Inventory has not changed in ProviderTree for provider: 62ba5f85-c74d-4b58-986e-d4197e813fd7 {{(pid=75045) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 23:51:10 user nova-compute[75045]: DEBUG nova.scheduler.client.report [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Inventory has not changed for provider 62ba5f85-c74d-4b58-986e-d4197e813fd7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75045) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 23:51:11 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Compute_service record updated for user:user {{(pid=75045) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 23:51:11 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.271s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:51:11 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:51:12 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:51:17 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:51:19 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2968ffa5-555e-498e-b54a-bb2b9925bcc4 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] Acquiring lock "c7b3eac2-a51b-40e7-a199-66aee8d2da09" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:51:19 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2968ffa5-555e-498e-b54a-bb2b9925bcc4 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] Lock "c7b3eac2-a51b-40e7-a199-66aee8d2da09" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:51:19 user nova-compute[75045]: INFO nova.compute.manager [None req-2968ffa5-555e-498e-b54a-bb2b9925bcc4 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] [instance: c7b3eac2-a51b-40e7-a199-66aee8d2da09] Rebooting instance
Nov 08 23:51:19 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2968ffa5-555e-498e-b54a-bb2b9925bcc4 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] Acquiring lock "refresh_cache-c7b3eac2-a51b-40e7-a199-66aee8d2da09" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 23:51:19 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2968ffa5-555e-498e-b54a-bb2b9925bcc4 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] Acquired lock "refresh_cache-c7b3eac2-a51b-40e7-a199-66aee8d2da09" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 23:51:19 user nova-compute[75045]: DEBUG nova.network.neutron [None req-2968ffa5-555e-498e-b54a-bb2b9925bcc4 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] [instance: c7b3eac2-a51b-40e7-a199-66aee8d2da09] Building network info cache for instance {{(pid=75045) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 23:51:19 user nova-compute[75045]: DEBUG nova.network.neutron [None req-2968ffa5-555e-498e-b54a-bb2b9925bcc4 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] [instance: c7b3eac2-a51b-40e7-a199-66aee8d2da09] Updating instance_info_cache with network_info: [{"id": "ee3648b5-a27a-401d-8708-e25f28d987da", "address": "fa:16:3e:37:0b:9c", "network": {"id": "fe5f7093-1cdd-465c-97f0-7d7b2dd1fa8a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1755065955-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4bfce59008d44fdb5ba91c70f1cf044", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee3648b5-a2", "ovs_interfaceid": "ee3648b5-a27a-401d-8708-e25f28d987da", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75045) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 23:51:19 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2968ffa5-555e-498e-b54a-bb2b9925bcc4 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] Releasing lock "refresh_cache-c7b3eac2-a51b-40e7-a199-66aee8d2da09" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 23:51:19 user nova-compute[75045]: DEBUG nova.compute.manager [None req-2968ffa5-555e-498e-b54a-bb2b9925bcc4 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] [instance: c7b3eac2-a51b-40e7-a199-66aee8d2da09] Checking state {{(pid=75045) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 23:51:20 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:51:20 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:51:20 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:51:20 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:51:20 user nova-compute[75045]: DEBUG nova.compute.manager [req-92a1771c-3c04-48be-9ca2-50dda6afa15e req-d82f9bc4-cba2-441c-826d-d7665c9d04a6 service nova] [instance: c7b3eac2-a51b-40e7-a199-66aee8d2da09] Received event network-vif-unplugged-ee3648b5-a27a-401d-8708-e25f28d987da {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:51:20 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-92a1771c-3c04-48be-9ca2-50dda6afa15e req-d82f9bc4-cba2-441c-826d-d7665c9d04a6 service nova] Acquiring lock "c7b3eac2-a51b-40e7-a199-66aee8d2da09-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:51:20 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-92a1771c-3c04-48be-9ca2-50dda6afa15e req-d82f9bc4-cba2-441c-826d-d7665c9d04a6 service nova] Lock "c7b3eac2-a51b-40e7-a199-66aee8d2da09-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:51:20 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-92a1771c-3c04-48be-9ca2-50dda6afa15e req-d82f9bc4-cba2-441c-826d-d7665c9d04a6 service nova] Lock "c7b3eac2-a51b-40e7-a199-66aee8d2da09-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:51:20 user nova-compute[75045]: DEBUG nova.compute.manager [req-92a1771c-3c04-48be-9ca2-50dda6afa15e req-d82f9bc4-cba2-441c-826d-d7665c9d04a6 service nova] [instance: c7b3eac2-a51b-40e7-a199-66aee8d2da09] No waiting events found dispatching network-vif-unplugged-ee3648b5-a27a-401d-8708-e25f28d987da {{(pid=75045) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 23:51:20 user nova-compute[75045]: WARNING nova.compute.manager [req-92a1771c-3c04-48be-9ca2-50dda6afa15e req-d82f9bc4-cba2-441c-826d-d7665c9d04a6 service nova] [instance: c7b3eac2-a51b-40e7-a199-66aee8d2da09] Received unexpected event network-vif-unplugged-ee3648b5-a27a-401d-8708-e25f28d987da for instance with vm_state active and task_state reboot_started_hard.
Nov 08 23:51:20 user nova-compute[75045]: INFO nova.virt.libvirt.driver [-] [instance: c7b3eac2-a51b-40e7-a199-66aee8d2da09] Instance destroyed successfully.
Nov 08 23:51:20 user nova-compute[75045]: DEBUG nova.objects.instance [None req-2968ffa5-555e-498e-b54a-bb2b9925bcc4 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] Lazy-loading 'resources' on Instance uuid c7b3eac2-a51b-40e7-a199-66aee8d2da09 {{(pid=75045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 23:51:20 user nova-compute[75045]: DEBUG nova.virt.libvirt.vif [None req-2968ffa5-555e-498e-b54a-bb2b9925bcc4 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T23:48:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1921157809',display_name='tempest-TestMinimumBasicScenario-server-1921157809',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1921157809',id=46,image_ref='f5ffbc98-11a7-4f8a-a6c2-51981767a401',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHecd69gYgaSALnbnoSk8qN0iobdxEqArnmuB2X8R1yl+8miN9+r40m6x9O1njTg8e0tQbpEe+KRfZaDGySkJLV+Zispu3OSLEK+XK2OAmFWBfz0y5wJsz4CCuk3AqcQeQ==',key_name='tempest-TestMinimumBasicScenario-2120728013',keypairs=<?>,launch_index=0,launched_at=2023-11-08T23:48:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c4bfce59008d44fdb5ba91c70f1cf044',ramdisk_id='',reservation_id='r-3g7sio6l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f5ffbc98-11a7-4f8a-a6c2-51981767a401',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1125576376',owner_user_name='tempest-TestMinimumBasicScenario-1125576376-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T23:51:20Z,user_data=None,user_id='4ed9cd91d0654f4aa4d620c9f0eb2766',uuid=c7b3eac2-a51b-40e7-a199-66aee8d2da09,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ee3648b5-a27a-401d-8708-e25f28d987da", "address": "fa:16:3e:37:0b:9c", "network": {"id": "fe5f7093-1cdd-465c-97f0-7d7b2dd1fa8a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1755065955-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4bfce59008d44fdb5ba91c70f1cf044", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee3648b5-a2", "ovs_interfaceid": "ee3648b5-a27a-401d-8708-e25f28d987da", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75045) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 23:51:20 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-2968ffa5-555e-498e-b54a-bb2b9925bcc4 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] Converting VIF {"id": "ee3648b5-a27a-401d-8708-e25f28d987da", "address": "fa:16:3e:37:0b:9c", "network": {"id": "fe5f7093-1cdd-465c-97f0-7d7b2dd1fa8a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1755065955-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4bfce59008d44fdb5ba91c70f1cf044", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee3648b5-a2", "ovs_interfaceid": "ee3648b5-a27a-401d-8708-e25f28d987da", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 23:51:20 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-2968ffa5-555e-498e-b54a-bb2b9925bcc4 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:37:0b:9c,bridge_name='br-int',has_traffic_filtering=True,id=ee3648b5-a27a-401d-8708-e25f28d987da,network=Network(fe5f7093-1cdd-465c-97f0-7d7b2dd1fa8a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee3648b5-a2') {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 23:51:20 user nova-compute[75045]: DEBUG os_vif [None req-2968ffa5-555e-498e-b54a-bb2b9925bcc4 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:37:0b:9c,bridge_name='br-int',has_traffic_filtering=True,id=ee3648b5-a27a-401d-8708-e25f28d987da,network=Network(fe5f7093-1cdd-465c-97f0-7d7b2dd1fa8a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee3648b5-a2') {{(pid=75045) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 23:51:20 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:51:20 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapee3648b5-a2, bridge=br-int, if_exists=True) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:51:20 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:51:20 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 23:51:20 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:51:20 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=eab0223d-15c9-4b63-9f2e-d415ab00b167) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:51:20 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:51:20 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:51:20 user nova-compute[75045]: INFO os_vif [None req-2968ffa5-555e-498e-b54a-bb2b9925bcc4 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:37:0b:9c,bridge_name='br-int',has_traffic_filtering=True,id=ee3648b5-a27a-401d-8708-e25f28d987da,network=Network(fe5f7093-1cdd-465c-97f0-7d7b2dd1fa8a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee3648b5-a2')
Nov 08 23:51:20 user nova-compute[75045]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2968ffa5-555e-498e-b54a-bb2b9925bcc4 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] [instance: c7b3eac2-a51b-40e7-a199-66aee8d2da09] calling os-brick to detach iSCSI Volume {{(pid=75045) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 23:51:20 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-2968ffa5-555e-498e-b54a-bb2b9925bcc4 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1b68210460>, {'target_iqn': 'iqn.2010-10.org.openstack:ac646643-9cac-4f95-bf27-7156728caf3d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ucbtGIhC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75045) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 23:51:20 user nova-compute[75045]: WARNING os_brick.initiator.connectors.base [None req-2968ffa5-555e-498e-b54a-bb2b9925bcc4 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 23:51:20 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-2968ffa5-555e-498e-b54a-bb2b9925bcc4 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 23:51:20 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-2968ffa5-555e-498e-b54a-bb2b9925bcc4 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 23:51:20 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:51:20 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:51:20 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad4c0f65-768d-4010-9fa8-deb17d04358e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ac646643-9cac-4f95-bf27-7156728caf3d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:51:20 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-2968ffa5-555e-498e-b54a-bb2b9925bcc4 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 23:51:20 user nova-compute[75045]: No targets found.
Nov 08 23:51:20 user nova-compute[75045]: iSNS:
Nov 08 23:51:20 user nova-compute[75045]: No targets found.
Nov 08 23:51:20 user nova-compute[75045]: STATIC:
Nov 08 23:51:20 user nova-compute[75045]: Target: iqn.2010-10.org.openstack:ac646643-9cac-4f95-bf27-7156728caf3d
Nov 08 23:51:20 user nova-compute[75045]:         Portal: 172.16.0.220:3260,-1
Nov 08 23:51:20 user nova-compute[75045]:                 Iface Name: default
Nov 08 23:51:20 user nova-compute[75045]: FIRMWARE:
Nov 08 23:51:20 user nova-compute[75045]: No targets found.
Nov 08 23:51:20 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 23:51:20 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-2968ffa5-555e-498e-b54a-bb2b9925bcc4 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 23:51:20 user nova-compute[75045]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 23:51:20 user nova-compute[75045]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75045) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 23:51:20 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-2968ffa5-555e-498e-b54a-bb2b9925bcc4 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ac646643-9cac-4f95-bf27-7156728caf3d', 0)] {{(pid=75045) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 23:51:20 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:51:20 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:51:20 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2646b52-c2a7-410d-831c-403301c0f524]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ac646643-9cac-4f95-bf27-7156728caf3d\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:51:20 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:51:20 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:51:20 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d7c8a34-a80f-409d-9571-aad9823bf0d8]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac646643-9cac-4f95-bf27-7156728caf3d (non-flash)\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:51:20 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-2968ffa5-555e-498e-b54a-bb2b9925bcc4 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac646643-9cac-4f95-bf27-7156728caf3d (non-flash)
Nov 08 23:51:20 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 23:51:20 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-2968ffa5-555e-498e-b54a-bb2b9925bcc4 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac646643-9cac-4f95-bf27-7156728caf3d (non-flash)
Nov 08 23:51:20 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 23:51:20 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-2968ffa5-555e-498e-b54a-bb2b9925bcc4 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1b68110af0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ac646643-9cac-4f95-bf27-7156728caf3d'): ({'sdb'}, set())}) {{(pid=75045) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 23:51:20 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-2968ffa5-555e-498e-b54a-bb2b9925bcc4 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] Removing single pathed devices sdb {{(pid=75045) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 23:51:20 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:51:20 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:51:20 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[42c5fcdf-aa06-4697-be39-13de4be898ba]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:51:20 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:51:20 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:51:20 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[b633a3e9-8296-475c-b0f7-574abf5796ea]: (4, ('ok\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:51:20 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-2968ffa5-555e-498e-b54a-bb2b9925bcc4 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] Flushing IO for device /dev/sdb {{(pid=75045) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 23:51:20 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:51:20 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:51:20 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[c60ed7be-7113-4edc-8933-463d786a5102]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:51:20 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-2968ffa5-555e-498e-b54a-bb2b9925bcc4 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75045) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 23:51:20 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:51:21 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.044s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:51:21 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8553dba-5412-47f5-9cda-5b1bea1304ff]: (4, ('1', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:51:21 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-2968ffa5-555e-498e-b54a-bb2b9925bcc4 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75045) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 23:51:21 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-2968ffa5-555e-498e-b54a-bb2b9925bcc4 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] SCSI volumes sdb have been removed. {{(pid=75045) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 23:51:21 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-2968ffa5-555e-498e-b54a-bb2b9925bcc4 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ac646643-9cac-4f95-bf27-7156728caf3d')] {{(pid=75045) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 23:51:21 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac646643-9cac-4f95-bf27-7156728caf3d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:51:21 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac646643-9cac-4f95-bf27-7156728caf3d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:51:21 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[77ef62c1-0855-4702-9727-739a8702a904]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:51:21 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-2968ffa5-555e-498e-b54a-bb2b9925bcc4 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:51:21 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac646643-9cac-4f95-bf27-7156728caf3d -p 172.16.0.220:3260 --logout {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:51:21 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac646643-9cac-4f95-bf27-7156728caf3d -p 172.16.0.220:3260 --logout" returned: 0 in 0.048s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:51:21 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[5200f020-85b8-433c-9aac-cbcb9527b787]: (4, ('Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:ac646643-9cac-4f95-bf27-7156728caf3d, portal: 172.16.0.220,3260]\nLogout of [sid: 47, target: iqn.2010-10.org.openstack:ac646643-9cac-4f95-bf27-7156728caf3d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:51:21 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-2968ffa5-555e-498e-b54a-bb2b9925bcc4 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:ac646643-9cac-4f95-bf27-7156728caf3d, portal: 172.16.0.220,3260]
Nov 08 23:51:21 user nova-compute[75045]: Logout of [sid: 47, target: iqn.2010-10.org.openstack:ac646643-9cac-4f95-bf27-7156728caf3d, portal: 172.16.0.220,3260] successful.
Nov 08 23:51:21 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:51:21 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac646643-9cac-4f95-bf27-7156728caf3d -p 172.16.0.220:3260 --op delete {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:51:21 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac646643-9cac-4f95-bf27-7156728caf3d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:51:21 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[6de68da3-6105-44f0-8dd4-d69e82956113]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:51:21 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-2968ffa5-555e-498e-b54a-bb2b9925bcc4 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:51:21 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-2968ffa5-555e-498e-b54a-bb2b9925bcc4 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.294s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 23:51:21 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-2968ffa5-555e-498e-b54a-bb2b9925bcc4 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] <== disconnect_volume: return (296ms) None {{(pid=75045) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 23:51:21 user nova-compute[75045]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2968ffa5-555e-498e-b54a-bb2b9925bcc4 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] [instance: c7b3eac2-a51b-40e7-a199-66aee8d2da09] Disconnected iSCSI Volume {{(pid=75045) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 23:51:21 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-2968ffa5-555e-498e-b54a-bb2b9925bcc4 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] [instance: c7b3eac2-a51b-40e7-a199-66aee8d2da09] Start _get_guest_xml network_info=[{"id": "ee3648b5-a27a-401d-8708-e25f28d987da", "address": "fa:16:3e:37:0b:9c", "network": {"id": "fe5f7093-1cdd-465c-97f0-7d7b2dd1fa8a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1755065955-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4bfce59008d44fdb5ba91c70f1cf044", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee3648b5-a2", "ovs_interfaceid": "ee3648b5-a27a-401d-8708-e25f28d987da", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=f5ffbc98-11a7-4f8a-a6c2-51981767a401,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'disk_bus': 'virtio', 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': 'f5ffbc98-11a7-4f8a-a6c2-51981767a401'}], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'device_type': 'disk', 'attachment_id': '4632ada2-4055-4803-908c-8f447cede8f1', 'guest_format': None, 'disk_bus': 'virtio', 'boot_index': None, 'mount_device': '/dev/vdb', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:ac646643-9cac-4f95-bf27-7156728caf3d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ucbtGIhC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': 'c7b3eac2-a51b-40e7-a199-66aee8d2da09', 'attached_at': '', 'detached_at': '', 'volume_id': 'ac646643-9cac-4f95-bf27-7156728caf3d', 'serial': 'ac646643-9cac-4f95-bf27-7156728caf3d'}, 'volume_type': None} {{(pid=75045) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 23:51:21 user nova-compute[75045]: WARNING nova.virt.libvirt.driver [None req-2968ffa5-555e-498e-b54a-bb2b9925bcc4 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 23:51:21 user nova-compute[75045]: WARNING nova.virt.libvirt.driver [None req-2968ffa5-555e-498e-b54a-bb2b9925bcc4 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 23:51:21 user nova-compute[75045]: DEBUG nova.virt.libvirt.host [None req-2968ffa5-555e-498e-b54a-bb2b9925bcc4 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75045) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 23:51:21 user nova-compute[75045]: DEBUG nova.virt.libvirt.host [None req-2968ffa5-555e-498e-b54a-bb2b9925bcc4 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] CPU controller missing on host. {{(pid=75045) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 23:51:21 user nova-compute[75045]: DEBUG nova.virt.libvirt.host [None req-2968ffa5-555e-498e-b54a-bb2b9925bcc4 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75045) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 23:51:21 user nova-compute[75045]: DEBUG nova.virt.libvirt.host [None req-2968ffa5-555e-498e-b54a-bb2b9925bcc4 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] CPU controller found on host. {{(pid=75045) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 23:51:21 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-2968ffa5-555e-498e-b54a-bb2b9925bcc4 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75045) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 23:51:21 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-2968ffa5-555e-498e-b54a-bb2b9925bcc4 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T23:11:41Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=f5ffbc98-11a7-4f8a-a6c2-51981767a401,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75045) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 23:51:21 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-2968ffa5-555e-498e-b54a-bb2b9925bcc4 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] Flavor limits 0:0:0 {{(pid=75045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 23:51:21 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-2968ffa5-555e-498e-b54a-bb2b9925bcc4 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] Image limits 0:0:0 {{(pid=75045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 23:51:21 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-2968ffa5-555e-498e-b54a-bb2b9925bcc4 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] Flavor pref 0:0:0 {{(pid=75045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 23:51:21 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-2968ffa5-555e-498e-b54a-bb2b9925bcc4 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] Image pref 0:0:0 {{(pid=75045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 23:51:21 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-2968ffa5-555e-498e-b54a-bb2b9925bcc4 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 23:51:21 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-2968ffa5-555e-498e-b54a-bb2b9925bcc4 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75045) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 23:51:21 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-2968ffa5-555e-498e-b54a-bb2b9925bcc4 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75045) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 23:51:21 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-2968ffa5-555e-498e-b54a-bb2b9925bcc4 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] Got 1 possible topologies {{(pid=75045) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 23:51:21 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-2968ffa5-555e-498e-b54a-bb2b9925bcc4 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75045) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 23:51:21 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-2968ffa5-555e-498e-b54a-bb2b9925bcc4 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75045) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 23:51:21 user nova-compute[75045]: DEBUG nova.objects.instance [None req-2968ffa5-555e-498e-b54a-bb2b9925bcc4 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] Lazy-loading 'vcpu_model' on Instance uuid c7b3eac2-a51b-40e7-a199-66aee8d2da09 {{(pid=75045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 23:51:21 user nova-compute[75045]: DEBUG nova.objects.base [None req-2968ffa5-555e-498e-b54a-bb2b9925bcc4 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] Object Instance<c7b3eac2-a51b-40e7-a199-66aee8d2da09> lazy-loaded attributes: resources,vcpu_model {{(pid=75045) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 23:51:21 user nova-compute[75045]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2968ffa5-555e-498e-b54a-bb2b9925bcc4 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] [instance: c7b3eac2-a51b-40e7-a199-66aee8d2da09] Calling os-brick to attach iSCSI Volume {{(pid=75045) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 23:51:21 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-2968ffa5-555e-498e-b54a-bb2b9925bcc4 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1b68210460>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ac646643-9cac-4f95-bf27-7156728caf3d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ucbtGIhC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75045) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 23:51:21 user nova-compute[75045]: WARNING os_brick.initiator.connectors.base [None req-2968ffa5-555e-498e-b54a-bb2b9925bcc4 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 23:51:21 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-2968ffa5-555e-498e-b54a-bb2b9925bcc4 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 23:51:21 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-2968ffa5-555e-498e-b54a-bb2b9925bcc4 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 23:51:21 user nova-compute[75045]: WARNING os_brick.initiator.connectors.base [None req-2968ffa5-555e-498e-b54a-bb2b9925bcc4 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 23:51:21 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-2968ffa5-555e-498e-b54a-bb2b9925bcc4 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ac646643-9cac-4f95-bf27-7156728caf3d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 23:51:21 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-2968ffa5-555e-498e-b54a-bb2b9925bcc4 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ac646643-9cac-4f95-bf27-7156728caf3d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 23:51:21 user nova-compute[75045]: INFO os_brick.initiator.connectors.iscsi [None req-2968ffa5-555e-498e-b54a-bb2b9925bcc4 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 23:51:21 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac646643-9cac-4f95-bf27-7156728caf3d -p 172.16.0.220:3260 {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:51:21 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac646643-9cac-4f95-bf27-7156728caf3d -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:51:21 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a058f62-a7fd-42e9-b14e-f1a606db5af7]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:51:21 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-2968ffa5-555e-498e-b54a-bb2b9925bcc4 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 23:51:21 user nova-compute[75045]:  {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:51:21 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac646643-9cac-4f95-bf27-7156728caf3d -p 172.16.0.220:3260 --interface default --op new {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:51:21 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac646643-9cac-4f95-bf27-7156728caf3d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:51:21 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d5061cd-d613-4848-b348-93b489ed7825]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ac646643-9cac-4f95-bf27-7156728caf3d] added\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:51:21 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-2968ffa5-555e-498e-b54a-bb2b9925bcc4 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ac646643-9cac-4f95-bf27-7156728caf3d] added
Nov 08 23:51:21 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:51:21 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac646643-9cac-4f95-bf27-7156728caf3d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:51:21 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac646643-9cac-4f95-bf27-7156728caf3d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:51:21 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ad2044d-eaed-4823-b427-2d2c0110d083]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:51:21 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-2968ffa5-555e-498e-b54a-bb2b9925bcc4 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:51:21 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac646643-9cac-4f95-bf27-7156728caf3d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:51:21 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac646643-9cac-4f95-bf27-7156728caf3d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:51:21 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d15b075-d820-4ebb-a093-cc4b523f0609]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:51:21 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-2968ffa5-555e-498e-b54a-bb2b9925bcc4 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:51:21 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac646643-9cac-4f95-bf27-7156728caf3d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ucbtGIhC {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:51:21 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac646643-9cac-4f95-bf27-7156728caf3d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ucbtGIhC" returned: 0 in 0.017s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:51:21 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6ffa919-d33b-4076-ad00-9a1cd332ea4d]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:51:21 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-2968ffa5-555e-498e-b54a-bb2b9925bcc4 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ucbtGIhC'): stdout= stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:51:21 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac646643-9cac-4f95-bf27-7156728caf3d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:51:21 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac646643-9cac-4f95-bf27-7156728caf3d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:51:21 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[9181a1ab-ba9e-4cb2-83c2-4b63170adbb6]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:51:21 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-2968ffa5-555e-498e-b54a-bb2b9925bcc4 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:51:21 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:51:21 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:51:21 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b976827-6ed1-44fe-bea8-4ac1b4481646]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:51:21 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-2968ffa5-555e-498e-b54a-bb2b9925bcc4 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 08 23:51:21 user nova-compute[75045]:  {{(pid=75045) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 23:51:21 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-2968ffa5-555e-498e-b54a-bb2b9925bcc4 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 08 23:51:21 user nova-compute[75045]:  {{(pid=75045) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 23:51:21 user nova-compute[75045]: WARNING os_brick.initiator.connectors.iscsi [None req-2968ffa5-555e-498e-b54a-bb2b9925bcc4 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 08 23:51:21 user nova-compute[75045]: 
Nov 08 23:51:21 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac646643-9cac-4f95-bf27-7156728caf3d -p 172.16.0.220:3260 --login {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:51:21 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac646643-9cac-4f95-bf27-7156728caf3d -p 172.16.0.220:3260 --login" returned: 0 in 0.045s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:51:21 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[38b6ea7a-78db-455b-a6af-36b56aa5b516]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ac646643-9cac-4f95-bf27-7156728caf3d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ac646643-9cac-4f95-bf27-7156728caf3d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:51:21 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-2968ffa5-555e-498e-b54a-bb2b9925bcc4 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ac646643-9cac-4f95-bf27-7156728caf3d, portal: 172.16.0.220,3260]
Nov 08 23:51:21 user nova-compute[75045]: Login to [iface: default, target: iqn.2010-10.org.openstack:ac646643-9cac-4f95-bf27-7156728caf3d, portal: 172.16.0.220,3260] successful.
Nov 08 23:51:21 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:51:21 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac646643-9cac-4f95-bf27-7156728caf3d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:51:21 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac646643-9cac-4f95-bf27-7156728caf3d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:51:21 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d27df63-53b0-4164-be78-6b991a66a845]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:51:21 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-2968ffa5-555e-498e-b54a-bb2b9925bcc4 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:51:21 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:51:21 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:51:21 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[a74d23f8-bdfd-4bef-b8f4-f6c3936f2c22]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac646643-9cac-4f95-bf27-7156728caf3d (non-flash)\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:51:21 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-2968ffa5-555e-498e-b54a-bb2b9925bcc4 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac646643-9cac-4f95-bf27-7156728caf3d (non-flash)
Nov 08 23:51:21 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 23:51:21 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-2968ffa5-555e-498e-b54a-bb2b9925bcc4 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac646643-9cac-4f95-bf27-7156728caf3d (non-flash)
Nov 08 23:51:21 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 23:51:21 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-2968ffa5-555e-498e-b54a-bb2b9925bcc4 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ac646643-9cac-4f95-bf27-7156728caf3d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.258s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 23:51:21 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-2968ffa5-555e-498e-b54a-bb2b9925bcc4 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] Connected to 172.16.0.220:3260 {{(pid=75045) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 23:51:21 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-2968ffa5-555e-498e-b54a-bb2b9925bcc4 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] HCTL ('33', '-', '-', 0) found on session 48 with lun 0 {{(pid=75045) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 23:51:21 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-2968ffa5-555e-498e-b54a-bb2b9925bcc4 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75045) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 23:51:21 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:51:21 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:51:21 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1d17f9b-3c8c-4af6-a34a-65264ddd60f9]: (4, ('- - 0', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:51:21 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-2968ffa5-555e-498e-b54a-bb2b9925bcc4 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] Searching for a device in session 48 and hctl ['33', '*', '*', 0] yield: None {{(pid=75045) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 23:51:22 user nova-compute[75045]: DEBUG nova.compute.manager [req-a59df733-77e1-4ffd-bb73-7628fb6ab908 req-83f0afec-a9c0-44e9-b3ea-2049b7e018b8 service nova] [instance: c7b3eac2-a51b-40e7-a199-66aee8d2da09] Received event network-vif-plugged-ee3648b5-a27a-401d-8708-e25f28d987da {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:51:22 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-a59df733-77e1-4ffd-bb73-7628fb6ab908 req-83f0afec-a9c0-44e9-b3ea-2049b7e018b8 service nova] Acquiring lock "c7b3eac2-a51b-40e7-a199-66aee8d2da09-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:51:22 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-a59df733-77e1-4ffd-bb73-7628fb6ab908 req-83f0afec-a9c0-44e9-b3ea-2049b7e018b8 service nova] Lock "c7b3eac2-a51b-40e7-a199-66aee8d2da09-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:51:22 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-a59df733-77e1-4ffd-bb73-7628fb6ab908 req-83f0afec-a9c0-44e9-b3ea-2049b7e018b8 service nova] Lock "c7b3eac2-a51b-40e7-a199-66aee8d2da09-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:51:22 user nova-compute[75045]: DEBUG nova.compute.manager [req-a59df733-77e1-4ffd-bb73-7628fb6ab908 req-83f0afec-a9c0-44e9-b3ea-2049b7e018b8 service nova] [instance: c7b3eac2-a51b-40e7-a199-66aee8d2da09] No waiting events found dispatching network-vif-plugged-ee3648b5-a27a-401d-8708-e25f28d987da {{(pid=75045) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 23:51:22 user nova-compute[75045]: WARNING nova.compute.manager [req-a59df733-77e1-4ffd-bb73-7628fb6ab908 req-83f0afec-a9c0-44e9-b3ea-2049b7e018b8 service nova] [instance: c7b3eac2-a51b-40e7-a199-66aee8d2da09] Received unexpected event network-vif-plugged-ee3648b5-a27a-401d-8708-e25f28d987da for instance with vm_state active and task_state reboot_started_hard.
Nov 08 23:51:22 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-2968ffa5-555e-498e-b54a-bb2b9925bcc4 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] Searching for a device in session 48 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75045) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 23:51:22 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-2968ffa5-555e-498e-b54a-bb2b9925bcc4 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:ac646643-9cac-4f95-bf27-7156728caf3d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ucbtGIhC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75045) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 23:51:22 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-2968ffa5-555e-498e-b54a-bb2b9925bcc4 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.287s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 23:51:22 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-2968ffa5-555e-498e-b54a-bb2b9925bcc4 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] <== connect_volume: return (1288ms) {'type': 'block', 'scsi_wwn': '26430386437373639', 'path': '/dev/sdb'} {{(pid=75045) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 23:51:22 user nova-compute[75045]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2968ffa5-555e-498e-b54a-bb2b9925bcc4 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] [instance: c7b3eac2-a51b-40e7-a199-66aee8d2da09] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26430386437373639', 'path': '/dev/sdb'} {{(pid=75045) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 23:51:22 user nova-compute[75045]: DEBUG nova.virt.libvirt.vif [None req-2968ffa5-555e-498e-b54a-bb2b9925bcc4 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T23:48:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1921157809',display_name='tempest-TestMinimumBasicScenario-server-1921157809',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1921157809',id=46,image_ref='f5ffbc98-11a7-4f8a-a6c2-51981767a401',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHecd69gYgaSALnbnoSk8qN0iobdxEqArnmuB2X8R1yl+8miN9+r40m6x9O1njTg8e0tQbpEe+KRfZaDGySkJLV+Zispu3OSLEK+XK2OAmFWBfz0y5wJsz4CCuk3AqcQeQ==',key_name='tempest-TestMinimumBasicScenario-2120728013',keypairs=<?>,launch_index=0,launched_at=2023-11-08T23:48:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c4bfce59008d44fdb5ba91c70f1cf044',ramdisk_id='',reservation_id='r-3g7sio6l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f5ffbc98-11a7-4f8a-a6c2-51981767a401',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1125576376',owner_user_name='tempest-TestMinimumBasicScenario-1125576376-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T23:51:20Z,user_data=None,user_id='4ed9cd91d0654f4aa4d620c9f0eb2766',uuid=c7b3eac2-a51b-40e7-a199-66aee8d2da09,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ee3648b5-a27a-401d-8708-e25f28d987da", "address": "fa:16:3e:37:0b:9c", "network": {"id": "fe5f7093-1cdd-465c-97f0-7d7b2dd1fa8a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1755065955-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4bfce59008d44fdb5ba91c70f1cf044", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee3648b5-a2", "ovs_interfaceid": "ee3648b5-a27a-401d-8708-e25f28d987da", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75045) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 23:51:22 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-2968ffa5-555e-498e-b54a-bb2b9925bcc4 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] Converting VIF {"id": "ee3648b5-a27a-401d-8708-e25f28d987da", "address": "fa:16:3e:37:0b:9c", "network": {"id": "fe5f7093-1cdd-465c-97f0-7d7b2dd1fa8a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1755065955-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4bfce59008d44fdb5ba91c70f1cf044", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee3648b5-a2", "ovs_interfaceid": "ee3648b5-a27a-401d-8708-e25f28d987da", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 23:51:22 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-2968ffa5-555e-498e-b54a-bb2b9925bcc4 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:37:0b:9c,bridge_name='br-int',has_traffic_filtering=True,id=ee3648b5-a27a-401d-8708-e25f28d987da,network=Network(fe5f7093-1cdd-465c-97f0-7d7b2dd1fa8a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee3648b5-a2') {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 23:51:22 user nova-compute[75045]: DEBUG nova.objects.instance [None req-2968ffa5-555e-498e-b54a-bb2b9925bcc4 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] Lazy-loading 'pci_devices' on Instance uuid c7b3eac2-a51b-40e7-a199-66aee8d2da09 {{(pid=75045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 23:51:22 user nova-compute[75045]: DEBUG nova.objects.base [None req-2968ffa5-555e-498e-b54a-bb2b9925bcc4 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] Object Instance<c7b3eac2-a51b-40e7-a199-66aee8d2da09> lazy-loaded attributes: resources,vcpu_model,pci_devices {{(pid=75045) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 23:51:22 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-2968ffa5-555e-498e-b54a-bb2b9925bcc4 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] [instance: c7b3eac2-a51b-40e7-a199-66aee8d2da09] End _get_guest_xml xml=<domain type="kvm">
Nov 08 23:51:22 user nova-compute[75045]:   <uuid>c7b3eac2-a51b-40e7-a199-66aee8d2da09</uuid>
Nov 08 23:51:22 user nova-compute[75045]:   <name>instance-0000002e</name>
Nov 08 23:51:22 user nova-compute[75045]:   <memory>524288</memory>
Nov 08 23:51:22 user nova-compute[75045]:   <vcpu>1</vcpu>
Nov 08 23:51:22 user nova-compute[75045]:   <metadata>
Nov 08 23:51:22 user nova-compute[75045]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 23:51:22 user nova-compute[75045]:       <nova:package version="0.0.0"/>
Nov 08 23:51:22 user nova-compute[75045]:       <nova:name>tempest-TestMinimumBasicScenario-server-1921157809</nova:name>
Nov 08 23:51:22 user nova-compute[75045]:       <nova:creationTime>2023-11-08 23:51:21</nova:creationTime>
Nov 08 23:51:22 user nova-compute[75045]:       <nova:flavor name="m1.tiny">
Nov 08 23:51:22 user nova-compute[75045]:         <nova:memory>512</nova:memory>
Nov 08 23:51:22 user nova-compute[75045]:         <nova:disk>1</nova:disk>
Nov 08 23:51:22 user nova-compute[75045]:         <nova:swap>0</nova:swap>
Nov 08 23:51:22 user nova-compute[75045]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 23:51:22 user nova-compute[75045]:         <nova:vcpus>1</nova:vcpus>
Nov 08 23:51:22 user nova-compute[75045]:       </nova:flavor>
Nov 08 23:51:22 user nova-compute[75045]:       <nova:owner>
Nov 08 23:51:22 user nova-compute[75045]:         <nova:user uuid="4ed9cd91d0654f4aa4d620c9f0eb2766">tempest-TestMinimumBasicScenario-1125576376-project-member</nova:user>
Nov 08 23:51:22 user nova-compute[75045]:         <nova:project uuid="c4bfce59008d44fdb5ba91c70f1cf044">tempest-TestMinimumBasicScenario-1125576376</nova:project>
Nov 08 23:51:22 user nova-compute[75045]:       </nova:owner>
Nov 08 23:51:22 user nova-compute[75045]:       <nova:root type="image" uuid="f5ffbc98-11a7-4f8a-a6c2-51981767a401"/>
Nov 08 23:51:22 user nova-compute[75045]:       <nova:ports>
Nov 08 23:51:22 user nova-compute[75045]:         <nova:port uuid="ee3648b5-a27a-401d-8708-e25f28d987da">
Nov 08 23:51:22 user nova-compute[75045]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 08 23:51:22 user nova-compute[75045]:         </nova:port>
Nov 08 23:51:22 user nova-compute[75045]:       </nova:ports>
Nov 08 23:51:22 user nova-compute[75045]:     </nova:instance>
Nov 08 23:51:22 user nova-compute[75045]:   </metadata>
Nov 08 23:51:22 user nova-compute[75045]:   <sysinfo type="smbios">
Nov 08 23:51:22 user nova-compute[75045]:     <system>
Nov 08 23:51:22 user nova-compute[75045]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 23:51:22 user nova-compute[75045]:       <entry name="product">OpenStack Nova</entry>
Nov 08 23:51:22 user nova-compute[75045]:       <entry name="version">0.0.0</entry>
Nov 08 23:51:22 user nova-compute[75045]:       <entry name="serial">c7b3eac2-a51b-40e7-a199-66aee8d2da09</entry>
Nov 08 23:51:22 user nova-compute[75045]:       <entry name="uuid">c7b3eac2-a51b-40e7-a199-66aee8d2da09</entry>
Nov 08 23:51:22 user nova-compute[75045]:       <entry name="family">Virtual Machine</entry>
Nov 08 23:51:22 user nova-compute[75045]:     </system>
Nov 08 23:51:22 user nova-compute[75045]:   </sysinfo>
Nov 08 23:51:22 user nova-compute[75045]:   <os>
Nov 08 23:51:22 user nova-compute[75045]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 23:51:22 user nova-compute[75045]:     <boot dev="hd"/>
Nov 08 23:51:22 user nova-compute[75045]:     <smbios mode="sysinfo"/>
Nov 08 23:51:22 user nova-compute[75045]:   </os>
Nov 08 23:51:22 user nova-compute[75045]:   <features>
Nov 08 23:51:22 user nova-compute[75045]:     <acpi/>
Nov 08 23:51:22 user nova-compute[75045]:     <apic/>
Nov 08 23:51:22 user nova-compute[75045]:     <vmcoreinfo/>
Nov 08 23:51:22 user nova-compute[75045]:   </features>
Nov 08 23:51:22 user nova-compute[75045]:   <clock offset="utc">
Nov 08 23:51:22 user nova-compute[75045]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 23:51:22 user nova-compute[75045]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 23:51:22 user nova-compute[75045]:     <timer name="hpet" present="no"/>
Nov 08 23:51:22 user nova-compute[75045]:   </clock>
Nov 08 23:51:22 user nova-compute[75045]:   <cpu mode="custom" match="exact">
Nov 08 23:51:22 user nova-compute[75045]:     <model>Nehalem</model>
Nov 08 23:51:22 user nova-compute[75045]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 23:51:22 user nova-compute[75045]:   </cpu>
Nov 08 23:51:22 user nova-compute[75045]:   <devices>
Nov 08 23:51:22 user nova-compute[75045]:     <disk type="file" device="disk">
Nov 08 23:51:22 user nova-compute[75045]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 23:51:22 user nova-compute[75045]:       <source file="/opt/stack/data/nova/instances/c7b3eac2-a51b-40e7-a199-66aee8d2da09/disk"/>
Nov 08 23:51:22 user nova-compute[75045]:       <target dev="vda" bus="virtio"/>
Nov 08 23:51:22 user nova-compute[75045]:     </disk>
Nov 08 23:51:22 user nova-compute[75045]:     <disk type="block" device="disk">
Nov 08 23:51:22 user nova-compute[75045]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 23:51:22 user nova-compute[75045]:       <source dev="/dev/sdb"/>
Nov 08 23:51:22 user nova-compute[75045]:       <target dev="vdb" bus="virtio"/>
Nov 08 23:51:22 user nova-compute[75045]:       <serial>ac646643-9cac-4f95-bf27-7156728caf3d</serial>
Nov 08 23:51:22 user nova-compute[75045]:     </disk>
Nov 08 23:51:22 user nova-compute[75045]:     <interface type="ethernet">
Nov 08 23:51:22 user nova-compute[75045]:       <mac address="fa:16:3e:37:0b:9c"/>
Nov 08 23:51:22 user nova-compute[75045]:       <model type="virtio"/>
Nov 08 23:51:22 user nova-compute[75045]:       <mtu size="1442"/>
Nov 08 23:51:22 user nova-compute[75045]:       <target dev="tapee3648b5-a2"/>
Nov 08 23:51:22 user nova-compute[75045]:     </interface>
Nov 08 23:51:22 user nova-compute[75045]:     <serial type="pty">
Nov 08 23:51:22 user nova-compute[75045]:       <log file="/opt/stack/data/nova/instances/c7b3eac2-a51b-40e7-a199-66aee8d2da09/console.log" append="off"/>
Nov 08 23:51:22 user nova-compute[75045]:     </serial>
Nov 08 23:51:22 user nova-compute[75045]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 23:51:22 user nova-compute[75045]:     <video>
Nov 08 23:51:22 user nova-compute[75045]:       <model type="virtio"/>
Nov 08 23:51:22 user nova-compute[75045]:     </video>
Nov 08 23:51:22 user nova-compute[75045]:     <rng model="virtio">
Nov 08 23:51:22 user nova-compute[75045]:       <backend model="random">/dev/urandom</backend>
Nov 08 23:51:22 user nova-compute[75045]:     </rng>
Nov 08 23:51:22 user nova-compute[75045]:     <controller type="usb" index="0" model="none"/>
Nov 08 23:51:22 user nova-compute[75045]:     <memballoon model="virtio">
Nov 08 23:51:22 user nova-compute[75045]:       <stats period="10"/>
Nov 08 23:51:22 user nova-compute[75045]:     </memballoon>
Nov 08 23:51:22 user nova-compute[75045]:   </devices>
Nov 08 23:51:22 user nova-compute[75045]: </domain>
Nov 08 23:51:22 user nova-compute[75045]:  {{(pid=75045) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 23:51:22 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2968ffa5-555e-498e-b54a-bb2b9925bcc4 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7b3eac2-a51b-40e7-a199-66aee8d2da09/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:51:22 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2968ffa5-555e-498e-b54a-bb2b9925bcc4 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7b3eac2-a51b-40e7-a199-66aee8d2da09/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:51:22 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2968ffa5-555e-498e-b54a-bb2b9925bcc4 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7b3eac2-a51b-40e7-a199-66aee8d2da09/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:51:22 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2968ffa5-555e-498e-b54a-bb2b9925bcc4 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7b3eac2-a51b-40e7-a199-66aee8d2da09/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:51:22 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-2968ffa5-555e-498e-b54a-bb2b9925bcc4 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75045) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 23:51:22 user nova-compute[75045]: DEBUG nova.objects.instance [None req-2968ffa5-555e-498e-b54a-bb2b9925bcc4 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] Lazy-loading 'trusted_certs' on Instance uuid c7b3eac2-a51b-40e7-a199-66aee8d2da09 {{(pid=75045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 23:51:22 user nova-compute[75045]: DEBUG nova.objects.base [None req-2968ffa5-555e-498e-b54a-bb2b9925bcc4 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] Object Instance<c7b3eac2-a51b-40e7-a199-66aee8d2da09> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs {{(pid=75045) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 23:51:22 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2968ffa5-555e-498e-b54a-bb2b9925bcc4 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2bbd956825794d94fd2176fa0e6b84d8b10a2324 --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:51:23 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2968ffa5-555e-498e-b54a-bb2b9925bcc4 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2bbd956825794d94fd2176fa0e6b84d8b10a2324 --force-share --output=json" returned: 0 in 0.194s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:51:23 user nova-compute[75045]: DEBUG nova.virt.disk.api [None req-2968ffa5-555e-498e-b54a-bb2b9925bcc4 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c7b3eac2-a51b-40e7-a199-66aee8d2da09/disk. size=1073741824 {{(pid=75045) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 23:51:23 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2968ffa5-555e-498e-b54a-bb2b9925bcc4 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7b3eac2-a51b-40e7-a199-66aee8d2da09/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:51:23 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2968ffa5-555e-498e-b54a-bb2b9925bcc4 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7b3eac2-a51b-40e7-a199-66aee8d2da09/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:51:23 user nova-compute[75045]: DEBUG nova.virt.disk.api [None req-2968ffa5-555e-498e-b54a-bb2b9925bcc4 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] Cannot resize image /opt/stack/data/nova/instances/c7b3eac2-a51b-40e7-a199-66aee8d2da09/disk to a smaller size. {{(pid=75045) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 08 23:51:23 user nova-compute[75045]: DEBUG nova.objects.instance [None req-2968ffa5-555e-498e-b54a-bb2b9925bcc4 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] Lazy-loading 'migration_context' on Instance uuid c7b3eac2-a51b-40e7-a199-66aee8d2da09 {{(pid=75045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 23:51:23 user nova-compute[75045]: DEBUG nova.objects.base [None req-2968ffa5-555e-498e-b54a-bb2b9925bcc4 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] Object Instance<c7b3eac2-a51b-40e7-a199-66aee8d2da09> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=75045) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 23:51:23 user nova-compute[75045]: DEBUG nova.virt.libvirt.vif [None req-2968ffa5-555e-498e-b54a-bb2b9925bcc4 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T23:48:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1921157809',display_name='tempest-TestMinimumBasicScenario-server-1921157809',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1921157809',id=46,image_ref='f5ffbc98-11a7-4f8a-a6c2-51981767a401',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHecd69gYgaSALnbnoSk8qN0iobdxEqArnmuB2X8R1yl+8miN9+r40m6x9O1njTg8e0tQbpEe+KRfZaDGySkJLV+Zispu3OSLEK+XK2OAmFWBfz0y5wJsz4CCuk3AqcQeQ==',key_name='tempest-TestMinimumBasicScenario-2120728013',keypairs=<?>,launch_index=0,launched_at=2023-11-08T23:48:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=1,progress=0,project_id='c4bfce59008d44fdb5ba91c70f1cf044',ramdisk_id='',reservation_id='r-3g7sio6l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f5ffbc98-11a7-4f8a-a6c2-51981767a401',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1125576376',owner_user_name='tempest-TestMinimumBasicScenario-1125576376-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T23:51:20Z,user_data=None,user_id='4ed9cd91d0654f4aa4d620c9f0eb2766',uuid=c7b3eac2-a51b-40e7-a199-66aee8d2da09,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ee3648b5-a27a-401d-8708-e25f28d987da", "address": "fa:16:3e:37:0b:9c", "network": {"id": "fe5f7093-1cdd-465c-97f0-7d7b2dd1fa8a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1755065955-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4bfce59008d44fdb5ba91c70f1cf044", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee3648b5-a2", "ovs_interfaceid": "ee3648b5-a27a-401d-8708-e25f28d987da", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75045) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 23:51:23 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-2968ffa5-555e-498e-b54a-bb2b9925bcc4 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] Converting VIF {"id": "ee3648b5-a27a-401d-8708-e25f28d987da", "address": "fa:16:3e:37:0b:9c", "network": {"id": "fe5f7093-1cdd-465c-97f0-7d7b2dd1fa8a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1755065955-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4bfce59008d44fdb5ba91c70f1cf044", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee3648b5-a2", "ovs_interfaceid": "ee3648b5-a27a-401d-8708-e25f28d987da", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 23:51:23 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-2968ffa5-555e-498e-b54a-bb2b9925bcc4 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:37:0b:9c,bridge_name='br-int',has_traffic_filtering=True,id=ee3648b5-a27a-401d-8708-e25f28d987da,network=Network(fe5f7093-1cdd-465c-97f0-7d7b2dd1fa8a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee3648b5-a2') {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 23:51:23 user nova-compute[75045]: DEBUG os_vif [None req-2968ffa5-555e-498e-b54a-bb2b9925bcc4 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:37:0b:9c,bridge_name='br-int',has_traffic_filtering=True,id=ee3648b5-a27a-401d-8708-e25f28d987da,network=Network(fe5f7093-1cdd-465c-97f0-7d7b2dd1fa8a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee3648b5-a2') {{(pid=75045) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 23:51:23 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:51:23 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:51:23 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 23:51:23 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:51:23 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4143a020-6b0e-5e9a-acad-dad01c60639d', '_type': 'linux-noop'}}, row=False) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:51:23 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:51:23 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 23:51:23 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:51:23 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapee3648b5-a2, may_exist=True, interface_attrs={}) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:51:23 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapee3648b5-a2, col_values=(('qos', UUID('316d39b4-7579-4149-9315-373c18b2cc44')),), if_exists=True) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:51:23 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapee3648b5-a2, col_values=(('external_ids', {'iface-id': 'ee3648b5-a27a-401d-8708-e25f28d987da', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:37:0b:9c', 'vm-uuid': 'c7b3eac2-a51b-40e7-a199-66aee8d2da09'}),), if_exists=True) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:51:23 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:51:23 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 23:51:23 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:51:23 user nova-compute[75045]: INFO os_vif [None req-2968ffa5-555e-498e-b54a-bb2b9925bcc4 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:37:0b:9c,bridge_name='br-int',has_traffic_filtering=True,id=ee3648b5-a27a-401d-8708-e25f28d987da,network=Network(fe5f7093-1cdd-465c-97f0-7d7b2dd1fa8a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee3648b5-a2')
Nov 08 23:51:24 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-98dd72b6-7b75-40ce-8351-40bca2b29e1c tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Acquiring lock "08fae2f1-6fa1-41f9-b6ac-7ea5ff7ce089" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:51:24 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-98dd72b6-7b75-40ce-8351-40bca2b29e1c tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Lock "08fae2f1-6fa1-41f9-b6ac-7ea5ff7ce089" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:51:24 user nova-compute[75045]: DEBUG nova.compute.manager [None req-98dd72b6-7b75-40ce-8351-40bca2b29e1c tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] [instance: 08fae2f1-6fa1-41f9-b6ac-7ea5ff7ce089] Starting instance... {{(pid=75045) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 23:51:24 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-98dd72b6-7b75-40ce-8351-40bca2b29e1c tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:51:24 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-98dd72b6-7b75-40ce-8351-40bca2b29e1c tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:51:24 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-98dd72b6-7b75-40ce-8351-40bca2b29e1c tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75045) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 23:51:24 user nova-compute[75045]: INFO nova.compute.claims [None req-98dd72b6-7b75-40ce-8351-40bca2b29e1c tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] [instance: 08fae2f1-6fa1-41f9-b6ac-7ea5ff7ce089] Claim successful on node user
Nov 08 23:51:24 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:51:24 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:51:24 user nova-compute[75045]: DEBUG nova.compute.provider_tree [None req-98dd72b6-7b75-40ce-8351-40bca2b29e1c tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Inventory has not changed in ProviderTree for provider: 62ba5f85-c74d-4b58-986e-d4197e813fd7 {{(pid=75045) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 23:51:24 user nova-compute[75045]: DEBUG nova.compute.manager [req-54eba5f3-47b3-4fba-a1b6-770f862682d7 req-e874d1ba-e295-4104-9247-f6bb62174980 service nova] [instance: c7b3eac2-a51b-40e7-a199-66aee8d2da09] Received event network-vif-plugged-ee3648b5-a27a-401d-8708-e25f28d987da {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:51:24 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-54eba5f3-47b3-4fba-a1b6-770f862682d7 req-e874d1ba-e295-4104-9247-f6bb62174980 service nova] Acquiring lock "c7b3eac2-a51b-40e7-a199-66aee8d2da09-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:51:24 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-54eba5f3-47b3-4fba-a1b6-770f862682d7 req-e874d1ba-e295-4104-9247-f6bb62174980 service nova] Lock "c7b3eac2-a51b-40e7-a199-66aee8d2da09-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:51:24 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-54eba5f3-47b3-4fba-a1b6-770f862682d7 req-e874d1ba-e295-4104-9247-f6bb62174980 service nova] Lock "c7b3eac2-a51b-40e7-a199-66aee8d2da09-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:51:24 user nova-compute[75045]: DEBUG nova.compute.manager [req-54eba5f3-47b3-4fba-a1b6-770f862682d7 req-e874d1ba-e295-4104-9247-f6bb62174980 service nova] [instance: c7b3eac2-a51b-40e7-a199-66aee8d2da09] No waiting events found dispatching network-vif-plugged-ee3648b5-a27a-401d-8708-e25f28d987da {{(pid=75045) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 23:51:24 user nova-compute[75045]: WARNING nova.compute.manager [req-54eba5f3-47b3-4fba-a1b6-770f862682d7 req-e874d1ba-e295-4104-9247-f6bb62174980 service nova] [instance: c7b3eac2-a51b-40e7-a199-66aee8d2da09] Received unexpected event network-vif-plugged-ee3648b5-a27a-401d-8708-e25f28d987da for instance with vm_state active and task_state reboot_started_hard.
Nov 08 23:51:24 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._run_image_cache_manager_pass {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:51:24 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:51:24 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:51:24 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: held 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:51:24 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:51:24 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: waited 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:51:24 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: held 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:51:24 user nova-compute[75045]: DEBUG nova.scheduler.client.report [None req-98dd72b6-7b75-40ce-8351-40bca2b29e1c tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Inventory has not changed for provider 62ba5f85-c74d-4b58-986e-d4197e813fd7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75045) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 23:51:25 user nova-compute[75045]: DEBUG nova.virt.libvirt.imagecache [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Verify base images {{(pid=75045) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:314}}
Nov 08 23:51:25 user nova-compute[75045]: DEBUG nova.virt.libvirt.imagecache [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Image id  yields fingerprint da39a3ee5e6b4b0d3255bfef95601890afd80709 {{(pid=75045) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Nov 08 23:51:25 user nova-compute[75045]: DEBUG nova.virt.libvirt.imagecache [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Image id a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb yields fingerprint b59f52a99fff51c56dd1edfb83892fb8f647f2f3 {{(pid=75045) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Nov 08 23:51:25 user nova-compute[75045]: INFO nova.virt.libvirt.imagecache [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] image a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb at (/opt/stack/data/nova/instances/_base/b59f52a99fff51c56dd1edfb83892fb8f647f2f3): checking
Nov 08 23:51:25 user nova-compute[75045]: DEBUG nova.virt.libvirt.imagecache [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] image a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb at (/opt/stack/data/nova/instances/_base/b59f52a99fff51c56dd1edfb83892fb8f647f2f3): image is in use {{(pid=75045) _mark_in_use /opt/stack/nova/nova/virt/libvirt/imagecache.py:279}}
Nov 08 23:51:25 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-98dd72b6-7b75-40ce-8351-40bca2b29e1c tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.393s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:51:25 user nova-compute[75045]: DEBUG nova.compute.manager [None req-98dd72b6-7b75-40ce-8351-40bca2b29e1c tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] [instance: 08fae2f1-6fa1-41f9-b6ac-7ea5ff7ce089] Start building networks asynchronously for instance. {{(pid=75045) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 23:51:25 user nova-compute[75045]: DEBUG nova.virt.libvirt.imagecache [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Image id f5ffbc98-11a7-4f8a-a6c2-51981767a401 yields fingerprint 2bbd956825794d94fd2176fa0e6b84d8b10a2324 {{(pid=75045) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Nov 08 23:51:25 user nova-compute[75045]: INFO nova.virt.libvirt.imagecache [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] image f5ffbc98-11a7-4f8a-a6c2-51981767a401 at (/opt/stack/data/nova/instances/_base/2bbd956825794d94fd2176fa0e6b84d8b10a2324): checking
Nov 08 23:51:25 user nova-compute[75045]: DEBUG nova.virt.libvirt.imagecache [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] image f5ffbc98-11a7-4f8a-a6c2-51981767a401 at (/opt/stack/data/nova/instances/_base/2bbd956825794d94fd2176fa0e6b84d8b10a2324): image is in use {{(pid=75045) _mark_in_use /opt/stack/nova/nova/virt/libvirt/imagecache.py:279}}
Nov 08 23:51:25 user nova-compute[75045]: DEBUG nova.virt.libvirt.imagecache [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] 354550b2-9cf4-4a7b-b3c9-c9f3b1a04dea is a valid instance name {{(pid=75045) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Nov 08 23:51:25 user nova-compute[75045]: DEBUG nova.virt.libvirt.imagecache [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] 354550b2-9cf4-4a7b-b3c9-c9f3b1a04dea has a disk file {{(pid=75045) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Nov 08 23:51:25 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/354550b2-9cf4-4a7b-b3c9-c9f3b1a04dea/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:51:25 user nova-compute[75045]: DEBUG nova.compute.manager [None req-98dd72b6-7b75-40ce-8351-40bca2b29e1c tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] [instance: 08fae2f1-6fa1-41f9-b6ac-7ea5ff7ce089] Allocating IP information in the background. {{(pid=75045) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 23:51:25 user nova-compute[75045]: DEBUG nova.network.neutron [None req-98dd72b6-7b75-40ce-8351-40bca2b29e1c tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] [instance: 08fae2f1-6fa1-41f9-b6ac-7ea5ff7ce089] allocate_for_instance() {{(pid=75045) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 23:51:25 user nova-compute[75045]: INFO nova.virt.libvirt.driver [None req-98dd72b6-7b75-40ce-8351-40bca2b29e1c tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] [instance: 08fae2f1-6fa1-41f9-b6ac-7ea5ff7ce089] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 23:51:25 user nova-compute[75045]: DEBUG nova.compute.manager [None req-98dd72b6-7b75-40ce-8351-40bca2b29e1c tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] [instance: 08fae2f1-6fa1-41f9-b6ac-7ea5ff7ce089] Start building block device mappings for instance. {{(pid=75045) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 23:51:25 user nova-compute[75045]: INFO nova.virt.block_device [None req-98dd72b6-7b75-40ce-8351-40bca2b29e1c tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] [instance: 08fae2f1-6fa1-41f9-b6ac-7ea5ff7ce089] Booting with volume dcbd911e-f385-4ed6-b8a4-383b3b56cf7d at /dev/vda
Nov 08 23:51:25 user nova-compute[75045]: DEBUG nova.policy [None req-98dd72b6-7b75-40ce-8351-40bca2b29e1c tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '76c31c64d9594f9cbef7586fafb48721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd59b73851c79473a9c2cdc0a120dfee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75045) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 23:51:25 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/354550b2-9cf4-4a7b-b3c9-c9f3b1a04dea/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:51:25 user nova-compute[75045]: DEBUG nova.virt.libvirt.imagecache [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Instance 354550b2-9cf4-4a7b-b3c9-c9f3b1a04dea is backed by b59f52a99fff51c56dd1edfb83892fb8f647f2f3 {{(pid=75045) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Nov 08 23:51:25 user nova-compute[75045]: DEBUG nova.virt.libvirt.imagecache [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] c7b3eac2-a51b-40e7-a199-66aee8d2da09 is a valid instance name {{(pid=75045) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Nov 08 23:51:25 user nova-compute[75045]: DEBUG nova.virt.libvirt.imagecache [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] c7b3eac2-a51b-40e7-a199-66aee8d2da09 has a disk file {{(pid=75045) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Nov 08 23:51:25 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7b3eac2-a51b-40e7-a199-66aee8d2da09/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:51:25 user nova-compute[75045]: DEBUG os_brick.utils [None req-98dd72b6-7b75-40ce-8351-40bca2b29e1c tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75045) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 23:51:25 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:51:25 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:51:25 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ea0ba02-7c1e-40e5-ab1f-5e3d5a5c4224]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6217bd6e884\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:51:25 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:51:25 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:51:25 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[7157ae96-8e91-466d-a2a1-938e55b92f36]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:51:25 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:51:25 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:51:25 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9f33035-7108-4a71-9fb7-83d54ff6735a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:51:25 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[61e8a206-3cd2-49e8-a837-e17940c3a098]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:51:25 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-98dd72b6-7b75-40ce-8351-40bca2b29e1c tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Running cmd (subprocess): nvme version {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:51:25 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-98dd72b6-7b75-40ce-8351-40bca2b29e1c tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] 'nvme version' failed. Not Retrying. {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 23:51:25 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:51:25 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.nvmeof [None req-98dd72b6-7b75-40ce-8351-40bca2b29e1c tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] nvme not present on system {{(pid=75045) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 23:51:25 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:51:25 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7b3eac2-a51b-40e7-a199-66aee8d2da09/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:51:25 user nova-compute[75045]: DEBUG nova.virt.libvirt.imagecache [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Instance c7b3eac2-a51b-40e7-a199-66aee8d2da09 is backed by 2bbd956825794d94fd2176fa0e6b84d8b10a2324 {{(pid=75045) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Nov 08 23:51:25 user nova-compute[75045]: DEBUG nova.virt.libvirt.imagecache [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] 0b413c71-c13a-4fea-91c4-f6b1953d54c6 is a valid instance name {{(pid=75045) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Nov 08 23:51:25 user nova-compute[75045]: DEBUG nova.virt.libvirt.imagecache [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] 0b413c71-c13a-4fea-91c4-f6b1953d54c6 has a disk file {{(pid=75045) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Nov 08 23:51:25 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b413c71-c13a-4fea-91c4-f6b1953d54c6/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:51:25 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 23:51:25 user nova-compute[75045]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 23:51:25 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[3425ad4b-cd08-4fa6-9fc6-f85f3acde5a2]: (4, '') {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:51:25 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:51:25 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.lightos [None req-98dd72b6-7b75-40ce-8351-40bca2b29e1c tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75045) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 23:51:25 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.lightos [None req-98dd72b6-7b75-40ce-8351-40bca2b29e1c tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75045) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 23:51:25 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.lightos [None req-98dd72b6-7b75-40ce-8351-40bca2b29e1c tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] LIGHTOS: no hostnqn found. {{(pid=75045) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 23:51:25 user nova-compute[75045]: DEBUG os_brick.utils [None req-98dd72b6-7b75-40ce-8351-40bca2b29e1c tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] <== get_connector_properties: return (187ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6217bd6e884', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75045) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 23:51:25 user nova-compute[75045]: DEBUG nova.virt.block_device [None req-98dd72b6-7b75-40ce-8351-40bca2b29e1c tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] [instance: 08fae2f1-6fa1-41f9-b6ac-7ea5ff7ce089] Updating existing volume attachment record: 7b5f8319-16b0-4561-9297-d33df846e848 {{(pid=75045) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 23:51:25 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b413c71-c13a-4fea-91c4-f6b1953d54c6/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:51:25 user nova-compute[75045]: DEBUG nova.virt.libvirt.imagecache [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Instance 0b413c71-c13a-4fea-91c4-f6b1953d54c6 is backed by b59f52a99fff51c56dd1edfb83892fb8f647f2f3 {{(pid=75045) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Nov 08 23:51:25 user nova-compute[75045]: WARNING nova.virt.libvirt.imagecache [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Unknown base file: /opt/stack/data/nova/instances/_base/369f126ab7c81df11aa9b3a6a382ee286861cd79
Nov 08 23:51:25 user nova-compute[75045]: WARNING nova.virt.libvirt.imagecache [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Unknown base file: /opt/stack/data/nova/instances/_base/4b10dc438b97ddb95edd42624e0fcf6950db25c8
Nov 08 23:51:25 user nova-compute[75045]: WARNING nova.virt.libvirt.imagecache [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Unknown base file: /opt/stack/data/nova/instances/_base/68dfa7529f9097fc2d70f3a52153af3b645d08d0
Nov 08 23:51:25 user nova-compute[75045]: WARNING nova.virt.libvirt.imagecache [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Unknown base file: /opt/stack/data/nova/instances/_base/4c51d55374ccc2195641a2efec032472dab01998
Nov 08 23:51:25 user nova-compute[75045]: WARNING nova.virt.libvirt.imagecache [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Unknown base file: /opt/stack/data/nova/instances/_base/fbc8816fee1dd209cdfd9e73c83a2f3b57e284bb
Nov 08 23:51:25 user nova-compute[75045]: WARNING nova.virt.libvirt.imagecache [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Unknown base file: /opt/stack/data/nova/instances/_base/b85a17781a80b384220ab457c3081a93e05fbde2
Nov 08 23:51:25 user nova-compute[75045]: WARNING nova.virt.libvirt.imagecache [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Unknown base file: /opt/stack/data/nova/instances/_base/2d6c1d7f7f6a4d95550ea70183b8136f63691857
Nov 08 23:51:25 user nova-compute[75045]: INFO nova.virt.libvirt.imagecache [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Active base files: /opt/stack/data/nova/instances/_base/b59f52a99fff51c56dd1edfb83892fb8f647f2f3 /opt/stack/data/nova/instances/_base/2bbd956825794d94fd2176fa0e6b84d8b10a2324
Nov 08 23:51:25 user nova-compute[75045]: INFO nova.virt.libvirt.imagecache [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Removable base files: /opt/stack/data/nova/instances/_base/369f126ab7c81df11aa9b3a6a382ee286861cd79 /opt/stack/data/nova/instances/_base/4b10dc438b97ddb95edd42624e0fcf6950db25c8 /opt/stack/data/nova/instances/_base/68dfa7529f9097fc2d70f3a52153af3b645d08d0 /opt/stack/data/nova/instances/_base/4c51d55374ccc2195641a2efec032472dab01998 /opt/stack/data/nova/instances/_base/fbc8816fee1dd209cdfd9e73c83a2f3b57e284bb /opt/stack/data/nova/instances/_base/b85a17781a80b384220ab457c3081a93e05fbde2 /opt/stack/data/nova/instances/_base/2d6c1d7f7f6a4d95550ea70183b8136f63691857
Nov 08 23:51:25 user nova-compute[75045]: INFO nova.virt.libvirt.imagecache [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/369f126ab7c81df11aa9b3a6a382ee286861cd79
Nov 08 23:51:25 user nova-compute[75045]: INFO nova.virt.libvirt.imagecache [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/4b10dc438b97ddb95edd42624e0fcf6950db25c8
Nov 08 23:51:25 user nova-compute[75045]: INFO nova.virt.libvirt.imagecache [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/68dfa7529f9097fc2d70f3a52153af3b645d08d0
Nov 08 23:51:25 user nova-compute[75045]: INFO nova.virt.libvirt.imagecache [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/4c51d55374ccc2195641a2efec032472dab01998
Nov 08 23:51:25 user nova-compute[75045]: INFO nova.virt.libvirt.imagecache [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/fbc8816fee1dd209cdfd9e73c83a2f3b57e284bb
Nov 08 23:51:25 user nova-compute[75045]: INFO nova.virt.libvirt.imagecache [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/b85a17781a80b384220ab457c3081a93e05fbde2
Nov 08 23:51:25 user nova-compute[75045]: INFO nova.virt.libvirt.imagecache [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/2d6c1d7f7f6a4d95550ea70183b8136f63691857
Nov 08 23:51:25 user nova-compute[75045]: DEBUG nova.virt.libvirt.imagecache [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Verification complete {{(pid=75045) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:350}}
Nov 08 23:51:25 user nova-compute[75045]: DEBUG nova.virt.libvirt.imagecache [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Verify swap images {{(pid=75045) _age_and_verify_swap_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:299}}
Nov 08 23:51:25 user nova-compute[75045]: DEBUG nova.virt.libvirt.imagecache [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Verify ephemeral images {{(pid=75045) _age_and_verify_ephemeral_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:284}}
Nov 08 23:51:25 user nova-compute[75045]: DEBUG nova.network.neutron [None req-98dd72b6-7b75-40ce-8351-40bca2b29e1c tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] [instance: 08fae2f1-6fa1-41f9-b6ac-7ea5ff7ce089] Successfully created port: ced9d13a-eae0-4a08-b54c-75e4d1b3234e {{(pid=75045) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 23:51:26 user nova-compute[75045]: DEBUG nova.network.neutron [None req-98dd72b6-7b75-40ce-8351-40bca2b29e1c tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] [instance: 08fae2f1-6fa1-41f9-b6ac-7ea5ff7ce089] Successfully updated port: ced9d13a-eae0-4a08-b54c-75e4d1b3234e {{(pid=75045) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 23:51:26 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-98dd72b6-7b75-40ce-8351-40bca2b29e1c tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Acquiring lock "refresh_cache-08fae2f1-6fa1-41f9-b6ac-7ea5ff7ce089" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 23:51:26 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-98dd72b6-7b75-40ce-8351-40bca2b29e1c tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Acquired lock "refresh_cache-08fae2f1-6fa1-41f9-b6ac-7ea5ff7ce089" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 23:51:26 user nova-compute[75045]: DEBUG nova.network.neutron [None req-98dd72b6-7b75-40ce-8351-40bca2b29e1c tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] [instance: 08fae2f1-6fa1-41f9-b6ac-7ea5ff7ce089] Building network info cache for instance {{(pid=75045) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 23:51:26 user nova-compute[75045]: DEBUG nova.network.neutron [None req-98dd72b6-7b75-40ce-8351-40bca2b29e1c tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] [instance: 08fae2f1-6fa1-41f9-b6ac-7ea5ff7ce089] Instance cache missing network info. {{(pid=75045) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 23:51:26 user nova-compute[75045]: DEBUG nova.network.neutron [None req-98dd72b6-7b75-40ce-8351-40bca2b29e1c tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] [instance: 08fae2f1-6fa1-41f9-b6ac-7ea5ff7ce089] Updating instance_info_cache with network_info: [{"id": "ced9d13a-eae0-4a08-b54c-75e4d1b3234e", "address": "fa:16:3e:b7:c7:a1", "network": {"id": "4205f899-9865-4c65-8b46-c9a533e9bb45", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-774780781-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d59b73851c79473a9c2cdc0a120dfee0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapced9d13a-ea", "ovs_interfaceid": "ced9d13a-eae0-4a08-b54c-75e4d1b3234e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75045) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 23:51:26 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-98dd72b6-7b75-40ce-8351-40bca2b29e1c tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Releasing lock "refresh_cache-08fae2f1-6fa1-41f9-b6ac-7ea5ff7ce089" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 23:51:26 user nova-compute[75045]: DEBUG nova.compute.manager [None req-98dd72b6-7b75-40ce-8351-40bca2b29e1c tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] [instance: 08fae2f1-6fa1-41f9-b6ac-7ea5ff7ce089] Instance network_info: |[{"id": "ced9d13a-eae0-4a08-b54c-75e4d1b3234e", "address": "fa:16:3e:b7:c7:a1", "network": {"id": "4205f899-9865-4c65-8b46-c9a533e9bb45", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-774780781-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d59b73851c79473a9c2cdc0a120dfee0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapced9d13a-ea", "ovs_interfaceid": "ced9d13a-eae0-4a08-b54c-75e4d1b3234e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75045) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 23:51:26 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:51:27 user nova-compute[75045]: DEBUG nova.compute.manager [req-77e3ecb5-d893-488b-abbd-3dee8d097697 req-49571d3d-2bf9-4cc4-99a4-5cd5d5b782fb service nova] [instance: c7b3eac2-a51b-40e7-a199-66aee8d2da09] Received event network-vif-plugged-ee3648b5-a27a-401d-8708-e25f28d987da {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:51:27 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-77e3ecb5-d893-488b-abbd-3dee8d097697 req-49571d3d-2bf9-4cc4-99a4-5cd5d5b782fb service nova] Acquiring lock "c7b3eac2-a51b-40e7-a199-66aee8d2da09-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:51:27 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-77e3ecb5-d893-488b-abbd-3dee8d097697 req-49571d3d-2bf9-4cc4-99a4-5cd5d5b782fb service nova] Lock "c7b3eac2-a51b-40e7-a199-66aee8d2da09-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:51:27 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-77e3ecb5-d893-488b-abbd-3dee8d097697 req-49571d3d-2bf9-4cc4-99a4-5cd5d5b782fb service nova] Lock "c7b3eac2-a51b-40e7-a199-66aee8d2da09-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:51:27 user nova-compute[75045]: DEBUG nova.compute.manager [req-77e3ecb5-d893-488b-abbd-3dee8d097697 req-49571d3d-2bf9-4cc4-99a4-5cd5d5b782fb service nova] [instance: c7b3eac2-a51b-40e7-a199-66aee8d2da09] No waiting events found dispatching network-vif-plugged-ee3648b5-a27a-401d-8708-e25f28d987da {{(pid=75045) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 23:51:27 user nova-compute[75045]: WARNING nova.compute.manager [req-77e3ecb5-d893-488b-abbd-3dee8d097697 req-49571d3d-2bf9-4cc4-99a4-5cd5d5b782fb service nova] [instance: c7b3eac2-a51b-40e7-a199-66aee8d2da09] Received unexpected event network-vif-plugged-ee3648b5-a27a-401d-8708-e25f28d987da for instance with vm_state active and task_state reboot_started_hard.
Nov 08 23:51:27 user nova-compute[75045]: DEBUG nova.compute.manager [req-77e3ecb5-d893-488b-abbd-3dee8d097697 req-49571d3d-2bf9-4cc4-99a4-5cd5d5b782fb service nova] [instance: 08fae2f1-6fa1-41f9-b6ac-7ea5ff7ce089] Received event network-changed-ced9d13a-eae0-4a08-b54c-75e4d1b3234e {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:51:27 user nova-compute[75045]: DEBUG nova.compute.manager [req-77e3ecb5-d893-488b-abbd-3dee8d097697 req-49571d3d-2bf9-4cc4-99a4-5cd5d5b782fb service nova] [instance: 08fae2f1-6fa1-41f9-b6ac-7ea5ff7ce089] Refreshing instance network info cache due to event network-changed-ced9d13a-eae0-4a08-b54c-75e4d1b3234e. {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 23:51:27 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-77e3ecb5-d893-488b-abbd-3dee8d097697 req-49571d3d-2bf9-4cc4-99a4-5cd5d5b782fb service nova] Acquiring lock "refresh_cache-08fae2f1-6fa1-41f9-b6ac-7ea5ff7ce089" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 23:51:27 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-77e3ecb5-d893-488b-abbd-3dee8d097697 req-49571d3d-2bf9-4cc4-99a4-5cd5d5b782fb service nova] Acquired lock "refresh_cache-08fae2f1-6fa1-41f9-b6ac-7ea5ff7ce089" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 23:51:27 user nova-compute[75045]: DEBUG nova.network.neutron [req-77e3ecb5-d893-488b-abbd-3dee8d097697 req-49571d3d-2bf9-4cc4-99a4-5cd5d5b782fb service nova] [instance: 08fae2f1-6fa1-41f9-b6ac-7ea5ff7ce089] Refreshing network info cache for port ced9d13a-eae0-4a08-b54c-75e4d1b3234e {{(pid=75045) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 23:51:27 user nova-compute[75045]: DEBUG nova.compute.manager [None req-2968ffa5-555e-498e-b54a-bb2b9925bcc4 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] [instance: c7b3eac2-a51b-40e7-a199-66aee8d2da09] Instance event wait completed in 0 seconds for  {{(pid=75045) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 23:51:27 user nova-compute[75045]: INFO nova.virt.libvirt.driver [-] [instance: c7b3eac2-a51b-40e7-a199-66aee8d2da09] Instance rebooted successfully.
Nov 08 23:51:27 user nova-compute[75045]: DEBUG nova.compute.manager [None req-2968ffa5-555e-498e-b54a-bb2b9925bcc4 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] [instance: c7b3eac2-a51b-40e7-a199-66aee8d2da09] Checking state {{(pid=75045) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 23:51:27 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2968ffa5-555e-498e-b54a-bb2b9925bcc4 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] Lock "c7b3eac2-a51b-40e7-a199-66aee8d2da09" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 7.941s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:51:27 user nova-compute[75045]: DEBUG nova.network.neutron [req-77e3ecb5-d893-488b-abbd-3dee8d097697 req-49571d3d-2bf9-4cc4-99a4-5cd5d5b782fb service nova] [instance: 08fae2f1-6fa1-41f9-b6ac-7ea5ff7ce089] Updated VIF entry in instance network info cache for port ced9d13a-eae0-4a08-b54c-75e4d1b3234e. {{(pid=75045) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 23:51:27 user nova-compute[75045]: DEBUG nova.network.neutron [req-77e3ecb5-d893-488b-abbd-3dee8d097697 req-49571d3d-2bf9-4cc4-99a4-5cd5d5b782fb service nova] [instance: 08fae2f1-6fa1-41f9-b6ac-7ea5ff7ce089] Updating instance_info_cache with network_info: [{"id": "ced9d13a-eae0-4a08-b54c-75e4d1b3234e", "address": "fa:16:3e:b7:c7:a1", "network": {"id": "4205f899-9865-4c65-8b46-c9a533e9bb45", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-774780781-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d59b73851c79473a9c2cdc0a120dfee0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapced9d13a-ea", "ovs_interfaceid": "ced9d13a-eae0-4a08-b54c-75e4d1b3234e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75045) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 23:51:27 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-77e3ecb5-d893-488b-abbd-3dee8d097697 req-49571d3d-2bf9-4cc4-99a4-5cd5d5b782fb service nova] Releasing lock "refresh_cache-08fae2f1-6fa1-41f9-b6ac-7ea5ff7ce089" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 23:51:28 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:51:32 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:51:33 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:51:38 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 23:51:38 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:51:38 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75045) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 23:51:38 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75045) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 23:51:38 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75045) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 23:51:38 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:51:42 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:51:43 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:51:47 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:51:48 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:51:52 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:51:53 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:51:54 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-5f687722-efe6-4175-9944-48a2028280e8 tempest-VolumesNegativeTest-1756715703 tempest-VolumesNegativeTest-1756715703-project-member] Acquiring lock "354550b2-9cf4-4a7b-b3c9-c9f3b1a04dea" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:51:54 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-5f687722-efe6-4175-9944-48a2028280e8 tempest-VolumesNegativeTest-1756715703 tempest-VolumesNegativeTest-1756715703-project-member] Lock "354550b2-9cf4-4a7b-b3c9-c9f3b1a04dea" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:51:54 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-5f687722-efe6-4175-9944-48a2028280e8 tempest-VolumesNegativeTest-1756715703 tempest-VolumesNegativeTest-1756715703-project-member] Acquiring lock "354550b2-9cf4-4a7b-b3c9-c9f3b1a04dea-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:51:54 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-5f687722-efe6-4175-9944-48a2028280e8 tempest-VolumesNegativeTest-1756715703 tempest-VolumesNegativeTest-1756715703-project-member] Lock "354550b2-9cf4-4a7b-b3c9-c9f3b1a04dea-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:51:54 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-5f687722-efe6-4175-9944-48a2028280e8 tempest-VolumesNegativeTest-1756715703 tempest-VolumesNegativeTest-1756715703-project-member] Lock "354550b2-9cf4-4a7b-b3c9-c9f3b1a04dea-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:51:54 user nova-compute[75045]: INFO nova.compute.manager [None req-5f687722-efe6-4175-9944-48a2028280e8 tempest-VolumesNegativeTest-1756715703 tempest-VolumesNegativeTest-1756715703-project-member] [instance: 354550b2-9cf4-4a7b-b3c9-c9f3b1a04dea] Terminating instance
Nov 08 23:51:54 user nova-compute[75045]: DEBUG nova.compute.manager [None req-5f687722-efe6-4175-9944-48a2028280e8 tempest-VolumesNegativeTest-1756715703 tempest-VolumesNegativeTest-1756715703-project-member] [instance: 354550b2-9cf4-4a7b-b3c9-c9f3b1a04dea] Start destroying the instance on the hypervisor. {{(pid=75045) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 23:51:54 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:51:54 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:51:54 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:51:54 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:51:54 user nova-compute[75045]: DEBUG nova.compute.manager [req-78ea5643-c72f-4162-9dcb-bc67845cda57 req-1af40875-caf1-4e98-8939-a22d7de01253 service nova] [instance: 354550b2-9cf4-4a7b-b3c9-c9f3b1a04dea] Received event network-vif-unplugged-7667374b-3abb-4fc5-a3cf-8388f2947aa3 {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:51:54 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-78ea5643-c72f-4162-9dcb-bc67845cda57 req-1af40875-caf1-4e98-8939-a22d7de01253 service nova] Acquiring lock "354550b2-9cf4-4a7b-b3c9-c9f3b1a04dea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:51:54 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-78ea5643-c72f-4162-9dcb-bc67845cda57 req-1af40875-caf1-4e98-8939-a22d7de01253 service nova] Lock "354550b2-9cf4-4a7b-b3c9-c9f3b1a04dea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:51:54 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-78ea5643-c72f-4162-9dcb-bc67845cda57 req-1af40875-caf1-4e98-8939-a22d7de01253 service nova] Lock "354550b2-9cf4-4a7b-b3c9-c9f3b1a04dea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:51:54 user nova-compute[75045]: DEBUG nova.compute.manager [req-78ea5643-c72f-4162-9dcb-bc67845cda57 req-1af40875-caf1-4e98-8939-a22d7de01253 service nova] [instance: 354550b2-9cf4-4a7b-b3c9-c9f3b1a04dea] No waiting events found dispatching network-vif-unplugged-7667374b-3abb-4fc5-a3cf-8388f2947aa3 {{(pid=75045) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 23:51:54 user nova-compute[75045]: DEBUG nova.compute.manager [req-78ea5643-c72f-4162-9dcb-bc67845cda57 req-1af40875-caf1-4e98-8939-a22d7de01253 service nova] [instance: 354550b2-9cf4-4a7b-b3c9-c9f3b1a04dea] Received event network-vif-unplugged-7667374b-3abb-4fc5-a3cf-8388f2947aa3 for instance with task_state deleting. {{(pid=75045) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 23:51:55 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:51:55 user nova-compute[75045]: INFO nova.virt.libvirt.driver [-] [instance: 354550b2-9cf4-4a7b-b3c9-c9f3b1a04dea] Instance destroyed successfully.
Nov 08 23:51:55 user nova-compute[75045]: DEBUG nova.objects.instance [None req-5f687722-efe6-4175-9944-48a2028280e8 tempest-VolumesNegativeTest-1756715703 tempest-VolumesNegativeTest-1756715703-project-member] Lazy-loading 'resources' on Instance uuid 354550b2-9cf4-4a7b-b3c9-c9f3b1a04dea {{(pid=75045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 23:51:55 user nova-compute[75045]: DEBUG nova.virt.libvirt.vif [None req-5f687722-efe6-4175-9944-48a2028280e8 tempest-VolumesNegativeTest-1756715703 tempest-VolumesNegativeTest-1756715703-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T23:50:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-965261517',display_name='tempest-VolumesNegativeTest-instance-965261517',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-965261517',id=47,image_ref='a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-08T23:50:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='30f84c7bf2484263b838d689595c8e31',ramdisk_id='',reservation_id='r-vcy1s0c3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesNegativeTest-1756715703',owner_user_name='tempest-VolumesNegativeTest-1756715703-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T23:50:13Z,user_data=None,user_id='a1249c15e72d4bee886afe49003c6e98',uuid=354550b2-9cf4-4a7b-b3c9-c9f3b1a04dea,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7667374b-3abb-4fc5-a3cf-8388f2947aa3", "address": "fa:16:3e:25:7e:8e", "network": {"id": "deecb7cd-355d-4c73-93a8-b9251ab6d74e", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.19", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "b1beba2cc4e7465ea249e2225fb494dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7667374b-3a", "ovs_interfaceid": "7667374b-3abb-4fc5-a3cf-8388f2947aa3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75045) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 23:51:55 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-5f687722-efe6-4175-9944-48a2028280e8 tempest-VolumesNegativeTest-1756715703 tempest-VolumesNegativeTest-1756715703-project-member] Converting VIF {"id": "7667374b-3abb-4fc5-a3cf-8388f2947aa3", "address": "fa:16:3e:25:7e:8e", "network": {"id": "deecb7cd-355d-4c73-93a8-b9251ab6d74e", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.19", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "b1beba2cc4e7465ea249e2225fb494dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7667374b-3a", "ovs_interfaceid": "7667374b-3abb-4fc5-a3cf-8388f2947aa3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 23:51:55 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-5f687722-efe6-4175-9944-48a2028280e8 tempest-VolumesNegativeTest-1756715703 tempest-VolumesNegativeTest-1756715703-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:25:7e:8e,bridge_name='br-int',has_traffic_filtering=True,id=7667374b-3abb-4fc5-a3cf-8388f2947aa3,network=Network(deecb7cd-355d-4c73-93a8-b9251ab6d74e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7667374b-3a') {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 23:51:55 user nova-compute[75045]: DEBUG os_vif [None req-5f687722-efe6-4175-9944-48a2028280e8 tempest-VolumesNegativeTest-1756715703 tempest-VolumesNegativeTest-1756715703-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:25:7e:8e,bridge_name='br-int',has_traffic_filtering=True,id=7667374b-3abb-4fc5-a3cf-8388f2947aa3,network=Network(deecb7cd-355d-4c73-93a8-b9251ab6d74e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7667374b-3a') {{(pid=75045) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 23:51:55 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:51:55 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7667374b-3a, bridge=br-int, if_exists=True) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:51:55 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:51:55 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 23:51:55 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:51:55 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=fa4cfe77-1e3f-4dee-9c4b-0aaaad7431a7) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:51:55 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:51:55 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 23:51:55 user nova-compute[75045]: INFO os_vif [None req-5f687722-efe6-4175-9944-48a2028280e8 tempest-VolumesNegativeTest-1756715703 tempest-VolumesNegativeTest-1756715703-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:25:7e:8e,bridge_name='br-int',has_traffic_filtering=True,id=7667374b-3abb-4fc5-a3cf-8388f2947aa3,network=Network(deecb7cd-355d-4c73-93a8-b9251ab6d74e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7667374b-3a')
Nov 08 23:51:55 user nova-compute[75045]: INFO nova.virt.libvirt.driver [None req-5f687722-efe6-4175-9944-48a2028280e8 tempest-VolumesNegativeTest-1756715703 tempest-VolumesNegativeTest-1756715703-project-member] [instance: 354550b2-9cf4-4a7b-b3c9-c9f3b1a04dea] Deleting instance files /opt/stack/data/nova/instances/354550b2-9cf4-4a7b-b3c9-c9f3b1a04dea_del
Nov 08 23:51:55 user nova-compute[75045]: INFO nova.virt.libvirt.driver [None req-5f687722-efe6-4175-9944-48a2028280e8 tempest-VolumesNegativeTest-1756715703 tempest-VolumesNegativeTest-1756715703-project-member] [instance: 354550b2-9cf4-4a7b-b3c9-c9f3b1a04dea] Deletion of /opt/stack/data/nova/instances/354550b2-9cf4-4a7b-b3c9-c9f3b1a04dea_del complete
Nov 08 23:51:55 user nova-compute[75045]: INFO nova.compute.manager [None req-5f687722-efe6-4175-9944-48a2028280e8 tempest-VolumesNegativeTest-1756715703 tempest-VolumesNegativeTest-1756715703-project-member] [instance: 354550b2-9cf4-4a7b-b3c9-c9f3b1a04dea] Took 0.89 seconds to destroy the instance on the hypervisor.
Nov 08 23:51:55 user nova-compute[75045]: DEBUG oslo.service.loopingcall [None req-5f687722-efe6-4175-9944-48a2028280e8 tempest-VolumesNegativeTest-1756715703 tempest-VolumesNegativeTest-1756715703-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75045) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 23:51:55 user nova-compute[75045]: DEBUG nova.compute.manager [-] [instance: 354550b2-9cf4-4a7b-b3c9-c9f3b1a04dea] Deallocating network for instance {{(pid=75045) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 23:51:55 user nova-compute[75045]: DEBUG nova.network.neutron [-] [instance: 354550b2-9cf4-4a7b-b3c9-c9f3b1a04dea] deallocate_for_instance() {{(pid=75045) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 23:51:56 user nova-compute[75045]: DEBUG nova.network.neutron [-] [instance: 354550b2-9cf4-4a7b-b3c9-c9f3b1a04dea] Updating instance_info_cache with network_info: [] {{(pid=75045) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 23:51:56 user nova-compute[75045]: DEBUG nova.compute.manager [req-f27e85f4-9d0d-4e7d-9e97-97984256d098 req-5f850c9f-ff8d-4965-99d6-c2de3191a448 service nova] [instance: 354550b2-9cf4-4a7b-b3c9-c9f3b1a04dea] Received event network-vif-deleted-7667374b-3abb-4fc5-a3cf-8388f2947aa3 {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:51:56 user nova-compute[75045]: INFO nova.compute.manager [req-f27e85f4-9d0d-4e7d-9e97-97984256d098 req-5f850c9f-ff8d-4965-99d6-c2de3191a448 service nova] [instance: 354550b2-9cf4-4a7b-b3c9-c9f3b1a04dea] Neutron deleted interface 7667374b-3abb-4fc5-a3cf-8388f2947aa3; detaching it from the instance and deleting it from the info cache
Nov 08 23:51:56 user nova-compute[75045]: DEBUG nova.network.neutron [req-f27e85f4-9d0d-4e7d-9e97-97984256d098 req-5f850c9f-ff8d-4965-99d6-c2de3191a448 service nova] [instance: 354550b2-9cf4-4a7b-b3c9-c9f3b1a04dea] Updating instance_info_cache with network_info: [] {{(pid=75045) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 23:51:56 user nova-compute[75045]: INFO nova.compute.manager [-] [instance: 354550b2-9cf4-4a7b-b3c9-c9f3b1a04dea] Took 0.59 seconds to deallocate network for instance.
Nov 08 23:51:56 user nova-compute[75045]: DEBUG nova.compute.manager [req-f27e85f4-9d0d-4e7d-9e97-97984256d098 req-5f850c9f-ff8d-4965-99d6-c2de3191a448 service nova] [instance: 354550b2-9cf4-4a7b-b3c9-c9f3b1a04dea] Detach interface failed, port_id=7667374b-3abb-4fc5-a3cf-8388f2947aa3, reason: Instance 354550b2-9cf4-4a7b-b3c9-c9f3b1a04dea could not be found. {{(pid=75045) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 08 23:51:56 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-5f687722-efe6-4175-9944-48a2028280e8 tempest-VolumesNegativeTest-1756715703 tempest-VolumesNegativeTest-1756715703-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:51:56 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-5f687722-efe6-4175-9944-48a2028280e8 tempest-VolumesNegativeTest-1756715703 tempest-VolumesNegativeTest-1756715703-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:51:56 user nova-compute[75045]: DEBUG nova.compute.provider_tree [None req-5f687722-efe6-4175-9944-48a2028280e8 tempest-VolumesNegativeTest-1756715703 tempest-VolumesNegativeTest-1756715703-project-member] Inventory has not changed in ProviderTree for provider: 62ba5f85-c74d-4b58-986e-d4197e813fd7 {{(pid=75045) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 23:51:56 user nova-compute[75045]: DEBUG nova.scheduler.client.report [None req-5f687722-efe6-4175-9944-48a2028280e8 tempest-VolumesNegativeTest-1756715703 tempest-VolumesNegativeTest-1756715703-project-member] Inventory has not changed for provider 62ba5f85-c74d-4b58-986e-d4197e813fd7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75045) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 23:51:56 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-5f687722-efe6-4175-9944-48a2028280e8 tempest-VolumesNegativeTest-1756715703 tempest-VolumesNegativeTest-1756715703-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.299s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:51:56 user nova-compute[75045]: INFO nova.scheduler.client.report [None req-5f687722-efe6-4175-9944-48a2028280e8 tempest-VolumesNegativeTest-1756715703 tempest-VolumesNegativeTest-1756715703-project-member] Deleted allocations for instance 354550b2-9cf4-4a7b-b3c9-c9f3b1a04dea
Nov 08 23:51:56 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-5f687722-efe6-4175-9944-48a2028280e8 tempest-VolumesNegativeTest-1756715703 tempest-VolumesNegativeTest-1756715703-project-member] Lock "354550b2-9cf4-4a7b-b3c9-c9f3b1a04dea" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.083s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:51:57 user nova-compute[75045]: DEBUG nova.compute.manager [req-987a0499-a269-40b2-97b4-6c909ee89eb7 req-88020970-2a8f-40aa-922c-2f8f88b065c6 service nova] [instance: 354550b2-9cf4-4a7b-b3c9-c9f3b1a04dea] Received event network-vif-plugged-7667374b-3abb-4fc5-a3cf-8388f2947aa3 {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:51:57 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-987a0499-a269-40b2-97b4-6c909ee89eb7 req-88020970-2a8f-40aa-922c-2f8f88b065c6 service nova] Acquiring lock "354550b2-9cf4-4a7b-b3c9-c9f3b1a04dea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:51:57 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-987a0499-a269-40b2-97b4-6c909ee89eb7 req-88020970-2a8f-40aa-922c-2f8f88b065c6 service nova] Lock "354550b2-9cf4-4a7b-b3c9-c9f3b1a04dea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:51:57 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-987a0499-a269-40b2-97b4-6c909ee89eb7 req-88020970-2a8f-40aa-922c-2f8f88b065c6 service nova] Lock "354550b2-9cf4-4a7b-b3c9-c9f3b1a04dea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:51:57 user nova-compute[75045]: DEBUG nova.compute.manager [req-987a0499-a269-40b2-97b4-6c909ee89eb7 req-88020970-2a8f-40aa-922c-2f8f88b065c6 service nova] [instance: 354550b2-9cf4-4a7b-b3c9-c9f3b1a04dea] No waiting events found dispatching network-vif-plugged-7667374b-3abb-4fc5-a3cf-8388f2947aa3 {{(pid=75045) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 23:51:57 user nova-compute[75045]: WARNING nova.compute.manager [req-987a0499-a269-40b2-97b4-6c909ee89eb7 req-88020970-2a8f-40aa-922c-2f8f88b065c6 service nova] [instance: 354550b2-9cf4-4a7b-b3c9-c9f3b1a04dea] Received unexpected event network-vif-plugged-7667374b-3abb-4fc5-a3cf-8388f2947aa3 for instance with vm_state deleted and task_state None.
Nov 08 23:51:57 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:51:57 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-fa0a151b-9798-4950-b19b-57fd6fe7deaa tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Acquiring lock "0b413c71-c13a-4fea-91c4-f6b1953d54c6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:51:57 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-fa0a151b-9798-4950-b19b-57fd6fe7deaa tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Lock "0b413c71-c13a-4fea-91c4-f6b1953d54c6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:51:57 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-fa0a151b-9798-4950-b19b-57fd6fe7deaa tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Acquiring lock "0b413c71-c13a-4fea-91c4-f6b1953d54c6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:51:57 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-fa0a151b-9798-4950-b19b-57fd6fe7deaa tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Lock "0b413c71-c13a-4fea-91c4-f6b1953d54c6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:51:57 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-fa0a151b-9798-4950-b19b-57fd6fe7deaa tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Lock "0b413c71-c13a-4fea-91c4-f6b1953d54c6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:51:57 user nova-compute[75045]: INFO nova.compute.manager [None req-fa0a151b-9798-4950-b19b-57fd6fe7deaa tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] [instance: 0b413c71-c13a-4fea-91c4-f6b1953d54c6] Terminating instance
Nov 08 23:51:57 user nova-compute[75045]: DEBUG nova.compute.manager [None req-fa0a151b-9798-4950-b19b-57fd6fe7deaa tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] [instance: 0b413c71-c13a-4fea-91c4-f6b1953d54c6] Start destroying the instance on the hypervisor. {{(pid=75045) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 23:51:57 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:51:57 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:51:57 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:51:57 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:51:57 user nova-compute[75045]: DEBUG nova.compute.manager [req-e8602852-8994-4cad-bfd9-26d21baab106 req-6d1befb3-0f9c-4182-a90b-c4eba69561b0 service nova] [instance: 0b413c71-c13a-4fea-91c4-f6b1953d54c6] Received event network-vif-unplugged-166cceb4-9b95-4bdd-a3ad-b6aad94dfed0 {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:51:57 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-e8602852-8994-4cad-bfd9-26d21baab106 req-6d1befb3-0f9c-4182-a90b-c4eba69561b0 service nova] Acquiring lock "0b413c71-c13a-4fea-91c4-f6b1953d54c6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:51:57 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-e8602852-8994-4cad-bfd9-26d21baab106 req-6d1befb3-0f9c-4182-a90b-c4eba69561b0 service nova] Lock "0b413c71-c13a-4fea-91c4-f6b1953d54c6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:51:57 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-e8602852-8994-4cad-bfd9-26d21baab106 req-6d1befb3-0f9c-4182-a90b-c4eba69561b0 service nova] Lock "0b413c71-c13a-4fea-91c4-f6b1953d54c6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:51:57 user nova-compute[75045]: DEBUG nova.compute.manager [req-e8602852-8994-4cad-bfd9-26d21baab106 req-6d1befb3-0f9c-4182-a90b-c4eba69561b0 service nova] [instance: 0b413c71-c13a-4fea-91c4-f6b1953d54c6] No waiting events found dispatching network-vif-unplugged-166cceb4-9b95-4bdd-a3ad-b6aad94dfed0 {{(pid=75045) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 23:51:57 user nova-compute[75045]: DEBUG nova.compute.manager [req-e8602852-8994-4cad-bfd9-26d21baab106 req-6d1befb3-0f9c-4182-a90b-c4eba69561b0 service nova] [instance: 0b413c71-c13a-4fea-91c4-f6b1953d54c6] Received event network-vif-unplugged-166cceb4-9b95-4bdd-a3ad-b6aad94dfed0 for instance with task_state deleting. {{(pid=75045) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 23:51:58 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:51:58 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:51:58 user nova-compute[75045]: INFO nova.virt.libvirt.driver [-] [instance: 0b413c71-c13a-4fea-91c4-f6b1953d54c6] Instance destroyed successfully.
Nov 08 23:51:58 user nova-compute[75045]: DEBUG nova.objects.instance [None req-fa0a151b-9798-4950-b19b-57fd6fe7deaa tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Lazy-loading 'resources' on Instance uuid 0b413c71-c13a-4fea-91c4-f6b1953d54c6 {{(pid=75045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 23:51:58 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:51:58 user nova-compute[75045]: DEBUG nova.virt.libvirt.vif [None req-fa0a151b-9798-4950-b19b-57fd6fe7deaa tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T23:41:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1115991455',display_name='tempest-AttachVolumeTestJSON-server-1115991455',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1115991455',id=42,image_ref='a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDP62TKuY3xQeSwtOVfapZleQ+Udsdwyg62rL9eK489WlMG5ccA/qQJy7H2wra4KXAElLeGxPHWcXNl9vwyU6pMJ292WwpOYwEUeIcXde3ufxVUWLY5U6GVW+3+zkZGZTw==',key_name='tempest-keypair-777988029',keypairs=<?>,launch_index=0,launched_at=2023-11-08T23:41:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c8be85d72bc440899f3ccb64b923e90e',ramdisk_id='',reservation_id='r-m3eq8ay7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1852573580',owner_user_name='tempest-AttachVolumeTestJSON-1852573580-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T23:50:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1e3647ad15a24f1584685f9340eae5bd',uuid=0b413c71-c13a-4fea-91c4-f6b1953d54c6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "166cceb4-9b95-4bdd-a3ad-b6aad94dfed0", "address": "fa:16:3e:17:84:3d", "network": {"id": "e31c3d41-e46f-4c74-8ef5-8243a391dde8", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-856540424-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.149", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c8be85d72bc440899f3ccb64b923e90e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap166cceb4-9b", "ovs_interfaceid": "166cceb4-9b95-4bdd-a3ad-b6aad94dfed0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75045) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 23:51:58 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-fa0a151b-9798-4950-b19b-57fd6fe7deaa tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Converting VIF {"id": "166cceb4-9b95-4bdd-a3ad-b6aad94dfed0", "address": "fa:16:3e:17:84:3d", "network": {"id": "e31c3d41-e46f-4c74-8ef5-8243a391dde8", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-856540424-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.149", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c8be85d72bc440899f3ccb64b923e90e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap166cceb4-9b", "ovs_interfaceid": "166cceb4-9b95-4bdd-a3ad-b6aad94dfed0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 23:51:58 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-fa0a151b-9798-4950-b19b-57fd6fe7deaa tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:17:84:3d,bridge_name='br-int',has_traffic_filtering=True,id=166cceb4-9b95-4bdd-a3ad-b6aad94dfed0,network=Network(e31c3d41-e46f-4c74-8ef5-8243a391dde8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap166cceb4-9b') {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 23:51:58 user nova-compute[75045]: DEBUG os_vif [None req-fa0a151b-9798-4950-b19b-57fd6fe7deaa tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:17:84:3d,bridge_name='br-int',has_traffic_filtering=True,id=166cceb4-9b95-4bdd-a3ad-b6aad94dfed0,network=Network(e31c3d41-e46f-4c74-8ef5-8243a391dde8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap166cceb4-9b') {{(pid=75045) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 23:51:58 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:51:58 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap166cceb4-9b, bridge=br-int, if_exists=True) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:51:58 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:51:58 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 23:51:58 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:51:58 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d809ad62-5856-4a5c-b35a-ed192a5857ad) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:51:58 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:51:58 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 23:51:58 user nova-compute[75045]: INFO os_vif [None req-fa0a151b-9798-4950-b19b-57fd6fe7deaa tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:17:84:3d,bridge_name='br-int',has_traffic_filtering=True,id=166cceb4-9b95-4bdd-a3ad-b6aad94dfed0,network=Network(e31c3d41-e46f-4c74-8ef5-8243a391dde8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap166cceb4-9b')
Nov 08 23:51:58 user nova-compute[75045]: INFO nova.virt.libvirt.driver [None req-fa0a151b-9798-4950-b19b-57fd6fe7deaa tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] [instance: 0b413c71-c13a-4fea-91c4-f6b1953d54c6] Deleting instance files /opt/stack/data/nova/instances/0b413c71-c13a-4fea-91c4-f6b1953d54c6_del
Nov 08 23:51:58 user nova-compute[75045]: INFO nova.virt.libvirt.driver [None req-fa0a151b-9798-4950-b19b-57fd6fe7deaa tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] [instance: 0b413c71-c13a-4fea-91c4-f6b1953d54c6] Deletion of /opt/stack/data/nova/instances/0b413c71-c13a-4fea-91c4-f6b1953d54c6_del complete
Nov 08 23:51:58 user nova-compute[75045]: INFO nova.compute.manager [None req-fa0a151b-9798-4950-b19b-57fd6fe7deaa tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] [instance: 0b413c71-c13a-4fea-91c4-f6b1953d54c6] Took 0.95 seconds to destroy the instance on the hypervisor.
Nov 08 23:51:58 user nova-compute[75045]: DEBUG oslo.service.loopingcall [None req-fa0a151b-9798-4950-b19b-57fd6fe7deaa tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75045) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 23:51:58 user nova-compute[75045]: DEBUG nova.compute.manager [-] [instance: 0b413c71-c13a-4fea-91c4-f6b1953d54c6] Deallocating network for instance {{(pid=75045) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 23:51:58 user nova-compute[75045]: DEBUG nova.network.neutron [-] [instance: 0b413c71-c13a-4fea-91c4-f6b1953d54c6] deallocate_for_instance() {{(pid=75045) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 23:51:58 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:51:58 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:51:58 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:51:58 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:51:58 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:51:58 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:51:58 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:51:58 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:51:58 user nova-compute[75045]: DEBUG nova.compute.manager [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Starting heal instance info cache {{(pid=75045) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 23:51:58 user nova-compute[75045]: DEBUG nova.network.neutron [-] [instance: 0b413c71-c13a-4fea-91c4-f6b1953d54c6] Updating instance_info_cache with network_info: [] {{(pid=75045) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 23:51:59 user nova-compute[75045]: DEBUG nova.compute.manager [req-e09d36ee-3ed1-42a0-bb62-d83fb7a1439a req-dc9bd508-ea17-49ad-9ef2-369b4f6bdfc8 service nova] [instance: 0b413c71-c13a-4fea-91c4-f6b1953d54c6] Received event network-vif-deleted-166cceb4-9b95-4bdd-a3ad-b6aad94dfed0 {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:51:59 user nova-compute[75045]: INFO nova.compute.manager [req-e09d36ee-3ed1-42a0-bb62-d83fb7a1439a req-dc9bd508-ea17-49ad-9ef2-369b4f6bdfc8 service nova] [instance: 0b413c71-c13a-4fea-91c4-f6b1953d54c6] Neutron deleted interface 166cceb4-9b95-4bdd-a3ad-b6aad94dfed0; detaching it from the instance and deleting it from the info cache
Nov 08 23:51:59 user nova-compute[75045]: DEBUG nova.network.neutron [req-e09d36ee-3ed1-42a0-bb62-d83fb7a1439a req-dc9bd508-ea17-49ad-9ef2-369b4f6bdfc8 service nova] [instance: 0b413c71-c13a-4fea-91c4-f6b1953d54c6] Updating instance_info_cache with network_info: [] {{(pid=75045) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 23:51:59 user nova-compute[75045]: INFO nova.compute.manager [-] [instance: 0b413c71-c13a-4fea-91c4-f6b1953d54c6] Took 0.79 seconds to deallocate network for instance.
Nov 08 23:51:59 user nova-compute[75045]: DEBUG nova.compute.manager [req-e09d36ee-3ed1-42a0-bb62-d83fb7a1439a req-dc9bd508-ea17-49ad-9ef2-369b4f6bdfc8 service nova] [instance: 0b413c71-c13a-4fea-91c4-f6b1953d54c6] Detach interface failed, port_id=166cceb4-9b95-4bdd-a3ad-b6aad94dfed0, reason: Instance 0b413c71-c13a-4fea-91c4-f6b1953d54c6 could not be found. {{(pid=75045) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 08 23:51:59 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Acquiring lock "refresh_cache-c7b3eac2-a51b-40e7-a199-66aee8d2da09" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 23:51:59 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Acquired lock "refresh_cache-c7b3eac2-a51b-40e7-a199-66aee8d2da09" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 23:51:59 user nova-compute[75045]: DEBUG nova.network.neutron [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] [instance: c7b3eac2-a51b-40e7-a199-66aee8d2da09] Forcefully refreshing network info cache for instance {{(pid=75045) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 23:51:59 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-fa0a151b-9798-4950-b19b-57fd6fe7deaa tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:51:59 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-fa0a151b-9798-4950-b19b-57fd6fe7deaa tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:51:59 user nova-compute[75045]: DEBUG nova.compute.provider_tree [None req-fa0a151b-9798-4950-b19b-57fd6fe7deaa tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Inventory has not changed in ProviderTree for provider: 62ba5f85-c74d-4b58-986e-d4197e813fd7 {{(pid=75045) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 23:51:59 user nova-compute[75045]: DEBUG nova.scheduler.client.report [None req-fa0a151b-9798-4950-b19b-57fd6fe7deaa tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Inventory has not changed for provider 62ba5f85-c74d-4b58-986e-d4197e813fd7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75045) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 23:51:59 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-fa0a151b-9798-4950-b19b-57fd6fe7deaa tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.218s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:51:59 user nova-compute[75045]: INFO nova.scheduler.client.report [None req-fa0a151b-9798-4950-b19b-57fd6fe7deaa tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Deleted allocations for instance 0b413c71-c13a-4fea-91c4-f6b1953d54c6
Nov 08 23:51:59 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-fa0a151b-9798-4950-b19b-57fd6fe7deaa tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Lock "0b413c71-c13a-4fea-91c4-f6b1953d54c6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.197s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:51:59 user nova-compute[75045]: DEBUG nova.network.neutron [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] [instance: c7b3eac2-a51b-40e7-a199-66aee8d2da09] Updating instance_info_cache with network_info: [{"id": "ee3648b5-a27a-401d-8708-e25f28d987da", "address": "fa:16:3e:37:0b:9c", "network": {"id": "fe5f7093-1cdd-465c-97f0-7d7b2dd1fa8a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1755065955-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4bfce59008d44fdb5ba91c70f1cf044", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee3648b5-a2", "ovs_interfaceid": "ee3648b5-a27a-401d-8708-e25f28d987da", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75045) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 23:51:59 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Releasing lock "refresh_cache-c7b3eac2-a51b-40e7-a199-66aee8d2da09" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 23:51:59 user nova-compute[75045]: DEBUG nova.compute.manager [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] [instance: c7b3eac2-a51b-40e7-a199-66aee8d2da09] Updated the network info_cache for instance {{(pid=75045) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 23:51:59 user nova-compute[75045]: DEBUG nova.compute.manager [req-ac8bacaa-46db-4e9a-858e-8532c27be83d req-5c0811f7-6429-4cd8-ab49-6125cc210ebd service nova] [instance: 0b413c71-c13a-4fea-91c4-f6b1953d54c6] Received event network-vif-plugged-166cceb4-9b95-4bdd-a3ad-b6aad94dfed0 {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:51:59 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-ac8bacaa-46db-4e9a-858e-8532c27be83d req-5c0811f7-6429-4cd8-ab49-6125cc210ebd service nova] Acquiring lock "0b413c71-c13a-4fea-91c4-f6b1953d54c6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:51:59 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-ac8bacaa-46db-4e9a-858e-8532c27be83d req-5c0811f7-6429-4cd8-ab49-6125cc210ebd service nova] Lock "0b413c71-c13a-4fea-91c4-f6b1953d54c6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:51:59 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-ac8bacaa-46db-4e9a-858e-8532c27be83d req-5c0811f7-6429-4cd8-ab49-6125cc210ebd service nova] Lock "0b413c71-c13a-4fea-91c4-f6b1953d54c6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:51:59 user nova-compute[75045]: DEBUG nova.compute.manager [req-ac8bacaa-46db-4e9a-858e-8532c27be83d req-5c0811f7-6429-4cd8-ab49-6125cc210ebd service nova] [instance: 0b413c71-c13a-4fea-91c4-f6b1953d54c6] No waiting events found dispatching network-vif-plugged-166cceb4-9b95-4bdd-a3ad-b6aad94dfed0 {{(pid=75045) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 23:51:59 user nova-compute[75045]: WARNING nova.compute.manager [req-ac8bacaa-46db-4e9a-858e-8532c27be83d req-5c0811f7-6429-4cd8-ab49-6125cc210ebd service nova] [instance: 0b413c71-c13a-4fea-91c4-f6b1953d54c6] Received unexpected event network-vif-plugged-166cceb4-9b95-4bdd-a3ad-b6aad94dfed0 for instance with vm_state deleted and task_state None.
Nov 08 23:51:59 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:51:59 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:51:59 user nova-compute[75045]: DEBUG nova.compute.manager [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75045) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 23:52:03 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:52:03 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:52:04 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:52:05 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:52:05 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:52:06 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:52:08 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 23:52:08 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:52:08 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75045) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 23:52:08 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75045) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 23:52:08 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75045) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 23:52:08 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:52:08 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:52:08 user nova-compute[75045]: DEBUG nova.compute.manager [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Cleaning up deleted instances {{(pid=75045) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 08 23:52:08 user nova-compute[75045]: DEBUG nova.compute.manager [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] There are 0 instances to clean {{(pid=75045) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 08 23:52:08 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:52:09 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:52:09 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager.update_available_resource {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:52:10 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:52:10 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:52:10 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:52:10 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Auditing locally available compute resources for user (node: user) {{(pid=75045) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 23:52:10 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7b3eac2-a51b-40e7-a199-66aee8d2da09/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:52:10 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7b3eac2-a51b-40e7-a199-66aee8d2da09/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:52:10 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7b3eac2-a51b-40e7-a199-66aee8d2da09/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:52:10 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7b3eac2-a51b-40e7-a199-66aee8d2da09/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:52:10 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75045) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 23:52:11 user nova-compute[75045]: WARNING nova.virt.libvirt.driver [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 23:52:11 user nova-compute[75045]: WARNING nova.virt.libvirt.driver [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 23:52:11 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Hypervisor/Node resource view: name=user free_ram=8696MB free_disk=24.961898803710938GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75045) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 23:52:11 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:52:11 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:52:11 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Instance c7b3eac2-a51b-40e7-a199-66aee8d2da09 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75045) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 23:52:11 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Instance 08fae2f1-6fa1-41f9-b6ac-7ea5ff7ce089 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75045) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 23:52:11 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75045) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 23:52:11 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75045) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 23:52:11 user nova-compute[75045]: DEBUG nova.scheduler.client.report [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Refreshing inventories for resource provider 62ba5f85-c74d-4b58-986e-d4197e813fd7 {{(pid=75045) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 08 23:52:11 user nova-compute[75045]: DEBUG nova.scheduler.client.report [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Updating ProviderTree inventory for provider 62ba5f85-c74d-4b58-986e-d4197e813fd7 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75045) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 08 23:52:11 user nova-compute[75045]: DEBUG nova.compute.provider_tree [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Updating inventory in ProviderTree for provider 62ba5f85-c74d-4b58-986e-d4197e813fd7 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75045) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 08 23:52:11 user nova-compute[75045]: DEBUG nova.scheduler.client.report [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Refreshing aggregate associations for resource provider 62ba5f85-c74d-4b58-986e-d4197e813fd7, aggregates: None {{(pid=75045) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 08 23:52:11 user nova-compute[75045]: DEBUG nova.scheduler.client.report [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Refreshing trait associations for resource provider 62ba5f85-c74d-4b58-986e-d4197e813fd7, traits: COMPUTE_STORAGE_BUS_SCSI,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_TRUSTED_CERTS,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_VIRTIO,HW_CPU_X86_SSSE3,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_FDC,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_RESCUE_BFV,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSE2,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN {{(pid=75045) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 08 23:52:11 user nova-compute[75045]: DEBUG nova.compute.provider_tree [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Inventory has not changed in ProviderTree for provider: 62ba5f85-c74d-4b58-986e-d4197e813fd7 {{(pid=75045) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 23:52:11 user nova-compute[75045]: DEBUG nova.scheduler.client.report [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Inventory has not changed for provider 62ba5f85-c74d-4b58-986e-d4197e813fd7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75045) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 23:52:11 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Compute_service record updated for user:user {{(pid=75045) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 23:52:11 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.535s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:52:12 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:52:13 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:52:16 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:52:16 user nova-compute[75045]: DEBUG nova.compute.manager [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Cleaning up deleted instances with incomplete migration  {{(pid=75045) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 08 23:52:18 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:52:23 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 23:52:28 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:52:33 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 23:52:33 user nova-compute[75045]: DEBUG nova.compute.manager [None req-98dd72b6-7b75-40ce-8351-40bca2b29e1c tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] [instance: 08fae2f1-6fa1-41f9-b6ac-7ea5ff7ce089] Start spawning the instance on the hypervisor. {{(pid=75045) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 23:52:33 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-98dd72b6-7b75-40ce-8351-40bca2b29e1c tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] [instance: 08fae2f1-6fa1-41f9-b6ac-7ea5ff7ce089] Creating instance directory {{(pid=75045) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 23:52:33 user nova-compute[75045]: INFO nova.virt.libvirt.driver [None req-98dd72b6-7b75-40ce-8351-40bca2b29e1c tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] [instance: 08fae2f1-6fa1-41f9-b6ac-7ea5ff7ce089] Creating image(s)
Nov 08 23:52:33 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-98dd72b6-7b75-40ce-8351-40bca2b29e1c tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] [instance: 08fae2f1-6fa1-41f9-b6ac-7ea5ff7ce089] Did not create local disks {{(pid=75045) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 08 23:52:33 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-98dd72b6-7b75-40ce-8351-40bca2b29e1c tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] [instance: 08fae2f1-6fa1-41f9-b6ac-7ea5ff7ce089] Ensure instance console log exists: /opt/stack/data/nova/instances/08fae2f1-6fa1-41f9-b6ac-7ea5ff7ce089/console.log {{(pid=75045) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 23:52:33 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-98dd72b6-7b75-40ce-8351-40bca2b29e1c tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:52:33 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-98dd72b6-7b75-40ce-8351-40bca2b29e1c tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:52:33 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-98dd72b6-7b75-40ce-8351-40bca2b29e1c tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:52:33 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-98dd72b6-7b75-40ce-8351-40bca2b29e1c tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] [instance: 08fae2f1-6fa1-41f9-b6ac-7ea5ff7ce089] Start _get_guest_xml network_info=[{"id": "ced9d13a-eae0-4a08-b54c-75e4d1b3234e", "address": "fa:16:3e:b7:c7:a1", "network": {"id": "4205f899-9865-4c65-8b46-c9a533e9bb45", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-774780781-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d59b73851c79473a9c2cdc0a120dfee0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapced9d13a-ea", "ovs_interfaceid": "ced9d13a-eae0-4a08-b54c-75e4d1b3234e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'device_type': 'disk', 'attachment_id': '7b5f8319-16b0-4561-9297-d33df846e848', 'guest_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:dcbd911e-f385-4ed6-b8a4-383b3b56cf7d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vcbhzLqi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '08fae2f1-6fa1-41f9-b6ac-7ea5ff7ce089', 'attached_at': '', 'detached_at': '', 'volume_id': 'dcbd911e-f385-4ed6-b8a4-383b3b56cf7d', 'serial': 'dcbd911e-f385-4ed6-b8a4-383b3b56cf7d'}, 'volume_type': None} {{(pid=75045) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 23:52:33 user nova-compute[75045]: WARNING nova.virt.libvirt.driver [None req-98dd72b6-7b75-40ce-8351-40bca2b29e1c tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 23:52:33 user nova-compute[75045]: WARNING nova.virt.libvirt.driver [None req-98dd72b6-7b75-40ce-8351-40bca2b29e1c tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 23:52:33 user nova-compute[75045]: DEBUG nova.virt.libvirt.host [None req-98dd72b6-7b75-40ce-8351-40bca2b29e1c tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75045) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 23:52:33 user nova-compute[75045]: DEBUG nova.virt.libvirt.host [None req-98dd72b6-7b75-40ce-8351-40bca2b29e1c tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] CPU controller missing on host. {{(pid=75045) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 23:52:33 user nova-compute[75045]: DEBUG nova.virt.libvirt.host [None req-98dd72b6-7b75-40ce-8351-40bca2b29e1c tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75045) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 23:52:33 user nova-compute[75045]: DEBUG nova.virt.libvirt.host [None req-98dd72b6-7b75-40ce-8351-40bca2b29e1c tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] CPU controller found on host. {{(pid=75045) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 23:52:33 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-98dd72b6-7b75-40ce-8351-40bca2b29e1c tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75045) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 23:52:33 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-98dd72b6-7b75-40ce-8351-40bca2b29e1c tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T23:11:41Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75045) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 23:52:33 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-98dd72b6-7b75-40ce-8351-40bca2b29e1c tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Flavor limits 0:0:0 {{(pid=75045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 23:52:33 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-98dd72b6-7b75-40ce-8351-40bca2b29e1c tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Image limits 0:0:0 {{(pid=75045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 23:52:33 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-98dd72b6-7b75-40ce-8351-40bca2b29e1c tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Flavor pref 0:0:0 {{(pid=75045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 23:52:33 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-98dd72b6-7b75-40ce-8351-40bca2b29e1c tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Image pref 0:0:0 {{(pid=75045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 23:52:33 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-98dd72b6-7b75-40ce-8351-40bca2b29e1c tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 23:52:33 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-98dd72b6-7b75-40ce-8351-40bca2b29e1c tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75045) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 23:52:33 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-98dd72b6-7b75-40ce-8351-40bca2b29e1c tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75045) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 23:52:33 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-98dd72b6-7b75-40ce-8351-40bca2b29e1c tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Got 1 possible topologies {{(pid=75045) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 23:52:33 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-98dd72b6-7b75-40ce-8351-40bca2b29e1c tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75045) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 23:52:33 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-98dd72b6-7b75-40ce-8351-40bca2b29e1c tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75045) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 23:52:33 user nova-compute[75045]: DEBUG nova.virt.libvirt.volume.iscsi [None req-98dd72b6-7b75-40ce-8351-40bca2b29e1c tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] [instance: 08fae2f1-6fa1-41f9-b6ac-7ea5ff7ce089] Calling os-brick to attach iSCSI Volume {{(pid=75045) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 23:52:33 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-98dd72b6-7b75-40ce-8351-40bca2b29e1c tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1b68210460>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:dcbd911e-f385-4ed6-b8a4-383b3b56cf7d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vcbhzLqi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75045) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 23:52:33 user nova-compute[75045]: WARNING os_brick.initiator.connectors.base [None req-98dd72b6-7b75-40ce-8351-40bca2b29e1c tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 23:52:33 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-98dd72b6-7b75-40ce-8351-40bca2b29e1c tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 23:52:33 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-98dd72b6-7b75-40ce-8351-40bca2b29e1c tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 23:52:33 user nova-compute[75045]: WARNING os_brick.initiator.connectors.base [None req-98dd72b6-7b75-40ce-8351-40bca2b29e1c tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 23:52:33 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-98dd72b6-7b75-40ce-8351-40bca2b29e1c tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dcbd911e-f385-4ed6-b8a4-383b3b56cf7d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 23:52:33 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-98dd72b6-7b75-40ce-8351-40bca2b29e1c tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dcbd911e-f385-4ed6-b8a4-383b3b56cf7d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 23:52:33 user nova-compute[75045]: INFO os_brick.initiator.connectors.iscsi [None req-98dd72b6-7b75-40ce-8351-40bca2b29e1c tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 23:52:33 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dcbd911e-f385-4ed6-b8a4-383b3b56cf7d -p 172.16.0.220:3260 {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:52:33 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dcbd911e-f385-4ed6-b8a4-383b3b56cf7d -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:52:33 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8c26baf-dde0-4a45-ae38-33a6778e80ee]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:52:33 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-98dd72b6-7b75-40ce-8351-40bca2b29e1c tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 23:52:33 user nova-compute[75045]:  {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:52:33 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dcbd911e-f385-4ed6-b8a4-383b3b56cf7d -p 172.16.0.220:3260 --interface default --op new {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:52:33 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dcbd911e-f385-4ed6-b8a4-383b3b56cf7d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:52:33 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6c12175-b7b6-4001-83f7-f5d76711fd18]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:dcbd911e-f385-4ed6-b8a4-383b3b56cf7d] added\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:52:33 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-98dd72b6-7b75-40ce-8351-40bca2b29e1c tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:dcbd911e-f385-4ed6-b8a4-383b3b56cf7d] added
Nov 08 23:52:33 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:52:33 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dcbd911e-f385-4ed6-b8a4-383b3b56cf7d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:52:33 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dcbd911e-f385-4ed6-b8a4-383b3b56cf7d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:52:33 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[463a40e5-4451-45ab-921a-61ecc3772c47]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:52:33 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-98dd72b6-7b75-40ce-8351-40bca2b29e1c tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:52:33 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dcbd911e-f385-4ed6-b8a4-383b3b56cf7d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:52:33 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dcbd911e-f385-4ed6-b8a4-383b3b56cf7d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:52:33 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[48516309-7fe6-448b-8164-390aeccf7637]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:52:33 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-98dd72b6-7b75-40ce-8351-40bca2b29e1c tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:52:33 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dcbd911e-f385-4ed6-b8a4-383b3b56cf7d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vcbhzLqi {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:52:33 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dcbd911e-f385-4ed6-b8a4-383b3b56cf7d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vcbhzLqi" returned: 0 in 0.017s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:52:33 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ddb4e40-1ea5-4ce5-8655-6bffa9fa10e8]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:52:33 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-98dd72b6-7b75-40ce-8351-40bca2b29e1c tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'vcbhzLqi'): stdout= stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:52:33 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dcbd911e-f385-4ed6-b8a4-383b3b56cf7d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:52:33 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dcbd911e-f385-4ed6-b8a4-383b3b56cf7d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:52:33 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[b87b4b97-263f-4507-85fc-5907af53c386]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:52:33 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-98dd72b6-7b75-40ce-8351-40bca2b29e1c tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:52:33 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:52:33 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:52:33 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[3aaaa241-6f8e-4a05-8a70-9695e8fdb0ff]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac646643-9cac-4f95-bf27-7156728caf3d (non-flash)\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:52:33 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-98dd72b6-7b75-40ce-8351-40bca2b29e1c tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac646643-9cac-4f95-bf27-7156728caf3d (non-flash)
Nov 08 23:52:33 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 23:52:33 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-98dd72b6-7b75-40ce-8351-40bca2b29e1c tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac646643-9cac-4f95-bf27-7156728caf3d (non-flash)
Nov 08 23:52:33 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 23:52:33 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dcbd911e-f385-4ed6-b8a4-383b3b56cf7d -p 172.16.0.220:3260 --login {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:52:33 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dcbd911e-f385-4ed6-b8a4-383b3b56cf7d -p 172.16.0.220:3260 --login" returned: 0 in 0.052s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:52:33 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[822c95ac-a9d7-4eae-8cf6-014376be5f38]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:dcbd911e-f385-4ed6-b8a4-383b3b56cf7d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:dcbd911e-f385-4ed6-b8a4-383b3b56cf7d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:52:33 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-98dd72b6-7b75-40ce-8351-40bca2b29e1c tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:dcbd911e-f385-4ed6-b8a4-383b3b56cf7d, portal: 172.16.0.220,3260]
Nov 08 23:52:33 user nova-compute[75045]: Login to [iface: default, target: iqn.2010-10.org.openstack:dcbd911e-f385-4ed6-b8a4-383b3b56cf7d, portal: 172.16.0.220,3260] successful.
Nov 08 23:52:33 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:52:33 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dcbd911e-f385-4ed6-b8a4-383b3b56cf7d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:52:33 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dcbd911e-f385-4ed6-b8a4-383b3b56cf7d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:52:33 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d192444-f777-4a5a-ab69-a009cfd47f6d]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:52:33 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-98dd72b6-7b75-40ce-8351-40bca2b29e1c tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:52:33 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:52:33 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:52:33 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[e60743f9-4c38-48a8-af24-9a2f601fce39]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac646643-9cac-4f95-bf27-7156728caf3d (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcbd911e-f385-4ed6-b8a4-383b3b56cf7d (non-flash)\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:52:33 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-98dd72b6-7b75-40ce-8351-40bca2b29e1c tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac646643-9cac-4f95-bf27-7156728caf3d (non-flash)
Nov 08 23:52:33 user nova-compute[75045]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcbd911e-f385-4ed6-b8a4-383b3b56cf7d (non-flash)
Nov 08 23:52:33 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 23:52:33 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-98dd72b6-7b75-40ce-8351-40bca2b29e1c tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac646643-9cac-4f95-bf27-7156728caf3d (non-flash)
Nov 08 23:52:33 user nova-compute[75045]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcbd911e-f385-4ed6-b8a4-383b3b56cf7d (non-flash)
Nov 08 23:52:33 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 23:52:33 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-98dd72b6-7b75-40ce-8351-40bca2b29e1c tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dcbd911e-f385-4ed6-b8a4-383b3b56cf7d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.257s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 23:52:33 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-98dd72b6-7b75-40ce-8351-40bca2b29e1c tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Connected to 172.16.0.220:3260 {{(pid=75045) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 23:52:33 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-98dd72b6-7b75-40ce-8351-40bca2b29e1c tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] HCTL ('34', '-', '-', 0) found on session 49 with lun 0 {{(pid=75045) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 23:52:33 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-98dd72b6-7b75-40ce-8351-40bca2b29e1c tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75045) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 23:52:33 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:52:33 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.021s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:52:33 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[6638a80d-a7ec-4ec2-b028-7ab3357e5b56]: (4, ('- - 0', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:52:33 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-98dd72b6-7b75-40ce-8351-40bca2b29e1c tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Searching for a device in session 49 and hctl ['34', '*', '*', 0] yield: None {{(pid=75045) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 23:52:34 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-98dd72b6-7b75-40ce-8351-40bca2b29e1c tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Searching for a device in session 49 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75045) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 23:52:34 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-98dd72b6-7b75-40ce-8351-40bca2b29e1c tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:dcbd911e-f385-4ed6-b8a4-383b3b56cf7d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vcbhzLqi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75045) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 23:52:34 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-98dd72b6-7b75-40ce-8351-40bca2b29e1c tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.291s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 23:52:34 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-98dd72b6-7b75-40ce-8351-40bca2b29e1c tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] <== connect_volume: return (1292ms) {'type': 'block', 'scsi_wwn': '26139353836656237', 'path': '/dev/sdc'} {{(pid=75045) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 23:52:34 user nova-compute[75045]: DEBUG nova.virt.libvirt.volume.iscsi [None req-98dd72b6-7b75-40ce-8351-40bca2b29e1c tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] [instance: 08fae2f1-6fa1-41f9-b6ac-7ea5ff7ce089] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26139353836656237', 'path': '/dev/sdc'} {{(pid=75045) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 23:52:34 user nova-compute[75045]: DEBUG nova.virt.libvirt.vif [None req-98dd72b6-7b75-40ce-8351-40bca2b29e1c tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T23:51:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1363662702',display_name='tempest-TestVolumeBootPattern-server-1363662702',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1363662702',id=48,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG4FMrZDNuVfIPnXfxN4nyoUo/5k5pInfzFUTQXcG54GN3K7TKcBDzRT7RSwNm2HHReK/sg/U9LFWtj081VW6fTpNzjBNfOxhMg0DqXN9g7DbQBYyYNAjTBN+tAvF+1fCA==',key_name='tempest-TestVolumeBootPattern-1614211608',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d59b73851c79473a9c2cdc0a120dfee0',ramdisk_id='',reservation_id='r-bqs394wa',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-650796844',owner_user_name='tempest-TestVolumeBootPattern-650796844-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T23:51:25Z,user_data=None,user_id='76c31c64d9594f9cbef7586fafb48721',uuid=08fae2f1-6fa1-41f9-b6ac-7ea5ff7ce089,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ced9d13a-eae0-4a08-b54c-75e4d1b3234e", "address": "fa:16:3e:b7:c7:a1", "network": {"id": "4205f899-9865-4c65-8b46-c9a533e9bb45", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-774780781-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d59b73851c79473a9c2cdc0a120dfee0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapced9d13a-ea", "ovs_interfaceid": "ced9d13a-eae0-4a08-b54c-75e4d1b3234e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75045) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 23:52:34 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-98dd72b6-7b75-40ce-8351-40bca2b29e1c tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Converting VIF {"id": "ced9d13a-eae0-4a08-b54c-75e4d1b3234e", "address": "fa:16:3e:b7:c7:a1", "network": {"id": "4205f899-9865-4c65-8b46-c9a533e9bb45", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-774780781-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d59b73851c79473a9c2cdc0a120dfee0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapced9d13a-ea", "ovs_interfaceid": "ced9d13a-eae0-4a08-b54c-75e4d1b3234e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 23:52:34 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-98dd72b6-7b75-40ce-8351-40bca2b29e1c tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b7:c7:a1,bridge_name='br-int',has_traffic_filtering=True,id=ced9d13a-eae0-4a08-b54c-75e4d1b3234e,network=Network(4205f899-9865-4c65-8b46-c9a533e9bb45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapced9d13a-ea') {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 23:52:34 user nova-compute[75045]: DEBUG nova.objects.instance [None req-98dd72b6-7b75-40ce-8351-40bca2b29e1c tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Lazy-loading 'pci_devices' on Instance uuid 08fae2f1-6fa1-41f9-b6ac-7ea5ff7ce089 {{(pid=75045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 23:52:34 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-98dd72b6-7b75-40ce-8351-40bca2b29e1c tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] [instance: 08fae2f1-6fa1-41f9-b6ac-7ea5ff7ce089] End _get_guest_xml xml=<domain type="kvm">
Nov 08 23:52:34 user nova-compute[75045]:   <uuid>08fae2f1-6fa1-41f9-b6ac-7ea5ff7ce089</uuid>
Nov 08 23:52:34 user nova-compute[75045]:   <name>instance-00000030</name>
Nov 08 23:52:34 user nova-compute[75045]:   <memory>524288</memory>
Nov 08 23:52:34 user nova-compute[75045]:   <vcpu>1</vcpu>
Nov 08 23:52:34 user nova-compute[75045]:   <metadata>
Nov 08 23:52:34 user nova-compute[75045]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 23:52:34 user nova-compute[75045]:       <nova:package version="0.0.0"/>
Nov 08 23:52:34 user nova-compute[75045]:       <nova:name>tempest-TestVolumeBootPattern-server-1363662702</nova:name>
Nov 08 23:52:34 user nova-compute[75045]:       <nova:creationTime>2023-11-08 23:52:33</nova:creationTime>
Nov 08 23:52:34 user nova-compute[75045]:       <nova:flavor name="m1.tiny">
Nov 08 23:52:34 user nova-compute[75045]:         <nova:memory>512</nova:memory>
Nov 08 23:52:34 user nova-compute[75045]:         <nova:disk>1</nova:disk>
Nov 08 23:52:34 user nova-compute[75045]:         <nova:swap>0</nova:swap>
Nov 08 23:52:34 user nova-compute[75045]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 23:52:34 user nova-compute[75045]:         <nova:vcpus>1</nova:vcpus>
Nov 08 23:52:34 user nova-compute[75045]:       </nova:flavor>
Nov 08 23:52:34 user nova-compute[75045]:       <nova:owner>
Nov 08 23:52:34 user nova-compute[75045]:         <nova:user uuid="76c31c64d9594f9cbef7586fafb48721">tempest-TestVolumeBootPattern-650796844-project-member</nova:user>
Nov 08 23:52:34 user nova-compute[75045]:         <nova:project uuid="d59b73851c79473a9c2cdc0a120dfee0">tempest-TestVolumeBootPattern-650796844</nova:project>
Nov 08 23:52:34 user nova-compute[75045]:       </nova:owner>
Nov 08 23:52:34 user nova-compute[75045]:       <nova:ports>
Nov 08 23:52:34 user nova-compute[75045]:         <nova:port uuid="ced9d13a-eae0-4a08-b54c-75e4d1b3234e">
Nov 08 23:52:34 user nova-compute[75045]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 08 23:52:34 user nova-compute[75045]:         </nova:port>
Nov 08 23:52:34 user nova-compute[75045]:       </nova:ports>
Nov 08 23:52:34 user nova-compute[75045]:     </nova:instance>
Nov 08 23:52:34 user nova-compute[75045]:   </metadata>
Nov 08 23:52:34 user nova-compute[75045]:   <sysinfo type="smbios">
Nov 08 23:52:34 user nova-compute[75045]:     <system>
Nov 08 23:52:34 user nova-compute[75045]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 23:52:34 user nova-compute[75045]:       <entry name="product">OpenStack Nova</entry>
Nov 08 23:52:34 user nova-compute[75045]:       <entry name="version">0.0.0</entry>
Nov 08 23:52:34 user nova-compute[75045]:       <entry name="serial">08fae2f1-6fa1-41f9-b6ac-7ea5ff7ce089</entry>
Nov 08 23:52:34 user nova-compute[75045]:       <entry name="uuid">08fae2f1-6fa1-41f9-b6ac-7ea5ff7ce089</entry>
Nov 08 23:52:34 user nova-compute[75045]:       <entry name="family">Virtual Machine</entry>
Nov 08 23:52:34 user nova-compute[75045]:     </system>
Nov 08 23:52:34 user nova-compute[75045]:   </sysinfo>
Nov 08 23:52:34 user nova-compute[75045]:   <os>
Nov 08 23:52:34 user nova-compute[75045]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 23:52:34 user nova-compute[75045]:     <boot dev="hd"/>
Nov 08 23:52:34 user nova-compute[75045]:     <smbios mode="sysinfo"/>
Nov 08 23:52:34 user nova-compute[75045]:   </os>
Nov 08 23:52:34 user nova-compute[75045]:   <features>
Nov 08 23:52:34 user nova-compute[75045]:     <acpi/>
Nov 08 23:52:34 user nova-compute[75045]:     <apic/>
Nov 08 23:52:34 user nova-compute[75045]:     <vmcoreinfo/>
Nov 08 23:52:34 user nova-compute[75045]:   </features>
Nov 08 23:52:34 user nova-compute[75045]:   <clock offset="utc">
Nov 08 23:52:34 user nova-compute[75045]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 23:52:34 user nova-compute[75045]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 23:52:34 user nova-compute[75045]:     <timer name="hpet" present="no"/>
Nov 08 23:52:34 user nova-compute[75045]:   </clock>
Nov 08 23:52:34 user nova-compute[75045]:   <cpu mode="custom" match="exact">
Nov 08 23:52:34 user nova-compute[75045]:     <model>Nehalem</model>
Nov 08 23:52:34 user nova-compute[75045]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 23:52:34 user nova-compute[75045]:   </cpu>
Nov 08 23:52:34 user nova-compute[75045]:   <devices>
Nov 08 23:52:34 user nova-compute[75045]:     <disk type="block" device="disk">
Nov 08 23:52:34 user nova-compute[75045]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 23:52:34 user nova-compute[75045]:       <source dev="/dev/sdc"/>
Nov 08 23:52:34 user nova-compute[75045]:       <target dev="vda" bus="virtio"/>
Nov 08 23:52:34 user nova-compute[75045]:       <serial>dcbd911e-f385-4ed6-b8a4-383b3b56cf7d</serial>
Nov 08 23:52:34 user nova-compute[75045]:     </disk>
Nov 08 23:52:34 user nova-compute[75045]:     <interface type="ethernet">
Nov 08 23:52:34 user nova-compute[75045]:       <mac address="fa:16:3e:b7:c7:a1"/>
Nov 08 23:52:34 user nova-compute[75045]:       <model type="virtio"/>
Nov 08 23:52:34 user nova-compute[75045]:       <mtu size="1442"/>
Nov 08 23:52:34 user nova-compute[75045]:       <target dev="tapced9d13a-ea"/>
Nov 08 23:52:34 user nova-compute[75045]:     </interface>
Nov 08 23:52:34 user nova-compute[75045]:     <serial type="pty">
Nov 08 23:52:34 user nova-compute[75045]:       <log file="/opt/stack/data/nova/instances/08fae2f1-6fa1-41f9-b6ac-7ea5ff7ce089/console.log" append="off"/>
Nov 08 23:52:34 user nova-compute[75045]:     </serial>
Nov 08 23:52:34 user nova-compute[75045]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 23:52:34 user nova-compute[75045]:     <video>
Nov 08 23:52:34 user nova-compute[75045]:       <model type="virtio"/>
Nov 08 23:52:34 user nova-compute[75045]:     </video>
Nov 08 23:52:34 user nova-compute[75045]:     <rng model="virtio">
Nov 08 23:52:34 user nova-compute[75045]:       <backend model="random">/dev/urandom</backend>
Nov 08 23:52:34 user nova-compute[75045]:     </rng>
Nov 08 23:52:34 user nova-compute[75045]:     <controller type="usb" index="0" model="none"/>
Nov 08 23:52:34 user nova-compute[75045]:     <memballoon model="virtio">
Nov 08 23:52:34 user nova-compute[75045]:       <stats period="10"/>
Nov 08 23:52:34 user nova-compute[75045]:     </memballoon>
Nov 08 23:52:34 user nova-compute[75045]:   </devices>
Nov 08 23:52:34 user nova-compute[75045]: </domain>
Nov 08 23:52:34 user nova-compute[75045]:  {{(pid=75045) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 23:52:34 user nova-compute[75045]: DEBUG nova.virt.libvirt.vif [None req-98dd72b6-7b75-40ce-8351-40bca2b29e1c tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T23:51:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1363662702',display_name='tempest-TestVolumeBootPattern-server-1363662702',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1363662702',id=48,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG4FMrZDNuVfIPnXfxN4nyoUo/5k5pInfzFUTQXcG54GN3K7TKcBDzRT7RSwNm2HHReK/sg/U9LFWtj081VW6fTpNzjBNfOxhMg0DqXN9g7DbQBYyYNAjTBN+tAvF+1fCA==',key_name='tempest-TestVolumeBootPattern-1614211608',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d59b73851c79473a9c2cdc0a120dfee0',ramdisk_id='',reservation_id='r-bqs394wa',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-650796844',owner_user_name='tempest-TestVolumeBootPattern-650796844-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T23:51:25Z,user_data=None,user_id='76c31c64d9594f9cbef7586fafb48721',uuid=08fae2f1-6fa1-41f9-b6ac-7ea5ff7ce089,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ced9d13a-eae0-4a08-b54c-75e4d1b3234e", "address": "fa:16:3e:b7:c7:a1", "network": {"id": "4205f899-9865-4c65-8b46-c9a533e9bb45", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-774780781-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d59b73851c79473a9c2cdc0a120dfee0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapced9d13a-ea", "ovs_interfaceid": "ced9d13a-eae0-4a08-b54c-75e4d1b3234e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75045) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 23:52:34 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-98dd72b6-7b75-40ce-8351-40bca2b29e1c tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Converting VIF {"id": "ced9d13a-eae0-4a08-b54c-75e4d1b3234e", "address": "fa:16:3e:b7:c7:a1", "network": {"id": "4205f899-9865-4c65-8b46-c9a533e9bb45", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-774780781-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d59b73851c79473a9c2cdc0a120dfee0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapced9d13a-ea", "ovs_interfaceid": "ced9d13a-eae0-4a08-b54c-75e4d1b3234e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 23:52:34 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-98dd72b6-7b75-40ce-8351-40bca2b29e1c tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b7:c7:a1,bridge_name='br-int',has_traffic_filtering=True,id=ced9d13a-eae0-4a08-b54c-75e4d1b3234e,network=Network(4205f899-9865-4c65-8b46-c9a533e9bb45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapced9d13a-ea') {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 23:52:34 user nova-compute[75045]: DEBUG os_vif [None req-98dd72b6-7b75-40ce-8351-40bca2b29e1c tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b7:c7:a1,bridge_name='br-int',has_traffic_filtering=True,id=ced9d13a-eae0-4a08-b54c-75e4d1b3234e,network=Network(4205f899-9865-4c65-8b46-c9a533e9bb45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapced9d13a-ea') {{(pid=75045) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 23:52:34 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:52:34 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:52:34 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 23:52:34 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:52:34 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '73fa1f33-89f3-52b0-aadb-05067b182271', '_type': 'linux-noop'}}, row=False) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:52:34 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 23:52:34 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:52:34 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapced9d13a-ea, may_exist=True, interface_attrs={}) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:52:34 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapced9d13a-ea, col_values=(('qos', UUID('282b0b29-a830-478d-b633-df2776e853be')),), if_exists=True) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:52:34 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapced9d13a-ea, col_values=(('external_ids', {'iface-id': 'ced9d13a-eae0-4a08-b54c-75e4d1b3234e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b7:c7:a1', 'vm-uuid': '08fae2f1-6fa1-41f9-b6ac-7ea5ff7ce089'}),), if_exists=True) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:52:34 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:52:34 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 23:52:34 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:52:34 user nova-compute[75045]: INFO os_vif [None req-98dd72b6-7b75-40ce-8351-40bca2b29e1c tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b7:c7:a1,bridge_name='br-int',has_traffic_filtering=True,id=ced9d13a-eae0-4a08-b54c-75e4d1b3234e,network=Network(4205f899-9865-4c65-8b46-c9a533e9bb45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapced9d13a-ea')
Nov 08 23:52:34 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-98dd72b6-7b75-40ce-8351-40bca2b29e1c tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] No BDM found with device name vda, not building metadata. {{(pid=75045) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 23:52:34 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-98dd72b6-7b75-40ce-8351-40bca2b29e1c tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] No VIF found with MAC fa:16:3e:b7:c7:a1, not building metadata {{(pid=75045) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 23:52:36 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:52:36 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:52:36 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:52:36 user nova-compute[75045]: DEBUG nova.compute.manager [req-d763314c-fe23-44b8-bf30-d75df71da36f req-063fa53e-3f6d-4528-9b3e-fd19607686a3 service nova] [instance: 08fae2f1-6fa1-41f9-b6ac-7ea5ff7ce089] Received event network-vif-plugged-ced9d13a-eae0-4a08-b54c-75e4d1b3234e {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:52:36 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-d763314c-fe23-44b8-bf30-d75df71da36f req-063fa53e-3f6d-4528-9b3e-fd19607686a3 service nova] Acquiring lock "08fae2f1-6fa1-41f9-b6ac-7ea5ff7ce089-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:52:36 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-d763314c-fe23-44b8-bf30-d75df71da36f req-063fa53e-3f6d-4528-9b3e-fd19607686a3 service nova] Lock "08fae2f1-6fa1-41f9-b6ac-7ea5ff7ce089-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:52:36 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-d763314c-fe23-44b8-bf30-d75df71da36f req-063fa53e-3f6d-4528-9b3e-fd19607686a3 service nova] Lock "08fae2f1-6fa1-41f9-b6ac-7ea5ff7ce089-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:52:36 user nova-compute[75045]: DEBUG nova.compute.manager [req-d763314c-fe23-44b8-bf30-d75df71da36f req-063fa53e-3f6d-4528-9b3e-fd19607686a3 service nova] [instance: 08fae2f1-6fa1-41f9-b6ac-7ea5ff7ce089] No waiting events found dispatching network-vif-plugged-ced9d13a-eae0-4a08-b54c-75e4d1b3234e {{(pid=75045) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 23:52:36 user nova-compute[75045]: WARNING nova.compute.manager [req-d763314c-fe23-44b8-bf30-d75df71da36f req-063fa53e-3f6d-4528-9b3e-fd19607686a3 service nova] [instance: 08fae2f1-6fa1-41f9-b6ac-7ea5ff7ce089] Received unexpected event network-vif-plugged-ced9d13a-eae0-4a08-b54c-75e4d1b3234e for instance with vm_state building and task_state spawning.
Nov 08 23:52:36 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:52:36 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:52:36 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:52:36 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:52:37 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:52:38 user nova-compute[75045]: DEBUG nova.compute.manager [req-9262defd-3fe3-4c2e-8dcf-6226f096c002 req-c6196798-a73c-48b5-8f50-e8b72e29d92f service nova] [instance: 08fae2f1-6fa1-41f9-b6ac-7ea5ff7ce089] Received event network-vif-plugged-ced9d13a-eae0-4a08-b54c-75e4d1b3234e {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:52:38 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-9262defd-3fe3-4c2e-8dcf-6226f096c002 req-c6196798-a73c-48b5-8f50-e8b72e29d92f service nova] Acquiring lock "08fae2f1-6fa1-41f9-b6ac-7ea5ff7ce089-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:52:38 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-9262defd-3fe3-4c2e-8dcf-6226f096c002 req-c6196798-a73c-48b5-8f50-e8b72e29d92f service nova] Lock "08fae2f1-6fa1-41f9-b6ac-7ea5ff7ce089-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:52:38 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-9262defd-3fe3-4c2e-8dcf-6226f096c002 req-c6196798-a73c-48b5-8f50-e8b72e29d92f service nova] Lock "08fae2f1-6fa1-41f9-b6ac-7ea5ff7ce089-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:52:38 user nova-compute[75045]: DEBUG nova.compute.manager [req-9262defd-3fe3-4c2e-8dcf-6226f096c002 req-c6196798-a73c-48b5-8f50-e8b72e29d92f service nova] [instance: 08fae2f1-6fa1-41f9-b6ac-7ea5ff7ce089] No waiting events found dispatching network-vif-plugged-ced9d13a-eae0-4a08-b54c-75e4d1b3234e {{(pid=75045) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 23:52:38 user nova-compute[75045]: WARNING nova.compute.manager [req-9262defd-3fe3-4c2e-8dcf-6226f096c002 req-c6196798-a73c-48b5-8f50-e8b72e29d92f service nova] [instance: 08fae2f1-6fa1-41f9-b6ac-7ea5ff7ce089] Received unexpected event network-vif-plugged-ced9d13a-eae0-4a08-b54c-75e4d1b3234e for instance with vm_state building and task_state spawning.
Nov 08 23:52:38 user nova-compute[75045]: DEBUG nova.compute.manager [None req-98dd72b6-7b75-40ce-8351-40bca2b29e1c tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] [instance: 08fae2f1-6fa1-41f9-b6ac-7ea5ff7ce089] Instance event wait completed in 0 seconds for  {{(pid=75045) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 23:52:38 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-98dd72b6-7b75-40ce-8351-40bca2b29e1c tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] [instance: 08fae2f1-6fa1-41f9-b6ac-7ea5ff7ce089] Guest created on hypervisor {{(pid=75045) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 23:52:38 user nova-compute[75045]: INFO nova.virt.libvirt.driver [-] [instance: 08fae2f1-6fa1-41f9-b6ac-7ea5ff7ce089] Instance spawned successfully.
Nov 08 23:52:38 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-98dd72b6-7b75-40ce-8351-40bca2b29e1c tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] [instance: 08fae2f1-6fa1-41f9-b6ac-7ea5ff7ce089] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75045) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 23:52:38 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-98dd72b6-7b75-40ce-8351-40bca2b29e1c tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] [instance: 08fae2f1-6fa1-41f9-b6ac-7ea5ff7ce089] Found default for hw_cdrom_bus of ide {{(pid=75045) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 23:52:38 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-98dd72b6-7b75-40ce-8351-40bca2b29e1c tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] [instance: 08fae2f1-6fa1-41f9-b6ac-7ea5ff7ce089] Found default for hw_disk_bus of virtio {{(pid=75045) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 23:52:38 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-98dd72b6-7b75-40ce-8351-40bca2b29e1c tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] [instance: 08fae2f1-6fa1-41f9-b6ac-7ea5ff7ce089] Found default for hw_input_bus of None {{(pid=75045) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 23:52:38 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-98dd72b6-7b75-40ce-8351-40bca2b29e1c tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] [instance: 08fae2f1-6fa1-41f9-b6ac-7ea5ff7ce089] Found default for hw_pointer_model of None {{(pid=75045) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 23:52:38 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-98dd72b6-7b75-40ce-8351-40bca2b29e1c tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] [instance: 08fae2f1-6fa1-41f9-b6ac-7ea5ff7ce089] Found default for hw_video_model of virtio {{(pid=75045) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 23:52:38 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-98dd72b6-7b75-40ce-8351-40bca2b29e1c tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] [instance: 08fae2f1-6fa1-41f9-b6ac-7ea5ff7ce089] Found default for hw_vif_model of virtio {{(pid=75045) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 23:52:38 user nova-compute[75045]: INFO nova.compute.manager [None req-98dd72b6-7b75-40ce-8351-40bca2b29e1c tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] [instance: 08fae2f1-6fa1-41f9-b6ac-7ea5ff7ce089] Took 5.28 seconds to spawn the instance on the hypervisor.
Nov 08 23:52:38 user nova-compute[75045]: DEBUG nova.compute.manager [None req-98dd72b6-7b75-40ce-8351-40bca2b29e1c tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] [instance: 08fae2f1-6fa1-41f9-b6ac-7ea5ff7ce089] Checking state {{(pid=75045) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 23:52:38 user nova-compute[75045]: INFO nova.compute.manager [None req-98dd72b6-7b75-40ce-8351-40bca2b29e1c tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] [instance: 08fae2f1-6fa1-41f9-b6ac-7ea5ff7ce089] Took 74.05 seconds to build instance.
Nov 08 23:52:38 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-98dd72b6-7b75-40ce-8351-40bca2b29e1c tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Lock "08fae2f1-6fa1-41f9-b6ac-7ea5ff7ce089" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 74.146s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:52:39 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:52:42 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:52:44 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:52:49 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._sync_power_states {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:52:49 user nova-compute[75045]: DEBUG nova.compute.manager [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Triggering sync for uuid c7b3eac2-a51b-40e7-a199-66aee8d2da09 {{(pid=75045) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 08 23:52:49 user nova-compute[75045]: DEBUG nova.compute.manager [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Triggering sync for uuid 08fae2f1-6fa1-41f9-b6ac-7ea5ff7ce089 {{(pid=75045) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 08 23:52:49 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Acquiring lock "c7b3eac2-a51b-40e7-a199-66aee8d2da09" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:52:49 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Lock "c7b3eac2-a51b-40e7-a199-66aee8d2da09" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:52:49 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Acquiring lock "08fae2f1-6fa1-41f9-b6ac-7ea5ff7ce089" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:52:49 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Lock "08fae2f1-6fa1-41f9-b6ac-7ea5ff7ce089" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:52:49 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Lock "c7b3eac2-a51b-40e7-a199-66aee8d2da09" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.029s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:52:49 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Lock "08fae2f1-6fa1-41f9-b6ac-7ea5ff7ce089" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.030s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:52:49 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 23:52:49 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:52:49 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75045) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 23:52:49 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75045) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 23:52:49 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75045) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 23:52:49 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:52:51 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-c630dca2-04c4-4dab-9a65-6f497eca7bcb tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Acquiring lock "a19b6a96-340f-488e-af81-853ee56bf30f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:52:51 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-c630dca2-04c4-4dab-9a65-6f497eca7bcb tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Lock "a19b6a96-340f-488e-af81-853ee56bf30f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:52:51 user nova-compute[75045]: DEBUG nova.compute.manager [None req-c630dca2-04c4-4dab-9a65-6f497eca7bcb tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] [instance: a19b6a96-340f-488e-af81-853ee56bf30f] Starting instance... {{(pid=75045) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 23:52:51 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-c630dca2-04c4-4dab-9a65-6f497eca7bcb tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:52:51 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-c630dca2-04c4-4dab-9a65-6f497eca7bcb tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:52:51 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-c630dca2-04c4-4dab-9a65-6f497eca7bcb tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75045) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 23:52:51 user nova-compute[75045]: INFO nova.compute.claims [None req-c630dca2-04c4-4dab-9a65-6f497eca7bcb tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] [instance: a19b6a96-340f-488e-af81-853ee56bf30f] Claim successful on node user
Nov 08 23:52:51 user nova-compute[75045]: DEBUG nova.compute.provider_tree [None req-c630dca2-04c4-4dab-9a65-6f497eca7bcb tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Inventory has not changed in ProviderTree for provider: 62ba5f85-c74d-4b58-986e-d4197e813fd7 {{(pid=75045) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 23:52:51 user nova-compute[75045]: DEBUG nova.scheduler.client.report [None req-c630dca2-04c4-4dab-9a65-6f497eca7bcb tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Inventory has not changed for provider 62ba5f85-c74d-4b58-986e-d4197e813fd7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75045) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 23:52:51 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-c630dca2-04c4-4dab-9a65-6f497eca7bcb tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.277s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:52:51 user nova-compute[75045]: DEBUG nova.compute.manager [None req-c630dca2-04c4-4dab-9a65-6f497eca7bcb tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] [instance: a19b6a96-340f-488e-af81-853ee56bf30f] Start building networks asynchronously for instance. {{(pid=75045) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 23:52:51 user nova-compute[75045]: DEBUG nova.compute.manager [None req-c630dca2-04c4-4dab-9a65-6f497eca7bcb tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] [instance: a19b6a96-340f-488e-af81-853ee56bf30f] Allocating IP information in the background. {{(pid=75045) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 23:52:51 user nova-compute[75045]: DEBUG nova.network.neutron [None req-c630dca2-04c4-4dab-9a65-6f497eca7bcb tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] [instance: a19b6a96-340f-488e-af81-853ee56bf30f] allocate_for_instance() {{(pid=75045) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 23:52:51 user nova-compute[75045]: INFO nova.virt.libvirt.driver [None req-c630dca2-04c4-4dab-9a65-6f497eca7bcb tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] [instance: a19b6a96-340f-488e-af81-853ee56bf30f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 23:52:51 user nova-compute[75045]: DEBUG nova.compute.manager [None req-c630dca2-04c4-4dab-9a65-6f497eca7bcb tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] [instance: a19b6a96-340f-488e-af81-853ee56bf30f] Start building block device mappings for instance. {{(pid=75045) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 23:52:51 user nova-compute[75045]: DEBUG nova.policy [None req-c630dca2-04c4-4dab-9a65-6f497eca7bcb tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1e3647ad15a24f1584685f9340eae5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8be85d72bc440899f3ccb64b923e90e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75045) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 23:52:51 user nova-compute[75045]: DEBUG nova.compute.manager [None req-c630dca2-04c4-4dab-9a65-6f497eca7bcb tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] [instance: a19b6a96-340f-488e-af81-853ee56bf30f] Start spawning the instance on the hypervisor. {{(pid=75045) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 23:52:52 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-c630dca2-04c4-4dab-9a65-6f497eca7bcb tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] [instance: a19b6a96-340f-488e-af81-853ee56bf30f] Creating instance directory {{(pid=75045) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 23:52:52 user nova-compute[75045]: INFO nova.virt.libvirt.driver [None req-c630dca2-04c4-4dab-9a65-6f497eca7bcb tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] [instance: a19b6a96-340f-488e-af81-853ee56bf30f] Creating image(s)
Nov 08 23:52:52 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-c630dca2-04c4-4dab-9a65-6f497eca7bcb tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Acquiring lock "/opt/stack/data/nova/instances/a19b6a96-340f-488e-af81-853ee56bf30f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:52:52 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-c630dca2-04c4-4dab-9a65-6f497eca7bcb tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Lock "/opt/stack/data/nova/instances/a19b6a96-340f-488e-af81-853ee56bf30f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:52:52 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-c630dca2-04c4-4dab-9a65-6f497eca7bcb tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Lock "/opt/stack/data/nova/instances/a19b6a96-340f-488e-af81-853ee56bf30f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.047s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:52:52 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-c630dca2-04c4-4dab-9a65-6f497eca7bcb tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b59f52a99fff51c56dd1edfb83892fb8f647f2f3 --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:52:52 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-c630dca2-04c4-4dab-9a65-6f497eca7bcb tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b59f52a99fff51c56dd1edfb83892fb8f647f2f3 --force-share --output=json" returned: 0 in 0.229s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:52:52 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-c630dca2-04c4-4dab-9a65-6f497eca7bcb tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Acquiring lock "b59f52a99fff51c56dd1edfb83892fb8f647f2f3" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:52:52 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-c630dca2-04c4-4dab-9a65-6f497eca7bcb tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Lock "b59f52a99fff51c56dd1edfb83892fb8f647f2f3" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:52:52 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-c630dca2-04c4-4dab-9a65-6f497eca7bcb tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b59f52a99fff51c56dd1edfb83892fb8f647f2f3 --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:52:52 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-c630dca2-04c4-4dab-9a65-6f497eca7bcb tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b59f52a99fff51c56dd1edfb83892fb8f647f2f3 --force-share --output=json" returned: 0 in 0.217s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:52:52 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-c630dca2-04c4-4dab-9a65-6f497eca7bcb tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b59f52a99fff51c56dd1edfb83892fb8f647f2f3,backing_fmt=raw /opt/stack/data/nova/instances/a19b6a96-340f-488e-af81-853ee56bf30f/disk 1073741824 {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:52:52 user nova-compute[75045]: DEBUG nova.network.neutron [None req-c630dca2-04c4-4dab-9a65-6f497eca7bcb tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] [instance: a19b6a96-340f-488e-af81-853ee56bf30f] Successfully created port: f3fb96dd-b444-47d0-98ff-0c7c910dbede {{(pid=75045) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 23:52:52 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-c630dca2-04c4-4dab-9a65-6f497eca7bcb tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b59f52a99fff51c56dd1edfb83892fb8f647f2f3,backing_fmt=raw /opt/stack/data/nova/instances/a19b6a96-340f-488e-af81-853ee56bf30f/disk 1073741824" returned: 0 in 0.464s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:52:52 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-c630dca2-04c4-4dab-9a65-6f497eca7bcb tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Lock "b59f52a99fff51c56dd1edfb83892fb8f647f2f3" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.690s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:52:52 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-c630dca2-04c4-4dab-9a65-6f497eca7bcb tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b59f52a99fff51c56dd1edfb83892fb8f647f2f3 --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:52:53 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-c630dca2-04c4-4dab-9a65-6f497eca7bcb tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b59f52a99fff51c56dd1edfb83892fb8f647f2f3 --force-share --output=json" returned: 0 in 0.287s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:52:53 user nova-compute[75045]: DEBUG nova.virt.disk.api [None req-c630dca2-04c4-4dab-9a65-6f497eca7bcb tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a19b6a96-340f-488e-af81-853ee56bf30f/disk. size=1073741824 {{(pid=75045) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 23:52:53 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-c630dca2-04c4-4dab-9a65-6f497eca7bcb tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a19b6a96-340f-488e-af81-853ee56bf30f/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:52:53 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-c630dca2-04c4-4dab-9a65-6f497eca7bcb tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a19b6a96-340f-488e-af81-853ee56bf30f/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:52:53 user nova-compute[75045]: DEBUG nova.virt.disk.api [None req-c630dca2-04c4-4dab-9a65-6f497eca7bcb tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Cannot resize image /opt/stack/data/nova/instances/a19b6a96-340f-488e-af81-853ee56bf30f/disk to a smaller size. {{(pid=75045) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 08 23:52:53 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-c630dca2-04c4-4dab-9a65-6f497eca7bcb tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] [instance: a19b6a96-340f-488e-af81-853ee56bf30f] Created local disks {{(pid=75045) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 23:52:53 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-c630dca2-04c4-4dab-9a65-6f497eca7bcb tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] [instance: a19b6a96-340f-488e-af81-853ee56bf30f] Ensure instance console log exists: /opt/stack/data/nova/instances/a19b6a96-340f-488e-af81-853ee56bf30f/console.log {{(pid=75045) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 23:52:53 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-c630dca2-04c4-4dab-9a65-6f497eca7bcb tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:52:53 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-c630dca2-04c4-4dab-9a65-6f497eca7bcb tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:52:53 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-c630dca2-04c4-4dab-9a65-6f497eca7bcb tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:52:53 user nova-compute[75045]: DEBUG nova.network.neutron [None req-c630dca2-04c4-4dab-9a65-6f497eca7bcb tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] [instance: a19b6a96-340f-488e-af81-853ee56bf30f] Successfully updated port: f3fb96dd-b444-47d0-98ff-0c7c910dbede {{(pid=75045) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 23:52:53 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-c630dca2-04c4-4dab-9a65-6f497eca7bcb tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Acquiring lock "refresh_cache-a19b6a96-340f-488e-af81-853ee56bf30f" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 23:52:53 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-c630dca2-04c4-4dab-9a65-6f497eca7bcb tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Acquired lock "refresh_cache-a19b6a96-340f-488e-af81-853ee56bf30f" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 23:52:53 user nova-compute[75045]: DEBUG nova.network.neutron [None req-c630dca2-04c4-4dab-9a65-6f497eca7bcb tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] [instance: a19b6a96-340f-488e-af81-853ee56bf30f] Building network info cache for instance {{(pid=75045) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 23:52:53 user nova-compute[75045]: DEBUG nova.compute.manager [req-210e605b-bae7-4bad-9499-b80ce4ede48e req-94b9067d-0194-4cd0-b95e-f20ec3a3ed57 service nova] [instance: a19b6a96-340f-488e-af81-853ee56bf30f] Received event network-changed-f3fb96dd-b444-47d0-98ff-0c7c910dbede {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:52:53 user nova-compute[75045]: DEBUG nova.compute.manager [req-210e605b-bae7-4bad-9499-b80ce4ede48e req-94b9067d-0194-4cd0-b95e-f20ec3a3ed57 service nova] [instance: a19b6a96-340f-488e-af81-853ee56bf30f] Refreshing instance network info cache due to event network-changed-f3fb96dd-b444-47d0-98ff-0c7c910dbede. {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 23:52:53 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-210e605b-bae7-4bad-9499-b80ce4ede48e req-94b9067d-0194-4cd0-b95e-f20ec3a3ed57 service nova] Acquiring lock "refresh_cache-a19b6a96-340f-488e-af81-853ee56bf30f" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 23:52:53 user nova-compute[75045]: DEBUG nova.network.neutron [None req-c630dca2-04c4-4dab-9a65-6f497eca7bcb tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] [instance: a19b6a96-340f-488e-af81-853ee56bf30f] Instance cache missing network info. {{(pid=75045) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 23:52:54 user nova-compute[75045]: DEBUG nova.network.neutron [None req-c630dca2-04c4-4dab-9a65-6f497eca7bcb tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] [instance: a19b6a96-340f-488e-af81-853ee56bf30f] Updating instance_info_cache with network_info: [{"id": "f3fb96dd-b444-47d0-98ff-0c7c910dbede", "address": "fa:16:3e:0c:c0:6c", "network": {"id": "e31c3d41-e46f-4c74-8ef5-8243a391dde8", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-856540424-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c8be85d72bc440899f3ccb64b923e90e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3fb96dd-b4", "ovs_interfaceid": "f3fb96dd-b444-47d0-98ff-0c7c910dbede", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75045) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 23:52:54 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-c630dca2-04c4-4dab-9a65-6f497eca7bcb tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Releasing lock "refresh_cache-a19b6a96-340f-488e-af81-853ee56bf30f" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 23:52:54 user nova-compute[75045]: DEBUG nova.compute.manager [None req-c630dca2-04c4-4dab-9a65-6f497eca7bcb tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] [instance: a19b6a96-340f-488e-af81-853ee56bf30f] Instance network_info: |[{"id": "f3fb96dd-b444-47d0-98ff-0c7c910dbede", "address": "fa:16:3e:0c:c0:6c", "network": {"id": "e31c3d41-e46f-4c74-8ef5-8243a391dde8", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-856540424-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c8be85d72bc440899f3ccb64b923e90e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3fb96dd-b4", "ovs_interfaceid": "f3fb96dd-b444-47d0-98ff-0c7c910dbede", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75045) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 23:52:54 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-210e605b-bae7-4bad-9499-b80ce4ede48e req-94b9067d-0194-4cd0-b95e-f20ec3a3ed57 service nova] Acquired lock "refresh_cache-a19b6a96-340f-488e-af81-853ee56bf30f" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 23:52:54 user nova-compute[75045]: DEBUG nova.network.neutron [req-210e605b-bae7-4bad-9499-b80ce4ede48e req-94b9067d-0194-4cd0-b95e-f20ec3a3ed57 service nova] [instance: a19b6a96-340f-488e-af81-853ee56bf30f] Refreshing network info cache for port f3fb96dd-b444-47d0-98ff-0c7c910dbede {{(pid=75045) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 23:52:54 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-c630dca2-04c4-4dab-9a65-6f497eca7bcb tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] [instance: a19b6a96-340f-488e-af81-853ee56bf30f] Start _get_guest_xml network_info=[{"id": "f3fb96dd-b444-47d0-98ff-0c7c910dbede", "address": "fa:16:3e:0c:c0:6c", "network": {"id": "e31c3d41-e46f-4c74-8ef5-8243a391dde8", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-856540424-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c8be85d72bc440899f3ccb64b923e90e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3fb96dd-b4", "ovs_interfaceid": "f3fb96dd-b444-47d0-98ff-0c7c910dbede", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T23:11:54Z,direct_url=<?>,disk_format='qcow2',id=a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b1beba2cc4e7465ea249e2225fb494dc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T23:11:56Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'disk_bus': 'virtio', 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': 'a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75045) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 23:52:54 user nova-compute[75045]: WARNING nova.virt.libvirt.driver [None req-c630dca2-04c4-4dab-9a65-6f497eca7bcb tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 23:52:54 user nova-compute[75045]: WARNING nova.virt.libvirt.driver [None req-c630dca2-04c4-4dab-9a65-6f497eca7bcb tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 23:52:54 user nova-compute[75045]: DEBUG nova.virt.libvirt.host [None req-c630dca2-04c4-4dab-9a65-6f497eca7bcb tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75045) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 23:52:54 user nova-compute[75045]: DEBUG nova.virt.libvirt.host [None req-c630dca2-04c4-4dab-9a65-6f497eca7bcb tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] CPU controller missing on host. {{(pid=75045) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 23:52:54 user nova-compute[75045]: DEBUG nova.virt.libvirt.host [None req-c630dca2-04c4-4dab-9a65-6f497eca7bcb tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75045) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 23:52:54 user nova-compute[75045]: DEBUG nova.virt.libvirt.host [None req-c630dca2-04c4-4dab-9a65-6f497eca7bcb tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] CPU controller found on host. {{(pid=75045) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 23:52:54 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-c630dca2-04c4-4dab-9a65-6f497eca7bcb tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75045) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 23:52:54 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-c630dca2-04c4-4dab-9a65-6f497eca7bcb tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T23:11:41Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T23:11:54Z,direct_url=<?>,disk_format='qcow2',id=a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b1beba2cc4e7465ea249e2225fb494dc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T23:11:56Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75045) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 23:52:54 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-c630dca2-04c4-4dab-9a65-6f497eca7bcb tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Flavor limits 0:0:0 {{(pid=75045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 23:52:54 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-c630dca2-04c4-4dab-9a65-6f497eca7bcb tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Image limits 0:0:0 {{(pid=75045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 23:52:54 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-c630dca2-04c4-4dab-9a65-6f497eca7bcb tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Flavor pref 0:0:0 {{(pid=75045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 23:52:54 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-c630dca2-04c4-4dab-9a65-6f497eca7bcb tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Image pref 0:0:0 {{(pid=75045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 23:52:54 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-c630dca2-04c4-4dab-9a65-6f497eca7bcb tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 23:52:54 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-c630dca2-04c4-4dab-9a65-6f497eca7bcb tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75045) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 23:52:54 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-c630dca2-04c4-4dab-9a65-6f497eca7bcb tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75045) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 23:52:54 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-c630dca2-04c4-4dab-9a65-6f497eca7bcb tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Got 1 possible topologies {{(pid=75045) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 23:52:54 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-c630dca2-04c4-4dab-9a65-6f497eca7bcb tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75045) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 23:52:54 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-c630dca2-04c4-4dab-9a65-6f497eca7bcb tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75045) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 23:52:54 user nova-compute[75045]: DEBUG nova.virt.libvirt.vif [None req-c630dca2-04c4-4dab-9a65-6f497eca7bcb tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T23:52:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-7117286',display_name='tempest-AttachVolumeTestJSON-server-7117286',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-7117286',id=49,image_ref='a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEwUSRDKaZl45jBGPlzBWh5SQ/B972l7W8699uxVzR8tW1yp9t3QaeTsM1zxnVpopR+6U6iomMQHyN1WGS8zg7XGUpHxIvtPO8beMDYfiszyOQLUrPzas93W4+SH/+6uPg==',key_name='tempest-keypair-1693710972',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c8be85d72bc440899f3ccb64b923e90e',ramdisk_id='',reservation_id='r-9wnfy1m9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1852573580',owner_user_name='tempest-AttachVolumeTestJSON-1852573580-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T23:52:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1e3647ad15a24f1584685f9340eae5bd',uuid=a19b6a96-340f-488e-af81-853ee56bf30f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f3fb96dd-b444-47d0-98ff-0c7c910dbede", "address": "fa:16:3e:0c:c0:6c", "network": {"id": "e31c3d41-e46f-4c74-8ef5-8243a391dde8", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-856540424-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c8be85d72bc440899f3ccb64b923e90e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3fb96dd-b4", "ovs_interfaceid": "f3fb96dd-b444-47d0-98ff-0c7c910dbede", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75045) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 23:52:54 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-c630dca2-04c4-4dab-9a65-6f497eca7bcb tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Converting VIF {"id": "f3fb96dd-b444-47d0-98ff-0c7c910dbede", "address": "fa:16:3e:0c:c0:6c", "network": {"id": "e31c3d41-e46f-4c74-8ef5-8243a391dde8", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-856540424-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c8be85d72bc440899f3ccb64b923e90e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3fb96dd-b4", "ovs_interfaceid": "f3fb96dd-b444-47d0-98ff-0c7c910dbede", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 23:52:54 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-c630dca2-04c4-4dab-9a65-6f497eca7bcb tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0c:c0:6c,bridge_name='br-int',has_traffic_filtering=True,id=f3fb96dd-b444-47d0-98ff-0c7c910dbede,network=Network(e31c3d41-e46f-4c74-8ef5-8243a391dde8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf3fb96dd-b4') {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 23:52:54 user nova-compute[75045]: DEBUG nova.objects.instance [None req-c630dca2-04c4-4dab-9a65-6f497eca7bcb tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Lazy-loading 'pci_devices' on Instance uuid a19b6a96-340f-488e-af81-853ee56bf30f {{(pid=75045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 23:52:54 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-c630dca2-04c4-4dab-9a65-6f497eca7bcb tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] [instance: a19b6a96-340f-488e-af81-853ee56bf30f] End _get_guest_xml xml=<domain type="kvm">
Nov 08 23:52:54 user nova-compute[75045]:   <uuid>a19b6a96-340f-488e-af81-853ee56bf30f</uuid>
Nov 08 23:52:54 user nova-compute[75045]:   <name>instance-00000031</name>
Nov 08 23:52:54 user nova-compute[75045]:   <memory>524288</memory>
Nov 08 23:52:54 user nova-compute[75045]:   <vcpu>1</vcpu>
Nov 08 23:52:54 user nova-compute[75045]:   <metadata>
Nov 08 23:52:54 user nova-compute[75045]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 23:52:54 user nova-compute[75045]:       <nova:package version="0.0.0"/>
Nov 08 23:52:54 user nova-compute[75045]:       <nova:name>tempest-AttachVolumeTestJSON-server-7117286</nova:name>
Nov 08 23:52:54 user nova-compute[75045]:       <nova:creationTime>2023-11-08 23:52:54</nova:creationTime>
Nov 08 23:52:54 user nova-compute[75045]:       <nova:flavor name="m1.tiny">
Nov 08 23:52:54 user nova-compute[75045]:         <nova:memory>512</nova:memory>
Nov 08 23:52:54 user nova-compute[75045]:         <nova:disk>1</nova:disk>
Nov 08 23:52:54 user nova-compute[75045]:         <nova:swap>0</nova:swap>
Nov 08 23:52:54 user nova-compute[75045]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 23:52:54 user nova-compute[75045]:         <nova:vcpus>1</nova:vcpus>
Nov 08 23:52:54 user nova-compute[75045]:       </nova:flavor>
Nov 08 23:52:54 user nova-compute[75045]:       <nova:owner>
Nov 08 23:52:54 user nova-compute[75045]:         <nova:user uuid="1e3647ad15a24f1584685f9340eae5bd">tempest-AttachVolumeTestJSON-1852573580-project-member</nova:user>
Nov 08 23:52:54 user nova-compute[75045]:         <nova:project uuid="c8be85d72bc440899f3ccb64b923e90e">tempest-AttachVolumeTestJSON-1852573580</nova:project>
Nov 08 23:52:54 user nova-compute[75045]:       </nova:owner>
Nov 08 23:52:54 user nova-compute[75045]:       <nova:root type="image" uuid="a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb"/>
Nov 08 23:52:54 user nova-compute[75045]:       <nova:ports>
Nov 08 23:52:54 user nova-compute[75045]:         <nova:port uuid="f3fb96dd-b444-47d0-98ff-0c7c910dbede">
Nov 08 23:52:54 user nova-compute[75045]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 08 23:52:54 user nova-compute[75045]:         </nova:port>
Nov 08 23:52:54 user nova-compute[75045]:       </nova:ports>
Nov 08 23:52:54 user nova-compute[75045]:     </nova:instance>
Nov 08 23:52:54 user nova-compute[75045]:   </metadata>
Nov 08 23:52:54 user nova-compute[75045]:   <sysinfo type="smbios">
Nov 08 23:52:54 user nova-compute[75045]:     <system>
Nov 08 23:52:54 user nova-compute[75045]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 23:52:54 user nova-compute[75045]:       <entry name="product">OpenStack Nova</entry>
Nov 08 23:52:54 user nova-compute[75045]:       <entry name="version">0.0.0</entry>
Nov 08 23:52:54 user nova-compute[75045]:       <entry name="serial">a19b6a96-340f-488e-af81-853ee56bf30f</entry>
Nov 08 23:52:54 user nova-compute[75045]:       <entry name="uuid">a19b6a96-340f-488e-af81-853ee56bf30f</entry>
Nov 08 23:52:54 user nova-compute[75045]:       <entry name="family">Virtual Machine</entry>
Nov 08 23:52:54 user nova-compute[75045]:     </system>
Nov 08 23:52:54 user nova-compute[75045]:   </sysinfo>
Nov 08 23:52:54 user nova-compute[75045]:   <os>
Nov 08 23:52:54 user nova-compute[75045]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 23:52:54 user nova-compute[75045]:     <boot dev="hd"/>
Nov 08 23:52:54 user nova-compute[75045]:     <smbios mode="sysinfo"/>
Nov 08 23:52:54 user nova-compute[75045]:   </os>
Nov 08 23:52:54 user nova-compute[75045]:   <features>
Nov 08 23:52:54 user nova-compute[75045]:     <acpi/>
Nov 08 23:52:54 user nova-compute[75045]:     <apic/>
Nov 08 23:52:54 user nova-compute[75045]:     <vmcoreinfo/>
Nov 08 23:52:54 user nova-compute[75045]:   </features>
Nov 08 23:52:54 user nova-compute[75045]:   <clock offset="utc">
Nov 08 23:52:54 user nova-compute[75045]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 23:52:54 user nova-compute[75045]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 23:52:54 user nova-compute[75045]:     <timer name="hpet" present="no"/>
Nov 08 23:52:54 user nova-compute[75045]:   </clock>
Nov 08 23:52:54 user nova-compute[75045]:   <cpu mode="custom" match="exact">
Nov 08 23:52:54 user nova-compute[75045]:     <model>Nehalem</model>
Nov 08 23:52:54 user nova-compute[75045]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 23:52:54 user nova-compute[75045]:   </cpu>
Nov 08 23:52:54 user nova-compute[75045]:   <devices>
Nov 08 23:52:54 user nova-compute[75045]:     <disk type="file" device="disk">
Nov 08 23:52:54 user nova-compute[75045]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 23:52:54 user nova-compute[75045]:       <source file="/opt/stack/data/nova/instances/a19b6a96-340f-488e-af81-853ee56bf30f/disk"/>
Nov 08 23:52:54 user nova-compute[75045]:       <target dev="vda" bus="virtio"/>
Nov 08 23:52:54 user nova-compute[75045]:     </disk>
Nov 08 23:52:54 user nova-compute[75045]:     <interface type="ethernet">
Nov 08 23:52:54 user nova-compute[75045]:       <mac address="fa:16:3e:0c:c0:6c"/>
Nov 08 23:52:54 user nova-compute[75045]:       <model type="virtio"/>
Nov 08 23:52:54 user nova-compute[75045]:       <mtu size="1442"/>
Nov 08 23:52:54 user nova-compute[75045]:       <target dev="tapf3fb96dd-b4"/>
Nov 08 23:52:54 user nova-compute[75045]:     </interface>
Nov 08 23:52:54 user nova-compute[75045]:     <serial type="pty">
Nov 08 23:52:54 user nova-compute[75045]:       <log file="/opt/stack/data/nova/instances/a19b6a96-340f-488e-af81-853ee56bf30f/console.log" append="off"/>
Nov 08 23:52:54 user nova-compute[75045]:     </serial>
Nov 08 23:52:54 user nova-compute[75045]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 23:52:54 user nova-compute[75045]:     <video>
Nov 08 23:52:54 user nova-compute[75045]:       <model type="virtio"/>
Nov 08 23:52:54 user nova-compute[75045]:     </video>
Nov 08 23:52:54 user nova-compute[75045]:     <rng model="virtio">
Nov 08 23:52:54 user nova-compute[75045]:       <backend model="random">/dev/urandom</backend>
Nov 08 23:52:54 user nova-compute[75045]:     </rng>
Nov 08 23:52:54 user nova-compute[75045]:     <controller type="usb" index="0" model="none"/>
Nov 08 23:52:54 user nova-compute[75045]:     <memballoon model="virtio">
Nov 08 23:52:54 user nova-compute[75045]:       <stats period="10"/>
Nov 08 23:52:54 user nova-compute[75045]:     </memballoon>
Nov 08 23:52:54 user nova-compute[75045]:   </devices>
Nov 08 23:52:54 user nova-compute[75045]: </domain>
Nov 08 23:52:54 user nova-compute[75045]:  {{(pid=75045) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 23:52:54 user nova-compute[75045]: DEBUG nova.virt.libvirt.vif [None req-c630dca2-04c4-4dab-9a65-6f497eca7bcb tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T23:52:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-7117286',display_name='tempest-AttachVolumeTestJSON-server-7117286',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-7117286',id=49,image_ref='a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEwUSRDKaZl45jBGPlzBWh5SQ/B972l7W8699uxVzR8tW1yp9t3QaeTsM1zxnVpopR+6U6iomMQHyN1WGS8zg7XGUpHxIvtPO8beMDYfiszyOQLUrPzas93W4+SH/+6uPg==',key_name='tempest-keypair-1693710972',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c8be85d72bc440899f3ccb64b923e90e',ramdisk_id='',reservation_id='r-9wnfy1m9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1852573580',owner_user_name='tempest-AttachVolumeTestJSON-1852573580-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T23:52:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1e3647ad15a24f1584685f9340eae5bd',uuid=a19b6a96-340f-488e-af81-853ee56bf30f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f3fb96dd-b444-47d0-98ff-0c7c910dbede", "address": "fa:16:3e:0c:c0:6c", "network": {"id": "e31c3d41-e46f-4c74-8ef5-8243a391dde8", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-856540424-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c8be85d72bc440899f3ccb64b923e90e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3fb96dd-b4", "ovs_interfaceid": "f3fb96dd-b444-47d0-98ff-0c7c910dbede", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75045) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 23:52:54 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-c630dca2-04c4-4dab-9a65-6f497eca7bcb tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Converting VIF {"id": "f3fb96dd-b444-47d0-98ff-0c7c910dbede", "address": "fa:16:3e:0c:c0:6c", "network": {"id": "e31c3d41-e46f-4c74-8ef5-8243a391dde8", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-856540424-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c8be85d72bc440899f3ccb64b923e90e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3fb96dd-b4", "ovs_interfaceid": "f3fb96dd-b444-47d0-98ff-0c7c910dbede", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 23:52:54 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-c630dca2-04c4-4dab-9a65-6f497eca7bcb tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0c:c0:6c,bridge_name='br-int',has_traffic_filtering=True,id=f3fb96dd-b444-47d0-98ff-0c7c910dbede,network=Network(e31c3d41-e46f-4c74-8ef5-8243a391dde8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf3fb96dd-b4') {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 23:52:54 user nova-compute[75045]: DEBUG os_vif [None req-c630dca2-04c4-4dab-9a65-6f497eca7bcb tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0c:c0:6c,bridge_name='br-int',has_traffic_filtering=True,id=f3fb96dd-b444-47d0-98ff-0c7c910dbede,network=Network(e31c3d41-e46f-4c74-8ef5-8243a391dde8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf3fb96dd-b4') {{(pid=75045) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 23:52:54 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:52:54 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:52:54 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 23:52:54 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:52:54 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd59ca8d1-2ce3-56df-abfc-dc7a05b4f8e9', '_type': 'linux-noop'}}, row=False) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:52:54 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:52:54 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 23:52:54 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:52:54 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf3fb96dd-b4, may_exist=True, interface_attrs={}) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:52:54 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf3fb96dd-b4, col_values=(('qos', UUID('45797b41-e96e-45e5-a961-a84cb326bdef')),), if_exists=True) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:52:54 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf3fb96dd-b4, col_values=(('external_ids', {'iface-id': 'f3fb96dd-b444-47d0-98ff-0c7c910dbede', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0c:c0:6c', 'vm-uuid': 'a19b6a96-340f-488e-af81-853ee56bf30f'}),), if_exists=True) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:52:54 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:52:54 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 23:52:54 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:52:54 user nova-compute[75045]: INFO os_vif [None req-c630dca2-04c4-4dab-9a65-6f497eca7bcb tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0c:c0:6c,bridge_name='br-int',has_traffic_filtering=True,id=f3fb96dd-b444-47d0-98ff-0c7c910dbede,network=Network(e31c3d41-e46f-4c74-8ef5-8243a391dde8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf3fb96dd-b4')
Nov 08 23:52:54 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-c630dca2-04c4-4dab-9a65-6f497eca7bcb tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] No BDM found with device name vda, not building metadata. {{(pid=75045) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 23:52:54 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-c630dca2-04c4-4dab-9a65-6f497eca7bcb tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] No VIF found with MAC fa:16:3e:0c:c0:6c, not building metadata {{(pid=75045) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 23:52:54 user nova-compute[75045]: DEBUG nova.network.neutron [req-210e605b-bae7-4bad-9499-b80ce4ede48e req-94b9067d-0194-4cd0-b95e-f20ec3a3ed57 service nova] [instance: a19b6a96-340f-488e-af81-853ee56bf30f] Updated VIF entry in instance network info cache for port f3fb96dd-b444-47d0-98ff-0c7c910dbede. {{(pid=75045) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 23:52:54 user nova-compute[75045]: DEBUG nova.network.neutron [req-210e605b-bae7-4bad-9499-b80ce4ede48e req-94b9067d-0194-4cd0-b95e-f20ec3a3ed57 service nova] [instance: a19b6a96-340f-488e-af81-853ee56bf30f] Updating instance_info_cache with network_info: [{"id": "f3fb96dd-b444-47d0-98ff-0c7c910dbede", "address": "fa:16:3e:0c:c0:6c", "network": {"id": "e31c3d41-e46f-4c74-8ef5-8243a391dde8", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-856540424-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c8be85d72bc440899f3ccb64b923e90e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3fb96dd-b4", "ovs_interfaceid": "f3fb96dd-b444-47d0-98ff-0c7c910dbede", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75045) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 23:52:54 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-210e605b-bae7-4bad-9499-b80ce4ede48e req-94b9067d-0194-4cd0-b95e-f20ec3a3ed57 service nova] Releasing lock "refresh_cache-a19b6a96-340f-488e-af81-853ee56bf30f" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 23:52:56 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:52:56 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:52:56 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:52:56 user nova-compute[75045]: DEBUG nova.compute.manager [req-9155f1b7-8d7b-4dc0-a8f6-8695ba8b4587 req-41cd95d1-4925-42f6-a8cc-035989e72c48 service nova] [instance: a19b6a96-340f-488e-af81-853ee56bf30f] Received event network-vif-plugged-f3fb96dd-b444-47d0-98ff-0c7c910dbede {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:52:56 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-9155f1b7-8d7b-4dc0-a8f6-8695ba8b4587 req-41cd95d1-4925-42f6-a8cc-035989e72c48 service nova] Acquiring lock "a19b6a96-340f-488e-af81-853ee56bf30f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:52:56 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-9155f1b7-8d7b-4dc0-a8f6-8695ba8b4587 req-41cd95d1-4925-42f6-a8cc-035989e72c48 service nova] Lock "a19b6a96-340f-488e-af81-853ee56bf30f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:52:56 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-9155f1b7-8d7b-4dc0-a8f6-8695ba8b4587 req-41cd95d1-4925-42f6-a8cc-035989e72c48 service nova] Lock "a19b6a96-340f-488e-af81-853ee56bf30f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:52:56 user nova-compute[75045]: DEBUG nova.compute.manager [req-9155f1b7-8d7b-4dc0-a8f6-8695ba8b4587 req-41cd95d1-4925-42f6-a8cc-035989e72c48 service nova] [instance: a19b6a96-340f-488e-af81-853ee56bf30f] No waiting events found dispatching network-vif-plugged-f3fb96dd-b444-47d0-98ff-0c7c910dbede {{(pid=75045) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 23:52:56 user nova-compute[75045]: WARNING nova.compute.manager [req-9155f1b7-8d7b-4dc0-a8f6-8695ba8b4587 req-41cd95d1-4925-42f6-a8cc-035989e72c48 service nova] [instance: a19b6a96-340f-488e-af81-853ee56bf30f] Received unexpected event network-vif-plugged-f3fb96dd-b444-47d0-98ff-0c7c910dbede for instance with vm_state building and task_state spawning.
Nov 08 23:52:56 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:52:56 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:52:56 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:52:57 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:52:57 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:52:58 user nova-compute[75045]: DEBUG nova.compute.manager [req-6ada7a64-8579-4279-8750-1a61e0b2b384 req-655c792d-f1ef-4a4e-b6a7-359d08514850 service nova] [instance: a19b6a96-340f-488e-af81-853ee56bf30f] Received event network-vif-plugged-f3fb96dd-b444-47d0-98ff-0c7c910dbede {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:52:58 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-6ada7a64-8579-4279-8750-1a61e0b2b384 req-655c792d-f1ef-4a4e-b6a7-359d08514850 service nova] Acquiring lock "a19b6a96-340f-488e-af81-853ee56bf30f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:52:58 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-6ada7a64-8579-4279-8750-1a61e0b2b384 req-655c792d-f1ef-4a4e-b6a7-359d08514850 service nova] Lock "a19b6a96-340f-488e-af81-853ee56bf30f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:52:58 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-6ada7a64-8579-4279-8750-1a61e0b2b384 req-655c792d-f1ef-4a4e-b6a7-359d08514850 service nova] Lock "a19b6a96-340f-488e-af81-853ee56bf30f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:52:58 user nova-compute[75045]: DEBUG nova.compute.manager [req-6ada7a64-8579-4279-8750-1a61e0b2b384 req-655c792d-f1ef-4a4e-b6a7-359d08514850 service nova] [instance: a19b6a96-340f-488e-af81-853ee56bf30f] No waiting events found dispatching network-vif-plugged-f3fb96dd-b444-47d0-98ff-0c7c910dbede {{(pid=75045) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 23:52:58 user nova-compute[75045]: WARNING nova.compute.manager [req-6ada7a64-8579-4279-8750-1a61e0b2b384 req-655c792d-f1ef-4a4e-b6a7-359d08514850 service nova] [instance: a19b6a96-340f-488e-af81-853ee56bf30f] Received unexpected event network-vif-plugged-f3fb96dd-b444-47d0-98ff-0c7c910dbede for instance with vm_state building and task_state spawning.
Nov 08 23:52:58 user nova-compute[75045]: DEBUG nova.compute.manager [None req-c630dca2-04c4-4dab-9a65-6f497eca7bcb tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] [instance: a19b6a96-340f-488e-af81-853ee56bf30f] Instance event wait completed in 0 seconds for  {{(pid=75045) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 23:52:58 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-c630dca2-04c4-4dab-9a65-6f497eca7bcb tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] [instance: a19b6a96-340f-488e-af81-853ee56bf30f] Guest created on hypervisor {{(pid=75045) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 23:52:58 user nova-compute[75045]: INFO nova.virt.libvirt.driver [-] [instance: a19b6a96-340f-488e-af81-853ee56bf30f] Instance spawned successfully.
Nov 08 23:52:58 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-c630dca2-04c4-4dab-9a65-6f497eca7bcb tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] [instance: a19b6a96-340f-488e-af81-853ee56bf30f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75045) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 23:52:58 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-c630dca2-04c4-4dab-9a65-6f497eca7bcb tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] [instance: a19b6a96-340f-488e-af81-853ee56bf30f] Found default for hw_cdrom_bus of ide {{(pid=75045) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 23:52:58 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-c630dca2-04c4-4dab-9a65-6f497eca7bcb tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] [instance: a19b6a96-340f-488e-af81-853ee56bf30f] Found default for hw_disk_bus of virtio {{(pid=75045) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 23:52:58 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-c630dca2-04c4-4dab-9a65-6f497eca7bcb tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] [instance: a19b6a96-340f-488e-af81-853ee56bf30f] Found default for hw_input_bus of None {{(pid=75045) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 23:52:58 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-c630dca2-04c4-4dab-9a65-6f497eca7bcb tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] [instance: a19b6a96-340f-488e-af81-853ee56bf30f] Found default for hw_pointer_model of None {{(pid=75045) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 23:52:58 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-c630dca2-04c4-4dab-9a65-6f497eca7bcb tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] [instance: a19b6a96-340f-488e-af81-853ee56bf30f] Found default for hw_video_model of virtio {{(pid=75045) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 23:52:58 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-c630dca2-04c4-4dab-9a65-6f497eca7bcb tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] [instance: a19b6a96-340f-488e-af81-853ee56bf30f] Found default for hw_vif_model of virtio {{(pid=75045) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 23:52:58 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:52:59 user nova-compute[75045]: INFO nova.compute.manager [None req-c630dca2-04c4-4dab-9a65-6f497eca7bcb tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] [instance: a19b6a96-340f-488e-af81-853ee56bf30f] Took 7.04 seconds to spawn the instance on the hypervisor.
Nov 08 23:52:59 user nova-compute[75045]: DEBUG nova.compute.manager [None req-c630dca2-04c4-4dab-9a65-6f497eca7bcb tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] [instance: a19b6a96-340f-488e-af81-853ee56bf30f] Checking state {{(pid=75045) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 23:52:59 user nova-compute[75045]: INFO nova.compute.manager [None req-c630dca2-04c4-4dab-9a65-6f497eca7bcb tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] [instance: a19b6a96-340f-488e-af81-853ee56bf30f] Took 7.72 seconds to build instance.
Nov 08 23:52:59 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-c630dca2-04c4-4dab-9a65-6f497eca7bcb tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Lock "a19b6a96-340f-488e-af81-853ee56bf30f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.853s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:52:59 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:52:59 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:52:59 user nova-compute[75045]: DEBUG nova.compute.manager [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Starting heal instance info cache {{(pid=75045) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 23:53:00 user nova-compute[75045]: DEBUG nova.compute.manager [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Didn't find any instances for network info cache update. {{(pid=75045) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 08 23:53:01 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:53:01 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:53:01 user nova-compute[75045]: DEBUG nova.compute.manager [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75045) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 23:53:02 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:53:04 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:53:04 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:53:05 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:53:06 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:53:06 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:53:07 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:53:09 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:53:11 user nova-compute[75045]: DEBUG nova.compute.manager [req-f7ad6515-f89d-4b19-a669-57f2465b0cd6 req-bb8d7f8e-5735-4561-a17e-1d95941099e8 service nova] [instance: c7b3eac2-a51b-40e7-a199-66aee8d2da09] Received event network-changed-ee3648b5-a27a-401d-8708-e25f28d987da {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:53:11 user nova-compute[75045]: DEBUG nova.compute.manager [req-f7ad6515-f89d-4b19-a669-57f2465b0cd6 req-bb8d7f8e-5735-4561-a17e-1d95941099e8 service nova] [instance: c7b3eac2-a51b-40e7-a199-66aee8d2da09] Refreshing instance network info cache due to event network-changed-ee3648b5-a27a-401d-8708-e25f28d987da. {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 23:53:11 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-f7ad6515-f89d-4b19-a669-57f2465b0cd6 req-bb8d7f8e-5735-4561-a17e-1d95941099e8 service nova] Acquiring lock "refresh_cache-c7b3eac2-a51b-40e7-a199-66aee8d2da09" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 23:53:11 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-f7ad6515-f89d-4b19-a669-57f2465b0cd6 req-bb8d7f8e-5735-4561-a17e-1d95941099e8 service nova] Acquired lock "refresh_cache-c7b3eac2-a51b-40e7-a199-66aee8d2da09" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 23:53:11 user nova-compute[75045]: DEBUG nova.network.neutron [req-f7ad6515-f89d-4b19-a669-57f2465b0cd6 req-bb8d7f8e-5735-4561-a17e-1d95941099e8 service nova] [instance: c7b3eac2-a51b-40e7-a199-66aee8d2da09] Refreshing network info cache for port ee3648b5-a27a-401d-8708-e25f28d987da {{(pid=75045) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 23:53:11 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager.update_available_resource {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:53:12 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:53:12 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:53:12 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:53:12 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Auditing locally available compute resources for user (node: user) {{(pid=75045) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 23:53:12 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:53:12 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7b3eac2-a51b-40e7-a199-66aee8d2da09/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:53:12 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7b3eac2-a51b-40e7-a199-66aee8d2da09/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:53:12 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7b3eac2-a51b-40e7-a199-66aee8d2da09/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:53:12 user nova-compute[75045]: DEBUG nova.network.neutron [req-f7ad6515-f89d-4b19-a669-57f2465b0cd6 req-bb8d7f8e-5735-4561-a17e-1d95941099e8 service nova] [instance: c7b3eac2-a51b-40e7-a199-66aee8d2da09] Updated VIF entry in instance network info cache for port ee3648b5-a27a-401d-8708-e25f28d987da. {{(pid=75045) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 23:53:12 user nova-compute[75045]: DEBUG nova.network.neutron [req-f7ad6515-f89d-4b19-a669-57f2465b0cd6 req-bb8d7f8e-5735-4561-a17e-1d95941099e8 service nova] [instance: c7b3eac2-a51b-40e7-a199-66aee8d2da09] Updating instance_info_cache with network_info: [{"id": "ee3648b5-a27a-401d-8708-e25f28d987da", "address": "fa:16:3e:37:0b:9c", "network": {"id": "fe5f7093-1cdd-465c-97f0-7d7b2dd1fa8a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1755065955-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4bfce59008d44fdb5ba91c70f1cf044", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee3648b5-a2", "ovs_interfaceid": "ee3648b5-a27a-401d-8708-e25f28d987da", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75045) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 23:53:12 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-f7ad6515-f89d-4b19-a669-57f2465b0cd6 req-bb8d7f8e-5735-4561-a17e-1d95941099e8 service nova] Releasing lock "refresh_cache-c7b3eac2-a51b-40e7-a199-66aee8d2da09" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 23:53:12 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7b3eac2-a51b-40e7-a199-66aee8d2da09/disk --force-share --output=json" returned: 0 in 0.272s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:53:12 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75045) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 23:53:12 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75045) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 23:53:12 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a19b6a96-340f-488e-af81-853ee56bf30f/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:53:12 user nova-compute[75045]: DEBUG nova.compute.manager [req-aa99bc00-add8-4296-8d3d-49852443f042 req-8ba86d2f-dab3-4985-9b90-6ec32f9f35ab service nova] [instance: c7b3eac2-a51b-40e7-a199-66aee8d2da09] Received event network-changed-ee3648b5-a27a-401d-8708-e25f28d987da {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:53:12 user nova-compute[75045]: DEBUG nova.compute.manager [req-aa99bc00-add8-4296-8d3d-49852443f042 req-8ba86d2f-dab3-4985-9b90-6ec32f9f35ab service nova] [instance: c7b3eac2-a51b-40e7-a199-66aee8d2da09] Refreshing instance network info cache due to event network-changed-ee3648b5-a27a-401d-8708-e25f28d987da. {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 23:53:12 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-aa99bc00-add8-4296-8d3d-49852443f042 req-8ba86d2f-dab3-4985-9b90-6ec32f9f35ab service nova] Acquiring lock "refresh_cache-c7b3eac2-a51b-40e7-a199-66aee8d2da09" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 23:53:12 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-aa99bc00-add8-4296-8d3d-49852443f042 req-8ba86d2f-dab3-4985-9b90-6ec32f9f35ab service nova] Acquired lock "refresh_cache-c7b3eac2-a51b-40e7-a199-66aee8d2da09" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 23:53:12 user nova-compute[75045]: DEBUG nova.network.neutron [req-aa99bc00-add8-4296-8d3d-49852443f042 req-8ba86d2f-dab3-4985-9b90-6ec32f9f35ab service nova] [instance: c7b3eac2-a51b-40e7-a199-66aee8d2da09] Refreshing network info cache for port ee3648b5-a27a-401d-8708-e25f28d987da {{(pid=75045) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 23:53:12 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a19b6a96-340f-488e-af81-853ee56bf30f/disk --force-share --output=json" returned: 0 in 0.240s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:53:12 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a19b6a96-340f-488e-af81-853ee56bf30f/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:53:13 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a19b6a96-340f-488e-af81-853ee56bf30f/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:53:13 user nova-compute[75045]: WARNING nova.virt.libvirt.driver [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 23:53:13 user nova-compute[75045]: WARNING nova.virt.libvirt.driver [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 23:53:13 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Hypervisor/Node resource view: name=user free_ram=8456MB free_disk=24.956302642822266GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75045) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 23:53:13 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:53:13 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:53:13 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-bb9da93a-2d6a-43ca-9f1b-c04410b63c10 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] Acquiring lock "c7b3eac2-a51b-40e7-a199-66aee8d2da09" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:53:13 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-bb9da93a-2d6a-43ca-9f1b-c04410b63c10 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] Lock "c7b3eac2-a51b-40e7-a199-66aee8d2da09" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:53:13 user nova-compute[75045]: INFO nova.compute.manager [None req-bb9da93a-2d6a-43ca-9f1b-c04410b63c10 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] [instance: c7b3eac2-a51b-40e7-a199-66aee8d2da09] Detaching volume ac646643-9cac-4f95-bf27-7156728caf3d
Nov 08 23:53:13 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Instance c7b3eac2-a51b-40e7-a199-66aee8d2da09 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75045) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 23:53:13 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Instance 08fae2f1-6fa1-41f9-b6ac-7ea5ff7ce089 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75045) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 23:53:13 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Instance a19b6a96-340f-488e-af81-853ee56bf30f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75045) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 23:53:13 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=75045) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 23:53:13 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=75045) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 23:53:13 user nova-compute[75045]: INFO nova.virt.block_device [None req-bb9da93a-2d6a-43ca-9f1b-c04410b63c10 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] [instance: c7b3eac2-a51b-40e7-a199-66aee8d2da09] Attempting to driver detach volume ac646643-9cac-4f95-bf27-7156728caf3d from mountpoint /dev/vdb
Nov 08 23:53:13 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-bb9da93a-2d6a-43ca-9f1b-c04410b63c10 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] Attempting to detach device vdb from instance c7b3eac2-a51b-40e7-a199-66aee8d2da09 from the persistent domain config. {{(pid=75045) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 08 23:53:13 user nova-compute[75045]: DEBUG nova.virt.libvirt.guest [None req-bb9da93a-2d6a-43ca-9f1b-c04410b63c10 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 23:53:13 user nova-compute[75045]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 23:53:13 user nova-compute[75045]:   <source dev="/dev/sdb"/>
Nov 08 23:53:13 user nova-compute[75045]:   <target dev="vdb" bus="virtio"/>
Nov 08 23:53:13 user nova-compute[75045]:   <serial>ac646643-9cac-4f95-bf27-7156728caf3d</serial>
Nov 08 23:53:13 user nova-compute[75045]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 08 23:53:13 user nova-compute[75045]: </disk>
Nov 08 23:53:13 user nova-compute[75045]:  {{(pid=75045) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 23:53:13 user nova-compute[75045]: INFO nova.virt.libvirt.driver [None req-bb9da93a-2d6a-43ca-9f1b-c04410b63c10 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] Successfully detached device vdb from instance c7b3eac2-a51b-40e7-a199-66aee8d2da09 from the persistent domain config.
Nov 08 23:53:13 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-bb9da93a-2d6a-43ca-9f1b-c04410b63c10 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance c7b3eac2-a51b-40e7-a199-66aee8d2da09 from the live domain config. {{(pid=75045) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 08 23:53:13 user nova-compute[75045]: DEBUG nova.virt.libvirt.guest [None req-bb9da93a-2d6a-43ca-9f1b-c04410b63c10 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 23:53:13 user nova-compute[75045]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 23:53:13 user nova-compute[75045]:   <source dev="/dev/sdb"/>
Nov 08 23:53:13 user nova-compute[75045]:   <target dev="vdb" bus="virtio"/>
Nov 08 23:53:13 user nova-compute[75045]:   <serial>ac646643-9cac-4f95-bf27-7156728caf3d</serial>
Nov 08 23:53:13 user nova-compute[75045]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 08 23:53:13 user nova-compute[75045]: </disk>
Nov 08 23:53:13 user nova-compute[75045]:  {{(pid=75045) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 23:53:13 user nova-compute[75045]: DEBUG nova.network.neutron [req-aa99bc00-add8-4296-8d3d-49852443f042 req-8ba86d2f-dab3-4985-9b90-6ec32f9f35ab service nova] [instance: c7b3eac2-a51b-40e7-a199-66aee8d2da09] Updated VIF entry in instance network info cache for port ee3648b5-a27a-401d-8708-e25f28d987da. {{(pid=75045) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 23:53:13 user nova-compute[75045]: DEBUG nova.network.neutron [req-aa99bc00-add8-4296-8d3d-49852443f042 req-8ba86d2f-dab3-4985-9b90-6ec32f9f35ab service nova] [instance: c7b3eac2-a51b-40e7-a199-66aee8d2da09] Updating instance_info_cache with network_info: [{"id": "ee3648b5-a27a-401d-8708-e25f28d987da", "address": "fa:16:3e:37:0b:9c", "network": {"id": "fe5f7093-1cdd-465c-97f0-7d7b2dd1fa8a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1755065955-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4bfce59008d44fdb5ba91c70f1cf044", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee3648b5-a2", "ovs_interfaceid": "ee3648b5-a27a-401d-8708-e25f28d987da", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75045) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 23:53:13 user nova-compute[75045]: DEBUG nova.compute.provider_tree [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Inventory has not changed in ProviderTree for provider: 62ba5f85-c74d-4b58-986e-d4197e813fd7 {{(pid=75045) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 23:53:13 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-aa99bc00-add8-4296-8d3d-49852443f042 req-8ba86d2f-dab3-4985-9b90-6ec32f9f35ab service nova] Releasing lock "refresh_cache-c7b3eac2-a51b-40e7-a199-66aee8d2da09" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 23:53:13 user nova-compute[75045]: DEBUG nova.scheduler.client.report [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Inventory has not changed for provider 62ba5f85-c74d-4b58-986e-d4197e813fd7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75045) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 23:53:14 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Compute_service record updated for user:user {{(pid=75045) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 23:53:14 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.352s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:53:14 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-bb9da93a-2d6a-43ca-9f1b-c04410b63c10 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance c7b3eac2-a51b-40e7-a199-66aee8d2da09 {{(pid=75045) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 08 23:53:14 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:53:17 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:53:19 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:53:22 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:53:24 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:53:27 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:53:29 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:53:34 user nova-compute[75045]: WARNING nova.virt.libvirt.driver [None req-bb9da93a-2d6a-43ca-9f1b-c04410b63c10 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance c7b3eac2-a51b-40e7-a199-66aee8d2da09 is timed out.
Nov 08 23:53:34 user nova-compute[75045]: INFO nova.virt.libvirt.driver [None req-bb9da93a-2d6a-43ca-9f1b-c04410b63c10 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] Successfully detached device vdb from instance c7b3eac2-a51b-40e7-a199-66aee8d2da09 from the live domain config.
Nov 08 23:53:34 user nova-compute[75045]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bb9da93a-2d6a-43ca-9f1b-c04410b63c10 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] [instance: c7b3eac2-a51b-40e7-a199-66aee8d2da09] calling os-brick to detach iSCSI Volume {{(pid=75045) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 23:53:34 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb9da93a-2d6a-43ca-9f1b-c04410b63c10 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1b68210460>, {'target_iqn': 'iqn.2010-10.org.openstack:ac646643-9cac-4f95-bf27-7156728caf3d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ucbtGIhC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75045) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 23:53:34 user nova-compute[75045]: WARNING os_brick.initiator.connectors.base [None req-bb9da93a-2d6a-43ca-9f1b-c04410b63c10 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 23:53:34 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-bb9da93a-2d6a-43ca-9f1b-c04410b63c10 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 23:53:34 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-bb9da93a-2d6a-43ca-9f1b-c04410b63c10 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 23:53:34 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:53:34 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:53:34 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[f59df6ca-7c08-40e7-8fa8-e2e1aa1febb6]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ac646643-9cac-4f95-bf27-7156728caf3d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:dcbd911e-f385-4ed6-b8a4-383b3b56cf7d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:53:34 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb9da93a-2d6a-43ca-9f1b-c04410b63c10 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 23:53:34 user nova-compute[75045]: No targets found.
Nov 08 23:53:34 user nova-compute[75045]: iSNS:
Nov 08 23:53:34 user nova-compute[75045]: No targets found.
Nov 08 23:53:34 user nova-compute[75045]: STATIC:
Nov 08 23:53:34 user nova-compute[75045]: Target: iqn.2010-10.org.openstack:ac646643-9cac-4f95-bf27-7156728caf3d
Nov 08 23:53:34 user nova-compute[75045]:         Portal: 172.16.0.220:3260,-1
Nov 08 23:53:34 user nova-compute[75045]:                 Iface Name: default
Nov 08 23:53:34 user nova-compute[75045]: Target: iqn.2010-10.org.openstack:dcbd911e-f385-4ed6-b8a4-383b3b56cf7d
Nov 08 23:53:34 user nova-compute[75045]:         Portal: 172.16.0.220:3260,-1
Nov 08 23:53:34 user nova-compute[75045]:                 Iface Name: default
Nov 08 23:53:34 user nova-compute[75045]: FIRMWARE:
Nov 08 23:53:34 user nova-compute[75045]: No targets found.
Nov 08 23:53:34 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 23:53:34 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb9da93a-2d6a-43ca-9f1b-c04410b63c10 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 23:53:34 user nova-compute[75045]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 23:53:34 user nova-compute[75045]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75045) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 23:53:34 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb9da93a-2d6a-43ca-9f1b-c04410b63c10 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ac646643-9cac-4f95-bf27-7156728caf3d', 0)] {{(pid=75045) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 23:53:34 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:53:34 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:53:34 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[868ae64f-dfad-4c0c-a852-14a4f0430395]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ac646643-9cac-4f95-bf27-7156728caf3d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dcbd911e-f385-4ed6-b8a4-383b3b56cf7d\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:53:34 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:53:34 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:53:34 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[764faca7-6560-4000-b165-63b0781e08c8]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac646643-9cac-4f95-bf27-7156728caf3d (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcbd911e-f385-4ed6-b8a4-383b3b56cf7d (non-flash)\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:53:34 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb9da93a-2d6a-43ca-9f1b-c04410b63c10 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac646643-9cac-4f95-bf27-7156728caf3d (non-flash)
Nov 08 23:53:34 user nova-compute[75045]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcbd911e-f385-4ed6-b8a4-383b3b56cf7d (non-flash)
Nov 08 23:53:34 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 23:53:34 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb9da93a-2d6a-43ca-9f1b-c04410b63c10 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac646643-9cac-4f95-bf27-7156728caf3d (non-flash)
Nov 08 23:53:34 user nova-compute[75045]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcbd911e-f385-4ed6-b8a4-383b3b56cf7d (non-flash)
Nov 08 23:53:34 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 23:53:34 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb9da93a-2d6a-43ca-9f1b-c04410b63c10 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1b48210280>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ac646643-9cac-4f95-bf27-7156728caf3d'): ({'sdb'}, set())}) {{(pid=75045) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 23:53:34 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-bb9da93a-2d6a-43ca-9f1b-c04410b63c10 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] Removing single pathed devices sdb {{(pid=75045) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 23:53:34 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:53:34 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:53:34 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[a754da4b-acce-484c-b3ec-ffdefe0dc0e3]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:53:34 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:53:34 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.026s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:53:34 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d1063e8-f2fd-40e8-9d57-78de51fde62c]: (4, ('ok\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:53:34 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-bb9da93a-2d6a-43ca-9f1b-c04410b63c10 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] Flushing IO for device /dev/sdb {{(pid=75045) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 23:53:34 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:53:34 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:53:34 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[f742e70e-7fbc-4980-b497-d1f324864e15]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:53:34 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-bb9da93a-2d6a-43ca-9f1b-c04410b63c10 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75045) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 23:53:34 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:53:34 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.045s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:53:34 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c07e2c3-3182-4f5a-b47d-0b58fc3a86c5]: (4, ('1', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:53:34 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-bb9da93a-2d6a-43ca-9f1b-c04410b63c10 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75045) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 23:53:34 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-bb9da93a-2d6a-43ca-9f1b-c04410b63c10 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] SCSI volumes sdb have been removed. {{(pid=75045) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 23:53:34 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb9da93a-2d6a-43ca-9f1b-c04410b63c10 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ac646643-9cac-4f95-bf27-7156728caf3d')] {{(pid=75045) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 23:53:34 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac646643-9cac-4f95-bf27-7156728caf3d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:53:34 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac646643-9cac-4f95-bf27-7156728caf3d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:53:34 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[f33493e5-7a37-465a-9730-a92dc6facd59]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:53:34 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb9da93a-2d6a-43ca-9f1b-c04410b63c10 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:53:34 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac646643-9cac-4f95-bf27-7156728caf3d -p 172.16.0.220:3260 --logout {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:53:34 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac646643-9cac-4f95-bf27-7156728caf3d -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:53:34 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[30915175-3254-4bfa-8572-6d57b2950ea9]: (4, ('Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:ac646643-9cac-4f95-bf27-7156728caf3d, portal: 172.16.0.220,3260]\nLogout of [sid: 48, target: iqn.2010-10.org.openstack:ac646643-9cac-4f95-bf27-7156728caf3d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:53:34 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb9da93a-2d6a-43ca-9f1b-c04410b63c10 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:ac646643-9cac-4f95-bf27-7156728caf3d, portal: 172.16.0.220,3260]
Nov 08 23:53:34 user nova-compute[75045]: Logout of [sid: 48, target: iqn.2010-10.org.openstack:ac646643-9cac-4f95-bf27-7156728caf3d, portal: 172.16.0.220,3260] successful.
Nov 08 23:53:34 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:53:34 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac646643-9cac-4f95-bf27-7156728caf3d -p 172.16.0.220:3260 --op delete {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:53:34 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac646643-9cac-4f95-bf27-7156728caf3d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:53:34 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[7811563a-ddcb-4c22-adfc-2780f3cbbb7e]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:53:34 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb9da93a-2d6a-43ca-9f1b-c04410b63c10 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:53:34 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-bb9da93a-2d6a-43ca-9f1b-c04410b63c10 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.310s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 23:53:34 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb9da93a-2d6a-43ca-9f1b-c04410b63c10 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] <== disconnect_volume: return (312ms) None {{(pid=75045) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 23:53:34 user nova-compute[75045]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bb9da93a-2d6a-43ca-9f1b-c04410b63c10 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] [instance: c7b3eac2-a51b-40e7-a199-66aee8d2da09] Disconnected iSCSI Volume {{(pid=75045) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 23:53:34 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:53:35 user nova-compute[75045]: DEBUG nova.objects.instance [None req-bb9da93a-2d6a-43ca-9f1b-c04410b63c10 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] Lazy-loading 'flavor' on Instance uuid c7b3eac2-a51b-40e7-a199-66aee8d2da09 {{(pid=75045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 23:53:35 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-bb9da93a-2d6a-43ca-9f1b-c04410b63c10 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] Lock "c7b3eac2-a51b-40e7-a199-66aee8d2da09" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.897s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:53:39 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 23:53:39 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 23:53:39 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75045) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 23:53:39 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75045) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 23:53:39 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75045) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 23:53:39 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:53:44 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 23:53:44 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:53:44 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75045) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 23:53:44 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75045) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 23:53:44 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75045) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 23:53:44 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:53:49 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 23:53:54 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 23:53:59 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 23:53:59 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:53:59 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75045) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 23:53:59 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75045) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 23:53:59 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75045) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 23:53:59 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 23:54:03 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:54:03 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:54:03 user nova-compute[75045]: DEBUG nova.compute.manager [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Starting heal instance info cache {{(pid=75045) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 23:54:03 user nova-compute[75045]: DEBUG nova.compute.manager [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Rebuilding the list of instances to heal {{(pid=75045) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 08 23:54:03 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Acquiring lock "refresh_cache-c7b3eac2-a51b-40e7-a199-66aee8d2da09" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 23:54:03 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Acquired lock "refresh_cache-c7b3eac2-a51b-40e7-a199-66aee8d2da09" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 23:54:03 user nova-compute[75045]: DEBUG nova.network.neutron [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] [instance: c7b3eac2-a51b-40e7-a199-66aee8d2da09] Forcefully refreshing network info cache for instance {{(pid=75045) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 23:54:03 user nova-compute[75045]: DEBUG nova.objects.instance [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Lazy-loading 'info_cache' on Instance uuid c7b3eac2-a51b-40e7-a199-66aee8d2da09 {{(pid=75045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 23:54:03 user nova-compute[75045]: DEBUG nova.network.neutron [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] [instance: c7b3eac2-a51b-40e7-a199-66aee8d2da09] Updating instance_info_cache with network_info: [{"id": "ee3648b5-a27a-401d-8708-e25f28d987da", "address": "fa:16:3e:37:0b:9c", "network": {"id": "fe5f7093-1cdd-465c-97f0-7d7b2dd1fa8a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1755065955-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4bfce59008d44fdb5ba91c70f1cf044", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee3648b5-a2", "ovs_interfaceid": "ee3648b5-a27a-401d-8708-e25f28d987da", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75045) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 23:54:03 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Releasing lock "refresh_cache-c7b3eac2-a51b-40e7-a199-66aee8d2da09" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 23:54:03 user nova-compute[75045]: DEBUG nova.compute.manager [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] [instance: c7b3eac2-a51b-40e7-a199-66aee8d2da09] Updated the network info_cache for instance {{(pid=75045) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 23:54:03 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:54:03 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:54:03 user nova-compute[75045]: DEBUG nova.compute.manager [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75045) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 23:54:04 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 23:54:06 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:54:06 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:54:06 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:54:07 user nova-compute[75045]: DEBUG nova.compute.manager [req-712549f0-d777-4ab2-902c-bc82f1cb87b9 req-b2c8d949-ce8f-40ed-9b44-5739674defcd service nova] [instance: 08fae2f1-6fa1-41f9-b6ac-7ea5ff7ce089] Received event network-changed-ced9d13a-eae0-4a08-b54c-75e4d1b3234e {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:54:07 user nova-compute[75045]: DEBUG nova.compute.manager [req-712549f0-d777-4ab2-902c-bc82f1cb87b9 req-b2c8d949-ce8f-40ed-9b44-5739674defcd service nova] [instance: 08fae2f1-6fa1-41f9-b6ac-7ea5ff7ce089] Refreshing instance network info cache due to event network-changed-ced9d13a-eae0-4a08-b54c-75e4d1b3234e. {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 23:54:07 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-712549f0-d777-4ab2-902c-bc82f1cb87b9 req-b2c8d949-ce8f-40ed-9b44-5739674defcd service nova] Acquiring lock "refresh_cache-08fae2f1-6fa1-41f9-b6ac-7ea5ff7ce089" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 23:54:07 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-712549f0-d777-4ab2-902c-bc82f1cb87b9 req-b2c8d949-ce8f-40ed-9b44-5739674defcd service nova] Acquired lock "refresh_cache-08fae2f1-6fa1-41f9-b6ac-7ea5ff7ce089" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 23:54:07 user nova-compute[75045]: DEBUG nova.network.neutron [req-712549f0-d777-4ab2-902c-bc82f1cb87b9 req-b2c8d949-ce8f-40ed-9b44-5739674defcd service nova] [instance: 08fae2f1-6fa1-41f9-b6ac-7ea5ff7ce089] Refreshing network info cache for port ced9d13a-eae0-4a08-b54c-75e4d1b3234e {{(pid=75045) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 23:54:07 user nova-compute[75045]: DEBUG nova.network.neutron [req-712549f0-d777-4ab2-902c-bc82f1cb87b9 req-b2c8d949-ce8f-40ed-9b44-5739674defcd service nova] [instance: 08fae2f1-6fa1-41f9-b6ac-7ea5ff7ce089] Updated VIF entry in instance network info cache for port ced9d13a-eae0-4a08-b54c-75e4d1b3234e. {{(pid=75045) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 23:54:07 user nova-compute[75045]: DEBUG nova.network.neutron [req-712549f0-d777-4ab2-902c-bc82f1cb87b9 req-b2c8d949-ce8f-40ed-9b44-5739674defcd service nova] [instance: 08fae2f1-6fa1-41f9-b6ac-7ea5ff7ce089] Updating instance_info_cache with network_info: [{"id": "ced9d13a-eae0-4a08-b54c-75e4d1b3234e", "address": "fa:16:3e:b7:c7:a1", "network": {"id": "4205f899-9865-4c65-8b46-c9a533e9bb45", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-774780781-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d59b73851c79473a9c2cdc0a120dfee0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapced9d13a-ea", "ovs_interfaceid": "ced9d13a-eae0-4a08-b54c-75e4d1b3234e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75045) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 23:54:07 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-712549f0-d777-4ab2-902c-bc82f1cb87b9 req-b2c8d949-ce8f-40ed-9b44-5739674defcd service nova] Releasing lock "refresh_cache-08fae2f1-6fa1-41f9-b6ac-7ea5ff7ce089" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 23:54:08 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-04768ce5-df99-4f47-9709-938322c42d60 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Acquiring lock "08fae2f1-6fa1-41f9-b6ac-7ea5ff7ce089" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:54:08 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-04768ce5-df99-4f47-9709-938322c42d60 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Lock "08fae2f1-6fa1-41f9-b6ac-7ea5ff7ce089" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:54:08 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-04768ce5-df99-4f47-9709-938322c42d60 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Acquiring lock "08fae2f1-6fa1-41f9-b6ac-7ea5ff7ce089-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:54:08 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-04768ce5-df99-4f47-9709-938322c42d60 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Lock "08fae2f1-6fa1-41f9-b6ac-7ea5ff7ce089-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:54:08 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-04768ce5-df99-4f47-9709-938322c42d60 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Lock "08fae2f1-6fa1-41f9-b6ac-7ea5ff7ce089-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:54:08 user nova-compute[75045]: INFO nova.compute.manager [None req-04768ce5-df99-4f47-9709-938322c42d60 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] [instance: 08fae2f1-6fa1-41f9-b6ac-7ea5ff7ce089] Terminating instance
Nov 08 23:54:08 user nova-compute[75045]: DEBUG nova.compute.manager [None req-04768ce5-df99-4f47-9709-938322c42d60 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] [instance: 08fae2f1-6fa1-41f9-b6ac-7ea5ff7ce089] Start destroying the instance on the hypervisor. {{(pid=75045) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 23:54:08 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:54:08 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:54:08 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:54:08 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:54:08 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:54:08 user nova-compute[75045]: INFO nova.virt.libvirt.driver [-] [instance: 08fae2f1-6fa1-41f9-b6ac-7ea5ff7ce089] Instance destroyed successfully.
Nov 08 23:54:08 user nova-compute[75045]: DEBUG nova.objects.instance [None req-04768ce5-df99-4f47-9709-938322c42d60 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Lazy-loading 'resources' on Instance uuid 08fae2f1-6fa1-41f9-b6ac-7ea5ff7ce089 {{(pid=75045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 23:54:08 user nova-compute[75045]: DEBUG nova.virt.libvirt.vif [None req-04768ce5-df99-4f47-9709-938322c42d60 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T23:51:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1363662702',display_name='tempest-TestVolumeBootPattern-server-1363662702',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1363662702',id=48,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG4FMrZDNuVfIPnXfxN4nyoUo/5k5pInfzFUTQXcG54GN3K7TKcBDzRT7RSwNm2HHReK/sg/U9LFWtj081VW6fTpNzjBNfOxhMg0DqXN9g7DbQBYyYNAjTBN+tAvF+1fCA==',key_name='tempest-TestVolumeBootPattern-1614211608',keypairs=<?>,launch_index=0,launched_at=2023-11-08T23:52:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d59b73851c79473a9c2cdc0a120dfee0',ramdisk_id='',reservation_id='r-bqs394wa',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-650796844',owner_user_name='tempest-TestVolumeBootPattern-650796844-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T23:52:39Z,user_data=None,user_id='76c31c64d9594f9cbef7586fafb48721',uuid=08fae2f1-6fa1-41f9-b6ac-7ea5ff7ce089,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ced9d13a-eae0-4a08-b54c-75e4d1b3234e", "address": "fa:16:3e:b7:c7:a1", "network": {"id": "4205f899-9865-4c65-8b46-c9a533e9bb45", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-774780781-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d59b73851c79473a9c2cdc0a120dfee0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapced9d13a-ea", "ovs_interfaceid": "ced9d13a-eae0-4a08-b54c-75e4d1b3234e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75045) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 23:54:08 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-04768ce5-df99-4f47-9709-938322c42d60 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Converting VIF {"id": "ced9d13a-eae0-4a08-b54c-75e4d1b3234e", "address": "fa:16:3e:b7:c7:a1", "network": {"id": "4205f899-9865-4c65-8b46-c9a533e9bb45", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-774780781-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d59b73851c79473a9c2cdc0a120dfee0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapced9d13a-ea", "ovs_interfaceid": "ced9d13a-eae0-4a08-b54c-75e4d1b3234e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 23:54:08 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-04768ce5-df99-4f47-9709-938322c42d60 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b7:c7:a1,bridge_name='br-int',has_traffic_filtering=True,id=ced9d13a-eae0-4a08-b54c-75e4d1b3234e,network=Network(4205f899-9865-4c65-8b46-c9a533e9bb45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapced9d13a-ea') {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 23:54:08 user nova-compute[75045]: DEBUG os_vif [None req-04768ce5-df99-4f47-9709-938322c42d60 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b7:c7:a1,bridge_name='br-int',has_traffic_filtering=True,id=ced9d13a-eae0-4a08-b54c-75e4d1b3234e,network=Network(4205f899-9865-4c65-8b46-c9a533e9bb45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapced9d13a-ea') {{(pid=75045) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 23:54:08 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:54:08 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapced9d13a-ea, bridge=br-int, if_exists=True) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:54:08 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:54:08 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 23:54:08 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:54:08 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=282b0b29-a830-478d-b633-df2776e853be) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:54:08 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:54:08 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 23:54:08 user nova-compute[75045]: INFO os_vif [None req-04768ce5-df99-4f47-9709-938322c42d60 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b7:c7:a1,bridge_name='br-int',has_traffic_filtering=True,id=ced9d13a-eae0-4a08-b54c-75e4d1b3234e,network=Network(4205f899-9865-4c65-8b46-c9a533e9bb45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapced9d13a-ea')
Nov 08 23:54:08 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:54:08 user nova-compute[75045]: DEBUG nova.virt.libvirt.volume.iscsi [None req-04768ce5-df99-4f47-9709-938322c42d60 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] [instance: 08fae2f1-6fa1-41f9-b6ac-7ea5ff7ce089] calling os-brick to detach iSCSI Volume {{(pid=75045) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 23:54:08 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-04768ce5-df99-4f47-9709-938322c42d60 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1b68210460>, {'target_iqn': 'iqn.2010-10.org.openstack:dcbd911e-f385-4ed6-b8a4-383b3b56cf7d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vcbhzLqi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75045) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 23:54:08 user nova-compute[75045]: WARNING os_brick.initiator.connectors.base [None req-04768ce5-df99-4f47-9709-938322c42d60 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 23:54:08 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-04768ce5-df99-4f47-9709-938322c42d60 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 23:54:08 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-04768ce5-df99-4f47-9709-938322c42d60 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 23:54:08 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:54:09 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:54:09 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe48dfce-c0cd-490a-a76b-1af8637c6d1f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:dcbd911e-f385-4ed6-b8a4-383b3b56cf7d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:54:09 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-04768ce5-df99-4f47-9709-938322c42d60 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 23:54:09 user nova-compute[75045]: No targets found.
Nov 08 23:54:09 user nova-compute[75045]: iSNS:
Nov 08 23:54:09 user nova-compute[75045]: No targets found.
Nov 08 23:54:09 user nova-compute[75045]: STATIC:
Nov 08 23:54:09 user nova-compute[75045]: Target: iqn.2010-10.org.openstack:dcbd911e-f385-4ed6-b8a4-383b3b56cf7d
Nov 08 23:54:09 user nova-compute[75045]:         Portal: 172.16.0.220:3260,-1
Nov 08 23:54:09 user nova-compute[75045]:                 Iface Name: default
Nov 08 23:54:09 user nova-compute[75045]: FIRMWARE:
Nov 08 23:54:09 user nova-compute[75045]: No targets found.
Nov 08 23:54:09 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 23:54:09 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-04768ce5-df99-4f47-9709-938322c42d60 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 23:54:09 user nova-compute[75045]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 23:54:09 user nova-compute[75045]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75045) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 23:54:09 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-04768ce5-df99-4f47-9709-938322c42d60 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dcbd911e-f385-4ed6-b8a4-383b3b56cf7d', 0)] {{(pid=75045) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 23:54:09 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:54:09 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:54:09 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[5228877e-ac33-4ed3-859e-ca191c6b0ee4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dcbd911e-f385-4ed6-b8a4-383b3b56cf7d\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:54:09 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:54:09 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:54:09 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c2d971b-1277-489e-a14c-e03ca4750177]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcbd911e-f385-4ed6-b8a4-383b3b56cf7d (non-flash)\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:54:09 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-04768ce5-df99-4f47-9709-938322c42d60 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcbd911e-f385-4ed6-b8a4-383b3b56cf7d (non-flash)
Nov 08 23:54:09 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 23:54:09 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-04768ce5-df99-4f47-9709-938322c42d60 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcbd911e-f385-4ed6-b8a4-383b3b56cf7d (non-flash)
Nov 08 23:54:09 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 23:54:09 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-04768ce5-df99-4f47-9709-938322c42d60 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1b4847a8c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dcbd911e-f385-4ed6-b8a4-383b3b56cf7d'): ({'sdc'}, set())}) {{(pid=75045) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 23:54:09 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-04768ce5-df99-4f47-9709-938322c42d60 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Removing single pathed devices sdc {{(pid=75045) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 23:54:09 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:54:09 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:54:09 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5a5610d-306a-413e-96f9-2d5ff36c14f9]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:54:09 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:54:09 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:54:09 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[90b99a37-fca1-4edf-a7b5-adf1e71135d9]: (4, ('ok\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:54:09 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-04768ce5-df99-4f47-9709-938322c42d60 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Flushing IO for device /dev/sdc {{(pid=75045) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 23:54:09 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:54:09 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:54:09 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd1fed90-766a-43e9-bfef-62b3e0edac1b]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:54:09 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-04768ce5-df99-4f47-9709-938322c42d60 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75045) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 23:54:09 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:54:09 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.060s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:54:09 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[85728de7-8adc-47fc-8ac1-e0e1e8585437]: (4, ('1', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:54:09 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-04768ce5-df99-4f47-9709-938322c42d60 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75045) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 23:54:09 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-04768ce5-df99-4f47-9709-938322c42d60 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] SCSI volumes sdc have been removed. {{(pid=75045) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 23:54:09 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-04768ce5-df99-4f47-9709-938322c42d60 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dcbd911e-f385-4ed6-b8a4-383b3b56cf7d')] {{(pid=75045) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 23:54:09 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dcbd911e-f385-4ed6-b8a4-383b3b56cf7d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:54:09 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dcbd911e-f385-4ed6-b8a4-383b3b56cf7d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:54:09 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[272327fe-80ad-4186-b5b2-7d235c23dfac]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:54:09 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-04768ce5-df99-4f47-9709-938322c42d60 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:54:09 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dcbd911e-f385-4ed6-b8a4-383b3b56cf7d -p 172.16.0.220:3260 --logout {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:54:09 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dcbd911e-f385-4ed6-b8a4-383b3b56cf7d -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:54:09 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ea46fcf-0a7c-469d-9886-e44cd7853d9b]: (4, ('Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:dcbd911e-f385-4ed6-b8a4-383b3b56cf7d, portal: 172.16.0.220,3260]\nLogout of [sid: 49, target: iqn.2010-10.org.openstack:dcbd911e-f385-4ed6-b8a4-383b3b56cf7d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:54:09 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-04768ce5-df99-4f47-9709-938322c42d60 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:dcbd911e-f385-4ed6-b8a4-383b3b56cf7d, portal: 172.16.0.220,3260]
Nov 08 23:54:09 user nova-compute[75045]: Logout of [sid: 49, target: iqn.2010-10.org.openstack:dcbd911e-f385-4ed6-b8a4-383b3b56cf7d, portal: 172.16.0.220,3260] successful.
Nov 08 23:54:09 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:54:09 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dcbd911e-f385-4ed6-b8a4-383b3b56cf7d -p 172.16.0.220:3260 --op delete {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:54:09 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dcbd911e-f385-4ed6-b8a4-383b3b56cf7d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:54:09 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[26e34e0e-a720-4b9d-a2f0-8e491e10d670]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:54:09 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-04768ce5-df99-4f47-9709-938322c42d60 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:54:09 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-04768ce5-df99-4f47-9709-938322c42d60 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.336s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 23:54:09 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-04768ce5-df99-4f47-9709-938322c42d60 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] <== disconnect_volume: return (338ms) None {{(pid=75045) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 23:54:09 user nova-compute[75045]: DEBUG nova.virt.libvirt.volume.iscsi [None req-04768ce5-df99-4f47-9709-938322c42d60 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] [instance: 08fae2f1-6fa1-41f9-b6ac-7ea5ff7ce089] Disconnected iSCSI Volume {{(pid=75045) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 23:54:09 user nova-compute[75045]: INFO nova.virt.libvirt.driver [None req-04768ce5-df99-4f47-9709-938322c42d60 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] [instance: 08fae2f1-6fa1-41f9-b6ac-7ea5ff7ce089] Deleting instance files /opt/stack/data/nova/instances/08fae2f1-6fa1-41f9-b6ac-7ea5ff7ce089_del
Nov 08 23:54:09 user nova-compute[75045]: INFO nova.virt.libvirt.driver [None req-04768ce5-df99-4f47-9709-938322c42d60 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] [instance: 08fae2f1-6fa1-41f9-b6ac-7ea5ff7ce089] Deletion of /opt/stack/data/nova/instances/08fae2f1-6fa1-41f9-b6ac-7ea5ff7ce089_del complete
Nov 08 23:54:09 user nova-compute[75045]: DEBUG nova.compute.manager [req-cf7c1305-e6bb-48b6-8e8e-c223209079e7 req-02f53b66-f51d-4fc4-a192-2c1b2b3d7928 service nova] [instance: 08fae2f1-6fa1-41f9-b6ac-7ea5ff7ce089] Received event network-vif-unplugged-ced9d13a-eae0-4a08-b54c-75e4d1b3234e {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:54:09 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-cf7c1305-e6bb-48b6-8e8e-c223209079e7 req-02f53b66-f51d-4fc4-a192-2c1b2b3d7928 service nova] Acquiring lock "08fae2f1-6fa1-41f9-b6ac-7ea5ff7ce089-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:54:09 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-cf7c1305-e6bb-48b6-8e8e-c223209079e7 req-02f53b66-f51d-4fc4-a192-2c1b2b3d7928 service nova] Lock "08fae2f1-6fa1-41f9-b6ac-7ea5ff7ce089-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:54:09 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-cf7c1305-e6bb-48b6-8e8e-c223209079e7 req-02f53b66-f51d-4fc4-a192-2c1b2b3d7928 service nova] Lock "08fae2f1-6fa1-41f9-b6ac-7ea5ff7ce089-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:54:09 user nova-compute[75045]: DEBUG nova.compute.manager [req-cf7c1305-e6bb-48b6-8e8e-c223209079e7 req-02f53b66-f51d-4fc4-a192-2c1b2b3d7928 service nova] [instance: 08fae2f1-6fa1-41f9-b6ac-7ea5ff7ce089] No waiting events found dispatching network-vif-unplugged-ced9d13a-eae0-4a08-b54c-75e4d1b3234e {{(pid=75045) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 23:54:09 user nova-compute[75045]: DEBUG nova.compute.manager [req-cf7c1305-e6bb-48b6-8e8e-c223209079e7 req-02f53b66-f51d-4fc4-a192-2c1b2b3d7928 service nova] [instance: 08fae2f1-6fa1-41f9-b6ac-7ea5ff7ce089] Received event network-vif-unplugged-ced9d13a-eae0-4a08-b54c-75e4d1b3234e for instance with task_state deleting. {{(pid=75045) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 23:54:09 user nova-compute[75045]: DEBUG nova.compute.manager [req-cf7c1305-e6bb-48b6-8e8e-c223209079e7 req-02f53b66-f51d-4fc4-a192-2c1b2b3d7928 service nova] [instance: 08fae2f1-6fa1-41f9-b6ac-7ea5ff7ce089] Received event network-vif-plugged-ced9d13a-eae0-4a08-b54c-75e4d1b3234e {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:54:09 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-cf7c1305-e6bb-48b6-8e8e-c223209079e7 req-02f53b66-f51d-4fc4-a192-2c1b2b3d7928 service nova] Acquiring lock "08fae2f1-6fa1-41f9-b6ac-7ea5ff7ce089-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:54:09 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-cf7c1305-e6bb-48b6-8e8e-c223209079e7 req-02f53b66-f51d-4fc4-a192-2c1b2b3d7928 service nova] Lock "08fae2f1-6fa1-41f9-b6ac-7ea5ff7ce089-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:54:09 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-cf7c1305-e6bb-48b6-8e8e-c223209079e7 req-02f53b66-f51d-4fc4-a192-2c1b2b3d7928 service nova] Lock "08fae2f1-6fa1-41f9-b6ac-7ea5ff7ce089-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:54:09 user nova-compute[75045]: DEBUG nova.compute.manager [req-cf7c1305-e6bb-48b6-8e8e-c223209079e7 req-02f53b66-f51d-4fc4-a192-2c1b2b3d7928 service nova] [instance: 08fae2f1-6fa1-41f9-b6ac-7ea5ff7ce089] No waiting events found dispatching network-vif-plugged-ced9d13a-eae0-4a08-b54c-75e4d1b3234e {{(pid=75045) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 23:54:09 user nova-compute[75045]: WARNING nova.compute.manager [req-cf7c1305-e6bb-48b6-8e8e-c223209079e7 req-02f53b66-f51d-4fc4-a192-2c1b2b3d7928 service nova] [instance: 08fae2f1-6fa1-41f9-b6ac-7ea5ff7ce089] Received unexpected event network-vif-plugged-ced9d13a-eae0-4a08-b54c-75e4d1b3234e for instance with vm_state active and task_state deleting.
Nov 08 23:54:09 user nova-compute[75045]: INFO nova.compute.manager [None req-04768ce5-df99-4f47-9709-938322c42d60 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] [instance: 08fae2f1-6fa1-41f9-b6ac-7ea5ff7ce089] Took 1.39 seconds to destroy the instance on the hypervisor.
Nov 08 23:54:09 user nova-compute[75045]: DEBUG oslo.service.loopingcall [None req-04768ce5-df99-4f47-9709-938322c42d60 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75045) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 23:54:09 user nova-compute[75045]: DEBUG nova.compute.manager [-] [instance: 08fae2f1-6fa1-41f9-b6ac-7ea5ff7ce089] Deallocating network for instance {{(pid=75045) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 23:54:09 user nova-compute[75045]: DEBUG nova.network.neutron [-] [instance: 08fae2f1-6fa1-41f9-b6ac-7ea5ff7ce089] deallocate_for_instance() {{(pid=75045) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 23:54:10 user nova-compute[75045]: DEBUG nova.network.neutron [-] [instance: 08fae2f1-6fa1-41f9-b6ac-7ea5ff7ce089] Updating instance_info_cache with network_info: [] {{(pid=75045) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 23:54:10 user nova-compute[75045]: INFO nova.compute.manager [-] [instance: 08fae2f1-6fa1-41f9-b6ac-7ea5ff7ce089] Took 1.39 seconds to deallocate network for instance.
Nov 08 23:54:10 user nova-compute[75045]: DEBUG nova.compute.manager [req-13221982-7592-4ee7-a33f-0d1db8c7b21f req-688b4304-957e-462f-b028-33390aef1f11 service nova] [instance: 08fae2f1-6fa1-41f9-b6ac-7ea5ff7ce089] Received event network-vif-deleted-ced9d13a-eae0-4a08-b54c-75e4d1b3234e {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:54:11 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:54:12 user nova-compute[75045]: INFO nova.compute.manager [None req-04768ce5-df99-4f47-9709-938322c42d60 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] [instance: 08fae2f1-6fa1-41f9-b6ac-7ea5ff7ce089] Took 1.12 seconds to detach 1 volumes for instance.
Nov 08 23:54:12 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:54:12 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-04768ce5-df99-4f47-9709-938322c42d60 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:54:12 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-04768ce5-df99-4f47-9709-938322c42d60 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:54:12 user nova-compute[75045]: DEBUG nova.compute.provider_tree [None req-04768ce5-df99-4f47-9709-938322c42d60 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Inventory has not changed in ProviderTree for provider: 62ba5f85-c74d-4b58-986e-d4197e813fd7 {{(pid=75045) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 23:54:12 user nova-compute[75045]: DEBUG nova.scheduler.client.report [None req-04768ce5-df99-4f47-9709-938322c42d60 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Inventory has not changed for provider 62ba5f85-c74d-4b58-986e-d4197e813fd7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75045) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 23:54:12 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-04768ce5-df99-4f47-9709-938322c42d60 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.190s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:54:12 user nova-compute[75045]: INFO nova.scheduler.client.report [None req-04768ce5-df99-4f47-9709-938322c42d60 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Deleted allocations for instance 08fae2f1-6fa1-41f9-b6ac-7ea5ff7ce089
Nov 08 23:54:12 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-04768ce5-df99-4f47-9709-938322c42d60 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Lock "08fae2f1-6fa1-41f9-b6ac-7ea5ff7ce089" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.289s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:54:13 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:54:13 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager.update_available_resource {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:54:13 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:54:13 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:54:13 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:54:13 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Auditing locally available compute resources for user (node: user) {{(pid=75045) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 23:54:14 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7b3eac2-a51b-40e7-a199-66aee8d2da09/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:54:14 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7b3eac2-a51b-40e7-a199-66aee8d2da09/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:54:14 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7b3eac2-a51b-40e7-a199-66aee8d2da09/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:54:14 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7b3eac2-a51b-40e7-a199-66aee8d2da09/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:54:14 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a19b6a96-340f-488e-af81-853ee56bf30f/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:54:14 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a19b6a96-340f-488e-af81-853ee56bf30f/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:54:14 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a19b6a96-340f-488e-af81-853ee56bf30f/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:54:14 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a19b6a96-340f-488e-af81-853ee56bf30f/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:54:15 user nova-compute[75045]: WARNING nova.virt.libvirt.driver [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 23:54:15 user nova-compute[75045]: WARNING nova.virt.libvirt.driver [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 23:54:15 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Hypervisor/Node resource view: name=user free_ram=8668MB free_disk=24.917282104492188GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75045) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 23:54:15 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:54:15 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:54:15 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Instance c7b3eac2-a51b-40e7-a199-66aee8d2da09 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75045) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 23:54:15 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Instance a19b6a96-340f-488e-af81-853ee56bf30f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75045) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 23:54:15 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75045) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 23:54:15 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75045) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 23:54:15 user nova-compute[75045]: DEBUG nova.compute.provider_tree [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Inventory has not changed in ProviderTree for provider: 62ba5f85-c74d-4b58-986e-d4197e813fd7 {{(pid=75045) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 23:54:15 user nova-compute[75045]: DEBUG nova.scheduler.client.report [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Inventory has not changed for provider 62ba5f85-c74d-4b58-986e-d4197e813fd7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75045) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 23:54:15 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Compute_service record updated for user:user {{(pid=75045) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 23:54:15 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.224s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:54:18 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:54:23 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-3781d93a-3d16-45b9-8a03-bb5cae17482e tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] Acquiring lock "c7b3eac2-a51b-40e7-a199-66aee8d2da09" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:54:23 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-3781d93a-3d16-45b9-8a03-bb5cae17482e tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] Lock "c7b3eac2-a51b-40e7-a199-66aee8d2da09" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:54:23 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-3781d93a-3d16-45b9-8a03-bb5cae17482e tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] Acquiring lock "c7b3eac2-a51b-40e7-a199-66aee8d2da09-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:54:23 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-3781d93a-3d16-45b9-8a03-bb5cae17482e tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] Lock "c7b3eac2-a51b-40e7-a199-66aee8d2da09-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:54:23 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-3781d93a-3d16-45b9-8a03-bb5cae17482e tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] Lock "c7b3eac2-a51b-40e7-a199-66aee8d2da09-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:54:23 user nova-compute[75045]: INFO nova.compute.manager [None req-3781d93a-3d16-45b9-8a03-bb5cae17482e tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] [instance: c7b3eac2-a51b-40e7-a199-66aee8d2da09] Terminating instance
Nov 08 23:54:23 user nova-compute[75045]: DEBUG nova.compute.manager [None req-3781d93a-3d16-45b9-8a03-bb5cae17482e tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] [instance: c7b3eac2-a51b-40e7-a199-66aee8d2da09] Start destroying the instance on the hypervisor. {{(pid=75045) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 23:54:23 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:54:23 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:54:23 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:54:23 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:54:23 user nova-compute[75045]: DEBUG nova.compute.manager [req-0edaac70-1b34-4334-b8e0-398996a24550 req-faa43b4a-4ba2-4d18-baa0-85cc254132f3 service nova] [instance: c7b3eac2-a51b-40e7-a199-66aee8d2da09] Received event network-vif-unplugged-ee3648b5-a27a-401d-8708-e25f28d987da {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:54:23 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-0edaac70-1b34-4334-b8e0-398996a24550 req-faa43b4a-4ba2-4d18-baa0-85cc254132f3 service nova] Acquiring lock "c7b3eac2-a51b-40e7-a199-66aee8d2da09-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:54:23 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-0edaac70-1b34-4334-b8e0-398996a24550 req-faa43b4a-4ba2-4d18-baa0-85cc254132f3 service nova] Lock "c7b3eac2-a51b-40e7-a199-66aee8d2da09-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:54:23 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-0edaac70-1b34-4334-b8e0-398996a24550 req-faa43b4a-4ba2-4d18-baa0-85cc254132f3 service nova] Lock "c7b3eac2-a51b-40e7-a199-66aee8d2da09-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:54:23 user nova-compute[75045]: DEBUG nova.compute.manager [req-0edaac70-1b34-4334-b8e0-398996a24550 req-faa43b4a-4ba2-4d18-baa0-85cc254132f3 service nova] [instance: c7b3eac2-a51b-40e7-a199-66aee8d2da09] No waiting events found dispatching network-vif-unplugged-ee3648b5-a27a-401d-8708-e25f28d987da {{(pid=75045) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 23:54:23 user nova-compute[75045]: DEBUG nova.compute.manager [req-0edaac70-1b34-4334-b8e0-398996a24550 req-faa43b4a-4ba2-4d18-baa0-85cc254132f3 service nova] [instance: c7b3eac2-a51b-40e7-a199-66aee8d2da09] Received event network-vif-unplugged-ee3648b5-a27a-401d-8708-e25f28d987da for instance with task_state deleting. {{(pid=75045) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 23:54:23 user nova-compute[75045]: INFO nova.virt.libvirt.driver [-] [instance: c7b3eac2-a51b-40e7-a199-66aee8d2da09] Instance destroyed successfully.
Nov 08 23:54:23 user nova-compute[75045]: DEBUG nova.objects.instance [None req-3781d93a-3d16-45b9-8a03-bb5cae17482e tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] Lazy-loading 'resources' on Instance uuid c7b3eac2-a51b-40e7-a199-66aee8d2da09 {{(pid=75045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 23:54:23 user nova-compute[75045]: DEBUG nova.virt.libvirt.vif [None req-3781d93a-3d16-45b9-8a03-bb5cae17482e tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T23:48:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1921157809',display_name='tempest-TestMinimumBasicScenario-server-1921157809',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1921157809',id=46,image_ref='f5ffbc98-11a7-4f8a-a6c2-51981767a401',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHecd69gYgaSALnbnoSk8qN0iobdxEqArnmuB2X8R1yl+8miN9+r40m6x9O1njTg8e0tQbpEe+KRfZaDGySkJLV+Zispu3OSLEK+XK2OAmFWBfz0y5wJsz4CCuk3AqcQeQ==',key_name='tempest-TestMinimumBasicScenario-2120728013',keypairs=<?>,launch_index=0,launched_at=2023-11-08T23:48:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c4bfce59008d44fdb5ba91c70f1cf044',ramdisk_id='',reservation_id='r-3g7sio6l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f5ffbc98-11a7-4f8a-a6c2-51981767a401',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1125576376',owner_user_name='tempest-TestMinimumBasicScenario-1125576376-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T23:51:27Z,user_data=None,user_id='4ed9cd91d0654f4aa4d620c9f0eb2766',uuid=c7b3eac2-a51b-40e7-a199-66aee8d2da09,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ee3648b5-a27a-401d-8708-e25f28d987da", "address": "fa:16:3e:37:0b:9c", "network": {"id": "fe5f7093-1cdd-465c-97f0-7d7b2dd1fa8a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1755065955-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4bfce59008d44fdb5ba91c70f1cf044", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee3648b5-a2", "ovs_interfaceid": "ee3648b5-a27a-401d-8708-e25f28d987da", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75045) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 23:54:23 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-3781d93a-3d16-45b9-8a03-bb5cae17482e tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] Converting VIF {"id": "ee3648b5-a27a-401d-8708-e25f28d987da", "address": "fa:16:3e:37:0b:9c", "network": {"id": "fe5f7093-1cdd-465c-97f0-7d7b2dd1fa8a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1755065955-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4bfce59008d44fdb5ba91c70f1cf044", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee3648b5-a2", "ovs_interfaceid": "ee3648b5-a27a-401d-8708-e25f28d987da", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 23:54:23 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-3781d93a-3d16-45b9-8a03-bb5cae17482e tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:37:0b:9c,bridge_name='br-int',has_traffic_filtering=True,id=ee3648b5-a27a-401d-8708-e25f28d987da,network=Network(fe5f7093-1cdd-465c-97f0-7d7b2dd1fa8a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee3648b5-a2') {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 23:54:23 user nova-compute[75045]: DEBUG os_vif [None req-3781d93a-3d16-45b9-8a03-bb5cae17482e tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:37:0b:9c,bridge_name='br-int',has_traffic_filtering=True,id=ee3648b5-a27a-401d-8708-e25f28d987da,network=Network(fe5f7093-1cdd-465c-97f0-7d7b2dd1fa8a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee3648b5-a2') {{(pid=75045) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 23:54:23 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:54:23 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapee3648b5-a2, bridge=br-int, if_exists=True) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:54:23 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:54:23 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 23:54:23 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:54:23 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=316d39b4-7579-4149-9315-373c18b2cc44) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:54:23 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:54:23 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 23:54:23 user nova-compute[75045]: INFO os_vif [None req-3781d93a-3d16-45b9-8a03-bb5cae17482e tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:37:0b:9c,bridge_name='br-int',has_traffic_filtering=True,id=ee3648b5-a27a-401d-8708-e25f28d987da,network=Network(fe5f7093-1cdd-465c-97f0-7d7b2dd1fa8a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee3648b5-a2')
Nov 08 23:54:23 user nova-compute[75045]: INFO nova.virt.libvirt.driver [None req-3781d93a-3d16-45b9-8a03-bb5cae17482e tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] [instance: c7b3eac2-a51b-40e7-a199-66aee8d2da09] Deleting instance files /opt/stack/data/nova/instances/c7b3eac2-a51b-40e7-a199-66aee8d2da09_del
Nov 08 23:54:23 user nova-compute[75045]: INFO nova.virt.libvirt.driver [None req-3781d93a-3d16-45b9-8a03-bb5cae17482e tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] [instance: c7b3eac2-a51b-40e7-a199-66aee8d2da09] Deletion of /opt/stack/data/nova/instances/c7b3eac2-a51b-40e7-a199-66aee8d2da09_del complete
Nov 08 23:54:23 user nova-compute[75045]: INFO nova.compute.manager [None req-3781d93a-3d16-45b9-8a03-bb5cae17482e tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] [instance: c7b3eac2-a51b-40e7-a199-66aee8d2da09] Took 0.87 seconds to destroy the instance on the hypervisor.
Nov 08 23:54:23 user nova-compute[75045]: DEBUG oslo.service.loopingcall [None req-3781d93a-3d16-45b9-8a03-bb5cae17482e tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75045) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 23:54:23 user nova-compute[75045]: DEBUG nova.compute.manager [-] [instance: c7b3eac2-a51b-40e7-a199-66aee8d2da09] Deallocating network for instance {{(pid=75045) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 23:54:23 user nova-compute[75045]: DEBUG nova.network.neutron [-] [instance: c7b3eac2-a51b-40e7-a199-66aee8d2da09] deallocate_for_instance() {{(pid=75045) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 23:54:24 user nova-compute[75045]: DEBUG nova.network.neutron [-] [instance: c7b3eac2-a51b-40e7-a199-66aee8d2da09] Updating instance_info_cache with network_info: [] {{(pid=75045) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 23:54:24 user nova-compute[75045]: INFO nova.compute.manager [-] [instance: c7b3eac2-a51b-40e7-a199-66aee8d2da09] Took 0.51 seconds to deallocate network for instance.
Nov 08 23:54:24 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-3781d93a-3d16-45b9-8a03-bb5cae17482e tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:54:24 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-3781d93a-3d16-45b9-8a03-bb5cae17482e tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:54:24 user nova-compute[75045]: DEBUG nova.compute.provider_tree [None req-3781d93a-3d16-45b9-8a03-bb5cae17482e tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] Inventory has not changed in ProviderTree for provider: 62ba5f85-c74d-4b58-986e-d4197e813fd7 {{(pid=75045) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 23:54:24 user nova-compute[75045]: DEBUG nova.scheduler.client.report [None req-3781d93a-3d16-45b9-8a03-bb5cae17482e tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] Inventory has not changed for provider 62ba5f85-c74d-4b58-986e-d4197e813fd7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75045) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 23:54:24 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-3781d93a-3d16-45b9-8a03-bb5cae17482e tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.139s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:54:24 user nova-compute[75045]: INFO nova.scheduler.client.report [None req-3781d93a-3d16-45b9-8a03-bb5cae17482e tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] Deleted allocations for instance c7b3eac2-a51b-40e7-a199-66aee8d2da09
Nov 08 23:54:24 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-3781d93a-3d16-45b9-8a03-bb5cae17482e tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] Lock "c7b3eac2-a51b-40e7-a199-66aee8d2da09" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.717s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:54:25 user nova-compute[75045]: DEBUG nova.compute.manager [req-f9b8e236-6615-4c5f-ae47-6dd0cd803bd3 req-bbb404b0-874a-47f8-8725-c130caa654a8 service nova] [instance: c7b3eac2-a51b-40e7-a199-66aee8d2da09] Received event network-vif-plugged-ee3648b5-a27a-401d-8708-e25f28d987da {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:54:25 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-f9b8e236-6615-4c5f-ae47-6dd0cd803bd3 req-bbb404b0-874a-47f8-8725-c130caa654a8 service nova] Acquiring lock "c7b3eac2-a51b-40e7-a199-66aee8d2da09-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:54:25 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-f9b8e236-6615-4c5f-ae47-6dd0cd803bd3 req-bbb404b0-874a-47f8-8725-c130caa654a8 service nova] Lock "c7b3eac2-a51b-40e7-a199-66aee8d2da09-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:54:25 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-f9b8e236-6615-4c5f-ae47-6dd0cd803bd3 req-bbb404b0-874a-47f8-8725-c130caa654a8 service nova] Lock "c7b3eac2-a51b-40e7-a199-66aee8d2da09-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:54:25 user nova-compute[75045]: DEBUG nova.compute.manager [req-f9b8e236-6615-4c5f-ae47-6dd0cd803bd3 req-bbb404b0-874a-47f8-8725-c130caa654a8 service nova] [instance: c7b3eac2-a51b-40e7-a199-66aee8d2da09] No waiting events found dispatching network-vif-plugged-ee3648b5-a27a-401d-8708-e25f28d987da {{(pid=75045) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 23:54:25 user nova-compute[75045]: WARNING nova.compute.manager [req-f9b8e236-6615-4c5f-ae47-6dd0cd803bd3 req-bbb404b0-874a-47f8-8725-c130caa654a8 service nova] [instance: c7b3eac2-a51b-40e7-a199-66aee8d2da09] Received unexpected event network-vif-plugged-ee3648b5-a27a-401d-8708-e25f28d987da for instance with vm_state deleted and task_state None.
Nov 08 23:54:25 user nova-compute[75045]: DEBUG nova.compute.manager [req-f9b8e236-6615-4c5f-ae47-6dd0cd803bd3 req-bbb404b0-874a-47f8-8725-c130caa654a8 service nova] [instance: c7b3eac2-a51b-40e7-a199-66aee8d2da09] Received event network-vif-deleted-ee3648b5-a27a-401d-8708-e25f28d987da {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:54:28 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:54:33 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:54:38 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 23:54:42 user nova-compute[75045]: DEBUG nova.compute.manager [req-e7d95741-1052-460a-bf80-694c1b9e5e19 req-43303ba8-ae7b-4ad6-82d7-fb695c12366d service nova] [instance: a19b6a96-340f-488e-af81-853ee56bf30f] Received event network-changed-f3fb96dd-b444-47d0-98ff-0c7c910dbede {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:54:42 user nova-compute[75045]: DEBUG nova.compute.manager [req-e7d95741-1052-460a-bf80-694c1b9e5e19 req-43303ba8-ae7b-4ad6-82d7-fb695c12366d service nova] [instance: a19b6a96-340f-488e-af81-853ee56bf30f] Refreshing instance network info cache due to event network-changed-f3fb96dd-b444-47d0-98ff-0c7c910dbede. {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 23:54:42 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-e7d95741-1052-460a-bf80-694c1b9e5e19 req-43303ba8-ae7b-4ad6-82d7-fb695c12366d service nova] Acquiring lock "refresh_cache-a19b6a96-340f-488e-af81-853ee56bf30f" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 23:54:42 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-e7d95741-1052-460a-bf80-694c1b9e5e19 req-43303ba8-ae7b-4ad6-82d7-fb695c12366d service nova] Acquired lock "refresh_cache-a19b6a96-340f-488e-af81-853ee56bf30f" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 23:54:42 user nova-compute[75045]: DEBUG nova.network.neutron [req-e7d95741-1052-460a-bf80-694c1b9e5e19 req-43303ba8-ae7b-4ad6-82d7-fb695c12366d service nova] [instance: a19b6a96-340f-488e-af81-853ee56bf30f] Refreshing network info cache for port f3fb96dd-b444-47d0-98ff-0c7c910dbede {{(pid=75045) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 23:54:43 user nova-compute[75045]: DEBUG nova.network.neutron [req-e7d95741-1052-460a-bf80-694c1b9e5e19 req-43303ba8-ae7b-4ad6-82d7-fb695c12366d service nova] [instance: a19b6a96-340f-488e-af81-853ee56bf30f] Updated VIF entry in instance network info cache for port f3fb96dd-b444-47d0-98ff-0c7c910dbede. {{(pid=75045) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 23:54:43 user nova-compute[75045]: DEBUG nova.network.neutron [req-e7d95741-1052-460a-bf80-694c1b9e5e19 req-43303ba8-ae7b-4ad6-82d7-fb695c12366d service nova] [instance: a19b6a96-340f-488e-af81-853ee56bf30f] Updating instance_info_cache with network_info: [{"id": "f3fb96dd-b444-47d0-98ff-0c7c910dbede", "address": "fa:16:3e:0c:c0:6c", "network": {"id": "e31c3d41-e46f-4c74-8ef5-8243a391dde8", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-856540424-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.59", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c8be85d72bc440899f3ccb64b923e90e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3fb96dd-b4", "ovs_interfaceid": "f3fb96dd-b444-47d0-98ff-0c7c910dbede", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75045) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 23:54:43 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-e7d95741-1052-460a-bf80-694c1b9e5e19 req-43303ba8-ae7b-4ad6-82d7-fb695c12366d service nova] Releasing lock "refresh_cache-a19b6a96-340f-488e-af81-853ee56bf30f" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 23:54:43 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 23:54:47 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:54:48 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:54:49 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-9e308647-8ad5-4ee0-8596-afaa38b071ae tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Acquiring lock "a19b6a96-340f-488e-af81-853ee56bf30f" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:54:49 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-9e308647-8ad5-4ee0-8596-afaa38b071ae tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Lock "a19b6a96-340f-488e-af81-853ee56bf30f" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:54:49 user nova-compute[75045]: DEBUG nova.objects.instance [None req-9e308647-8ad5-4ee0-8596-afaa38b071ae tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Lazy-loading 'flavor' on Instance uuid a19b6a96-340f-488e-af81-853ee56bf30f {{(pid=75045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 23:54:49 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-9e308647-8ad5-4ee0-8596-afaa38b071ae tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Lock "a19b6a96-340f-488e-af81-853ee56bf30f" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.068s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:54:49 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-9e308647-8ad5-4ee0-8596-afaa38b071ae tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Acquiring lock "a19b6a96-340f-488e-af81-853ee56bf30f" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:54:49 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-9e308647-8ad5-4ee0-8596-afaa38b071ae tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Lock "a19b6a96-340f-488e-af81-853ee56bf30f" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:54:49 user nova-compute[75045]: INFO nova.compute.manager [None req-9e308647-8ad5-4ee0-8596-afaa38b071ae tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] [instance: a19b6a96-340f-488e-af81-853ee56bf30f] Attaching volume c632bc58-d20b-46e4-9d9d-316f17f3ea43 to /dev/vdb
Nov 08 23:54:49 user nova-compute[75045]: DEBUG os_brick.utils [None req-9e308647-8ad5-4ee0-8596-afaa38b071ae tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75045) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 23:54:49 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:54:49 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:54:49 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[913d0dfd-4e27-4f34-ba07-be6e97a2b084]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6217bd6e884\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:54:49 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:54:49 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:54:49 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[83e68a21-c5b1-429f-8419-e25c52604042]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:54:49 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:54:49 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:54:49 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bdd80e3-1a7a-4bd3-9289-6bfd0c5ee8cc]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:54:49 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ef599f6-491b-4cb9-8a6f-d0f604dea2fd]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:54:49 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-9e308647-8ad5-4ee0-8596-afaa38b071ae tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Running cmd (subprocess): nvme version {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:54:49 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-9e308647-8ad5-4ee0-8596-afaa38b071ae tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] 'nvme version' failed. Not Retrying. {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 23:54:49 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9e308647-8ad5-4ee0-8596-afaa38b071ae tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] nvme not present on system {{(pid=75045) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 23:54:49 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:54:49 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 23:54:49 user nova-compute[75045]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 23:54:49 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[940ea68c-b558-4058-aeb4-241af0af8dfd]: (4, '') {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:54:49 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.lightos [None req-9e308647-8ad5-4ee0-8596-afaa38b071ae tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75045) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 23:54:49 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.lightos [None req-9e308647-8ad5-4ee0-8596-afaa38b071ae tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75045) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 23:54:49 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.lightos [None req-9e308647-8ad5-4ee0-8596-afaa38b071ae tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] LIGHTOS: no hostnqn found. {{(pid=75045) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 23:54:49 user nova-compute[75045]: DEBUG os_brick.utils [None req-9e308647-8ad5-4ee0-8596-afaa38b071ae tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6217bd6e884', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75045) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 23:54:49 user nova-compute[75045]: DEBUG nova.virt.block_device [None req-9e308647-8ad5-4ee0-8596-afaa38b071ae tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] [instance: a19b6a96-340f-488e-af81-853ee56bf30f] Updating existing volume attachment record: 4ab88a0e-64d4-4637-946c-37e2916539ce {{(pid=75045) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 23:54:52 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:54:53 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:54:58 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 23:55:00 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-af167af0-1115-4146-a74e-887c5bfb5362 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Acquiring lock "df16d913-9985-415f-aedc-14f2ca5bcf13" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:55:00 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-af167af0-1115-4146-a74e-887c5bfb5362 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Lock "df16d913-9985-415f-aedc-14f2ca5bcf13" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:55:00 user nova-compute[75045]: DEBUG nova.compute.manager [None req-af167af0-1115-4146-a74e-887c5bfb5362 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] [instance: df16d913-9985-415f-aedc-14f2ca5bcf13] Starting instance... {{(pid=75045) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 23:55:00 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-af167af0-1115-4146-a74e-887c5bfb5362 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:55:00 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-af167af0-1115-4146-a74e-887c5bfb5362 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:55:00 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-af167af0-1115-4146-a74e-887c5bfb5362 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75045) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 23:55:00 user nova-compute[75045]: INFO nova.compute.claims [None req-af167af0-1115-4146-a74e-887c5bfb5362 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] [instance: df16d913-9985-415f-aedc-14f2ca5bcf13] Claim successful on node user
Nov 08 23:55:00 user nova-compute[75045]: DEBUG nova.compute.provider_tree [None req-af167af0-1115-4146-a74e-887c5bfb5362 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Inventory has not changed in ProviderTree for provider: 62ba5f85-c74d-4b58-986e-d4197e813fd7 {{(pid=75045) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 23:55:00 user nova-compute[75045]: DEBUG nova.scheduler.client.report [None req-af167af0-1115-4146-a74e-887c5bfb5362 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Inventory has not changed for provider 62ba5f85-c74d-4b58-986e-d4197e813fd7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75045) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 23:55:00 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-af167af0-1115-4146-a74e-887c5bfb5362 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.239s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:55:00 user nova-compute[75045]: DEBUG nova.compute.manager [None req-af167af0-1115-4146-a74e-887c5bfb5362 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] [instance: df16d913-9985-415f-aedc-14f2ca5bcf13] Start building networks asynchronously for instance. {{(pid=75045) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 23:55:00 user nova-compute[75045]: DEBUG nova.compute.manager [None req-af167af0-1115-4146-a74e-887c5bfb5362 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] [instance: df16d913-9985-415f-aedc-14f2ca5bcf13] Allocating IP information in the background. {{(pid=75045) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 23:55:00 user nova-compute[75045]: DEBUG nova.network.neutron [None req-af167af0-1115-4146-a74e-887c5bfb5362 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] [instance: df16d913-9985-415f-aedc-14f2ca5bcf13] allocate_for_instance() {{(pid=75045) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 23:55:00 user nova-compute[75045]: INFO nova.virt.libvirt.driver [None req-af167af0-1115-4146-a74e-887c5bfb5362 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] [instance: df16d913-9985-415f-aedc-14f2ca5bcf13] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 23:55:00 user nova-compute[75045]: DEBUG nova.compute.manager [None req-af167af0-1115-4146-a74e-887c5bfb5362 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] [instance: df16d913-9985-415f-aedc-14f2ca5bcf13] Start building block device mappings for instance. {{(pid=75045) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 23:55:00 user nova-compute[75045]: DEBUG nova.policy [None req-af167af0-1115-4146-a74e-887c5bfb5362 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '76c31c64d9594f9cbef7586fafb48721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd59b73851c79473a9c2cdc0a120dfee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75045) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 23:55:00 user nova-compute[75045]: INFO nova.virt.block_device [None req-af167af0-1115-4146-a74e-887c5bfb5362 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] [instance: df16d913-9985-415f-aedc-14f2ca5bcf13] Booting with volume dcbd911e-f385-4ed6-b8a4-383b3b56cf7d at /dev/vda
Nov 08 23:55:00 user nova-compute[75045]: DEBUG os_brick.utils [None req-af167af0-1115-4146-a74e-887c5bfb5362 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75045) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 23:55:00 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:55:00 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:55:00 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ad8214a-0383-4912-8852-d6653d2369b4]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6217bd6e884\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:55:00 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:55:00 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:55:00 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8177cd5-7301-4ac6-b386-67d8fa195552]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:55:00 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:55:01 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:55:01 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c832f61-e5f9-4a6f-b8ba-f10a58e7a064]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:55:01 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebefee4f-71f2-4e26-bd0f-640b9f6d37e0]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:55:01 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-af167af0-1115-4146-a74e-887c5bfb5362 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Running cmd (subprocess): nvme version {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:55:01 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-af167af0-1115-4146-a74e-887c5bfb5362 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] 'nvme version' failed. Not Retrying. {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 23:55:01 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.nvmeof [None req-af167af0-1115-4146-a74e-887c5bfb5362 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] nvme not present on system {{(pid=75045) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 23:55:01 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:55:01 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 23:55:01 user nova-compute[75045]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 23:55:01 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[520c330c-9f5f-430f-b6fe-5f945f0bcff0]: (4, '') {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:55:01 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.lightos [None req-af167af0-1115-4146-a74e-887c5bfb5362 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75045) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 23:55:01 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.lightos [None req-af167af0-1115-4146-a74e-887c5bfb5362 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75045) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 23:55:01 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.lightos [None req-af167af0-1115-4146-a74e-887c5bfb5362 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] LIGHTOS: no hostnqn found. {{(pid=75045) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 23:55:01 user nova-compute[75045]: DEBUG os_brick.utils [None req-af167af0-1115-4146-a74e-887c5bfb5362 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6217bd6e884', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75045) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 23:55:01 user nova-compute[75045]: DEBUG nova.virt.block_device [None req-af167af0-1115-4146-a74e-887c5bfb5362 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] [instance: df16d913-9985-415f-aedc-14f2ca5bcf13] Updating existing volume attachment record: 4d370013-bb7e-4d03-84b7-1a664d7d029a {{(pid=75045) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 23:55:01 user nova-compute[75045]: DEBUG nova.network.neutron [None req-af167af0-1115-4146-a74e-887c5bfb5362 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] [instance: df16d913-9985-415f-aedc-14f2ca5bcf13] Successfully created port: c762a745-51d7-4d4e-bdc5-c962aec66b02 {{(pid=75045) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 23:55:02 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:55:02 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:55:02 user nova-compute[75045]: DEBUG nova.network.neutron [None req-af167af0-1115-4146-a74e-887c5bfb5362 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] [instance: df16d913-9985-415f-aedc-14f2ca5bcf13] Successfully updated port: c762a745-51d7-4d4e-bdc5-c962aec66b02 {{(pid=75045) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 23:55:02 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-af167af0-1115-4146-a74e-887c5bfb5362 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Acquiring lock "refresh_cache-df16d913-9985-415f-aedc-14f2ca5bcf13" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 23:55:02 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-af167af0-1115-4146-a74e-887c5bfb5362 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Acquired lock "refresh_cache-df16d913-9985-415f-aedc-14f2ca5bcf13" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 23:55:02 user nova-compute[75045]: DEBUG nova.network.neutron [None req-af167af0-1115-4146-a74e-887c5bfb5362 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] [instance: df16d913-9985-415f-aedc-14f2ca5bcf13] Building network info cache for instance {{(pid=75045) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 23:55:02 user nova-compute[75045]: DEBUG nova.compute.manager [req-6fe8b20d-492b-402e-9825-31d833b08077 req-cab1d006-4f7a-4521-99ab-1d73e6ea8eab service nova] [instance: df16d913-9985-415f-aedc-14f2ca5bcf13] Received event network-changed-c762a745-51d7-4d4e-bdc5-c962aec66b02 {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:55:02 user nova-compute[75045]: DEBUG nova.compute.manager [req-6fe8b20d-492b-402e-9825-31d833b08077 req-cab1d006-4f7a-4521-99ab-1d73e6ea8eab service nova] [instance: df16d913-9985-415f-aedc-14f2ca5bcf13] Refreshing instance network info cache due to event network-changed-c762a745-51d7-4d4e-bdc5-c962aec66b02. {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 23:55:02 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-6fe8b20d-492b-402e-9825-31d833b08077 req-cab1d006-4f7a-4521-99ab-1d73e6ea8eab service nova] Acquiring lock "refresh_cache-df16d913-9985-415f-aedc-14f2ca5bcf13" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 23:55:02 user nova-compute[75045]: DEBUG nova.network.neutron [None req-af167af0-1115-4146-a74e-887c5bfb5362 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] [instance: df16d913-9985-415f-aedc-14f2ca5bcf13] Instance cache missing network info. {{(pid=75045) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 23:55:02 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:55:02 user nova-compute[75045]: DEBUG nova.compute.manager [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Starting heal instance info cache {{(pid=75045) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 23:55:03 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Acquiring lock "refresh_cache-a19b6a96-340f-488e-af81-853ee56bf30f" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 23:55:03 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Acquired lock "refresh_cache-a19b6a96-340f-488e-af81-853ee56bf30f" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 23:55:03 user nova-compute[75045]: DEBUG nova.network.neutron [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] [instance: a19b6a96-340f-488e-af81-853ee56bf30f] Forcefully refreshing network info cache for instance {{(pid=75045) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 23:55:03 user nova-compute[75045]: DEBUG nova.network.neutron [None req-af167af0-1115-4146-a74e-887c5bfb5362 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] [instance: df16d913-9985-415f-aedc-14f2ca5bcf13] Updating instance_info_cache with network_info: [{"id": "c762a745-51d7-4d4e-bdc5-c962aec66b02", "address": "fa:16:3e:80:3b:b9", "network": {"id": "4205f899-9865-4c65-8b46-c9a533e9bb45", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-774780781-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d59b73851c79473a9c2cdc0a120dfee0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc762a745-51", "ovs_interfaceid": "c762a745-51d7-4d4e-bdc5-c962aec66b02", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75045) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 23:55:03 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-af167af0-1115-4146-a74e-887c5bfb5362 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Releasing lock "refresh_cache-df16d913-9985-415f-aedc-14f2ca5bcf13" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 23:55:03 user nova-compute[75045]: DEBUG nova.compute.manager [None req-af167af0-1115-4146-a74e-887c5bfb5362 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] [instance: df16d913-9985-415f-aedc-14f2ca5bcf13] Instance network_info: |[{"id": "c762a745-51d7-4d4e-bdc5-c962aec66b02", "address": "fa:16:3e:80:3b:b9", "network": {"id": "4205f899-9865-4c65-8b46-c9a533e9bb45", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-774780781-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d59b73851c79473a9c2cdc0a120dfee0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc762a745-51", "ovs_interfaceid": "c762a745-51d7-4d4e-bdc5-c962aec66b02", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75045) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 23:55:03 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-6fe8b20d-492b-402e-9825-31d833b08077 req-cab1d006-4f7a-4521-99ab-1d73e6ea8eab service nova] Acquired lock "refresh_cache-df16d913-9985-415f-aedc-14f2ca5bcf13" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 23:55:03 user nova-compute[75045]: DEBUG nova.network.neutron [req-6fe8b20d-492b-402e-9825-31d833b08077 req-cab1d006-4f7a-4521-99ab-1d73e6ea8eab service nova] [instance: df16d913-9985-415f-aedc-14f2ca5bcf13] Refreshing network info cache for port c762a745-51d7-4d4e-bdc5-c962aec66b02 {{(pid=75045) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 23:55:03 user nova-compute[75045]: DEBUG nova.network.neutron [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] [instance: a19b6a96-340f-488e-af81-853ee56bf30f] Updating instance_info_cache with network_info: [{"id": "f3fb96dd-b444-47d0-98ff-0c7c910dbede", "address": "fa:16:3e:0c:c0:6c", "network": {"id": "e31c3d41-e46f-4c74-8ef5-8243a391dde8", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-856540424-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.59", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c8be85d72bc440899f3ccb64b923e90e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3fb96dd-b4", "ovs_interfaceid": "f3fb96dd-b444-47d0-98ff-0c7c910dbede", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75045) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 23:55:03 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Releasing lock "refresh_cache-a19b6a96-340f-488e-af81-853ee56bf30f" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 23:55:03 user nova-compute[75045]: DEBUG nova.compute.manager [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] [instance: a19b6a96-340f-488e-af81-853ee56bf30f] Updated the network info_cache for instance {{(pid=75045) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 23:55:03 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:55:03 user nova-compute[75045]: DEBUG nova.compute.manager [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75045) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 23:55:03 user nova-compute[75045]: DEBUG nova.network.neutron [req-6fe8b20d-492b-402e-9825-31d833b08077 req-cab1d006-4f7a-4521-99ab-1d73e6ea8eab service nova] [instance: df16d913-9985-415f-aedc-14f2ca5bcf13] Updated VIF entry in instance network info cache for port c762a745-51d7-4d4e-bdc5-c962aec66b02. {{(pid=75045) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 23:55:03 user nova-compute[75045]: DEBUG nova.network.neutron [req-6fe8b20d-492b-402e-9825-31d833b08077 req-cab1d006-4f7a-4521-99ab-1d73e6ea8eab service nova] [instance: df16d913-9985-415f-aedc-14f2ca5bcf13] Updating instance_info_cache with network_info: [{"id": "c762a745-51d7-4d4e-bdc5-c962aec66b02", "address": "fa:16:3e:80:3b:b9", "network": {"id": "4205f899-9865-4c65-8b46-c9a533e9bb45", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-774780781-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d59b73851c79473a9c2cdc0a120dfee0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc762a745-51", "ovs_interfaceid": "c762a745-51d7-4d4e-bdc5-c962aec66b02", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75045) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 23:55:03 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-6fe8b20d-492b-402e-9825-31d833b08077 req-cab1d006-4f7a-4521-99ab-1d73e6ea8eab service nova] Releasing lock "refresh_cache-df16d913-9985-415f-aedc-14f2ca5bcf13" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 23:55:03 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:55:03 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:55:06 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:55:06 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:55:07 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:55:08 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 23:55:08 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:55:08 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75045) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 23:55:08 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75045) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 23:55:08 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75045) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 23:55:08 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:55:08 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:55:13 user nova-compute[75045]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9e308647-8ad5-4ee0-8596-afaa38b071ae tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] [instance: a19b6a96-340f-488e-af81-853ee56bf30f] Calling os-brick to attach iSCSI Volume {{(pid=75045) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 23:55:13 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e308647-8ad5-4ee0-8596-afaa38b071ae tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1b68210460>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c632bc58-d20b-46e4-9d9d-316f17f3ea43', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NsTdycnt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75045) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 23:55:13 user nova-compute[75045]: WARNING os_brick.initiator.connectors.base [None req-9e308647-8ad5-4ee0-8596-afaa38b071ae tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 23:55:13 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-9e308647-8ad5-4ee0-8596-afaa38b071ae tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 23:55:13 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-9e308647-8ad5-4ee0-8596-afaa38b071ae tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 23:55:13 user nova-compute[75045]: WARNING os_brick.initiator.connectors.base [None req-9e308647-8ad5-4ee0-8596-afaa38b071ae tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 23:55:13 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-9e308647-8ad5-4ee0-8596-afaa38b071ae tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c632bc58-d20b-46e4-9d9d-316f17f3ea43" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 23:55:13 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-9e308647-8ad5-4ee0-8596-afaa38b071ae tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c632bc58-d20b-46e4-9d9d-316f17f3ea43" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 23:55:13 user nova-compute[75045]: INFO os_brick.initiator.connectors.iscsi [None req-9e308647-8ad5-4ee0-8596-afaa38b071ae tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 23:55:13 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c632bc58-d20b-46e4-9d9d-316f17f3ea43 -p 172.16.0.220:3260 {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:55:13 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c632bc58-d20b-46e4-9d9d-316f17f3ea43 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:55:13 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[99af8c62-202b-475d-ba0a-a7996838159b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:55:13 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e308647-8ad5-4ee0-8596-afaa38b071ae tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 23:55:13 user nova-compute[75045]:  {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:55:13 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c632bc58-d20b-46e4-9d9d-316f17f3ea43 -p 172.16.0.220:3260 --interface default --op new {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:55:13 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c632bc58-d20b-46e4-9d9d-316f17f3ea43 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:55:13 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[50b27f77-39af-4ca2-aed2-372f98b3e8bd]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c632bc58-d20b-46e4-9d9d-316f17f3ea43] added\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:55:13 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e308647-8ad5-4ee0-8596-afaa38b071ae tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c632bc58-d20b-46e4-9d9d-316f17f3ea43] added
Nov 08 23:55:13 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:55:13 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c632bc58-d20b-46e4-9d9d-316f17f3ea43 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:55:13 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c632bc58-d20b-46e4-9d9d-316f17f3ea43 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:55:13 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[e366d985-ab57-450e-9035-fa61223e4a16]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:55:13 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e308647-8ad5-4ee0-8596-afaa38b071ae tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:55:13 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c632bc58-d20b-46e4-9d9d-316f17f3ea43 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:55:13 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c632bc58-d20b-46e4-9d9d-316f17f3ea43 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:55:13 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[5067ab4e-c616-4946-b8db-192e8d7abbac]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:55:13 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e308647-8ad5-4ee0-8596-afaa38b071ae tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:55:13 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c632bc58-d20b-46e4-9d9d-316f17f3ea43 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NsTdycnt {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:55:13 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c632bc58-d20b-46e4-9d9d-316f17f3ea43 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NsTdycnt" returned: 0 in 0.017s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:55:13 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[520fded3-2820-4fc2-b06f-dcda72e613f8]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:55:13 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e308647-8ad5-4ee0-8596-afaa38b071ae tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'NsTdycnt'): stdout= stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:55:13 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c632bc58-d20b-46e4-9d9d-316f17f3ea43 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:55:13 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c632bc58-d20b-46e4-9d9d-316f17f3ea43 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:55:13 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[b08087f8-dc69-4681-8504-1e4ce0bad9f6]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:55:13 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e308647-8ad5-4ee0-8596-afaa38b071ae tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:55:13 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:55:13 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:55:13 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[1978c881-a2b7-43df-bb35-140cec70c5d6]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:55:13 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e308647-8ad5-4ee0-8596-afaa38b071ae tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 08 23:55:13 user nova-compute[75045]:  {{(pid=75045) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 23:55:13 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e308647-8ad5-4ee0-8596-afaa38b071ae tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 08 23:55:13 user nova-compute[75045]:  {{(pid=75045) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 23:55:13 user nova-compute[75045]: WARNING os_brick.initiator.connectors.iscsi [None req-9e308647-8ad5-4ee0-8596-afaa38b071ae tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 08 23:55:13 user nova-compute[75045]: 
Nov 08 23:55:13 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c632bc58-d20b-46e4-9d9d-316f17f3ea43 -p 172.16.0.220:3260 --login {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:55:13 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c632bc58-d20b-46e4-9d9d-316f17f3ea43 -p 172.16.0.220:3260 --login" returned: 0 in 0.044s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:55:13 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[71063aa4-70cb-4fe8-a253-9c8410b44684]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c632bc58-d20b-46e4-9d9d-316f17f3ea43, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c632bc58-d20b-46e4-9d9d-316f17f3ea43, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:55:13 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e308647-8ad5-4ee0-8596-afaa38b071ae tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c632bc58-d20b-46e4-9d9d-316f17f3ea43, portal: 172.16.0.220,3260]
Nov 08 23:55:13 user nova-compute[75045]: Login to [iface: default, target: iqn.2010-10.org.openstack:c632bc58-d20b-46e4-9d9d-316f17f3ea43, portal: 172.16.0.220,3260] successful.
Nov 08 23:55:13 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:55:13 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c632bc58-d20b-46e4-9d9d-316f17f3ea43 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:55:13 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c632bc58-d20b-46e4-9d9d-316f17f3ea43 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:55:13 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fc734c2-8939-4fd5-b8d5-217873e51007]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:55:13 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e308647-8ad5-4ee0-8596-afaa38b071ae tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:55:13 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:55:13 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:55:13 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[d953210a-156d-4814-8365-c48dd155d5f7]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c632bc58-d20b-46e4-9d9d-316f17f3ea43 (non-flash)\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:55:13 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e308647-8ad5-4ee0-8596-afaa38b071ae tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c632bc58-d20b-46e4-9d9d-316f17f3ea43 (non-flash)
Nov 08 23:55:13 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 23:55:13 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e308647-8ad5-4ee0-8596-afaa38b071ae tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c632bc58-d20b-46e4-9d9d-316f17f3ea43 (non-flash)
Nov 08 23:55:13 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 23:55:13 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-9e308647-8ad5-4ee0-8596-afaa38b071ae tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c632bc58-d20b-46e4-9d9d-316f17f3ea43" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.280s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 23:55:13 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e308647-8ad5-4ee0-8596-afaa38b071ae tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Connected to 172.16.0.220:3260 {{(pid=75045) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 23:55:13 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-9e308647-8ad5-4ee0-8596-afaa38b071ae tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] HCTL ('33', '-', '-', 0) found on session 50 with lun 0 {{(pid=75045) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 23:55:13 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-9e308647-8ad5-4ee0-8596-afaa38b071ae tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75045) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 23:55:13 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:55:13 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:55:13 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[997ad4c8-3f76-4879-941a-e1623bbf234a]: (4, ('- - 0', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:55:13 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-9e308647-8ad5-4ee0-8596-afaa38b071ae tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Searching for a device in session 50 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75045) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 23:55:13 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e308647-8ad5-4ee0-8596-afaa38b071ae tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:c632bc58-d20b-46e4-9d9d-316f17f3ea43', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NsTdycnt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75045) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 23:55:13 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:55:14 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-9e308647-8ad5-4ee0-8596-afaa38b071ae tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.314s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 23:55:14 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e308647-8ad5-4ee0-8596-afaa38b071ae tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] <== connect_volume: return (1316ms) {'type': 'block', 'scsi_wwn': '26663656332633337', 'path': '/dev/sdb'} {{(pid=75045) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 23:55:14 user nova-compute[75045]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9e308647-8ad5-4ee0-8596-afaa38b071ae tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] [instance: a19b6a96-340f-488e-af81-853ee56bf30f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26663656332633337', 'path': '/dev/sdb'} {{(pid=75045) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 23:55:14 user nova-compute[75045]: DEBUG nova.objects.instance [None req-9e308647-8ad5-4ee0-8596-afaa38b071ae tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Lazy-loading 'flavor' on Instance uuid a19b6a96-340f-488e-af81-853ee56bf30f {{(pid=75045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 23:55:14 user nova-compute[75045]: DEBUG nova.virt.libvirt.guest [None req-9e308647-8ad5-4ee0-8596-afaa38b071ae tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] attach device xml: <disk type="block" device="disk">
Nov 08 23:55:14 user nova-compute[75045]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 23:55:14 user nova-compute[75045]:   <source dev="/dev/sdb"/>
Nov 08 23:55:14 user nova-compute[75045]:   <target dev="vdb" bus="virtio"/>
Nov 08 23:55:14 user nova-compute[75045]:   <serial>c632bc58-d20b-46e4-9d9d-316f17f3ea43</serial>
Nov 08 23:55:14 user nova-compute[75045]: </disk>
Nov 08 23:55:14 user nova-compute[75045]:  {{(pid=75045) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 08 23:55:14 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager.update_available_resource {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:55:15 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:55:15 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:55:15 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:55:15 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Auditing locally available compute resources for user (node: user) {{(pid=75045) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 23:55:15 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-9e308647-8ad5-4ee0-8596-afaa38b071ae tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] No BDM found with device name vda, not building metadata. {{(pid=75045) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 23:55:15 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-9e308647-8ad5-4ee0-8596-afaa38b071ae tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75045) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 23:55:15 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-9e308647-8ad5-4ee0-8596-afaa38b071ae tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] No VIF found with MAC fa:16:3e:0c:c0:6c, not building metadata {{(pid=75045) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 23:55:15 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a19b6a96-340f-488e-af81-853ee56bf30f/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:55:15 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-9e308647-8ad5-4ee0-8596-afaa38b071ae tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Lock "a19b6a96-340f-488e-af81-853ee56bf30f" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 25.423s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:55:15 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a19b6a96-340f-488e-af81-853ee56bf30f/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:55:15 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a19b6a96-340f-488e-af81-853ee56bf30f/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:55:15 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a19b6a96-340f-488e-af81-853ee56bf30f/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:55:15 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75045) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 23:55:15 user nova-compute[75045]: WARNING nova.virt.libvirt.driver [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 23:55:15 user nova-compute[75045]: WARNING nova.virt.libvirt.driver [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 23:55:15 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Hypervisor/Node resource view: name=user free_ram=8725MB free_disk=24.98241424560547GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75045) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 23:55:15 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:55:15 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:55:15 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Instance a19b6a96-340f-488e-af81-853ee56bf30f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75045) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 23:55:15 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Instance df16d913-9985-415f-aedc-14f2ca5bcf13 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75045) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 23:55:15 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75045) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 23:55:15 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75045) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 23:55:16 user nova-compute[75045]: DEBUG nova.compute.provider_tree [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Inventory has not changed in ProviderTree for provider: 62ba5f85-c74d-4b58-986e-d4197e813fd7 {{(pid=75045) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 23:55:16 user nova-compute[75045]: DEBUG nova.scheduler.client.report [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Inventory has not changed for provider 62ba5f85-c74d-4b58-986e-d4197e813fd7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75045) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 23:55:16 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Compute_service record updated for user:user {{(pid=75045) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 23:55:16 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.236s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:55:17 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:55:17 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-c0eb8290-e597-4959-a172-21a88218f1cd tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] Acquiring lock "8d9a47ed-6aa3-468f-b106-46b60cd27a46" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:55:17 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-c0eb8290-e597-4959-a172-21a88218f1cd tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] Lock "8d9a47ed-6aa3-468f-b106-46b60cd27a46" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:55:17 user nova-compute[75045]: DEBUG nova.compute.manager [None req-c0eb8290-e597-4959-a172-21a88218f1cd tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] [instance: 8d9a47ed-6aa3-468f-b106-46b60cd27a46] Starting instance... {{(pid=75045) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 23:55:17 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-c0eb8290-e597-4959-a172-21a88218f1cd tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:55:17 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-c0eb8290-e597-4959-a172-21a88218f1cd tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:55:17 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-c0eb8290-e597-4959-a172-21a88218f1cd tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75045) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 23:55:17 user nova-compute[75045]: INFO nova.compute.claims [None req-c0eb8290-e597-4959-a172-21a88218f1cd tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] [instance: 8d9a47ed-6aa3-468f-b106-46b60cd27a46] Claim successful on node user
Nov 08 23:55:18 user nova-compute[75045]: DEBUG nova.compute.provider_tree [None req-c0eb8290-e597-4959-a172-21a88218f1cd tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] Inventory has not changed in ProviderTree for provider: 62ba5f85-c74d-4b58-986e-d4197e813fd7 {{(pid=75045) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 23:55:18 user nova-compute[75045]: DEBUG nova.scheduler.client.report [None req-c0eb8290-e597-4959-a172-21a88218f1cd tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] Inventory has not changed for provider 62ba5f85-c74d-4b58-986e-d4197e813fd7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75045) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 23:55:18 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-c0eb8290-e597-4959-a172-21a88218f1cd tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.388s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:55:18 user nova-compute[75045]: DEBUG nova.compute.manager [None req-c0eb8290-e597-4959-a172-21a88218f1cd tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] [instance: 8d9a47ed-6aa3-468f-b106-46b60cd27a46] Start building networks asynchronously for instance. {{(pid=75045) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 23:55:18 user nova-compute[75045]: DEBUG nova.compute.manager [None req-c0eb8290-e597-4959-a172-21a88218f1cd tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] [instance: 8d9a47ed-6aa3-468f-b106-46b60cd27a46] Allocating IP information in the background. {{(pid=75045) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 23:55:18 user nova-compute[75045]: DEBUG nova.network.neutron [None req-c0eb8290-e597-4959-a172-21a88218f1cd tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] [instance: 8d9a47ed-6aa3-468f-b106-46b60cd27a46] allocate_for_instance() {{(pid=75045) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 23:55:18 user nova-compute[75045]: INFO nova.virt.libvirt.driver [None req-c0eb8290-e597-4959-a172-21a88218f1cd tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] [instance: 8d9a47ed-6aa3-468f-b106-46b60cd27a46] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 23:55:18 user nova-compute[75045]: DEBUG nova.compute.manager [None req-c0eb8290-e597-4959-a172-21a88218f1cd tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] [instance: 8d9a47ed-6aa3-468f-b106-46b60cd27a46] Start building block device mappings for instance. {{(pid=75045) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 23:55:18 user nova-compute[75045]: DEBUG nova.policy [None req-c0eb8290-e597-4959-a172-21a88218f1cd tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4ed9cd91d0654f4aa4d620c9f0eb2766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4bfce59008d44fdb5ba91c70f1cf044', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75045) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 23:55:18 user nova-compute[75045]: DEBUG nova.compute.manager [None req-c0eb8290-e597-4959-a172-21a88218f1cd tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] [instance: 8d9a47ed-6aa3-468f-b106-46b60cd27a46] Start spawning the instance on the hypervisor. {{(pid=75045) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 23:55:18 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-c0eb8290-e597-4959-a172-21a88218f1cd tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] [instance: 8d9a47ed-6aa3-468f-b106-46b60cd27a46] Creating instance directory {{(pid=75045) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 23:55:18 user nova-compute[75045]: INFO nova.virt.libvirt.driver [None req-c0eb8290-e597-4959-a172-21a88218f1cd tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] [instance: 8d9a47ed-6aa3-468f-b106-46b60cd27a46] Creating image(s)
Nov 08 23:55:18 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-c0eb8290-e597-4959-a172-21a88218f1cd tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] Acquiring lock "/opt/stack/data/nova/instances/8d9a47ed-6aa3-468f-b106-46b60cd27a46/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:55:18 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-c0eb8290-e597-4959-a172-21a88218f1cd tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] Lock "/opt/stack/data/nova/instances/8d9a47ed-6aa3-468f-b106-46b60cd27a46/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:55:18 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-c0eb8290-e597-4959-a172-21a88218f1cd tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] Lock "/opt/stack/data/nova/instances/8d9a47ed-6aa3-468f-b106-46b60cd27a46/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:55:18 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-c0eb8290-e597-4959-a172-21a88218f1cd tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] Acquiring lock "7070334dc3cfbe48fbd98bf3bd308a1c4e612158" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:55:18 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-c0eb8290-e597-4959-a172-21a88218f1cd tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] Lock "7070334dc3cfbe48fbd98bf3bd308a1c4e612158" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:55:19 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-c0eb8290-e597-4959-a172-21a88218f1cd tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7070334dc3cfbe48fbd98bf3bd308a1c4e612158.part --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:55:19 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:55:19 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:55:19 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-c0eb8290-e597-4959-a172-21a88218f1cd tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7070334dc3cfbe48fbd98bf3bd308a1c4e612158.part --force-share --output=json" returned: 0 in 0.194s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:55:19 user nova-compute[75045]: DEBUG nova.virt.images [None req-c0eb8290-e597-4959-a172-21a88218f1cd tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] e9a408d2-654c-4686-a04d-a5bce3fa0668 was qcow2, converting to raw {{(pid=75045) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 08 23:55:19 user nova-compute[75045]: DEBUG nova.privsep.utils [None req-c0eb8290-e597-4959-a172-21a88218f1cd tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75045) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 08 23:55:19 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-c0eb8290-e597-4959-a172-21a88218f1cd tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/7070334dc3cfbe48fbd98bf3bd308a1c4e612158.part /opt/stack/data/nova/instances/_base/7070334dc3cfbe48fbd98bf3bd308a1c4e612158.converted {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:55:19 user nova-compute[75045]: DEBUG nova.network.neutron [None req-c0eb8290-e597-4959-a172-21a88218f1cd tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] [instance: 8d9a47ed-6aa3-468f-b106-46b60cd27a46] Successfully created port: 26db8f3f-0cb5-474c-9499-14ece10e73e3 {{(pid=75045) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 23:55:19 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-c0eb8290-e597-4959-a172-21a88218f1cd tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/7070334dc3cfbe48fbd98bf3bd308a1c4e612158.part /opt/stack/data/nova/instances/_base/7070334dc3cfbe48fbd98bf3bd308a1c4e612158.converted" returned: 0 in 0.387s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:55:19 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-c0eb8290-e597-4959-a172-21a88218f1cd tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7070334dc3cfbe48fbd98bf3bd308a1c4e612158.converted --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:55:20 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-c0eb8290-e597-4959-a172-21a88218f1cd tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7070334dc3cfbe48fbd98bf3bd308a1c4e612158.converted --force-share --output=json" returned: 0 in 0.175s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:55:20 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-c0eb8290-e597-4959-a172-21a88218f1cd tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] Lock "7070334dc3cfbe48fbd98bf3bd308a1c4e612158" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.641s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:55:20 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-c0eb8290-e597-4959-a172-21a88218f1cd tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7070334dc3cfbe48fbd98bf3bd308a1c4e612158 --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:55:20 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-c0eb8290-e597-4959-a172-21a88218f1cd tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7070334dc3cfbe48fbd98bf3bd308a1c4e612158 --force-share --output=json" returned: 0 in 0.176s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:55:20 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-c0eb8290-e597-4959-a172-21a88218f1cd tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] Acquiring lock "7070334dc3cfbe48fbd98bf3bd308a1c4e612158" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:55:20 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-c0eb8290-e597-4959-a172-21a88218f1cd tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] Lock "7070334dc3cfbe48fbd98bf3bd308a1c4e612158" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:55:20 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-c0eb8290-e597-4959-a172-21a88218f1cd tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7070334dc3cfbe48fbd98bf3bd308a1c4e612158 --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:55:20 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-c0eb8290-e597-4959-a172-21a88218f1cd tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7070334dc3cfbe48fbd98bf3bd308a1c4e612158 --force-share --output=json" returned: 0 in 0.192s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:55:20 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-c0eb8290-e597-4959-a172-21a88218f1cd tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7070334dc3cfbe48fbd98bf3bd308a1c4e612158,backing_fmt=raw /opt/stack/data/nova/instances/8d9a47ed-6aa3-468f-b106-46b60cd27a46/disk 1073741824 {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:55:20 user nova-compute[75045]: DEBUG nova.network.neutron [None req-c0eb8290-e597-4959-a172-21a88218f1cd tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] [instance: 8d9a47ed-6aa3-468f-b106-46b60cd27a46] Successfully updated port: 26db8f3f-0cb5-474c-9499-14ece10e73e3 {{(pid=75045) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 23:55:20 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-c0eb8290-e597-4959-a172-21a88218f1cd tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7070334dc3cfbe48fbd98bf3bd308a1c4e612158,backing_fmt=raw /opt/stack/data/nova/instances/8d9a47ed-6aa3-468f-b106-46b60cd27a46/disk 1073741824" returned: 0 in 0.049s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:55:20 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-c0eb8290-e597-4959-a172-21a88218f1cd tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] Lock "7070334dc3cfbe48fbd98bf3bd308a1c4e612158" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.248s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:55:20 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-c0eb8290-e597-4959-a172-21a88218f1cd tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7070334dc3cfbe48fbd98bf3bd308a1c4e612158 --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:55:20 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-c0eb8290-e597-4959-a172-21a88218f1cd tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] Acquiring lock "refresh_cache-8d9a47ed-6aa3-468f-b106-46b60cd27a46" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 23:55:20 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-c0eb8290-e597-4959-a172-21a88218f1cd tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] Acquired lock "refresh_cache-8d9a47ed-6aa3-468f-b106-46b60cd27a46" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 23:55:20 user nova-compute[75045]: DEBUG nova.network.neutron [None req-c0eb8290-e597-4959-a172-21a88218f1cd tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] [instance: 8d9a47ed-6aa3-468f-b106-46b60cd27a46] Building network info cache for instance {{(pid=75045) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 23:55:20 user nova-compute[75045]: DEBUG nova.compute.manager [req-d44e30b6-5781-49cd-b3ff-838344d08826 req-dbb5d92b-59bd-462f-95da-2469eb8890c5 service nova] [instance: 8d9a47ed-6aa3-468f-b106-46b60cd27a46] Received event network-changed-26db8f3f-0cb5-474c-9499-14ece10e73e3 {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:55:20 user nova-compute[75045]: DEBUG nova.compute.manager [req-d44e30b6-5781-49cd-b3ff-838344d08826 req-dbb5d92b-59bd-462f-95da-2469eb8890c5 service nova] [instance: 8d9a47ed-6aa3-468f-b106-46b60cd27a46] Refreshing instance network info cache due to event network-changed-26db8f3f-0cb5-474c-9499-14ece10e73e3. {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 23:55:20 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-d44e30b6-5781-49cd-b3ff-838344d08826 req-dbb5d92b-59bd-462f-95da-2469eb8890c5 service nova] Acquiring lock "refresh_cache-8d9a47ed-6aa3-468f-b106-46b60cd27a46" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 23:55:20 user nova-compute[75045]: DEBUG nova.network.neutron [None req-c0eb8290-e597-4959-a172-21a88218f1cd tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] [instance: 8d9a47ed-6aa3-468f-b106-46b60cd27a46] Instance cache missing network info. {{(pid=75045) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 23:55:20 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-c0eb8290-e597-4959-a172-21a88218f1cd tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7070334dc3cfbe48fbd98bf3bd308a1c4e612158 --force-share --output=json" returned: 0 in 0.177s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:55:20 user nova-compute[75045]: DEBUG nova.virt.disk.api [None req-c0eb8290-e597-4959-a172-21a88218f1cd tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8d9a47ed-6aa3-468f-b106-46b60cd27a46/disk. size=1073741824 {{(pid=75045) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 23:55:20 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-c0eb8290-e597-4959-a172-21a88218f1cd tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d9a47ed-6aa3-468f-b106-46b60cd27a46/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:55:20 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-c0eb8290-e597-4959-a172-21a88218f1cd tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d9a47ed-6aa3-468f-b106-46b60cd27a46/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:55:20 user nova-compute[75045]: DEBUG nova.virt.disk.api [None req-c0eb8290-e597-4959-a172-21a88218f1cd tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] Cannot resize image /opt/stack/data/nova/instances/8d9a47ed-6aa3-468f-b106-46b60cd27a46/disk to a smaller size. {{(pid=75045) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 08 23:55:20 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-c0eb8290-e597-4959-a172-21a88218f1cd tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] [instance: 8d9a47ed-6aa3-468f-b106-46b60cd27a46] Created local disks {{(pid=75045) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 23:55:20 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-c0eb8290-e597-4959-a172-21a88218f1cd tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] [instance: 8d9a47ed-6aa3-468f-b106-46b60cd27a46] Ensure instance console log exists: /opt/stack/data/nova/instances/8d9a47ed-6aa3-468f-b106-46b60cd27a46/console.log {{(pid=75045) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 23:55:20 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-c0eb8290-e597-4959-a172-21a88218f1cd tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:55:20 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-c0eb8290-e597-4959-a172-21a88218f1cd tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:55:20 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-c0eb8290-e597-4959-a172-21a88218f1cd tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:55:20 user nova-compute[75045]: DEBUG nova.network.neutron [None req-c0eb8290-e597-4959-a172-21a88218f1cd tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] [instance: 8d9a47ed-6aa3-468f-b106-46b60cd27a46] Updating instance_info_cache with network_info: [{"id": "26db8f3f-0cb5-474c-9499-14ece10e73e3", "address": "fa:16:3e:12:6c:30", "network": {"id": "fe5f7093-1cdd-465c-97f0-7d7b2dd1fa8a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1755065955-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4bfce59008d44fdb5ba91c70f1cf044", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26db8f3f-0c", "ovs_interfaceid": "26db8f3f-0cb5-474c-9499-14ece10e73e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75045) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 23:55:20 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-c0eb8290-e597-4959-a172-21a88218f1cd tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] Releasing lock "refresh_cache-8d9a47ed-6aa3-468f-b106-46b60cd27a46" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 23:55:20 user nova-compute[75045]: DEBUG nova.compute.manager [None req-c0eb8290-e597-4959-a172-21a88218f1cd tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] [instance: 8d9a47ed-6aa3-468f-b106-46b60cd27a46] Instance network_info: |[{"id": "26db8f3f-0cb5-474c-9499-14ece10e73e3", "address": "fa:16:3e:12:6c:30", "network": {"id": "fe5f7093-1cdd-465c-97f0-7d7b2dd1fa8a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1755065955-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4bfce59008d44fdb5ba91c70f1cf044", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26db8f3f-0c", "ovs_interfaceid": "26db8f3f-0cb5-474c-9499-14ece10e73e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75045) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 23:55:20 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-d44e30b6-5781-49cd-b3ff-838344d08826 req-dbb5d92b-59bd-462f-95da-2469eb8890c5 service nova] Acquired lock "refresh_cache-8d9a47ed-6aa3-468f-b106-46b60cd27a46" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 23:55:20 user nova-compute[75045]: DEBUG nova.network.neutron [req-d44e30b6-5781-49cd-b3ff-838344d08826 req-dbb5d92b-59bd-462f-95da-2469eb8890c5 service nova] [instance: 8d9a47ed-6aa3-468f-b106-46b60cd27a46] Refreshing network info cache for port 26db8f3f-0cb5-474c-9499-14ece10e73e3 {{(pid=75045) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 23:55:20 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-c0eb8290-e597-4959-a172-21a88218f1cd tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] [instance: 8d9a47ed-6aa3-468f-b106-46b60cd27a46] Start _get_guest_xml network_info=[{"id": "26db8f3f-0cb5-474c-9499-14ece10e73e3", "address": "fa:16:3e:12:6c:30", "network": {"id": "fe5f7093-1cdd-465c-97f0-7d7b2dd1fa8a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1755065955-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4bfce59008d44fdb5ba91c70f1cf044", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26db8f3f-0c", "ovs_interfaceid": "26db8f3f-0cb5-474c-9499-14ece10e73e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T23:55:14Z,direct_url=<?>,disk_format='qcow2',id=e9a408d2-654c-4686-a04d-a5bce3fa0668,min_disk=0,min_ram=0,name='tempest-scenario-img--269725771',owner='c4bfce59008d44fdb5ba91c70f1cf044',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T23:55:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'disk_bus': 'virtio', 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': 'e9a408d2-654c-4686-a04d-a5bce3fa0668'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75045) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 23:55:20 user nova-compute[75045]: WARNING nova.virt.libvirt.driver [None req-c0eb8290-e597-4959-a172-21a88218f1cd tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 23:55:20 user nova-compute[75045]: WARNING nova.virt.libvirt.driver [None req-c0eb8290-e597-4959-a172-21a88218f1cd tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 23:55:20 user nova-compute[75045]: DEBUG nova.virt.libvirt.host [None req-c0eb8290-e597-4959-a172-21a88218f1cd tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75045) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 23:55:20 user nova-compute[75045]: DEBUG nova.virt.libvirt.host [None req-c0eb8290-e597-4959-a172-21a88218f1cd tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] CPU controller missing on host. {{(pid=75045) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 23:55:20 user nova-compute[75045]: DEBUG nova.virt.libvirt.host [None req-c0eb8290-e597-4959-a172-21a88218f1cd tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75045) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 23:55:20 user nova-compute[75045]: DEBUG nova.virt.libvirt.host [None req-c0eb8290-e597-4959-a172-21a88218f1cd tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] CPU controller found on host. {{(pid=75045) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 23:55:20 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-c0eb8290-e597-4959-a172-21a88218f1cd tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75045) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 23:55:20 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-c0eb8290-e597-4959-a172-21a88218f1cd tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T23:11:41Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T23:55:14Z,direct_url=<?>,disk_format='qcow2',id=e9a408d2-654c-4686-a04d-a5bce3fa0668,min_disk=0,min_ram=0,name='tempest-scenario-img--269725771',owner='c4bfce59008d44fdb5ba91c70f1cf044',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T23:55:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75045) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 23:55:20 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-c0eb8290-e597-4959-a172-21a88218f1cd tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] Flavor limits 0:0:0 {{(pid=75045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 23:55:20 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-c0eb8290-e597-4959-a172-21a88218f1cd tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] Image limits 0:0:0 {{(pid=75045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 23:55:20 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-c0eb8290-e597-4959-a172-21a88218f1cd tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] Flavor pref 0:0:0 {{(pid=75045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 23:55:20 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-c0eb8290-e597-4959-a172-21a88218f1cd tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] Image pref 0:0:0 {{(pid=75045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 23:55:20 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-c0eb8290-e597-4959-a172-21a88218f1cd tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 23:55:20 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-c0eb8290-e597-4959-a172-21a88218f1cd tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75045) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 23:55:20 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-c0eb8290-e597-4959-a172-21a88218f1cd tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75045) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 23:55:20 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-c0eb8290-e597-4959-a172-21a88218f1cd tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] Got 1 possible topologies {{(pid=75045) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 23:55:20 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-c0eb8290-e597-4959-a172-21a88218f1cd tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75045) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 23:55:20 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-c0eb8290-e597-4959-a172-21a88218f1cd tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75045) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 23:55:20 user nova-compute[75045]: DEBUG nova.virt.libvirt.vif [None req-c0eb8290-e597-4959-a172-21a88218f1cd tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T23:55:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-995750485',display_name='tempest-TestMinimumBasicScenario-server-995750485',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-995750485',id=51,image_ref='e9a408d2-654c-4686-a04d-a5bce3fa0668',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLsl2uyN7Jq9gVsEB++YEMgh7/QXDixJkbRJ9YT7eeiV8fPimhSb00+fgyaUjcwKXyno8lm9QP9R40mzt4cBHvMjx0tEf28AUzMlrAPp72Pva72DfgQ3b8K7fGRRmg4S4Q==',key_name='tempest-TestMinimumBasicScenario-419972175',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c4bfce59008d44fdb5ba91c70f1cf044',ramdisk_id='',reservation_id='r-pdpr1g7q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e9a408d2-654c-4686-a04d-a5bce3fa0668',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1125576376',owner_user_name='tempest-TestMinimumBasicScenario-1125576376-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T23:55:18Z,user_data=None,user_id='4ed9cd91d0654f4aa4d620c9f0eb2766',uuid=8d9a47ed-6aa3-468f-b106-46b60cd27a46,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "26db8f3f-0cb5-474c-9499-14ece10e73e3", "address": "fa:16:3e:12:6c:30", "network": {"id": "fe5f7093-1cdd-465c-97f0-7d7b2dd1fa8a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1755065955-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4bfce59008d44fdb5ba91c70f1cf044", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26db8f3f-0c", "ovs_interfaceid": "26db8f3f-0cb5-474c-9499-14ece10e73e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75045) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 23:55:20 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-c0eb8290-e597-4959-a172-21a88218f1cd tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] Converting VIF {"id": "26db8f3f-0cb5-474c-9499-14ece10e73e3", "address": "fa:16:3e:12:6c:30", "network": {"id": "fe5f7093-1cdd-465c-97f0-7d7b2dd1fa8a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1755065955-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4bfce59008d44fdb5ba91c70f1cf044", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26db8f3f-0c", "ovs_interfaceid": "26db8f3f-0cb5-474c-9499-14ece10e73e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 23:55:20 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-c0eb8290-e597-4959-a172-21a88218f1cd tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:12:6c:30,bridge_name='br-int',has_traffic_filtering=True,id=26db8f3f-0cb5-474c-9499-14ece10e73e3,network=Network(fe5f7093-1cdd-465c-97f0-7d7b2dd1fa8a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26db8f3f-0c') {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 23:55:20 user nova-compute[75045]: DEBUG nova.objects.instance [None req-c0eb8290-e597-4959-a172-21a88218f1cd tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] Lazy-loading 'pci_devices' on Instance uuid 8d9a47ed-6aa3-468f-b106-46b60cd27a46 {{(pid=75045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 23:55:20 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-c0eb8290-e597-4959-a172-21a88218f1cd tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] [instance: 8d9a47ed-6aa3-468f-b106-46b60cd27a46] End _get_guest_xml xml=<domain type="kvm">
Nov 08 23:55:20 user nova-compute[75045]:   <uuid>8d9a47ed-6aa3-468f-b106-46b60cd27a46</uuid>
Nov 08 23:55:20 user nova-compute[75045]:   <name>instance-00000033</name>
Nov 08 23:55:20 user nova-compute[75045]:   <memory>524288</memory>
Nov 08 23:55:20 user nova-compute[75045]:   <vcpu>1</vcpu>
Nov 08 23:55:20 user nova-compute[75045]:   <metadata>
Nov 08 23:55:20 user nova-compute[75045]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 23:55:20 user nova-compute[75045]:       <nova:package version="0.0.0"/>
Nov 08 23:55:20 user nova-compute[75045]:       <nova:name>tempest-TestMinimumBasicScenario-server-995750485</nova:name>
Nov 08 23:55:20 user nova-compute[75045]:       <nova:creationTime>2023-11-08 23:55:20</nova:creationTime>
Nov 08 23:55:20 user nova-compute[75045]:       <nova:flavor name="m1.tiny">
Nov 08 23:55:20 user nova-compute[75045]:         <nova:memory>512</nova:memory>
Nov 08 23:55:20 user nova-compute[75045]:         <nova:disk>1</nova:disk>
Nov 08 23:55:20 user nova-compute[75045]:         <nova:swap>0</nova:swap>
Nov 08 23:55:20 user nova-compute[75045]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 23:55:20 user nova-compute[75045]:         <nova:vcpus>1</nova:vcpus>
Nov 08 23:55:20 user nova-compute[75045]:       </nova:flavor>
Nov 08 23:55:20 user nova-compute[75045]:       <nova:owner>
Nov 08 23:55:20 user nova-compute[75045]:         <nova:user uuid="4ed9cd91d0654f4aa4d620c9f0eb2766">tempest-TestMinimumBasicScenario-1125576376-project-member</nova:user>
Nov 08 23:55:20 user nova-compute[75045]:         <nova:project uuid="c4bfce59008d44fdb5ba91c70f1cf044">tempest-TestMinimumBasicScenario-1125576376</nova:project>
Nov 08 23:55:20 user nova-compute[75045]:       </nova:owner>
Nov 08 23:55:20 user nova-compute[75045]:       <nova:root type="image" uuid="e9a408d2-654c-4686-a04d-a5bce3fa0668"/>
Nov 08 23:55:20 user nova-compute[75045]:       <nova:ports>
Nov 08 23:55:20 user nova-compute[75045]:         <nova:port uuid="26db8f3f-0cb5-474c-9499-14ece10e73e3">
Nov 08 23:55:20 user nova-compute[75045]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 08 23:55:20 user nova-compute[75045]:         </nova:port>
Nov 08 23:55:20 user nova-compute[75045]:       </nova:ports>
Nov 08 23:55:20 user nova-compute[75045]:     </nova:instance>
Nov 08 23:55:20 user nova-compute[75045]:   </metadata>
Nov 08 23:55:20 user nova-compute[75045]:   <sysinfo type="smbios">
Nov 08 23:55:20 user nova-compute[75045]:     <system>
Nov 08 23:55:20 user nova-compute[75045]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 23:55:20 user nova-compute[75045]:       <entry name="product">OpenStack Nova</entry>
Nov 08 23:55:20 user nova-compute[75045]:       <entry name="version">0.0.0</entry>
Nov 08 23:55:20 user nova-compute[75045]:       <entry name="serial">8d9a47ed-6aa3-468f-b106-46b60cd27a46</entry>
Nov 08 23:55:20 user nova-compute[75045]:       <entry name="uuid">8d9a47ed-6aa3-468f-b106-46b60cd27a46</entry>
Nov 08 23:55:20 user nova-compute[75045]:       <entry name="family">Virtual Machine</entry>
Nov 08 23:55:20 user nova-compute[75045]:     </system>
Nov 08 23:55:20 user nova-compute[75045]:   </sysinfo>
Nov 08 23:55:20 user nova-compute[75045]:   <os>
Nov 08 23:55:20 user nova-compute[75045]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 23:55:20 user nova-compute[75045]:     <boot dev="hd"/>
Nov 08 23:55:20 user nova-compute[75045]:     <smbios mode="sysinfo"/>
Nov 08 23:55:20 user nova-compute[75045]:   </os>
Nov 08 23:55:20 user nova-compute[75045]:   <features>
Nov 08 23:55:20 user nova-compute[75045]:     <acpi/>
Nov 08 23:55:20 user nova-compute[75045]:     <apic/>
Nov 08 23:55:20 user nova-compute[75045]:     <vmcoreinfo/>
Nov 08 23:55:20 user nova-compute[75045]:   </features>
Nov 08 23:55:20 user nova-compute[75045]:   <clock offset="utc">
Nov 08 23:55:20 user nova-compute[75045]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 23:55:20 user nova-compute[75045]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 23:55:20 user nova-compute[75045]:     <timer name="hpet" present="no"/>
Nov 08 23:55:20 user nova-compute[75045]:   </clock>
Nov 08 23:55:20 user nova-compute[75045]:   <cpu mode="custom" match="exact">
Nov 08 23:55:20 user nova-compute[75045]:     <model>Nehalem</model>
Nov 08 23:55:20 user nova-compute[75045]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 23:55:20 user nova-compute[75045]:   </cpu>
Nov 08 23:55:20 user nova-compute[75045]:   <devices>
Nov 08 23:55:20 user nova-compute[75045]:     <disk type="file" device="disk">
Nov 08 23:55:20 user nova-compute[75045]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 23:55:20 user nova-compute[75045]:       <source file="/opt/stack/data/nova/instances/8d9a47ed-6aa3-468f-b106-46b60cd27a46/disk"/>
Nov 08 23:55:20 user nova-compute[75045]:       <target dev="vda" bus="virtio"/>
Nov 08 23:55:20 user nova-compute[75045]:     </disk>
Nov 08 23:55:20 user nova-compute[75045]:     <interface type="ethernet">
Nov 08 23:55:20 user nova-compute[75045]:       <mac address="fa:16:3e:12:6c:30"/>
Nov 08 23:55:20 user nova-compute[75045]:       <model type="virtio"/>
Nov 08 23:55:20 user nova-compute[75045]:       <mtu size="1442"/>
Nov 08 23:55:20 user nova-compute[75045]:       <target dev="tap26db8f3f-0c"/>
Nov 08 23:55:20 user nova-compute[75045]:     </interface>
Nov 08 23:55:20 user nova-compute[75045]:     <serial type="pty">
Nov 08 23:55:20 user nova-compute[75045]:       <log file="/opt/stack/data/nova/instances/8d9a47ed-6aa3-468f-b106-46b60cd27a46/console.log" append="off"/>
Nov 08 23:55:20 user nova-compute[75045]:     </serial>
Nov 08 23:55:20 user nova-compute[75045]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 23:55:20 user nova-compute[75045]:     <video>
Nov 08 23:55:20 user nova-compute[75045]:       <model type="virtio"/>
Nov 08 23:55:20 user nova-compute[75045]:     </video>
Nov 08 23:55:20 user nova-compute[75045]:     <rng model="virtio">
Nov 08 23:55:20 user nova-compute[75045]:       <backend model="random">/dev/urandom</backend>
Nov 08 23:55:20 user nova-compute[75045]:     </rng>
Nov 08 23:55:20 user nova-compute[75045]:     <controller type="usb" index="0" model="none"/>
Nov 08 23:55:20 user nova-compute[75045]:     <memballoon model="virtio">
Nov 08 23:55:20 user nova-compute[75045]:       <stats period="10"/>
Nov 08 23:55:20 user nova-compute[75045]:     </memballoon>
Nov 08 23:55:20 user nova-compute[75045]:   </devices>
Nov 08 23:55:20 user nova-compute[75045]: </domain>
Nov 08 23:55:20 user nova-compute[75045]:  {{(pid=75045) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 23:55:20 user nova-compute[75045]: DEBUG nova.virt.libvirt.vif [None req-c0eb8290-e597-4959-a172-21a88218f1cd tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T23:55:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-995750485',display_name='tempest-TestMinimumBasicScenario-server-995750485',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-995750485',id=51,image_ref='e9a408d2-654c-4686-a04d-a5bce3fa0668',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLsl2uyN7Jq9gVsEB++YEMgh7/QXDixJkbRJ9YT7eeiV8fPimhSb00+fgyaUjcwKXyno8lm9QP9R40mzt4cBHvMjx0tEf28AUzMlrAPp72Pva72DfgQ3b8K7fGRRmg4S4Q==',key_name='tempest-TestMinimumBasicScenario-419972175',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c4bfce59008d44fdb5ba91c70f1cf044',ramdisk_id='',reservation_id='r-pdpr1g7q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e9a408d2-654c-4686-a04d-a5bce3fa0668',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1125576376',owner_user_name='tempest-TestMinimumBasicScenario-1125576376-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T23:55:18Z,user_data=None,user_id='4ed9cd91d0654f4aa4d620c9f0eb2766',uuid=8d9a47ed-6aa3-468f-b106-46b60cd27a46,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "26db8f3f-0cb5-474c-9499-14ece10e73e3", "address": "fa:16:3e:12:6c:30", "network": {"id": "fe5f7093-1cdd-465c-97f0-7d7b2dd1fa8a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1755065955-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4bfce59008d44fdb5ba91c70f1cf044", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26db8f3f-0c", "ovs_interfaceid": "26db8f3f-0cb5-474c-9499-14ece10e73e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75045) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 23:55:20 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-c0eb8290-e597-4959-a172-21a88218f1cd tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] Converting VIF {"id": "26db8f3f-0cb5-474c-9499-14ece10e73e3", "address": "fa:16:3e:12:6c:30", "network": {"id": "fe5f7093-1cdd-465c-97f0-7d7b2dd1fa8a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1755065955-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4bfce59008d44fdb5ba91c70f1cf044", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26db8f3f-0c", "ovs_interfaceid": "26db8f3f-0cb5-474c-9499-14ece10e73e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 23:55:20 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-c0eb8290-e597-4959-a172-21a88218f1cd tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:12:6c:30,bridge_name='br-int',has_traffic_filtering=True,id=26db8f3f-0cb5-474c-9499-14ece10e73e3,network=Network(fe5f7093-1cdd-465c-97f0-7d7b2dd1fa8a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26db8f3f-0c') {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 23:55:20 user nova-compute[75045]: DEBUG os_vif [None req-c0eb8290-e597-4959-a172-21a88218f1cd tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:12:6c:30,bridge_name='br-int',has_traffic_filtering=True,id=26db8f3f-0cb5-474c-9499-14ece10e73e3,network=Network(fe5f7093-1cdd-465c-97f0-7d7b2dd1fa8a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26db8f3f-0c') {{(pid=75045) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 23:55:20 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:55:20 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:55:20 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 23:55:20 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:55:20 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '720997c9-b147-50e0-9ed9-4e46cadb82ea', '_type': 'linux-noop'}}, row=False) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:55:21 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:55:21 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 23:55:21 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:55:21 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap26db8f3f-0c, may_exist=True, interface_attrs={}) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:55:21 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap26db8f3f-0c, col_values=(('qos', UUID('91f5a5a1-5b02-4a1c-a36e-6416dc78a3a7')),), if_exists=True) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:55:21 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap26db8f3f-0c, col_values=(('external_ids', {'iface-id': '26db8f3f-0cb5-474c-9499-14ece10e73e3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:12:6c:30', 'vm-uuid': '8d9a47ed-6aa3-468f-b106-46b60cd27a46'}),), if_exists=True) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:55:21 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:55:21 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 23:55:21 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:55:21 user nova-compute[75045]: INFO os_vif [None req-c0eb8290-e597-4959-a172-21a88218f1cd tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:12:6c:30,bridge_name='br-int',has_traffic_filtering=True,id=26db8f3f-0cb5-474c-9499-14ece10e73e3,network=Network(fe5f7093-1cdd-465c-97f0-7d7b2dd1fa8a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26db8f3f-0c')
Nov 08 23:55:21 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-c0eb8290-e597-4959-a172-21a88218f1cd tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] No BDM found with device name vda, not building metadata. {{(pid=75045) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 23:55:21 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-c0eb8290-e597-4959-a172-21a88218f1cd tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] No VIF found with MAC fa:16:3e:12:6c:30, not building metadata {{(pid=75045) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 23:55:21 user nova-compute[75045]: DEBUG nova.network.neutron [req-d44e30b6-5781-49cd-b3ff-838344d08826 req-dbb5d92b-59bd-462f-95da-2469eb8890c5 service nova] [instance: 8d9a47ed-6aa3-468f-b106-46b60cd27a46] Updated VIF entry in instance network info cache for port 26db8f3f-0cb5-474c-9499-14ece10e73e3. {{(pid=75045) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 23:55:21 user nova-compute[75045]: DEBUG nova.network.neutron [req-d44e30b6-5781-49cd-b3ff-838344d08826 req-dbb5d92b-59bd-462f-95da-2469eb8890c5 service nova] [instance: 8d9a47ed-6aa3-468f-b106-46b60cd27a46] Updating instance_info_cache with network_info: [{"id": "26db8f3f-0cb5-474c-9499-14ece10e73e3", "address": "fa:16:3e:12:6c:30", "network": {"id": "fe5f7093-1cdd-465c-97f0-7d7b2dd1fa8a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1755065955-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4bfce59008d44fdb5ba91c70f1cf044", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26db8f3f-0c", "ovs_interfaceid": "26db8f3f-0cb5-474c-9499-14ece10e73e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75045) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 23:55:21 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-d44e30b6-5781-49cd-b3ff-838344d08826 req-dbb5d92b-59bd-462f-95da-2469eb8890c5 service nova] Releasing lock "refresh_cache-8d9a47ed-6aa3-468f-b106-46b60cd27a46" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 23:55:22 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:55:22 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:55:22 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:55:22 user nova-compute[75045]: DEBUG nova.compute.manager [req-5768deba-aebf-44a7-b38e-7f7832db179d req-35359cd9-b6f3-483a-a428-529e4aaabb26 service nova] [instance: 8d9a47ed-6aa3-468f-b106-46b60cd27a46] Received event network-vif-plugged-26db8f3f-0cb5-474c-9499-14ece10e73e3 {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:55:22 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-5768deba-aebf-44a7-b38e-7f7832db179d req-35359cd9-b6f3-483a-a428-529e4aaabb26 service nova] Acquiring lock "8d9a47ed-6aa3-468f-b106-46b60cd27a46-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:55:22 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-5768deba-aebf-44a7-b38e-7f7832db179d req-35359cd9-b6f3-483a-a428-529e4aaabb26 service nova] Lock "8d9a47ed-6aa3-468f-b106-46b60cd27a46-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:55:22 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-5768deba-aebf-44a7-b38e-7f7832db179d req-35359cd9-b6f3-483a-a428-529e4aaabb26 service nova] Lock "8d9a47ed-6aa3-468f-b106-46b60cd27a46-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:55:22 user nova-compute[75045]: DEBUG nova.compute.manager [req-5768deba-aebf-44a7-b38e-7f7832db179d req-35359cd9-b6f3-483a-a428-529e4aaabb26 service nova] [instance: 8d9a47ed-6aa3-468f-b106-46b60cd27a46] No waiting events found dispatching network-vif-plugged-26db8f3f-0cb5-474c-9499-14ece10e73e3 {{(pid=75045) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 23:55:22 user nova-compute[75045]: WARNING nova.compute.manager [req-5768deba-aebf-44a7-b38e-7f7832db179d req-35359cd9-b6f3-483a-a428-529e4aaabb26 service nova] [instance: 8d9a47ed-6aa3-468f-b106-46b60cd27a46] Received unexpected event network-vif-plugged-26db8f3f-0cb5-474c-9499-14ece10e73e3 for instance with vm_state building and task_state spawning.
Nov 08 23:55:22 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-db11b9bb-1244-4012-bbdd-53a3a5fe55d6 tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Acquiring lock "a19b6a96-340f-488e-af81-853ee56bf30f" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:55:22 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-db11b9bb-1244-4012-bbdd-53a3a5fe55d6 tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Lock "a19b6a96-340f-488e-af81-853ee56bf30f" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:55:22 user nova-compute[75045]: DEBUG nova.objects.instance [None req-db11b9bb-1244-4012-bbdd-53a3a5fe55d6 tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Lazy-loading 'flavor' on Instance uuid a19b6a96-340f-488e-af81-853ee56bf30f {{(pid=75045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 23:55:22 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-db11b9bb-1244-4012-bbdd-53a3a5fe55d6 tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Lock "a19b6a96-340f-488e-af81-853ee56bf30f" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.064s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:55:22 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-db11b9bb-1244-4012-bbdd-53a3a5fe55d6 tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Acquiring lock "a19b6a96-340f-488e-af81-853ee56bf30f" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:55:22 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-db11b9bb-1244-4012-bbdd-53a3a5fe55d6 tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Lock "a19b6a96-340f-488e-af81-853ee56bf30f" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:55:22 user nova-compute[75045]: INFO nova.compute.manager [None req-db11b9bb-1244-4012-bbdd-53a3a5fe55d6 tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] [instance: a19b6a96-340f-488e-af81-853ee56bf30f] Attaching volume 8cde2eb2-d792-44e3-9a37-b04543d41bda to /dev/vdc
Nov 08 23:55:22 user nova-compute[75045]: DEBUG os_brick.utils [None req-db11b9bb-1244-4012-bbdd-53a3a5fe55d6 tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75045) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 23:55:22 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:55:23 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:55:23 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[9de2f955-f5ff-4c0c-bfee-c9e3cac28183]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6217bd6e884\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:55:23 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:55:23 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:55:23 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:55:23 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:55:23 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fb4a747-82e2-44ed-9abc-4c307dfef2a0]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:55:23 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:55:23 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:55:23 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:55:23 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[63aade97-c167-4e1e-8fce-50b94f0feb88]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:55:23 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[c166e97a-5197-441b-a360-6495ea1b9aec]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:55:23 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-db11b9bb-1244-4012-bbdd-53a3a5fe55d6 tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Running cmd (subprocess): nvme version {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:55:23 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-db11b9bb-1244-4012-bbdd-53a3a5fe55d6 tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] 'nvme version' failed. Not Retrying. {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 23:55:23 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.nvmeof [None req-db11b9bb-1244-4012-bbdd-53a3a5fe55d6 tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] nvme not present on system {{(pid=75045) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 23:55:23 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:55:23 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 23:55:23 user nova-compute[75045]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 23:55:23 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[6effd0b4-1447-466f-9d24-a3367c0e5b0a]: (4, '') {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:55:23 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.lightos [None req-db11b9bb-1244-4012-bbdd-53a3a5fe55d6 tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75045) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 23:55:23 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.lightos [None req-db11b9bb-1244-4012-bbdd-53a3a5fe55d6 tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75045) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 23:55:23 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.lightos [None req-db11b9bb-1244-4012-bbdd-53a3a5fe55d6 tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] LIGHTOS: no hostnqn found. {{(pid=75045) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 23:55:23 user nova-compute[75045]: DEBUG os_brick.utils [None req-db11b9bb-1244-4012-bbdd-53a3a5fe55d6 tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6217bd6e884', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75045) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 23:55:23 user nova-compute[75045]: DEBUG nova.virt.block_device [None req-db11b9bb-1244-4012-bbdd-53a3a5fe55d6 tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] [instance: a19b6a96-340f-488e-af81-853ee56bf30f] Updating existing volume attachment record: ef0845ed-5630-4e72-a42c-5921e1c09263 {{(pid=75045) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 23:55:24 user nova-compute[75045]: DEBUG nova.compute.manager [req-92ff89eb-391c-4fd0-85a5-bc1d4fb46d70 req-6a7691e3-faaa-4889-9785-b10db48d101b service nova] [instance: 8d9a47ed-6aa3-468f-b106-46b60cd27a46] Received event network-vif-plugged-26db8f3f-0cb5-474c-9499-14ece10e73e3 {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:55:24 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-92ff89eb-391c-4fd0-85a5-bc1d4fb46d70 req-6a7691e3-faaa-4889-9785-b10db48d101b service nova] Acquiring lock "8d9a47ed-6aa3-468f-b106-46b60cd27a46-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:55:24 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-92ff89eb-391c-4fd0-85a5-bc1d4fb46d70 req-6a7691e3-faaa-4889-9785-b10db48d101b service nova] Lock "8d9a47ed-6aa3-468f-b106-46b60cd27a46-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:55:24 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-92ff89eb-391c-4fd0-85a5-bc1d4fb46d70 req-6a7691e3-faaa-4889-9785-b10db48d101b service nova] Lock "8d9a47ed-6aa3-468f-b106-46b60cd27a46-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:55:24 user nova-compute[75045]: DEBUG nova.compute.manager [req-92ff89eb-391c-4fd0-85a5-bc1d4fb46d70 req-6a7691e3-faaa-4889-9785-b10db48d101b service nova] [instance: 8d9a47ed-6aa3-468f-b106-46b60cd27a46] No waiting events found dispatching network-vif-plugged-26db8f3f-0cb5-474c-9499-14ece10e73e3 {{(pid=75045) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 23:55:24 user nova-compute[75045]: WARNING nova.compute.manager [req-92ff89eb-391c-4fd0-85a5-bc1d4fb46d70 req-6a7691e3-faaa-4889-9785-b10db48d101b service nova] [instance: 8d9a47ed-6aa3-468f-b106-46b60cd27a46] Received unexpected event network-vif-plugged-26db8f3f-0cb5-474c-9499-14ece10e73e3 for instance with vm_state building and task_state spawning.
Nov 08 23:55:24 user nova-compute[75045]: DEBUG nova.compute.manager [None req-c0eb8290-e597-4959-a172-21a88218f1cd tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] [instance: 8d9a47ed-6aa3-468f-b106-46b60cd27a46] Instance event wait completed in 0 seconds for  {{(pid=75045) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 23:55:24 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-c0eb8290-e597-4959-a172-21a88218f1cd tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] [instance: 8d9a47ed-6aa3-468f-b106-46b60cd27a46] Guest created on hypervisor {{(pid=75045) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 23:55:24 user nova-compute[75045]: INFO nova.virt.libvirt.driver [-] [instance: 8d9a47ed-6aa3-468f-b106-46b60cd27a46] Instance spawned successfully.
Nov 08 23:55:24 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-c0eb8290-e597-4959-a172-21a88218f1cd tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] [instance: 8d9a47ed-6aa3-468f-b106-46b60cd27a46] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75045) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 23:55:24 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-c0eb8290-e597-4959-a172-21a88218f1cd tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] [instance: 8d9a47ed-6aa3-468f-b106-46b60cd27a46] Found default for hw_cdrom_bus of ide {{(pid=75045) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 23:55:24 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-c0eb8290-e597-4959-a172-21a88218f1cd tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] [instance: 8d9a47ed-6aa3-468f-b106-46b60cd27a46] Found default for hw_disk_bus of virtio {{(pid=75045) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 23:55:24 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-c0eb8290-e597-4959-a172-21a88218f1cd tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] [instance: 8d9a47ed-6aa3-468f-b106-46b60cd27a46] Found default for hw_input_bus of None {{(pid=75045) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 23:55:24 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-c0eb8290-e597-4959-a172-21a88218f1cd tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] [instance: 8d9a47ed-6aa3-468f-b106-46b60cd27a46] Found default for hw_pointer_model of None {{(pid=75045) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 23:55:24 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-c0eb8290-e597-4959-a172-21a88218f1cd tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] [instance: 8d9a47ed-6aa3-468f-b106-46b60cd27a46] Found default for hw_video_model of virtio {{(pid=75045) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 23:55:24 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-c0eb8290-e597-4959-a172-21a88218f1cd tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] [instance: 8d9a47ed-6aa3-468f-b106-46b60cd27a46] Found default for hw_vif_model of virtio {{(pid=75045) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 23:55:24 user nova-compute[75045]: INFO nova.compute.manager [None req-c0eb8290-e597-4959-a172-21a88218f1cd tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] [instance: 8d9a47ed-6aa3-468f-b106-46b60cd27a46] Took 6.49 seconds to spawn the instance on the hypervisor.
Nov 08 23:55:24 user nova-compute[75045]: DEBUG nova.compute.manager [None req-c0eb8290-e597-4959-a172-21a88218f1cd tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] [instance: 8d9a47ed-6aa3-468f-b106-46b60cd27a46] Checking state {{(pid=75045) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 23:55:24 user nova-compute[75045]: INFO nova.compute.manager [None req-c0eb8290-e597-4959-a172-21a88218f1cd tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] [instance: 8d9a47ed-6aa3-468f-b106-46b60cd27a46] Took 7.30 seconds to build instance.
Nov 08 23:55:25 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-c0eb8290-e597-4959-a172-21a88218f1cd tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] Lock "8d9a47ed-6aa3-468f-b106-46b60cd27a46" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.427s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:55:26 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:55:27 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:55:31 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:55:31 user nova-compute[75045]: DEBUG nova.compute.manager [None req-af167af0-1115-4146-a74e-887c5bfb5362 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] [instance: df16d913-9985-415f-aedc-14f2ca5bcf13] Start spawning the instance on the hypervisor. {{(pid=75045) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 23:55:31 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-af167af0-1115-4146-a74e-887c5bfb5362 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] [instance: df16d913-9985-415f-aedc-14f2ca5bcf13] Creating instance directory {{(pid=75045) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 23:55:31 user nova-compute[75045]: INFO nova.virt.libvirt.driver [None req-af167af0-1115-4146-a74e-887c5bfb5362 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] [instance: df16d913-9985-415f-aedc-14f2ca5bcf13] Creating image(s)
Nov 08 23:55:31 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-af167af0-1115-4146-a74e-887c5bfb5362 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] [instance: df16d913-9985-415f-aedc-14f2ca5bcf13] Did not create local disks {{(pid=75045) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 08 23:55:31 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-af167af0-1115-4146-a74e-887c5bfb5362 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] [instance: df16d913-9985-415f-aedc-14f2ca5bcf13] Ensure instance console log exists: /opt/stack/data/nova/instances/df16d913-9985-415f-aedc-14f2ca5bcf13/console.log {{(pid=75045) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 23:55:31 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-af167af0-1115-4146-a74e-887c5bfb5362 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:55:31 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-af167af0-1115-4146-a74e-887c5bfb5362 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:55:31 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-af167af0-1115-4146-a74e-887c5bfb5362 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:55:31 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-af167af0-1115-4146-a74e-887c5bfb5362 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] [instance: df16d913-9985-415f-aedc-14f2ca5bcf13] Start _get_guest_xml network_info=[{"id": "c762a745-51d7-4d4e-bdc5-c962aec66b02", "address": "fa:16:3e:80:3b:b9", "network": {"id": "4205f899-9865-4c65-8b46-c9a533e9bb45", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-774780781-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d59b73851c79473a9c2cdc0a120dfee0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc762a745-51", "ovs_interfaceid": "c762a745-51d7-4d4e-bdc5-c962aec66b02", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'device_type': 'disk', 'attachment_id': '4d370013-bb7e-4d03-84b7-1a664d7d029a', 'guest_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:dcbd911e-f385-4ed6-b8a4-383b3b56cf7d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vcbhzLqi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'df16d913-9985-415f-aedc-14f2ca5bcf13', 'attached_at': '', 'detached_at': '', 'volume_id': 'dcbd911e-f385-4ed6-b8a4-383b3b56cf7d', 'serial': 'dcbd911e-f385-4ed6-b8a4-383b3b56cf7d'}, 'volume_type': None} {{(pid=75045) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 23:55:31 user nova-compute[75045]: WARNING nova.virt.libvirt.driver [None req-af167af0-1115-4146-a74e-887c5bfb5362 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 23:55:31 user nova-compute[75045]: WARNING nova.virt.libvirt.driver [None req-af167af0-1115-4146-a74e-887c5bfb5362 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 23:55:31 user nova-compute[75045]: DEBUG nova.virt.libvirt.host [None req-af167af0-1115-4146-a74e-887c5bfb5362 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75045) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 23:55:31 user nova-compute[75045]: DEBUG nova.virt.libvirt.host [None req-af167af0-1115-4146-a74e-887c5bfb5362 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] CPU controller missing on host. {{(pid=75045) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 23:55:31 user nova-compute[75045]: DEBUG nova.virt.libvirt.host [None req-af167af0-1115-4146-a74e-887c5bfb5362 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75045) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 23:55:31 user nova-compute[75045]: DEBUG nova.virt.libvirt.host [None req-af167af0-1115-4146-a74e-887c5bfb5362 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] CPU controller found on host. {{(pid=75045) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 23:55:31 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-af167af0-1115-4146-a74e-887c5bfb5362 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75045) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 23:55:31 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-af167af0-1115-4146-a74e-887c5bfb5362 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T23:11:41Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75045) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 23:55:31 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-af167af0-1115-4146-a74e-887c5bfb5362 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Flavor limits 0:0:0 {{(pid=75045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 23:55:31 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-af167af0-1115-4146-a74e-887c5bfb5362 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Image limits 0:0:0 {{(pid=75045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 23:55:31 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-af167af0-1115-4146-a74e-887c5bfb5362 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Flavor pref 0:0:0 {{(pid=75045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 23:55:31 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-af167af0-1115-4146-a74e-887c5bfb5362 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Image pref 0:0:0 {{(pid=75045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 23:55:31 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-af167af0-1115-4146-a74e-887c5bfb5362 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 23:55:31 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-af167af0-1115-4146-a74e-887c5bfb5362 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75045) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 23:55:31 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-af167af0-1115-4146-a74e-887c5bfb5362 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75045) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 23:55:31 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-af167af0-1115-4146-a74e-887c5bfb5362 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Got 1 possible topologies {{(pid=75045) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 23:55:31 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-af167af0-1115-4146-a74e-887c5bfb5362 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75045) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 23:55:31 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-af167af0-1115-4146-a74e-887c5bfb5362 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75045) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 23:55:31 user nova-compute[75045]: DEBUG nova.virt.libvirt.volume.iscsi [None req-af167af0-1115-4146-a74e-887c5bfb5362 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] [instance: df16d913-9985-415f-aedc-14f2ca5bcf13] Calling os-brick to attach iSCSI Volume {{(pid=75045) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 23:55:31 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-af167af0-1115-4146-a74e-887c5bfb5362 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1b68210460>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:dcbd911e-f385-4ed6-b8a4-383b3b56cf7d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vcbhzLqi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75045) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 23:55:31 user nova-compute[75045]: WARNING os_brick.initiator.connectors.base [None req-af167af0-1115-4146-a74e-887c5bfb5362 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 23:55:31 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-af167af0-1115-4146-a74e-887c5bfb5362 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 23:55:31 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-af167af0-1115-4146-a74e-887c5bfb5362 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 23:55:31 user nova-compute[75045]: WARNING os_brick.initiator.connectors.base [None req-af167af0-1115-4146-a74e-887c5bfb5362 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 23:55:31 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-af167af0-1115-4146-a74e-887c5bfb5362 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dcbd911e-f385-4ed6-b8a4-383b3b56cf7d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 23:55:31 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-af167af0-1115-4146-a74e-887c5bfb5362 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dcbd911e-f385-4ed6-b8a4-383b3b56cf7d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 23:55:31 user nova-compute[75045]: INFO os_brick.initiator.connectors.iscsi [None req-af167af0-1115-4146-a74e-887c5bfb5362 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 23:55:31 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dcbd911e-f385-4ed6-b8a4-383b3b56cf7d -p 172.16.0.220:3260 {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:55:31 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dcbd911e-f385-4ed6-b8a4-383b3b56cf7d -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:55:31 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ec1b009-ddf6-41d7-92e4-bfc37f4746a1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:55:31 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-af167af0-1115-4146-a74e-887c5bfb5362 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 23:55:31 user nova-compute[75045]:  {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:55:31 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dcbd911e-f385-4ed6-b8a4-383b3b56cf7d -p 172.16.0.220:3260 --interface default --op new {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:55:31 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dcbd911e-f385-4ed6-b8a4-383b3b56cf7d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:55:31 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[77d52442-ad55-4acf-aff5-f3dd4276135a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:dcbd911e-f385-4ed6-b8a4-383b3b56cf7d] added\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:55:31 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-af167af0-1115-4146-a74e-887c5bfb5362 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:dcbd911e-f385-4ed6-b8a4-383b3b56cf7d] added
Nov 08 23:55:31 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:55:31 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dcbd911e-f385-4ed6-b8a4-383b3b56cf7d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:55:31 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dcbd911e-f385-4ed6-b8a4-383b3b56cf7d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:55:31 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[c51e7af7-a56c-484d-8e48-3bd577a7ae3e]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:55:31 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-af167af0-1115-4146-a74e-887c5bfb5362 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:55:31 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dcbd911e-f385-4ed6-b8a4-383b3b56cf7d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:55:31 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dcbd911e-f385-4ed6-b8a4-383b3b56cf7d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:55:31 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c161831-b70e-44bf-8cfc-621b94e79cd0]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:55:31 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-af167af0-1115-4146-a74e-887c5bfb5362 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:55:31 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dcbd911e-f385-4ed6-b8a4-383b3b56cf7d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vcbhzLqi {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:55:31 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dcbd911e-f385-4ed6-b8a4-383b3b56cf7d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vcbhzLqi" returned: 0 in 0.018s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:55:31 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d977f49-8be7-4171-8482-bbef5e81b3cc]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:55:31 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-af167af0-1115-4146-a74e-887c5bfb5362 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'vcbhzLqi'): stdout= stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:55:31 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dcbd911e-f385-4ed6-b8a4-383b3b56cf7d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:55:31 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dcbd911e-f385-4ed6-b8a4-383b3b56cf7d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.029s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:55:31 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cc66327-73c5-496b-a1b5-4a7f19452402]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:55:31 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-af167af0-1115-4146-a74e-887c5bfb5362 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:55:31 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:55:31 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:55:31 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4ae0e9b-1e0a-4d6a-98ed-2e299b4d9035]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c632bc58-d20b-46e4-9d9d-316f17f3ea43 (non-flash)\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:55:31 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-af167af0-1115-4146-a74e-887c5bfb5362 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c632bc58-d20b-46e4-9d9d-316f17f3ea43 (non-flash)
Nov 08 23:55:31 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 23:55:31 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-af167af0-1115-4146-a74e-887c5bfb5362 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c632bc58-d20b-46e4-9d9d-316f17f3ea43 (non-flash)
Nov 08 23:55:31 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 23:55:31 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dcbd911e-f385-4ed6-b8a4-383b3b56cf7d -p 172.16.0.220:3260 --login {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:55:32 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dcbd911e-f385-4ed6-b8a4-383b3b56cf7d -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:55:32 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2ac7572-1fbc-463e-967e-4d4638827a3a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:dcbd911e-f385-4ed6-b8a4-383b3b56cf7d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:dcbd911e-f385-4ed6-b8a4-383b3b56cf7d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:55:32 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-af167af0-1115-4146-a74e-887c5bfb5362 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:dcbd911e-f385-4ed6-b8a4-383b3b56cf7d, portal: 172.16.0.220,3260]
Nov 08 23:55:32 user nova-compute[75045]: Login to [iface: default, target: iqn.2010-10.org.openstack:dcbd911e-f385-4ed6-b8a4-383b3b56cf7d, portal: 172.16.0.220,3260] successful.
Nov 08 23:55:32 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:55:32 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dcbd911e-f385-4ed6-b8a4-383b3b56cf7d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:55:32 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dcbd911e-f385-4ed6-b8a4-383b3b56cf7d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:55:32 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0a38b56-9f4a-4c9b-8e13-3407ec2786a4]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:55:32 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-af167af0-1115-4146-a74e-887c5bfb5362 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:55:32 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:55:32 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:55:32 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[28cd6f9e-8dc5-46f5-abac-62728d4bb492]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c632bc58-d20b-46e4-9d9d-316f17f3ea43 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcbd911e-f385-4ed6-b8a4-383b3b56cf7d (non-flash)\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:55:32 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-af167af0-1115-4146-a74e-887c5bfb5362 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c632bc58-d20b-46e4-9d9d-316f17f3ea43 (non-flash)
Nov 08 23:55:32 user nova-compute[75045]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcbd911e-f385-4ed6-b8a4-383b3b56cf7d (non-flash)
Nov 08 23:55:32 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 23:55:32 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-af167af0-1115-4146-a74e-887c5bfb5362 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c632bc58-d20b-46e4-9d9d-316f17f3ea43 (non-flash)
Nov 08 23:55:32 user nova-compute[75045]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcbd911e-f385-4ed6-b8a4-383b3b56cf7d (non-flash)
Nov 08 23:55:32 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 23:55:32 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-af167af0-1115-4146-a74e-887c5bfb5362 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dcbd911e-f385-4ed6-b8a4-383b3b56cf7d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.292s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 23:55:32 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-af167af0-1115-4146-a74e-887c5bfb5362 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Connected to 172.16.0.220:3260 {{(pid=75045) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 23:55:32 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-af167af0-1115-4146-a74e-887c5bfb5362 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] HCTL ('34', '-', '-', 0) found on session 51 with lun 0 {{(pid=75045) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 23:55:32 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-af167af0-1115-4146-a74e-887c5bfb5362 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75045) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 23:55:32 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:55:32 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.024s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:55:32 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[3becec51-fd5c-4d69-b884-6d11645f193d]: (4, ('- - 0', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:55:32 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-af167af0-1115-4146-a74e-887c5bfb5362 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Searching for a device in session 51 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75045) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 23:55:32 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-af167af0-1115-4146-a74e-887c5bfb5362 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:dcbd911e-f385-4ed6-b8a4-383b3b56cf7d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vcbhzLqi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75045) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 23:55:33 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-af167af0-1115-4146-a74e-887c5bfb5362 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.341s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 23:55:33 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-af167af0-1115-4146-a74e-887c5bfb5362 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] <== connect_volume: return (1343ms) {'type': 'block', 'scsi_wwn': '26139353836656237', 'path': '/dev/sdc'} {{(pid=75045) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 23:55:33 user nova-compute[75045]: DEBUG nova.virt.libvirt.volume.iscsi [None req-af167af0-1115-4146-a74e-887c5bfb5362 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] [instance: df16d913-9985-415f-aedc-14f2ca5bcf13] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26139353836656237', 'path': '/dev/sdc'} {{(pid=75045) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 23:55:33 user nova-compute[75045]: DEBUG nova.virt.libvirt.vif [None req-af167af0-1115-4146-a74e-887c5bfb5362 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T23:54:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1514794373',display_name='tempest-TestVolumeBootPattern-server-1514794373',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1514794373',id=50,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG4FMrZDNuVfIPnXfxN4nyoUo/5k5pInfzFUTQXcG54GN3K7TKcBDzRT7RSwNm2HHReK/sg/U9LFWtj081VW6fTpNzjBNfOxhMg0DqXN9g7DbQBYyYNAjTBN+tAvF+1fCA==',key_name='tempest-TestVolumeBootPattern-1614211608',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d59b73851c79473a9c2cdc0a120dfee0',ramdisk_id='',reservation_id='r-00v3iqx0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-650796844',owner_user_name='tempest-TestVolumeBootPattern-650796844-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T23:55:01Z,user_data=None,user_id='76c31c64d9594f9cbef7586fafb48721',uuid=df16d913-9985-415f-aedc-14f2ca5bcf13,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c762a745-51d7-4d4e-bdc5-c962aec66b02", "address": "fa:16:3e:80:3b:b9", "network": {"id": "4205f899-9865-4c65-8b46-c9a533e9bb45", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-774780781-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d59b73851c79473a9c2cdc0a120dfee0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc762a745-51", "ovs_interfaceid": "c762a745-51d7-4d4e-bdc5-c962aec66b02", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75045) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 23:55:33 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-af167af0-1115-4146-a74e-887c5bfb5362 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Converting VIF {"id": "c762a745-51d7-4d4e-bdc5-c962aec66b02", "address": "fa:16:3e:80:3b:b9", "network": {"id": "4205f899-9865-4c65-8b46-c9a533e9bb45", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-774780781-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d59b73851c79473a9c2cdc0a120dfee0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc762a745-51", "ovs_interfaceid": "c762a745-51d7-4d4e-bdc5-c962aec66b02", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 23:55:33 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-af167af0-1115-4146-a74e-887c5bfb5362 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:80:3b:b9,bridge_name='br-int',has_traffic_filtering=True,id=c762a745-51d7-4d4e-bdc5-c962aec66b02,network=Network(4205f899-9865-4c65-8b46-c9a533e9bb45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc762a745-51') {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 23:55:33 user nova-compute[75045]: DEBUG nova.objects.instance [None req-af167af0-1115-4146-a74e-887c5bfb5362 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Lazy-loading 'pci_devices' on Instance uuid df16d913-9985-415f-aedc-14f2ca5bcf13 {{(pid=75045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 23:55:33 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-af167af0-1115-4146-a74e-887c5bfb5362 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] [instance: df16d913-9985-415f-aedc-14f2ca5bcf13] End _get_guest_xml xml=<domain type="kvm">
Nov 08 23:55:33 user nova-compute[75045]:   <uuid>df16d913-9985-415f-aedc-14f2ca5bcf13</uuid>
Nov 08 23:55:33 user nova-compute[75045]:   <name>instance-00000032</name>
Nov 08 23:55:33 user nova-compute[75045]:   <memory>524288</memory>
Nov 08 23:55:33 user nova-compute[75045]:   <vcpu>1</vcpu>
Nov 08 23:55:33 user nova-compute[75045]:   <metadata>
Nov 08 23:55:33 user nova-compute[75045]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 23:55:33 user nova-compute[75045]:       <nova:package version="0.0.0"/>
Nov 08 23:55:33 user nova-compute[75045]:       <nova:name>tempest-TestVolumeBootPattern-server-1514794373</nova:name>
Nov 08 23:55:33 user nova-compute[75045]:       <nova:creationTime>2023-11-08 23:55:31</nova:creationTime>
Nov 08 23:55:33 user nova-compute[75045]:       <nova:flavor name="m1.tiny">
Nov 08 23:55:33 user nova-compute[75045]:         <nova:memory>512</nova:memory>
Nov 08 23:55:33 user nova-compute[75045]:         <nova:disk>1</nova:disk>
Nov 08 23:55:33 user nova-compute[75045]:         <nova:swap>0</nova:swap>
Nov 08 23:55:33 user nova-compute[75045]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 23:55:33 user nova-compute[75045]:         <nova:vcpus>1</nova:vcpus>
Nov 08 23:55:33 user nova-compute[75045]:       </nova:flavor>
Nov 08 23:55:33 user nova-compute[75045]:       <nova:owner>
Nov 08 23:55:33 user nova-compute[75045]:         <nova:user uuid="76c31c64d9594f9cbef7586fafb48721">tempest-TestVolumeBootPattern-650796844-project-member</nova:user>
Nov 08 23:55:33 user nova-compute[75045]:         <nova:project uuid="d59b73851c79473a9c2cdc0a120dfee0">tempest-TestVolumeBootPattern-650796844</nova:project>
Nov 08 23:55:33 user nova-compute[75045]:       </nova:owner>
Nov 08 23:55:33 user nova-compute[75045]:       <nova:ports>
Nov 08 23:55:33 user nova-compute[75045]:         <nova:port uuid="c762a745-51d7-4d4e-bdc5-c962aec66b02">
Nov 08 23:55:33 user nova-compute[75045]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 08 23:55:33 user nova-compute[75045]:         </nova:port>
Nov 08 23:55:33 user nova-compute[75045]:       </nova:ports>
Nov 08 23:55:33 user nova-compute[75045]:     </nova:instance>
Nov 08 23:55:33 user nova-compute[75045]:   </metadata>
Nov 08 23:55:33 user nova-compute[75045]:   <sysinfo type="smbios">
Nov 08 23:55:33 user nova-compute[75045]:     <system>
Nov 08 23:55:33 user nova-compute[75045]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 23:55:33 user nova-compute[75045]:       <entry name="product">OpenStack Nova</entry>
Nov 08 23:55:33 user nova-compute[75045]:       <entry name="version">0.0.0</entry>
Nov 08 23:55:33 user nova-compute[75045]:       <entry name="serial">df16d913-9985-415f-aedc-14f2ca5bcf13</entry>
Nov 08 23:55:33 user nova-compute[75045]:       <entry name="uuid">df16d913-9985-415f-aedc-14f2ca5bcf13</entry>
Nov 08 23:55:33 user nova-compute[75045]:       <entry name="family">Virtual Machine</entry>
Nov 08 23:55:33 user nova-compute[75045]:     </system>
Nov 08 23:55:33 user nova-compute[75045]:   </sysinfo>
Nov 08 23:55:33 user nova-compute[75045]:   <os>
Nov 08 23:55:33 user nova-compute[75045]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 23:55:33 user nova-compute[75045]:     <boot dev="hd"/>
Nov 08 23:55:33 user nova-compute[75045]:     <smbios mode="sysinfo"/>
Nov 08 23:55:33 user nova-compute[75045]:   </os>
Nov 08 23:55:33 user nova-compute[75045]:   <features>
Nov 08 23:55:33 user nova-compute[75045]:     <acpi/>
Nov 08 23:55:33 user nova-compute[75045]:     <apic/>
Nov 08 23:55:33 user nova-compute[75045]:     <vmcoreinfo/>
Nov 08 23:55:33 user nova-compute[75045]:   </features>
Nov 08 23:55:33 user nova-compute[75045]:   <clock offset="utc">
Nov 08 23:55:33 user nova-compute[75045]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 23:55:33 user nova-compute[75045]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 23:55:33 user nova-compute[75045]:     <timer name="hpet" present="no"/>
Nov 08 23:55:33 user nova-compute[75045]:   </clock>
Nov 08 23:55:33 user nova-compute[75045]:   <cpu mode="custom" match="exact">
Nov 08 23:55:33 user nova-compute[75045]:     <model>Nehalem</model>
Nov 08 23:55:33 user nova-compute[75045]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 23:55:33 user nova-compute[75045]:   </cpu>
Nov 08 23:55:33 user nova-compute[75045]:   <devices>
Nov 08 23:55:33 user nova-compute[75045]:     <disk type="block" device="disk">
Nov 08 23:55:33 user nova-compute[75045]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 23:55:33 user nova-compute[75045]:       <source dev="/dev/sdc"/>
Nov 08 23:55:33 user nova-compute[75045]:       <target dev="vda" bus="virtio"/>
Nov 08 23:55:33 user nova-compute[75045]:       <serial>dcbd911e-f385-4ed6-b8a4-383b3b56cf7d</serial>
Nov 08 23:55:33 user nova-compute[75045]:     </disk>
Nov 08 23:55:33 user nova-compute[75045]:     <interface type="ethernet">
Nov 08 23:55:33 user nova-compute[75045]:       <mac address="fa:16:3e:80:3b:b9"/>
Nov 08 23:55:33 user nova-compute[75045]:       <model type="virtio"/>
Nov 08 23:55:33 user nova-compute[75045]:       <mtu size="1442"/>
Nov 08 23:55:33 user nova-compute[75045]:       <target dev="tapc762a745-51"/>
Nov 08 23:55:33 user nova-compute[75045]:     </interface>
Nov 08 23:55:33 user nova-compute[75045]:     <serial type="pty">
Nov 08 23:55:33 user nova-compute[75045]:       <log file="/opt/stack/data/nova/instances/df16d913-9985-415f-aedc-14f2ca5bcf13/console.log" append="off"/>
Nov 08 23:55:33 user nova-compute[75045]:     </serial>
Nov 08 23:55:33 user nova-compute[75045]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 23:55:33 user nova-compute[75045]:     <video>
Nov 08 23:55:33 user nova-compute[75045]:       <model type="virtio"/>
Nov 08 23:55:33 user nova-compute[75045]:     </video>
Nov 08 23:55:33 user nova-compute[75045]:     <rng model="virtio">
Nov 08 23:55:33 user nova-compute[75045]:       <backend model="random">/dev/urandom</backend>
Nov 08 23:55:33 user nova-compute[75045]:     </rng>
Nov 08 23:55:33 user nova-compute[75045]:     <controller type="usb" index="0" model="none"/>
Nov 08 23:55:33 user nova-compute[75045]:     <memballoon model="virtio">
Nov 08 23:55:33 user nova-compute[75045]:       <stats period="10"/>
Nov 08 23:55:33 user nova-compute[75045]:     </memballoon>
Nov 08 23:55:33 user nova-compute[75045]:   </devices>
Nov 08 23:55:33 user nova-compute[75045]: </domain>
Nov 08 23:55:33 user nova-compute[75045]:  {{(pid=75045) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 23:55:33 user nova-compute[75045]: DEBUG nova.virt.libvirt.vif [None req-af167af0-1115-4146-a74e-887c5bfb5362 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T23:54:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1514794373',display_name='tempest-TestVolumeBootPattern-server-1514794373',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1514794373',id=50,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG4FMrZDNuVfIPnXfxN4nyoUo/5k5pInfzFUTQXcG54GN3K7TKcBDzRT7RSwNm2HHReK/sg/U9LFWtj081VW6fTpNzjBNfOxhMg0DqXN9g7DbQBYyYNAjTBN+tAvF+1fCA==',key_name='tempest-TestVolumeBootPattern-1614211608',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d59b73851c79473a9c2cdc0a120dfee0',ramdisk_id='',reservation_id='r-00v3iqx0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-650796844',owner_user_name='tempest-TestVolumeBootPattern-650796844-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T23:55:01Z,user_data=None,user_id='76c31c64d9594f9cbef7586fafb48721',uuid=df16d913-9985-415f-aedc-14f2ca5bcf13,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c762a745-51d7-4d4e-bdc5-c962aec66b02", "address": "fa:16:3e:80:3b:b9", "network": {"id": "4205f899-9865-4c65-8b46-c9a533e9bb45", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-774780781-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d59b73851c79473a9c2cdc0a120dfee0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc762a745-51", "ovs_interfaceid": "c762a745-51d7-4d4e-bdc5-c962aec66b02", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75045) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 23:55:33 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-af167af0-1115-4146-a74e-887c5bfb5362 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Converting VIF {"id": "c762a745-51d7-4d4e-bdc5-c962aec66b02", "address": "fa:16:3e:80:3b:b9", "network": {"id": "4205f899-9865-4c65-8b46-c9a533e9bb45", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-774780781-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d59b73851c79473a9c2cdc0a120dfee0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc762a745-51", "ovs_interfaceid": "c762a745-51d7-4d4e-bdc5-c962aec66b02", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 23:55:33 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-af167af0-1115-4146-a74e-887c5bfb5362 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:80:3b:b9,bridge_name='br-int',has_traffic_filtering=True,id=c762a745-51d7-4d4e-bdc5-c962aec66b02,network=Network(4205f899-9865-4c65-8b46-c9a533e9bb45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc762a745-51') {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 23:55:33 user nova-compute[75045]: DEBUG os_vif [None req-af167af0-1115-4146-a74e-887c5bfb5362 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:80:3b:b9,bridge_name='br-int',has_traffic_filtering=True,id=c762a745-51d7-4d4e-bdc5-c962aec66b02,network=Network(4205f899-9865-4c65-8b46-c9a533e9bb45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc762a745-51') {{(pid=75045) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 23:55:33 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:55:33 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:55:33 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 23:55:33 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:55:33 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4294bee0-1060-5ea2-abc7-1332f3a9ca71', '_type': 'linux-noop'}}, row=False) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:55:33 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:55:33 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 23:55:33 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:55:33 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc762a745-51, may_exist=True, interface_attrs={}) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:55:33 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc762a745-51, col_values=(('qos', UUID('bfbeb5aa-fd90-4398-8053-5fdfcf11ee5b')),), if_exists=True) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:55:33 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc762a745-51, col_values=(('external_ids', {'iface-id': 'c762a745-51d7-4d4e-bdc5-c962aec66b02', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:80:3b:b9', 'vm-uuid': 'df16d913-9985-415f-aedc-14f2ca5bcf13'}),), if_exists=True) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:55:33 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:55:33 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 23:55:33 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:55:33 user nova-compute[75045]: INFO os_vif [None req-af167af0-1115-4146-a74e-887c5bfb5362 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:80:3b:b9,bridge_name='br-int',has_traffic_filtering=True,id=c762a745-51d7-4d4e-bdc5-c962aec66b02,network=Network(4205f899-9865-4c65-8b46-c9a533e9bb45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc762a745-51')
Nov 08 23:55:33 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-af167af0-1115-4146-a74e-887c5bfb5362 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] No BDM found with device name vda, not building metadata. {{(pid=75045) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 23:55:33 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-af167af0-1115-4146-a74e-887c5bfb5362 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] No VIF found with MAC fa:16:3e:80:3b:b9, not building metadata {{(pid=75045) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 23:55:34 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:55:34 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:55:34 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:55:34 user nova-compute[75045]: DEBUG nova.compute.manager [req-98dcd2e1-2fd0-4591-83ed-c9a0e98e39e6 req-b45d9c33-d46a-4837-972b-cbe545fe735c service nova] [instance: df16d913-9985-415f-aedc-14f2ca5bcf13] Received event network-vif-plugged-c762a745-51d7-4d4e-bdc5-c962aec66b02 {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:55:34 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-98dcd2e1-2fd0-4591-83ed-c9a0e98e39e6 req-b45d9c33-d46a-4837-972b-cbe545fe735c service nova] Acquiring lock "df16d913-9985-415f-aedc-14f2ca5bcf13-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:55:34 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-98dcd2e1-2fd0-4591-83ed-c9a0e98e39e6 req-b45d9c33-d46a-4837-972b-cbe545fe735c service nova] Lock "df16d913-9985-415f-aedc-14f2ca5bcf13-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:55:34 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-98dcd2e1-2fd0-4591-83ed-c9a0e98e39e6 req-b45d9c33-d46a-4837-972b-cbe545fe735c service nova] Lock "df16d913-9985-415f-aedc-14f2ca5bcf13-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:55:34 user nova-compute[75045]: DEBUG nova.compute.manager [req-98dcd2e1-2fd0-4591-83ed-c9a0e98e39e6 req-b45d9c33-d46a-4837-972b-cbe545fe735c service nova] [instance: df16d913-9985-415f-aedc-14f2ca5bcf13] No waiting events found dispatching network-vif-plugged-c762a745-51d7-4d4e-bdc5-c962aec66b02 {{(pid=75045) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 23:55:34 user nova-compute[75045]: WARNING nova.compute.manager [req-98dcd2e1-2fd0-4591-83ed-c9a0e98e39e6 req-b45d9c33-d46a-4837-972b-cbe545fe735c service nova] [instance: df16d913-9985-415f-aedc-14f2ca5bcf13] Received unexpected event network-vif-plugged-c762a745-51d7-4d4e-bdc5-c962aec66b02 for instance with vm_state building and task_state spawning.
Nov 08 23:55:35 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:55:35 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:55:35 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:55:36 user nova-compute[75045]: DEBUG nova.compute.manager [None req-af167af0-1115-4146-a74e-887c5bfb5362 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] [instance: df16d913-9985-415f-aedc-14f2ca5bcf13] Instance event wait completed in 0 seconds for  {{(pid=75045) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 23:55:36 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-af167af0-1115-4146-a74e-887c5bfb5362 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] [instance: df16d913-9985-415f-aedc-14f2ca5bcf13] Guest created on hypervisor {{(pid=75045) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 23:55:36 user nova-compute[75045]: INFO nova.virt.libvirt.driver [-] [instance: df16d913-9985-415f-aedc-14f2ca5bcf13] Instance spawned successfully.
Nov 08 23:55:36 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-af167af0-1115-4146-a74e-887c5bfb5362 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] [instance: df16d913-9985-415f-aedc-14f2ca5bcf13] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75045) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 23:55:36 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-af167af0-1115-4146-a74e-887c5bfb5362 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] [instance: df16d913-9985-415f-aedc-14f2ca5bcf13] Found default for hw_cdrom_bus of ide {{(pid=75045) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 23:55:36 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-af167af0-1115-4146-a74e-887c5bfb5362 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] [instance: df16d913-9985-415f-aedc-14f2ca5bcf13] Found default for hw_disk_bus of virtio {{(pid=75045) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 23:55:36 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-af167af0-1115-4146-a74e-887c5bfb5362 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] [instance: df16d913-9985-415f-aedc-14f2ca5bcf13] Found default for hw_input_bus of None {{(pid=75045) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 23:55:36 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-af167af0-1115-4146-a74e-887c5bfb5362 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] [instance: df16d913-9985-415f-aedc-14f2ca5bcf13] Found default for hw_pointer_model of None {{(pid=75045) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 23:55:36 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-af167af0-1115-4146-a74e-887c5bfb5362 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] [instance: df16d913-9985-415f-aedc-14f2ca5bcf13] Found default for hw_video_model of virtio {{(pid=75045) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 23:55:36 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-af167af0-1115-4146-a74e-887c5bfb5362 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] [instance: df16d913-9985-415f-aedc-14f2ca5bcf13] Found default for hw_vif_model of virtio {{(pid=75045) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 23:55:36 user nova-compute[75045]: DEBUG nova.compute.manager [req-7a511ebe-5135-417f-93db-8d59d027fd51 req-b7ae4d4f-e609-4d3a-9c42-8ab969734493 service nova] [instance: df16d913-9985-415f-aedc-14f2ca5bcf13] Received event network-vif-plugged-c762a745-51d7-4d4e-bdc5-c962aec66b02 {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:55:36 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-7a511ebe-5135-417f-93db-8d59d027fd51 req-b7ae4d4f-e609-4d3a-9c42-8ab969734493 service nova] Acquiring lock "df16d913-9985-415f-aedc-14f2ca5bcf13-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:55:36 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-7a511ebe-5135-417f-93db-8d59d027fd51 req-b7ae4d4f-e609-4d3a-9c42-8ab969734493 service nova] Lock "df16d913-9985-415f-aedc-14f2ca5bcf13-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:55:36 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-7a511ebe-5135-417f-93db-8d59d027fd51 req-b7ae4d4f-e609-4d3a-9c42-8ab969734493 service nova] Lock "df16d913-9985-415f-aedc-14f2ca5bcf13-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:55:36 user nova-compute[75045]: DEBUG nova.compute.manager [req-7a511ebe-5135-417f-93db-8d59d027fd51 req-b7ae4d4f-e609-4d3a-9c42-8ab969734493 service nova] [instance: df16d913-9985-415f-aedc-14f2ca5bcf13] No waiting events found dispatching network-vif-plugged-c762a745-51d7-4d4e-bdc5-c962aec66b02 {{(pid=75045) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 23:55:36 user nova-compute[75045]: WARNING nova.compute.manager [req-7a511ebe-5135-417f-93db-8d59d027fd51 req-b7ae4d4f-e609-4d3a-9c42-8ab969734493 service nova] [instance: df16d913-9985-415f-aedc-14f2ca5bcf13] Received unexpected event network-vif-plugged-c762a745-51d7-4d4e-bdc5-c962aec66b02 for instance with vm_state building and task_state spawning.
Nov 08 23:55:36 user nova-compute[75045]: INFO nova.compute.manager [None req-af167af0-1115-4146-a74e-887c5bfb5362 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] [instance: df16d913-9985-415f-aedc-14f2ca5bcf13] Took 5.30 seconds to spawn the instance on the hypervisor.
Nov 08 23:55:36 user nova-compute[75045]: DEBUG nova.compute.manager [None req-af167af0-1115-4146-a74e-887c5bfb5362 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] [instance: df16d913-9985-415f-aedc-14f2ca5bcf13] Checking state {{(pid=75045) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 23:55:37 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:55:37 user nova-compute[75045]: INFO nova.compute.manager [None req-af167af0-1115-4146-a74e-887c5bfb5362 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] [instance: df16d913-9985-415f-aedc-14f2ca5bcf13] Took 36.76 seconds to build instance.
Nov 08 23:55:37 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-af167af0-1115-4146-a74e-887c5bfb5362 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Lock "df16d913-9985-415f-aedc-14f2ca5bcf13" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 36.909s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:55:38 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:55:42 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:55:43 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:55:47 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:55:47 user nova-compute[75045]: DEBUG nova.virt.libvirt.volume.iscsi [None req-db11b9bb-1244-4012-bbdd-53a3a5fe55d6 tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] [instance: a19b6a96-340f-488e-af81-853ee56bf30f] Calling os-brick to attach iSCSI Volume {{(pid=75045) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 23:55:47 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-db11b9bb-1244-4012-bbdd-53a3a5fe55d6 tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1b68210460>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:8cde2eb2-d792-44e3-9a37-b04543d41bda', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'krJhGgoS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75045) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 23:55:47 user nova-compute[75045]: WARNING os_brick.initiator.connectors.base [None req-db11b9bb-1244-4012-bbdd-53a3a5fe55d6 tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 23:55:47 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-db11b9bb-1244-4012-bbdd-53a3a5fe55d6 tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 23:55:47 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-db11b9bb-1244-4012-bbdd-53a3a5fe55d6 tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 23:55:47 user nova-compute[75045]: WARNING os_brick.initiator.connectors.base [None req-db11b9bb-1244-4012-bbdd-53a3a5fe55d6 tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 23:55:47 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-db11b9bb-1244-4012-bbdd-53a3a5fe55d6 tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8cde2eb2-d792-44e3-9a37-b04543d41bda" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 23:55:47 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-db11b9bb-1244-4012-bbdd-53a3a5fe55d6 tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8cde2eb2-d792-44e3-9a37-b04543d41bda" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 23:55:47 user nova-compute[75045]: INFO os_brick.initiator.connectors.iscsi [None req-db11b9bb-1244-4012-bbdd-53a3a5fe55d6 tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 23:55:47 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8cde2eb2-d792-44e3-9a37-b04543d41bda -p 172.16.0.220:3260 {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:55:47 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8cde2eb2-d792-44e3-9a37-b04543d41bda -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:55:47 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[326ede9a-9089-48a0-90ae-e6dabe6af290]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:55:47 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-db11b9bb-1244-4012-bbdd-53a3a5fe55d6 tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 23:55:47 user nova-compute[75045]:  {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:55:47 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8cde2eb2-d792-44e3-9a37-b04543d41bda -p 172.16.0.220:3260 --interface default --op new {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:55:47 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8cde2eb2-d792-44e3-9a37-b04543d41bda -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:55:47 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[e31a21d1-ebb4-415a-8e82-e980a23a40cc]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8cde2eb2-d792-44e3-9a37-b04543d41bda] added\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:55:47 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-db11b9bb-1244-4012-bbdd-53a3a5fe55d6 tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8cde2eb2-d792-44e3-9a37-b04543d41bda] added
Nov 08 23:55:47 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:55:47 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8cde2eb2-d792-44e3-9a37-b04543d41bda -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:55:47 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8cde2eb2-d792-44e3-9a37-b04543d41bda -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.062s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:55:47 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2f88513-55ac-48df-9cba-2e922e658190]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:55:47 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-db11b9bb-1244-4012-bbdd-53a3a5fe55d6 tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:55:47 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8cde2eb2-d792-44e3-9a37-b04543d41bda -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:55:47 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8cde2eb2-d792-44e3-9a37-b04543d41bda -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:55:47 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[0435a6fd-6a03-436b-8631-08d3db9a98b2]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:55:47 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-db11b9bb-1244-4012-bbdd-53a3a5fe55d6 tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:55:47 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8cde2eb2-d792-44e3-9a37-b04543d41bda -p 172.16.0.220:3260 --op update -n node.session.auth.username -v krJhGgoS {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:55:47 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8cde2eb2-d792-44e3-9a37-b04543d41bda -p 172.16.0.220:3260 --op update -n node.session.auth.username -v krJhGgoS" returned: 0 in 0.019s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:55:47 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[c197297d-2cfb-41ff-8b67-cdf20fb07e0e]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:55:47 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-db11b9bb-1244-4012-bbdd-53a3a5fe55d6 tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'krJhGgoS'): stdout= stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:55:47 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8cde2eb2-d792-44e3-9a37-b04543d41bda -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:55:47 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8cde2eb2-d792-44e3-9a37-b04543d41bda -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:55:47 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[08108740-046c-42ca-add8-e192d7251982]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:55:47 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-db11b9bb-1244-4012-bbdd-53a3a5fe55d6 tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:55:47 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:55:47 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:55:47 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[76439193-a564-4533-b365-805357acd898]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c632bc58-d20b-46e4-9d9d-316f17f3ea43 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcbd911e-f385-4ed6-b8a4-383b3b56cf7d (non-flash)\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:55:47 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-db11b9bb-1244-4012-bbdd-53a3a5fe55d6 tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c632bc58-d20b-46e4-9d9d-316f17f3ea43 (non-flash)
Nov 08 23:55:47 user nova-compute[75045]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcbd911e-f385-4ed6-b8a4-383b3b56cf7d (non-flash)
Nov 08 23:55:47 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 23:55:47 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-db11b9bb-1244-4012-bbdd-53a3a5fe55d6 tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c632bc58-d20b-46e4-9d9d-316f17f3ea43 (non-flash)
Nov 08 23:55:47 user nova-compute[75045]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcbd911e-f385-4ed6-b8a4-383b3b56cf7d (non-flash)
Nov 08 23:55:47 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 23:55:47 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8cde2eb2-d792-44e3-9a37-b04543d41bda -p 172.16.0.220:3260 --login {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:55:47 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8cde2eb2-d792-44e3-9a37-b04543d41bda -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:55:47 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc143f08-9e0a-4cf2-b448-2c2c292ccdf0]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8cde2eb2-d792-44e3-9a37-b04543d41bda, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8cde2eb2-d792-44e3-9a37-b04543d41bda, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:55:47 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-db11b9bb-1244-4012-bbdd-53a3a5fe55d6 tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8cde2eb2-d792-44e3-9a37-b04543d41bda, portal: 172.16.0.220,3260]
Nov 08 23:55:47 user nova-compute[75045]: Login to [iface: default, target: iqn.2010-10.org.openstack:8cde2eb2-d792-44e3-9a37-b04543d41bda, portal: 172.16.0.220,3260] successful.
Nov 08 23:55:47 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:55:47 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8cde2eb2-d792-44e3-9a37-b04543d41bda -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:55:47 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8cde2eb2-d792-44e3-9a37-b04543d41bda -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:55:47 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[62aa6f9e-067d-4421-8e78-30d2a9be4ad2]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:55:47 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-db11b9bb-1244-4012-bbdd-53a3a5fe55d6 tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:55:47 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:55:47 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:55:47 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[39057bc0-508d-4525-b846-84e6bd3844ed]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c632bc58-d20b-46e4-9d9d-316f17f3ea43 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcbd911e-f385-4ed6-b8a4-383b3b56cf7d (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cde2eb2-d792-44e3-9a37-b04543d41bda (non-flash)\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:55:47 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-db11b9bb-1244-4012-bbdd-53a3a5fe55d6 tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c632bc58-d20b-46e4-9d9d-316f17f3ea43 (non-flash)
Nov 08 23:55:47 user nova-compute[75045]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcbd911e-f385-4ed6-b8a4-383b3b56cf7d (non-flash)
Nov 08 23:55:47 user nova-compute[75045]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cde2eb2-d792-44e3-9a37-b04543d41bda (non-flash)
Nov 08 23:55:47 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 23:55:47 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-db11b9bb-1244-4012-bbdd-53a3a5fe55d6 tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c632bc58-d20b-46e4-9d9d-316f17f3ea43 (non-flash)
Nov 08 23:55:47 user nova-compute[75045]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcbd911e-f385-4ed6-b8a4-383b3b56cf7d (non-flash)
Nov 08 23:55:47 user nova-compute[75045]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cde2eb2-d792-44e3-9a37-b04543d41bda (non-flash)
Nov 08 23:55:47 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 23:55:47 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-db11b9bb-1244-4012-bbdd-53a3a5fe55d6 tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8cde2eb2-d792-44e3-9a37-b04543d41bda" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.323s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 23:55:47 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-db11b9bb-1244-4012-bbdd-53a3a5fe55d6 tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Connected to 172.16.0.220:3260 {{(pid=75045) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 23:55:47 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-db11b9bb-1244-4012-bbdd-53a3a5fe55d6 tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] HCTL ('35', '-', '-', 0) found on session 52 with lun 0 {{(pid=75045) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 23:55:47 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-db11b9bb-1244-4012-bbdd-53a3a5fe55d6 tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75045) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 23:55:47 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:55:48 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.019s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:55:48 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9f311b9-aa91-4234-9c40-e3cb6e1a0f8b]: (4, ('- - 0', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:55:48 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-db11b9bb-1244-4012-bbdd-53a3a5fe55d6 tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Searching for a device in session 52 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75045) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 23:55:48 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-db11b9bb-1244-4012-bbdd-53a3a5fe55d6 tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:8cde2eb2-d792-44e3-9a37-b04543d41bda', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'krJhGgoS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75045) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 23:55:48 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:55:49 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-db11b9bb-1244-4012-bbdd-53a3a5fe55d6 tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.358s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 23:55:49 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-db11b9bb-1244-4012-bbdd-53a3a5fe55d6 tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] <== connect_volume: return (1360ms) {'type': 'block', 'scsi_wwn': '26539383365306466', 'path': '/dev/sdd'} {{(pid=75045) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 23:55:49 user nova-compute[75045]: DEBUG nova.virt.libvirt.volume.iscsi [None req-db11b9bb-1244-4012-bbdd-53a3a5fe55d6 tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] [instance: a19b6a96-340f-488e-af81-853ee56bf30f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26539383365306466', 'path': '/dev/sdd'} {{(pid=75045) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 23:55:49 user nova-compute[75045]: DEBUG nova.objects.instance [None req-db11b9bb-1244-4012-bbdd-53a3a5fe55d6 tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Lazy-loading 'flavor' on Instance uuid a19b6a96-340f-488e-af81-853ee56bf30f {{(pid=75045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 23:55:49 user nova-compute[75045]: DEBUG nova.virt.libvirt.guest [None req-db11b9bb-1244-4012-bbdd-53a3a5fe55d6 tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] attach device xml: <disk type="block" device="disk">
Nov 08 23:55:49 user nova-compute[75045]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 23:55:49 user nova-compute[75045]:   <source dev="/dev/sdd"/>
Nov 08 23:55:49 user nova-compute[75045]:   <target dev="vdc" bus="virtio"/>
Nov 08 23:55:49 user nova-compute[75045]:   <serial>8cde2eb2-d792-44e3-9a37-b04543d41bda</serial>
Nov 08 23:55:49 user nova-compute[75045]: </disk>
Nov 08 23:55:49 user nova-compute[75045]:  {{(pid=75045) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 08 23:55:49 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-db11b9bb-1244-4012-bbdd-53a3a5fe55d6 tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] No BDM found with device name vda, not building metadata. {{(pid=75045) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 23:55:49 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-db11b9bb-1244-4012-bbdd-53a3a5fe55d6 tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75045) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 23:55:49 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-db11b9bb-1244-4012-bbdd-53a3a5fe55d6 tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75045) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 23:55:49 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-db11b9bb-1244-4012-bbdd-53a3a5fe55d6 tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] No VIF found with MAC fa:16:3e:0c:c0:6c, not building metadata {{(pid=75045) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 23:55:49 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-db11b9bb-1244-4012-bbdd-53a3a5fe55d6 tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Lock "a19b6a96-340f-488e-af81-853ee56bf30f" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 26.690s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:55:50 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-20a9c531-51c5-4316-8e50-70975ea0b6e9 tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Acquiring lock "a19b6a96-340f-488e-af81-853ee56bf30f" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:55:50 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-20a9c531-51c5-4316-8e50-70975ea0b6e9 tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Lock "a19b6a96-340f-488e-af81-853ee56bf30f" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:55:50 user nova-compute[75045]: INFO nova.compute.manager [None req-20a9c531-51c5-4316-8e50-70975ea0b6e9 tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] [instance: a19b6a96-340f-488e-af81-853ee56bf30f] Detaching volume c632bc58-d20b-46e4-9d9d-316f17f3ea43
Nov 08 23:55:50 user nova-compute[75045]: INFO nova.virt.block_device [None req-20a9c531-51c5-4316-8e50-70975ea0b6e9 tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] [instance: a19b6a96-340f-488e-af81-853ee56bf30f] Attempting to driver detach volume c632bc58-d20b-46e4-9d9d-316f17f3ea43 from mountpoint /dev/vdb
Nov 08 23:55:50 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-20a9c531-51c5-4316-8e50-70975ea0b6e9 tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Attempting to detach device vdb from instance a19b6a96-340f-488e-af81-853ee56bf30f from the persistent domain config. {{(pid=75045) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 08 23:55:50 user nova-compute[75045]: DEBUG nova.virt.libvirt.guest [None req-20a9c531-51c5-4316-8e50-70975ea0b6e9 tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 23:55:50 user nova-compute[75045]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 23:55:50 user nova-compute[75045]:   <source dev="/dev/sdb"/>
Nov 08 23:55:50 user nova-compute[75045]:   <target dev="vdb" bus="virtio"/>
Nov 08 23:55:50 user nova-compute[75045]:   <serial>c632bc58-d20b-46e4-9d9d-316f17f3ea43</serial>
Nov 08 23:55:50 user nova-compute[75045]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 08 23:55:50 user nova-compute[75045]: </disk>
Nov 08 23:55:50 user nova-compute[75045]:  {{(pid=75045) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 23:55:50 user nova-compute[75045]: INFO nova.virt.libvirt.driver [None req-20a9c531-51c5-4316-8e50-70975ea0b6e9 tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Successfully detached device vdb from instance a19b6a96-340f-488e-af81-853ee56bf30f from the persistent domain config.
Nov 08 23:55:50 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-20a9c531-51c5-4316-8e50-70975ea0b6e9 tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance a19b6a96-340f-488e-af81-853ee56bf30f from the live domain config. {{(pid=75045) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 08 23:55:50 user nova-compute[75045]: DEBUG nova.virt.libvirt.guest [None req-20a9c531-51c5-4316-8e50-70975ea0b6e9 tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 23:55:50 user nova-compute[75045]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 23:55:50 user nova-compute[75045]:   <source dev="/dev/sdb"/>
Nov 08 23:55:50 user nova-compute[75045]:   <target dev="vdb" bus="virtio"/>
Nov 08 23:55:50 user nova-compute[75045]:   <serial>c632bc58-d20b-46e4-9d9d-316f17f3ea43</serial>
Nov 08 23:55:50 user nova-compute[75045]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 08 23:55:50 user nova-compute[75045]: </disk>
Nov 08 23:55:50 user nova-compute[75045]:  {{(pid=75045) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 23:55:50 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-20a9c531-51c5-4316-8e50-70975ea0b6e9 tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance a19b6a96-340f-488e-af81-853ee56bf30f {{(pid=75045) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 08 23:55:52 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:55:53 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:55:57 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:55:58 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:56:02 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:56:02 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:56:03 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:56:03 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:56:04 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:56:04 user nova-compute[75045]: DEBUG nova.compute.manager [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Starting heal instance info cache {{(pid=75045) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 23:56:04 user nova-compute[75045]: DEBUG nova.compute.manager [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Rebuilding the list of instances to heal {{(pid=75045) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 08 23:56:05 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Acquiring lock "refresh_cache-a19b6a96-340f-488e-af81-853ee56bf30f" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 23:56:05 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Acquired lock "refresh_cache-a19b6a96-340f-488e-af81-853ee56bf30f" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 23:56:05 user nova-compute[75045]: DEBUG nova.network.neutron [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] [instance: a19b6a96-340f-488e-af81-853ee56bf30f] Forcefully refreshing network info cache for instance {{(pid=75045) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 23:56:05 user nova-compute[75045]: DEBUG nova.objects.instance [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Lazy-loading 'info_cache' on Instance uuid a19b6a96-340f-488e-af81-853ee56bf30f {{(pid=75045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 23:56:05 user nova-compute[75045]: DEBUG nova.network.neutron [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] [instance: a19b6a96-340f-488e-af81-853ee56bf30f] Updating instance_info_cache with network_info: [{"id": "f3fb96dd-b444-47d0-98ff-0c7c910dbede", "address": "fa:16:3e:0c:c0:6c", "network": {"id": "e31c3d41-e46f-4c74-8ef5-8243a391dde8", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-856540424-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.59", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c8be85d72bc440899f3ccb64b923e90e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3fb96dd-b4", "ovs_interfaceid": "f3fb96dd-b444-47d0-98ff-0c7c910dbede", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75045) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 23:56:05 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Releasing lock "refresh_cache-a19b6a96-340f-488e-af81-853ee56bf30f" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 23:56:05 user nova-compute[75045]: DEBUG nova.compute.manager [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] [instance: a19b6a96-340f-488e-af81-853ee56bf30f] Updated the network info_cache for instance {{(pid=75045) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 23:56:05 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:56:05 user nova-compute[75045]: DEBUG nova.compute.manager [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75045) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 23:56:06 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:56:07 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:56:08 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:56:08 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:56:08 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:56:10 user nova-compute[75045]: WARNING nova.virt.libvirt.driver [None req-20a9c531-51c5-4316-8e50-70975ea0b6e9 tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance a19b6a96-340f-488e-af81-853ee56bf30f is timed out.
Nov 08 23:56:10 user nova-compute[75045]: INFO nova.virt.libvirt.driver [None req-20a9c531-51c5-4316-8e50-70975ea0b6e9 tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Successfully detached device vdb from instance a19b6a96-340f-488e-af81-853ee56bf30f from the live domain config.
Nov 08 23:56:10 user nova-compute[75045]: DEBUG nova.virt.libvirt.volume.iscsi [None req-20a9c531-51c5-4316-8e50-70975ea0b6e9 tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] [instance: a19b6a96-340f-488e-af81-853ee56bf30f] calling os-brick to detach iSCSI Volume {{(pid=75045) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 23:56:10 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-20a9c531-51c5-4316-8e50-70975ea0b6e9 tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1b68210460>, {'target_iqn': 'iqn.2010-10.org.openstack:c632bc58-d20b-46e4-9d9d-316f17f3ea43', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NsTdycnt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75045) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 23:56:10 user nova-compute[75045]: WARNING os_brick.initiator.connectors.base [None req-20a9c531-51c5-4316-8e50-70975ea0b6e9 tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 23:56:10 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-20a9c531-51c5-4316-8e50-70975ea0b6e9 tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 23:56:10 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-20a9c531-51c5-4316-8e50-70975ea0b6e9 tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 23:56:10 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:56:10 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:56:10 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8a6dc5e-e79c-4204-8386-243d2189b6f0]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c632bc58-d20b-46e4-9d9d-316f17f3ea43\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:dcbd911e-f385-4ed6-b8a4-383b3b56cf7d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8cde2eb2-d792-44e3-9a37-b04543d41bda\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:56:10 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-20a9c531-51c5-4316-8e50-70975ea0b6e9 tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 23:56:10 user nova-compute[75045]: No targets found.
Nov 08 23:56:10 user nova-compute[75045]: iSNS:
Nov 08 23:56:10 user nova-compute[75045]: No targets found.
Nov 08 23:56:10 user nova-compute[75045]: STATIC:
Nov 08 23:56:10 user nova-compute[75045]: Target: iqn.2010-10.org.openstack:c632bc58-d20b-46e4-9d9d-316f17f3ea43
Nov 08 23:56:10 user nova-compute[75045]:         Portal: 172.16.0.220:3260,-1
Nov 08 23:56:10 user nova-compute[75045]:                 Iface Name: default
Nov 08 23:56:10 user nova-compute[75045]: Target: iqn.2010-10.org.openstack:dcbd911e-f385-4ed6-b8a4-383b3b56cf7d
Nov 08 23:56:10 user nova-compute[75045]:         Portal: 172.16.0.220:3260,-1
Nov 08 23:56:10 user nova-compute[75045]:                 Iface Name: default
Nov 08 23:56:10 user nova-compute[75045]: Target: iqn.2010-10.org.openstack:8cde2eb2-d792-44e3-9a37-b04543d41bda
Nov 08 23:56:10 user nova-compute[75045]:         Portal: 172.16.0.220:3260,-1
Nov 08 23:56:10 user nova-compute[75045]:                 Iface Name: default
Nov 08 23:56:10 user nova-compute[75045]: FIRMWARE:
Nov 08 23:56:10 user nova-compute[75045]: No targets found.
Nov 08 23:56:10 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 23:56:10 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-20a9c531-51c5-4316-8e50-70975ea0b6e9 tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 23:56:10 user nova-compute[75045]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 23:56:10 user nova-compute[75045]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75045) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 23:56:10 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-20a9c531-51c5-4316-8e50-70975ea0b6e9 tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c632bc58-d20b-46e4-9d9d-316f17f3ea43', 0)] {{(pid=75045) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 23:56:10 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:56:10 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:56:10 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b79de5b-d0b5-4ce9-95bd-0c395d41bd4a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8cde2eb2-d792-44e3-9a37-b04543d41bda\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c632bc58-d20b-46e4-9d9d-316f17f3ea43\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dcbd911e-f385-4ed6-b8a4-383b3b56cf7d\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:56:10 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:56:10 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:56:10 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[aedb7a31-202a-46f9-9e3f-03970a746bc1]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c632bc58-d20b-46e4-9d9d-316f17f3ea43 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcbd911e-f385-4ed6-b8a4-383b3b56cf7d (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cde2eb2-d792-44e3-9a37-b04543d41bda (non-flash)\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:56:10 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-20a9c531-51c5-4316-8e50-70975ea0b6e9 tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c632bc58-d20b-46e4-9d9d-316f17f3ea43 (non-flash)
Nov 08 23:56:10 user nova-compute[75045]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcbd911e-f385-4ed6-b8a4-383b3b56cf7d (non-flash)
Nov 08 23:56:10 user nova-compute[75045]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cde2eb2-d792-44e3-9a37-b04543d41bda (non-flash)
Nov 08 23:56:10 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 23:56:10 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-20a9c531-51c5-4316-8e50-70975ea0b6e9 tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c632bc58-d20b-46e4-9d9d-316f17f3ea43 (non-flash)
Nov 08 23:56:10 user nova-compute[75045]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcbd911e-f385-4ed6-b8a4-383b3b56cf7d (non-flash)
Nov 08 23:56:10 user nova-compute[75045]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cde2eb2-d792-44e3-9a37-b04543d41bda (non-flash)
Nov 08 23:56:10 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 23:56:10 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-20a9c531-51c5-4316-8e50-70975ea0b6e9 tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1b48464280>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c632bc58-d20b-46e4-9d9d-316f17f3ea43'): ({'sdb'}, set())}) {{(pid=75045) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 23:56:10 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-20a9c531-51c5-4316-8e50-70975ea0b6e9 tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Removing single pathed devices sdb {{(pid=75045) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 23:56:10 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:56:10 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:56:10 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:56:10 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[67f5b837-6f08-47de-830f-884b0f5dbaf4]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:56:10 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:56:10 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:56:11 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[c98d1b21-15dc-491c-9617-6dd1d6c66003]: (4, ('ok\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:56:11 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-20a9c531-51c5-4316-8e50-70975ea0b6e9 tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Flushing IO for device /dev/sdb {{(pid=75045) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 23:56:11 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:56:11 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:56:11 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a00a40a-3163-4d42-a872-d621fad6aa7e]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:56:11 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-20a9c531-51c5-4316-8e50-70975ea0b6e9 tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75045) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 23:56:11 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:56:11 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.052s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:56:11 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a21a15f-d0f4-4bf2-9752-b9e2481c1158]: (4, ('1', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:56:11 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-20a9c531-51c5-4316-8e50-70975ea0b6e9 tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75045) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 23:56:11 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-20a9c531-51c5-4316-8e50-70975ea0b6e9 tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] SCSI volumes sdb have been removed. {{(pid=75045) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 23:56:11 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-20a9c531-51c5-4316-8e50-70975ea0b6e9 tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c632bc58-d20b-46e4-9d9d-316f17f3ea43')] {{(pid=75045) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 23:56:11 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c632bc58-d20b-46e4-9d9d-316f17f3ea43 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:56:11 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c632bc58-d20b-46e4-9d9d-316f17f3ea43 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:56:11 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[42eebf63-752c-4f84-a3cc-cb9d5492f7f1]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:56:11 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-20a9c531-51c5-4316-8e50-70975ea0b6e9 tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:56:11 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c632bc58-d20b-46e4-9d9d-316f17f3ea43 -p 172.16.0.220:3260 --logout {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:56:11 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c632bc58-d20b-46e4-9d9d-316f17f3ea43 -p 172.16.0.220:3260 --logout" returned: 0 in 0.050s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:56:11 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec144ba8-29c0-4ecb-bb12-e83a305f77ff]: (4, ('Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:c632bc58-d20b-46e4-9d9d-316f17f3ea43, portal: 172.16.0.220,3260]\nLogout of [sid: 50, target: iqn.2010-10.org.openstack:c632bc58-d20b-46e4-9d9d-316f17f3ea43, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:56:11 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-20a9c531-51c5-4316-8e50-70975ea0b6e9 tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:c632bc58-d20b-46e4-9d9d-316f17f3ea43, portal: 172.16.0.220,3260]
Nov 08 23:56:11 user nova-compute[75045]: Logout of [sid: 50, target: iqn.2010-10.org.openstack:c632bc58-d20b-46e4-9d9d-316f17f3ea43, portal: 172.16.0.220,3260] successful.
Nov 08 23:56:11 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:56:11 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c632bc58-d20b-46e4-9d9d-316f17f3ea43 -p 172.16.0.220:3260 --op delete {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:56:11 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c632bc58-d20b-46e4-9d9d-316f17f3ea43 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:56:11 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[69541e16-6ed8-4600-90ab-ab4a7b7d8fd0]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:56:11 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-20a9c531-51c5-4316-8e50-70975ea0b6e9 tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:56:11 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-20a9c531-51c5-4316-8e50-70975ea0b6e9 tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.315s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 23:56:11 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-20a9c531-51c5-4316-8e50-70975ea0b6e9 tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] <== disconnect_volume: return (316ms) None {{(pid=75045) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 23:56:11 user nova-compute[75045]: DEBUG nova.virt.libvirt.volume.iscsi [None req-20a9c531-51c5-4316-8e50-70975ea0b6e9 tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] [instance: a19b6a96-340f-488e-af81-853ee56bf30f] Disconnected iSCSI Volume {{(pid=75045) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 23:56:12 user nova-compute[75045]: DEBUG nova.objects.instance [None req-20a9c531-51c5-4316-8e50-70975ea0b6e9 tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Lazy-loading 'flavor' on Instance uuid a19b6a96-340f-488e-af81-853ee56bf30f {{(pid=75045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 23:56:12 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-20a9c531-51c5-4316-8e50-70975ea0b6e9 tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Lock "a19b6a96-340f-488e-af81-853ee56bf30f" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.855s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:56:12 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-4d3de2d7-3757-430a-9734-ab34bea6598e tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Acquiring lock "a19b6a96-340f-488e-af81-853ee56bf30f" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:56:12 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-4d3de2d7-3757-430a-9734-ab34bea6598e tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Lock "a19b6a96-340f-488e-af81-853ee56bf30f" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:56:12 user nova-compute[75045]: INFO nova.compute.manager [None req-4d3de2d7-3757-430a-9734-ab34bea6598e tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] [instance: a19b6a96-340f-488e-af81-853ee56bf30f] Detaching volume 8cde2eb2-d792-44e3-9a37-b04543d41bda
Nov 08 23:56:13 user nova-compute[75045]: INFO nova.virt.block_device [None req-4d3de2d7-3757-430a-9734-ab34bea6598e tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] [instance: a19b6a96-340f-488e-af81-853ee56bf30f] Attempting to driver detach volume 8cde2eb2-d792-44e3-9a37-b04543d41bda from mountpoint /dev/vdc
Nov 08 23:56:13 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-4d3de2d7-3757-430a-9734-ab34bea6598e tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Attempting to detach device vdc from instance a19b6a96-340f-488e-af81-853ee56bf30f from the persistent domain config. {{(pid=75045) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 08 23:56:13 user nova-compute[75045]: DEBUG nova.virt.libvirt.guest [None req-4d3de2d7-3757-430a-9734-ab34bea6598e tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 23:56:13 user nova-compute[75045]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 23:56:13 user nova-compute[75045]:   <source dev="/dev/sdd"/>
Nov 08 23:56:13 user nova-compute[75045]:   <target dev="vdc" bus="virtio"/>
Nov 08 23:56:13 user nova-compute[75045]:   <serial>8cde2eb2-d792-44e3-9a37-b04543d41bda</serial>
Nov 08 23:56:13 user nova-compute[75045]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 08 23:56:13 user nova-compute[75045]: </disk>
Nov 08 23:56:13 user nova-compute[75045]:  {{(pid=75045) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 23:56:13 user nova-compute[75045]: INFO nova.virt.libvirt.driver [None req-4d3de2d7-3757-430a-9734-ab34bea6598e tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Successfully detached device vdc from instance a19b6a96-340f-488e-af81-853ee56bf30f from the persistent domain config.
Nov 08 23:56:13 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-4d3de2d7-3757-430a-9734-ab34bea6598e tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance a19b6a96-340f-488e-af81-853ee56bf30f from the live domain config. {{(pid=75045) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 08 23:56:13 user nova-compute[75045]: DEBUG nova.virt.libvirt.guest [None req-4d3de2d7-3757-430a-9734-ab34bea6598e tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 23:56:13 user nova-compute[75045]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 23:56:13 user nova-compute[75045]:   <source dev="/dev/sdd"/>
Nov 08 23:56:13 user nova-compute[75045]:   <target dev="vdc" bus="virtio"/>
Nov 08 23:56:13 user nova-compute[75045]:   <serial>8cde2eb2-d792-44e3-9a37-b04543d41bda</serial>
Nov 08 23:56:13 user nova-compute[75045]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 08 23:56:13 user nova-compute[75045]: </disk>
Nov 08 23:56:13 user nova-compute[75045]:  {{(pid=75045) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 23:56:13 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 23:56:13 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-4d3de2d7-3757-430a-9734-ab34bea6598e tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance a19b6a96-340f-488e-af81-853ee56bf30f {{(pid=75045) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 08 23:56:14 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:56:15 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager.update_available_resource {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:56:16 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:56:16 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:56:16 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:56:16 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Auditing locally available compute resources for user (node: user) {{(pid=75045) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 23:56:16 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75045) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 23:56:16 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d9a47ed-6aa3-468f-b106-46b60cd27a46/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:56:16 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d9a47ed-6aa3-468f-b106-46b60cd27a46/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:56:16 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d9a47ed-6aa3-468f-b106-46b60cd27a46/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:56:16 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d9a47ed-6aa3-468f-b106-46b60cd27a46/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:56:16 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a19b6a96-340f-488e-af81-853ee56bf30f/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:56:16 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a19b6a96-340f-488e-af81-853ee56bf30f/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:56:16 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a19b6a96-340f-488e-af81-853ee56bf30f/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:56:16 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a19b6a96-340f-488e-af81-853ee56bf30f/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:56:17 user nova-compute[75045]: WARNING nova.virt.libvirt.driver [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 23:56:17 user nova-compute[75045]: WARNING nova.virt.libvirt.driver [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 23:56:17 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Hypervisor/Node resource view: name=user free_ram=8567MB free_disk=24.882049560546875GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75045) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 23:56:17 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:56:17 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:56:17 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Instance a19b6a96-340f-488e-af81-853ee56bf30f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75045) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 23:56:17 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Instance df16d913-9985-415f-aedc-14f2ca5bcf13 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75045) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 23:56:17 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Instance 8d9a47ed-6aa3-468f-b106-46b60cd27a46 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75045) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 23:56:17 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=75045) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 23:56:17 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=75045) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 23:56:17 user nova-compute[75045]: DEBUG nova.compute.provider_tree [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Inventory has not changed in ProviderTree for provider: 62ba5f85-c74d-4b58-986e-d4197e813fd7 {{(pid=75045) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 23:56:17 user nova-compute[75045]: DEBUG nova.scheduler.client.report [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Inventory has not changed for provider 62ba5f85-c74d-4b58-986e-d4197e813fd7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75045) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 23:56:17 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Compute_service record updated for user:user {{(pid=75045) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 23:56:17 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.251s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:56:18 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 23:56:23 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 23:56:28 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 23:56:33 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:56:33 user nova-compute[75045]: WARNING nova.virt.libvirt.driver [None req-4d3de2d7-3757-430a-9734-ab34bea6598e tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance a19b6a96-340f-488e-af81-853ee56bf30f is timed out.
Nov 08 23:56:33 user nova-compute[75045]: INFO nova.virt.libvirt.driver [None req-4d3de2d7-3757-430a-9734-ab34bea6598e tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Successfully detached device vdc from instance a19b6a96-340f-488e-af81-853ee56bf30f from the live domain config.
Nov 08 23:56:33 user nova-compute[75045]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4d3de2d7-3757-430a-9734-ab34bea6598e tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] [instance: a19b6a96-340f-488e-af81-853ee56bf30f] calling os-brick to detach iSCSI Volume {{(pid=75045) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 23:56:33 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d3de2d7-3757-430a-9734-ab34bea6598e tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1b68210460>, {'target_iqn': 'iqn.2010-10.org.openstack:8cde2eb2-d792-44e3-9a37-b04543d41bda', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'krJhGgoS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=75045) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 23:56:33 user nova-compute[75045]: WARNING os_brick.initiator.connectors.base [None req-4d3de2d7-3757-430a-9734-ab34bea6598e tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 23:56:33 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-4d3de2d7-3757-430a-9734-ab34bea6598e tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 23:56:33 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-4d3de2d7-3757-430a-9734-ab34bea6598e tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 23:56:33 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:56:33 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:56:33 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9e1223d-5ba8-42c6-b5ab-b9b8eb27fb44]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:dcbd911e-f385-4ed6-b8a4-383b3b56cf7d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8cde2eb2-d792-44e3-9a37-b04543d41bda\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:56:33 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d3de2d7-3757-430a-9734-ab34bea6598e tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 23:56:33 user nova-compute[75045]: No targets found.
Nov 08 23:56:33 user nova-compute[75045]: iSNS:
Nov 08 23:56:33 user nova-compute[75045]: No targets found.
Nov 08 23:56:33 user nova-compute[75045]: STATIC:
Nov 08 23:56:33 user nova-compute[75045]: Target: iqn.2010-10.org.openstack:dcbd911e-f385-4ed6-b8a4-383b3b56cf7d
Nov 08 23:56:33 user nova-compute[75045]:         Portal: 172.16.0.220:3260,-1
Nov 08 23:56:33 user nova-compute[75045]:                 Iface Name: default
Nov 08 23:56:33 user nova-compute[75045]: Target: iqn.2010-10.org.openstack:8cde2eb2-d792-44e3-9a37-b04543d41bda
Nov 08 23:56:33 user nova-compute[75045]:         Portal: 172.16.0.220:3260,-1
Nov 08 23:56:33 user nova-compute[75045]:                 Iface Name: default
Nov 08 23:56:33 user nova-compute[75045]: FIRMWARE:
Nov 08 23:56:33 user nova-compute[75045]: No targets found.
Nov 08 23:56:33 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 23:56:33 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d3de2d7-3757-430a-9734-ab34bea6598e tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 23:56:33 user nova-compute[75045]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 23:56:33 user nova-compute[75045]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75045) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 23:56:33 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d3de2d7-3757-430a-9734-ab34bea6598e tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8cde2eb2-d792-44e3-9a37-b04543d41bda', 0)] {{(pid=75045) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 23:56:33 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:56:33 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:56:33 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf486056-e7a3-42e8-ba20-946bd1b13a52]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8cde2eb2-d792-44e3-9a37-b04543d41bda\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dcbd911e-f385-4ed6-b8a4-383b3b56cf7d\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:56:33 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:56:33 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:56:33 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[565a9295-0aeb-4bd7-8d5f-fddb83326ffb]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcbd911e-f385-4ed6-b8a4-383b3b56cf7d (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cde2eb2-d792-44e3-9a37-b04543d41bda (non-flash)\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:56:33 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d3de2d7-3757-430a-9734-ab34bea6598e tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcbd911e-f385-4ed6-b8a4-383b3b56cf7d (non-flash)
Nov 08 23:56:33 user nova-compute[75045]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cde2eb2-d792-44e3-9a37-b04543d41bda (non-flash)
Nov 08 23:56:33 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 23:56:33 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d3de2d7-3757-430a-9734-ab34bea6598e tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcbd911e-f385-4ed6-b8a4-383b3b56cf7d (non-flash)
Nov 08 23:56:33 user nova-compute[75045]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cde2eb2-d792-44e3-9a37-b04543d41bda (non-flash)
Nov 08 23:56:33 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 23:56:33 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d3de2d7-3757-430a-9734-ab34bea6598e tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1b4848f640>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8cde2eb2-d792-44e3-9a37-b04543d41bda'): ({'sdd'}, set())}) {{(pid=75045) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 23:56:33 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-4d3de2d7-3757-430a-9734-ab34bea6598e tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Removing single pathed devices sdd {{(pid=75045) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 23:56:33 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:56:33 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:56:33 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[43dbd6e6-11cd-4810-a645-0c8bf00a70bc]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:56:33 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:56:33 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:56:33 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[e79b5881-6f22-499c-8063-5c41cdd52f94]: (4, ('ok\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:56:33 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-4d3de2d7-3757-430a-9734-ab34bea6598e tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Flushing IO for device /dev/sdd {{(pid=75045) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 23:56:33 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:56:33 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:56:33 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[abc50d34-9660-4c77-91b3-2ee40a98a63b]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:56:33 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-4d3de2d7-3757-430a-9734-ab34bea6598e tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75045) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 23:56:33 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:56:33 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.036s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:56:33 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[d968db0f-ea85-4286-ae21-4e100d000c96]: (4, ('1', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:56:33 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-4d3de2d7-3757-430a-9734-ab34bea6598e tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75045) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 23:56:33 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-4d3de2d7-3757-430a-9734-ab34bea6598e tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] SCSI volumes sdd have been removed. {{(pid=75045) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 23:56:33 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d3de2d7-3757-430a-9734-ab34bea6598e tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8cde2eb2-d792-44e3-9a37-b04543d41bda')] {{(pid=75045) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 23:56:33 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8cde2eb2-d792-44e3-9a37-b04543d41bda -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:56:33 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8cde2eb2-d792-44e3-9a37-b04543d41bda -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:56:33 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cb5702c-3ac0-4e3e-af31-8a56481d89c5]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:56:33 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d3de2d7-3757-430a-9734-ab34bea6598e tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:56:33 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8cde2eb2-d792-44e3-9a37-b04543d41bda -p 172.16.0.220:3260 --logout {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:56:33 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8cde2eb2-d792-44e3-9a37-b04543d41bda -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:56:33 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[f607f6ef-7219-489b-9123-d6fc126bb218]: (4, ('Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:8cde2eb2-d792-44e3-9a37-b04543d41bda, portal: 172.16.0.220,3260]\nLogout of [sid: 52, target: iqn.2010-10.org.openstack:8cde2eb2-d792-44e3-9a37-b04543d41bda, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:56:33 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d3de2d7-3757-430a-9734-ab34bea6598e tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:8cde2eb2-d792-44e3-9a37-b04543d41bda, portal: 172.16.0.220,3260]
Nov 08 23:56:33 user nova-compute[75045]: Logout of [sid: 52, target: iqn.2010-10.org.openstack:8cde2eb2-d792-44e3-9a37-b04543d41bda, portal: 172.16.0.220,3260] successful.
Nov 08 23:56:33 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:56:33 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8cde2eb2-d792-44e3-9a37-b04543d41bda -p 172.16.0.220:3260 --op delete {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:56:33 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8cde2eb2-d792-44e3-9a37-b04543d41bda -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:56:33 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d5f72f3-d8ea-4efa-b6c9-479dc6beb646]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:56:33 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d3de2d7-3757-430a-9734-ab34bea6598e tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:56:33 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-4d3de2d7-3757-430a-9734-ab34bea6598e tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.288s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 23:56:33 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d3de2d7-3757-430a-9734-ab34bea6598e tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] <== disconnect_volume: return (289ms) None {{(pid=75045) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 23:56:33 user nova-compute[75045]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4d3de2d7-3757-430a-9734-ab34bea6598e tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] [instance: a19b6a96-340f-488e-af81-853ee56bf30f] Disconnected iSCSI Volume {{(pid=75045) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 23:56:34 user nova-compute[75045]: DEBUG nova.objects.instance [None req-4d3de2d7-3757-430a-9734-ab34bea6598e tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Lazy-loading 'flavor' on Instance uuid a19b6a96-340f-488e-af81-853ee56bf30f {{(pid=75045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 23:56:34 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-4d3de2d7-3757-430a-9734-ab34bea6598e tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Lock "a19b6a96-340f-488e-af81-853ee56bf30f" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.763s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:56:35 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-a8a891c6-3a66-4f51-9873-975f971fbaa3 tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Acquiring lock "a19b6a96-340f-488e-af81-853ee56bf30f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:56:35 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-a8a891c6-3a66-4f51-9873-975f971fbaa3 tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Lock "a19b6a96-340f-488e-af81-853ee56bf30f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:56:35 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-a8a891c6-3a66-4f51-9873-975f971fbaa3 tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Acquiring lock "a19b6a96-340f-488e-af81-853ee56bf30f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:56:35 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-a8a891c6-3a66-4f51-9873-975f971fbaa3 tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Lock "a19b6a96-340f-488e-af81-853ee56bf30f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:56:35 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-a8a891c6-3a66-4f51-9873-975f971fbaa3 tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Lock "a19b6a96-340f-488e-af81-853ee56bf30f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:56:35 user nova-compute[75045]: INFO nova.compute.manager [None req-a8a891c6-3a66-4f51-9873-975f971fbaa3 tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] [instance: a19b6a96-340f-488e-af81-853ee56bf30f] Terminating instance
Nov 08 23:56:35 user nova-compute[75045]: DEBUG nova.compute.manager [None req-a8a891c6-3a66-4f51-9873-975f971fbaa3 tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] [instance: a19b6a96-340f-488e-af81-853ee56bf30f] Start destroying the instance on the hypervisor. {{(pid=75045) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 23:56:35 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:56:35 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:56:35 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:56:35 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:56:36 user nova-compute[75045]: DEBUG nova.compute.manager [req-a0cf20c9-f629-45f7-902e-2abd5c3d6898 req-96cc2032-d9b0-4aec-85aa-1afa0dd29ef3 service nova] [instance: a19b6a96-340f-488e-af81-853ee56bf30f] Received event network-vif-unplugged-f3fb96dd-b444-47d0-98ff-0c7c910dbede {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:56:36 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-a0cf20c9-f629-45f7-902e-2abd5c3d6898 req-96cc2032-d9b0-4aec-85aa-1afa0dd29ef3 service nova] Acquiring lock "a19b6a96-340f-488e-af81-853ee56bf30f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:56:36 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-a0cf20c9-f629-45f7-902e-2abd5c3d6898 req-96cc2032-d9b0-4aec-85aa-1afa0dd29ef3 service nova] Lock "a19b6a96-340f-488e-af81-853ee56bf30f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:56:36 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-a0cf20c9-f629-45f7-902e-2abd5c3d6898 req-96cc2032-d9b0-4aec-85aa-1afa0dd29ef3 service nova] Lock "a19b6a96-340f-488e-af81-853ee56bf30f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:56:36 user nova-compute[75045]: DEBUG nova.compute.manager [req-a0cf20c9-f629-45f7-902e-2abd5c3d6898 req-96cc2032-d9b0-4aec-85aa-1afa0dd29ef3 service nova] [instance: a19b6a96-340f-488e-af81-853ee56bf30f] No waiting events found dispatching network-vif-unplugged-f3fb96dd-b444-47d0-98ff-0c7c910dbede {{(pid=75045) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 23:56:36 user nova-compute[75045]: DEBUG nova.compute.manager [req-a0cf20c9-f629-45f7-902e-2abd5c3d6898 req-96cc2032-d9b0-4aec-85aa-1afa0dd29ef3 service nova] [instance: a19b6a96-340f-488e-af81-853ee56bf30f] Received event network-vif-unplugged-f3fb96dd-b444-47d0-98ff-0c7c910dbede for instance with task_state deleting. {{(pid=75045) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 23:56:36 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:56:36 user nova-compute[75045]: INFO nova.virt.libvirt.driver [-] [instance: a19b6a96-340f-488e-af81-853ee56bf30f] Instance destroyed successfully.
Nov 08 23:56:36 user nova-compute[75045]: DEBUG nova.objects.instance [None req-a8a891c6-3a66-4f51-9873-975f971fbaa3 tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Lazy-loading 'resources' on Instance uuid a19b6a96-340f-488e-af81-853ee56bf30f {{(pid=75045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 23:56:36 user nova-compute[75045]: DEBUG nova.virt.libvirt.vif [None req-a8a891c6-3a66-4f51-9873-975f971fbaa3 tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T23:52:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-7117286',display_name='tempest-AttachVolumeTestJSON-server-7117286',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-7117286',id=49,image_ref='a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEwUSRDKaZl45jBGPlzBWh5SQ/B972l7W8699uxVzR8tW1yp9t3QaeTsM1zxnVpopR+6U6iomMQHyN1WGS8zg7XGUpHxIvtPO8beMDYfiszyOQLUrPzas93W4+SH/+6uPg==',key_name='tempest-keypair-1693710972',keypairs=<?>,launch_index=0,launched_at=2023-11-08T23:52:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c8be85d72bc440899f3ccb64b923e90e',ramdisk_id='',reservation_id='r-9wnfy1m9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a9ae9a7f-51b3-46f2-9b49-ddf0a0035bbb',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1852573580',owner_user_name='tempest-AttachVolumeTestJSON-1852573580-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T23:52:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1e3647ad15a24f1584685f9340eae5bd',uuid=a19b6a96-340f-488e-af81-853ee56bf30f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f3fb96dd-b444-47d0-98ff-0c7c910dbede", "address": "fa:16:3e:0c:c0:6c", "network": {"id": "e31c3d41-e46f-4c74-8ef5-8243a391dde8", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-856540424-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.59", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c8be85d72bc440899f3ccb64b923e90e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3fb96dd-b4", "ovs_interfaceid": "f3fb96dd-b444-47d0-98ff-0c7c910dbede", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75045) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 23:56:36 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-a8a891c6-3a66-4f51-9873-975f971fbaa3 tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Converting VIF {"id": "f3fb96dd-b444-47d0-98ff-0c7c910dbede", "address": "fa:16:3e:0c:c0:6c", "network": {"id": "e31c3d41-e46f-4c74-8ef5-8243a391dde8", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-856540424-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.59", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c8be85d72bc440899f3ccb64b923e90e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3fb96dd-b4", "ovs_interfaceid": "f3fb96dd-b444-47d0-98ff-0c7c910dbede", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 23:56:36 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-a8a891c6-3a66-4f51-9873-975f971fbaa3 tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0c:c0:6c,bridge_name='br-int',has_traffic_filtering=True,id=f3fb96dd-b444-47d0-98ff-0c7c910dbede,network=Network(e31c3d41-e46f-4c74-8ef5-8243a391dde8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf3fb96dd-b4') {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 23:56:36 user nova-compute[75045]: DEBUG os_vif [None req-a8a891c6-3a66-4f51-9873-975f971fbaa3 tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:0c:c0:6c,bridge_name='br-int',has_traffic_filtering=True,id=f3fb96dd-b444-47d0-98ff-0c7c910dbede,network=Network(e31c3d41-e46f-4c74-8ef5-8243a391dde8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf3fb96dd-b4') {{(pid=75045) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 23:56:36 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:56:36 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf3fb96dd-b4, bridge=br-int, if_exists=True) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:56:36 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:56:36 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 23:56:36 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:56:36 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=45797b41-e96e-45e5-a961-a84cb326bdef) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:56:36 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:56:36 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:56:36 user nova-compute[75045]: INFO os_vif [None req-a8a891c6-3a66-4f51-9873-975f971fbaa3 tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:0c:c0:6c,bridge_name='br-int',has_traffic_filtering=True,id=f3fb96dd-b444-47d0-98ff-0c7c910dbede,network=Network(e31c3d41-e46f-4c74-8ef5-8243a391dde8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf3fb96dd-b4')
Nov 08 23:56:36 user nova-compute[75045]: INFO nova.virt.libvirt.driver [None req-a8a891c6-3a66-4f51-9873-975f971fbaa3 tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] [instance: a19b6a96-340f-488e-af81-853ee56bf30f] Deleting instance files /opt/stack/data/nova/instances/a19b6a96-340f-488e-af81-853ee56bf30f_del
Nov 08 23:56:36 user nova-compute[75045]: INFO nova.virt.libvirt.driver [None req-a8a891c6-3a66-4f51-9873-975f971fbaa3 tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] [instance: a19b6a96-340f-488e-af81-853ee56bf30f] Deletion of /opt/stack/data/nova/instances/a19b6a96-340f-488e-af81-853ee56bf30f_del complete
Nov 08 23:56:36 user nova-compute[75045]: INFO nova.compute.manager [None req-a8a891c6-3a66-4f51-9873-975f971fbaa3 tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] [instance: a19b6a96-340f-488e-af81-853ee56bf30f] Took 0.85 seconds to destroy the instance on the hypervisor.
Nov 08 23:56:36 user nova-compute[75045]: DEBUG oslo.service.loopingcall [None req-a8a891c6-3a66-4f51-9873-975f971fbaa3 tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75045) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 23:56:36 user nova-compute[75045]: DEBUG nova.compute.manager [-] [instance: a19b6a96-340f-488e-af81-853ee56bf30f] Deallocating network for instance {{(pid=75045) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 23:56:36 user nova-compute[75045]: DEBUG nova.network.neutron [-] [instance: a19b6a96-340f-488e-af81-853ee56bf30f] deallocate_for_instance() {{(pid=75045) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 23:56:37 user nova-compute[75045]: DEBUG nova.network.neutron [-] [instance: a19b6a96-340f-488e-af81-853ee56bf30f] Updating instance_info_cache with network_info: [] {{(pid=75045) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 23:56:38 user nova-compute[75045]: INFO nova.compute.manager [-] [instance: a19b6a96-340f-488e-af81-853ee56bf30f] Took 1.38 seconds to deallocate network for instance.
Nov 08 23:56:38 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-a8a891c6-3a66-4f51-9873-975f971fbaa3 tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:56:38 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-a8a891c6-3a66-4f51-9873-975f971fbaa3 tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:56:38 user nova-compute[75045]: DEBUG nova.compute.provider_tree [None req-a8a891c6-3a66-4f51-9873-975f971fbaa3 tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Inventory has not changed in ProviderTree for provider: 62ba5f85-c74d-4b58-986e-d4197e813fd7 {{(pid=75045) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 23:56:38 user nova-compute[75045]: DEBUG nova.scheduler.client.report [None req-a8a891c6-3a66-4f51-9873-975f971fbaa3 tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Inventory has not changed for provider 62ba5f85-c74d-4b58-986e-d4197e813fd7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75045) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 23:56:38 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-a8a891c6-3a66-4f51-9873-975f971fbaa3 tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.171s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:56:38 user nova-compute[75045]: DEBUG nova.compute.manager [req-46524793-15ac-46c5-bf9d-af13349f3321 req-9a92f059-7a06-43a2-8e6d-411a96ea574f service nova] [instance: a19b6a96-340f-488e-af81-853ee56bf30f] Received event network-vif-plugged-f3fb96dd-b444-47d0-98ff-0c7c910dbede {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:56:38 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-46524793-15ac-46c5-bf9d-af13349f3321 req-9a92f059-7a06-43a2-8e6d-411a96ea574f service nova] Acquiring lock "a19b6a96-340f-488e-af81-853ee56bf30f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:56:38 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-46524793-15ac-46c5-bf9d-af13349f3321 req-9a92f059-7a06-43a2-8e6d-411a96ea574f service nova] Lock "a19b6a96-340f-488e-af81-853ee56bf30f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:56:38 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-46524793-15ac-46c5-bf9d-af13349f3321 req-9a92f059-7a06-43a2-8e6d-411a96ea574f service nova] Lock "a19b6a96-340f-488e-af81-853ee56bf30f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:56:38 user nova-compute[75045]: DEBUG nova.compute.manager [req-46524793-15ac-46c5-bf9d-af13349f3321 req-9a92f059-7a06-43a2-8e6d-411a96ea574f service nova] [instance: a19b6a96-340f-488e-af81-853ee56bf30f] No waiting events found dispatching network-vif-plugged-f3fb96dd-b444-47d0-98ff-0c7c910dbede {{(pid=75045) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 23:56:38 user nova-compute[75045]: WARNING nova.compute.manager [req-46524793-15ac-46c5-bf9d-af13349f3321 req-9a92f059-7a06-43a2-8e6d-411a96ea574f service nova] [instance: a19b6a96-340f-488e-af81-853ee56bf30f] Received unexpected event network-vif-plugged-f3fb96dd-b444-47d0-98ff-0c7c910dbede for instance with vm_state deleted and task_state None.
Nov 08 23:56:38 user nova-compute[75045]: DEBUG nova.compute.manager [req-46524793-15ac-46c5-bf9d-af13349f3321 req-9a92f059-7a06-43a2-8e6d-411a96ea574f service nova] [instance: a19b6a96-340f-488e-af81-853ee56bf30f] Received event network-vif-deleted-f3fb96dd-b444-47d0-98ff-0c7c910dbede {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:56:38 user nova-compute[75045]: INFO nova.scheduler.client.report [None req-a8a891c6-3a66-4f51-9873-975f971fbaa3 tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Deleted allocations for instance a19b6a96-340f-488e-af81-853ee56bf30f
Nov 08 23:56:38 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-a8a891c6-3a66-4f51-9873-975f971fbaa3 tempest-AttachVolumeTestJSON-1852573580 tempest-AttachVolumeTestJSON-1852573580-project-member] Lock "a19b6a96-340f-488e-af81-853ee56bf30f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.599s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:56:41 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:56:46 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 23:56:51 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 23:56:52 user nova-compute[75045]: DEBUG nova.compute.manager [req-82a43438-c7d0-4c5c-8358-9bd073585410 req-3385dabc-dc74-4b3e-ae66-b46ae30537f1 service nova] [instance: df16d913-9985-415f-aedc-14f2ca5bcf13] Received event network-changed-c762a745-51d7-4d4e-bdc5-c962aec66b02 {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:56:52 user nova-compute[75045]: DEBUG nova.compute.manager [req-82a43438-c7d0-4c5c-8358-9bd073585410 req-3385dabc-dc74-4b3e-ae66-b46ae30537f1 service nova] [instance: df16d913-9985-415f-aedc-14f2ca5bcf13] Refreshing instance network info cache due to event network-changed-c762a745-51d7-4d4e-bdc5-c962aec66b02. {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 23:56:52 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-82a43438-c7d0-4c5c-8358-9bd073585410 req-3385dabc-dc74-4b3e-ae66-b46ae30537f1 service nova] Acquiring lock "refresh_cache-df16d913-9985-415f-aedc-14f2ca5bcf13" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 23:56:52 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-82a43438-c7d0-4c5c-8358-9bd073585410 req-3385dabc-dc74-4b3e-ae66-b46ae30537f1 service nova] Acquired lock "refresh_cache-df16d913-9985-415f-aedc-14f2ca5bcf13" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 23:56:52 user nova-compute[75045]: DEBUG nova.network.neutron [req-82a43438-c7d0-4c5c-8358-9bd073585410 req-3385dabc-dc74-4b3e-ae66-b46ae30537f1 service nova] [instance: df16d913-9985-415f-aedc-14f2ca5bcf13] Refreshing network info cache for port c762a745-51d7-4d4e-bdc5-c962aec66b02 {{(pid=75045) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 23:56:52 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:56:52 user nova-compute[75045]: DEBUG nova.network.neutron [req-82a43438-c7d0-4c5c-8358-9bd073585410 req-3385dabc-dc74-4b3e-ae66-b46ae30537f1 service nova] [instance: df16d913-9985-415f-aedc-14f2ca5bcf13] Updated VIF entry in instance network info cache for port c762a745-51d7-4d4e-bdc5-c962aec66b02. {{(pid=75045) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 23:56:52 user nova-compute[75045]: DEBUG nova.network.neutron [req-82a43438-c7d0-4c5c-8358-9bd073585410 req-3385dabc-dc74-4b3e-ae66-b46ae30537f1 service nova] [instance: df16d913-9985-415f-aedc-14f2ca5bcf13] Updating instance_info_cache with network_info: [{"id": "c762a745-51d7-4d4e-bdc5-c962aec66b02", "address": "fa:16:3e:80:3b:b9", "network": {"id": "4205f899-9865-4c65-8b46-c9a533e9bb45", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-774780781-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.119", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d59b73851c79473a9c2cdc0a120dfee0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc762a745-51", "ovs_interfaceid": "c762a745-51d7-4d4e-bdc5-c962aec66b02", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75045) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 23:56:52 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-82a43438-c7d0-4c5c-8358-9bd073585410 req-3385dabc-dc74-4b3e-ae66-b46ae30537f1 service nova] Releasing lock "refresh_cache-df16d913-9985-415f-aedc-14f2ca5bcf13" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 23:56:56 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:56:57 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:57:01 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:57:02 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:57:03 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:57:04 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:57:04 user nova-compute[75045]: DEBUG nova.compute.manager [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Starting heal instance info cache {{(pid=75045) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 23:57:05 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Acquiring lock "refresh_cache-df16d913-9985-415f-aedc-14f2ca5bcf13" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 23:57:05 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Acquired lock "refresh_cache-df16d913-9985-415f-aedc-14f2ca5bcf13" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 23:57:05 user nova-compute[75045]: DEBUG nova.network.neutron [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] [instance: df16d913-9985-415f-aedc-14f2ca5bcf13] Forcefully refreshing network info cache for instance {{(pid=75045) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 23:57:05 user nova-compute[75045]: DEBUG nova.network.neutron [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] [instance: df16d913-9985-415f-aedc-14f2ca5bcf13] Updating instance_info_cache with network_info: [{"id": "c762a745-51d7-4d4e-bdc5-c962aec66b02", "address": "fa:16:3e:80:3b:b9", "network": {"id": "4205f899-9865-4c65-8b46-c9a533e9bb45", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-774780781-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.119", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d59b73851c79473a9c2cdc0a120dfee0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc762a745-51", "ovs_interfaceid": "c762a745-51d7-4d4e-bdc5-c962aec66b02", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75045) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 23:57:05 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Releasing lock "refresh_cache-df16d913-9985-415f-aedc-14f2ca5bcf13" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 23:57:05 user nova-compute[75045]: DEBUG nova.compute.manager [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] [instance: df16d913-9985-415f-aedc-14f2ca5bcf13] Updated the network info_cache for instance {{(pid=75045) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 23:57:05 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:57:05 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:57:05 user nova-compute[75045]: DEBUG nova.compute.manager [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75045) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 23:57:06 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:57:07 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:57:08 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:57:08 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:57:09 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:57:10 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-75892721-9dcd-49a3-becc-2a7d0e5f91c0 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Acquiring lock "f2b04024-a109-4b8b-8a7d-1c0fc8712afd" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:57:10 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-75892721-9dcd-49a3-becc-2a7d0e5f91c0 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Lock "f2b04024-a109-4b8b-8a7d-1c0fc8712afd" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:57:10 user nova-compute[75045]: DEBUG nova.compute.manager [None req-75892721-9dcd-49a3-becc-2a7d0e5f91c0 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] [instance: f2b04024-a109-4b8b-8a7d-1c0fc8712afd] Starting instance... {{(pid=75045) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 23:57:10 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:57:10 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:57:11 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-75892721-9dcd-49a3-becc-2a7d0e5f91c0 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:57:11 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-75892721-9dcd-49a3-becc-2a7d0e5f91c0 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:57:11 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-75892721-9dcd-49a3-becc-2a7d0e5f91c0 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75045) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 23:57:11 user nova-compute[75045]: INFO nova.compute.claims [None req-75892721-9dcd-49a3-becc-2a7d0e5f91c0 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] [instance: f2b04024-a109-4b8b-8a7d-1c0fc8712afd] Claim successful on node user
Nov 08 23:57:11 user nova-compute[75045]: DEBUG nova.compute.provider_tree [None req-75892721-9dcd-49a3-becc-2a7d0e5f91c0 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Inventory has not changed in ProviderTree for provider: 62ba5f85-c74d-4b58-986e-d4197e813fd7 {{(pid=75045) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 23:57:11 user nova-compute[75045]: DEBUG nova.scheduler.client.report [None req-75892721-9dcd-49a3-becc-2a7d0e5f91c0 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Inventory has not changed for provider 62ba5f85-c74d-4b58-986e-d4197e813fd7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75045) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 23:57:11 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-75892721-9dcd-49a3-becc-2a7d0e5f91c0 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.272s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:57:11 user nova-compute[75045]: DEBUG nova.compute.manager [None req-75892721-9dcd-49a3-becc-2a7d0e5f91c0 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] [instance: f2b04024-a109-4b8b-8a7d-1c0fc8712afd] Start building networks asynchronously for instance. {{(pid=75045) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 23:57:11 user nova-compute[75045]: DEBUG nova.compute.manager [None req-75892721-9dcd-49a3-becc-2a7d0e5f91c0 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] [instance: f2b04024-a109-4b8b-8a7d-1c0fc8712afd] Allocating IP information in the background. {{(pid=75045) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 23:57:11 user nova-compute[75045]: DEBUG nova.network.neutron [None req-75892721-9dcd-49a3-becc-2a7d0e5f91c0 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] [instance: f2b04024-a109-4b8b-8a7d-1c0fc8712afd] allocate_for_instance() {{(pid=75045) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 23:57:11 user nova-compute[75045]: INFO nova.virt.libvirt.driver [None req-75892721-9dcd-49a3-becc-2a7d0e5f91c0 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] [instance: f2b04024-a109-4b8b-8a7d-1c0fc8712afd] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 23:57:11 user nova-compute[75045]: DEBUG nova.compute.manager [None req-75892721-9dcd-49a3-becc-2a7d0e5f91c0 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] [instance: f2b04024-a109-4b8b-8a7d-1c0fc8712afd] Start building block device mappings for instance. {{(pid=75045) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 23:57:11 user nova-compute[75045]: DEBUG nova.policy [None req-75892721-9dcd-49a3-becc-2a7d0e5f91c0 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '76c31c64d9594f9cbef7586fafb48721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd59b73851c79473a9c2cdc0a120dfee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75045) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 23:57:11 user nova-compute[75045]: INFO nova.virt.block_device [None req-75892721-9dcd-49a3-becc-2a7d0e5f91c0 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] [instance: f2b04024-a109-4b8b-8a7d-1c0fc8712afd] Booting with volume c32ddba4-c092-4e6e-abe5-8dab539439b9 at /dev/vda
Nov 08 23:57:11 user nova-compute[75045]: DEBUG os_brick.utils [None req-75892721-9dcd-49a3-becc-2a7d0e5f91c0 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75045) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 23:57:11 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:57:11 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:57:11 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c1c626c-0656-4b6b-b5ca-2d05a37151e3]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6217bd6e884\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:57:11 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:57:11 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:57:11 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:57:11 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[e488a2b1-dddb-48de-a7ef-fac6590e0e7f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:57:11 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:57:11 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:57:11 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8c545da-805e-4aa3-b870-afca933dfcf6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:57:11 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0621559-8cde-4ca8-9dcb-fb7b9f446dbe]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:57:11 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-75892721-9dcd-49a3-becc-2a7d0e5f91c0 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Running cmd (subprocess): nvme version {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:57:11 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-75892721-9dcd-49a3-becc-2a7d0e5f91c0 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] 'nvme version' failed. Not Retrying. {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 23:57:11 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.nvmeof [None req-75892721-9dcd-49a3-becc-2a7d0e5f91c0 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] nvme not present on system {{(pid=75045) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 23:57:11 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:57:11 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 23:57:11 user nova-compute[75045]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 23:57:11 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[70122a16-3f82-454d-a506-f8661d5a28e0]: (4, '') {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:57:11 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.lightos [None req-75892721-9dcd-49a3-becc-2a7d0e5f91c0 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75045) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 23:57:11 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.lightos [None req-75892721-9dcd-49a3-becc-2a7d0e5f91c0 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75045) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 23:57:11 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.lightos [None req-75892721-9dcd-49a3-becc-2a7d0e5f91c0 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] LIGHTOS: no hostnqn found. {{(pid=75045) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 23:57:11 user nova-compute[75045]: DEBUG os_brick.utils [None req-75892721-9dcd-49a3-becc-2a7d0e5f91c0 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] <== get_connector_properties: return (133ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6217bd6e884', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75045) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 23:57:11 user nova-compute[75045]: DEBUG nova.virt.block_device [None req-75892721-9dcd-49a3-becc-2a7d0e5f91c0 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] [instance: f2b04024-a109-4b8b-8a7d-1c0fc8712afd] Updating existing volume attachment record: 0a8cb458-9956-4968-8fc6-fe08545414bf {{(pid=75045) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 23:57:12 user nova-compute[75045]: DEBUG nova.network.neutron [None req-75892721-9dcd-49a3-becc-2a7d0e5f91c0 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] [instance: f2b04024-a109-4b8b-8a7d-1c0fc8712afd] Successfully created port: e4007497-d23d-4fc2-bba3-e618eec593e2 {{(pid=75045) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 23:57:12 user nova-compute[75045]: DEBUG nova.network.neutron [None req-75892721-9dcd-49a3-becc-2a7d0e5f91c0 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] [instance: f2b04024-a109-4b8b-8a7d-1c0fc8712afd] Successfully updated port: e4007497-d23d-4fc2-bba3-e618eec593e2 {{(pid=75045) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 23:57:12 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-75892721-9dcd-49a3-becc-2a7d0e5f91c0 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Acquiring lock "refresh_cache-f2b04024-a109-4b8b-8a7d-1c0fc8712afd" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 23:57:12 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-75892721-9dcd-49a3-becc-2a7d0e5f91c0 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Acquired lock "refresh_cache-f2b04024-a109-4b8b-8a7d-1c0fc8712afd" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 23:57:12 user nova-compute[75045]: DEBUG nova.network.neutron [None req-75892721-9dcd-49a3-becc-2a7d0e5f91c0 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] [instance: f2b04024-a109-4b8b-8a7d-1c0fc8712afd] Building network info cache for instance {{(pid=75045) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 23:57:12 user nova-compute[75045]: DEBUG nova.compute.manager [req-3aefa9df-41df-423a-9ba6-e0f5aad21b93 req-ccab501a-e1ed-464f-9066-fad15287285a service nova] [instance: f2b04024-a109-4b8b-8a7d-1c0fc8712afd] Received event network-changed-e4007497-d23d-4fc2-bba3-e618eec593e2 {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:57:12 user nova-compute[75045]: DEBUG nova.compute.manager [req-3aefa9df-41df-423a-9ba6-e0f5aad21b93 req-ccab501a-e1ed-464f-9066-fad15287285a service nova] [instance: f2b04024-a109-4b8b-8a7d-1c0fc8712afd] Refreshing instance network info cache due to event network-changed-e4007497-d23d-4fc2-bba3-e618eec593e2. {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 23:57:12 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-3aefa9df-41df-423a-9ba6-e0f5aad21b93 req-ccab501a-e1ed-464f-9066-fad15287285a service nova] Acquiring lock "refresh_cache-f2b04024-a109-4b8b-8a7d-1c0fc8712afd" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 23:57:12 user nova-compute[75045]: DEBUG nova.network.neutron [None req-75892721-9dcd-49a3-becc-2a7d0e5f91c0 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] [instance: f2b04024-a109-4b8b-8a7d-1c0fc8712afd] Instance cache missing network info. {{(pid=75045) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 23:57:13 user nova-compute[75045]: DEBUG nova.network.neutron [None req-75892721-9dcd-49a3-becc-2a7d0e5f91c0 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] [instance: f2b04024-a109-4b8b-8a7d-1c0fc8712afd] Updating instance_info_cache with network_info: [{"id": "e4007497-d23d-4fc2-bba3-e618eec593e2", "address": "fa:16:3e:6c:b3:93", "network": {"id": "4205f899-9865-4c65-8b46-c9a533e9bb45", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-774780781-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d59b73851c79473a9c2cdc0a120dfee0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4007497-d2", "ovs_interfaceid": "e4007497-d23d-4fc2-bba3-e618eec593e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75045) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 23:57:13 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-75892721-9dcd-49a3-becc-2a7d0e5f91c0 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Releasing lock "refresh_cache-f2b04024-a109-4b8b-8a7d-1c0fc8712afd" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 23:57:13 user nova-compute[75045]: DEBUG nova.compute.manager [None req-75892721-9dcd-49a3-becc-2a7d0e5f91c0 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] [instance: f2b04024-a109-4b8b-8a7d-1c0fc8712afd] Instance network_info: |[{"id": "e4007497-d23d-4fc2-bba3-e618eec593e2", "address": "fa:16:3e:6c:b3:93", "network": {"id": "4205f899-9865-4c65-8b46-c9a533e9bb45", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-774780781-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d59b73851c79473a9c2cdc0a120dfee0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4007497-d2", "ovs_interfaceid": "e4007497-d23d-4fc2-bba3-e618eec593e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75045) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 23:57:13 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-3aefa9df-41df-423a-9ba6-e0f5aad21b93 req-ccab501a-e1ed-464f-9066-fad15287285a service nova] Acquired lock "refresh_cache-f2b04024-a109-4b8b-8a7d-1c0fc8712afd" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 23:57:13 user nova-compute[75045]: DEBUG nova.network.neutron [req-3aefa9df-41df-423a-9ba6-e0f5aad21b93 req-ccab501a-e1ed-464f-9066-fad15287285a service nova] [instance: f2b04024-a109-4b8b-8a7d-1c0fc8712afd] Refreshing network info cache for port e4007497-d23d-4fc2-bba3-e618eec593e2 {{(pid=75045) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 23:57:13 user nova-compute[75045]: DEBUG nova.network.neutron [req-3aefa9df-41df-423a-9ba6-e0f5aad21b93 req-ccab501a-e1ed-464f-9066-fad15287285a service nova] [instance: f2b04024-a109-4b8b-8a7d-1c0fc8712afd] Updated VIF entry in instance network info cache for port e4007497-d23d-4fc2-bba3-e618eec593e2. {{(pid=75045) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 23:57:13 user nova-compute[75045]: DEBUG nova.network.neutron [req-3aefa9df-41df-423a-9ba6-e0f5aad21b93 req-ccab501a-e1ed-464f-9066-fad15287285a service nova] [instance: f2b04024-a109-4b8b-8a7d-1c0fc8712afd] Updating instance_info_cache with network_info: [{"id": "e4007497-d23d-4fc2-bba3-e618eec593e2", "address": "fa:16:3e:6c:b3:93", "network": {"id": "4205f899-9865-4c65-8b46-c9a533e9bb45", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-774780781-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d59b73851c79473a9c2cdc0a120dfee0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4007497-d2", "ovs_interfaceid": "e4007497-d23d-4fc2-bba3-e618eec593e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75045) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 23:57:13 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-3aefa9df-41df-423a-9ba6-e0f5aad21b93 req-ccab501a-e1ed-464f-9066-fad15287285a service nova] Releasing lock "refresh_cache-f2b04024-a109-4b8b-8a7d-1c0fc8712afd" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 23:57:14 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-d887fd5f-fc1a-454d-97f5-1060763b3813 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] Acquiring lock "8d9a47ed-6aa3-468f-b106-46b60cd27a46" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:57:14 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-d887fd5f-fc1a-454d-97f5-1060763b3813 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] Lock "8d9a47ed-6aa3-468f-b106-46b60cd27a46" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:57:14 user nova-compute[75045]: DEBUG nova.objects.instance [None req-d887fd5f-fc1a-454d-97f5-1060763b3813 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] Lazy-loading 'flavor' on Instance uuid 8d9a47ed-6aa3-468f-b106-46b60cd27a46 {{(pid=75045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 23:57:14 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-d887fd5f-fc1a-454d-97f5-1060763b3813 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] Lock "8d9a47ed-6aa3-468f-b106-46b60cd27a46" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.096s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:57:14 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-d887fd5f-fc1a-454d-97f5-1060763b3813 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] Acquiring lock "8d9a47ed-6aa3-468f-b106-46b60cd27a46" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:57:14 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-d887fd5f-fc1a-454d-97f5-1060763b3813 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] Lock "8d9a47ed-6aa3-468f-b106-46b60cd27a46" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:57:14 user nova-compute[75045]: INFO nova.compute.manager [None req-d887fd5f-fc1a-454d-97f5-1060763b3813 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] [instance: 8d9a47ed-6aa3-468f-b106-46b60cd27a46] Attaching volume 6204dd7b-f1fa-43fe-ab4b-ada1efb74e9c to /dev/vdb
Nov 08 23:57:14 user nova-compute[75045]: DEBUG os_brick.utils [None req-d887fd5f-fc1a-454d-97f5-1060763b3813 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75045) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 23:57:14 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:57:14 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:57:14 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[81b6c53b-8cef-4b4b-978f-72f2c8f7359a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6217bd6e884\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:57:14 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:57:14 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.021s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:57:14 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[04a159a8-114e-4b20-8f8d-325260eafb64]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:57:14 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:57:14 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:57:14 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[66414785-b864-4296-b587-f29b0853beaf]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:57:14 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb03b2fc-aa83-4a6d-829e-042e9d3641b7]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:57:14 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-d887fd5f-fc1a-454d-97f5-1060763b3813 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] Running cmd (subprocess): nvme version {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:57:14 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-d887fd5f-fc1a-454d-97f5-1060763b3813 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] 'nvme version' failed. Not Retrying. {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 23:57:14 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d887fd5f-fc1a-454d-97f5-1060763b3813 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] nvme not present on system {{(pid=75045) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 23:57:14 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:57:14 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 23:57:14 user nova-compute[75045]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 23:57:14 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[329495ee-c7d4-4e18-862d-de59e0f57bee]: (4, '') {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:57:14 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.lightos [None req-d887fd5f-fc1a-454d-97f5-1060763b3813 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75045) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 23:57:14 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.lightos [None req-d887fd5f-fc1a-454d-97f5-1060763b3813 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75045) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 23:57:14 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.lightos [None req-d887fd5f-fc1a-454d-97f5-1060763b3813 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] LIGHTOS: no hostnqn found. {{(pid=75045) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 23:57:14 user nova-compute[75045]: DEBUG os_brick.utils [None req-d887fd5f-fc1a-454d-97f5-1060763b3813 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] <== get_connector_properties: return (137ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6217bd6e884', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75045) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 23:57:14 user nova-compute[75045]: DEBUG nova.virt.block_device [None req-d887fd5f-fc1a-454d-97f5-1060763b3813 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] [instance: 8d9a47ed-6aa3-468f-b106-46b60cd27a46] Updating existing volume attachment record: b9bda88e-7436-4456-b56d-e9a284f6d1b5 {{(pid=75045) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 23:57:16 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 23:57:17 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager.update_available_resource {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:57:18 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:57:18 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.002s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:57:18 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:57:18 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Auditing locally available compute resources for user (node: user) {{(pid=75045) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 23:57:18 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75045) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 23:57:18 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d9a47ed-6aa3-468f-b106-46b60cd27a46/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:57:18 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d9a47ed-6aa3-468f-b106-46b60cd27a46/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:57:18 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d9a47ed-6aa3-468f-b106-46b60cd27a46/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:57:18 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d9a47ed-6aa3-468f-b106-46b60cd27a46/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:57:18 user nova-compute[75045]: WARNING nova.virt.libvirt.driver [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 23:57:18 user nova-compute[75045]: WARNING nova.virt.libvirt.driver [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 23:57:18 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Hypervisor/Node resource view: name=user free_ram=8723MB free_disk=24.907520294189453GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75045) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 23:57:18 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:57:18 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:57:19 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Instance df16d913-9985-415f-aedc-14f2ca5bcf13 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75045) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 23:57:19 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Instance 8d9a47ed-6aa3-468f-b106-46b60cd27a46 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75045) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 23:57:19 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Instance f2b04024-a109-4b8b-8a7d-1c0fc8712afd actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75045) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 23:57:19 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=75045) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 23:57:19 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=75045) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 23:57:19 user nova-compute[75045]: DEBUG nova.scheduler.client.report [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Refreshing inventories for resource provider 62ba5f85-c74d-4b58-986e-d4197e813fd7 {{(pid=75045) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 08 23:57:19 user nova-compute[75045]: DEBUG nova.scheduler.client.report [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Updating ProviderTree inventory for provider 62ba5f85-c74d-4b58-986e-d4197e813fd7 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75045) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 08 23:57:19 user nova-compute[75045]: DEBUG nova.compute.provider_tree [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Updating inventory in ProviderTree for provider 62ba5f85-c74d-4b58-986e-d4197e813fd7 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75045) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 08 23:57:19 user nova-compute[75045]: DEBUG nova.scheduler.client.report [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Refreshing aggregate associations for resource provider 62ba5f85-c74d-4b58-986e-d4197e813fd7, aggregates: None {{(pid=75045) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 08 23:57:19 user nova-compute[75045]: DEBUG nova.scheduler.client.report [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Refreshing trait associations for resource provider 62ba5f85-c74d-4b58-986e-d4197e813fd7, traits: COMPUTE_STORAGE_BUS_SCSI,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_TRUSTED_CERTS,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_VIRTIO,HW_CPU_X86_SSSE3,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_FDC,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_RESCUE_BFV,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSE2,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN {{(pid=75045) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 08 23:57:19 user nova-compute[75045]: DEBUG nova.compute.provider_tree [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Inventory has not changed in ProviderTree for provider: 62ba5f85-c74d-4b58-986e-d4197e813fd7 {{(pid=75045) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 23:57:19 user nova-compute[75045]: DEBUG nova.scheduler.client.report [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Inventory has not changed for provider 62ba5f85-c74d-4b58-986e-d4197e813fd7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75045) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 23:57:19 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Compute_service record updated for user:user {{(pid=75045) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 23:57:19 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.442s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:57:20 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:57:20 user nova-compute[75045]: DEBUG nova.compute.manager [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Cleaning up deleted instances {{(pid=75045) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 08 23:57:20 user nova-compute[75045]: DEBUG nova.compute.manager [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] There are 0 instances to clean {{(pid=75045) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 08 23:57:21 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 23:57:25 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:57:25 user nova-compute[75045]: DEBUG nova.compute.manager [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Cleaning up deleted instances with incomplete migration  {{(pid=75045) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 08 23:57:26 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 23:57:26 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:57:27 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:57:31 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:57:35 user nova-compute[75045]: DEBUG nova.compute.manager [None req-75892721-9dcd-49a3-becc-2a7d0e5f91c0 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] [instance: f2b04024-a109-4b8b-8a7d-1c0fc8712afd] Start spawning the instance on the hypervisor. {{(pid=75045) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 23:57:35 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-75892721-9dcd-49a3-becc-2a7d0e5f91c0 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] [instance: f2b04024-a109-4b8b-8a7d-1c0fc8712afd] Creating instance directory {{(pid=75045) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 23:57:35 user nova-compute[75045]: INFO nova.virt.libvirt.driver [None req-75892721-9dcd-49a3-becc-2a7d0e5f91c0 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] [instance: f2b04024-a109-4b8b-8a7d-1c0fc8712afd] Creating image(s)
Nov 08 23:57:35 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-75892721-9dcd-49a3-becc-2a7d0e5f91c0 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] [instance: f2b04024-a109-4b8b-8a7d-1c0fc8712afd] Did not create local disks {{(pid=75045) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 08 23:57:35 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-75892721-9dcd-49a3-becc-2a7d0e5f91c0 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] [instance: f2b04024-a109-4b8b-8a7d-1c0fc8712afd] Ensure instance console log exists: /opt/stack/data/nova/instances/f2b04024-a109-4b8b-8a7d-1c0fc8712afd/console.log {{(pid=75045) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 23:57:35 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-75892721-9dcd-49a3-becc-2a7d0e5f91c0 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:57:35 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-75892721-9dcd-49a3-becc-2a7d0e5f91c0 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:57:35 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-75892721-9dcd-49a3-becc-2a7d0e5f91c0 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:57:35 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-75892721-9dcd-49a3-becc-2a7d0e5f91c0 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] [instance: f2b04024-a109-4b8b-8a7d-1c0fc8712afd] Start _get_guest_xml network_info=[{"id": "e4007497-d23d-4fc2-bba3-e618eec593e2", "address": "fa:16:3e:6c:b3:93", "network": {"id": "4205f899-9865-4c65-8b46-c9a533e9bb45", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-774780781-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d59b73851c79473a9c2cdc0a120dfee0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4007497-d2", "ovs_interfaceid": "e4007497-d23d-4fc2-bba3-e618eec593e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'device_type': 'disk', 'attachment_id': '0a8cb458-9956-4968-8fc6-fe08545414bf', 'guest_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:c32ddba4-c092-4e6e-abe5-8dab539439b9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yMhRfWug', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'f2b04024-a109-4b8b-8a7d-1c0fc8712afd', 'attached_at': '', 'detached_at': '', 'volume_id': 'c32ddba4-c092-4e6e-abe5-8dab539439b9', 'serial': 'c32ddba4-c092-4e6e-abe5-8dab539439b9'}, 'volume_type': None} {{(pid=75045) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 23:57:35 user nova-compute[75045]: WARNING nova.virt.libvirt.driver [None req-75892721-9dcd-49a3-becc-2a7d0e5f91c0 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 23:57:35 user nova-compute[75045]: WARNING nova.virt.libvirt.driver [None req-75892721-9dcd-49a3-becc-2a7d0e5f91c0 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 23:57:35 user nova-compute[75045]: DEBUG nova.virt.libvirt.host [None req-75892721-9dcd-49a3-becc-2a7d0e5f91c0 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75045) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 23:57:35 user nova-compute[75045]: DEBUG nova.virt.libvirt.host [None req-75892721-9dcd-49a3-becc-2a7d0e5f91c0 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] CPU controller missing on host. {{(pid=75045) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 23:57:35 user nova-compute[75045]: DEBUG nova.virt.libvirt.host [None req-75892721-9dcd-49a3-becc-2a7d0e5f91c0 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75045) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 23:57:35 user nova-compute[75045]: DEBUG nova.virt.libvirt.host [None req-75892721-9dcd-49a3-becc-2a7d0e5f91c0 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] CPU controller found on host. {{(pid=75045) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 23:57:35 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-75892721-9dcd-49a3-becc-2a7d0e5f91c0 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75045) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 23:57:35 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-75892721-9dcd-49a3-becc-2a7d0e5f91c0 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T23:11:41Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75045) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 23:57:35 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-75892721-9dcd-49a3-becc-2a7d0e5f91c0 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Flavor limits 0:0:0 {{(pid=75045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 23:57:35 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-75892721-9dcd-49a3-becc-2a7d0e5f91c0 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Image limits 0:0:0 {{(pid=75045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 23:57:35 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-75892721-9dcd-49a3-becc-2a7d0e5f91c0 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Flavor pref 0:0:0 {{(pid=75045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 23:57:35 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-75892721-9dcd-49a3-becc-2a7d0e5f91c0 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Image pref 0:0:0 {{(pid=75045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 23:57:35 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-75892721-9dcd-49a3-becc-2a7d0e5f91c0 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 23:57:35 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-75892721-9dcd-49a3-becc-2a7d0e5f91c0 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75045) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 23:57:35 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-75892721-9dcd-49a3-becc-2a7d0e5f91c0 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75045) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 23:57:35 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-75892721-9dcd-49a3-becc-2a7d0e5f91c0 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Got 1 possible topologies {{(pid=75045) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 23:57:35 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-75892721-9dcd-49a3-becc-2a7d0e5f91c0 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75045) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 23:57:35 user nova-compute[75045]: DEBUG nova.virt.hardware [None req-75892721-9dcd-49a3-becc-2a7d0e5f91c0 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75045) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 23:57:35 user nova-compute[75045]: DEBUG nova.virt.libvirt.volume.iscsi [None req-75892721-9dcd-49a3-becc-2a7d0e5f91c0 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] [instance: f2b04024-a109-4b8b-8a7d-1c0fc8712afd] Calling os-brick to attach iSCSI Volume {{(pid=75045) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 23:57:35 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-75892721-9dcd-49a3-becc-2a7d0e5f91c0 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1b68210460>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c32ddba4-c092-4e6e-abe5-8dab539439b9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yMhRfWug', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75045) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 23:57:35 user nova-compute[75045]: WARNING os_brick.initiator.connectors.base [None req-75892721-9dcd-49a3-becc-2a7d0e5f91c0 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 23:57:35 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-75892721-9dcd-49a3-becc-2a7d0e5f91c0 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 23:57:35 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-75892721-9dcd-49a3-becc-2a7d0e5f91c0 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 23:57:35 user nova-compute[75045]: WARNING os_brick.initiator.connectors.base [None req-75892721-9dcd-49a3-becc-2a7d0e5f91c0 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 23:57:35 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-75892721-9dcd-49a3-becc-2a7d0e5f91c0 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c32ddba4-c092-4e6e-abe5-8dab539439b9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 23:57:35 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-75892721-9dcd-49a3-becc-2a7d0e5f91c0 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c32ddba4-c092-4e6e-abe5-8dab539439b9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 23:57:35 user nova-compute[75045]: INFO os_brick.initiator.connectors.iscsi [None req-75892721-9dcd-49a3-becc-2a7d0e5f91c0 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 23:57:35 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c32ddba4-c092-4e6e-abe5-8dab539439b9 -p 172.16.0.220:3260 {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:57:35 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c32ddba4-c092-4e6e-abe5-8dab539439b9 -p 172.16.0.220:3260" returned: 21 in 0.027s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:57:35 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebb0fc20-c6ac-48af-a415-ceb44180b19f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:57:35 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-75892721-9dcd-49a3-becc-2a7d0e5f91c0 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 23:57:35 user nova-compute[75045]:  {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:57:35 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c32ddba4-c092-4e6e-abe5-8dab539439b9 -p 172.16.0.220:3260 --interface default --op new {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:57:35 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c32ddba4-c092-4e6e-abe5-8dab539439b9 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:57:35 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[77fc4528-8dd4-41f4-90aa-e65ed78b585c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c32ddba4-c092-4e6e-abe5-8dab539439b9] added\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:57:35 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-75892721-9dcd-49a3-becc-2a7d0e5f91c0 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c32ddba4-c092-4e6e-abe5-8dab539439b9] added
Nov 08 23:57:35 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:57:35 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c32ddba4-c092-4e6e-abe5-8dab539439b9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:57:35 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c32ddba4-c092-4e6e-abe5-8dab539439b9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:57:35 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[bed1d45a-3054-4bd5-86d2-234c35dd0cbf]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:57:35 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-75892721-9dcd-49a3-becc-2a7d0e5f91c0 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:57:35 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c32ddba4-c092-4e6e-abe5-8dab539439b9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:57:35 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c32ddba4-c092-4e6e-abe5-8dab539439b9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:57:35 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[63e60020-dac1-4686-a58b-d79ee90460c6]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:57:35 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-75892721-9dcd-49a3-becc-2a7d0e5f91c0 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:57:35 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c32ddba4-c092-4e6e-abe5-8dab539439b9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yMhRfWug {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:57:35 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c32ddba4-c092-4e6e-abe5-8dab539439b9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yMhRfWug" returned: 0 in 0.018s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:57:35 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f2181cb-0e81-41e1-9f53-fb4f88e326c8]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:57:35 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-75892721-9dcd-49a3-becc-2a7d0e5f91c0 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'yMhRfWug'): stdout= stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:57:35 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c32ddba4-c092-4e6e-abe5-8dab539439b9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:57:35 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c32ddba4-c092-4e6e-abe5-8dab539439b9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:57:35 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4b8ccaa-2343-4a62-805c-7775a20bd6a5]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:57:35 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-75892721-9dcd-49a3-becc-2a7d0e5f91c0 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:57:35 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:57:36 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:57:36 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[55a12f85-16b2-43d3-9916-08072b8e8cc6]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcbd911e-f385-4ed6-b8a4-383b3b56cf7d (non-flash)\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:57:36 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-75892721-9dcd-49a3-becc-2a7d0e5f91c0 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcbd911e-f385-4ed6-b8a4-383b3b56cf7d (non-flash)
Nov 08 23:57:36 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 23:57:36 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-75892721-9dcd-49a3-becc-2a7d0e5f91c0 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcbd911e-f385-4ed6-b8a4-383b3b56cf7d (non-flash)
Nov 08 23:57:36 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 23:57:36 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c32ddba4-c092-4e6e-abe5-8dab539439b9 -p 172.16.0.220:3260 --login {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:57:36 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c32ddba4-c092-4e6e-abe5-8dab539439b9 -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:57:36 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[964c09c6-2e77-4dea-8ffc-fe870fdcf972]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c32ddba4-c092-4e6e-abe5-8dab539439b9, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c32ddba4-c092-4e6e-abe5-8dab539439b9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:57:36 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-75892721-9dcd-49a3-becc-2a7d0e5f91c0 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c32ddba4-c092-4e6e-abe5-8dab539439b9, portal: 172.16.0.220,3260]
Nov 08 23:57:36 user nova-compute[75045]: Login to [iface: default, target: iqn.2010-10.org.openstack:c32ddba4-c092-4e6e-abe5-8dab539439b9, portal: 172.16.0.220,3260] successful.
Nov 08 23:57:36 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:57:36 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c32ddba4-c092-4e6e-abe5-8dab539439b9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:57:36 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c32ddba4-c092-4e6e-abe5-8dab539439b9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:57:36 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[c758877d-b406-45e3-9bcf-5c461bbef059]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:57:36 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-75892721-9dcd-49a3-becc-2a7d0e5f91c0 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:57:36 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:57:36 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:57:36 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[87daf93d-09b8-4231-b127-dcb00c8e0180]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcbd911e-f385-4ed6-b8a4-383b3b56cf7d (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c32ddba4-c092-4e6e-abe5-8dab539439b9 (non-flash)\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:57:36 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-75892721-9dcd-49a3-becc-2a7d0e5f91c0 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcbd911e-f385-4ed6-b8a4-383b3b56cf7d (non-flash)
Nov 08 23:57:36 user nova-compute[75045]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c32ddba4-c092-4e6e-abe5-8dab539439b9 (non-flash)
Nov 08 23:57:36 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 23:57:36 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-75892721-9dcd-49a3-becc-2a7d0e5f91c0 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcbd911e-f385-4ed6-b8a4-383b3b56cf7d (non-flash)
Nov 08 23:57:36 user nova-compute[75045]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c32ddba4-c092-4e6e-abe5-8dab539439b9 (non-flash)
Nov 08 23:57:36 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 23:57:36 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-75892721-9dcd-49a3-becc-2a7d0e5f91c0 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c32ddba4-c092-4e6e-abe5-8dab539439b9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.292s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 23:57:36 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-75892721-9dcd-49a3-becc-2a7d0e5f91c0 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Connected to 172.16.0.220:3260 {{(pid=75045) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 23:57:36 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-75892721-9dcd-49a3-becc-2a7d0e5f91c0 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] HCTL ('33', '-', '-', 0) found on session 53 with lun 0 {{(pid=75045) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 23:57:36 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-75892721-9dcd-49a3-becc-2a7d0e5f91c0 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75045) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 23:57:36 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:57:36 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:57:36 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac51a05c-f7eb-4b21-b829-f6e5fc7f8a2a]: (4, ('- - 0', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:57:36 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-75892721-9dcd-49a3-becc-2a7d0e5f91c0 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Searching for a device in session 53 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75045) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 23:57:36 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-75892721-9dcd-49a3-becc-2a7d0e5f91c0 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:c32ddba4-c092-4e6e-abe5-8dab539439b9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yMhRfWug', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75045) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 23:57:36 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 23:57:37 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-75892721-9dcd-49a3-becc-2a7d0e5f91c0 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.325s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 23:57:37 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-75892721-9dcd-49a3-becc-2a7d0e5f91c0 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] <== connect_volume: return (1327ms) {'type': 'block', 'scsi_wwn': '26439643736343737', 'path': '/dev/sdb'} {{(pid=75045) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 23:57:37 user nova-compute[75045]: DEBUG nova.virt.libvirt.volume.iscsi [None req-75892721-9dcd-49a3-becc-2a7d0e5f91c0 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] [instance: f2b04024-a109-4b8b-8a7d-1c0fc8712afd] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26439643736343737', 'path': '/dev/sdb'} {{(pid=75045) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 23:57:37 user nova-compute[75045]: DEBUG nova.virt.libvirt.vif [None req-75892721-9dcd-49a3-becc-2a7d0e5f91c0 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T23:57:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1479224387',display_name='tempest-TestVolumeBootPattern-server-1479224387',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1479224387',id=52,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG4FMrZDNuVfIPnXfxN4nyoUo/5k5pInfzFUTQXcG54GN3K7TKcBDzRT7RSwNm2HHReK/sg/U9LFWtj081VW6fTpNzjBNfOxhMg0DqXN9g7DbQBYyYNAjTBN+tAvF+1fCA==',key_name='tempest-TestVolumeBootPattern-1614211608',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d59b73851c79473a9c2cdc0a120dfee0',ramdisk_id='',reservation_id='r-1nrdzycw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-650796844',owner_user_name='tempest-TestVolumeBootPattern-650796844-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T23:57:11Z,user_data=None,user_id='76c31c64d9594f9cbef7586fafb48721',uuid=f2b04024-a109-4b8b-8a7d-1c0fc8712afd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e4007497-d23d-4fc2-bba3-e618eec593e2", "address": "fa:16:3e:6c:b3:93", "network": {"id": "4205f899-9865-4c65-8b46-c9a533e9bb45", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-774780781-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d59b73851c79473a9c2cdc0a120dfee0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4007497-d2", "ovs_interfaceid": "e4007497-d23d-4fc2-bba3-e618eec593e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75045) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 23:57:37 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-75892721-9dcd-49a3-becc-2a7d0e5f91c0 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Converting VIF {"id": "e4007497-d23d-4fc2-bba3-e618eec593e2", "address": "fa:16:3e:6c:b3:93", "network": {"id": "4205f899-9865-4c65-8b46-c9a533e9bb45", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-774780781-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d59b73851c79473a9c2cdc0a120dfee0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4007497-d2", "ovs_interfaceid": "e4007497-d23d-4fc2-bba3-e618eec593e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 23:57:37 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-75892721-9dcd-49a3-becc-2a7d0e5f91c0 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6c:b3:93,bridge_name='br-int',has_traffic_filtering=True,id=e4007497-d23d-4fc2-bba3-e618eec593e2,network=Network(4205f899-9865-4c65-8b46-c9a533e9bb45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape4007497-d2') {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 23:57:37 user nova-compute[75045]: DEBUG nova.objects.instance [None req-75892721-9dcd-49a3-becc-2a7d0e5f91c0 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Lazy-loading 'pci_devices' on Instance uuid f2b04024-a109-4b8b-8a7d-1c0fc8712afd {{(pid=75045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 23:57:37 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-75892721-9dcd-49a3-becc-2a7d0e5f91c0 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] [instance: f2b04024-a109-4b8b-8a7d-1c0fc8712afd] End _get_guest_xml xml=<domain type="kvm">
Nov 08 23:57:37 user nova-compute[75045]:   <uuid>f2b04024-a109-4b8b-8a7d-1c0fc8712afd</uuid>
Nov 08 23:57:37 user nova-compute[75045]:   <name>instance-00000034</name>
Nov 08 23:57:37 user nova-compute[75045]:   <memory>524288</memory>
Nov 08 23:57:37 user nova-compute[75045]:   <vcpu>1</vcpu>
Nov 08 23:57:37 user nova-compute[75045]:   <metadata>
Nov 08 23:57:37 user nova-compute[75045]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 23:57:37 user nova-compute[75045]:       <nova:package version="0.0.0"/>
Nov 08 23:57:37 user nova-compute[75045]:       <nova:name>tempest-TestVolumeBootPattern-server-1479224387</nova:name>
Nov 08 23:57:37 user nova-compute[75045]:       <nova:creationTime>2023-11-08 23:57:35</nova:creationTime>
Nov 08 23:57:37 user nova-compute[75045]:       <nova:flavor name="m1.tiny">
Nov 08 23:57:37 user nova-compute[75045]:         <nova:memory>512</nova:memory>
Nov 08 23:57:37 user nova-compute[75045]:         <nova:disk>1</nova:disk>
Nov 08 23:57:37 user nova-compute[75045]:         <nova:swap>0</nova:swap>
Nov 08 23:57:37 user nova-compute[75045]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 23:57:37 user nova-compute[75045]:         <nova:vcpus>1</nova:vcpus>
Nov 08 23:57:37 user nova-compute[75045]:       </nova:flavor>
Nov 08 23:57:37 user nova-compute[75045]:       <nova:owner>
Nov 08 23:57:37 user nova-compute[75045]:         <nova:user uuid="76c31c64d9594f9cbef7586fafb48721">tempest-TestVolumeBootPattern-650796844-project-member</nova:user>
Nov 08 23:57:37 user nova-compute[75045]:         <nova:project uuid="d59b73851c79473a9c2cdc0a120dfee0">tempest-TestVolumeBootPattern-650796844</nova:project>
Nov 08 23:57:37 user nova-compute[75045]:       </nova:owner>
Nov 08 23:57:37 user nova-compute[75045]:       <nova:ports>
Nov 08 23:57:37 user nova-compute[75045]:         <nova:port uuid="e4007497-d23d-4fc2-bba3-e618eec593e2">
Nov 08 23:57:37 user nova-compute[75045]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 08 23:57:37 user nova-compute[75045]:         </nova:port>
Nov 08 23:57:37 user nova-compute[75045]:       </nova:ports>
Nov 08 23:57:37 user nova-compute[75045]:     </nova:instance>
Nov 08 23:57:37 user nova-compute[75045]:   </metadata>
Nov 08 23:57:37 user nova-compute[75045]:   <sysinfo type="smbios">
Nov 08 23:57:37 user nova-compute[75045]:     <system>
Nov 08 23:57:37 user nova-compute[75045]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 23:57:37 user nova-compute[75045]:       <entry name="product">OpenStack Nova</entry>
Nov 08 23:57:37 user nova-compute[75045]:       <entry name="version">0.0.0</entry>
Nov 08 23:57:37 user nova-compute[75045]:       <entry name="serial">f2b04024-a109-4b8b-8a7d-1c0fc8712afd</entry>
Nov 08 23:57:37 user nova-compute[75045]:       <entry name="uuid">f2b04024-a109-4b8b-8a7d-1c0fc8712afd</entry>
Nov 08 23:57:37 user nova-compute[75045]:       <entry name="family">Virtual Machine</entry>
Nov 08 23:57:37 user nova-compute[75045]:     </system>
Nov 08 23:57:37 user nova-compute[75045]:   </sysinfo>
Nov 08 23:57:37 user nova-compute[75045]:   <os>
Nov 08 23:57:37 user nova-compute[75045]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 23:57:37 user nova-compute[75045]:     <boot dev="hd"/>
Nov 08 23:57:37 user nova-compute[75045]:     <smbios mode="sysinfo"/>
Nov 08 23:57:37 user nova-compute[75045]:   </os>
Nov 08 23:57:37 user nova-compute[75045]:   <features>
Nov 08 23:57:37 user nova-compute[75045]:     <acpi/>
Nov 08 23:57:37 user nova-compute[75045]:     <apic/>
Nov 08 23:57:37 user nova-compute[75045]:     <vmcoreinfo/>
Nov 08 23:57:37 user nova-compute[75045]:   </features>
Nov 08 23:57:37 user nova-compute[75045]:   <clock offset="utc">
Nov 08 23:57:37 user nova-compute[75045]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 23:57:37 user nova-compute[75045]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 23:57:37 user nova-compute[75045]:     <timer name="hpet" present="no"/>
Nov 08 23:57:37 user nova-compute[75045]:   </clock>
Nov 08 23:57:37 user nova-compute[75045]:   <cpu mode="custom" match="exact">
Nov 08 23:57:37 user nova-compute[75045]:     <model>Nehalem</model>
Nov 08 23:57:37 user nova-compute[75045]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 23:57:37 user nova-compute[75045]:   </cpu>
Nov 08 23:57:37 user nova-compute[75045]:   <devices>
Nov 08 23:57:37 user nova-compute[75045]:     <disk type="block" device="disk">
Nov 08 23:57:37 user nova-compute[75045]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 23:57:37 user nova-compute[75045]:       <source dev="/dev/sdb"/>
Nov 08 23:57:37 user nova-compute[75045]:       <target dev="vda" bus="virtio"/>
Nov 08 23:57:37 user nova-compute[75045]:       <serial>c32ddba4-c092-4e6e-abe5-8dab539439b9</serial>
Nov 08 23:57:37 user nova-compute[75045]:     </disk>
Nov 08 23:57:37 user nova-compute[75045]:     <interface type="ethernet">
Nov 08 23:57:37 user nova-compute[75045]:       <mac address="fa:16:3e:6c:b3:93"/>
Nov 08 23:57:37 user nova-compute[75045]:       <model type="virtio"/>
Nov 08 23:57:37 user nova-compute[75045]:       <mtu size="1442"/>
Nov 08 23:57:37 user nova-compute[75045]:       <target dev="tape4007497-d2"/>
Nov 08 23:57:37 user nova-compute[75045]:     </interface>
Nov 08 23:57:37 user nova-compute[75045]:     <serial type="pty">
Nov 08 23:57:37 user nova-compute[75045]:       <log file="/opt/stack/data/nova/instances/f2b04024-a109-4b8b-8a7d-1c0fc8712afd/console.log" append="off"/>
Nov 08 23:57:37 user nova-compute[75045]:     </serial>
Nov 08 23:57:37 user nova-compute[75045]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 23:57:37 user nova-compute[75045]:     <video>
Nov 08 23:57:37 user nova-compute[75045]:       <model type="virtio"/>
Nov 08 23:57:37 user nova-compute[75045]:     </video>
Nov 08 23:57:37 user nova-compute[75045]:     <rng model="virtio">
Nov 08 23:57:37 user nova-compute[75045]:       <backend model="random">/dev/urandom</backend>
Nov 08 23:57:37 user nova-compute[75045]:     </rng>
Nov 08 23:57:37 user nova-compute[75045]:     <controller type="usb" index="0" model="none"/>
Nov 08 23:57:37 user nova-compute[75045]:     <memballoon model="virtio">
Nov 08 23:57:37 user nova-compute[75045]:       <stats period="10"/>
Nov 08 23:57:37 user nova-compute[75045]:     </memballoon>
Nov 08 23:57:37 user nova-compute[75045]:   </devices>
Nov 08 23:57:37 user nova-compute[75045]: </domain>
Nov 08 23:57:37 user nova-compute[75045]:  {{(pid=75045) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 23:57:37 user nova-compute[75045]: DEBUG nova.virt.libvirt.vif [None req-75892721-9dcd-49a3-becc-2a7d0e5f91c0 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T23:57:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1479224387',display_name='tempest-TestVolumeBootPattern-server-1479224387',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1479224387',id=52,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG4FMrZDNuVfIPnXfxN4nyoUo/5k5pInfzFUTQXcG54GN3K7TKcBDzRT7RSwNm2HHReK/sg/U9LFWtj081VW6fTpNzjBNfOxhMg0DqXN9g7DbQBYyYNAjTBN+tAvF+1fCA==',key_name='tempest-TestVolumeBootPattern-1614211608',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d59b73851c79473a9c2cdc0a120dfee0',ramdisk_id='',reservation_id='r-1nrdzycw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-650796844',owner_user_name='tempest-TestVolumeBootPattern-650796844-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T23:57:11Z,user_data=None,user_id='76c31c64d9594f9cbef7586fafb48721',uuid=f2b04024-a109-4b8b-8a7d-1c0fc8712afd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e4007497-d23d-4fc2-bba3-e618eec593e2", "address": "fa:16:3e:6c:b3:93", "network": {"id": "4205f899-9865-4c65-8b46-c9a533e9bb45", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-774780781-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d59b73851c79473a9c2cdc0a120dfee0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4007497-d2", "ovs_interfaceid": "e4007497-d23d-4fc2-bba3-e618eec593e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75045) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 23:57:37 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-75892721-9dcd-49a3-becc-2a7d0e5f91c0 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Converting VIF {"id": "e4007497-d23d-4fc2-bba3-e618eec593e2", "address": "fa:16:3e:6c:b3:93", "network": {"id": "4205f899-9865-4c65-8b46-c9a533e9bb45", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-774780781-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d59b73851c79473a9c2cdc0a120dfee0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4007497-d2", "ovs_interfaceid": "e4007497-d23d-4fc2-bba3-e618eec593e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 23:57:37 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-75892721-9dcd-49a3-becc-2a7d0e5f91c0 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6c:b3:93,bridge_name='br-int',has_traffic_filtering=True,id=e4007497-d23d-4fc2-bba3-e618eec593e2,network=Network(4205f899-9865-4c65-8b46-c9a533e9bb45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape4007497-d2') {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 23:57:37 user nova-compute[75045]: DEBUG os_vif [None req-75892721-9dcd-49a3-becc-2a7d0e5f91c0 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6c:b3:93,bridge_name='br-int',has_traffic_filtering=True,id=e4007497-d23d-4fc2-bba3-e618eec593e2,network=Network(4205f899-9865-4c65-8b46-c9a533e9bb45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape4007497-d2') {{(pid=75045) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 23:57:37 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:57:37 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:57:37 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 23:57:37 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:57:37 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b587b34b-4ba8-529d-b1ae-5a4b0675e994', '_type': 'linux-noop'}}, row=False) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:57:37 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 23:57:37 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:57:37 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape4007497-d2, may_exist=True, interface_attrs={}) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:57:37 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape4007497-d2, col_values=(('qos', UUID('2a6ee86c-cc0e-4554-8ee6-599aca6e45c0')),), if_exists=True) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:57:37 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape4007497-d2, col_values=(('external_ids', {'iface-id': 'e4007497-d23d-4fc2-bba3-e618eec593e2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6c:b3:93', 'vm-uuid': 'f2b04024-a109-4b8b-8a7d-1c0fc8712afd'}),), if_exists=True) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:57:37 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 23:57:37 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:57:37 user nova-compute[75045]: INFO os_vif [None req-75892721-9dcd-49a3-becc-2a7d0e5f91c0 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6c:b3:93,bridge_name='br-int',has_traffic_filtering=True,id=e4007497-d23d-4fc2-bba3-e618eec593e2,network=Network(4205f899-9865-4c65-8b46-c9a533e9bb45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape4007497-d2')
Nov 08 23:57:37 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-75892721-9dcd-49a3-becc-2a7d0e5f91c0 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] No BDM found with device name vda, not building metadata. {{(pid=75045) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 23:57:37 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-75892721-9dcd-49a3-becc-2a7d0e5f91c0 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] No VIF found with MAC fa:16:3e:6c:b3:93, not building metadata {{(pid=75045) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 23:57:38 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:57:38 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:57:38 user nova-compute[75045]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d887fd5f-fc1a-454d-97f5-1060763b3813 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] [instance: 8d9a47ed-6aa3-468f-b106-46b60cd27a46] Calling os-brick to attach iSCSI Volume {{(pid=75045) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 23:57:38 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-d887fd5f-fc1a-454d-97f5-1060763b3813 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1b68210460>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:6204dd7b-f1fa-43fe-ab4b-ada1efb74e9c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ueWBwFrj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75045) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 23:57:38 user nova-compute[75045]: WARNING os_brick.initiator.connectors.base [None req-d887fd5f-fc1a-454d-97f5-1060763b3813 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 23:57:38 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-d887fd5f-fc1a-454d-97f5-1060763b3813 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 23:57:38 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-d887fd5f-fc1a-454d-97f5-1060763b3813 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 23:57:38 user nova-compute[75045]: WARNING os_brick.initiator.connectors.base [None req-d887fd5f-fc1a-454d-97f5-1060763b3813 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 23:57:38 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-d887fd5f-fc1a-454d-97f5-1060763b3813 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6204dd7b-f1fa-43fe-ab4b-ada1efb74e9c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 23:57:38 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-d887fd5f-fc1a-454d-97f5-1060763b3813 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6204dd7b-f1fa-43fe-ab4b-ada1efb74e9c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 23:57:38 user nova-compute[75045]: INFO os_brick.initiator.connectors.iscsi [None req-d887fd5f-fc1a-454d-97f5-1060763b3813 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 23:57:38 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6204dd7b-f1fa-43fe-ab4b-ada1efb74e9c -p 172.16.0.220:3260 {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:57:38 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6204dd7b-f1fa-43fe-ab4b-ada1efb74e9c -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:57:38 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a17212f-cc22-465f-a49f-8297da69e45b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:57:38 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-d887fd5f-fc1a-454d-97f5-1060763b3813 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 23:57:38 user nova-compute[75045]:  {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:57:38 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6204dd7b-f1fa-43fe-ab4b-ada1efb74e9c -p 172.16.0.220:3260 --interface default --op new {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:57:38 user nova-compute[75045]: DEBUG nova.compute.manager [req-3d359784-79a2-48a3-baad-08f6019589ad req-f3bea5d7-f7ab-490b-8868-a59eba70ac01 service nova] [instance: f2b04024-a109-4b8b-8a7d-1c0fc8712afd] Received event network-vif-plugged-e4007497-d23d-4fc2-bba3-e618eec593e2 {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:57:38 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-3d359784-79a2-48a3-baad-08f6019589ad req-f3bea5d7-f7ab-490b-8868-a59eba70ac01 service nova] Acquiring lock "f2b04024-a109-4b8b-8a7d-1c0fc8712afd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:57:38 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-3d359784-79a2-48a3-baad-08f6019589ad req-f3bea5d7-f7ab-490b-8868-a59eba70ac01 service nova] Lock "f2b04024-a109-4b8b-8a7d-1c0fc8712afd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:57:38 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-3d359784-79a2-48a3-baad-08f6019589ad req-f3bea5d7-f7ab-490b-8868-a59eba70ac01 service nova] Lock "f2b04024-a109-4b8b-8a7d-1c0fc8712afd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:57:38 user nova-compute[75045]: DEBUG nova.compute.manager [req-3d359784-79a2-48a3-baad-08f6019589ad req-f3bea5d7-f7ab-490b-8868-a59eba70ac01 service nova] [instance: f2b04024-a109-4b8b-8a7d-1c0fc8712afd] No waiting events found dispatching network-vif-plugged-e4007497-d23d-4fc2-bba3-e618eec593e2 {{(pid=75045) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 23:57:38 user nova-compute[75045]: WARNING nova.compute.manager [req-3d359784-79a2-48a3-baad-08f6019589ad req-f3bea5d7-f7ab-490b-8868-a59eba70ac01 service nova] [instance: f2b04024-a109-4b8b-8a7d-1c0fc8712afd] Received unexpected event network-vif-plugged-e4007497-d23d-4fc2-bba3-e618eec593e2 for instance with vm_state building and task_state spawning.
Nov 08 23:57:38 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6204dd7b-f1fa-43fe-ab4b-ada1efb74e9c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:57:38 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[14193377-370f-44c4-9a10-0a7c17fb48d5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6204dd7b-f1fa-43fe-ab4b-ada1efb74e9c] added\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:57:38 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-d887fd5f-fc1a-454d-97f5-1060763b3813 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6204dd7b-f1fa-43fe-ab4b-ada1efb74e9c] added
Nov 08 23:57:38 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:57:38 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6204dd7b-f1fa-43fe-ab4b-ada1efb74e9c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:57:38 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6204dd7b-f1fa-43fe-ab4b-ada1efb74e9c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:57:38 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[7590e7ce-6bc9-4834-9ebc-48d5907dbbc9]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:57:38 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-d887fd5f-fc1a-454d-97f5-1060763b3813 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:57:38 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6204dd7b-f1fa-43fe-ab4b-ada1efb74e9c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:57:38 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6204dd7b-f1fa-43fe-ab4b-ada1efb74e9c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:57:38 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[486139f9-73ae-493c-a2fe-a8b885c14337]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:57:38 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-d887fd5f-fc1a-454d-97f5-1060763b3813 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:57:38 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:57:38 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:57:38 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6204dd7b-f1fa-43fe-ab4b-ada1efb74e9c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ueWBwFrj {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:57:38 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6204dd7b-f1fa-43fe-ab4b-ada1efb74e9c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ueWBwFrj" returned: 0 in 0.026s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:57:38 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[55d4a82b-68cd-490d-9c96-9e81188a5d91]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:57:38 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-d887fd5f-fc1a-454d-97f5-1060763b3813 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ueWBwFrj'): stdout= stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:57:38 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6204dd7b-f1fa-43fe-ab4b-ada1efb74e9c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:57:39 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6204dd7b-f1fa-43fe-ab4b-ada1efb74e9c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:57:39 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[a44d3736-4f95-4d33-8eea-168fba35f75d]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:57:39 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-d887fd5f-fc1a-454d-97f5-1060763b3813 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:57:39 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:57:39 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:57:39 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[c586aafb-c0c7-4634-8a71-14583e40159f]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcbd911e-f385-4ed6-b8a4-383b3b56cf7d (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c32ddba4-c092-4e6e-abe5-8dab539439b9 (non-flash)\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:57:39 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-d887fd5f-fc1a-454d-97f5-1060763b3813 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcbd911e-f385-4ed6-b8a4-383b3b56cf7d (non-flash)
Nov 08 23:57:39 user nova-compute[75045]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c32ddba4-c092-4e6e-abe5-8dab539439b9 (non-flash)
Nov 08 23:57:39 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 23:57:39 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-d887fd5f-fc1a-454d-97f5-1060763b3813 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcbd911e-f385-4ed6-b8a4-383b3b56cf7d (non-flash)
Nov 08 23:57:39 user nova-compute[75045]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c32ddba4-c092-4e6e-abe5-8dab539439b9 (non-flash)
Nov 08 23:57:39 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 23:57:39 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6204dd7b-f1fa-43fe-ab4b-ada1efb74e9c -p 172.16.0.220:3260 --login {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:57:39 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6204dd7b-f1fa-43fe-ab4b-ada1efb74e9c -p 172.16.0.220:3260 --login" returned: 0 in 0.071s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:57:39 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e931030-549d-48c3-a301-126506555e3e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6204dd7b-f1fa-43fe-ab4b-ada1efb74e9c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6204dd7b-f1fa-43fe-ab4b-ada1efb74e9c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:57:39 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-d887fd5f-fc1a-454d-97f5-1060763b3813 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6204dd7b-f1fa-43fe-ab4b-ada1efb74e9c, portal: 172.16.0.220,3260]
Nov 08 23:57:39 user nova-compute[75045]: Login to [iface: default, target: iqn.2010-10.org.openstack:6204dd7b-f1fa-43fe-ab4b-ada1efb74e9c, portal: 172.16.0.220,3260] successful.
Nov 08 23:57:39 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:57:39 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6204dd7b-f1fa-43fe-ab4b-ada1efb74e9c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:57:39 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6204dd7b-f1fa-43fe-ab4b-ada1efb74e9c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:57:39 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1782138-ebc1-4a64-a06b-882398c164b9]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:57:39 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-d887fd5f-fc1a-454d-97f5-1060763b3813 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:57:39 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:57:39 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:57:39 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[e727ddb9-5781-48da-8790-85c2cf6b3d28]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcbd911e-f385-4ed6-b8a4-383b3b56cf7d (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c32ddba4-c092-4e6e-abe5-8dab539439b9 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6204dd7b-f1fa-43fe-ab4b-ada1efb74e9c (non-flash)\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:57:39 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-d887fd5f-fc1a-454d-97f5-1060763b3813 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcbd911e-f385-4ed6-b8a4-383b3b56cf7d (non-flash)
Nov 08 23:57:39 user nova-compute[75045]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c32ddba4-c092-4e6e-abe5-8dab539439b9 (non-flash)
Nov 08 23:57:39 user nova-compute[75045]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6204dd7b-f1fa-43fe-ab4b-ada1efb74e9c (non-flash)
Nov 08 23:57:39 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 23:57:39 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-d887fd5f-fc1a-454d-97f5-1060763b3813 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcbd911e-f385-4ed6-b8a4-383b3b56cf7d (non-flash)
Nov 08 23:57:39 user nova-compute[75045]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c32ddba4-c092-4e6e-abe5-8dab539439b9 (non-flash)
Nov 08 23:57:39 user nova-compute[75045]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6204dd7b-f1fa-43fe-ab4b-ada1efb74e9c (non-flash)
Nov 08 23:57:39 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 23:57:39 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-d887fd5f-fc1a-454d-97f5-1060763b3813 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6204dd7b-f1fa-43fe-ab4b-ada1efb74e9c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.347s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 23:57:39 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-d887fd5f-fc1a-454d-97f5-1060763b3813 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] Connected to 172.16.0.220:3260 {{(pid=75045) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 23:57:39 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-d887fd5f-fc1a-454d-97f5-1060763b3813 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] HCTL ('35', '-', '-', 0) found on session 54 with lun 0 {{(pid=75045) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 23:57:39 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-d887fd5f-fc1a-454d-97f5-1060763b3813 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75045) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 23:57:39 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:57:39 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.018s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:57:39 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[97de7e20-1d60-433e-94e3-fbd5de3a032f]: (4, ('- - 0', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:57:39 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-d887fd5f-fc1a-454d-97f5-1060763b3813 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] Searching for a device in session 54 and hctl ['35', '*', '*', 0] yield: None {{(pid=75045) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 23:57:40 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-d887fd5f-fc1a-454d-97f5-1060763b3813 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] Searching for a device in session 54 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75045) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 23:57:40 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-d887fd5f-fc1a-454d-97f5-1060763b3813 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:6204dd7b-f1fa-43fe-ab4b-ada1efb74e9c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ueWBwFrj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75045) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 23:57:40 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-d887fd5f-fc1a-454d-97f5-1060763b3813 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.377s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 23:57:40 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-d887fd5f-fc1a-454d-97f5-1060763b3813 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] <== connect_volume: return (1379ms) {'type': 'block', 'scsi_wwn': '26235646363313466', 'path': '/dev/sdd'} {{(pid=75045) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 23:57:40 user nova-compute[75045]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d887fd5f-fc1a-454d-97f5-1060763b3813 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] [instance: 8d9a47ed-6aa3-468f-b106-46b60cd27a46] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26235646363313466', 'path': '/dev/sdd'} {{(pid=75045) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 23:57:40 user nova-compute[75045]: DEBUG nova.objects.instance [None req-d887fd5f-fc1a-454d-97f5-1060763b3813 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] Lazy-loading 'flavor' on Instance uuid 8d9a47ed-6aa3-468f-b106-46b60cd27a46 {{(pid=75045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 23:57:40 user nova-compute[75045]: DEBUG nova.virt.libvirt.guest [None req-d887fd5f-fc1a-454d-97f5-1060763b3813 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] attach device xml: <disk type="block" device="disk">
Nov 08 23:57:40 user nova-compute[75045]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 23:57:40 user nova-compute[75045]:   <source dev="/dev/sdd"/>
Nov 08 23:57:40 user nova-compute[75045]:   <target dev="vdb" bus="virtio"/>
Nov 08 23:57:40 user nova-compute[75045]:   <serial>6204dd7b-f1fa-43fe-ab4b-ada1efb74e9c</serial>
Nov 08 23:57:40 user nova-compute[75045]: </disk>
Nov 08 23:57:40 user nova-compute[75045]:  {{(pid=75045) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 08 23:57:40 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-d887fd5f-fc1a-454d-97f5-1060763b3813 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] No BDM found with device name vda, not building metadata. {{(pid=75045) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 23:57:40 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-d887fd5f-fc1a-454d-97f5-1060763b3813 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75045) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 23:57:40 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-d887fd5f-fc1a-454d-97f5-1060763b3813 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] No VIF found with MAC fa:16:3e:12:6c:30, not building metadata {{(pid=75045) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 23:57:40 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-d887fd5f-fc1a-454d-97f5-1060763b3813 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] Lock "8d9a47ed-6aa3-468f-b106-46b60cd27a46" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 26.359s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:57:40 user nova-compute[75045]: DEBUG nova.compute.manager [None req-75892721-9dcd-49a3-becc-2a7d0e5f91c0 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] [instance: f2b04024-a109-4b8b-8a7d-1c0fc8712afd] Instance event wait completed in 0 seconds for  {{(pid=75045) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 23:57:40 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-75892721-9dcd-49a3-becc-2a7d0e5f91c0 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] [instance: f2b04024-a109-4b8b-8a7d-1c0fc8712afd] Guest created on hypervisor {{(pid=75045) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 23:57:40 user nova-compute[75045]: INFO nova.virt.libvirt.driver [-] [instance: f2b04024-a109-4b8b-8a7d-1c0fc8712afd] Instance spawned successfully.
Nov 08 23:57:40 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-75892721-9dcd-49a3-becc-2a7d0e5f91c0 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] [instance: f2b04024-a109-4b8b-8a7d-1c0fc8712afd] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75045) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 23:57:40 user nova-compute[75045]: DEBUG nova.compute.manager [req-7dcf91c9-96d6-4785-b16e-9cfbacf4a4b3 req-b21b7be3-2407-4e34-97ed-65cfed50311c service nova] [instance: f2b04024-a109-4b8b-8a7d-1c0fc8712afd] Received event network-vif-plugged-e4007497-d23d-4fc2-bba3-e618eec593e2 {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:57:40 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-7dcf91c9-96d6-4785-b16e-9cfbacf4a4b3 req-b21b7be3-2407-4e34-97ed-65cfed50311c service nova] Acquiring lock "f2b04024-a109-4b8b-8a7d-1c0fc8712afd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:57:40 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-7dcf91c9-96d6-4785-b16e-9cfbacf4a4b3 req-b21b7be3-2407-4e34-97ed-65cfed50311c service nova] Lock "f2b04024-a109-4b8b-8a7d-1c0fc8712afd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:57:40 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-7dcf91c9-96d6-4785-b16e-9cfbacf4a4b3 req-b21b7be3-2407-4e34-97ed-65cfed50311c service nova] Lock "f2b04024-a109-4b8b-8a7d-1c0fc8712afd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:57:40 user nova-compute[75045]: DEBUG nova.compute.manager [req-7dcf91c9-96d6-4785-b16e-9cfbacf4a4b3 req-b21b7be3-2407-4e34-97ed-65cfed50311c service nova] [instance: f2b04024-a109-4b8b-8a7d-1c0fc8712afd] No waiting events found dispatching network-vif-plugged-e4007497-d23d-4fc2-bba3-e618eec593e2 {{(pid=75045) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 23:57:40 user nova-compute[75045]: WARNING nova.compute.manager [req-7dcf91c9-96d6-4785-b16e-9cfbacf4a4b3 req-b21b7be3-2407-4e34-97ed-65cfed50311c service nova] [instance: f2b04024-a109-4b8b-8a7d-1c0fc8712afd] Received unexpected event network-vif-plugged-e4007497-d23d-4fc2-bba3-e618eec593e2 for instance with vm_state building and task_state spawning.
Nov 08 23:57:40 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-75892721-9dcd-49a3-becc-2a7d0e5f91c0 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] [instance: f2b04024-a109-4b8b-8a7d-1c0fc8712afd] Found default for hw_cdrom_bus of ide {{(pid=75045) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 23:57:40 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-75892721-9dcd-49a3-becc-2a7d0e5f91c0 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] [instance: f2b04024-a109-4b8b-8a7d-1c0fc8712afd] Found default for hw_disk_bus of virtio {{(pid=75045) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 23:57:40 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-75892721-9dcd-49a3-becc-2a7d0e5f91c0 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] [instance: f2b04024-a109-4b8b-8a7d-1c0fc8712afd] Found default for hw_input_bus of None {{(pid=75045) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 23:57:40 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-75892721-9dcd-49a3-becc-2a7d0e5f91c0 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] [instance: f2b04024-a109-4b8b-8a7d-1c0fc8712afd] Found default for hw_pointer_model of None {{(pid=75045) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 23:57:40 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-75892721-9dcd-49a3-becc-2a7d0e5f91c0 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] [instance: f2b04024-a109-4b8b-8a7d-1c0fc8712afd] Found default for hw_video_model of virtio {{(pid=75045) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 23:57:40 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-75892721-9dcd-49a3-becc-2a7d0e5f91c0 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] [instance: f2b04024-a109-4b8b-8a7d-1c0fc8712afd] Found default for hw_vif_model of virtio {{(pid=75045) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 23:57:41 user nova-compute[75045]: INFO nova.compute.manager [None req-75892721-9dcd-49a3-becc-2a7d0e5f91c0 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] [instance: f2b04024-a109-4b8b-8a7d-1c0fc8712afd] Took 5.30 seconds to spawn the instance on the hypervisor.
Nov 08 23:57:41 user nova-compute[75045]: DEBUG nova.compute.manager [None req-75892721-9dcd-49a3-becc-2a7d0e5f91c0 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] [instance: f2b04024-a109-4b8b-8a7d-1c0fc8712afd] Checking state {{(pid=75045) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 23:57:41 user nova-compute[75045]: INFO nova.compute.manager [None req-75892721-9dcd-49a3-becc-2a7d0e5f91c0 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] [instance: f2b04024-a109-4b8b-8a7d-1c0fc8712afd] Took 30.17 seconds to build instance.
Nov 08 23:57:41 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-75892721-9dcd-49a3-becc-2a7d0e5f91c0 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Lock "f2b04024-a109-4b8b-8a7d-1c0fc8712afd" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 30.259s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:57:42 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:57:42 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:57:43 user nova-compute[75045]: DEBUG nova.compute.manager [req-e0acec9f-7cb6-4556-b7d5-deae2aeea2aa req-12b413a8-e1a9-4c50-8159-a7ed0220452d service nova] [instance: 8d9a47ed-6aa3-468f-b106-46b60cd27a46] Received event network-changed-26db8f3f-0cb5-474c-9499-14ece10e73e3 {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:57:43 user nova-compute[75045]: DEBUG nova.compute.manager [req-e0acec9f-7cb6-4556-b7d5-deae2aeea2aa req-12b413a8-e1a9-4c50-8159-a7ed0220452d service nova] [instance: 8d9a47ed-6aa3-468f-b106-46b60cd27a46] Refreshing instance network info cache due to event network-changed-26db8f3f-0cb5-474c-9499-14ece10e73e3. {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 23:57:43 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-e0acec9f-7cb6-4556-b7d5-deae2aeea2aa req-12b413a8-e1a9-4c50-8159-a7ed0220452d service nova] Acquiring lock "refresh_cache-8d9a47ed-6aa3-468f-b106-46b60cd27a46" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 23:57:43 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-e0acec9f-7cb6-4556-b7d5-deae2aeea2aa req-12b413a8-e1a9-4c50-8159-a7ed0220452d service nova] Acquired lock "refresh_cache-8d9a47ed-6aa3-468f-b106-46b60cd27a46" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 23:57:43 user nova-compute[75045]: DEBUG nova.network.neutron [req-e0acec9f-7cb6-4556-b7d5-deae2aeea2aa req-12b413a8-e1a9-4c50-8159-a7ed0220452d service nova] [instance: 8d9a47ed-6aa3-468f-b106-46b60cd27a46] Refreshing network info cache for port 26db8f3f-0cb5-474c-9499-14ece10e73e3 {{(pid=75045) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 23:57:44 user nova-compute[75045]: DEBUG nova.network.neutron [req-e0acec9f-7cb6-4556-b7d5-deae2aeea2aa req-12b413a8-e1a9-4c50-8159-a7ed0220452d service nova] [instance: 8d9a47ed-6aa3-468f-b106-46b60cd27a46] Updated VIF entry in instance network info cache for port 26db8f3f-0cb5-474c-9499-14ece10e73e3. {{(pid=75045) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 23:57:44 user nova-compute[75045]: DEBUG nova.network.neutron [req-e0acec9f-7cb6-4556-b7d5-deae2aeea2aa req-12b413a8-e1a9-4c50-8159-a7ed0220452d service nova] [instance: 8d9a47ed-6aa3-468f-b106-46b60cd27a46] Updating instance_info_cache with network_info: [{"id": "26db8f3f-0cb5-474c-9499-14ece10e73e3", "address": "fa:16:3e:12:6c:30", "network": {"id": "fe5f7093-1cdd-465c-97f0-7d7b2dd1fa8a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1755065955-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.27", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4bfce59008d44fdb5ba91c70f1cf044", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26db8f3f-0c", "ovs_interfaceid": "26db8f3f-0cb5-474c-9499-14ece10e73e3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75045) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 23:57:44 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-e0acec9f-7cb6-4556-b7d5-deae2aeea2aa req-12b413a8-e1a9-4c50-8159-a7ed0220452d service nova] Releasing lock "refresh_cache-8d9a47ed-6aa3-468f-b106-46b60cd27a46" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 23:57:45 user nova-compute[75045]: DEBUG nova.compute.manager [req-40800171-d925-4703-b5d6-d4538f839bd0 req-a28b587c-b556-4938-adb9-25ce8c89b927 service nova] [instance: 8d9a47ed-6aa3-468f-b106-46b60cd27a46] Received event network-changed-26db8f3f-0cb5-474c-9499-14ece10e73e3 {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:57:45 user nova-compute[75045]: DEBUG nova.compute.manager [req-40800171-d925-4703-b5d6-d4538f839bd0 req-a28b587c-b556-4938-adb9-25ce8c89b927 service nova] [instance: 8d9a47ed-6aa3-468f-b106-46b60cd27a46] Refreshing instance network info cache due to event network-changed-26db8f3f-0cb5-474c-9499-14ece10e73e3. {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 23:57:45 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-40800171-d925-4703-b5d6-d4538f839bd0 req-a28b587c-b556-4938-adb9-25ce8c89b927 service nova] Acquiring lock "refresh_cache-8d9a47ed-6aa3-468f-b106-46b60cd27a46" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 23:57:45 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-40800171-d925-4703-b5d6-d4538f839bd0 req-a28b587c-b556-4938-adb9-25ce8c89b927 service nova] Acquired lock "refresh_cache-8d9a47ed-6aa3-468f-b106-46b60cd27a46" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 23:57:45 user nova-compute[75045]: DEBUG nova.network.neutron [req-40800171-d925-4703-b5d6-d4538f839bd0 req-a28b587c-b556-4938-adb9-25ce8c89b927 service nova] [instance: 8d9a47ed-6aa3-468f-b106-46b60cd27a46] Refreshing network info cache for port 26db8f3f-0cb5-474c-9499-14ece10e73e3 {{(pid=75045) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 23:57:46 user nova-compute[75045]: DEBUG nova.network.neutron [req-40800171-d925-4703-b5d6-d4538f839bd0 req-a28b587c-b556-4938-adb9-25ce8c89b927 service nova] [instance: 8d9a47ed-6aa3-468f-b106-46b60cd27a46] Updated VIF entry in instance network info cache for port 26db8f3f-0cb5-474c-9499-14ece10e73e3. {{(pid=75045) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 23:57:46 user nova-compute[75045]: DEBUG nova.network.neutron [req-40800171-d925-4703-b5d6-d4538f839bd0 req-a28b587c-b556-4938-adb9-25ce8c89b927 service nova] [instance: 8d9a47ed-6aa3-468f-b106-46b60cd27a46] Updating instance_info_cache with network_info: [{"id": "26db8f3f-0cb5-474c-9499-14ece10e73e3", "address": "fa:16:3e:12:6c:30", "network": {"id": "fe5f7093-1cdd-465c-97f0-7d7b2dd1fa8a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1755065955-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.27", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4bfce59008d44fdb5ba91c70f1cf044", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26db8f3f-0c", "ovs_interfaceid": "26db8f3f-0cb5-474c-9499-14ece10e73e3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75045) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 23:57:46 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-40800171-d925-4703-b5d6-d4538f839bd0 req-a28b587c-b556-4938-adb9-25ce8c89b927 service nova] Releasing lock "refresh_cache-8d9a47ed-6aa3-468f-b106-46b60cd27a46" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 23:57:46 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-66093934-bb69-4af4-8580-5ad2b1de3313 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] Acquiring lock "8d9a47ed-6aa3-468f-b106-46b60cd27a46" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:57:46 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-66093934-bb69-4af4-8580-5ad2b1de3313 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] Lock "8d9a47ed-6aa3-468f-b106-46b60cd27a46" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:57:46 user nova-compute[75045]: INFO nova.compute.manager [None req-66093934-bb69-4af4-8580-5ad2b1de3313 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] [instance: 8d9a47ed-6aa3-468f-b106-46b60cd27a46] Rebooting instance
Nov 08 23:57:46 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-66093934-bb69-4af4-8580-5ad2b1de3313 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] Acquiring lock "refresh_cache-8d9a47ed-6aa3-468f-b106-46b60cd27a46" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 23:57:46 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-66093934-bb69-4af4-8580-5ad2b1de3313 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] Acquired lock "refresh_cache-8d9a47ed-6aa3-468f-b106-46b60cd27a46" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 23:57:46 user nova-compute[75045]: DEBUG nova.network.neutron [None req-66093934-bb69-4af4-8580-5ad2b1de3313 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] [instance: 8d9a47ed-6aa3-468f-b106-46b60cd27a46] Building network info cache for instance {{(pid=75045) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 23:57:47 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:57:47 user nova-compute[75045]: DEBUG nova.network.neutron [None req-66093934-bb69-4af4-8580-5ad2b1de3313 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] [instance: 8d9a47ed-6aa3-468f-b106-46b60cd27a46] Updating instance_info_cache with network_info: [{"id": "26db8f3f-0cb5-474c-9499-14ece10e73e3", "address": "fa:16:3e:12:6c:30", "network": {"id": "fe5f7093-1cdd-465c-97f0-7d7b2dd1fa8a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1755065955-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.27", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4bfce59008d44fdb5ba91c70f1cf044", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26db8f3f-0c", "ovs_interfaceid": "26db8f3f-0cb5-474c-9499-14ece10e73e3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75045) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 23:57:47 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:57:47 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-66093934-bb69-4af4-8580-5ad2b1de3313 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] Releasing lock "refresh_cache-8d9a47ed-6aa3-468f-b106-46b60cd27a46" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 23:57:47 user nova-compute[75045]: DEBUG nova.compute.manager [None req-66093934-bb69-4af4-8580-5ad2b1de3313 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] [instance: 8d9a47ed-6aa3-468f-b106-46b60cd27a46] Checking state {{(pid=75045) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 23:57:49 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:57:49 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:57:49 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:57:49 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:57:49 user nova-compute[75045]: DEBUG nova.compute.manager [req-e239a433-8669-4c19-b511-ae98e664d44f req-1b66835a-62b7-4372-9364-3d071194e57e service nova] [instance: 8d9a47ed-6aa3-468f-b106-46b60cd27a46] Received event network-vif-unplugged-26db8f3f-0cb5-474c-9499-14ece10e73e3 {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:57:49 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-e239a433-8669-4c19-b511-ae98e664d44f req-1b66835a-62b7-4372-9364-3d071194e57e service nova] Acquiring lock "8d9a47ed-6aa3-468f-b106-46b60cd27a46-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:57:49 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-e239a433-8669-4c19-b511-ae98e664d44f req-1b66835a-62b7-4372-9364-3d071194e57e service nova] Lock "8d9a47ed-6aa3-468f-b106-46b60cd27a46-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:57:49 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-e239a433-8669-4c19-b511-ae98e664d44f req-1b66835a-62b7-4372-9364-3d071194e57e service nova] Lock "8d9a47ed-6aa3-468f-b106-46b60cd27a46-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:57:49 user nova-compute[75045]: DEBUG nova.compute.manager [req-e239a433-8669-4c19-b511-ae98e664d44f req-1b66835a-62b7-4372-9364-3d071194e57e service nova] [instance: 8d9a47ed-6aa3-468f-b106-46b60cd27a46] No waiting events found dispatching network-vif-unplugged-26db8f3f-0cb5-474c-9499-14ece10e73e3 {{(pid=75045) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 23:57:49 user nova-compute[75045]: WARNING nova.compute.manager [req-e239a433-8669-4c19-b511-ae98e664d44f req-1b66835a-62b7-4372-9364-3d071194e57e service nova] [instance: 8d9a47ed-6aa3-468f-b106-46b60cd27a46] Received unexpected event network-vif-unplugged-26db8f3f-0cb5-474c-9499-14ece10e73e3 for instance with vm_state active and task_state reboot_started.
Nov 08 23:57:50 user nova-compute[75045]: INFO nova.virt.libvirt.driver [None req-66093934-bb69-4af4-8580-5ad2b1de3313 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] [instance: 8d9a47ed-6aa3-468f-b106-46b60cd27a46] Instance shutdown successfully.
Nov 08 23:57:51 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:57:51 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:57:51 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:57:51 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:57:51 user nova-compute[75045]: DEBUG nova.compute.manager [req-1fb3ab5f-bd1e-4e4e-9401-1d262c3e9a5f req-ab4c49bd-0d22-49d0-955f-c2df75e95396 service nova] [instance: 8d9a47ed-6aa3-468f-b106-46b60cd27a46] Received event network-vif-plugged-26db8f3f-0cb5-474c-9499-14ece10e73e3 {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:57:51 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-1fb3ab5f-bd1e-4e4e-9401-1d262c3e9a5f req-ab4c49bd-0d22-49d0-955f-c2df75e95396 service nova] Acquiring lock "8d9a47ed-6aa3-468f-b106-46b60cd27a46-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:57:51 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-1fb3ab5f-bd1e-4e4e-9401-1d262c3e9a5f req-ab4c49bd-0d22-49d0-955f-c2df75e95396 service nova] Lock "8d9a47ed-6aa3-468f-b106-46b60cd27a46-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:57:51 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-1fb3ab5f-bd1e-4e4e-9401-1d262c3e9a5f req-ab4c49bd-0d22-49d0-955f-c2df75e95396 service nova] Lock "8d9a47ed-6aa3-468f-b106-46b60cd27a46-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:57:51 user nova-compute[75045]: DEBUG nova.compute.manager [req-1fb3ab5f-bd1e-4e4e-9401-1d262c3e9a5f req-ab4c49bd-0d22-49d0-955f-c2df75e95396 service nova] [instance: 8d9a47ed-6aa3-468f-b106-46b60cd27a46] No waiting events found dispatching network-vif-plugged-26db8f3f-0cb5-474c-9499-14ece10e73e3 {{(pid=75045) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 23:57:51 user nova-compute[75045]: WARNING nova.compute.manager [req-1fb3ab5f-bd1e-4e4e-9401-1d262c3e9a5f req-ab4c49bd-0d22-49d0-955f-c2df75e95396 service nova] [instance: 8d9a47ed-6aa3-468f-b106-46b60cd27a46] Received unexpected event network-vif-plugged-26db8f3f-0cb5-474c-9499-14ece10e73e3 for instance with vm_state active and task_state reboot_started.
Nov 08 23:57:52 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:57:52 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:57:52 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:57:52 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:57:52 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:57:53 user nova-compute[75045]: INFO nova.virt.libvirt.driver [-] [instance: 8d9a47ed-6aa3-468f-b106-46b60cd27a46] Instance running successfully.
Nov 08 23:57:53 user nova-compute[75045]: INFO nova.virt.libvirt.driver [None req-66093934-bb69-4af4-8580-5ad2b1de3313 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] [instance: 8d9a47ed-6aa3-468f-b106-46b60cd27a46] Instance soft rebooted successfully.
Nov 08 23:57:53 user nova-compute[75045]: DEBUG nova.compute.manager [None req-66093934-bb69-4af4-8580-5ad2b1de3313 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] [instance: 8d9a47ed-6aa3-468f-b106-46b60cd27a46] Checking state {{(pid=75045) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 23:57:53 user nova-compute[75045]: DEBUG nova.compute.manager [req-da2073da-4c8e-4ac2-af18-28d0bbd74503 req-8501d9d3-9288-42fd-a6d7-c427c92063e0 service nova] [instance: 8d9a47ed-6aa3-468f-b106-46b60cd27a46] Received event network-vif-plugged-26db8f3f-0cb5-474c-9499-14ece10e73e3 {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:57:53 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-da2073da-4c8e-4ac2-af18-28d0bbd74503 req-8501d9d3-9288-42fd-a6d7-c427c92063e0 service nova] Acquiring lock "8d9a47ed-6aa3-468f-b106-46b60cd27a46-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:57:53 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-da2073da-4c8e-4ac2-af18-28d0bbd74503 req-8501d9d3-9288-42fd-a6d7-c427c92063e0 service nova] Lock "8d9a47ed-6aa3-468f-b106-46b60cd27a46-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:57:53 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-da2073da-4c8e-4ac2-af18-28d0bbd74503 req-8501d9d3-9288-42fd-a6d7-c427c92063e0 service nova] Lock "8d9a47ed-6aa3-468f-b106-46b60cd27a46-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:57:53 user nova-compute[75045]: DEBUG nova.compute.manager [req-da2073da-4c8e-4ac2-af18-28d0bbd74503 req-8501d9d3-9288-42fd-a6d7-c427c92063e0 service nova] [instance: 8d9a47ed-6aa3-468f-b106-46b60cd27a46] No waiting events found dispatching network-vif-plugged-26db8f3f-0cb5-474c-9499-14ece10e73e3 {{(pid=75045) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 23:57:53 user nova-compute[75045]: WARNING nova.compute.manager [req-da2073da-4c8e-4ac2-af18-28d0bbd74503 req-8501d9d3-9288-42fd-a6d7-c427c92063e0 service nova] [instance: 8d9a47ed-6aa3-468f-b106-46b60cd27a46] Received unexpected event network-vif-plugged-26db8f3f-0cb5-474c-9499-14ece10e73e3 for instance with vm_state active and task_state reboot_started.
Nov 08 23:57:53 user nova-compute[75045]: DEBUG nova.compute.manager [req-da2073da-4c8e-4ac2-af18-28d0bbd74503 req-8501d9d3-9288-42fd-a6d7-c427c92063e0 service nova] [instance: 8d9a47ed-6aa3-468f-b106-46b60cd27a46] Received event network-vif-plugged-26db8f3f-0cb5-474c-9499-14ece10e73e3 {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:57:53 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-da2073da-4c8e-4ac2-af18-28d0bbd74503 req-8501d9d3-9288-42fd-a6d7-c427c92063e0 service nova] Acquiring lock "8d9a47ed-6aa3-468f-b106-46b60cd27a46-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:57:53 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-da2073da-4c8e-4ac2-af18-28d0bbd74503 req-8501d9d3-9288-42fd-a6d7-c427c92063e0 service nova] Lock "8d9a47ed-6aa3-468f-b106-46b60cd27a46-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:57:53 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-da2073da-4c8e-4ac2-af18-28d0bbd74503 req-8501d9d3-9288-42fd-a6d7-c427c92063e0 service nova] Lock "8d9a47ed-6aa3-468f-b106-46b60cd27a46-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:57:53 user nova-compute[75045]: DEBUG nova.compute.manager [req-da2073da-4c8e-4ac2-af18-28d0bbd74503 req-8501d9d3-9288-42fd-a6d7-c427c92063e0 service nova] [instance: 8d9a47ed-6aa3-468f-b106-46b60cd27a46] No waiting events found dispatching network-vif-plugged-26db8f3f-0cb5-474c-9499-14ece10e73e3 {{(pid=75045) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 23:57:53 user nova-compute[75045]: WARNING nova.compute.manager [req-da2073da-4c8e-4ac2-af18-28d0bbd74503 req-8501d9d3-9288-42fd-a6d7-c427c92063e0 service nova] [instance: 8d9a47ed-6aa3-468f-b106-46b60cd27a46] Received unexpected event network-vif-plugged-26db8f3f-0cb5-474c-9499-14ece10e73e3 for instance with vm_state active and task_state reboot_started.
Nov 08 23:57:53 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-66093934-bb69-4af4-8580-5ad2b1de3313 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] Lock "8d9a47ed-6aa3-468f-b106-46b60cd27a46" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 7.514s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:57:57 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:57:57 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:58:02 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:58:02 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:58:03 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:58:04 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:58:05 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:58:05 user nova-compute[75045]: DEBUG nova.compute.manager [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Starting heal instance info cache {{(pid=75045) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 23:58:06 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Acquiring lock "refresh_cache-8d9a47ed-6aa3-468f-b106-46b60cd27a46" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 23:58:06 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Acquired lock "refresh_cache-8d9a47ed-6aa3-468f-b106-46b60cd27a46" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 23:58:06 user nova-compute[75045]: DEBUG nova.network.neutron [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] [instance: 8d9a47ed-6aa3-468f-b106-46b60cd27a46] Forcefully refreshing network info cache for instance {{(pid=75045) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 23:58:06 user nova-compute[75045]: DEBUG nova.network.neutron [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] [instance: 8d9a47ed-6aa3-468f-b106-46b60cd27a46] Updating instance_info_cache with network_info: [{"id": "26db8f3f-0cb5-474c-9499-14ece10e73e3", "address": "fa:16:3e:12:6c:30", "network": {"id": "fe5f7093-1cdd-465c-97f0-7d7b2dd1fa8a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1755065955-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.27", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4bfce59008d44fdb5ba91c70f1cf044", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26db8f3f-0c", "ovs_interfaceid": "26db8f3f-0cb5-474c-9499-14ece10e73e3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75045) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 23:58:06 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Releasing lock "refresh_cache-8d9a47ed-6aa3-468f-b106-46b60cd27a46" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 23:58:06 user nova-compute[75045]: DEBUG nova.compute.manager [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] [instance: 8d9a47ed-6aa3-468f-b106-46b60cd27a46] Updated the network info_cache for instance {{(pid=75045) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 23:58:06 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:58:06 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:58:06 user nova-compute[75045]: DEBUG nova.compute.manager [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75045) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 23:58:07 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:58:07 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:58:09 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:58:10 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:58:11 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:58:12 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:58:12 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:58:16 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:58:17 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:58:17 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:58:19 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager.update_available_resource {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:58:19 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:58:19 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:58:20 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:58:20 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Auditing locally available compute resources for user (node: user) {{(pid=75045) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 23:58:20 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75045) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 23:58:20 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d9a47ed-6aa3-468f-b106-46b60cd27a46/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:58:20 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d9a47ed-6aa3-468f-b106-46b60cd27a46/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:58:20 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d9a47ed-6aa3-468f-b106-46b60cd27a46/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:58:20 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d9a47ed-6aa3-468f-b106-46b60cd27a46/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:58:20 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75045) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 23:58:20 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75045) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 23:58:20 user nova-compute[75045]: WARNING nova.virt.libvirt.driver [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 23:58:20 user nova-compute[75045]: WARNING nova.virt.libvirt.driver [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 23:58:20 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Hypervisor/Node resource view: name=user free_ram=8638MB free_disk=24.903453826904297GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75045) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 23:58:20 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:58:20 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:58:20 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Instance df16d913-9985-415f-aedc-14f2ca5bcf13 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75045) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 23:58:20 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Instance 8d9a47ed-6aa3-468f-b106-46b60cd27a46 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75045) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 23:58:20 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Instance f2b04024-a109-4b8b-8a7d-1c0fc8712afd actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75045) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 23:58:20 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=75045) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 23:58:20 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=75045) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 23:58:21 user nova-compute[75045]: DEBUG nova.compute.provider_tree [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Inventory has not changed in ProviderTree for provider: 62ba5f85-c74d-4b58-986e-d4197e813fd7 {{(pid=75045) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 23:58:21 user nova-compute[75045]: DEBUG nova.scheduler.client.report [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Inventory has not changed for provider 62ba5f85-c74d-4b58-986e-d4197e813fd7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75045) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 23:58:21 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Compute_service record updated for user:user {{(pid=75045) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 23:58:21 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.255s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:58:22 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:58:22 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:58:27 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:58:32 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:58:37 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 23:58:42 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:58:46 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:58:47 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:58:52 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:58:57 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:59:02 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:59:02 user nova-compute[75045]: DEBUG nova.compute.manager [req-7eda7c1e-b4e7-4e9b-8399-f9e1efa6f928 req-9c4d53e1-8bb6-4270-b1e4-b32aa2f279f2 service nova] [instance: f2b04024-a109-4b8b-8a7d-1c0fc8712afd] Received event network-changed-e4007497-d23d-4fc2-bba3-e618eec593e2 {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:59:02 user nova-compute[75045]: DEBUG nova.compute.manager [req-7eda7c1e-b4e7-4e9b-8399-f9e1efa6f928 req-9c4d53e1-8bb6-4270-b1e4-b32aa2f279f2 service nova] [instance: f2b04024-a109-4b8b-8a7d-1c0fc8712afd] Refreshing instance network info cache due to event network-changed-e4007497-d23d-4fc2-bba3-e618eec593e2. {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 23:59:02 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-7eda7c1e-b4e7-4e9b-8399-f9e1efa6f928 req-9c4d53e1-8bb6-4270-b1e4-b32aa2f279f2 service nova] Acquiring lock "refresh_cache-f2b04024-a109-4b8b-8a7d-1c0fc8712afd" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 23:59:02 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-7eda7c1e-b4e7-4e9b-8399-f9e1efa6f928 req-9c4d53e1-8bb6-4270-b1e4-b32aa2f279f2 service nova] Acquired lock "refresh_cache-f2b04024-a109-4b8b-8a7d-1c0fc8712afd" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 23:59:02 user nova-compute[75045]: DEBUG nova.network.neutron [req-7eda7c1e-b4e7-4e9b-8399-f9e1efa6f928 req-9c4d53e1-8bb6-4270-b1e4-b32aa2f279f2 service nova] [instance: f2b04024-a109-4b8b-8a7d-1c0fc8712afd] Refreshing network info cache for port e4007497-d23d-4fc2-bba3-e618eec593e2 {{(pid=75045) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 23:59:02 user nova-compute[75045]: DEBUG nova.network.neutron [req-7eda7c1e-b4e7-4e9b-8399-f9e1efa6f928 req-9c4d53e1-8bb6-4270-b1e4-b32aa2f279f2 service nova] [instance: f2b04024-a109-4b8b-8a7d-1c0fc8712afd] Updated VIF entry in instance network info cache for port e4007497-d23d-4fc2-bba3-e618eec593e2. {{(pid=75045) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 23:59:02 user nova-compute[75045]: DEBUG nova.network.neutron [req-7eda7c1e-b4e7-4e9b-8399-f9e1efa6f928 req-9c4d53e1-8bb6-4270-b1e4-b32aa2f279f2 service nova] [instance: f2b04024-a109-4b8b-8a7d-1c0fc8712afd] Updating instance_info_cache with network_info: [{"id": "e4007497-d23d-4fc2-bba3-e618eec593e2", "address": "fa:16:3e:6c:b3:93", "network": {"id": "4205f899-9865-4c65-8b46-c9a533e9bb45", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-774780781-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.148", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d59b73851c79473a9c2cdc0a120dfee0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4007497-d2", "ovs_interfaceid": "e4007497-d23d-4fc2-bba3-e618eec593e2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75045) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 23:59:02 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-7eda7c1e-b4e7-4e9b-8399-f9e1efa6f928 req-9c4d53e1-8bb6-4270-b1e4-b32aa2f279f2 service nova] Releasing lock "refresh_cache-f2b04024-a109-4b8b-8a7d-1c0fc8712afd" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 23:59:03 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-c923da88-fa80-4d0b-89a3-a8fb29d43586 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Acquiring lock "f2b04024-a109-4b8b-8a7d-1c0fc8712afd" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:59:03 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-c923da88-fa80-4d0b-89a3-a8fb29d43586 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Lock "f2b04024-a109-4b8b-8a7d-1c0fc8712afd" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:59:03 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-c923da88-fa80-4d0b-89a3-a8fb29d43586 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Acquiring lock "f2b04024-a109-4b8b-8a7d-1c0fc8712afd-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:59:03 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-c923da88-fa80-4d0b-89a3-a8fb29d43586 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Lock "f2b04024-a109-4b8b-8a7d-1c0fc8712afd-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:59:03 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-c923da88-fa80-4d0b-89a3-a8fb29d43586 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Lock "f2b04024-a109-4b8b-8a7d-1c0fc8712afd-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:59:03 user nova-compute[75045]: INFO nova.compute.manager [None req-c923da88-fa80-4d0b-89a3-a8fb29d43586 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] [instance: f2b04024-a109-4b8b-8a7d-1c0fc8712afd] Terminating instance
Nov 08 23:59:03 user nova-compute[75045]: DEBUG nova.compute.manager [None req-c923da88-fa80-4d0b-89a3-a8fb29d43586 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] [instance: f2b04024-a109-4b8b-8a7d-1c0fc8712afd] Start destroying the instance on the hypervisor. {{(pid=75045) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 23:59:03 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:59:03 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:59:03 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:59:03 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:59:03 user nova-compute[75045]: DEBUG nova.compute.manager [req-5e03f915-425c-4259-8129-b18431467d74 req-d06be5a7-3b58-4e87-aa60-2c28b3a27aa1 service nova] [instance: f2b04024-a109-4b8b-8a7d-1c0fc8712afd] Received event network-vif-unplugged-e4007497-d23d-4fc2-bba3-e618eec593e2 {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:59:03 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-5e03f915-425c-4259-8129-b18431467d74 req-d06be5a7-3b58-4e87-aa60-2c28b3a27aa1 service nova] Acquiring lock "f2b04024-a109-4b8b-8a7d-1c0fc8712afd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:59:03 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-5e03f915-425c-4259-8129-b18431467d74 req-d06be5a7-3b58-4e87-aa60-2c28b3a27aa1 service nova] Lock "f2b04024-a109-4b8b-8a7d-1c0fc8712afd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:59:03 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-5e03f915-425c-4259-8129-b18431467d74 req-d06be5a7-3b58-4e87-aa60-2c28b3a27aa1 service nova] Lock "f2b04024-a109-4b8b-8a7d-1c0fc8712afd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:59:03 user nova-compute[75045]: DEBUG nova.compute.manager [req-5e03f915-425c-4259-8129-b18431467d74 req-d06be5a7-3b58-4e87-aa60-2c28b3a27aa1 service nova] [instance: f2b04024-a109-4b8b-8a7d-1c0fc8712afd] No waiting events found dispatching network-vif-unplugged-e4007497-d23d-4fc2-bba3-e618eec593e2 {{(pid=75045) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 23:59:03 user nova-compute[75045]: DEBUG nova.compute.manager [req-5e03f915-425c-4259-8129-b18431467d74 req-d06be5a7-3b58-4e87-aa60-2c28b3a27aa1 service nova] [instance: f2b04024-a109-4b8b-8a7d-1c0fc8712afd] Received event network-vif-unplugged-e4007497-d23d-4fc2-bba3-e618eec593e2 for instance with task_state deleting. {{(pid=75045) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 23:59:04 user nova-compute[75045]: INFO nova.virt.libvirt.driver [-] [instance: f2b04024-a109-4b8b-8a7d-1c0fc8712afd] Instance destroyed successfully.
Nov 08 23:59:04 user nova-compute[75045]: DEBUG nova.objects.instance [None req-c923da88-fa80-4d0b-89a3-a8fb29d43586 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Lazy-loading 'resources' on Instance uuid f2b04024-a109-4b8b-8a7d-1c0fc8712afd {{(pid=75045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 23:59:04 user nova-compute[75045]: DEBUG nova.virt.libvirt.vif [None req-c923da88-fa80-4d0b-89a3-a8fb29d43586 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T23:57:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1479224387',display_name='tempest-TestVolumeBootPattern-server-1479224387',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1479224387',id=52,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG4FMrZDNuVfIPnXfxN4nyoUo/5k5pInfzFUTQXcG54GN3K7TKcBDzRT7RSwNm2HHReK/sg/U9LFWtj081VW6fTpNzjBNfOxhMg0DqXN9g7DbQBYyYNAjTBN+tAvF+1fCA==',key_name='tempest-TestVolumeBootPattern-1614211608',keypairs=<?>,launch_index=0,launched_at=2023-11-08T23:57:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d59b73851c79473a9c2cdc0a120dfee0',ramdisk_id='',reservation_id='r-1nrdzycw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-650796844',owner_user_name='tempest-TestVolumeBootPattern-650796844-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T23:57:41Z,user_data=None,user_id='76c31c64d9594f9cbef7586fafb48721',uuid=f2b04024-a109-4b8b-8a7d-1c0fc8712afd,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e4007497-d23d-4fc2-bba3-e618eec593e2", "address": "fa:16:3e:6c:b3:93", "network": {"id": "4205f899-9865-4c65-8b46-c9a533e9bb45", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-774780781-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.148", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d59b73851c79473a9c2cdc0a120dfee0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4007497-d2", "ovs_interfaceid": "e4007497-d23d-4fc2-bba3-e618eec593e2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75045) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 23:59:04 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-c923da88-fa80-4d0b-89a3-a8fb29d43586 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Converting VIF {"id": "e4007497-d23d-4fc2-bba3-e618eec593e2", "address": "fa:16:3e:6c:b3:93", "network": {"id": "4205f899-9865-4c65-8b46-c9a533e9bb45", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-774780781-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.148", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d59b73851c79473a9c2cdc0a120dfee0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4007497-d2", "ovs_interfaceid": "e4007497-d23d-4fc2-bba3-e618eec593e2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 23:59:04 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-c923da88-fa80-4d0b-89a3-a8fb29d43586 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6c:b3:93,bridge_name='br-int',has_traffic_filtering=True,id=e4007497-d23d-4fc2-bba3-e618eec593e2,network=Network(4205f899-9865-4c65-8b46-c9a533e9bb45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape4007497-d2') {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 23:59:04 user nova-compute[75045]: DEBUG os_vif [None req-c923da88-fa80-4d0b-89a3-a8fb29d43586 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:6c:b3:93,bridge_name='br-int',has_traffic_filtering=True,id=e4007497-d23d-4fc2-bba3-e618eec593e2,network=Network(4205f899-9865-4c65-8b46-c9a533e9bb45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape4007497-d2') {{(pid=75045) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 23:59:04 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:59:04 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape4007497-d2, bridge=br-int, if_exists=True) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:59:04 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:59:04 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 23:59:04 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:59:04 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2a6ee86c-cc0e-4554-8ee6-599aca6e45c0) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 23:59:04 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 23:59:04 user nova-compute[75045]: INFO os_vif [None req-c923da88-fa80-4d0b-89a3-a8fb29d43586 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:6c:b3:93,bridge_name='br-int',has_traffic_filtering=True,id=e4007497-d23d-4fc2-bba3-e618eec593e2,network=Network(4205f899-9865-4c65-8b46-c9a533e9bb45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape4007497-d2')
Nov 08 23:59:04 user nova-compute[75045]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c923da88-fa80-4d0b-89a3-a8fb29d43586 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] [instance: f2b04024-a109-4b8b-8a7d-1c0fc8712afd] calling os-brick to detach iSCSI Volume {{(pid=75045) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 23:59:04 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-c923da88-fa80-4d0b-89a3-a8fb29d43586 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1b68210460>, {'target_iqn': 'iqn.2010-10.org.openstack:c32ddba4-c092-4e6e-abe5-8dab539439b9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yMhRfWug', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75045) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 23:59:04 user nova-compute[75045]: WARNING os_brick.initiator.connectors.base [None req-c923da88-fa80-4d0b-89a3-a8fb29d43586 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 23:59:04 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-c923da88-fa80-4d0b-89a3-a8fb29d43586 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 23:59:04 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-c923da88-fa80-4d0b-89a3-a8fb29d43586 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 23:59:04 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:59:04 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:59:04 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[685367a6-f59d-4cff-bd90-67288820a93b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:dcbd911e-f385-4ed6-b8a4-383b3b56cf7d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6204dd7b-f1fa-43fe-ab4b-ada1efb74e9c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c32ddba4-c092-4e6e-abe5-8dab539439b9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:59:04 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-c923da88-fa80-4d0b-89a3-a8fb29d43586 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 23:59:04 user nova-compute[75045]: No targets found.
Nov 08 23:59:04 user nova-compute[75045]: iSNS:
Nov 08 23:59:04 user nova-compute[75045]: No targets found.
Nov 08 23:59:04 user nova-compute[75045]: STATIC:
Nov 08 23:59:04 user nova-compute[75045]: Target: iqn.2010-10.org.openstack:dcbd911e-f385-4ed6-b8a4-383b3b56cf7d
Nov 08 23:59:04 user nova-compute[75045]:         Portal: 172.16.0.220:3260,-1
Nov 08 23:59:04 user nova-compute[75045]:                 Iface Name: default
Nov 08 23:59:04 user nova-compute[75045]: Target: iqn.2010-10.org.openstack:6204dd7b-f1fa-43fe-ab4b-ada1efb74e9c
Nov 08 23:59:04 user nova-compute[75045]:         Portal: 172.16.0.220:3260,-1
Nov 08 23:59:04 user nova-compute[75045]:                 Iface Name: default
Nov 08 23:59:04 user nova-compute[75045]: Target: iqn.2010-10.org.openstack:c32ddba4-c092-4e6e-abe5-8dab539439b9
Nov 08 23:59:04 user nova-compute[75045]:         Portal: 172.16.0.220:3260,-1
Nov 08 23:59:04 user nova-compute[75045]:                 Iface Name: default
Nov 08 23:59:04 user nova-compute[75045]: FIRMWARE:
Nov 08 23:59:04 user nova-compute[75045]: No targets found.
Nov 08 23:59:04 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 23:59:04 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-c923da88-fa80-4d0b-89a3-a8fb29d43586 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 23:59:04 user nova-compute[75045]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 23:59:04 user nova-compute[75045]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75045) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 23:59:04 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-c923da88-fa80-4d0b-89a3-a8fb29d43586 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c32ddba4-c092-4e6e-abe5-8dab539439b9', 0)] {{(pid=75045) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 23:59:04 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:59:04 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:59:04 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[63b01c3f-cc79-4774-9c8a-8e3f11a76775]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6204dd7b-f1fa-43fe-ab4b-ada1efb74e9c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c32ddba4-c092-4e6e-abe5-8dab539439b9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dcbd911e-f385-4ed6-b8a4-383b3b56cf7d\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:59:04 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:59:04 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:59:04 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[b00c6b17-cab4-470e-b81f-1760876a776d]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcbd911e-f385-4ed6-b8a4-383b3b56cf7d (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c32ddba4-c092-4e6e-abe5-8dab539439b9 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6204dd7b-f1fa-43fe-ab4b-ada1efb74e9c (non-flash)\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:59:04 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-c923da88-fa80-4d0b-89a3-a8fb29d43586 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcbd911e-f385-4ed6-b8a4-383b3b56cf7d (non-flash)
Nov 08 23:59:04 user nova-compute[75045]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c32ddba4-c092-4e6e-abe5-8dab539439b9 (non-flash)
Nov 08 23:59:04 user nova-compute[75045]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6204dd7b-f1fa-43fe-ab4b-ada1efb74e9c (non-flash)
Nov 08 23:59:04 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 23:59:04 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-c923da88-fa80-4d0b-89a3-a8fb29d43586 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcbd911e-f385-4ed6-b8a4-383b3b56cf7d (non-flash)
Nov 08 23:59:04 user nova-compute[75045]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c32ddba4-c092-4e6e-abe5-8dab539439b9 (non-flash)
Nov 08 23:59:04 user nova-compute[75045]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6204dd7b-f1fa-43fe-ab4b-ada1efb74e9c (non-flash)
Nov 08 23:59:04 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 23:59:04 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-c923da88-fa80-4d0b-89a3-a8fb29d43586 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1b684ded40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c32ddba4-c092-4e6e-abe5-8dab539439b9'): ({'sdb'}, set())}) {{(pid=75045) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 23:59:04 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-c923da88-fa80-4d0b-89a3-a8fb29d43586 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Removing single pathed devices sdb {{(pid=75045) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 23:59:04 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:59:04 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:59:04 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d7a114e-c1c5-4282-b4e3-9d1c04f4d125]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:59:04 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:59:04 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:59:04 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[81c348de-4a22-47e6-b400-74f9ad7546ec]: (4, ('ok\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:59:04 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-c923da88-fa80-4d0b-89a3-a8fb29d43586 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Flushing IO for device /dev/sdb {{(pid=75045) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 23:59:04 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:59:04 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:59:04 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec835097-0524-4af6-b1f0-a2f1f98b35f0]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:59:04 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-c923da88-fa80-4d0b-89a3-a8fb29d43586 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75045) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 23:59:04 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:59:04 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.097s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:59:04 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2dbb68d-2b05-486f-98e0-c1106a08fa23]: (4, ('1', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:59:04 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-c923da88-fa80-4d0b-89a3-a8fb29d43586 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75045) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 23:59:04 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-c923da88-fa80-4d0b-89a3-a8fb29d43586 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] SCSI volumes sdb have been removed. {{(pid=75045) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 23:59:04 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-c923da88-fa80-4d0b-89a3-a8fb29d43586 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c32ddba4-c092-4e6e-abe5-8dab539439b9')] {{(pid=75045) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 23:59:04 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c32ddba4-c092-4e6e-abe5-8dab539439b9 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:59:04 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c32ddba4-c092-4e6e-abe5-8dab539439b9 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:59:04 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca666f6e-0b60-4175-87b0-cf07d0f294e3]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:59:04 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-c923da88-fa80-4d0b-89a3-a8fb29d43586 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:59:04 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c32ddba4-c092-4e6e-abe5-8dab539439b9 -p 172.16.0.220:3260 --logout {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:59:04 user nova-compute[75045]: DEBUG nova.compute.manager [req-fe389452-8446-4160-8e08-3bf2e6ea751e req-c22f5cd0-195b-4e6a-b0f1-dfd4e894b2b4 service nova] [instance: f2b04024-a109-4b8b-8a7d-1c0fc8712afd] Received event network-changed-e4007497-d23d-4fc2-bba3-e618eec593e2 {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:59:04 user nova-compute[75045]: DEBUG nova.compute.manager [req-fe389452-8446-4160-8e08-3bf2e6ea751e req-c22f5cd0-195b-4e6a-b0f1-dfd4e894b2b4 service nova] [instance: f2b04024-a109-4b8b-8a7d-1c0fc8712afd] Refreshing instance network info cache due to event network-changed-e4007497-d23d-4fc2-bba3-e618eec593e2. {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 23:59:04 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-fe389452-8446-4160-8e08-3bf2e6ea751e req-c22f5cd0-195b-4e6a-b0f1-dfd4e894b2b4 service nova] Acquiring lock "refresh_cache-f2b04024-a109-4b8b-8a7d-1c0fc8712afd" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 23:59:04 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-fe389452-8446-4160-8e08-3bf2e6ea751e req-c22f5cd0-195b-4e6a-b0f1-dfd4e894b2b4 service nova] Acquired lock "refresh_cache-f2b04024-a109-4b8b-8a7d-1c0fc8712afd" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 23:59:04 user nova-compute[75045]: DEBUG nova.network.neutron [req-fe389452-8446-4160-8e08-3bf2e6ea751e req-c22f5cd0-195b-4e6a-b0f1-dfd4e894b2b4 service nova] [instance: f2b04024-a109-4b8b-8a7d-1c0fc8712afd] Refreshing network info cache for port e4007497-d23d-4fc2-bba3-e618eec593e2 {{(pid=75045) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 23:59:04 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c32ddba4-c092-4e6e-abe5-8dab539439b9 -p 172.16.0.220:3260 --logout" returned: 0 in 0.077s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:59:04 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[d38bc8ee-2918-4e73-952f-c832c9c80984]: (4, ('Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:c32ddba4-c092-4e6e-abe5-8dab539439b9, portal: 172.16.0.220,3260]\nLogout of [sid: 53, target: iqn.2010-10.org.openstack:c32ddba4-c092-4e6e-abe5-8dab539439b9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:59:04 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-c923da88-fa80-4d0b-89a3-a8fb29d43586 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:c32ddba4-c092-4e6e-abe5-8dab539439b9, portal: 172.16.0.220,3260]
Nov 08 23:59:04 user nova-compute[75045]: Logout of [sid: 53, target: iqn.2010-10.org.openstack:c32ddba4-c092-4e6e-abe5-8dab539439b9, portal: 172.16.0.220,3260] successful.
Nov 08 23:59:04 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:59:04 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c32ddba4-c092-4e6e-abe5-8dab539439b9 -p 172.16.0.220:3260 --op delete {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:59:04 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c32ddba4-c092-4e6e-abe5-8dab539439b9 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:59:04 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fcff2b8-92e1-4f29-8c97-29d946ad4441]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 23:59:04 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-c923da88-fa80-4d0b-89a3-a8fb29d43586 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 23:59:04 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-c923da88-fa80-4d0b-89a3-a8fb29d43586 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.381s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 23:59:04 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-c923da88-fa80-4d0b-89a3-a8fb29d43586 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] <== disconnect_volume: return (382ms) None {{(pid=75045) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 23:59:04 user nova-compute[75045]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c923da88-fa80-4d0b-89a3-a8fb29d43586 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] [instance: f2b04024-a109-4b8b-8a7d-1c0fc8712afd] Disconnected iSCSI Volume {{(pid=75045) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 23:59:04 user nova-compute[75045]: INFO nova.virt.libvirt.driver [None req-c923da88-fa80-4d0b-89a3-a8fb29d43586 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] [instance: f2b04024-a109-4b8b-8a7d-1c0fc8712afd] Deleting instance files /opt/stack/data/nova/instances/f2b04024-a109-4b8b-8a7d-1c0fc8712afd_del
Nov 08 23:59:04 user nova-compute[75045]: INFO nova.virt.libvirt.driver [None req-c923da88-fa80-4d0b-89a3-a8fb29d43586 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] [instance: f2b04024-a109-4b8b-8a7d-1c0fc8712afd] Deletion of /opt/stack/data/nova/instances/f2b04024-a109-4b8b-8a7d-1c0fc8712afd_del complete
Nov 08 23:59:04 user nova-compute[75045]: INFO nova.compute.manager [None req-c923da88-fa80-4d0b-89a3-a8fb29d43586 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] [instance: f2b04024-a109-4b8b-8a7d-1c0fc8712afd] Took 1.24 seconds to destroy the instance on the hypervisor.
Nov 08 23:59:04 user nova-compute[75045]: DEBUG oslo.service.loopingcall [None req-c923da88-fa80-4d0b-89a3-a8fb29d43586 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75045) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 23:59:04 user nova-compute[75045]: DEBUG nova.compute.manager [-] [instance: f2b04024-a109-4b8b-8a7d-1c0fc8712afd] Deallocating network for instance {{(pid=75045) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 23:59:04 user nova-compute[75045]: DEBUG nova.network.neutron [-] [instance: f2b04024-a109-4b8b-8a7d-1c0fc8712afd] deallocate_for_instance() {{(pid=75045) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 23:59:04 user nova-compute[75045]: DEBUG nova.network.neutron [req-fe389452-8446-4160-8e08-3bf2e6ea751e req-c22f5cd0-195b-4e6a-b0f1-dfd4e894b2b4 service nova] [instance: f2b04024-a109-4b8b-8a7d-1c0fc8712afd] Updated VIF entry in instance network info cache for port e4007497-d23d-4fc2-bba3-e618eec593e2. {{(pid=75045) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 23:59:04 user nova-compute[75045]: DEBUG nova.network.neutron [req-fe389452-8446-4160-8e08-3bf2e6ea751e req-c22f5cd0-195b-4e6a-b0f1-dfd4e894b2b4 service nova] [instance: f2b04024-a109-4b8b-8a7d-1c0fc8712afd] Updating instance_info_cache with network_info: [{"id": "e4007497-d23d-4fc2-bba3-e618eec593e2", "address": "fa:16:3e:6c:b3:93", "network": {"id": "4205f899-9865-4c65-8b46-c9a533e9bb45", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-774780781-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d59b73851c79473a9c2cdc0a120dfee0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4007497-d2", "ovs_interfaceid": "e4007497-d23d-4fc2-bba3-e618eec593e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75045) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 23:59:04 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-fe389452-8446-4160-8e08-3bf2e6ea751e req-c22f5cd0-195b-4e6a-b0f1-dfd4e894b2b4 service nova] Releasing lock "refresh_cache-f2b04024-a109-4b8b-8a7d-1c0fc8712afd" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 23:59:05 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:59:05 user nova-compute[75045]: DEBUG nova.network.neutron [-] [instance: f2b04024-a109-4b8b-8a7d-1c0fc8712afd] Updating instance_info_cache with network_info: [] {{(pid=75045) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 23:59:05 user nova-compute[75045]: INFO nova.compute.manager [-] [instance: f2b04024-a109-4b8b-8a7d-1c0fc8712afd] Took 0.71 seconds to deallocate network for instance.
Nov 08 23:59:05 user nova-compute[75045]: DEBUG nova.compute.manager [req-0fc48504-b4c8-4a53-b30f-50b8c6c2f005 req-000512aa-c207-47d4-b930-7bd55115e25d service nova] [instance: f2b04024-a109-4b8b-8a7d-1c0fc8712afd] Received event network-vif-deleted-e4007497-d23d-4fc2-bba3-e618eec593e2 {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:59:05 user nova-compute[75045]: DEBUG nova.compute.manager [req-5a801f16-7e65-45a2-bde2-a56b303815cd req-0d4f63bc-0879-4325-8c25-1d515dfaf142 service nova] [instance: f2b04024-a109-4b8b-8a7d-1c0fc8712afd] Received event network-vif-plugged-e4007497-d23d-4fc2-bba3-e618eec593e2 {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:59:05 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-5a801f16-7e65-45a2-bde2-a56b303815cd req-0d4f63bc-0879-4325-8c25-1d515dfaf142 service nova] Acquiring lock "f2b04024-a109-4b8b-8a7d-1c0fc8712afd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:59:05 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-5a801f16-7e65-45a2-bde2-a56b303815cd req-0d4f63bc-0879-4325-8c25-1d515dfaf142 service nova] Lock "f2b04024-a109-4b8b-8a7d-1c0fc8712afd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:59:05 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-5a801f16-7e65-45a2-bde2-a56b303815cd req-0d4f63bc-0879-4325-8c25-1d515dfaf142 service nova] Lock "f2b04024-a109-4b8b-8a7d-1c0fc8712afd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:59:05 user nova-compute[75045]: DEBUG nova.compute.manager [req-5a801f16-7e65-45a2-bde2-a56b303815cd req-0d4f63bc-0879-4325-8c25-1d515dfaf142 service nova] [instance: f2b04024-a109-4b8b-8a7d-1c0fc8712afd] No waiting events found dispatching network-vif-plugged-e4007497-d23d-4fc2-bba3-e618eec593e2 {{(pid=75045) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 23:59:05 user nova-compute[75045]: WARNING nova.compute.manager [req-5a801f16-7e65-45a2-bde2-a56b303815cd req-0d4f63bc-0879-4325-8c25-1d515dfaf142 service nova] [instance: f2b04024-a109-4b8b-8a7d-1c0fc8712afd] Received unexpected event network-vif-plugged-e4007497-d23d-4fc2-bba3-e618eec593e2 for instance with vm_state active and task_state deleting.
Nov 08 23:59:06 user nova-compute[75045]: INFO nova.compute.manager [None req-c923da88-fa80-4d0b-89a3-a8fb29d43586 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] [instance: f2b04024-a109-4b8b-8a7d-1c0fc8712afd] Took 0.91 seconds to detach 1 volumes for instance.
Nov 08 23:59:06 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-c923da88-fa80-4d0b-89a3-a8fb29d43586 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:59:06 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-c923da88-fa80-4d0b-89a3-a8fb29d43586 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:59:06 user nova-compute[75045]: DEBUG nova.compute.provider_tree [None req-c923da88-fa80-4d0b-89a3-a8fb29d43586 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Inventory has not changed in ProviderTree for provider: 62ba5f85-c74d-4b58-986e-d4197e813fd7 {{(pid=75045) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 23:59:06 user nova-compute[75045]: DEBUG nova.scheduler.client.report [None req-c923da88-fa80-4d0b-89a3-a8fb29d43586 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Inventory has not changed for provider 62ba5f85-c74d-4b58-986e-d4197e813fd7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75045) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 23:59:06 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-c923da88-fa80-4d0b-89a3-a8fb29d43586 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.154s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:59:06 user nova-compute[75045]: INFO nova.scheduler.client.report [None req-c923da88-fa80-4d0b-89a3-a8fb29d43586 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Deleted allocations for instance f2b04024-a109-4b8b-8a7d-1c0fc8712afd
Nov 08 23:59:06 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-c923da88-fa80-4d0b-89a3-a8fb29d43586 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Lock "f2b04024-a109-4b8b-8a7d-1c0fc8712afd" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.199s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:59:06 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:59:06 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:59:06 user nova-compute[75045]: DEBUG nova.compute.manager [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75045) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 23:59:07 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:59:07 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:59:07 user nova-compute[75045]: DEBUG nova.compute.manager [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Starting heal instance info cache {{(pid=75045) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 23:59:07 user nova-compute[75045]: DEBUG nova.compute.manager [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Rebuilding the list of instances to heal {{(pid=75045) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 08 23:59:08 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Acquiring lock "refresh_cache-df16d913-9985-415f-aedc-14f2ca5bcf13" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 23:59:08 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Acquired lock "refresh_cache-df16d913-9985-415f-aedc-14f2ca5bcf13" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 23:59:08 user nova-compute[75045]: DEBUG nova.network.neutron [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] [instance: df16d913-9985-415f-aedc-14f2ca5bcf13] Forcefully refreshing network info cache for instance {{(pid=75045) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 23:59:08 user nova-compute[75045]: DEBUG nova.objects.instance [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Lazy-loading 'info_cache' on Instance uuid df16d913-9985-415f-aedc-14f2ca5bcf13 {{(pid=75045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 23:59:08 user nova-compute[75045]: DEBUG nova.network.neutron [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] [instance: df16d913-9985-415f-aedc-14f2ca5bcf13] Updating instance_info_cache with network_info: [{"id": "c762a745-51d7-4d4e-bdc5-c962aec66b02", "address": "fa:16:3e:80:3b:b9", "network": {"id": "4205f899-9865-4c65-8b46-c9a533e9bb45", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-774780781-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.119", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d59b73851c79473a9c2cdc0a120dfee0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc762a745-51", "ovs_interfaceid": "c762a745-51d7-4d4e-bdc5-c962aec66b02", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75045) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 23:59:08 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Releasing lock "refresh_cache-df16d913-9985-415f-aedc-14f2ca5bcf13" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 23:59:08 user nova-compute[75045]: DEBUG nova.compute.manager [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] [instance: df16d913-9985-415f-aedc-14f2ca5bcf13] Updated the network info_cache for instance {{(pid=75045) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 23:59:09 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:59:10 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:59:12 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:59:12 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:59:14 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 23:59:14 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:59:19 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 23:59:19 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:59:19 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75045) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 23:59:19 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75045) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 23:59:19 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75045) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 23:59:19 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:59:20 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager.update_available_resource {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 23:59:20 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:59:20 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:59:20 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:59:20 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Auditing locally available compute resources for user (node: user) {{(pid=75045) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 23:59:21 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75045) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 23:59:21 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d9a47ed-6aa3-468f-b106-46b60cd27a46/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:59:21 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d9a47ed-6aa3-468f-b106-46b60cd27a46/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:59:21 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d9a47ed-6aa3-468f-b106-46b60cd27a46/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 23:59:21 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d9a47ed-6aa3-468f-b106-46b60cd27a46/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 23:59:21 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75045) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 23:59:21 user nova-compute[75045]: WARNING nova.virt.libvirt.driver [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 23:59:21 user nova-compute[75045]: WARNING nova.virt.libvirt.driver [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 23:59:21 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Hypervisor/Node resource view: name=user free_ram=8793MB free_disk=24.893569946289062GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75045) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 23:59:21 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:59:21 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:59:21 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Instance df16d913-9985-415f-aedc-14f2ca5bcf13 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75045) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 23:59:21 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Instance 8d9a47ed-6aa3-468f-b106-46b60cd27a46 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75045) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 23:59:21 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75045) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 23:59:21 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75045) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 23:59:21 user nova-compute[75045]: DEBUG nova.compute.provider_tree [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Inventory has not changed in ProviderTree for provider: 62ba5f85-c74d-4b58-986e-d4197e813fd7 {{(pid=75045) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 23:59:21 user nova-compute[75045]: DEBUG nova.scheduler.client.report [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Inventory has not changed for provider 62ba5f85-c74d-4b58-986e-d4197e813fd7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75045) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 23:59:21 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Compute_service record updated for user:user {{(pid=75045) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 23:59:21 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.181s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 23:59:24 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:59:29 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 23:59:29 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:59:29 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75045) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 23:59:29 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75045) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 23:59:29 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75045) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 23:59:29 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:59:34 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:59:38 user nova-compute[75045]: DEBUG nova.compute.manager [req-4b87d1d8-2641-438b-b6d6-2c72295b2b55 req-f9171e46-0764-4684-89ed-784e0b5a4242 service nova] [instance: 8d9a47ed-6aa3-468f-b106-46b60cd27a46] Received event network-changed-26db8f3f-0cb5-474c-9499-14ece10e73e3 {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:59:38 user nova-compute[75045]: DEBUG nova.compute.manager [req-4b87d1d8-2641-438b-b6d6-2c72295b2b55 req-f9171e46-0764-4684-89ed-784e0b5a4242 service nova] [instance: 8d9a47ed-6aa3-468f-b106-46b60cd27a46] Refreshing instance network info cache due to event network-changed-26db8f3f-0cb5-474c-9499-14ece10e73e3. {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 23:59:38 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-4b87d1d8-2641-438b-b6d6-2c72295b2b55 req-f9171e46-0764-4684-89ed-784e0b5a4242 service nova] Acquiring lock "refresh_cache-8d9a47ed-6aa3-468f-b106-46b60cd27a46" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 23:59:38 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-4b87d1d8-2641-438b-b6d6-2c72295b2b55 req-f9171e46-0764-4684-89ed-784e0b5a4242 service nova] Acquired lock "refresh_cache-8d9a47ed-6aa3-468f-b106-46b60cd27a46" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 23:59:38 user nova-compute[75045]: DEBUG nova.network.neutron [req-4b87d1d8-2641-438b-b6d6-2c72295b2b55 req-f9171e46-0764-4684-89ed-784e0b5a4242 service nova] [instance: 8d9a47ed-6aa3-468f-b106-46b60cd27a46] Refreshing network info cache for port 26db8f3f-0cb5-474c-9499-14ece10e73e3 {{(pid=75045) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 23:59:38 user nova-compute[75045]: DEBUG nova.network.neutron [req-4b87d1d8-2641-438b-b6d6-2c72295b2b55 req-f9171e46-0764-4684-89ed-784e0b5a4242 service nova] [instance: 8d9a47ed-6aa3-468f-b106-46b60cd27a46] Updated VIF entry in instance network info cache for port 26db8f3f-0cb5-474c-9499-14ece10e73e3. {{(pid=75045) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 23:59:38 user nova-compute[75045]: DEBUG nova.network.neutron [req-4b87d1d8-2641-438b-b6d6-2c72295b2b55 req-f9171e46-0764-4684-89ed-784e0b5a4242 service nova] [instance: 8d9a47ed-6aa3-468f-b106-46b60cd27a46] Updating instance_info_cache with network_info: [{"id": "26db8f3f-0cb5-474c-9499-14ece10e73e3", "address": "fa:16:3e:12:6c:30", "network": {"id": "fe5f7093-1cdd-465c-97f0-7d7b2dd1fa8a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1755065955-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.27", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4bfce59008d44fdb5ba91c70f1cf044", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26db8f3f-0c", "ovs_interfaceid": "26db8f3f-0cb5-474c-9499-14ece10e73e3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75045) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 23:59:38 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-4b87d1d8-2641-438b-b6d6-2c72295b2b55 req-f9171e46-0764-4684-89ed-784e0b5a4242 service nova] Releasing lock "refresh_cache-8d9a47ed-6aa3-468f-b106-46b60cd27a46" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 23:59:39 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:59:39 user nova-compute[75045]: DEBUG nova.compute.manager [req-7bc22368-ad4b-46b3-ab89-c77da2efe771 req-3ac8952f-3661-40e3-9630-601003e4f66e service nova] [instance: 8d9a47ed-6aa3-468f-b106-46b60cd27a46] Received event network-changed-26db8f3f-0cb5-474c-9499-14ece10e73e3 {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 23:59:39 user nova-compute[75045]: DEBUG nova.compute.manager [req-7bc22368-ad4b-46b3-ab89-c77da2efe771 req-3ac8952f-3661-40e3-9630-601003e4f66e service nova] [instance: 8d9a47ed-6aa3-468f-b106-46b60cd27a46] Refreshing instance network info cache due to event network-changed-26db8f3f-0cb5-474c-9499-14ece10e73e3. {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 23:59:39 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-7bc22368-ad4b-46b3-ab89-c77da2efe771 req-3ac8952f-3661-40e3-9630-601003e4f66e service nova] Acquiring lock "refresh_cache-8d9a47ed-6aa3-468f-b106-46b60cd27a46" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 23:59:39 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-7bc22368-ad4b-46b3-ab89-c77da2efe771 req-3ac8952f-3661-40e3-9630-601003e4f66e service nova] Acquired lock "refresh_cache-8d9a47ed-6aa3-468f-b106-46b60cd27a46" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 23:59:39 user nova-compute[75045]: DEBUG nova.network.neutron [req-7bc22368-ad4b-46b3-ab89-c77da2efe771 req-3ac8952f-3661-40e3-9630-601003e4f66e service nova] [instance: 8d9a47ed-6aa3-468f-b106-46b60cd27a46] Refreshing network info cache for port 26db8f3f-0cb5-474c-9499-14ece10e73e3 {{(pid=75045) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 23:59:39 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2475c2de-42da-45ab-b953-a48149a72413 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] Acquiring lock "8d9a47ed-6aa3-468f-b106-46b60cd27a46" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 23:59:39 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2475c2de-42da-45ab-b953-a48149a72413 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] Lock "8d9a47ed-6aa3-468f-b106-46b60cd27a46" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 23:59:39 user nova-compute[75045]: INFO nova.compute.manager [None req-2475c2de-42da-45ab-b953-a48149a72413 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] [instance: 8d9a47ed-6aa3-468f-b106-46b60cd27a46] Detaching volume 6204dd7b-f1fa-43fe-ab4b-ada1efb74e9c
Nov 08 23:59:39 user nova-compute[75045]: INFO nova.virt.block_device [None req-2475c2de-42da-45ab-b953-a48149a72413 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] [instance: 8d9a47ed-6aa3-468f-b106-46b60cd27a46] Attempting to driver detach volume 6204dd7b-f1fa-43fe-ab4b-ada1efb74e9c from mountpoint /dev/vdb
Nov 08 23:59:39 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-2475c2de-42da-45ab-b953-a48149a72413 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] Attempting to detach device vdb from instance 8d9a47ed-6aa3-468f-b106-46b60cd27a46 from the persistent domain config. {{(pid=75045) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 08 23:59:39 user nova-compute[75045]: DEBUG nova.virt.libvirt.guest [None req-2475c2de-42da-45ab-b953-a48149a72413 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 23:59:39 user nova-compute[75045]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 23:59:39 user nova-compute[75045]:   <source dev="/dev/sdd"/>
Nov 08 23:59:39 user nova-compute[75045]:   <target dev="vdb" bus="virtio"/>
Nov 08 23:59:39 user nova-compute[75045]:   <serial>6204dd7b-f1fa-43fe-ab4b-ada1efb74e9c</serial>
Nov 08 23:59:39 user nova-compute[75045]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 08 23:59:39 user nova-compute[75045]: </disk>
Nov 08 23:59:39 user nova-compute[75045]:  {{(pid=75045) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 23:59:39 user nova-compute[75045]: INFO nova.virt.libvirt.driver [None req-2475c2de-42da-45ab-b953-a48149a72413 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] Successfully detached device vdb from instance 8d9a47ed-6aa3-468f-b106-46b60cd27a46 from the persistent domain config.
Nov 08 23:59:39 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-2475c2de-42da-45ab-b953-a48149a72413 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 8d9a47ed-6aa3-468f-b106-46b60cd27a46 from the live domain config. {{(pid=75045) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 08 23:59:39 user nova-compute[75045]: DEBUG nova.virt.libvirt.guest [None req-2475c2de-42da-45ab-b953-a48149a72413 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 23:59:39 user nova-compute[75045]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 23:59:39 user nova-compute[75045]:   <source dev="/dev/sdd"/>
Nov 08 23:59:39 user nova-compute[75045]:   <target dev="vdb" bus="virtio"/>
Nov 08 23:59:39 user nova-compute[75045]:   <serial>6204dd7b-f1fa-43fe-ab4b-ada1efb74e9c</serial>
Nov 08 23:59:39 user nova-compute[75045]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 08 23:59:39 user nova-compute[75045]: </disk>
Nov 08 23:59:39 user nova-compute[75045]:  {{(pid=75045) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 23:59:39 user nova-compute[75045]: DEBUG nova.network.neutron [req-7bc22368-ad4b-46b3-ab89-c77da2efe771 req-3ac8952f-3661-40e3-9630-601003e4f66e service nova] [instance: 8d9a47ed-6aa3-468f-b106-46b60cd27a46] Updated VIF entry in instance network info cache for port 26db8f3f-0cb5-474c-9499-14ece10e73e3. {{(pid=75045) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 23:59:39 user nova-compute[75045]: DEBUG nova.network.neutron [req-7bc22368-ad4b-46b3-ab89-c77da2efe771 req-3ac8952f-3661-40e3-9630-601003e4f66e service nova] [instance: 8d9a47ed-6aa3-468f-b106-46b60cd27a46] Updating instance_info_cache with network_info: [{"id": "26db8f3f-0cb5-474c-9499-14ece10e73e3", "address": "fa:16:3e:12:6c:30", "network": {"id": "fe5f7093-1cdd-465c-97f0-7d7b2dd1fa8a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1755065955-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4bfce59008d44fdb5ba91c70f1cf044", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26db8f3f-0c", "ovs_interfaceid": "26db8f3f-0cb5-474c-9499-14ece10e73e3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75045) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 23:59:39 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-7bc22368-ad4b-46b3-ab89-c77da2efe771 req-3ac8952f-3661-40e3-9630-601003e4f66e service nova] Releasing lock "refresh_cache-8d9a47ed-6aa3-468f-b106-46b60cd27a46" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 23:59:40 user nova-compute[75045]: DEBUG nova.virt.libvirt.driver [None req-2475c2de-42da-45ab-b953-a48149a72413 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 8d9a47ed-6aa3-468f-b106-46b60cd27a46 {{(pid=75045) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 08 23:59:42 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:59:44 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:59:49 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:59:54 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 23:59:59 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:00:00 user nova-compute[75045]: WARNING nova.virt.libvirt.driver [None req-2475c2de-42da-45ab-b953-a48149a72413 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 8d9a47ed-6aa3-468f-b106-46b60cd27a46 is timed out.
Nov 09 00:00:00 user nova-compute[75045]: INFO nova.virt.libvirt.driver [None req-2475c2de-42da-45ab-b953-a48149a72413 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] Successfully detached device vdb from instance 8d9a47ed-6aa3-468f-b106-46b60cd27a46 from the live domain config.
Nov 09 00:00:00 user nova-compute[75045]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2475c2de-42da-45ab-b953-a48149a72413 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] [instance: 8d9a47ed-6aa3-468f-b106-46b60cd27a46] calling os-brick to detach iSCSI Volume {{(pid=75045) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 09 00:00:00 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-2475c2de-42da-45ab-b953-a48149a72413 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1b68210460>, {'target_iqn': 'iqn.2010-10.org.openstack:6204dd7b-f1fa-43fe-ab4b-ada1efb74e9c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ueWBwFrj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=75045) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 00:00:00 user nova-compute[75045]: WARNING os_brick.initiator.connectors.base [None req-2475c2de-42da-45ab-b953-a48149a72413 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 00:00:00 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-2475c2de-42da-45ab-b953-a48149a72413 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 00:00:00 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-2475c2de-42da-45ab-b953-a48149a72413 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 00:00:00 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:00:00 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:00:00 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b80cb40-caf0-4f07-a549-683322946a36]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:dcbd911e-f385-4ed6-b8a4-383b3b56cf7d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6204dd7b-f1fa-43fe-ab4b-ada1efb74e9c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:00:00 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-2475c2de-42da-45ab-b953-a48149a72413 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 09 00:00:00 user nova-compute[75045]: No targets found.
Nov 09 00:00:00 user nova-compute[75045]: iSNS:
Nov 09 00:00:00 user nova-compute[75045]: No targets found.
Nov 09 00:00:00 user nova-compute[75045]: STATIC:
Nov 09 00:00:00 user nova-compute[75045]: Target: iqn.2010-10.org.openstack:dcbd911e-f385-4ed6-b8a4-383b3b56cf7d
Nov 09 00:00:00 user nova-compute[75045]:         Portal: 172.16.0.220:3260,-1
Nov 09 00:00:00 user nova-compute[75045]:                 Iface Name: default
Nov 09 00:00:00 user nova-compute[75045]: Target: iqn.2010-10.org.openstack:6204dd7b-f1fa-43fe-ab4b-ada1efb74e9c
Nov 09 00:00:00 user nova-compute[75045]:         Portal: 172.16.0.220:3260,-1
Nov 09 00:00:00 user nova-compute[75045]:                 Iface Name: default
Nov 09 00:00:00 user nova-compute[75045]: FIRMWARE:
Nov 09 00:00:00 user nova-compute[75045]: No targets found.
Nov 09 00:00:00 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 00:00:00 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-2475c2de-42da-45ab-b953-a48149a72413 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 09 00:00:00 user nova-compute[75045]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 09 00:00:00 user nova-compute[75045]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75045) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 09 00:00:00 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-2475c2de-42da-45ab-b953-a48149a72413 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6204dd7b-f1fa-43fe-ab4b-ada1efb74e9c', 0)] {{(pid=75045) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 09 00:00:00 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:00:00 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:00:00 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8dce85b-6d54-4c3c-bf6d-c5996c842086]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6204dd7b-f1fa-43fe-ab4b-ada1efb74e9c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dcbd911e-f385-4ed6-b8a4-383b3b56cf7d\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:00:00 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:00:00 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:00:00 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[84c09a9b-8738-4ae2-8491-418447d33464]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcbd911e-f385-4ed6-b8a4-383b3b56cf7d (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6204dd7b-f1fa-43fe-ab4b-ada1efb74e9c (non-flash)\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:00:00 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-2475c2de-42da-45ab-b953-a48149a72413 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcbd911e-f385-4ed6-b8a4-383b3b56cf7d (non-flash)
Nov 09 00:00:00 user nova-compute[75045]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6204dd7b-f1fa-43fe-ab4b-ada1efb74e9c (non-flash)
Nov 09 00:00:00 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 00:00:00 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-2475c2de-42da-45ab-b953-a48149a72413 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcbd911e-f385-4ed6-b8a4-383b3b56cf7d (non-flash)
Nov 09 00:00:00 user nova-compute[75045]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6204dd7b-f1fa-43fe-ab4b-ada1efb74e9c (non-flash)
Nov 09 00:00:00 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 00:00:00 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-2475c2de-42da-45ab-b953-a48149a72413 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1b482640d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6204dd7b-f1fa-43fe-ab4b-ada1efb74e9c'): ({'sdd'}, set())}) {{(pid=75045) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 09 00:00:00 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-2475c2de-42da-45ab-b953-a48149a72413 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] Removing single pathed devices sdd {{(pid=75045) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 09 00:00:00 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:00:00 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:00:00 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[7869cd76-c99a-423a-88e6-455725130b8d]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:00:00 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:00:00 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.023s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:00:00 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[46e5c3f2-221e-4e03-a006-552f7b6ea6ff]: (4, ('ok\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:00:00 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-2475c2de-42da-45ab-b953-a48149a72413 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] Flushing IO for device /dev/sdd {{(pid=75045) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 09 00:00:00 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:00:00 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:00:00 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7fa2302-7db0-42b9-aea7-f879d3b0b6fe]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:00:00 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-2475c2de-42da-45ab-b953-a48149a72413 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75045) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 09 00:00:00 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:00:00 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.044s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:00:00 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9002e63-4b88-4275-a4ec-536742c6d913]: (4, ('1', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:00:00 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-2475c2de-42da-45ab-b953-a48149a72413 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75045) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 09 00:00:00 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-2475c2de-42da-45ab-b953-a48149a72413 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] SCSI volumes sdd have been removed. {{(pid=75045) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 09 00:00:00 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-2475c2de-42da-45ab-b953-a48149a72413 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6204dd7b-f1fa-43fe-ab4b-ada1efb74e9c')] {{(pid=75045) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 09 00:00:00 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6204dd7b-f1fa-43fe-ab4b-ada1efb74e9c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:00:00 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6204dd7b-f1fa-43fe-ab4b-ada1efb74e9c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:00:00 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d33c1f8-096d-42ba-b1df-6b66c2f8802d]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:00:00 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-2475c2de-42da-45ab-b953-a48149a72413 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 00:00:00 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6204dd7b-f1fa-43fe-ab4b-ada1efb74e9c -p 172.16.0.220:3260 --logout {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:00:00 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6204dd7b-f1fa-43fe-ab4b-ada1efb74e9c -p 172.16.0.220:3260 --logout" returned: 0 in 0.078s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:00:00 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b7ecddd-81c8-4198-834d-60bfe066cc93]: (4, ('Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:6204dd7b-f1fa-43fe-ab4b-ada1efb74e9c, portal: 172.16.0.220,3260]\nLogout of [sid: 54, target: iqn.2010-10.org.openstack:6204dd7b-f1fa-43fe-ab4b-ada1efb74e9c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:00:00 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-2475c2de-42da-45ab-b953-a48149a72413 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:6204dd7b-f1fa-43fe-ab4b-ada1efb74e9c, portal: 172.16.0.220,3260]
Nov 09 00:00:00 user nova-compute[75045]: Logout of [sid: 54, target: iqn.2010-10.org.openstack:6204dd7b-f1fa-43fe-ab4b-ada1efb74e9c, portal: 172.16.0.220,3260] successful.
Nov 09 00:00:00 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 00:00:00 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6204dd7b-f1fa-43fe-ab4b-ada1efb74e9c -p 172.16.0.220:3260 --op delete {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:00:00 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6204dd7b-f1fa-43fe-ab4b-ada1efb74e9c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:00:00 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[b277d46f-0190-4ad3-8ea4-b7db6a54a274]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:00:00 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-2475c2de-42da-45ab-b953-a48149a72413 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 00:00:00 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-2475c2de-42da-45ab-b953-a48149a72413 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.340s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 00:00:00 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-2475c2de-42da-45ab-b953-a48149a72413 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] <== disconnect_volume: return (342ms) None {{(pid=75045) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 00:00:00 user nova-compute[75045]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2475c2de-42da-45ab-b953-a48149a72413 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] [instance: 8d9a47ed-6aa3-468f-b106-46b60cd27a46] Disconnected iSCSI Volume {{(pid=75045) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 09 00:00:01 user nova-compute[75045]: DEBUG nova.objects.instance [None req-2475c2de-42da-45ab-b953-a48149a72413 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] Lazy-loading 'flavor' on Instance uuid 8d9a47ed-6aa3-468f-b106-46b60cd27a46 {{(pid=75045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 00:00:01 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2475c2de-42da-45ab-b953-a48149a72413 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] Lock "8d9a47ed-6aa3-468f-b106-46b60cd27a46" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.126s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:00:04 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 00:00:04 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 00:00:06 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 00:00:06 user nova-compute[75045]: DEBUG nova.compute.manager [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75045) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 09 00:00:08 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 00:00:09 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 00:00:09 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:00:09 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75045) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 09 00:00:09 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75045) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 09 00:00:09 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75045) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 09 00:00:09 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:00:09 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 00:00:09 user nova-compute[75045]: DEBUG nova.compute.manager [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Starting heal instance info cache {{(pid=75045) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 09 00:00:10 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Acquiring lock "refresh_cache-8d9a47ed-6aa3-468f-b106-46b60cd27a46" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 00:00:10 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Acquired lock "refresh_cache-8d9a47ed-6aa3-468f-b106-46b60cd27a46" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 00:00:10 user nova-compute[75045]: DEBUG nova.network.neutron [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] [instance: 8d9a47ed-6aa3-468f-b106-46b60cd27a46] Forcefully refreshing network info cache for instance {{(pid=75045) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 09 00:00:11 user nova-compute[75045]: DEBUG nova.network.neutron [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] [instance: 8d9a47ed-6aa3-468f-b106-46b60cd27a46] Updating instance_info_cache with network_info: [{"id": "26db8f3f-0cb5-474c-9499-14ece10e73e3", "address": "fa:16:3e:12:6c:30", "network": {"id": "fe5f7093-1cdd-465c-97f0-7d7b2dd1fa8a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1755065955-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4bfce59008d44fdb5ba91c70f1cf044", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26db8f3f-0c", "ovs_interfaceid": "26db8f3f-0cb5-474c-9499-14ece10e73e3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75045) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 00:00:11 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Releasing lock "refresh_cache-8d9a47ed-6aa3-468f-b106-46b60cd27a46" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 00:00:11 user nova-compute[75045]: DEBUG nova.compute.manager [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] [instance: 8d9a47ed-6aa3-468f-b106-46b60cd27a46] Updated the network info_cache for instance {{(pid=75045) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 09 00:00:11 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 00:00:12 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 00:00:13 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 00:00:14 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 00:00:16 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 00:00:16 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 00:00:17 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:00:17 user nova-compute[75045]: DEBUG nova.compute.manager [req-e20e57ee-0bba-495b-852c-db11db09f604 req-5d4cf5c2-fc86-44e4-a427-32af44284c5e service nova] [instance: df16d913-9985-415f-aedc-14f2ca5bcf13] Received event network-changed-c762a745-51d7-4d4e-bdc5-c962aec66b02 {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 00:00:17 user nova-compute[75045]: DEBUG nova.compute.manager [req-e20e57ee-0bba-495b-852c-db11db09f604 req-5d4cf5c2-fc86-44e4-a427-32af44284c5e service nova] [instance: df16d913-9985-415f-aedc-14f2ca5bcf13] Refreshing instance network info cache due to event network-changed-c762a745-51d7-4d4e-bdc5-c962aec66b02. {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 09 00:00:17 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-e20e57ee-0bba-495b-852c-db11db09f604 req-5d4cf5c2-fc86-44e4-a427-32af44284c5e service nova] Acquiring lock "refresh_cache-df16d913-9985-415f-aedc-14f2ca5bcf13" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 00:00:17 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-e20e57ee-0bba-495b-852c-db11db09f604 req-5d4cf5c2-fc86-44e4-a427-32af44284c5e service nova] Acquired lock "refresh_cache-df16d913-9985-415f-aedc-14f2ca5bcf13" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 00:00:17 user nova-compute[75045]: DEBUG nova.network.neutron [req-e20e57ee-0bba-495b-852c-db11db09f604 req-5d4cf5c2-fc86-44e4-a427-32af44284c5e service nova] [instance: df16d913-9985-415f-aedc-14f2ca5bcf13] Refreshing network info cache for port c762a745-51d7-4d4e-bdc5-c962aec66b02 {{(pid=75045) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 09 00:00:18 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-3f122b8e-b495-49f0-8d1a-8a6ac4a02da7 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Acquiring lock "df16d913-9985-415f-aedc-14f2ca5bcf13" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:00:18 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-3f122b8e-b495-49f0-8d1a-8a6ac4a02da7 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Lock "df16d913-9985-415f-aedc-14f2ca5bcf13" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:00:18 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-3f122b8e-b495-49f0-8d1a-8a6ac4a02da7 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Acquiring lock "df16d913-9985-415f-aedc-14f2ca5bcf13-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:00:18 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-3f122b8e-b495-49f0-8d1a-8a6ac4a02da7 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Lock "df16d913-9985-415f-aedc-14f2ca5bcf13-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:00:18 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-3f122b8e-b495-49f0-8d1a-8a6ac4a02da7 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Lock "df16d913-9985-415f-aedc-14f2ca5bcf13-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:00:18 user nova-compute[75045]: INFO nova.compute.manager [None req-3f122b8e-b495-49f0-8d1a-8a6ac4a02da7 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] [instance: df16d913-9985-415f-aedc-14f2ca5bcf13] Terminating instance
Nov 09 00:00:18 user nova-compute[75045]: DEBUG nova.compute.manager [None req-3f122b8e-b495-49f0-8d1a-8a6ac4a02da7 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] [instance: df16d913-9985-415f-aedc-14f2ca5bcf13] Start destroying the instance on the hypervisor. {{(pid=75045) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 09 00:00:18 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:00:18 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:00:18 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:00:18 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:00:18 user nova-compute[75045]: DEBUG nova.compute.manager [req-d85e41b7-a9c3-49b4-9f98-2fb04be8c4b7 req-b41b6a98-db0b-42ea-a556-e645656871ea service nova] [instance: df16d913-9985-415f-aedc-14f2ca5bcf13] Received event network-vif-unplugged-c762a745-51d7-4d4e-bdc5-c962aec66b02 {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 00:00:18 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-d85e41b7-a9c3-49b4-9f98-2fb04be8c4b7 req-b41b6a98-db0b-42ea-a556-e645656871ea service nova] Acquiring lock "df16d913-9985-415f-aedc-14f2ca5bcf13-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:00:18 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-d85e41b7-a9c3-49b4-9f98-2fb04be8c4b7 req-b41b6a98-db0b-42ea-a556-e645656871ea service nova] Lock "df16d913-9985-415f-aedc-14f2ca5bcf13-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:00:18 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-d85e41b7-a9c3-49b4-9f98-2fb04be8c4b7 req-b41b6a98-db0b-42ea-a556-e645656871ea service nova] Lock "df16d913-9985-415f-aedc-14f2ca5bcf13-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:00:18 user nova-compute[75045]: DEBUG nova.compute.manager [req-d85e41b7-a9c3-49b4-9f98-2fb04be8c4b7 req-b41b6a98-db0b-42ea-a556-e645656871ea service nova] [instance: df16d913-9985-415f-aedc-14f2ca5bcf13] No waiting events found dispatching network-vif-unplugged-c762a745-51d7-4d4e-bdc5-c962aec66b02 {{(pid=75045) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 00:00:18 user nova-compute[75045]: DEBUG nova.compute.manager [req-d85e41b7-a9c3-49b4-9f98-2fb04be8c4b7 req-b41b6a98-db0b-42ea-a556-e645656871ea service nova] [instance: df16d913-9985-415f-aedc-14f2ca5bcf13] Received event network-vif-unplugged-c762a745-51d7-4d4e-bdc5-c962aec66b02 for instance with task_state deleting. {{(pid=75045) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 09 00:00:18 user nova-compute[75045]: INFO nova.virt.libvirt.driver [-] [instance: df16d913-9985-415f-aedc-14f2ca5bcf13] Instance destroyed successfully.
Nov 09 00:00:18 user nova-compute[75045]: DEBUG nova.objects.instance [None req-3f122b8e-b495-49f0-8d1a-8a6ac4a02da7 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Lazy-loading 'resources' on Instance uuid df16d913-9985-415f-aedc-14f2ca5bcf13 {{(pid=75045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 00:00:18 user nova-compute[75045]: DEBUG nova.virt.libvirt.vif [None req-3f122b8e-b495-49f0-8d1a-8a6ac4a02da7 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T23:54:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1514794373',display_name='tempest-TestVolumeBootPattern-server-1514794373',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1514794373',id=50,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG4FMrZDNuVfIPnXfxN4nyoUo/5k5pInfzFUTQXcG54GN3K7TKcBDzRT7RSwNm2HHReK/sg/U9LFWtj081VW6fTpNzjBNfOxhMg0DqXN9g7DbQBYyYNAjTBN+tAvF+1fCA==',key_name='tempest-TestVolumeBootPattern-1614211608',keypairs=<?>,launch_index=0,launched_at=2023-11-08T23:55:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d59b73851c79473a9c2cdc0a120dfee0',ramdisk_id='',reservation_id='r-00v3iqx0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-650796844',owner_user_name='tempest-TestVolumeBootPattern-650796844-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T23:55:37Z,user_data=None,user_id='76c31c64d9594f9cbef7586fafb48721',uuid=df16d913-9985-415f-aedc-14f2ca5bcf13,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c762a745-51d7-4d4e-bdc5-c962aec66b02", "address": "fa:16:3e:80:3b:b9", "network": {"id": "4205f899-9865-4c65-8b46-c9a533e9bb45", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-774780781-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.119", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d59b73851c79473a9c2cdc0a120dfee0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc762a745-51", "ovs_interfaceid": "c762a745-51d7-4d4e-bdc5-c962aec66b02", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75045) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 09 00:00:18 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-3f122b8e-b495-49f0-8d1a-8a6ac4a02da7 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Converting VIF {"id": "c762a745-51d7-4d4e-bdc5-c962aec66b02", "address": "fa:16:3e:80:3b:b9", "network": {"id": "4205f899-9865-4c65-8b46-c9a533e9bb45", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-774780781-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.119", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d59b73851c79473a9c2cdc0a120dfee0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc762a745-51", "ovs_interfaceid": "c762a745-51d7-4d4e-bdc5-c962aec66b02", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 00:00:18 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-3f122b8e-b495-49f0-8d1a-8a6ac4a02da7 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:80:3b:b9,bridge_name='br-int',has_traffic_filtering=True,id=c762a745-51d7-4d4e-bdc5-c962aec66b02,network=Network(4205f899-9865-4c65-8b46-c9a533e9bb45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc762a745-51') {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 00:00:18 user nova-compute[75045]: DEBUG os_vif [None req-3f122b8e-b495-49f0-8d1a-8a6ac4a02da7 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:80:3b:b9,bridge_name='br-int',has_traffic_filtering=True,id=c762a745-51d7-4d4e-bdc5-c962aec66b02,network=Network(4205f899-9865-4c65-8b46-c9a533e9bb45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc762a745-51') {{(pid=75045) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 09 00:00:18 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:00:18 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc762a745-51, bridge=br-int, if_exists=True) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 00:00:18 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:00:18 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 00:00:18 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:00:18 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=bfbeb5aa-fd90-4398-8053-5fdfcf11ee5b) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 00:00:18 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:00:18 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 00:00:18 user nova-compute[75045]: INFO os_vif [None req-3f122b8e-b495-49f0-8d1a-8a6ac4a02da7 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:80:3b:b9,bridge_name='br-int',has_traffic_filtering=True,id=c762a745-51d7-4d4e-bdc5-c962aec66b02,network=Network(4205f899-9865-4c65-8b46-c9a533e9bb45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc762a745-51')
Nov 09 00:00:18 user nova-compute[75045]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3f122b8e-b495-49f0-8d1a-8a6ac4a02da7 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] [instance: df16d913-9985-415f-aedc-14f2ca5bcf13] calling os-brick to detach iSCSI Volume {{(pid=75045) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 09 00:00:18 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f122b8e-b495-49f0-8d1a-8a6ac4a02da7 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1b68210460>, {'target_iqn': 'iqn.2010-10.org.openstack:dcbd911e-f385-4ed6-b8a4-383b3b56cf7d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vcbhzLqi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75045) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 00:00:18 user nova-compute[75045]: WARNING os_brick.initiator.connectors.base [None req-3f122b8e-b495-49f0-8d1a-8a6ac4a02da7 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 00:00:18 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-3f122b8e-b495-49f0-8d1a-8a6ac4a02da7 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 00:00:18 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-3f122b8e-b495-49f0-8d1a-8a6ac4a02da7 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 00:00:18 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:00:18 user nova-compute[75045]: DEBUG nova.network.neutron [req-e20e57ee-0bba-495b-852c-db11db09f604 req-5d4cf5c2-fc86-44e4-a427-32af44284c5e service nova] [instance: df16d913-9985-415f-aedc-14f2ca5bcf13] Updated VIF entry in instance network info cache for port c762a745-51d7-4d4e-bdc5-c962aec66b02. {{(pid=75045) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 09 00:00:18 user nova-compute[75045]: DEBUG nova.network.neutron [req-e20e57ee-0bba-495b-852c-db11db09f604 req-5d4cf5c2-fc86-44e4-a427-32af44284c5e service nova] [instance: df16d913-9985-415f-aedc-14f2ca5bcf13] Updating instance_info_cache with network_info: [{"id": "c762a745-51d7-4d4e-bdc5-c962aec66b02", "address": "fa:16:3e:80:3b:b9", "network": {"id": "4205f899-9865-4c65-8b46-c9a533e9bb45", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-774780781-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d59b73851c79473a9c2cdc0a120dfee0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc762a745-51", "ovs_interfaceid": "c762a745-51d7-4d4e-bdc5-c962aec66b02", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75045) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 00:00:18 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:00:18 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[439eba57-9006-4fec-b427-b10dd7655c34]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:dcbd911e-f385-4ed6-b8a4-383b3b56cf7d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:00:18 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f122b8e-b495-49f0-8d1a-8a6ac4a02da7 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 09 00:00:18 user nova-compute[75045]: No targets found.
Nov 09 00:00:18 user nova-compute[75045]: iSNS:
Nov 09 00:00:18 user nova-compute[75045]: No targets found.
Nov 09 00:00:18 user nova-compute[75045]: STATIC:
Nov 09 00:00:18 user nova-compute[75045]: Target: iqn.2010-10.org.openstack:dcbd911e-f385-4ed6-b8a4-383b3b56cf7d
Nov 09 00:00:18 user nova-compute[75045]:         Portal: 172.16.0.220:3260,-1
Nov 09 00:00:18 user nova-compute[75045]:                 Iface Name: default
Nov 09 00:00:18 user nova-compute[75045]: FIRMWARE:
Nov 09 00:00:18 user nova-compute[75045]: No targets found.
Nov 09 00:00:18 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 00:00:18 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f122b8e-b495-49f0-8d1a-8a6ac4a02da7 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 09 00:00:18 user nova-compute[75045]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 09 00:00:18 user nova-compute[75045]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75045) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 09 00:00:18 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f122b8e-b495-49f0-8d1a-8a6ac4a02da7 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dcbd911e-f385-4ed6-b8a4-383b3b56cf7d', 0)] {{(pid=75045) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 09 00:00:18 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:00:18 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-e20e57ee-0bba-495b-852c-db11db09f604 req-5d4cf5c2-fc86-44e4-a427-32af44284c5e service nova] Releasing lock "refresh_cache-df16d913-9985-415f-aedc-14f2ca5bcf13" {{(pid=75045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 00:00:18 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:00:18 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[174554d8-7c97-40db-ab1b-49e286ed341b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dcbd911e-f385-4ed6-b8a4-383b3b56cf7d\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:00:19 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:00:19 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:00:19 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f4ee65b-2346-4a2f-9b17-442bc64856cb]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcbd911e-f385-4ed6-b8a4-383b3b56cf7d (non-flash)\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:00:19 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f122b8e-b495-49f0-8d1a-8a6ac4a02da7 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcbd911e-f385-4ed6-b8a4-383b3b56cf7d (non-flash)
Nov 09 00:00:19 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 00:00:19 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f122b8e-b495-49f0-8d1a-8a6ac4a02da7 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcbd911e-f385-4ed6-b8a4-383b3b56cf7d (non-flash)
Nov 09 00:00:19 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 00:00:19 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f122b8e-b495-49f0-8d1a-8a6ac4a02da7 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1b68267c70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dcbd911e-f385-4ed6-b8a4-383b3b56cf7d'): ({'sdc'}, set())}) {{(pid=75045) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 09 00:00:19 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-3f122b8e-b495-49f0-8d1a-8a6ac4a02da7 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Removing single pathed devices sdc {{(pid=75045) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 09 00:00:19 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:00:19 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:00:19 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[56a55974-5320-4c00-bcaa-348be6edb6ff]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:00:19 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:00:19 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:00:19 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[909b1626-eea5-4d0d-bb68-4ce6231c97a8]: (4, ('ok\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:00:19 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-3f122b8e-b495-49f0-8d1a-8a6ac4a02da7 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Flushing IO for device /dev/sdc {{(pid=75045) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 09 00:00:19 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:00:19 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.016s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:00:19 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1cf05d9-f15e-4eff-8367-71ebf0c723df]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:00:19 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-3f122b8e-b495-49f0-8d1a-8a6ac4a02da7 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75045) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 09 00:00:19 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:00:19 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.063s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:00:19 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e5ae523-07ff-4849-be13-742c277ae035]: (4, ('1', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:00:19 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-3f122b8e-b495-49f0-8d1a-8a6ac4a02da7 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75045) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 09 00:00:19 user nova-compute[75045]: DEBUG os_brick.initiator.linuxscsi [None req-3f122b8e-b495-49f0-8d1a-8a6ac4a02da7 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] SCSI volumes sdc have been removed. {{(pid=75045) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 09 00:00:19 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f122b8e-b495-49f0-8d1a-8a6ac4a02da7 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dcbd911e-f385-4ed6-b8a4-383b3b56cf7d')] {{(pid=75045) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 09 00:00:19 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dcbd911e-f385-4ed6-b8a4-383b3b56cf7d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:00:19 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dcbd911e-f385-4ed6-b8a4-383b3b56cf7d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:00:19 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ebe7971-603d-4dde-a9ea-ff1f134c4497]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:00:19 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f122b8e-b495-49f0-8d1a-8a6ac4a02da7 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 00:00:19 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dcbd911e-f385-4ed6-b8a4-383b3b56cf7d -p 172.16.0.220:3260 --logout {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:00:19 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dcbd911e-f385-4ed6-b8a4-383b3b56cf7d -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:00:19 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[d367ad95-5c68-4c91-9159-a40036cf77c8]: (4, ('Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:dcbd911e-f385-4ed6-b8a4-383b3b56cf7d, portal: 172.16.0.220,3260]\nLogout of [sid: 51, target: iqn.2010-10.org.openstack:dcbd911e-f385-4ed6-b8a4-383b3b56cf7d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:00:19 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f122b8e-b495-49f0-8d1a-8a6ac4a02da7 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:dcbd911e-f385-4ed6-b8a4-383b3b56cf7d, portal: 172.16.0.220,3260]
Nov 09 00:00:19 user nova-compute[75045]: Logout of [sid: 51, target: iqn.2010-10.org.openstack:dcbd911e-f385-4ed6-b8a4-383b3b56cf7d, portal: 172.16.0.220,3260] successful.
Nov 09 00:00:19 user nova-compute[75045]:  stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 00:00:19 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dcbd911e-f385-4ed6-b8a4-383b3b56cf7d -p 172.16.0.220:3260 --op delete {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:00:19 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dcbd911e-f385-4ed6-b8a4-383b3b56cf7d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=86132) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:00:19 user nova-compute[75045]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bcd869a-3676-4394-8cc5-b39f96cdaae4]: (4, ('', '')) {{(pid=86132) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:00:19 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f122b8e-b495-49f0-8d1a-8a6ac4a02da7 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75045) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 00:00:19 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.base [None req-3f122b8e-b495-49f0-8d1a-8a6ac4a02da7 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.339s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 00:00:19 user nova-compute[75045]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f122b8e-b495-49f0-8d1a-8a6ac4a02da7 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] <== disconnect_volume: return (341ms) None {{(pid=75045) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 00:00:19 user nova-compute[75045]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3f122b8e-b495-49f0-8d1a-8a6ac4a02da7 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] [instance: df16d913-9985-415f-aedc-14f2ca5bcf13] Disconnected iSCSI Volume {{(pid=75045) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 09 00:00:19 user nova-compute[75045]: INFO nova.virt.libvirt.driver [None req-3f122b8e-b495-49f0-8d1a-8a6ac4a02da7 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] [instance: df16d913-9985-415f-aedc-14f2ca5bcf13] Deleting instance files /opt/stack/data/nova/instances/df16d913-9985-415f-aedc-14f2ca5bcf13_del
Nov 09 00:00:19 user nova-compute[75045]: INFO nova.virt.libvirt.driver [None req-3f122b8e-b495-49f0-8d1a-8a6ac4a02da7 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] [instance: df16d913-9985-415f-aedc-14f2ca5bcf13] Deletion of /opt/stack/data/nova/instances/df16d913-9985-415f-aedc-14f2ca5bcf13_del complete
Nov 09 00:00:19 user nova-compute[75045]: INFO nova.compute.manager [None req-3f122b8e-b495-49f0-8d1a-8a6ac4a02da7 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] [instance: df16d913-9985-415f-aedc-14f2ca5bcf13] Took 1.29 seconds to destroy the instance on the hypervisor.
Nov 09 00:00:19 user nova-compute[75045]: DEBUG oslo.service.loopingcall [None req-3f122b8e-b495-49f0-8d1a-8a6ac4a02da7 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75045) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 09 00:00:19 user nova-compute[75045]: DEBUG nova.compute.manager [-] [instance: df16d913-9985-415f-aedc-14f2ca5bcf13] Deallocating network for instance {{(pid=75045) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 09 00:00:19 user nova-compute[75045]: DEBUG nova.network.neutron [-] [instance: df16d913-9985-415f-aedc-14f2ca5bcf13] deallocate_for_instance() {{(pid=75045) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 09 00:00:19 user nova-compute[75045]: DEBUG nova.network.neutron [-] [instance: df16d913-9985-415f-aedc-14f2ca5bcf13] Updating instance_info_cache with network_info: [] {{(pid=75045) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 00:00:19 user nova-compute[75045]: INFO nova.compute.manager [-] [instance: df16d913-9985-415f-aedc-14f2ca5bcf13] Took 0.44 seconds to deallocate network for instance.
Nov 09 00:00:20 user nova-compute[75045]: DEBUG nova.compute.manager [req-9cf2397c-e081-4b9b-b41b-60ff3fe2c5d7 req-481e2854-5f3f-4c49-bb42-95d75b0e55a6 service nova] [instance: df16d913-9985-415f-aedc-14f2ca5bcf13] Received event network-vif-plugged-c762a745-51d7-4d4e-bdc5-c962aec66b02 {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 00:00:20 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-9cf2397c-e081-4b9b-b41b-60ff3fe2c5d7 req-481e2854-5f3f-4c49-bb42-95d75b0e55a6 service nova] Acquiring lock "df16d913-9985-415f-aedc-14f2ca5bcf13-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:00:20 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-9cf2397c-e081-4b9b-b41b-60ff3fe2c5d7 req-481e2854-5f3f-4c49-bb42-95d75b0e55a6 service nova] Lock "df16d913-9985-415f-aedc-14f2ca5bcf13-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:00:20 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-9cf2397c-e081-4b9b-b41b-60ff3fe2c5d7 req-481e2854-5f3f-4c49-bb42-95d75b0e55a6 service nova] Lock "df16d913-9985-415f-aedc-14f2ca5bcf13-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:00:20 user nova-compute[75045]: DEBUG nova.compute.manager [req-9cf2397c-e081-4b9b-b41b-60ff3fe2c5d7 req-481e2854-5f3f-4c49-bb42-95d75b0e55a6 service nova] [instance: df16d913-9985-415f-aedc-14f2ca5bcf13] No waiting events found dispatching network-vif-plugged-c762a745-51d7-4d4e-bdc5-c962aec66b02 {{(pid=75045) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 00:00:20 user nova-compute[75045]: WARNING nova.compute.manager [req-9cf2397c-e081-4b9b-b41b-60ff3fe2c5d7 req-481e2854-5f3f-4c49-bb42-95d75b0e55a6 service nova] [instance: df16d913-9985-415f-aedc-14f2ca5bcf13] Received unexpected event network-vif-plugged-c762a745-51d7-4d4e-bdc5-c962aec66b02 for instance with vm_state active and task_state deleting.
Nov 09 00:00:20 user nova-compute[75045]: DEBUG nova.compute.manager [req-9cf2397c-e081-4b9b-b41b-60ff3fe2c5d7 req-481e2854-5f3f-4c49-bb42-95d75b0e55a6 service nova] [instance: df16d913-9985-415f-aedc-14f2ca5bcf13] Received event network-vif-deleted-c762a745-51d7-4d4e-bdc5-c962aec66b02 {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 00:00:20 user nova-compute[75045]: INFO nova.compute.manager [None req-3f122b8e-b495-49f0-8d1a-8a6ac4a02da7 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] [instance: df16d913-9985-415f-aedc-14f2ca5bcf13] Took 1.06 seconds to detach 1 volumes for instance.
Nov 09 00:00:20 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-3f122b8e-b495-49f0-8d1a-8a6ac4a02da7 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:00:20 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-3f122b8e-b495-49f0-8d1a-8a6ac4a02da7 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:00:21 user nova-compute[75045]: DEBUG nova.compute.provider_tree [None req-3f122b8e-b495-49f0-8d1a-8a6ac4a02da7 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Inventory has not changed in ProviderTree for provider: 62ba5f85-c74d-4b58-986e-d4197e813fd7 {{(pid=75045) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 00:00:21 user nova-compute[75045]: DEBUG nova.scheduler.client.report [None req-3f122b8e-b495-49f0-8d1a-8a6ac4a02da7 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Inventory has not changed for provider 62ba5f85-c74d-4b58-986e-d4197e813fd7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75045) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 00:00:21 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-3f122b8e-b495-49f0-8d1a-8a6ac4a02da7 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.157s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:00:21 user nova-compute[75045]: INFO nova.scheduler.client.report [None req-3f122b8e-b495-49f0-8d1a-8a6ac4a02da7 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Deleted allocations for instance df16d913-9985-415f-aedc-14f2ca5bcf13
Nov 09 00:00:21 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-3f122b8e-b495-49f0-8d1a-8a6ac4a02da7 tempest-TestVolumeBootPattern-650796844 tempest-TestVolumeBootPattern-650796844-project-member] Lock "df16d913-9985-415f-aedc-14f2ca5bcf13" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.205s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:00:22 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager.update_available_resource {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 00:00:23 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:00:23 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:00:23 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:00:23 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Auditing locally available compute resources for user (node: user) {{(pid=75045) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 09 00:00:23 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d9a47ed-6aa3-468f-b106-46b60cd27a46/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:00:23 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d9a47ed-6aa3-468f-b106-46b60cd27a46/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:00:23 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d9a47ed-6aa3-468f-b106-46b60cd27a46/disk --force-share --output=json {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:00:23 user nova-compute[75045]: DEBUG oslo_concurrency.processutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d9a47ed-6aa3-468f-b106-46b60cd27a46/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75045) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:00:23 user nova-compute[75045]: WARNING nova.virt.libvirt.driver [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 00:00:23 user nova-compute[75045]: WARNING nova.virt.libvirt.driver [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 00:00:23 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Hypervisor/Node resource view: name=user free_ram=8867MB free_disk=24.890350341796875GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75045) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 09 00:00:23 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:00:23 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:00:23 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:00:23 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Instance 8d9a47ed-6aa3-468f-b106-46b60cd27a46 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75045) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 00:00:23 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75045) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 09 00:00:23 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75045) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 09 00:00:24 user nova-compute[75045]: DEBUG nova.compute.provider_tree [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Inventory has not changed in ProviderTree for provider: 62ba5f85-c74d-4b58-986e-d4197e813fd7 {{(pid=75045) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 00:00:24 user nova-compute[75045]: DEBUG nova.scheduler.client.report [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Inventory has not changed for provider 62ba5f85-c74d-4b58-986e-d4197e813fd7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75045) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 00:00:24 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Compute_service record updated for user:user {{(pid=75045) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 09 00:00:24 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.199s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:00:28 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:00:33 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:00:38 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 00:00:38 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:00:38 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75045) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 09 00:00:38 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75045) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 09 00:00:38 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75045) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 09 00:00:38 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:00:40 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-414c8e14-eef7-4757-a47b-972934cb9f80 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] Acquiring lock "8d9a47ed-6aa3-468f-b106-46b60cd27a46" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:00:40 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-414c8e14-eef7-4757-a47b-972934cb9f80 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] Lock "8d9a47ed-6aa3-468f-b106-46b60cd27a46" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:00:40 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-414c8e14-eef7-4757-a47b-972934cb9f80 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] Acquiring lock "8d9a47ed-6aa3-468f-b106-46b60cd27a46-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:00:40 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-414c8e14-eef7-4757-a47b-972934cb9f80 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] Lock "8d9a47ed-6aa3-468f-b106-46b60cd27a46-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:00:40 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-414c8e14-eef7-4757-a47b-972934cb9f80 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] Lock "8d9a47ed-6aa3-468f-b106-46b60cd27a46-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:00:40 user nova-compute[75045]: INFO nova.compute.manager [None req-414c8e14-eef7-4757-a47b-972934cb9f80 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] [instance: 8d9a47ed-6aa3-468f-b106-46b60cd27a46] Terminating instance
Nov 09 00:00:40 user nova-compute[75045]: DEBUG nova.compute.manager [None req-414c8e14-eef7-4757-a47b-972934cb9f80 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] [instance: 8d9a47ed-6aa3-468f-b106-46b60cd27a46] Start destroying the instance on the hypervisor. {{(pid=75045) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 09 00:00:40 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:00:40 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:00:40 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:00:40 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:00:40 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:00:40 user nova-compute[75045]: DEBUG nova.compute.manager [req-b1066fe5-d062-4fb6-b746-bf5948833ba0 req-0195d046-5a82-4065-ae72-b120c4d3e4ae service nova] [instance: 8d9a47ed-6aa3-468f-b106-46b60cd27a46] Received event network-vif-unplugged-26db8f3f-0cb5-474c-9499-14ece10e73e3 {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 00:00:40 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-b1066fe5-d062-4fb6-b746-bf5948833ba0 req-0195d046-5a82-4065-ae72-b120c4d3e4ae service nova] Acquiring lock "8d9a47ed-6aa3-468f-b106-46b60cd27a46-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:00:40 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-b1066fe5-d062-4fb6-b746-bf5948833ba0 req-0195d046-5a82-4065-ae72-b120c4d3e4ae service nova] Lock "8d9a47ed-6aa3-468f-b106-46b60cd27a46-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:00:40 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-b1066fe5-d062-4fb6-b746-bf5948833ba0 req-0195d046-5a82-4065-ae72-b120c4d3e4ae service nova] Lock "8d9a47ed-6aa3-468f-b106-46b60cd27a46-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:00:40 user nova-compute[75045]: DEBUG nova.compute.manager [req-b1066fe5-d062-4fb6-b746-bf5948833ba0 req-0195d046-5a82-4065-ae72-b120c4d3e4ae service nova] [instance: 8d9a47ed-6aa3-468f-b106-46b60cd27a46] No waiting events found dispatching network-vif-unplugged-26db8f3f-0cb5-474c-9499-14ece10e73e3 {{(pid=75045) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 00:00:40 user nova-compute[75045]: DEBUG nova.compute.manager [req-b1066fe5-d062-4fb6-b746-bf5948833ba0 req-0195d046-5a82-4065-ae72-b120c4d3e4ae service nova] [instance: 8d9a47ed-6aa3-468f-b106-46b60cd27a46] Received event network-vif-unplugged-26db8f3f-0cb5-474c-9499-14ece10e73e3 for instance with task_state deleting. {{(pid=75045) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 09 00:00:41 user nova-compute[75045]: INFO nova.virt.libvirt.driver [-] [instance: 8d9a47ed-6aa3-468f-b106-46b60cd27a46] Instance destroyed successfully.
Nov 09 00:00:41 user nova-compute[75045]: DEBUG nova.objects.instance [None req-414c8e14-eef7-4757-a47b-972934cb9f80 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] Lazy-loading 'resources' on Instance uuid 8d9a47ed-6aa3-468f-b106-46b60cd27a46 {{(pid=75045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 00:00:41 user nova-compute[75045]: DEBUG nova.virt.libvirt.vif [None req-414c8e14-eef7-4757-a47b-972934cb9f80 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T23:55:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-995750485',display_name='tempest-TestMinimumBasicScenario-server-995750485',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-995750485',id=51,image_ref='e9a408d2-654c-4686-a04d-a5bce3fa0668',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLsl2uyN7Jq9gVsEB++YEMgh7/QXDixJkbRJ9YT7eeiV8fPimhSb00+fgyaUjcwKXyno8lm9QP9R40mzt4cBHvMjx0tEf28AUzMlrAPp72Pva72DfgQ3b8K7fGRRmg4S4Q==',key_name='tempest-TestMinimumBasicScenario-419972175',keypairs=<?>,launch_index=0,launched_at=2023-11-08T23:55:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c4bfce59008d44fdb5ba91c70f1cf044',ramdisk_id='',reservation_id='r-pdpr1g7q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e9a408d2-654c-4686-a04d-a5bce3fa0668',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1125576376',owner_user_name='tempest-TestMinimumBasicScenario-1125576376-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T23:57:54Z,user_data=None,user_id='4ed9cd91d0654f4aa4d620c9f0eb2766',uuid=8d9a47ed-6aa3-468f-b106-46b60cd27a46,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "26db8f3f-0cb5-474c-9499-14ece10e73e3", "address": "fa:16:3e:12:6c:30", "network": {"id": "fe5f7093-1cdd-465c-97f0-7d7b2dd1fa8a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1755065955-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4bfce59008d44fdb5ba91c70f1cf044", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26db8f3f-0c", "ovs_interfaceid": "26db8f3f-0cb5-474c-9499-14ece10e73e3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75045) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 09 00:00:41 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-414c8e14-eef7-4757-a47b-972934cb9f80 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] Converting VIF {"id": "26db8f3f-0cb5-474c-9499-14ece10e73e3", "address": "fa:16:3e:12:6c:30", "network": {"id": "fe5f7093-1cdd-465c-97f0-7d7b2dd1fa8a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1755065955-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4bfce59008d44fdb5ba91c70f1cf044", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26db8f3f-0c", "ovs_interfaceid": "26db8f3f-0cb5-474c-9499-14ece10e73e3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 00:00:41 user nova-compute[75045]: DEBUG nova.network.os_vif_util [None req-414c8e14-eef7-4757-a47b-972934cb9f80 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:12:6c:30,bridge_name='br-int',has_traffic_filtering=True,id=26db8f3f-0cb5-474c-9499-14ece10e73e3,network=Network(fe5f7093-1cdd-465c-97f0-7d7b2dd1fa8a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26db8f3f-0c') {{(pid=75045) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 00:00:41 user nova-compute[75045]: DEBUG os_vif [None req-414c8e14-eef7-4757-a47b-972934cb9f80 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:12:6c:30,bridge_name='br-int',has_traffic_filtering=True,id=26db8f3f-0cb5-474c-9499-14ece10e73e3,network=Network(fe5f7093-1cdd-465c-97f0-7d7b2dd1fa8a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26db8f3f-0c') {{(pid=75045) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 09 00:00:41 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:00:41 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap26db8f3f-0c, bridge=br-int, if_exists=True) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 00:00:41 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:00:41 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 00:00:41 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:00:41 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=91f5a5a1-5b02-4a1c-a36e-6416dc78a3a7) {{(pid=75045) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 00:00:41 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:00:41 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 00:00:41 user nova-compute[75045]: INFO os_vif [None req-414c8e14-eef7-4757-a47b-972934cb9f80 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:12:6c:30,bridge_name='br-int',has_traffic_filtering=True,id=26db8f3f-0cb5-474c-9499-14ece10e73e3,network=Network(fe5f7093-1cdd-465c-97f0-7d7b2dd1fa8a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26db8f3f-0c')
Nov 09 00:00:41 user nova-compute[75045]: INFO nova.virt.libvirt.driver [None req-414c8e14-eef7-4757-a47b-972934cb9f80 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] [instance: 8d9a47ed-6aa3-468f-b106-46b60cd27a46] Deleting instance files /opt/stack/data/nova/instances/8d9a47ed-6aa3-468f-b106-46b60cd27a46_del
Nov 09 00:00:41 user nova-compute[75045]: INFO nova.virt.libvirt.driver [None req-414c8e14-eef7-4757-a47b-972934cb9f80 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] [instance: 8d9a47ed-6aa3-468f-b106-46b60cd27a46] Deletion of /opt/stack/data/nova/instances/8d9a47ed-6aa3-468f-b106-46b60cd27a46_del complete
Nov 09 00:00:41 user nova-compute[75045]: INFO nova.compute.manager [None req-414c8e14-eef7-4757-a47b-972934cb9f80 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] [instance: 8d9a47ed-6aa3-468f-b106-46b60cd27a46] Took 0.87 seconds to destroy the instance on the hypervisor.
Nov 09 00:00:41 user nova-compute[75045]: DEBUG oslo.service.loopingcall [None req-414c8e14-eef7-4757-a47b-972934cb9f80 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75045) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 09 00:00:41 user nova-compute[75045]: DEBUG nova.compute.manager [-] [instance: 8d9a47ed-6aa3-468f-b106-46b60cd27a46] Deallocating network for instance {{(pid=75045) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 09 00:00:41 user nova-compute[75045]: DEBUG nova.network.neutron [-] [instance: 8d9a47ed-6aa3-468f-b106-46b60cd27a46] deallocate_for_instance() {{(pid=75045) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 09 00:00:41 user nova-compute[75045]: DEBUG nova.network.neutron [-] [instance: 8d9a47ed-6aa3-468f-b106-46b60cd27a46] Updating instance_info_cache with network_info: [] {{(pid=75045) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 00:00:42 user nova-compute[75045]: INFO nova.compute.manager [-] [instance: 8d9a47ed-6aa3-468f-b106-46b60cd27a46] Took 0.53 seconds to deallocate network for instance.
Nov 09 00:00:42 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-414c8e14-eef7-4757-a47b-972934cb9f80 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:00:42 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-414c8e14-eef7-4757-a47b-972934cb9f80 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:00:42 user nova-compute[75045]: DEBUG nova.compute.provider_tree [None req-414c8e14-eef7-4757-a47b-972934cb9f80 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] Inventory has not changed in ProviderTree for provider: 62ba5f85-c74d-4b58-986e-d4197e813fd7 {{(pid=75045) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 00:00:42 user nova-compute[75045]: DEBUG nova.scheduler.client.report [None req-414c8e14-eef7-4757-a47b-972934cb9f80 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] Inventory has not changed for provider 62ba5f85-c74d-4b58-986e-d4197e813fd7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75045) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 00:00:42 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-414c8e14-eef7-4757-a47b-972934cb9f80 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.106s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:00:42 user nova-compute[75045]: INFO nova.scheduler.client.report [None req-414c8e14-eef7-4757-a47b-972934cb9f80 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] Deleted allocations for instance 8d9a47ed-6aa3-468f-b106-46b60cd27a46
Nov 09 00:00:42 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-414c8e14-eef7-4757-a47b-972934cb9f80 tempest-TestMinimumBasicScenario-1125576376 tempest-TestMinimumBasicScenario-1125576376-project-member] Lock "8d9a47ed-6aa3-468f-b106-46b60cd27a46" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.722s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:00:42 user nova-compute[75045]: DEBUG nova.compute.manager [req-1436cc4c-dd32-47e6-9f67-770e2a5594f2 req-ebe7c298-60d1-438f-b9e1-73c72831e5eb service nova] [instance: 8d9a47ed-6aa3-468f-b106-46b60cd27a46] Received event network-vif-plugged-26db8f3f-0cb5-474c-9499-14ece10e73e3 {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 00:00:42 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-1436cc4c-dd32-47e6-9f67-770e2a5594f2 req-ebe7c298-60d1-438f-b9e1-73c72831e5eb service nova] Acquiring lock "8d9a47ed-6aa3-468f-b106-46b60cd27a46-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:00:42 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-1436cc4c-dd32-47e6-9f67-770e2a5594f2 req-ebe7c298-60d1-438f-b9e1-73c72831e5eb service nova] Lock "8d9a47ed-6aa3-468f-b106-46b60cd27a46-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:00:42 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [req-1436cc4c-dd32-47e6-9f67-770e2a5594f2 req-ebe7c298-60d1-438f-b9e1-73c72831e5eb service nova] Lock "8d9a47ed-6aa3-468f-b106-46b60cd27a46-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:00:42 user nova-compute[75045]: DEBUG nova.compute.manager [req-1436cc4c-dd32-47e6-9f67-770e2a5594f2 req-ebe7c298-60d1-438f-b9e1-73c72831e5eb service nova] [instance: 8d9a47ed-6aa3-468f-b106-46b60cd27a46] No waiting events found dispatching network-vif-plugged-26db8f3f-0cb5-474c-9499-14ece10e73e3 {{(pid=75045) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 00:00:42 user nova-compute[75045]: WARNING nova.compute.manager [req-1436cc4c-dd32-47e6-9f67-770e2a5594f2 req-ebe7c298-60d1-438f-b9e1-73c72831e5eb service nova] [instance: 8d9a47ed-6aa3-468f-b106-46b60cd27a46] Received unexpected event network-vif-plugged-26db8f3f-0cb5-474c-9499-14ece10e73e3 for instance with vm_state deleted and task_state None.
Nov 09 00:00:42 user nova-compute[75045]: DEBUG nova.compute.manager [req-1436cc4c-dd32-47e6-9f67-770e2a5594f2 req-ebe7c298-60d1-438f-b9e1-73c72831e5eb service nova] [instance: 8d9a47ed-6aa3-468f-b106-46b60cd27a46] Received event network-vif-deleted-26db8f3f-0cb5-474c-9499-14ece10e73e3 {{(pid=75045) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 00:00:46 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:00:51 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 00:00:56 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 00:01:01 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 00:01:06 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:01:07 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 00:01:08 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 00:01:08 user nova-compute[75045]: DEBUG nova.compute.manager [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75045) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 09 00:01:10 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 00:01:11 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 00:01:11 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 00:01:11 user nova-compute[75045]: DEBUG nova.compute.manager [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Starting heal instance info cache {{(pid=75045) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 09 00:01:11 user nova-compute[75045]: DEBUG nova.compute.manager [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Rebuilding the list of instances to heal {{(pid=75045) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 09 00:01:11 user nova-compute[75045]: DEBUG nova.compute.manager [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Didn't find any instances for network info cache update. {{(pid=75045) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 09 00:01:11 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 00:01:13 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 00:01:14 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 00:01:16 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:01:17 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 00:01:21 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 00:01:21 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:01:23 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager.update_available_resource {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 00:01:23 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:01:23 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:01:23 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:01:23 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Auditing locally available compute resources for user (node: user) {{(pid=75045) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 09 00:01:24 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:01:24 user nova-compute[75045]: WARNING nova.virt.libvirt.driver [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 00:01:24 user nova-compute[75045]: WARNING nova.virt.libvirt.driver [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 00:01:24 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Hypervisor/Node resource view: name=user free_ram=9064MB free_disk=24.91632843017578GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75045) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 09 00:01:24 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:01:24 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:01:24 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75045) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 09 00:01:24 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75045) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 09 00:01:24 user nova-compute[75045]: DEBUG nova.compute.provider_tree [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Inventory has not changed in ProviderTree for provider: 62ba5f85-c74d-4b58-986e-d4197e813fd7 {{(pid=75045) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 00:01:24 user nova-compute[75045]: DEBUG nova.scheduler.client.report [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Inventory has not changed for provider 62ba5f85-c74d-4b58-986e-d4197e813fd7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75045) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 00:01:24 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Compute_service record updated for user:user {{(pid=75045) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 09 00:01:24 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.142s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:01:26 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:01:27 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:01:31 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:01:33 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:01:36 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:01:36 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:01:41 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:01:46 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:01:51 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:01:56 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:02:01 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:02:06 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:02:06 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 00:02:10 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 00:02:10 user nova-compute[75045]: DEBUG nova.compute.manager [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75045) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 09 00:02:11 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:02:11 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 00:02:11 user nova-compute[75045]: DEBUG nova.compute.manager [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Starting heal instance info cache {{(pid=75045) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 09 00:02:11 user nova-compute[75045]: DEBUG nova.compute.manager [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Rebuilding the list of instances to heal {{(pid=75045) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 09 00:02:11 user nova-compute[75045]: DEBUG nova.compute.manager [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Didn't find any instances for network info cache update. {{(pid=75045) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 09 00:02:11 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 00:02:12 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 00:02:14 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 00:02:15 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 00:02:16 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 00:02:17 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 00:02:20 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 00:02:20 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 00:02:21 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:02:23 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 00:02:23 user nova-compute[75045]: DEBUG nova.compute.manager [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Cleaning up deleted instances {{(pid=75045) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 09 00:02:24 user nova-compute[75045]: DEBUG nova.compute.manager [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] There are 0 instances to clean {{(pid=75045) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 09 00:02:24 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager.update_available_resource {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 00:02:25 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:02:25 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:02:25 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:02:25 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Auditing locally available compute resources for user (node: user) {{(pid=75045) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 09 00:02:25 user nova-compute[75045]: WARNING nova.virt.libvirt.driver [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 00:02:25 user nova-compute[75045]: WARNING nova.virt.libvirt.driver [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 00:02:25 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Hypervisor/Node resource view: name=user free_ram=9116MB free_disk=24.954421997070312GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75045) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 09 00:02:25 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:02:25 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:02:25 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75045) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 09 00:02:25 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75045) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 09 00:02:25 user nova-compute[75045]: DEBUG nova.scheduler.client.report [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Refreshing inventories for resource provider 62ba5f85-c74d-4b58-986e-d4197e813fd7 {{(pid=75045) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 09 00:02:25 user nova-compute[75045]: DEBUG nova.scheduler.client.report [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Updating ProviderTree inventory for provider 62ba5f85-c74d-4b58-986e-d4197e813fd7 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75045) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 09 00:02:25 user nova-compute[75045]: DEBUG nova.compute.provider_tree [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Updating inventory in ProviderTree for provider 62ba5f85-c74d-4b58-986e-d4197e813fd7 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75045) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 09 00:02:25 user nova-compute[75045]: DEBUG nova.scheduler.client.report [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Refreshing aggregate associations for resource provider 62ba5f85-c74d-4b58-986e-d4197e813fd7, aggregates: None {{(pid=75045) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 09 00:02:25 user nova-compute[75045]: DEBUG nova.scheduler.client.report [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Refreshing trait associations for resource provider 62ba5f85-c74d-4b58-986e-d4197e813fd7, traits: COMPUTE_STORAGE_BUS_SCSI,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_TRUSTED_CERTS,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_VIRTIO,HW_CPU_X86_SSSE3,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_FDC,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_RESCUE_BFV,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSE2,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN {{(pid=75045) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 09 00:02:25 user nova-compute[75045]: DEBUG nova.compute.provider_tree [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Inventory has not changed in ProviderTree for provider: 62ba5f85-c74d-4b58-986e-d4197e813fd7 {{(pid=75045) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 00:02:25 user nova-compute[75045]: DEBUG nova.scheduler.client.report [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Inventory has not changed for provider 62ba5f85-c74d-4b58-986e-d4197e813fd7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75045) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 00:02:25 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Compute_service record updated for user:user {{(pid=75045) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 09 00:02:25 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.478s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:02:26 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:02:26 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 00:02:26 user nova-compute[75045]: DEBUG nova.compute.manager [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Cleaning up deleted instances with incomplete migration  {{(pid=75045) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 09 00:02:31 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:02:36 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 00:02:41 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 00:02:46 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:02:51 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:02:52 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._sync_power_states {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 00:02:56 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 00:02:56 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:02:56 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75045) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 09 00:02:56 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75045) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 09 00:02:56 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75045) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 09 00:02:56 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:03:01 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:03:06 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:03:06 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 00:03:10 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 00:03:10 user nova-compute[75045]: DEBUG nova.compute.manager [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75045) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 09 00:03:11 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 00:03:11 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 00:03:11 user nova-compute[75045]: DEBUG nova.compute.manager [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Starting heal instance info cache {{(pid=75045) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 09 00:03:11 user nova-compute[75045]: DEBUG nova.compute.manager [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Rebuilding the list of instances to heal {{(pid=75045) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 09 00:03:11 user nova-compute[75045]: DEBUG nova.compute.manager [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Didn't find any instances for network info cache update. {{(pid=75045) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 09 00:03:12 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 00:03:14 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 00:03:14 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 00:03:16 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 00:03:16 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:03:16 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75045) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 09 00:03:16 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75045) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 09 00:03:16 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75045) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 09 00:03:16 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:03:16 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 00:03:19 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 00:03:21 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:03:24 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager.update_available_resource {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 00:03:24 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:03:24 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:03:24 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:03:24 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Auditing locally available compute resources for user (node: user) {{(pid=75045) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 09 00:03:25 user nova-compute[75045]: WARNING nova.virt.libvirt.driver [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 00:03:25 user nova-compute[75045]: WARNING nova.virt.libvirt.driver [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 00:03:25 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Hypervisor/Node resource view: name=user free_ram=9111MB free_disk=24.937591552734375GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75045) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 09 00:03:25 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:03:25 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:03:25 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75045) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 09 00:03:25 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75045) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 09 00:03:25 user nova-compute[75045]: DEBUG nova.compute.provider_tree [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Inventory has not changed in ProviderTree for provider: 62ba5f85-c74d-4b58-986e-d4197e813fd7 {{(pid=75045) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 00:03:25 user nova-compute[75045]: DEBUG nova.scheduler.client.report [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Inventory has not changed for provider 62ba5f85-c74d-4b58-986e-d4197e813fd7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75045) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 00:03:25 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Compute_service record updated for user:user {{(pid=75045) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 09 00:03:25 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.118s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:03:26 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:03:31 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:03:36 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:03:41 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 00:03:46 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:03:51 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:03:56 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:04:01 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:04:06 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:04:09 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 00:04:11 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:04:12 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 00:04:12 user nova-compute[75045]: DEBUG nova.compute.manager [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Starting heal instance info cache {{(pid=75045) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 09 00:04:12 user nova-compute[75045]: DEBUG nova.compute.manager [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Rebuilding the list of instances to heal {{(pid=75045) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 09 00:04:12 user nova-compute[75045]: DEBUG nova.compute.manager [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Didn't find any instances for network info cache update. {{(pid=75045) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 09 00:04:12 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 00:04:12 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 00:04:12 user nova-compute[75045]: DEBUG nova.compute.manager [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75045) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 09 00:04:15 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 00:04:15 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 00:04:16 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:04:17 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 00:04:19 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 00:04:21 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 00:04:21 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 00:04:25 user nova-compute[75045]: DEBUG oslo_service.periodic_task [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Running periodic task ComputeManager.update_available_resource {{(pid=75045) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 00:04:25 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:04:25 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:04:25 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:04:25 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Auditing locally available compute resources for user (node: user) {{(pid=75045) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 09 00:04:26 user nova-compute[75045]: WARNING nova.virt.libvirt.driver [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 00:04:26 user nova-compute[75045]: WARNING nova.virt.libvirt.driver [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 00:04:26 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Hypervisor/Node resource view: name=user free_ram=9141MB free_disk=24.92876434326172GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75045) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 09 00:04:26 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:04:26 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:04:26 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75045) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 09 00:04:26 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75045) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 09 00:04:26 user nova-compute[75045]: DEBUG nova.compute.provider_tree [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Inventory has not changed in ProviderTree for provider: 62ba5f85-c74d-4b58-986e-d4197e813fd7 {{(pid=75045) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 00:04:26 user nova-compute[75045]: DEBUG nova.scheduler.client.report [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Inventory has not changed for provider 62ba5f85-c74d-4b58-986e-d4197e813fd7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75045) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 00:04:26 user nova-compute[75045]: DEBUG nova.compute.resource_tracker [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Compute_service record updated for user:user {{(pid=75045) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 09 00:04:26 user nova-compute[75045]: DEBUG oslo_concurrency.lockutils [None req-2bf17c52-07c3-472e-9ee1-8d998c94457b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.112s {{(pid=75045) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:04:26 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 00:04:27 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:04:31 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:04:36 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:04:41 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:04:46 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:04:51 user nova-compute[75045]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75045) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}